== sanity test 398b: DIO and buffer IO race ============== 15:52:03 (1790106723) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 4.28161 s, 11.8 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179163: Tue Sep 22 15:53:36 2026 read: IOPS=19, BW=78.3KiB/s (80.2kB/s)(5992KiB/76506msec) clat (usec): min=46, max=650617, avg=28410.74, stdev=23913.58 lat (usec): min=47, max=650620, avg=28412.05, stdev=23913.60 clat percentiles (usec): | 1.00th=[ 52], 5.00th=[ 8029], 10.00th=[ 11076], 20.00th=[ 14746], | 30.00th=[ 17695], 40.00th=[ 20841], 50.00th=[ 24773], 60.00th=[ 28705], | 70.00th=[ 33162], 80.00th=[ 38536], 90.00th=[ 50070], 95.00th=[ 62129], | 99.00th=[ 88605], 99.50th=[102237], 99.90th=[173016], 99.95th=[650118], | 99.99th=[650118] bw ( KiB/s): min= 31, max= 144, per=25.77%, avg=78.33, stdev=22.38, samples=150 iops : min= 7, max= 36, avg=18.96, stdev= 5.65, samples=150 write: IOPS=20, BW=82.3KiB/s (84.3kB/s)(6296KiB/76506msec); 0 zone resets clat (usec): min=730, max=183389, avg=21463.91, stdev=22082.86 lat (usec): min=731, max=183389, avg=21466.44, stdev=22083.10 clat percentiles (usec): | 1.00th=[ 988], 5.00th=[ 1156], 10.00th=[ 1385], 20.00th=[ 2409], | 30.00th=[ 4178], 40.00th=[ 9503], 50.00th=[ 15270], 60.00th=[ 21103], | 70.00th=[ 27395], 80.00th=[ 37487], 90.00th=[ 52167], 95.00th=[ 64750], | 99.00th=[ 89654], 99.50th=[109577], 99.90th=[147850], 99.95th=[183501], | 99.99th=[183501] bw ( KiB/s): min= 15, max= 167, per=25.91%, avg=82.39, stdev=27.73, samples=150 iops : min= 3, max= 41, avg=19.99, stdev= 6.97, samples=150 lat (usec) : 50=0.29%, 100=1.24%, 250=0.23%, 500=0.07%, 750=0.07% lat (usec) : 1000=0.55% lat (msec) : 2=7.91%, 4=6.67%, 10=7.49%, 20=23.40%, 50=41.47% lat (msec) : 100=9.96%, 250=0.62%, 750=0.03% cpu : usr=0.09%, sys=8.15%, ctx=6711, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179164: Tue Sep 22 15:53:36 2026 read: IOPS=18, BW=75.9KiB/s (77.7kB/s)(5940KiB/78298msec) clat (usec): min=36, max=554047, avg=28574.72, stdev=23164.18 lat (usec): min=37, max=554049, avg=28577.83, stdev=23163.37 clat percentiles (usec): | 1.00th=[ 53], 5.00th=[ 8455], 10.00th=[ 10945], 20.00th=[ 14615], | 30.00th=[ 17695], 40.00th=[ 20579], 50.00th=[ 23987], 60.00th=[ 28705], | 70.00th=[ 33817], 80.00th=[ 39584], 90.00th=[ 50070], 95.00th=[ 58983], | 99.00th=[ 99091], 99.50th=[113771], 99.90th=[219153], 99.95th=[557843], | 99.99th=[557843] bw ( KiB/s): min= 23, max= 133, per=24.97%, avg=75.92, stdev=22.63, samples=154 iops : min= 5, max= 33, avg=18.36, stdev= 5.69, samples=154 write: IOPS=20, BW=81.1KiB/s (83.0kB/s)(6348KiB/78298msec); 0 zone resets clat (usec): min=787, max=218106, avg=22457.07, stdev=22400.07 lat (usec): min=788, max=218106, avg=22460.17, stdev=22399.34 clat percentiles (usec): | 1.00th=[ 947], 5.00th=[ 1156], 10.00th=[ 1385], 20.00th=[ 2442], | 30.00th=[ 4621], 40.00th=[ 10683], 50.00th=[ 16712], 60.00th=[ 22676], | 70.00th=[ 30540], 80.00th=[ 39584], 90.00th=[ 53216], 95.00th=[ 65799], | 99.00th=[ 92799], 99.50th=[107480], 99.90th=[124257], 99.95th=[219153], | 99.99th=[219153] bw ( KiB/s): min= 23, max= 152, per=25.43%, avg=80.86, stdev=26.66, samples=154 iops : min= 5, max= 38, avg=19.60, stdev= 6.69, samples=154 lat (usec) : 50=0.29%, 100=1.17%, 250=0.33%, 500=0.13%, 1000=0.68% lat (msec) : 2=7.94%, 4=5.70%, 10=7.62%, 20=23.21%, 50=42.29% lat (msec) : 100=9.90%, 250=0.72%, 750=0.03% cpu : usr=0.08%, sys=7.96%, ctx=6770, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179165: Tue Sep 22 15:53:36 2026 read: IOPS=19, BW=76.4KiB/s (78.2kB/s)(6028KiB/78933msec) clat (usec): min=35, max=174108, avg=27926.37, stdev=18337.72 lat (usec): min=36, max=174109, avg=27927.81, stdev=18337.48 clat percentiles (usec): | 1.00th=[ 57], 5.00th=[ 8291], 10.00th=[ 10945], 20.00th=[ 14091], | 30.00th=[ 17171], 40.00th=[ 20579], 50.00th=[ 24511], 60.00th=[ 28181], | 70.00th=[ 32637], 80.00th=[ 38536], 90.00th=[ 49546], 95.00th=[ 60556], | 99.00th=[ 92799], 99.50th=[109577], 99.90th=[170918], 99.95th=[175113], | 99.99th=[175113] bw ( KiB/s): min= 7, max= 152, per=25.04%, avg=76.12, stdev=25.80, samples=155 iops : min= 1, max= 38, avg=18.41, stdev= 6.48, samples=155 write: IOPS=19, BW=79.3KiB/s (81.2kB/s)(6260KiB/78933msec); 0 zone resets clat (usec): min=688, max=605779, avg=23423.61, stdev=26512.18 lat (usec): min=688, max=605783, avg=23426.01, stdev=26512.52 clat percentiles (usec): | 1.00th=[ 955], 5.00th=[ 1172], 10.00th=[ 1467], 20.00th=[ 2769], | 30.00th=[ 5866], 40.00th=[ 12518], 50.00th=[ 18220], 60.00th=[ 24249], | 70.00th=[ 30016], 80.00th=[ 39584], 90.00th=[ 53216], 95.00th=[ 64750], | 99.00th=[ 99091], 99.50th=[116917], 99.90th=[132645], 99.95th=[608175], | 99.99th=[608175] bw ( KiB/s): min= 15, max= 173, per=24.85%, avg=79.02, stdev=24.17, samples=155 iops : min= 3, max= 43, avg=19.14, stdev= 6.08, samples=155 lat (usec) : 50=0.29%, 100=1.04%, 250=0.20%, 500=0.03%, 750=0.07% lat (usec) : 1000=0.88% lat (msec) : 2=6.71%, 4=5.27%, 10=7.98%, 20=23.50%, 50=43.00% lat (msec) : 100=10.25%, 250=0.75%, 750=0.03% cpu : usr=0.10%, sys=7.90%, ctx=6902, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179166: Tue Sep 22 15:53:36 2026 read: IOPS=19, BW=77.3KiB/s (79.2kB/s)(6052KiB/78267msec) clat (usec): min=33, max=157899, avg=28003.51, stdev=17726.56 lat (usec): min=33, max=157900, avg=28004.71, stdev=17726.42 clat percentiles (usec): | 1.00th=[ 50], 5.00th=[ 1385], 10.00th=[ 11731], 20.00th=[ 15008], | 30.00th=[ 17695], 40.00th=[ 21365], 50.00th=[ 24511], 60.00th=[ 28181], | 70.00th=[ 32900], 80.00th=[ 39584], 90.00th=[ 49546], 95.00th=[ 60031], | 99.00th=[ 84411], 99.50th=[103285], 99.90th=[139461], 99.95th=[158335], | 99.99th=[158335] bw ( KiB/s): min= 31, max= 143, per=25.49%, avg=77.49, stdev=21.97, samples=154 iops : min= 7, max= 35, avg=18.74, stdev= 5.53, samples=154 write: IOPS=19, BW=79.7KiB/s (81.6kB/s)(6236KiB/78267msec); 0 zone resets clat (usec): min=707, max=538738, avg=22863.31, stdev=25404.85 lat (usec): min=708, max=538742, avg=22864.90, stdev=25404.81 clat percentiles (usec): | 1.00th=[ 971], 5.00th=[ 1221], 10.00th=[ 1565], 20.00th=[ 2966], | 30.00th=[ 5604], 40.00th=[ 11731], 50.00th=[ 17433], 60.00th=[ 22676], | 70.00th=[ 29230], 80.00th=[ 39584], 90.00th=[ 52691], 95.00th=[ 63701], | 99.00th=[ 95945], 99.50th=[106431], 99.90th=[158335], 99.95th=[541066], | 99.99th=[541066] bw ( KiB/s): min= 31, max= 174, per=25.08%, avg=79.76, stdev=27.62, samples=154 iops : min= 7, max= 43, avg=19.32, stdev= 6.91, samples=154 lat (usec) : 50=0.55%, 100=1.50%, 250=0.29%, 500=0.03%, 750=0.10% lat (usec) : 1000=0.59% lat (msec) : 2=6.38%, 4=5.63%, 10=7.71%, 20=23.34%, 50=43.36% lat (msec) : 100=9.80%, 250=0.68%, 750=0.03% cpu : usr=0.10%, sys=7.89%, ctx=6905, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=304KiB/s (312kB/s), 75.9KiB/s-78.3KiB/s (77.7kB/s-80.2kB/s), io=23.4MiB (24.6MB), run=76506-78933msec WRITE: bw=318KiB/s (326kB/s), 79.3KiB/s-82.3KiB/s (81.2kB/s-84.3kB/s), io=24.6MiB (25.7MB), run=76506-78933msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179158: Tue Sep 22 15:54:02 2026 read: IOPS=14, BW=57.0KiB/s (58.4kB/s)(5992KiB/105087msec) clat (msec): min=4, max=648, avg=27.86, stdev=28.26 lat (msec): min=4, max=648, avg=27.86, stdev=28.26 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 11], | 30.00th=[ 14], 40.00th=[ 17], 50.00th=[ 20], 60.00th=[ 24], | 70.00th=[ 30], 80.00th=[ 40], 90.00th=[ 60], 95.00th=[ 77], | 99.00th=[ 110], 99.50th=[ 140], 99.90th=[ 192], 99.95th=[ 651], | 99.99th=[ 651] bw ( KiB/s): min= 7, max= 184, per=25.21%, avg=56.97, stdev=34.36, samples=206 iops : min= 1, max= 46, avg=13.67, stdev= 8.60, samples=206 write: IOPS=14, BW=59.9KiB/s (61.3kB/s)(6296KiB/105087msec); 0 zone resets clat (msec): min=6, max=226, avg=40.08, stdev=26.04 lat (msec): min=6, max=226, avg=40.08, stdev=26.04 clat percentiles (msec): | 1.00th=[ 12], 5.00th=[ 15], 10.00th=[ 17], 20.00th=[ 20], | 30.00th=[ 24], 40.00th=[ 28], 50.00th=[ 33], 60.00th=[ 39], | 70.00th=[ 46], 80.00th=[ 58], 90.00th=[ 73], 95.00th=[ 90], | 99.00th=[ 134], 99.50th=[ 159], 99.90th=[ 197], 99.95th=[ 226], | 99.99th=[ 226] bw ( KiB/s): min= 15, max= 175, per=25.17%, avg=59.64, stdev=31.29, samples=207 iops : min= 3, max= 43, avg=14.35, stdev= 7.86, samples=207 lat (msec) : 10=7.55%, 20=28.13%, 50=44.40%, 100=17.38%, 250=2.51% lat (msec) : 750=0.03% cpu : usr=0.08%, sys=2.85%, ctx=4772, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179159: Tue Sep 22 15:54:02 2026 read: IOPS=14, BW=56.3KiB/s (57.6kB/s)(5940KiB/105586msec) clat (msec): min=4, max=599, avg=27.51, stdev=27.67 lat (msec): min=4, max=599, avg=27.51, stdev=27.67 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 12], | 30.00th=[ 14], 40.00th=[ 17], 50.00th=[ 20], 60.00th=[ 24], | 70.00th=[ 30], 80.00th=[ 39], 90.00th=[ 57], 95.00th=[ 73], | 99.00th=[ 118], 99.50th=[ 146], 99.90th=[ 215], 99.95th=[ 600], | 99.99th=[ 600] bw ( KiB/s): min= 7, max= 168, per=24.88%, avg=56.22, stdev=33.29, samples=207 iops : min= 1, max= 42, avg=13.49, stdev= 8.35, samples=207 write: IOPS=15, BW=60.1KiB/s (61.6kB/s)(6348KiB/105586msec); 0 zone resets clat (msec): min=7, max=199, avg=40.62, stdev=26.45 lat (msec): min=7, max=199, avg=40.62, stdev=26.45 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 15], 10.00th=[ 17], 20.00th=[ 20], | 30.00th=[ 24], 40.00th=[ 28], 50.00th=[ 33], 60.00th=[ 39], | 70.00th=[ 48], 80.00th=[ 59], 90.00th=[ 75], 95.00th=[ 95], | 99.00th=[ 132], 99.50th=[ 146], 99.90th=[ 194], 99.95th=[ 201], | 99.99th=[ 201] bw ( KiB/s): min= 15, max= 159, per=25.21%, avg=59.75, stdev=31.36, samples=208 iops : min= 3, max= 39, avg=14.37, stdev= 7.87, samples=208 lat (msec) : 10=7.52%, 20=28.22%, 50=43.68%, 100=17.64%, 250=2.90% lat (msec) : 750=0.03% cpu : usr=0.06%, sys=2.81%, ctx=4902, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179160: Tue Sep 22 15:54:02 2026 read: IOPS=14, BW=56.9KiB/s (58.3kB/s)(6028KiB/105855msec) clat (msec): min=4, max=190, avg=27.24, stdev=22.46 lat (msec): min=4, max=190, avg=27.25, stdev=22.46 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 12], | 30.00th=[ 14], 40.00th=[ 17], 50.00th=[ 20], 60.00th=[ 24], | 70.00th=[ 31], 80.00th=[ 40], 90.00th=[ 58], 95.00th=[ 72], | 99.00th=[ 110], 99.50th=[ 125], 99.90th=[ 176], 99.95th=[ 190], | 99.99th=[ 190] bw ( KiB/s): min= 7, max= 184, per=25.31%, avg=57.20, stdev=32.74, samples=207 iops : min= 1, max= 46, avg=13.73, stdev= 8.20, samples=207 write: IOPS=14, BW=59.1KiB/s (60.6kB/s)(6260KiB/105855msec); 0 zone resets clat (msec): min=7, max=623, avg=41.24, stdev=30.37 lat (msec): min=7, max=623, avg=41.24, stdev=30.37 clat percentiles (msec): | 1.00th=[ 12], 5.00th=[ 15], 10.00th=[ 17], 20.00th=[ 21], | 30.00th=[ 24], 40.00th=[ 28], 50.00th=[ 33], 60.00th=[ 40], | 70.00th=[ 48], 80.00th=[ 59], 90.00th=[ 77], 95.00th=[ 93], | 99.00th=[ 133], 99.50th=[ 157], 99.90th=[ 239], 99.95th=[ 625], | 99.99th=[ 625] bw ( KiB/s): min= 7, max= 167, per=24.83%, avg=58.84, stdev=32.12, samples=209 iops : min= 1, max= 41, avg=14.14, stdev= 8.06, samples=209 lat (msec) : 10=7.45%, 20=27.34%, 50=45.15%, 100=17.29%, 250=2.73% lat (msec) : 750=0.03% cpu : usr=0.07%, sys=2.75%, ctx=4804, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179161: Tue Sep 22 15:54:02 2026 read: IOPS=14, BW=57.3KiB/s (58.6kB/s)(6052KiB/105687msec) clat (msec): min=3, max=213, avg=27.36, stdev=23.07 lat (msec): min=3, max=213, avg=27.36, stdev=23.07 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 12], | 30.00th=[ 14], 40.00th=[ 17], 50.00th=[ 20], 60.00th=[ 24], | 70.00th=[ 29], 80.00th=[ 39], 90.00th=[ 60], 95.00th=[ 77], | 99.00th=[ 111], 99.50th=[ 126], 99.90th=[ 184], 99.95th=[ 215], | 99.99th=[ 215] bw ( KiB/s): min= 7, max= 192, per=25.23%, avg=57.02, stdev=32.52, samples=207 iops : min= 1, max= 48, avg=13.69, stdev= 8.15, samples=207 write: IOPS=14, BW=59.0KiB/s (60.4kB/s)(6236KiB/105687msec); 0 zone resets clat (msec): min=6, max=615, avg=41.07, stdev=31.09 lat (msec): min=6, max=615, avg=41.07, stdev=31.09 clat percentiles (msec): | 1.00th=[ 12], 5.00th=[ 15], 10.00th=[ 17], 20.00th=[ 20], | 30.00th=[ 23], 40.00th=[ 28], 50.00th=[ 32], 60.00th=[ 39], | 70.00th=[ 48], 80.00th=[ 59], 90.00th=[ 79], 95.00th=[ 93], | 99.00th=[ 146], 99.50th=[ 176], 99.90th=[ 239], 99.95th=[ 617], | 99.99th=[ 617] bw ( KiB/s): min= 7, max= 144, per=24.84%, avg=58.87, stdev=31.01, samples=207 iops : min= 1, max= 36, avg=14.15, stdev= 7.80, samples=207 lat (msec) : 4=0.03%, 10=7.39%, 20=29.13%, 50=42.74%, 100=18.07% lat (msec) : 250=2.60%, 750=0.03% cpu : usr=0.07%, sys=2.79%, ctx=4776, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=227KiB/s (232kB/s), 56.3KiB/s-57.3KiB/s (57.6kB/s-58.6kB/s), io=23.4MiB (24.6MB), run=105087-105855msec WRITE: bw=237KiB/s (243kB/s), 59.0KiB/s-60.1KiB/s (60.4kB/s-61.6kB/s), io=24.6MiB (25.7MB), run=105087-105855msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179198: Tue Sep 22 15:54:31 2026 read: IOPS=17, BW=280KiB/s (286kB/s)(5920KiB/21167msec) clat (usec): min=40, max=168742, avg=30173.95, stdev=21522.31 lat (usec): min=40, max=168744, avg=30177.73, stdev=21523.89 clat percentiles (usec): | 1.00th=[ 46], 5.00th=[ 66], 10.00th=[ 135], 20.00th=[ 15401], | 30.00th=[ 19530], 40.00th=[ 22676], 50.00th=[ 26084], 60.00th=[ 31065], | 70.00th=[ 36439], 80.00th=[ 44827], 90.00th=[ 54789], 95.00th=[ 70779], | 99.00th=[ 92799], 99.50th=[124257], 99.90th=[168821], 99.95th=[168821], | 99.99th=[168821] bw ( KiB/s): min= 63, max= 526, per=24.96%, avg=274.10, stdev=110.25, samples=41 iops : min= 3, max= 32, avg=16.34, stdev= 6.96, samples=41 write: IOPS=18, BW=301KiB/s (308kB/s)(6368KiB/21167msec); 0 zone resets clat (usec): min=1266, max=127823, avg=24860.92, stdev=24691.05 lat (usec): min=1266, max=127825, avg=24863.03, stdev=24691.19 clat percentiles (usec): | 1.00th=[ 1614], 5.00th=[ 2008], 10.00th=[ 2474], 20.00th=[ 3982], | 30.00th=[ 6587], 40.00th=[ 10028], 50.00th=[ 16909], 60.00th=[ 23200], | 70.00th=[ 32113], 80.00th=[ 42206], 90.00th=[ 63177], 95.00th=[ 76022], | 99.00th=[102237], 99.50th=[111674], 99.90th=[127402], 99.95th=[127402], | 99.99th=[127402] bw ( KiB/s): min= 127, max= 574, per=25.79%, avg=297.90, stdev=106.55, samples=41 iops : min= 7, max= 35, avg=17.85, stdev= 6.69, samples=41 lat (usec) : 50=0.65%, 100=3.65%, 250=0.91%, 500=0.26%, 750=0.13% lat (msec) : 2=2.47%, 4=8.07%, 10=10.81%, 20=16.41%, 50=42.19% lat (msec) : 100=13.28%, 250=1.17% cpu : usr=0.12%, sys=7.88%, ctx=1668, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179199: Tue Sep 22 15:54:31 2026 read: IOPS=16, BW=270KiB/s (277kB/s)(5744KiB/21270msec) clat (usec): min=39, max=149115, avg=32462.70, stdev=25131.33 lat (usec): min=40, max=149116, avg=32466.86, stdev=25134.94 clat percentiles (usec): | 1.00th=[ 50], 5.00th=[ 67], 10.00th=[ 388], 20.00th=[ 16319], | 30.00th=[ 20055], 40.00th=[ 23725], 50.00th=[ 27395], 60.00th=[ 32113], | 70.00th=[ 38536], 80.00th=[ 47449], 90.00th=[ 60031], 95.00th=[ 77071], | 99.00th=[131597], 99.50th=[141558], 99.90th=[149947], 99.95th=[149947], | 99.99th=[149947] bw ( KiB/s): min= 94, max= 479, per=24.62%, avg=270.31, stdev=86.77, samples=42 iops : min= 5, max= 29, avg=16.12, stdev= 5.46, samples=42 write: IOPS=19, BW=308KiB/s (315kB/s)(6544KiB/21270msec); 0 zone resets clat (usec): min=1337, max=141217, avg=23371.60, stdev=22541.93 lat (usec): min=1339, max=141219, avg=23373.81, stdev=22542.03 clat percentiles (usec): | 1.00th=[ 1565], 5.00th=[ 1942], 10.00th=[ 2245], 20.00th=[ 3425], | 30.00th=[ 6194], 40.00th=[ 11076], 50.00th=[ 18482], 60.00th=[ 22938], | 70.00th=[ 29754], 80.00th=[ 38536], 90.00th=[ 56886], 95.00th=[ 68682], | 99.00th=[ 89654], 99.50th=[106431], 99.90th=[141558], 99.95th=[141558], | 99.99th=[141558] bw ( KiB/s): min= 94, max= 702, per=26.48%, avg=305.83, stdev=122.04, samples=42 iops : min= 5, max= 43, avg=18.36, stdev= 7.71, samples=42 lat (usec) : 50=0.52%, 100=3.26%, 250=0.78%, 500=0.52%, 750=0.26% lat (usec) : 1000=0.13% lat (msec) : 2=3.39%, 4=8.46%, 10=9.51%, 20=15.10%, 50=43.10% lat (msec) : 100=13.15%, 250=1.82% cpu : usr=0.09%, sys=8.50%, ctx=1677, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179200: Tue Sep 22 15:54:31 2026 read: IOPS=17, BW=287KiB/s (294kB/s)(6256KiB/21800msec) clat (usec): min=39, max=112876, avg=31681.77, stdev=20312.31 lat (usec): min=40, max=112877, avg=31683.07, stdev=20312.32 clat percentiles (usec): | 1.00th=[ 51], 5.00th=[ 67], 10.00th=[ 318], 20.00th=[ 16581], | 30.00th=[ 20055], 40.00th=[ 24249], 50.00th=[ 28705], 60.00th=[ 34341], | 70.00th=[ 40109], 80.00th=[ 46400], 90.00th=[ 57410], 95.00th=[ 66323], | 99.00th=[ 92799], 99.50th=[102237], 99.90th=[112722], 99.95th=[112722], | 99.99th=[112722] bw ( KiB/s): min= 158, max= 512, per=26.02%, avg=285.67, stdev=87.77, samples=43 iops : min= 9, max= 32, avg=17.09, stdev= 5.57, samples=43 write: IOPS=17, BW=277KiB/s (283kB/s)(6032KiB/21800msec); 0 zone resets clat (usec): min=1027, max=131520, avg=24731.56, stdev=24351.61 lat (usec): min=1029, max=131520, avg=24740.89, stdev=24375.47 clat percentiles (usec): | 1.00th=[ 1565], 5.00th=[ 2212], 10.00th=[ 2868], 20.00th=[ 4424], | 30.00th=[ 6652], 40.00th=[ 10290], 50.00th=[ 16909], 60.00th=[ 24511], | 70.00th=[ 31851], 80.00th=[ 42730], 90.00th=[ 56361], 95.00th=[ 71828], | 99.00th=[116917], 99.50th=[121111], 99.90th=[131597], 99.95th=[131597], | 99.99th=[131597] bw ( KiB/s): min= 95, max= 617, per=23.50%, avg=271.37, stdev=112.61, samples=43 iops : min= 5, max= 38, avg=16.19, stdev= 7.10, samples=43 lat (usec) : 50=0.26%, 100=3.91%, 250=0.78%, 500=0.26% lat (msec) : 2=2.08%, 4=7.03%, 10=10.55%, 20=16.28%, 50=43.23% lat (msec) : 100=14.19%, 250=1.43% cpu : usr=0.09%, sys=8.06%, ctx=1718, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179201: Tue Sep 22 15:54:31 2026 read: IOPS=17, BW=280KiB/s (287kB/s)(6032KiB/21525msec) clat (usec): min=44, max=147355, avg=30217.71, stdev=21102.30 lat (usec): min=44, max=147356, avg=30218.92, stdev=21102.32 clat percentiles (usec): | 1.00th=[ 54], 5.00th=[ 62], 10.00th=[ 88], 20.00th=[ 15008], | 30.00th=[ 19268], 40.00th=[ 23987], 50.00th=[ 27919], 60.00th=[ 32375], | 70.00th=[ 36963], 80.00th=[ 44827], 90.00th=[ 55837], 95.00th=[ 67634], | 99.00th=[ 96994], 99.50th=[106431], 99.90th=[147850], 99.95th=[147850], | 99.99th=[147850] bw ( KiB/s): min= 31, max= 606, per=25.05%, avg=275.00, stdev=124.52, samples=42 iops : min= 1, max= 37, avg=16.43, stdev= 7.89, samples=42 write: IOPS=18, BW=291KiB/s (298kB/s)(6256KiB/21525msec); 0 zone resets clat (usec): min=1529, max=176630, avg=25678.73, stdev=27492.10 lat (usec): min=1531, max=176631, avg=25681.68, stdev=27491.47 clat percentiles (usec): | 1.00th=[ 1582], 5.00th=[ 1844], 10.00th=[ 2442], 20.00th=[ 3785], | 30.00th=[ 5669], 40.00th=[ 8455], 50.00th=[ 16581], 60.00th=[ 23462], | 70.00th=[ 32637], 80.00th=[ 45351], 90.00th=[ 63701], 95.00th=[ 86508], | 99.00th=[111674], 99.50th=[137364], 99.90th=[177210], 99.95th=[177210], | 99.99th=[177210] bw ( KiB/s): min= 95, max= 670, per=24.82%, avg=286.64, stdev=96.64, samples=42 iops : min= 5, max= 41, avg=17.14, stdev= 6.07, samples=42 lat (usec) : 50=0.26%, 100=5.08%, 250=1.04%, 500=0.13% lat (msec) : 2=3.26%, 4=7.55%, 10=10.42%, 20=15.49%, 50=40.23% lat (msec) : 100=14.84%, 250=1.69% cpu : usr=0.11%, sys=8.08%, ctx=1700, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1099KiB/s (1125kB/s), 270KiB/s-287KiB/s (277kB/s-294kB/s), io=23.4MiB (24.5MB), run=21167-21800msec WRITE: bw=1156KiB/s (1184kB/s), 277KiB/s-308KiB/s (283kB/s-315kB/s), io=24.6MiB (25.8MB), run=21167-21800msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179203: Tue Sep 22 15:54:38 2026 read: IOPS=13, BW=213KiB/s (218kB/s)(5920KiB/27849msec) clat (msec): min=4, max=185, avg=29.41, stdev=28.87 lat (msec): min=4, max=185, avg=29.41, stdev=28.87 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 10], | 30.00th=[ 13], 40.00th=[ 16], 50.00th=[ 20], 60.00th=[ 23], | 70.00th=[ 28], 80.00th=[ 41], 90.00th=[ 72], 95.00th=[ 93], | 99.00th=[ 148], 99.50th=[ 161], 99.90th=[ 186], 99.95th=[ 186], | 99.99th=[ 186] bw ( KiB/s): min= 31, max= 734, per=24.90%, avg=212.36, stdev=151.14, samples=55 iops : min= 1, max= 45, avg=12.53, stdev= 9.57, samples=55 write: IOPS=14, BW=229KiB/s (234kB/s)(6368KiB/27849msec); 0 zone resets clat (msec): min=7, max=209, avg=42.32, stdev=32.99 lat (msec): min=7, max=209, avg=42.32, stdev=32.99 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 13], 10.00th=[ 15], 20.00th=[ 18], | 30.00th=[ 21], 40.00th=[ 25], 50.00th=[ 30], 60.00th=[ 37], | 70.00th=[ 50], 80.00th=[ 64], 90.00th=[ 90], 95.00th=[ 112], | 99.00th=[ 163], 99.50th=[ 180], 99.90th=[ 209], 99.95th=[ 209], | 99.99th=[ 209] bw ( KiB/s): min= 28, max= 704, per=25.45%, avg=228.33, stdev=166.18, samples=55 iops : min= 1, max= 44, avg=13.53, stdev=10.54, samples=55 lat (msec) : 10=10.81%, 20=28.91%, 50=37.11%, 100=17.58%, 250=5.60% cpu : usr=0.07%, sys=2.85%, ctx=1325, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179204: Tue Sep 22 15:54:38 2026 read: IOPS=12, BW=206KiB/s (211kB/s)(5744KiB/27838msec) clat (msec): min=4, max=183, avg=28.43, stdev=27.74 lat (msec): min=4, max=183, avg=28.43, stdev=27.74 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 7], 10.00th=[ 8], 20.00th=[ 10], | 30.00th=[ 12], 40.00th=[ 15], 50.00th=[ 19], 60.00th=[ 24], | 70.00th=[ 30], 80.00th=[ 41], 90.00th=[ 69], 95.00th=[ 94], | 99.00th=[ 130], 99.50th=[ 144], 99.90th=[ 184], 99.95th=[ 184], | 99.99th=[ 184] bw ( KiB/s): min= 28, max= 672, per=24.18%, avg=206.24, stdev=167.90, samples=55 iops : min= 1, max= 42, avg=12.15, stdev=10.67, samples=55 write: IOPS=14, BW=235KiB/s (241kB/s)(6544KiB/27838msec); 0 zone resets clat (msec): min=8, max=198, avg=42.89, stdev=32.99 lat (msec): min=8, max=198, avg=42.89, stdev=32.99 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 13], 10.00th=[ 15], 20.00th=[ 18], | 30.00th=[ 21], 40.00th=[ 25], 50.00th=[ 32], 60.00th=[ 37], | 70.00th=[ 50], 80.00th=[ 68], 90.00th=[ 92], 95.00th=[ 110], | 99.00th=[ 144], 99.50th=[ 157], 99.90th=[ 199], 99.95th=[ 199], | 99.99th=[ 199] bw ( KiB/s): min= 63, max= 704, per=26.20%, avg=235.04, stdev=159.66, samples=55 iops : min= 3, max= 44, avg=13.96, stdev=10.10, samples=55 lat (msec) : 10=11.20%, 20=29.95%, 50=35.94%, 100=17.06%, 250=5.86% cpu : usr=0.04%, sys=3.04%, ctx=1268, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179205: Tue Sep 22 15:54:38 2026 read: IOPS=13, BW=223KiB/s (228kB/s)(6256KiB/28065msec) clat (msec): min=4, max=197, avg=29.52, stdev=28.74 lat (msec): min=4, max=197, avg=29.52, stdev=28.74 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 7], 10.00th=[ 8], 20.00th=[ 10], | 30.00th=[ 13], 40.00th=[ 16], 50.00th=[ 21], 60.00th=[ 25], | 70.00th=[ 31], 80.00th=[ 41], 90.00th=[ 66], 95.00th=[ 93], | 99.00th=[ 150], 99.50th=[ 192], 99.90th=[ 199], 99.95th=[ 199], | 99.99th=[ 199] bw ( KiB/s): min= 31, max= 864, per=26.07%, avg=222.35, stdev=178.56, samples=55 iops : min= 1, max= 54, avg=13.16, stdev=11.28, samples=55 write: IOPS=13, BW=215KiB/s (220kB/s)(6032KiB/28065msec); 0 zone resets clat (msec): min=7, max=218, avg=43.52, stdev=34.79 lat (msec): min=7, max=218, avg=43.52, stdev=34.79 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 12], 10.00th=[ 15], 20.00th=[ 18], | 30.00th=[ 20], 40.00th=[ 24], 50.00th=[ 30], 60.00th=[ 39], | 70.00th=[ 53], 80.00th=[ 69], 90.00th=[ 90], 95.00th=[ 116], | 99.00th=[ 174], 99.50th=[ 203], 99.90th=[ 220], 99.95th=[ 220], | 99.99th=[ 220] bw ( KiB/s): min= 62, max= 761, per=23.56%, avg=211.33, stdev=155.37, samples=55 iops : min= 3, max= 47, avg=12.47, stdev= 9.86, samples=55 lat (msec) : 10=11.33%, 20=28.65%, 50=36.85%, 100=17.84%, 250=5.34% cpu : usr=0.08%, sys=2.92%, ctx=1315, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179206: Tue Sep 22 15:54:38 2026 read: IOPS=13, BW=219KiB/s (224kB/s)(6032KiB/27515msec) clat (msec): min=3, max=204, avg=28.88, stdev=27.50 lat (msec): min=3, max=204, avg=28.88, stdev=27.50 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 7], 10.00th=[ 8], 20.00th=[ 11], | 30.00th=[ 13], 40.00th=[ 16], 50.00th=[ 20], 60.00th=[ 24], | 70.00th=[ 29], 80.00th=[ 44], 90.00th=[ 65], 95.00th=[ 87], | 99.00th=[ 142], 99.50th=[ 161], 99.90th=[ 205], 99.95th=[ 205], | 99.99th=[ 205] bw ( KiB/s): min= 31, max= 672, per=25.45%, avg=217.07, stdev=152.47, samples=54 iops : min= 1, max= 42, avg=12.83, stdev= 9.66, samples=54 write: IOPS=14, BW=227KiB/s (233kB/s)(6256KiB/27515msec); 0 zone resets clat (msec): min=8, max=197, avg=42.32, stdev=32.37 lat (msec): min=8, max=197, avg=42.33, stdev=32.37 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 13], 10.00th=[ 15], 20.00th=[ 17], | 30.00th=[ 20], 40.00th=[ 24], 50.00th=[ 31], 60.00th=[ 39], | 70.00th=[ 56], 80.00th=[ 67], 90.00th=[ 87], 95.00th=[ 107], | 99.00th=[ 153], 99.50th=[ 174], 99.90th=[ 199], 99.95th=[ 199], | 99.99th=[ 199] bw ( KiB/s): min= 31, max= 672, per=25.25%, avg=226.52, stdev=170.67, samples=54 iops : min= 1, max= 42, avg=13.43, stdev=10.83, samples=54 lat (msec) : 4=0.13%, 10=9.90%, 20=31.77%, 50=33.98%, 100=19.53% lat (msec) : 250=4.69% cpu : usr=0.10%, sys=2.91%, ctx=1263, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=853KiB/s (874kB/s), 206KiB/s-223KiB/s (211kB/s-228kB/s), io=23.4MiB (24.5MB), run=27515-28065msec WRITE: bw=898KiB/s (919kB/s), 215KiB/s-235KiB/s (220kB/s-241kB/s), io=24.6MiB (25.8MB), run=27515-28065msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179215: Tue Sep 22 15:54:48 2026 read: IOPS=2, BW=2064KiB/s (2113kB/s)(7168KiB/3473msec) clat (msec): min=148, max=477, avg=268.22, stdev=109.31 lat (msec): min=148, max=477, avg=268.22, stdev=109.31 clat percentiles (msec): | 1.00th=[ 148], 5.00th=[ 148], 10.00th=[ 148], 20.00th=[ 188], | 30.00th=[ 203], 40.00th=[ 203], 50.00th=[ 255], 60.00th=[ 305], | 70.00th=[ 305], 80.00th=[ 305], 90.00th=[ 477], 95.00th=[ 477], | 99.00th=[ 477], 99.50th=[ 477], 99.90th=[ 477], 99.95th=[ 477], | 99.99th=[ 477] bw ( KiB/s): min= 1759, max= 4063, per=48.70%, avg=2674.50, stdev=1029.91, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 0.82, samples=4 write: IOPS=1, BW=1474KiB/s (1510kB/s)(5120KiB/3473msec); 0 zone resets clat (msec): min=184, max=424, avg=301.33, stdev=107.43 lat (msec): min=184, max=424, avg=302.00, stdev=107.12 clat percentiles (msec): | 1.00th=[ 186], 5.00th=[ 186], 10.00th=[ 186], 20.00th=[ 186], | 30.00th=[ 243], 40.00th=[ 243], 50.00th=[ 249], 60.00th=[ 249], | 70.00th=[ 405], 80.00th=[ 405], 90.00th=[ 426], 95.00th=[ 426], | 99.00th=[ 426], 99.50th=[ 426], 99.90th=[ 426], 99.95th=[ 426], | 99.99th=[ 426] bw ( KiB/s): min= 1759, max= 3757, per=31.24%, avg=2401.75, stdev=913.54, samples=4 iops : min= 1, max= 3, avg= 1.75, stdev= 0.96, samples=4 lat (msec) : 250=50.00%, 500=50.00% cpu : usr=0.00%, sys=22.87%, ctx=339, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179216: Tue Sep 22 15:54:48 2026 read: IOPS=0, BW=549KiB/s (562kB/s)(2048KiB/3729msec) clat (usec): min=540, max=124545, avg=62543.08, stdev=87684.77 lat (usec): min=541, max=124548, avg=62545.03, stdev=87685.64 clat percentiles (usec): | 1.00th=[ 537], 5.00th=[ 537], 10.00th=[ 537], 20.00th=[ 537], | 30.00th=[ 537], 40.00th=[ 537], 50.00th=[ 537], 60.00th=[124257], | 70.00th=[124257], 80.00th=[124257], 90.00th=[124257], 95.00th=[124257], | 99.00th=[124257], 99.50th=[124257], 99.90th=[124257], 99.95th=[124257], | 99.99th=[124257] bw ( KiB/s): min= 1414, max= 1878, per=29.97%, avg=1646.00, stdev=328.10, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2746KiB/s (2812kB/s)(10.0MiB/3729msec); 0 zone resets clat (msec): min=203, max=610, avg=358.05, stdev=130.06 lat (msec): min=203, max=610, avg=358.25, stdev=129.97 clat percentiles (msec): | 1.00th=[ 205], 5.00th=[ 205], 10.00th=[ 205], 20.00th=[ 224], | 30.00th=[ 266], 40.00th=[ 288], 50.00th=[ 338], 60.00th=[ 347], | 70.00th=[ 380], 80.00th=[ 397], 90.00th=[ 531], 95.00th=[ 609], | 99.00th=[ 609], 99.50th=[ 609], 99.90th=[ 609], 99.95th=[ 609], | 99.99th=[ 609] bw ( KiB/s): min= 1414, max= 4096, per=32.47%, avg=2496.67, stdev=1056.27, samples=6 iops : min= 1, max= 4, avg= 1.83, stdev= 1.33, samples=6 lat (usec) : 750=8.33% lat (msec) : 250=25.00%, 500=50.00%, 750=16.67% cpu : usr=0.08%, sys=24.11%, ctx=175, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179217: Tue Sep 22 15:54:48 2026 read: IOPS=1, BW=1843KiB/s (1888kB/s)(6144KiB/3333msec) clat (usec): min=641, max=432331, avg=194444.54, stdev=150285.53 lat (usec): min=644, max=432333, avg=194446.24, stdev=150285.15 clat percentiles (usec): | 1.00th=[ 644], 5.00th=[ 644], 10.00th=[ 644], 20.00th=[103285], | 30.00th=[103285], 40.00th=[130548], 50.00th=[130548], 60.00th=[240124], | 70.00th=[258999], 80.00th=[258999], 90.00th=[434111], 95.00th=[434111], | 99.00th=[434111], 99.50th=[434111], 99.90th=[434111], 99.95th=[434111], | 99.99th=[434111] bw ( KiB/s): min= 3518, max= 4063, per=69.02%, avg=3790.50, stdev=385.37, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1843KiB/s (1888kB/s)(6144KiB/3333msec); 0 zone resets clat (msec): min=205, max=658, avg=333.04, stdev=178.33 lat (msec): min=205, max=658, avg=333.28, stdev=178.23 clat percentiles (msec): | 1.00th=[ 207], 5.00th=[ 207], 10.00th=[ 207], 20.00th=[ 209], | 30.00th=[ 209], 40.00th=[ 241], 50.00th=[ 241], 60.00th=[ 264], | 70.00th=[ 422], 80.00th=[ 422], 90.00th=[ 659], 95.00th=[ 659], | 99.00th=[ 659], 99.50th=[ 659], 99.90th=[ 659], 99.95th=[ 659], | 99.99th=[ 659] bw ( KiB/s): min= 1410, max= 2048, per=23.96%, avg=1841.75, stdev=297.81, samples=4 iops : min= 1, max= 2, avg= 1.25, stdev= 0.50, samples=4 lat (usec) : 750=8.33% lat (msec) : 250=50.00%, 500=33.33%, 750=8.33% cpu : usr=0.03%, sys=22.51%, ctx=213, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179218: Tue Sep 22 15:54:48 2026 read: IOPS=1, BW=1710KiB/s (1751kB/s)(5120KiB/2995msec) clat (usec): min=815, max=150147, avg=70175.23, stdev=66461.85 lat (usec): min=816, max=150148, avg=70176.67, stdev=66461.88 clat percentiles (usec): | 1.00th=[ 816], 5.00th=[ 816], 10.00th=[ 816], 20.00th=[ 816], | 30.00th=[ 1237], 40.00th=[ 1237], 50.00th=[ 96994], 60.00th=[ 96994], | 70.00th=[101188], 80.00th=[101188], 90.00th=[149947], 95.00th=[149947], | 99.00th=[149947], 99.50th=[149947], 99.90th=[149947], 99.95th=[149947], | 99.99th=[149947] bw ( KiB/s): min= 7515, max= 7515, per=100.00%, avg=7515.00, stdev= 0.00, samples=1 iops : min= 7, max= 7, avg= 7.00, stdev= 0.00, samples=1 write: IOPS=2, BW=2393KiB/s (2451kB/s)(7168KiB/2995msec); 0 zone resets clat (msec): min=226, max=749, avg=353.42, stdev=186.36 lat (msec): min=226, max=749, avg=353.54, stdev=186.39 clat percentiles (msec): | 1.00th=[ 226], 5.00th=[ 226], 10.00th=[ 226], 20.00th=[ 243], | 30.00th=[ 249], 40.00th=[ 249], 50.00th=[ 251], 60.00th=[ 359], | 70.00th=[ 359], 80.00th=[ 397], 90.00th=[ 751], 95.00th=[ 751], | 99.00th=[ 751], 99.50th=[ 751], 99.90th=[ 751], 99.95th=[ 751], | 99.99th=[ 751] bw ( KiB/s): min= 1406, max= 3518, per=28.31%, avg=2176.20, stdev=793.74, samples=5 iops : min= 1, max= 3, avg= 1.60, stdev= 0.89, samples=5 lat (usec) : 1000=8.33% lat (msec) : 2=8.33%, 100=8.33%, 250=41.67%, 500=25.00%, 750=8.33% cpu : usr=0.03%, sys=25.15%, ctx=373, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5492KiB/s (5624kB/s), 549KiB/s-2064KiB/s (562kB/s-2113kB/s), io=20.0MiB (20.0MB), run=2995-3729msec WRITE: bw=7689KiB/s (7873kB/s), 1474KiB/s-2746KiB/s (1510kB/s-2812kB/s), io=28.0MiB (29.4MB), run=2995-3729msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179220: Tue Sep 22 15:54:48 2026 read: IOPS=1, BW=1890KiB/s (1936kB/s)(7168KiB/3792msec) clat (msec): min=90, max=293, avg=170.72, stdev=84.17 lat (msec): min=90, max=293, avg=170.73, stdev=84.17 clat percentiles (msec): | 1.00th=[ 91], 5.00th=[ 91], 10.00th=[ 91], 20.00th=[ 93], | 30.00th=[ 106], 40.00th=[ 106], 50.00th=[ 167], 60.00th=[ 171], | 70.00th=[ 171], 80.00th=[ 275], 90.00th=[ 292], 95.00th=[ 292], | 99.00th=[ 292], 99.50th=[ 292], 99.90th=[ 292], 99.95th=[ 292], | 99.99th=[ 292] bw ( KiB/s): min= 2007, max= 3984, per=55.08%, avg=2911.50, stdev=1051.32, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 1.15, samples=4 write: IOPS=1, BW=1350KiB/s (1383kB/s)(5120KiB/3792msec); 0 zone resets clat (msec): min=273, max=765, avg=482.39, stdev=216.48 lat (msec): min=273, max=765, avg=482.47, stdev=216.49 clat percentiles (msec): | 1.00th=[ 275], 5.00th=[ 275], 10.00th=[ 275], 20.00th=[ 275], | 30.00th=[ 342], 40.00th=[ 342], 50.00th=[ 372], 60.00th=[ 372], | 70.00th=[ 659], 80.00th=[ 659], 90.00th=[ 768], 95.00th=[ 768], | 99.00th=[ 768], 99.50th=[ 768], 99.90th=[ 768], 99.95th=[ 768], | 99.99th=[ 768] bw ( KiB/s): min= 1969, max= 2015, per=26.97%, avg=1995.75, stdev=20.22, samples=4 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=4 lat (msec) : 100=16.67%, 250=25.00%, 500=41.67%, 750=8.33%, 1000=8.33% cpu : usr=0.00%, sys=9.15%, ctx=126, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179221: Tue Sep 22 15:54:48 2026 read: IOPS=0, BW=529KiB/s (541kB/s)(2048KiB/3874msec) clat (msec): min=263, max=471, avg=367.37, stdev=146.78 lat (msec): min=263, max=471, avg=367.37, stdev=146.78 clat percentiles (msec): | 1.00th=[ 264], 5.00th=[ 264], 10.00th=[ 264], 20.00th=[ 264], | 30.00th=[ 264], 40.00th=[ 264], 50.00th=[ 264], 60.00th=[ 472], | 70.00th=[ 472], 80.00th=[ 472], 90.00th=[ 472], 95.00th=[ 472], | 99.00th=[ 472], 99.50th=[ 472], 99.90th=[ 472], 99.95th=[ 472], | 99.99th=[ 472] bw ( KiB/s): min= 1822, max= 2015, per=36.29%, avg=1918.50, stdev=136.47, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2643KiB/s (2707kB/s)(10.0MiB/3874msec); 0 zone resets clat (msec): min=142, max=551, avg=308.78, stdev=152.44 lat (msec): min=142, max=552, avg=308.87, stdev=152.44 clat percentiles (msec): | 1.00th=[ 142], 5.00th=[ 142], 10.00th=[ 142], 20.00th=[ 146], | 30.00th=[ 169], 40.00th=[ 194], 50.00th=[ 279], 60.00th=[ 292], | 70.00th=[ 368], 80.00th=[ 435], 90.00th=[ 514], 95.00th=[ 550], | 99.00th=[ 550], 99.50th=[ 550], 99.90th=[ 550], 99.95th=[ 550], | 99.99th=[ 550] bw ( KiB/s): min= 1822, max= 4015, per=35.69%, avg=2641.33, stdev=1054.83, samples=6 iops : min= 1, max= 3, avg= 1.67, stdev= 1.03, samples=6 lat (msec) : 250=33.33%, 500=50.00%, 750=16.67% cpu : usr=0.00%, sys=10.17%, ctx=134, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179222: Tue Sep 22 15:54:48 2026 read: IOPS=1, BW=1645KiB/s (1685kB/s)(6144KiB/3734msec) clat (msec): min=59, max=524, avg=196.74, stdev=170.07 lat (msec): min=59, max=524, avg=196.74, stdev=170.07 clat percentiles (msec): | 1.00th=[ 60], 5.00th=[ 60], 10.00th=[ 60], 20.00th=[ 104], | 30.00th=[ 104], 40.00th=[ 104], 50.00th=[ 104], 60.00th=[ 176], | 70.00th=[ 215], 80.00th=[ 215], 90.00th=[ 527], 95.00th=[ 527], | 99.00th=[ 527], 99.50th=[ 527], 99.90th=[ 527], 99.95th=[ 527], | 99.99th=[ 527] bw ( KiB/s): min= 2007, max= 3938, per=47.31%, avg=2500.75, stdev=958.29, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 write: IOPS=1, BW=1645KiB/s (1685kB/s)(6144KiB/3734msec); 0 zone resets clat (msec): min=206, max=584, avg=406.73, stdev=126.04 lat (msec): min=206, max=584, avg=406.85, stdev=126.03 clat percentiles (msec): | 1.00th=[ 207], 5.00th=[ 207], 10.00th=[ 207], 20.00th=[ 347], | 30.00th=[ 347], 40.00th=[ 405], 50.00th=[ 405], 60.00th=[ 439], | 70.00th=[ 460], 80.00th=[ 460], 90.00th=[ 584], 95.00th=[ 584], | 99.00th=[ 584], 99.50th=[ 584], 99.90th=[ 584], 99.95th=[ 584], | 99.99th=[ 584] bw ( KiB/s): min= 1992, max= 4015, per=39.41%, avg=2916.50, stdev=1065.11, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 1.15, samples=4 lat (msec) : 100=8.33%, 250=41.67%, 500=33.33%, 750=16.67% cpu : usr=0.00%, sys=8.14%, ctx=114, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179223: Tue Sep 22 15:54:48 2026 read: IOPS=1, BW=1335KiB/s (1367kB/s)(5120KiB/3834msec) clat (msec): min=49, max=422, avg=228.67, stdev=173.96 lat (msec): min=49, max=422, avg=228.67, stdev=173.96 clat percentiles (msec): | 1.00th=[ 50], 5.00th=[ 50], 10.00th=[ 50], 20.00th=[ 50], | 30.00th=[ 129], 40.00th=[ 129], 50.00th=[ 136], 60.00th=[ 136], | 70.00th=[ 409], 80.00th=[ 409], 90.00th=[ 422], 95.00th=[ 422], | 99.00th=[ 422], 99.50th=[ 422], 99.90th=[ 422], 99.95th=[ 422], | 99.99th=[ 422] bw ( KiB/s): min= 2007, max= 4087, per=51.14%, avg=2703.00, stdev=1198.59, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 write: IOPS=1, BW=1870KiB/s (1914kB/s)(7168KiB/3834msec); 0 zone resets clat (msec): min=87, max=770, avg=339.80, stdev=261.39 lat (msec): min=88, max=770, avg=340.24, stdev=261.70 clat percentiles (msec): | 1.00th=[ 88], 5.00th=[ 88], 10.00th=[ 88], 20.00th=[ 113], | 30.00th=[ 120], 40.00th=[ 120], 50.00th=[ 330], 60.00th=[ 376], | 70.00th=[ 376], 80.00th=[ 584], 90.00th=[ 768], 95.00th=[ 768], | 99.00th=[ 768], 99.50th=[ 768], 99.90th=[ 768], 99.95th=[ 768], | 99.99th=[ 768] bw ( KiB/s): min= 1822, max= 3938, per=33.04%, avg=2445.50, stdev=998.99, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (msec) : 50=8.33%, 100=8.33%, 250=33.33%, 500=33.33%, 750=8.33% lat (msec) : 1000=8.33% cpu : usr=0.00%, sys=6.60%, ctx=97, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5287KiB/s (5413kB/s), 529KiB/s-1890KiB/s (541kB/s-1936kB/s), io=20.0MiB (20.0MB), run=3734-3874msec WRITE: bw=7401KiB/s (7579kB/s), 1350KiB/s-2643KiB/s (1383kB/s-2707kB/s), io=28.0MiB (29.4MB), run=3734-3874msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179229: Tue Sep 22 15:54:58 2026 read: IOPS=1, BW=7943KiB/s (8134kB/s)(12.0MiB/1547msec) clat (msec): min=426, max=552, avg=485.08, stdev=63.27 lat (msec): min=426, max=552, avg=485.09, stdev=63.27 clat percentiles (msec): | 1.00th=[ 426], 5.00th=[ 426], 10.00th=[ 426], 20.00th=[ 426], | 30.00th=[ 426], 40.00th=[ 477], 50.00th=[ 477], 60.00th=[ 477], | 70.00th=[ 550], 80.00th=[ 550], 90.00th=[ 550], 95.00th=[ 550], | 99.00th=[ 550], 99.50th=[ 550], 99.90th=[ 550], 99.95th=[ 550], | 99.99th=[ 550] bw ( KiB/s): min= 7111, max= 8192, per=97.33%, avg=7651.50, stdev=764.38, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 500=66.67%, 750=33.33% cpu : usr=0.00%, sys=20.89%, ctx=478, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179230: Tue Sep 22 15:54:58 2026 read: IOPS=0, BW=1965KiB/s (2013kB/s)(4096KiB/2084msec) clat (nsec): min=508567k, max=508567k, avg=508567446.00, stdev= 0.00 lat (nsec): min=508572k, max=508572k, avg=508571927.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 510], 5.00th=[ 510], 10.00th=[ 510], 20.00th=[ 510], | 30.00th=[ 510], 40.00th=[ 510], 50.00th=[ 510], 60.00th=[ 510], | 70.00th=[ 510], 80.00th=[ 510], 90.00th=[ 510], 95.00th=[ 510], | 99.00th=[ 510], 99.50th=[ 510], 99.90th=[ 510], 99.95th=[ 510], | 99.99th=[ 510] bw ( KiB/s): min= 6068, max= 6068, per=77.19%, avg=6068.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=3931KiB/s (4025kB/s)(8192KiB/2084msec); 0 zone resets clat (msec): min=602, max=855, avg=729.47, stdev=178.87 lat (msec): min=604, max=856, avg=730.41, stdev=178.19 clat percentiles (msec): | 1.00th=[ 600], 5.00th=[ 600], 10.00th=[ 600], 20.00th=[ 600], | 30.00th=[ 600], 40.00th=[ 600], 50.00th=[ 600], 60.00th=[ 860], | 70.00th=[ 860], 80.00th=[ 860], 90.00th=[ 860], 95.00th=[ 860], | 99.00th=[ 860], 99.50th=[ 860], 99.90th=[ 860], 99.95th=[ 860], | 99.99th=[ 860] bw ( KiB/s): min= 8126, max= 8126, per=59.20%, avg=8126.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=66.67%, 1000=33.33% cpu : usr=0.00%, sys=8.59%, ctx=156, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179232: Tue Sep 22 15:54:58 2026 write: IOPS=1, BW=5705KiB/s (5842kB/s)(12.0MiB/2154msec); 0 zone resets clat (msec): min=407, max=1047, avg=674.60, stdev=333.01 lat (msec): min=408, max=1055, avg=677.76, stdev=337.19 clat percentiles (msec): | 1.00th=[ 409], 5.00th=[ 409], 10.00th=[ 409], 20.00th=[ 409], | 30.00th=[ 409], 40.00th=[ 567], 50.00th=[ 567], 60.00th=[ 567], | 70.00th=[ 1045], 80.00th=[ 1045], 90.00th=[ 1045], 95.00th=[ 1045], | 99.00th=[ 1045], 99.50th=[ 1045], 99.90th=[ 1045], 99.95th=[ 1045], | 99.99th=[ 1045] bw ( KiB/s): min= 8126, max= 8159, per=59.32%, avg=8142.50, stdev=23.33, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.00%, sys=6.32%, ctx=65, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179233: Tue Sep 22 15:54:58 2026 write: IOPS=1, BW=5148KiB/s (5271kB/s)(12.0MiB/2387msec); 0 zone resets clat (msec): min=390, max=1468, avg=767.60, stdev=607.82 lat (msec): min=391, max=1469, avg=768.14, stdev=607.75 clat percentiles (msec): | 1.00th=[ 393], 5.00th=[ 393], 10.00th=[ 393], 20.00th=[ 393], | 30.00th=[ 393], 40.00th=[ 443], 50.00th=[ 443], 60.00th=[ 443], | 70.00th=[ 1469], 80.00th=[ 1469], 90.00th=[ 1469], 95.00th=[ 1469], | 99.00th=[ 1469], 99.50th=[ 1469], 99.90th=[ 1469], 99.95th=[ 1469], | 99.99th=[ 1469] bw ( KiB/s): min= 6770, max= 8192, per=54.50%, avg=7481.00, stdev=1005.51, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 500=66.67%, 2000=33.33% cpu : usr=0.00%, sys=5.83%, ctx=45, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=7862KiB/s (8050kB/s), 1965KiB/s-7943KiB/s (2013kB/s-8134kB/s), io=16.0MiB (16.8MB), run=1547-2084msec WRITE: bw=13.4MiB/s (14.1MB/s), 3931KiB/s-5705KiB/s (4025kB/s-5842kB/s), io=32.0MiB (33.6MB), run=2084-2387msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179234: Tue Sep 22 15:54:58 2026 read: IOPS=1, BW=7103KiB/s (7273kB/s)(12.0MiB/1730msec) clat (msec): min=546, max=558, avg=554.24, stdev= 6.71 lat (msec): min=546, max=558, avg=554.24, stdev= 6.71 clat percentiles (msec): | 1.00th=[ 550], 5.00th=[ 550], 10.00th=[ 550], 20.00th=[ 550], | 30.00th=[ 550], 40.00th=[ 558], 50.00th=[ 558], 60.00th=[ 558], | 70.00th=[ 558], 80.00th=[ 558], 90.00th=[ 558], 95.00th=[ 558], | 99.00th=[ 558], 99.50th=[ 558], 99.90th=[ 558], 99.95th=[ 558], | 99.99th=[ 558] bw ( KiB/s): min= 6014, max= 8078, per=100.00%, avg=7046.00, stdev=1459.47, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=100.00% cpu : usr=0.00%, sys=6.48%, ctx=49, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179235: Tue Sep 22 15:54:58 2026 read: IOPS=0, BW=1589KiB/s (1628kB/s)(4096KiB/2577msec) clat (nsec): min=1826.8M, max=1826.8M, avg=1826849793.00, stdev= 0.00 lat (nsec): min=1826.9M, max=1826.9M, avg=1826852250.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1821], 5.00th=[ 1821], 10.00th=[ 1821], 20.00th=[ 1821], | 30.00th=[ 1821], 40.00th=[ 1821], 50.00th=[ 1821], 60.00th=[ 1821], | 70.00th=[ 1821], 80.00th=[ 1821], 90.00th=[ 1821], 95.00th=[ 1821], | 99.00th=[ 1821], 99.50th=[ 1821], 99.90th=[ 1821], 99.95th=[ 1821], | 99.99th=[ 1821] bw ( KiB/s): min= 8094, max= 8094, per=100.00%, avg=8094.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=3179KiB/s (3255kB/s)(8192KiB/2577msec); 0 zone resets clat (msec): min=261, max=348, avg=304.95, stdev=62.04 lat (msec): min=261, max=349, avg=305.27, stdev=61.89 clat percentiles (msec): | 1.00th=[ 262], 5.00th=[ 262], 10.00th=[ 262], 20.00th=[ 262], | 30.00th=[ 262], 40.00th=[ 262], 50.00th=[ 262], 60.00th=[ 351], | 70.00th=[ 351], 80.00th=[ 351], 90.00th=[ 351], 95.00th=[ 351], | 99.00th=[ 351], 99.50th=[ 351], 99.90th=[ 351], 99.95th=[ 351], | 99.99th=[ 351] lat (msec) : 500=66.67%, 2000=33.33% cpu : usr=0.00%, sys=5.67%, ctx=77, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179236: Tue Sep 22 15:54:58 2026 write: IOPS=1, BW=4840KiB/s (4956kB/s)(12.0MiB/2539msec); 0 zone resets clat (msec): min=398, max=1589, avg=820.93, stdev=667.01 lat (msec): min=399, max=1590, avg=821.37, stdev=666.83 clat percentiles (msec): | 1.00th=[ 401], 5.00th=[ 401], 10.00th=[ 401], 20.00th=[ 401], | 30.00th=[ 401], 40.00th=[ 477], 50.00th=[ 477], 60.00th=[ 477], | 70.00th=[ 1586], 80.00th=[ 1586], 90.00th=[ 1586], 95.00th=[ 1586], | 99.00th=[ 1586], 99.50th=[ 1586], 99.90th=[ 1586], 99.95th=[ 1586], | 99.99th=[ 1586] bw ( KiB/s): min= 8094, max= 8094, per=63.76%, avg=8094.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=66.67%, 2000=33.33% cpu : usr=0.00%, sys=5.91%, ctx=65, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179237: Tue Sep 22 15:54:58 2026 write: IOPS=1, BW=4761KiB/s (4875kB/s)(12.0MiB/2581msec); 0 zone resets clat (msec): min=589, max=1130, avg=814.25, stdev=281.79 lat (msec): min=589, max=1130, avg=814.69, stdev=281.84 clat percentiles (msec): | 1.00th=[ 592], 5.00th=[ 592], 10.00th=[ 592], 20.00th=[ 592], | 30.00th=[ 592], 40.00th=[ 726], 50.00th=[ 726], 60.00th=[ 726], | 70.00th=[ 1133], 80.00th=[ 1133], 90.00th=[ 1133], 95.00th=[ 1133], | 99.00th=[ 1133], 99.50th=[ 1133], 99.90th=[ 1133], 99.95th=[ 1133], | 99.99th=[ 1133] bw ( KiB/s): min= 8078, max= 8175, per=64.01%, avg=8126.50, stdev=68.59, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=66.67%, 2000=33.33% cpu : usr=0.00%, sys=4.61%, ctx=51, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=6358KiB/s (6510kB/s), 1589KiB/s-7103KiB/s (1628kB/s-7273kB/s), io=16.0MiB (16.8MB), run=1730-2577msec WRITE: bw=12.4MiB/s (13.0MB/s), 3179KiB/s-4840KiB/s (3255kB/s-4956kB/s), io=32.0MiB (33.6MB), run=2539-2581msec