== sanity test 398b: DIO and buffer IO race ============== 13:12:47 (1785949967) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 10.93 s, 4.6 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144002: Wed Aug 5 13:16:48 2026 read: IOPS=7, BW=29.8KiB/s (30.5kB/s)(5992KiB/201239msec) clat (usec): min=27, max=1363.5k, avg=67820.03, stdev=67864.78 lat (usec): min=27, max=1363.6k, avg=67823.27, stdev=67863.45 clat percentiles (usec): | 1.00th=[ 46], 5.00th=[ 58], 10.00th=[ 1385], | 20.00th=[ 30016], 30.00th=[ 39060], 40.00th=[ 47449], | 50.00th=[ 56886], 60.00th=[ 67634], 70.00th=[ 81265], | 80.00th=[ 99091], 90.00th=[ 126354], 95.00th=[ 152044], | 99.00th=[ 229639], 99.50th=[ 350225], 99.90th=[1166017], | 99.95th=[1367344], 99.99th=[1367344] bw ( KiB/s): min= 7, max= 84, per=25.65%, avg=30.52, stdev=14.15, samples=378 iops : min= 1, max= 21, avg= 6.96, stdev= 3.57, samples=378 write: IOPS=7, BW=31.3KiB/s (32.0kB/s)(6296KiB/201239msec); 0 zone resets clat (usec): min=1012, max=430971, avg=62991.44, stdev=64906.84 lat (usec): min=1012, max=430972, avg=62993.74, stdev=64906.94 clat percentiles (usec): | 1.00th=[ 1123], 5.00th=[ 1270], 10.00th=[ 1434], 20.00th=[ 6390], | 30.00th=[ 14615], 40.00th=[ 30016], 50.00th=[ 46400], 60.00th=[ 61604], | 70.00th=[ 82314], 80.00th=[107480], 90.00th=[149947], 95.00th=[191890], | 99.00th=[291505], 99.50th=[337642], 99.90th=[417334], 99.95th=[429917], | 99.99th=[429917] bw ( KiB/s): min= 7, max= 86, per=25.36%, avg=31.45, stdev=16.51, samples=385 iops : min= 1, max= 21, avg= 7.21, stdev= 4.19, samples=385 lat (usec) : 50=1.01%, 100=3.29%, 250=0.33%, 500=0.07%, 750=0.07% lat (usec) : 1000=0.03% lat (msec) : 2=6.41%, 4=1.56%, 10=5.47%, 20=5.70%, 50=23.47% lat (msec) : 100=31.25%, 250=20.08%, 500=1.14%, 750=0.07%, 2000=0.07% cpu : usr=0.05%, sys=3.33%, ctx=6198, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144006: Wed Aug 5 13:16:48 2026 read: IOPS=7, BW=29.6KiB/s (30.3kB/s)(5940KiB/200746msec) clat (usec): min=26, max=401700, avg=65482.61, stdev=49042.81 lat (usec): min=26, max=401700, avg=65483.86, stdev=49042.82 clat percentiles (usec): | 1.00th=[ 47], 5.00th=[ 58], 10.00th=[ 13042], 20.00th=[ 29754], | 30.00th=[ 39060], 40.00th=[ 47449], 50.00th=[ 55313], 60.00th=[ 66323], | 70.00th=[ 79168], 80.00th=[ 96994], 90.00th=[124257], 95.00th=[152044], | 99.00th=[242222], 99.50th=[295699], 99.90th=[371196], 99.95th=[400557], | 99.99th=[400557] bw ( KiB/s): min= 7, max= 79, per=25.09%, avg=29.85, stdev=15.37, samples=383 iops : min= 1, max= 19, avg= 6.80, stdev= 3.90, samples=383 write: IOPS=7, BW=31.6KiB/s (32.4kB/s)(6348KiB/200746msec); 0 zone resets clat (usec): min=979, max=1347.9k, avg=64957.60, stdev=78930.92 lat (usec): min=979, max=1347.9k, avg=64960.02, stdev=78930.31 clat percentiles (usec): | 1.00th=[ 1090], 5.00th=[ 1221], 10.00th=[ 1369], | 20.00th=[ 5669], 30.00th=[ 12518], 40.00th=[ 29754], | 50.00th=[ 47973], 60.00th=[ 65274], 70.00th=[ 83362], | 80.00th=[ 106431], 90.00th=[ 149947], 95.00th=[ 198181], | 99.00th=[ 308282], 99.50th=[ 358613], 99.90th=[ 901776], | 99.95th=[1350566], 99.99th=[1350566] bw ( KiB/s): min= 7, max= 87, per=25.59%, avg=31.74, stdev=16.38, samples=385 iops : min= 1, max= 21, avg= 7.27, stdev= 4.13, samples=385 lat (usec) : 50=1.01%, 100=3.16%, 250=0.13%, 500=0.07%, 1000=0.13% lat (msec) : 2=7.06%, 4=1.33%, 10=5.73%, 20=5.05%, 50=23.47% lat (msec) : 100=32.13%, 250=19.17%, 500=1.43%, 750=0.03%, 1000=0.07% lat (msec) : 2000=0.03% cpu : usr=0.04%, sys=3.39%, ctx=6198, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144008: Wed Aug 5 13:16:48 2026 read: IOPS=7, BW=29.9KiB/s (30.6kB/s)(6028KiB/201464msec) clat (usec): min=28, max=872787, avg=65892.62, stdev=54099.89 lat (usec): min=28, max=872788, avg=65893.88, stdev=54099.92 clat percentiles (usec): | 1.00th=[ 45], 5.00th=[ 56], 10.00th=[ 13042], 20.00th=[ 29754], | 30.00th=[ 38011], 40.00th=[ 46400], 50.00th=[ 55837], 60.00th=[ 65799], | 70.00th=[ 79168], 80.00th=[ 96994], 90.00th=[127402], 95.00th=[158335], | 99.00th=[229639], 99.50th=[291505], 99.90th=[501220], 99.95th=[876610], | 99.99th=[876610] bw ( KiB/s): min= 7, max= 88, per=25.32%, avg=30.13, stdev=15.04, samples=386 iops : min= 1, max= 22, avg= 6.87, stdev= 3.80, samples=386 write: IOPS=7, BW=31.1KiB/s (31.8kB/s)(6260KiB/201464msec); 0 zone resets clat (usec): min=1004, max=1342.0k, avg=65002.25, stdev=72767.41 lat (usec): min=1006, max=1342.0k, avg=65008.21, stdev=72770.01 clat percentiles (usec): | 1.00th=[ 1106], 5.00th=[ 1237], 10.00th=[ 1369], | 20.00th=[ 5932], 30.00th=[ 14091], 40.00th=[ 30540], | 50.00th=[ 49021], 60.00th=[ 66323], 70.00th=[ 85459], | 80.00th=[ 110625], 90.00th=[ 152044], 95.00th=[ 193987], | 99.00th=[ 270533], 99.50th=[ 320865], 99.90th=[ 530580], | 99.95th=[1333789], 99.99th=[1333789] bw ( KiB/s): min= 7, max= 95, per=25.31%, avg=31.38, stdev=15.59, samples=385 iops : min= 1, max= 23, avg= 7.18, stdev= 3.94, samples=385 lat (usec) : 50=1.33%, 100=3.03%, 250=0.13%, 750=0.07% lat (msec) : 2=6.77%, 4=1.50%, 10=5.40%, 20=5.05%, 50=24.22% lat (msec) : 100=31.22%, 250=20.08%, 500=1.07%, 750=0.07%, 1000=0.03% lat (msec) : 2000=0.03% cpu : usr=0.05%, sys=3.18%, ctx=6077, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144009: Wed Aug 5 13:16:48 2026 read: IOPS=7, BW=30.8KiB/s (31.5kB/s)(6052KiB/196781msec) clat (usec): min=33, max=665945, avg=63966.35, stdev=51892.36 lat (usec): min=33, max=665947, avg=63968.56, stdev=51892.64 clat percentiles (usec): | 1.00th=[ 44], 5.00th=[ 55], 10.00th=[ 92], 20.00th=[ 28967], | 30.00th=[ 37487], 40.00th=[ 45876], 50.00th=[ 54264], 60.00th=[ 65274], | 70.00th=[ 76022], 80.00th=[ 92799], 90.00th=[123208], 95.00th=[145753], | 99.00th=[244319], 99.50th=[325059], 99.90th=[463471], 99.95th=[666895], | 99.99th=[666895] bw ( KiB/s): min= 7, max= 87, per=26.74%, avg=31.82, stdev=15.18, samples=367 iops : min= 1, max= 21, avg= 7.29, stdev= 3.84, samples=367 write: IOPS=7, BW=31.7KiB/s (32.5kB/s)(6236KiB/196781msec); 0 zone resets clat (usec): min=1003, max=1365.2k, avg=63899.80, stdev=72510.19 lat (usec): min=1003, max=1365.2k, avg=63905.44, stdev=72508.31 clat percentiles (usec): | 1.00th=[ 1090], 5.00th=[ 1237], 10.00th=[ 1401], | 20.00th=[ 6128], 30.00th=[ 12649], 40.00th=[ 29230], | 50.00th=[ 46924], 60.00th=[ 64750], 70.00th=[ 86508], | 80.00th=[ 110625], 90.00th=[ 147850], 95.00th=[ 191890], | 99.00th=[ 270533], 99.50th=[ 333448], 99.90th=[ 434111], | 99.95th=[1367344], 99.99th=[1367344] bw ( KiB/s): min= 7, max= 91, per=25.75%, avg=31.93, stdev=16.79, samples=376 iops : min= 1, max= 22, avg= 7.32, stdev= 4.24, samples=376 lat (usec) : 50=1.30%, 100=3.65%, 250=0.07%, 500=0.10%, 750=0.03% lat (usec) : 1000=0.03% lat (msec) : 2=6.45%, 4=1.66%, 10=5.70%, 20=5.89%, 50=23.14% lat (msec) : 100=31.05%, 250=19.73%, 500=1.14%, 750=0.03%, 2000=0.03% cpu : usr=0.05%, sys=3.28%, ctx=6008, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=119KiB/s (122kB/s), 29.6KiB/s-30.8KiB/s (30.3kB/s-31.5kB/s), io=23.4MiB (24.6MB), run=196781-201464msec WRITE: bw=125KiB/s (128kB/s), 31.1KiB/s-31.7KiB/s (31.8kB/s-32.5kB/s), io=24.6MiB (25.7MB), run=196781-201464msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144003: Wed Aug 5 13:19:53 2026 read: IOPS=3, BW=15.6KiB/s (15.9kB/s)(5992KiB/384995msec) clat (msec): min=5, max=1414, avg=52.75, stdev=72.70 lat (msec): min=5, max=1414, avg=52.75, stdev=72.70 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 16], | 30.00th=[ 20], 40.00th=[ 24], 50.00th=[ 29], 60.00th=[ 36], | 70.00th=[ 50], 80.00th=[ 74], 90.00th=[ 117], 95.00th=[ 171], | 99.00th=[ 326], 99.50th=[ 380], 99.90th=[ 676], 99.95th=[ 1418], | 99.99th=[ 1418] bw ( KiB/s): min= 7, max= 72, per=32.12%, avg=19.92, stdev=14.04, samples=576 iops : min= 1, max= 18, avg= 4.35, stdev= 3.54, samples=576 write: IOPS=4, BW=16.4KiB/s (16.7kB/s)(6296KiB/384995msec); 0 zone resets clat (msec): min=35, max=1169, avg=194.13, stdev=109.37 lat (msec): min=35, max=1169, avg=194.13, stdev=109.37 clat percentiles (msec): | 1.00th=[ 53], 5.00th=[ 72], 10.00th=[ 87], 20.00th=[ 108], | 30.00th=[ 126], 40.00th=[ 148], 50.00th=[ 169], 60.00th=[ 194], | 70.00th=[ 226], 80.00th=[ 271], 90.00th=[ 334], 95.00th=[ 397], | 99.00th=[ 550], 99.50th=[ 609], 99.90th=[ 953], 99.95th=[ 1167], | 99.99th=[ 1167] bw ( KiB/s): min= 7, max= 55, per=25.70%, avg=16.71, stdev= 9.15, samples=715 iops : min= 1, max= 13, avg= 3.53, stdev= 2.35, samples=715 lat (msec) : 10=2.80%, 20=12.66%, 50=19.08%, 100=16.11%, 250=36.17% lat (msec) : 500=12.24%, 750=0.81%, 1000=0.07%, 2000=0.07% cpu : usr=0.03%, sys=0.87%, ctx=5060, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144004: Wed Aug 5 13:19:53 2026 read: IOPS=3, BW=15.4KiB/s (15.8kB/s)(5940KiB/386151msec) clat (msec): min=5, max=1454, avg=49.47, stdev=67.19 lat (msec): min=5, max=1454, avg=49.47, stdev=67.19 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 16], | 30.00th=[ 20], 40.00th=[ 23], 50.00th=[ 28], 60.00th=[ 35], | 70.00th=[ 48], 80.00th=[ 71], 90.00th=[ 116], 95.00th=[ 150], | 99.00th=[ 279], 99.50th=[ 338], 99.90th=[ 726], 99.95th=[ 1452], | 99.99th=[ 1452] bw ( KiB/s): min= 7, max= 126, per=32.58%, avg=20.20, stdev=14.96, samples=562 iops : min= 1, max= 31, avg= 4.41, stdev= 3.78, samples=562 write: IOPS=4, BW=16.4KiB/s (16.8kB/s)(6348KiB/386151msec); 0 zone resets clat (msec): min=33, max=1015, avg=196.74, stdev=117.11 lat (msec): min=33, max=1015, avg=196.75, stdev=117.11 clat percentiles (msec): | 1.00th=[ 47], 5.00th=[ 71], 10.00th=[ 82], 20.00th=[ 107], | 30.00th=[ 128], 40.00th=[ 146], 50.00th=[ 163], 60.00th=[ 190], | 70.00th=[ 228], 80.00th=[ 275], 90.00th=[ 351], 95.00th=[ 422], | 99.00th=[ 592], 99.50th=[ 701], 99.90th=[ 936], 99.95th=[ 1020], | 99.99th=[ 1020] bw ( KiB/s): min= 7, max= 55, per=26.22%, avg=17.04, stdev= 9.39, samples=707 iops : min= 1, max= 13, avg= 3.62, stdev= 2.42, samples=707 lat (msec) : 10=2.70%, 20=12.76%, 50=19.79%, 100=15.69%, 250=36.00% lat (msec) : 500=11.62%, 750=1.24%, 1000=0.13%, 2000=0.07% cpu : usr=0.02%, sys=0.85%, ctx=5027, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144005: Wed Aug 5 13:19:53 2026 read: IOPS=3, BW=15.7KiB/s (16.1kB/s)(6028KiB/383436msec) clat (msec): min=5, max=533, avg=51.02, stdev=58.23 lat (msec): min=5, max=533, avg=51.02, stdev=58.23 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 13], 20.00th=[ 16], | 30.00th=[ 20], 40.00th=[ 23], 50.00th=[ 29], 60.00th=[ 37], | 70.00th=[ 51], 80.00th=[ 77], 90.00th=[ 120], 95.00th=[ 167], | 99.00th=[ 300], 99.50th=[ 359], 99.90th=[ 498], 99.95th=[ 535], | 99.99th=[ 535] bw ( KiB/s): min= 7, max= 95, per=31.74%, avg=19.68, stdev=14.89, samples=586 iops : min= 1, max= 23, avg= 4.28, stdev= 3.76, samples=586 write: IOPS=4, BW=16.3KiB/s (16.7kB/s)(6260KiB/383436msec); 0 zone resets clat (msec): min=33, max=1587, avg=195.59, stdev=117.37 lat (msec): min=33, max=1587, avg=195.60, stdev=117.36 clat percentiles (msec): | 1.00th=[ 50], 5.00th=[ 72], 10.00th=[ 87], 20.00th=[ 109], | 30.00th=[ 130], 40.00th=[ 148], 50.00th=[ 169], 60.00th=[ 192], | 70.00th=[ 228], 80.00th=[ 271], 90.00th=[ 334], 95.00th=[ 397], | 99.00th=[ 542], 99.50th=[ 676], 99.90th=[ 1569], 99.95th=[ 1586], | 99.99th=[ 1586] bw ( KiB/s): min= 7, max= 56, per=25.75%, avg=16.74, stdev= 9.21, samples=710 iops : min= 1, max= 14, avg= 3.55, stdev= 2.36, samples=710 lat (msec) : 10=2.77%, 20=12.89%, 50=19.11%, 100=15.98%, 250=36.20% lat (msec) : 500=12.21%, 750=0.65%, 1000=0.13%, 2000=0.07% cpu : usr=0.03%, sys=0.87%, ctx=4960, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144007: Wed Aug 5 13:19:53 2026 read: IOPS=3, BW=15.7KiB/s (16.1kB/s)(6052KiB/384296msec) clat (msec): min=4, max=677, avg=52.10, stdev=62.48 lat (msec): min=4, max=677, avg=52.10, stdev=62.48 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 13], 20.00th=[ 17], | 30.00th=[ 20], 40.00th=[ 24], 50.00th=[ 29], 60.00th=[ 37], | 70.00th=[ 48], 80.00th=[ 75], 90.00th=[ 131], 95.00th=[ 169], | 99.00th=[ 268], 99.50th=[ 376], 99.90th=[ 667], 99.95th=[ 676], | 99.99th=[ 676] bw ( KiB/s): min= 7, max= 79, per=32.97%, avg=20.44, stdev=14.79, samples=568 iops : min= 1, max= 19, avg= 4.48, stdev= 3.73, samples=568 write: IOPS=4, BW=16.2KiB/s (16.6kB/s)(6236KiB/384296msec); 0 zone resets clat (msec): min=36, max=1567, avg=195.64, stdev=116.55 lat (msec): min=36, max=1567, avg=195.64, stdev=116.55 clat percentiles (msec): | 1.00th=[ 55], 5.00th=[ 75], 10.00th=[ 86], 20.00th=[ 107], | 30.00th=[ 128], 40.00th=[ 148], 50.00th=[ 171], 60.00th=[ 194], | 70.00th=[ 228], 80.00th=[ 266], 90.00th=[ 334], 95.00th=[ 409], | 99.00th=[ 535], 99.50th=[ 600], 99.90th=[ 1552], 99.95th=[ 1569], | 99.99th=[ 1569] bw ( KiB/s): min= 7, max= 55, per=25.32%, avg=16.46, stdev= 9.08, samples=719 iops : min= 1, max= 13, avg= 3.47, stdev= 2.34, samples=719 lat (msec) : 10=2.70%, 20=12.47%, 50=19.95%, 100=14.84%, 250=38.05% lat (msec) : 500=11.10%, 750=0.72%, 1000=0.07%, 2000=0.10% cpu : usr=0.03%, sys=0.90%, ctx=4923, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=62.2KiB/s (63.7kB/s), 15.4KiB/s-15.7KiB/s (15.8kB/s-16.1kB/s), io=23.4MiB (24.6MB), run=383436-386151msec WRITE: bw=65.1KiB/s (66.7kB/s), 16.2KiB/s-16.4KiB/s (16.6kB/s-16.8kB/s), io=24.6MiB (25.7MB), run=383436-386151msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144086: Wed Aug 5 13:20:51 2026 read: IOPS=9, BW=147KiB/s (150kB/s)(5920KiB/40361msec) clat (usec): min=32, max=284222, avg=55899.49, stdev=48085.57 lat (usec): min=32, max=284224, avg=55900.61, stdev=48085.58 clat percentiles (usec): | 1.00th=[ 40], 5.00th=[ 53], 10.00th=[ 59], 20.00th=[ 77], | 30.00th=[ 33424], 40.00th=[ 40633], 50.00th=[ 49021], 60.00th=[ 58983], | 70.00th=[ 69731], 80.00th=[ 89654], 90.00th=[111674], 95.00th=[149947], | 99.00th=[210764], 99.50th=[274727], 99.90th=[283116], 99.95th=[283116], | 99.99th=[283116] bw ( KiB/s): min= 30, max= 380, per=27.85%, avg=150.12, stdev=77.17, samples=76 iops : min= 1, max= 23, avg= 8.66, stdev= 4.90, samples=76 write: IOPS=9, BW=158KiB/s (162kB/s)(6368KiB/40361msec); 0 zone resets clat (usec): min=1464, max=530118, avg=49248.64, stdev=63388.70 lat (usec): min=1465, max=530121, avg=49252.28, stdev=63388.12 clat percentiles (usec): | 1.00th=[ 1516], 5.00th=[ 1647], 10.00th=[ 1778], 20.00th=[ 5669], | 30.00th=[ 10683], 40.00th=[ 15139], 50.00th=[ 25297], 60.00th=[ 40109], | 70.00th=[ 57410], 80.00th=[ 90702], 90.00th=[126354], 95.00th=[156238], | 99.00th=[261096], 99.50th=[513803], 99.90th=[530580], 99.95th=[530580], | 99.99th=[530580] bw ( KiB/s): min= 30, max= 320, per=28.20%, avg=159.88, stdev=69.72, samples=77 iops : min= 1, max= 20, avg= 9.26, stdev= 4.42, samples=77 lat (usec) : 50=2.08%, 100=8.20%, 250=0.26%, 1000=0.13% lat (msec) : 2=7.29%, 4=1.95%, 10=5.99%, 20=9.24%, 50=23.44% lat (msec) : 100=26.17%, 250=14.32%, 500=0.65%, 750=0.26% cpu : usr=0.05%, sys=3.70%, ctx=1356, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144087: Wed Aug 5 13:20:51 2026 read: IOPS=8, BW=129KiB/s (133kB/s)(5744KiB/44380msec) clat (usec): min=44, max=368628, avg=65291.45, stdev=51162.28 lat (usec): min=44, max=368629, avg=65306.27, stdev=51155.97 clat percentiles (usec): | 1.00th=[ 48], 5.00th=[ 57], 10.00th=[ 65], 20.00th=[ 23200], | 30.00th=[ 39584], 40.00th=[ 49546], 50.00th=[ 59507], 60.00th=[ 73925], | 70.00th=[ 86508], 80.00th=[102237], 90.00th=[121111], 95.00th=[147850], | 99.00th=[235930], 99.50th=[354419], 99.90th=[367002], 99.95th=[367002], | 99.99th=[367002] bw ( KiB/s): min= 30, max= 256, per=24.07%, avg=129.74, stdev=56.53, samples=85 iops : min= 1, max= 16, avg= 7.34, stdev= 3.60, samples=85 write: IOPS=9, BW=147KiB/s (151kB/s)(6544KiB/44380msec); 0 zone resets clat (usec): min=1376, max=254131, avg=50683.71, stdev=55645.54 lat (usec): min=1378, max=254133, avg=50701.13, stdev=55633.03 clat percentiles (usec): | 1.00th=[ 1516], 5.00th=[ 1696], 10.00th=[ 1876], 20.00th=[ 6063], | 30.00th=[ 10028], 40.00th=[ 15795], 50.00th=[ 28705], 60.00th=[ 46400], | 70.00th=[ 67634], 80.00th=[ 91751], 90.00th=[135267], 95.00th=[166724], | 99.00th=[240124], 99.50th=[246416], 99.90th=[254804], 99.95th=[254804], | 99.99th=[254804] bw ( KiB/s): min= 31, max= 345, per=26.19%, avg=148.48, stdev=68.15, samples=84 iops : min= 1, max= 21, avg= 8.54, stdev= 4.34, samples=84 lat (usec) : 50=0.65%, 100=7.03%, 250=0.26%, 500=0.13% lat (msec) : 2=5.99%, 4=2.08%, 10=7.94%, 20=7.81%, 50=20.31% lat (msec) : 100=28.26%, 250=19.01%, 500=0.52% cpu : usr=0.04%, sys=3.41%, ctx=1420, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144088: Wed Aug 5 13:20:51 2026 read: IOPS=9, BW=144KiB/s (148kB/s)(6256KiB/43329msec) clat (usec): min=30, max=437477, avg=59288.29, stdev=49895.39 lat (usec): min=30, max=437478, avg=59289.44, stdev=49895.42 clat percentiles (usec): | 1.00th=[ 39], 5.00th=[ 53], 10.00th=[ 60], 20.00th=[ 857], | 30.00th=[ 34341], 40.00th=[ 44303], 50.00th=[ 54789], 60.00th=[ 65799], | 70.00th=[ 80217], 80.00th=[ 91751], 90.00th=[121111], 95.00th=[139461], | 99.00th=[193987], 99.50th=[287310], 99.90th=[438305], 99.95th=[438305], | 99.99th=[438305] bw ( KiB/s): min= 31, max= 312, per=27.25%, avg=146.90, stdev=57.77, samples=83 iops : min= 1, max= 19, avg= 8.43, stdev= 3.65, samples=83 write: IOPS=8, BW=139KiB/s (143kB/s)(6032KiB/43329msec); 0 zone resets clat (usec): min=1338, max=435655, avg=52937.41, stdev=62492.15 lat (usec): min=1340, max=435658, avg=52942.51, stdev=62490.59 clat percentiles (usec): | 1.00th=[ 1434], 5.00th=[ 1663], 10.00th=[ 1876], 20.00th=[ 5997], | 30.00th=[ 10028], 40.00th=[ 16581], 50.00th=[ 31327], 60.00th=[ 46400], | 70.00th=[ 64750], 80.00th=[ 92799], 90.00th=[137364], 95.00th=[173016], | 99.00th=[299893], 99.50th=[404751], 99.90th=[434111], 99.95th=[434111], | 99.99th=[434111] bw ( KiB/s): min= 30, max= 378, per=24.99%, avg=141.68, stdev=71.62, samples=82 iops : min= 1, max= 23, avg= 8.11, stdev= 4.55, samples=82 lat (usec) : 50=2.08%, 100=7.68%, 250=0.26%, 750=0.13%, 1000=0.13% lat (msec) : 2=5.73%, 4=2.60%, 10=7.03%, 20=6.12%, 50=22.79% lat (msec) : 100=28.65%, 250=15.76%, 500=1.04% cpu : usr=0.05%, sys=3.17%, ctx=1301, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144089: Wed Aug 5 13:20:51 2026 read: IOPS=8, BW=142KiB/s (146kB/s)(6032KiB/42343msec) clat (usec): min=35, max=242044, avg=60472.54, stdev=50241.54 lat (usec): min=36, max=242045, avg=60473.60, stdev=50241.52 clat percentiles (usec): | 1.00th=[ 39], 5.00th=[ 53], 10.00th=[ 59], 20.00th=[ 73], | 30.00th=[ 33424], 40.00th=[ 45876], 50.00th=[ 57934], 60.00th=[ 70779], | 70.00th=[ 81265], 80.00th=[100140], 90.00th=[125305], 95.00th=[145753], | 99.00th=[231736], 99.50th=[238027], 99.90th=[242222], 99.95th=[242222], | 99.99th=[242222] bw ( KiB/s): min= 29, max= 335, per=27.02%, avg=145.66, stdev=67.51, samples=80 iops : min= 1, max= 20, avg= 8.32, stdev= 4.23, samples=80 write: IOPS=9, BW=148KiB/s (151kB/s)(6256KiB/42343msec); 0 zone resets clat (usec): min=1270, max=443440, avg=49407.95, stdev=56286.08 lat (usec): min=1271, max=443442, avg=49418.22, stdev=56280.98 clat percentiles (usec): | 1.00th=[ 1467], 5.00th=[ 1729], 10.00th=[ 4080], 20.00th=[ 7701], | 30.00th=[ 11863], 40.00th=[ 17433], 50.00th=[ 28443], 60.00th=[ 47973], | 70.00th=[ 65274], 80.00th=[ 83362], 90.00th=[120062], 95.00th=[147850], | 99.00th=[258999], 99.50th=[387974], 99.90th=[442500], 99.95th=[442500], | 99.99th=[442500] bw ( KiB/s): min= 30, max= 320, per=26.51%, avg=150.33, stdev=73.85, samples=81 iops : min= 1, max= 20, avg= 8.64, stdev= 4.69, samples=81 lat (usec) : 50=1.82%, 100=9.90%, 250=0.26% lat (msec) : 2=4.56%, 4=0.91%, 10=8.72%, 20=8.33%, 50=17.84% lat (msec) : 100=30.73%, 250=16.41%, 500=0.52% cpu : usr=0.05%, sys=3.20%, ctx=1310, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=540KiB/s (553kB/s), 129KiB/s-147KiB/s (133kB/s-150kB/s), io=23.4MiB (24.5MB), run=40361-44380msec WRITE: bw=568KiB/s (581kB/s), 139KiB/s-158KiB/s (143kB/s-162kB/s), io=24.6MiB (25.8MB), run=40361-44380msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144091: Wed Aug 5 13:21:49 2026 read: IOPS=3, BW=59.5KiB/s (60.9kB/s)(5920KiB/99534msec) clat (msec): min=8, max=551, avg=60.00, stdev=69.79 lat (msec): min=8, max=551, avg=60.00, stdev=69.79 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 13], 10.00th=[ 16], 20.00th=[ 21], | 30.00th=[ 27], 40.00th=[ 31], 50.00th=[ 39], 60.00th=[ 46], | 70.00th=[ 57], 80.00th=[ 79], 90.00th=[ 131], 95.00th=[ 192], | 99.00th=[ 405], 99.50th=[ 493], 99.90th=[ 550], 99.95th=[ 550], | 99.99th=[ 550] bw ( KiB/s): min= 29, max= 317, per=31.65%, avg=74.70, stdev=49.36, samples=155 iops : min= 1, max= 19, avg= 3.85, stdev= 3.15, samples=155 write: IOPS=3, BW=63.0KiB/s (65.5kB/s)(6368KiB/99534msec); 0 zone resets clat (msec): min=33, max=931, avg=194.22, stdev=99.92 lat (msec): min=33, max=931, avg=194.22, stdev=99.92 clat percentiles (msec): | 1.00th=[ 57], 5.00th=[ 80], 10.00th=[ 95], 20.00th=[ 117], | 30.00th=[ 136], 40.00th=[ 150], 50.00th=[ 174], 60.00th=[ 199], | 70.00th=[ 224], 80.00th=[ 259], 90.00th=[ 317], 95.00th=[ 368], | 99.00th=[ 498], 99.50th=[ 609], 99.90th=[ 936], 99.95th=[ 936], | 99.99th=[ 936] bw ( KiB/s): min= 29, max= 224, per=26.87%, avg=66.63, stdev=34.06, samples=187 iops : min= 1, max= 14, avg= 3.34, stdev= 2.20, samples=187 lat (msec) : 10=1.04%, 20=7.81%, 50=22.92%, 100=16.54%, 250=38.80% lat (msec) : 500=12.37%, 750=0.39%, 1000=0.13% cpu : usr=0.03%, sys=0.91%, ctx=1254, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144092: Wed Aug 5 13:21:49 2026 read: IOPS=3, BW=56.6KiB/s (57.0kB/s)(5744KiB/101466msec) clat (msec): min=7, max=472, avg=59.87, stdev=66.02 lat (msec): min=7, max=472, avg=59.87, stdev=66.02 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 13], 10.00th=[ 15], 20.00th=[ 21], | 30.00th=[ 26], 40.00th=[ 30], 50.00th=[ 35], 60.00th=[ 43], | 70.00th=[ 59], 80.00th=[ 83], 90.00th=[ 140], 95.00th=[ 234], | 99.00th=[ 292], 99.50th=[ 355], 99.90th=[ 472], 99.95th=[ 472], | 99.99th=[ 472] bw ( KiB/s): min= 26, max= 224, per=32.55%, avg=76.82, stdev=51.63, samples=145 iops : min= 1, max= 14, avg= 3.99, stdev= 3.25, samples=145 write: IOPS=4, BW=64.5KiB/s (66.0kB/s)(6544KiB/101466msec); 0 zone resets clat (msec): min=40, max=768, avg=195.41, stdev=104.21 lat (msec): min=40, max=768, avg=195.41, stdev=104.21 clat percentiles (msec): | 1.00th=[ 55], 5.00th=[ 74], 10.00th=[ 91], 20.00th=[ 114], | 30.00th=[ 136], 40.00th=[ 155], 50.00th=[ 176], 60.00th=[ 197], | 70.00th=[ 228], 80.00th=[ 262], 90.00th=[ 326], 95.00th=[ 388], | 99.00th=[ 531], 99.50th=[ 735], 99.90th=[ 768], 99.95th=[ 768], | 99.99th=[ 768] bw ( KiB/s): min= 26, max= 224, per=27.55%, avg=68.32, stdev=34.61, samples=186 iops : min= 1, max= 14, avg= 3.46, stdev= 2.24, samples=186 lat (msec) : 10=0.91%, 20=7.94%, 50=22.01%, 100=16.80%, 250=38.15% lat (msec) : 500=13.41%, 750=0.52%, 1000=0.26% cpu : usr=0.02%, sys=0.97%, ctx=1390, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144093: Wed Aug 5 13:21:49 2026 read: IOPS=4, BW=66.7KiB/s (68.3kB/s)(6256KiB/93768msec) clat (msec): min=5, max=549, avg=54.07, stdev=55.63 lat (msec): min=5, max=549, avg=54.07, stdev=55.63 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 13], 10.00th=[ 15], 20.00th=[ 19], | 30.00th=[ 24], 40.00th=[ 27], 50.00th=[ 34], 60.00th=[ 44], | 70.00th=[ 55], 80.00th=[ 80], 90.00th=[ 127], 95.00th=[ 159], | 99.00th=[ 249], 99.50th=[ 334], 99.90th=[ 550], 99.95th=[ 550], | 99.99th=[ 550] bw ( KiB/s): min= 30, max= 318, per=34.41%, avg=81.20, stdev=56.39, samples=151 iops : min= 1, max= 19, avg= 4.26, stdev= 3.56, samples=151 write: IOPS=4, BW=64.3KiB/s (65.9kB/s)(6032KiB/93768msec); 0 zone resets clat (msec): min=52, max=746, avg=192.54, stdev=92.68 lat (msec): min=52, max=746, avg=192.54, stdev=92.68 clat percentiles (msec): | 1.00th=[ 61], 5.00th=[ 78], 10.00th=[ 94], 20.00th=[ 116], | 30.00th=[ 138], 40.00th=[ 161], 50.00th=[ 178], 60.00th=[ 199], | 70.00th=[ 222], 80.00th=[ 255], 90.00th=[ 313], 95.00th=[ 363], | 99.00th=[ 498], 99.50th=[ 609], 99.90th=[ 743], 99.95th=[ 743], | 99.99th=[ 743] bw ( KiB/s): min= 29, max= 190, per=27.25%, avg=67.57, stdev=32.15, samples=174 iops : min= 1, max= 11, avg= 3.41, stdev= 2.10, samples=174 lat (msec) : 10=1.17%, 20=10.42%, 50=22.53%, 100=15.36%, 250=39.84% lat (msec) : 500=10.16%, 750=0.52% cpu : usr=0.02%, sys=0.90%, ctx=1285, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144094: Wed Aug 5 13:21:49 2026 read: IOPS=3, BW=61.0KiB/s (62.5kB/s)(6032KiB/98854msec) clat (msec): min=6, max=461, avg=60.77, stdev=63.00 lat (msec): min=6, max=461, avg=60.78, stdev=63.00 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 13], 10.00th=[ 15], 20.00th=[ 20], | 30.00th=[ 26], 40.00th=[ 32], 50.00th=[ 39], 60.00th=[ 47], | 70.00th=[ 62], 80.00th=[ 87], 90.00th=[ 136], 95.00th=[ 201], | 99.00th=[ 351], 99.50th=[ 372], 99.90th=[ 460], 99.95th=[ 460], | 99.99th=[ 460] bw ( KiB/s): min= 28, max= 285, per=32.89%, avg=77.62, stdev=52.77, samples=151 iops : min= 1, max= 17, avg= 4.03, stdev= 3.33, samples=151 write: IOPS=3, BW=63.3KiB/s (64.8kB/s)(6256KiB/98854msec); 0 zone resets clat (msec): min=43, max=630, avg=194.12, stdev=94.57 lat (msec): min=43, max=630, avg=194.12, stdev=94.58 clat percentiles (msec): | 1.00th=[ 58], 5.00th=[ 78], 10.00th=[ 91], 20.00th=[ 116], | 30.00th=[ 140], 40.00th=[ 155], 50.00th=[ 174], 60.00th=[ 201], | 70.00th=[ 226], 80.00th=[ 259], 90.00th=[ 321], 95.00th=[ 372], | 99.00th=[ 518], 99.50th=[ 542], 99.90th=[ 634], 99.95th=[ 634], | 99.99th=[ 634] bw ( KiB/s): min= 30, max= 160, per=26.57%, avg=65.90, stdev=32.10, samples=185 iops : min= 1, max= 10, avg= 3.30, stdev= 2.09, samples=185 lat (msec) : 10=0.91%, 20=9.51%, 50=20.44%, 100=16.67%, 250=40.10% lat (msec) : 500=11.72%, 750=0.65% cpu : usr=0.03%, sys=0.88%, ctx=1329, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=236KiB/s (242kB/s), 56.6KiB/s-66.7KiB/s (57.0kB/s-68.3kB/s), io=23.4MiB (24.5MB), run=93768-101466msec WRITE: bw=248KiB/s (254kB/s), 63.3KiB/s-64.5KiB/s (64.8kB/s-66.0kB/s), io=24.6MiB (25.8MB), run=93768-101466msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144116: Wed Aug 5 13:22:09 2026 read: IOPS=1, BW=1782KiB/s (1825kB/s)(7168KiB/4023msec) clat (msec): min=114, max=434, avg=214.19, stdev=112.36 lat (msec): min=114, max=434, avg=214.19, stdev=112.36 clat percentiles (msec): | 1.00th=[ 115], 5.00th=[ 115], 10.00th=[ 115], 20.00th=[ 125], | 30.00th=[ 140], 40.00th=[ 140], 50.00th=[ 186], 60.00th=[ 247], | 70.00th=[ 247], 80.00th=[ 255], 90.00th=[ 435], 95.00th=[ 435], | 99.00th=[ 435], 99.50th=[ 435], 99.90th=[ 435], 99.95th=[ 435], | 99.99th=[ 435] bw ( KiB/s): min= 1896, max= 3976, per=98.69%, avg=2966.50, stdev=1150.09, samples=4 iops : min= 1, max= 3, avg= 2.25, stdev= 0.96, samples=4 write: IOPS=1, BW=1273KiB/s (1303kB/s)(5120KiB/4023msec); 0 zone resets clat (msec): min=334, max=672, avg=469.00, stdev=143.03 lat (msec): min=334, max=672, avg=469.08, stdev=143.04 clat percentiles (msec): | 1.00th=[ 334], 5.00th=[ 334], 10.00th=[ 334], 20.00th=[ 334], | 30.00th=[ 380], 40.00th=[ 380], 50.00th=[ 397], 60.00th=[ 397], | 70.00th=[ 567], 80.00th=[ 567], 90.00th=[ 676], 95.00th=[ 676], | 99.00th=[ 676], 99.50th=[ 676], 99.90th=[ 676], 99.95th=[ 676], | 99.99th=[ 676] bw ( KiB/s): min= 1892, max= 2048, per=46.81%, avg=1970.20, stdev=72.35, samples=5 iops : min= 1, max= 2, avg= 1.20, stdev= 0.45, samples=5 lat (msec) : 250=41.67%, 500=41.67%, 750=16.67% cpu : usr=0.00%, sys=1.77%, ctx=49, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144117: Wed Aug 5 13:22:09 2026 read: IOPS=0, BW=301KiB/s (308kB/s)(2048KiB/6811msec) clat (msec): min=144, max=209, avg=176.88, stdev=45.96 lat (msec): min=144, max=209, avg=176.88, stdev=45.96 clat percentiles (msec): | 1.00th=[ 144], 5.00th=[ 144], 10.00th=[ 144], 20.00th=[ 144], | 30.00th=[ 144], 40.00th=[ 144], 50.00th=[ 144], 60.00th=[ 209], | 70.00th=[ 209], 80.00th=[ 209], 90.00th=[ 209], 95.00th=[ 209], | 99.00th=[ 209], 99.50th=[ 209], 99.90th=[ 209], 99.95th=[ 209], | 99.99th=[ 209] bw ( KiB/s): min= 1961, max= 2023, per=66.27%, avg=1992.00, stdev=43.84, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1503KiB/s (1540kB/s)(10.0MiB/6811msec); 0 zone resets clat (msec): min=294, max=2311, avg=637.66, stdev=607.47 lat (msec): min=294, max=2311, avg=637.74, stdev=607.47 clat percentiles (msec): | 1.00th=[ 296], 5.00th=[ 296], 10.00th=[ 296], 20.00th=[ 300], | 30.00th=[ 351], 40.00th=[ 384], 50.00th=[ 405], 60.00th=[ 409], | 70.00th=[ 550], 80.00th=[ 592], 90.00th=[ 793], 95.00th=[ 2299], | 99.00th=[ 2299], 99.50th=[ 2299], 99.90th=[ 2299], 99.95th=[ 2299], | 99.99th=[ 2299] bw ( KiB/s): min= 1892, max= 4096, per=60.93%, avg=2564.57, stdev=996.94, samples=7 iops : min= 1, max= 4, avg= 1.71, stdev= 1.25, samples=7 lat (msec) : 250=16.67%, 500=50.00%, 750=16.67%, 1000=8.33%, >=2000=8.33% cpu : usr=0.01%, sys=1.48%, ctx=52, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144118: Wed Aug 5 13:22:09 2026 read: IOPS=1, BW=1181KiB/s (1209kB/s)(6144KiB/5204msec) clat (msec): min=102, max=742, avg=287.67, stdev=232.28 lat (msec): min=102, max=742, avg=287.68, stdev=232.28 clat percentiles (msec): | 1.00th=[ 104], 5.00th=[ 104], 10.00th=[ 104], 20.00th=[ 169], | 30.00th=[ 169], 40.00th=[ 174], 50.00th=[ 174], 60.00th=[ 241], | 70.00th=[ 296], 80.00th=[ 296], 90.00th=[ 743], 95.00th=[ 743], | 99.00th=[ 743], 99.50th=[ 743], 99.90th=[ 743], 99.95th=[ 743], | 99.99th=[ 743] bw ( KiB/s): min= 1992, max= 3785, per=81.90%, avg=2462.00, stdev=882.30, samples=4 iops : min= 1, max= 3, avg= 1.75, stdev= 0.96, samples=4 write: IOPS=1, BW=1181KiB/s (1209kB/s)(6144KiB/5204msec); 0 zone resets clat (msec): min=334, max=1058, avg=545.68, stdev=271.29 lat (msec): min=334, max=1058, avg=545.90, stdev=271.33 clat percentiles (msec): | 1.00th=[ 334], 5.00th=[ 334], 10.00th=[ 334], 20.00th=[ 372], | 30.00th=[ 372], 40.00th=[ 376], 50.00th=[ 376], 60.00th=[ 550], | 70.00th=[ 584], 80.00th=[ 584], 90.00th=[ 1062], 95.00th=[ 1062], | 99.00th=[ 1062], 99.50th=[ 1062], 99.90th=[ 1062], 99.95th=[ 1062], | 99.99th=[ 1062] bw ( KiB/s): min= 1882, max= 3792, per=55.41%, avg=2332.40, stdev=817.63, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 lat (msec) : 250=33.33%, 500=33.33%, 750=25.00%, 2000=8.33% cpu : usr=0.04%, sys=2.52%, ctx=70, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144119: Wed Aug 5 13:22:09 2026 read: IOPS=1, BW=1058KiB/s (1084kB/s)(5120KiB/4838msec) clat (msec): min=169, max=503, avg=296.42, stdev=135.03 lat (msec): min=169, max=503, avg=296.42, stdev=135.03 clat percentiles (msec): | 1.00th=[ 169], 5.00th=[ 169], 10.00th=[ 169], 20.00th=[ 169], | 30.00th=[ 182], 40.00th=[ 182], 50.00th=[ 313], 60.00th=[ 313], | 70.00th=[ 313], 80.00th=[ 313], 90.00th=[ 506], 95.00th=[ 506], | 99.00th=[ 506], 99.50th=[ 506], 99.90th=[ 506], 99.95th=[ 506], | 99.99th=[ 506] bw ( KiB/s): min= 1892, max= 4047, per=88.57%, avg=2662.33, stdev=1201.69, samples=3 iops : min= 1, max= 3, avg= 2.00, stdev= 1.00, samples=3 write: IOPS=1, BW=1482KiB/s (1517kB/s)(7168KiB/4838msec); 0 zone resets clat (msec): min=253, max=827, avg=449.43, stdev=187.47 lat (msec): min=253, max=827, avg=449.51, stdev=187.47 clat percentiles (msec): | 1.00th=[ 255], 5.00th=[ 255], 10.00th=[ 255], 20.00th=[ 321], | 30.00th=[ 342], 40.00th=[ 342], 50.00th=[ 447], 60.00th=[ 472], | 70.00th=[ 472], 80.00th=[ 481], 90.00th=[ 827], 95.00th=[ 827], | 99.00th=[ 827], 99.50th=[ 827], 99.90th=[ 827], 99.95th=[ 827], | 99.99th=[ 827] bw ( KiB/s): min= 1882, max= 3792, per=53.77%, avg=2263.17, stdev=751.59, samples=6 iops : min= 1, max= 3, avg= 1.50, stdev= 0.84, samples=6 lat (msec) : 250=16.67%, 500=66.67%, 750=8.33%, 1000=8.33% cpu : usr=0.00%, sys=1.82%, ctx=62, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3007KiB/s (3079kB/s), 301KiB/s-1782KiB/s (308kB/s-1825kB/s), io=20.0MiB (20.0MB), run=4023-6811msec WRITE: bw=4210KiB/s (4311kB/s), 1181KiB/s-1503KiB/s (1209kB/s-1540kB/s), io=28.0MiB (29.4MB), run=4023-6811msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144121: Wed Aug 5 13:22:10 2026 read: IOPS=1, BW=1556KiB/s (1593kB/s)(7168KiB/4608msec) clat (usec): min=355, max=2014.9k, avg=435875.15, stdev=710636.26 lat (usec): min=356, max=2014.9k, avg=435876.18, stdev=710636.31 clat percentiles (usec): | 1.00th=[ 355], 5.00th=[ 355], 10.00th=[ 355], | 20.00th=[ 685], 30.00th=[ 120062], 40.00th=[ 120062], | 50.00th=[ 240124], 60.00th=[ 320865], 70.00th=[ 320865], | 80.00th=[ 354419], 90.00th=[2021655], 95.00th=[2021655], | 99.00th=[2021655], 99.50th=[2021655], 99.90th=[2021655], | 99.95th=[2021655], 99.99th=[2021655] bw ( KiB/s): min= 2003, max= 4015, per=63.80%, avg=2835.25, stdev=996.79, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 1.15, samples=4 write: IOPS=1, BW=1111KiB/s (1138kB/s)(5120KiB/4608msec); 0 zone resets clat (msec): min=196, max=382, avg=310.99, stdev=79.15 lat (msec): min=197, max=382, avg=311.07, stdev=79.15 clat percentiles (msec): | 1.00th=[ 197], 5.00th=[ 197], 10.00th=[ 197], 20.00th=[ 197], | 30.00th=[ 262], 40.00th=[ 262], 50.00th=[ 355], 60.00th=[ 355], | 70.00th=[ 363], 80.00th=[ 363], 90.00th=[ 384], 95.00th=[ 384], | 99.00th=[ 384], 99.50th=[ 384], 99.90th=[ 384], 99.95th=[ 384], | 99.99th=[ 384] bw ( KiB/s): min= 2003, max= 4015, per=43.10%, avg=2681.67, stdev=1154.76, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (usec) : 500=8.33%, 750=8.33% lat (msec) : 250=25.00%, 500=50.00%, >=2000=8.33% cpu : usr=0.00%, sys=7.47%, ctx=151, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144122: Wed Aug 5 13:22:10 2026 read: IOPS=0, BW=484KiB/s (496kB/s)(2048KiB/4229msec) clat (usec): min=639, max=497326, avg=248983.14, stdev=351210.87 lat (usec): min=639, max=497328, avg=248983.98, stdev=351211.56 clat percentiles (usec): | 1.00th=[ 644], 5.00th=[ 644], 10.00th=[ 644], 20.00th=[ 644], | 30.00th=[ 644], 40.00th=[ 644], 50.00th=[ 644], 60.00th=[497026], | 70.00th=[497026], 80.00th=[497026], 90.00th=[497026], 95.00th=[497026], | 99.00th=[497026], 99.50th=[497026], 99.90th=[497026], 99.95th=[497026], | 99.99th=[497026] bw ( KiB/s): min= 1747, max= 2015, per=42.33%, avg=1881.00, stdev=189.50, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2421KiB/s (2479kB/s)(10.0MiB/4229msec); 0 zone resets clat (msec): min=220, max=777, avg=372.70, stdev=176.79 lat (msec): min=220, max=777, avg=373.01, stdev=176.75 clat percentiles (msec): | 1.00th=[ 222], 5.00th=[ 222], 10.00th=[ 222], 20.00th=[ 262], | 30.00th=[ 264], 40.00th=[ 279], 50.00th=[ 288], 60.00th=[ 300], | 70.00th=[ 363], 80.00th=[ 388], 90.00th=[ 592], 95.00th=[ 776], | 99.00th=[ 776], 99.50th=[ 776], 99.90th=[ 776], 99.95th=[ 776], | 99.99th=[ 776] bw ( KiB/s): min= 1980, max= 4031, per=47.37%, avg=2947.17, stdev=1045.33, samples=6 iops : min= 1, max= 3, avg= 2.00, stdev= 1.10, samples=6 lat (usec) : 750=8.33% lat (msec) : 250=8.33%, 500=66.67%, 750=8.33%, 1000=8.33% cpu : usr=0.00%, sys=9.79%, ctx=91, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144123: Wed Aug 5 13:22:10 2026 read: IOPS=1, BW=1468KiB/s (1503kB/s)(6144KiB/4185msec) clat (usec): min=567, max=310318, avg=103749.39, stdev=158260.75 lat (usec): min=568, max=310320, avg=103750.53, stdev=158260.94 clat percentiles (usec): | 1.00th=[ 570], 5.00th=[ 570], 10.00th=[ 570], 20.00th=[ 586], | 30.00th=[ 586], 40.00th=[ 1778], 50.00th=[ 1778], 60.00th=[ 3458], | 70.00th=[304088], 80.00th=[304088], 90.00th=[308282], 95.00th=[308282], | 99.00th=[308282], 99.50th=[308282], 99.90th=[308282], 99.95th=[308282], | 99.99th=[308282] bw ( KiB/s): min= 3631, max= 4031, per=86.21%, avg=3831.00, stdev=282.84, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1468KiB/s (1503kB/s)(6144KiB/4185msec); 0 zone resets clat (msec): min=285, max=1224, avg=593.53, stdev=388.05 lat (msec): min=285, max=1224, avg=593.61, stdev=388.05 clat percentiles (msec): | 1.00th=[ 284], 5.00th=[ 284], 10.00th=[ 284], 20.00th=[ 326], | 30.00th=[ 326], 40.00th=[ 397], 50.00th=[ 397], 60.00th=[ 401], | 70.00th=[ 927], 80.00th=[ 927], 90.00th=[ 1217], 95.00th=[ 1217], | 99.00th=[ 1217], 99.50th=[ 1217], 99.90th=[ 1217], 99.95th=[ 1217], | 99.99th=[ 1217] bw ( KiB/s): min= 1815, max= 2027, per=31.69%, avg=1972.00, stdev=89.71, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 lat (usec) : 750=16.67% lat (msec) : 2=8.33%, 4=8.33%, 500=50.00%, 1000=8.33%, 2000=8.33% cpu : usr=0.00%, sys=5.23%, ctx=91, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144124: Wed Aug 5 13:22:10 2026 read: IOPS=1, BW=1304KiB/s (1335kB/s)(5120KiB/3926msec) clat (usec): min=525, max=258524, avg=107967.76, stdev=130357.47 lat (usec): min=526, max=258525, avg=107968.76, stdev=130357.17 clat percentiles (usec): | 1.00th=[ 529], 5.00th=[ 529], 10.00th=[ 529], 20.00th=[ 529], | 30.00th=[ 594], 40.00th=[ 594], 50.00th=[ 39584], 60.00th=[ 39584], | 70.00th=[240124], 80.00th=[240124], 90.00th=[258999], 95.00th=[258999], | 99.00th=[258999], 99.50th=[258999], 99.90th=[258999], 99.95th=[258999], | 99.99th=[258999] bw ( KiB/s): min= 1815, max= 6047, per=88.46%, avg=3931.00, stdev=2992.48, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 write: IOPS=1, BW=1826KiB/s (1870kB/s)(7168KiB/3926msec); 0 zone resets clat (msec): min=178, max=982, avg=483.55, stdev=329.84 lat (msec): min=178, max=982, avg=483.62, stdev=329.84 clat percentiles (msec): | 1.00th=[ 180], 5.00th=[ 180], 10.00th=[ 180], 20.00th=[ 215], | 30.00th=[ 271], 40.00th=[ 271], 50.00th=[ 372], 60.00th=[ 460], | 70.00th=[ 460], 80.00th=[ 911], 90.00th=[ 986], 95.00th=[ 986], | 99.00th=[ 986], 99.50th=[ 986], 99.90th=[ 986], 99.95th=[ 986], | 99.99th=[ 986] bw ( KiB/s): min= 1484, max= 4055, per=42.43%, avg=2640.00, stdev=1129.38, samples=5 iops : min= 1, max= 3, avg= 1.80, stdev= 1.10, samples=5 lat (usec) : 750=16.67% lat (msec) : 50=8.33%, 250=25.00%, 500=33.33%, 1000=16.67% cpu : usr=0.00%, sys=7.85%, ctx=117, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4444KiB/s (4551kB/s), 484KiB/s-1556KiB/s (496kB/s-1593kB/s), io=20.0MiB (20.0MB), run=3926-4608msec WRITE: bw=6222KiB/s (6372kB/s), 1111KiB/s-2421KiB/s (1138kB/s-2479kB/s), io=28.0MiB (29.4MB), run=3926-4608msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144132: Wed Aug 5 13:22:28 2026 read: IOPS=0, BW=2772KiB/s (2838kB/s)(12.0MiB/4433msec) clat (msec): min=276, max=1934, avg=1307.22, stdev=899.51 lat (msec): min=276, max=1934, avg=1307.22, stdev=899.52 clat percentiles (msec): | 1.00th=[ 275], 5.00th=[ 275], 10.00th=[ 275], 20.00th=[ 275], | 30.00th=[ 275], 40.00th=[ 1703], 50.00th=[ 1703], 60.00th=[ 1703], | 70.00th=[ 1938], 80.00th=[ 1938], 90.00th=[ 1938], 95.00th=[ 1938], | 99.00th=[ 1938], 99.50th=[ 1938], 99.90th=[ 1938], 99.95th=[ 1938], | 99.99th=[ 1938] bw ( KiB/s): min= 8175, max= 8175, per=100.00%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.00%, sys=2.73%, ctx=58, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144133: Wed Aug 5 13:22:28 2026 read: IOPS=0, BW=941KiB/s (963kB/s)(4096KiB/4355msec) clat (nsec): min=941843k, max=941843k, avg=941843223.00, stdev= 0.00 lat (nsec): min=941846k, max=941846k, avg=941846075.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 944], 5.00th=[ 944], 10.00th=[ 944], 20.00th=[ 944], | 30.00th=[ 944], 40.00th=[ 944], 50.00th=[ 944], 60.00th=[ 944], | 70.00th=[ 944], 80.00th=[ 944], 90.00th=[ 944], 95.00th=[ 944], | 99.00th=[ 944], 99.50th=[ 944], 99.90th=[ 944], 99.95th=[ 944], | 99.99th=[ 944] bw ( KiB/s): min= 7968, max= 7968, per=100.00%, avg=7968.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=1881KiB/s (1926kB/s)(8192KiB/4355msec); 0 zone resets clat (msec): min=1477, max=1662, avg=1569.87, stdev=130.84 lat (msec): min=1478, max=1662, avg=1570.57, stdev=130.52 clat percentiles (msec): | 1.00th=[ 1485], 5.00th=[ 1485], 10.00th=[ 1485], 20.00th=[ 1485], | 30.00th=[ 1485], 40.00th=[ 1485], 50.00th=[ 1485], 60.00th=[ 1670], | 70.00th=[ 1670], 80.00th=[ 1670], 90.00th=[ 1670], 95.00th=[ 1670], | 99.00th=[ 1670], 99.50th=[ 1670], 99.90th=[ 1670], 99.95th=[ 1670], | 99.99th=[ 1670] bw ( KiB/s): min= 7684, max= 7684, per=100.00%, avg=7684.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 1000=33.33%, 2000=66.67% cpu : usr=0.00%, sys=2.39%, ctx=46, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144134: Wed Aug 5 13:22:28 2026 write: IOPS=0, BW=4091KiB/s (4189kB/s)(12.0MiB/3004msec); 0 zone resets clat (msec): min=426, max=1927, avg=967.09, stdev=833.98 lat (msec): min=426, max=1927, avg=967.36, stdev=833.90 clat percentiles (msec): | 1.00th=[ 426], 5.00th=[ 426], 10.00th=[ 426], 20.00th=[ 426], | 30.00th=[ 426], 40.00th=[ 550], 50.00th=[ 550], 60.00th=[ 550], | 70.00th=[ 1921], 80.00th=[ 1921], 90.00th=[ 1921], 95.00th=[ 1921], | 99.00th=[ 1921], 99.50th=[ 1921], 99.90th=[ 1921], 99.95th=[ 1921], | 99.99th=[ 1921] bw ( KiB/s): min= 6086, max= 8031, per=93.81%, avg=7058.50, stdev=1375.32, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.00%, sys=2.40%, ctx=58, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144135: Wed Aug 5 13:22:28 2026 write: IOPS=0, BW=3834KiB/s (3926kB/s)(12.0MiB/3205msec); 0 zone resets clat (msec): min=434, max=1313, avg=999.97, stdev=490.48 lat (msec): min=435, max=1316, avg=1001.47, stdev=491.40 clat percentiles (msec): | 1.00th=[ 435], 5.00th=[ 435], 10.00th=[ 435], 20.00th=[ 435], | 30.00th=[ 435], 40.00th=[ 1250], 50.00th=[ 1250], 60.00th=[ 1250], | 70.00th=[ 1318], 80.00th=[ 1318], 90.00th=[ 1318], 95.00th=[ 1318], | 99.00th=[ 1318], 99.50th=[ 1318], 99.90th=[ 1318], 99.95th=[ 1318], | 99.99th=[ 1318] bw ( KiB/s): min= 5505, max= 8175, per=90.91%, avg=6840.00, stdev=1887.98, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.00%, sys=3.56%, ctx=50, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3696KiB/s (3785kB/s), 941KiB/s-2772KiB/s (963kB/s-2838kB/s), io=16.0MiB (16.8MB), run=4355-4433msec WRITE: bw=7524KiB/s (7705kB/s), 1881KiB/s-4091KiB/s (1926kB/s-4189kB/s), io=32.0MiB (33.6MB), run=3004-4355msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144137: Wed Aug 5 13:22:29 2026 read: IOPS=0, BW=3711KiB/s (3800kB/s)(12.0MiB/3311msec) clat (msec): min=866, max=1257, avg=1054.20, stdev=195.60 lat (msec): min=866, max=1257, avg=1054.45, stdev=196.00 clat percentiles (msec): | 1.00th=[ 869], 5.00th=[ 869], 10.00th=[ 869], 20.00th=[ 869], | 30.00th=[ 869], 40.00th=[ 1036], 50.00th=[ 1036], 60.00th=[ 1036], | 70.00th=[ 1250], 80.00th=[ 1250], 90.00th=[ 1250], 95.00th=[ 1250], | 99.00th=[ 1250], 99.50th=[ 1250], 99.90th=[ 1250], 99.95th=[ 1250], | 99.99th=[ 1250] bw ( KiB/s): min= 7922, max= 8175, per=100.00%, avg=8048.50, stdev=178.90, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=33.33%, 2000=66.67% cpu : usr=0.00%, sys=8.67%, ctx=157, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144138: Wed Aug 5 13:22:29 2026 read: IOPS=0, BW=1008KiB/s (1033kB/s)(4096KiB/4062msec) clat (nsec): min=825123k, max=825123k, avg=825123421.00, stdev= 0.00 lat (nsec): min=825126k, max=825126k, avg=825126484.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 827], 5.00th=[ 827], 10.00th=[ 827], 20.00th=[ 827], | 30.00th=[ 827], 40.00th=[ 827], 50.00th=[ 827], 60.00th=[ 827], | 70.00th=[ 827], 80.00th=[ 827], 90.00th=[ 827], 95.00th=[ 827], | 99.00th=[ 827], 99.50th=[ 827], 99.90th=[ 827], 99.95th=[ 827], | 99.99th=[ 827] bw ( KiB/s): min= 8094, max= 8094, per=100.00%, avg=8094.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2017KiB/s (2065kB/s)(8192KiB/4062msec); 0 zone resets clat (msec): min=1496, max=1647, avg=1571.85, stdev=106.44 lat (msec): min=1498, max=1647, avg=1573.12, stdev=105.22 clat percentiles (msec): | 1.00th=[ 1502], 5.00th=[ 1502], 10.00th=[ 1502], 20.00th=[ 1502], | 30.00th=[ 1502], 40.00th=[ 1502], 50.00th=[ 1502], 60.00th=[ 1653], | 70.00th=[ 1653], 80.00th=[ 1653], 90.00th=[ 1653], 95.00th=[ 1653], | 99.00th=[ 1653], 99.50th=[ 1653], 99.90th=[ 1653], 99.95th=[ 1653], | 99.99th=[ 1653] bw ( KiB/s): min= 8159, max= 8159, per=100.00%, avg=8159.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 1000=33.33%, 2000=66.67% cpu : usr=0.00%, sys=2.95%, ctx=129, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144139: Wed Aug 5 13:22:29 2026 write: IOPS=0, BW=2998KiB/s (3070kB/s)(12.0MiB/4099msec); 0 zone resets clat (msec): min=547, max=1779, avg=1346.67, stdev=692.80 lat (msec): min=548, max=1780, avg=1347.12, stdev=692.56 clat percentiles (msec): | 1.00th=[ 550], 5.00th=[ 550], 10.00th=[ 550], 20.00th=[ 550], | 30.00th=[ 550], 40.00th=[ 1720], 50.00th=[ 1720], 60.00th=[ 1720], | 70.00th=[ 1787], 80.00th=[ 1787], 90.00th=[ 1787], 95.00th=[ 1787], | 99.00th=[ 1787], 99.50th=[ 1787], 99.90th=[ 1787], 99.95th=[ 1787], | 99.99th=[ 1787] bw ( KiB/s): min= 8094, max= 8175, per=100.00%, avg=8134.50, stdev=57.28, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 2000=66.67% cpu : usr=0.00%, sys=2.90%, ctx=50, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144140: Wed Aug 5 13:22:29 2026 write: IOPS=1, BW=4190KiB/s (4290kB/s)(12.0MiB/2933msec); 0 zone resets clat (msec): min=379, max=1474, avg=938.67, stdev=548.11 lat (msec): min=379, max=1477, avg=939.87, stdev=549.21 clat percentiles (msec): | 1.00th=[ 380], 5.00th=[ 380], 10.00th=[ 380], 20.00th=[ 380], | 30.00th=[ 380], 40.00th=[ 961], 50.00th=[ 961], 60.00th=[ 961], | 70.00th=[ 1469], 80.00th=[ 1469], 90.00th=[ 1469], 95.00th=[ 1469], | 99.00th=[ 1469], 99.50th=[ 1469], 99.90th=[ 1469], 99.95th=[ 1469], | 99.99th=[ 1469] bw ( KiB/s): min= 8094, max= 8159, per=100.00%, avg=8126.50, stdev=45.96, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=4.50%, ctx=51, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4033KiB/s (4130kB/s), 1008KiB/s-3711KiB/s (1033kB/s-3800kB/s), io=16.0MiB (16.8MB), run=3311-4062msec WRITE: bw=7994KiB/s (8186kB/s), 2017KiB/s-4190KiB/s (2065kB/s-4290kB/s), io=32.0MiB (33.6MB), run=2933-4099msec