== sanity test 398b: DIO and buffer IO race ============== 11:33:45 (1782488025) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 6.54532 s, 7.7 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=151016: Fri Jun 26 11:36:21 2026 read: IOPS=10, BW=43.0KiB/s (45.0kB/s)(5992KiB/136305msec) clat (usec): min=32, max=889681, avg=42747.95, stdev=38056.71 lat (usec): min=32, max=889683, avg=42752.04, stdev=38058.99 clat percentiles (usec): | 1.00th=[ 49], 5.00th=[ 59], 10.00th=[ 103], 20.00th=[ 19268], | 30.00th=[ 25297], 40.00th=[ 30016], 50.00th=[ 36439], 60.00th=[ 44827], | 70.00th=[ 52691], 80.00th=[ 64226], 90.00th=[ 82314], 95.00th=[101188], | 99.00th=[141558], 99.50th=[168821], 99.90th=[274727], 99.95th=[893387], | 99.99th=[893387] bw ( KiB/s): min= 7, max= 102, per=24.90%, avg=43.82, stdev=20.00, samples=267 iops : min= 1, max= 25, avg=10.30, stdev= 5.03, samples=267 write: IOPS=11, BW=46.2KiB/s (47.3kB/s)(6296KiB/136305msec); 0 zone resets clat (usec): min=849, max=369523, avg=45632.00, stdev=47004.20 lat (usec): min=850, max=369525, avg=45645.02, stdev=46995.85 clat percentiles (usec): | 1.00th=[ 1254], 5.00th=[ 1385], 10.00th=[ 1975], 20.00th=[ 5014], | 30.00th=[ 10552], 40.00th=[ 22414], 50.00th=[ 34341], 60.00th=[ 44827], | 70.00th=[ 60031], 80.00th=[ 78119], 90.00th=[107480], 95.00th=[137364], | 99.00th=[200279], 99.50th=[229639], 99.90th=[362808], 99.95th=[371196], | 99.99th=[371196] bw ( KiB/s): min= 7, max= 111, per=24.99%, avg=45.98, stdev=20.70, samples=267 iops : min= 1, max= 27, avg=10.84, stdev= 5.22, samples=267 lat (usec) : 50=0.59%, 100=4.23%, 250=0.39%, 500=0.16%, 1000=0.10% lat (msec) : 2=5.31%, 4=3.74%, 10=6.45%, 20=9.11%, 50=35.29% lat (msec) : 100=26.30%, 250=8.04%, 500=0.26%, 1000=0.03% cpu : usr=0.08%, sys=5.38%, ctx=6556, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=151018: Fri Jun 26 11:36:21 2026 read: IOPS=11, BW=45.3KiB/s (46.4kB/s)(5940KiB/131175msec) clat (usec): min=25, max=391137, avg=42548.50, stdev=32763.23 lat (usec): min=25, max=391139, avg=42553.89, stdev=32763.33 clat percentiles (usec): | 1.00th=[ 50], 5.00th=[ 61], 10.00th=[ 163], 20.00th=[ 20317], | 30.00th=[ 25822], 40.00th=[ 31327], 50.00th=[ 36439], 60.00th=[ 43254], | 70.00th=[ 51643], 80.00th=[ 62653], 90.00th=[ 79168], 95.00th=[ 96994], | 99.00th=[147850], 99.50th=[168821], 99.90th=[299893], 99.95th=[392168], | 99.99th=[392168] bw ( KiB/s): min= 7, max= 101, per=25.53%, avg=44.93, stdev=19.82, samples=258 iops : min= 1, max= 25, avg=10.59, stdev= 5.00, samples=258 write: IOPS=12, BW=48.4KiB/s (49.6kB/s)(6348KiB/131175msec); 0 zone resets clat (usec): min=921, max=862020, avg=42560.01, stdev=47865.18 lat (usec): min=923, max=862022, avg=42570.77, stdev=47862.82 clat percentiles (usec): | 1.00th=[ 1237], 5.00th=[ 1369], 10.00th=[ 1696], 20.00th=[ 4555], | 30.00th=[ 9372], 40.00th=[ 19530], 50.00th=[ 29492], 60.00th=[ 40633], | 70.00th=[ 54264], 80.00th=[ 73925], 90.00th=[100140], 95.00th=[130548], | 99.00th=[187696], 99.50th=[200279], 99.90th=[371196], 99.95th=[859833], | 99.99th=[859833] bw ( KiB/s): min= 7, max= 128, per=26.43%, avg=48.63, stdev=22.03, samples=255 iops : min= 1, max= 32, avg=11.51, stdev= 5.56, samples=255 lat (usec) : 50=0.46%, 100=4.13%, 250=0.26%, 500=0.07%, 750=0.10% lat (usec) : 1000=0.03% lat (msec) : 2=6.22%, 4=3.52%, 10=6.45%, 20=9.11%, 50=36.98% lat (msec) : 100=25.55%, 250=6.90%, 500=0.20%, 1000=0.03% cpu : usr=0.09%, sys=5.45%, ctx=6533, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=151020: Fri Jun 26 11:36:21 2026 read: IOPS=11, BW=44.2KiB/s (45.3kB/s)(6028KiB/136363msec) clat (usec): min=32, max=333405, avg=41325.67, stdev=33015.12 lat (usec): min=32, max=333407, avg=41335.24, stdev=33016.94 clat percentiles (usec): | 1.00th=[ 42], 5.00th=[ 58], 10.00th=[ 89], 20.00th=[ 17957], | 30.00th=[ 23987], 40.00th=[ 28705], 50.00th=[ 34341], 60.00th=[ 41681], | 70.00th=[ 50070], 80.00th=[ 62129], 90.00th=[ 83362], 95.00th=[100140], | 99.00th=[143655], 99.50th=[181404], 99.90th=[254804], 99.95th=[333448], | 99.99th=[333448] bw ( KiB/s): min= 7, max= 135, per=25.04%, avg=44.07, stdev=21.99, samples=266 iops : min= 1, max= 33, avg=10.36, stdev= 5.52, samples=266 write: IOPS=11, BW=45.9KiB/s (47.0kB/s)(6260KiB/136363msec); 0 zone resets clat (usec): min=936, max=1096.4k, avg=47051.79, stdev=53545.33 lat (usec): min=937, max=1096.4k, avg=47054.54, stdev=53545.81 clat percentiles (usec): | 1.00th=[ 1237], 5.00th=[ 1385], 10.00th=[ 2057], | 20.00th=[ 5473], 30.00th=[ 11207], 40.00th=[ 24249], | 50.00th=[ 35914], 60.00th=[ 45876], 70.00th=[ 60031], | 80.00th=[ 78119], 90.00th=[ 111674], 95.00th=[ 139461], | 99.00th=[ 189793], 99.50th=[ 233833], 99.90th=[ 442500], | 99.95th=[1098908], 99.99th=[1098908] bw ( KiB/s): min= 7, max= 109, per=24.86%, avg=45.74, stdev=19.93, samples=266 iops : min= 1, max= 27, avg=10.79, stdev= 5.03, samples=266 lat (usec) : 50=1.14%, 100=3.94%, 250=0.46%, 500=0.13%, 750=0.07% lat (usec) : 1000=0.13% lat (msec) : 2=4.92%, 4=3.91%, 10=6.02%, 20=9.38%, 50=36.69% lat (msec) : 100=24.19%, 250=8.79%, 500=0.23%, 2000=0.03% cpu : usr=0.08%, sys=5.21%, ctx=6467, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=151021: Fri Jun 26 11:36:21 2026 read: IOPS=11, BW=44.0KiB/s (46.1kB/s)(6052KiB/134529msec) clat (usec): min=28, max=874498, avg=44707.87, stdev=40110.86 lat (usec): min=28, max=874499, avg=44710.21, stdev=40110.75 clat percentiles (usec): | 1.00th=[ 43], 5.00th=[ 61], 10.00th=[ 506], 20.00th=[ 19530], | 30.00th=[ 25560], 40.00th=[ 31327], 50.00th=[ 36963], 60.00th=[ 45351], | 70.00th=[ 53740], 80.00th=[ 64750], 90.00th=[ 84411], 95.00th=[103285], | 99.00th=[181404], 99.50th=[204473], 99.90th=[254804], 99.95th=[876610], | 99.99th=[876610] bw ( KiB/s): min= 7, max= 118, per=25.37%, avg=44.65, stdev=20.33, samples=264 iops : min= 1, max= 29, avg=10.51, stdev= 5.15, samples=264 write: IOPS=11, BW=46.4KiB/s (47.5kB/s)(6236KiB/134529msec); 0 zone resets clat (usec): min=1002, max=334374, avg=42630.53, stdev=44638.09 lat (usec): min=1003, max=334379, avg=42634.49, stdev=44636.47 clat percentiles (usec): | 1.00th=[ 1254], 5.00th=[ 1369], 10.00th=[ 1795], 20.00th=[ 4752], | 30.00th=[ 9372], 40.00th=[ 19792], 50.00th=[ 31589], 60.00th=[ 41681], | 70.00th=[ 55837], 80.00th=[ 72877], 90.00th=[101188], 95.00th=[130548], | 99.00th=[191890], 99.50th=[221250], 99.90th=[333448], 99.95th=[333448], | 99.99th=[333448] bw ( KiB/s): min= 7, max= 126, per=25.18%, avg=46.33, stdev=20.81, samples=262 iops : min= 1, max= 31, avg=10.93, stdev= 5.24, samples=262 lat (usec) : 50=0.75%, 100=3.74%, 250=0.33%, 500=0.10%, 750=0.07% lat (usec) : 1000=0.07% lat (msec) : 2=5.60%, 4=3.42%, 10=7.06%, 20=9.64%, 50=35.06% lat (msec) : 100=26.20%, 250=7.75%, 500=0.20%, 1000=0.03% cpu : usr=0.09%, sys=5.47%, ctx=6779, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=176KiB/s (180kB/s), 43.0KiB/s-45.3KiB/s (45.0kB/s-46.4kB/s), io=23.4MiB (24.6MB), run=131175-136363msec WRITE: bw=184KiB/s (189kB/s), 45.9KiB/s-48.4KiB/s (47.0kB/s-49.6kB/s), io=24.6MiB (25.7MB), run=131175-136363msec rand-rw: (groupid=0, jobs=1): err= 0: pid=151015: Fri Jun 26 11:39:21 2026 read: IOPS=4, BW=19.0KiB/s (19.5kB/s)(5992KiB/315245msec) clat (msec): min=5, max=885, avg=38.07, stdev=43.99 lat (msec): min=5, max=885, avg=38.07, stdev=43.99 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 16], | 30.00th=[ 18], 40.00th=[ 22], 50.00th=[ 26], 60.00th=[ 30], | 70.00th=[ 37], 80.00th=[ 50], 90.00th=[ 82], 95.00th=[ 113], | 99.00th=[ 194], 99.50th=[ 239], 99.90th=[ 485], 99.95th=[ 885], | 99.99th=[ 885] bw ( KiB/s): min= 7, max= 112, per=29.08%, avg=21.81, stdev=14.93, samples=529 iops : min= 1, max= 28, avg= 4.83, stdev= 3.76, samples=529 write: IOPS=4, BW=19.0KiB/s (20.5kB/s)(6296KiB/315245msec); 0 zone resets clat (msec): min=37, max=571, avg=163.81, stdev=74.59 lat (msec): min=37, max=571, avg=163.82, stdev=74.60 clat percentiles (msec): | 1.00th=[ 53], 5.00th=[ 73], 10.00th=[ 84], 20.00th=[ 101], | 30.00th=[ 118], 40.00th=[ 132], 50.00th=[ 148], 60.00th=[ 169], | 70.00th=[ 192], 80.00th=[ 220], 90.00th=[ 262], 95.00th=[ 309], | 99.00th=[ 405], 99.50th=[ 443], 99.90th=[ 527], 99.95th=[ 575], | 99.99th=[ 575] bw ( KiB/s): min= 7, max= 63, per=24.97%, avg=19.73, stdev= 8.92, samples=612 iops : min= 1, max= 15, avg= 4.31, stdev= 2.27, samples=612 lat (msec) : 10=2.77%, 20=15.07%, 50=21.74%, 100=16.18%, 250=37.99% lat (msec) : 500=6.12%, 750=0.10%, 1000=0.03% cpu : usr=0.04%, sys=1.17%, ctx=5271, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=151017: Fri Jun 26 11:39:21 2026 read: IOPS=4, BW=18.8KiB/s (19.2kB/s)(5940KiB/316494msec) clat (msec): min=4, max=881, avg=38.06, stdev=44.80 lat (msec): min=4, max=881, avg=38.06, stdev=44.80 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 12], 20.00th=[ 16], | 30.00th=[ 18], 40.00th=[ 22], 50.00th=[ 25], 60.00th=[ 30], | 70.00th=[ 37], 80.00th=[ 51], 90.00th=[ 83], 95.00th=[ 106], | 99.00th=[ 211], 99.50th=[ 259], 99.90th=[ 451], 99.95th=[ 885], | 99.99th=[ 885] bw ( KiB/s): min= 7, max= 102, per=29.58%, avg=22.19, stdev=15.89, samples=515 iops : min= 1, max= 25, avg= 4.92, stdev= 4.01, samples=515 write: IOPS=5, BW=20.1KiB/s (20.5kB/s)(6348KiB/316494msec); 0 zone resets clat (msec): min=36, max=730, avg=163.54, stdev=74.57 lat (msec): min=36, max=730, avg=163.55, stdev=74.57 clat percentiles (msec): | 1.00th=[ 51], 5.00th=[ 70], 10.00th=[ 82], 20.00th=[ 102], | 30.00th=[ 118], 40.00th=[ 134], 50.00th=[ 150], 60.00th=[ 169], | 70.00th=[ 194], 80.00th=[ 218], 90.00th=[ 264], 95.00th=[ 305], | 99.00th=[ 397], 99.50th=[ 439], 99.90th=[ 625], 99.95th=[ 735], | 99.99th=[ 735] bw ( KiB/s): min= 7, max= 56, per=25.16%, avg=19.88, stdev= 8.82, samples=612 iops : min= 1, max= 14, avg= 4.35, stdev= 2.25, samples=612 lat (msec) : 10=2.15%, 20=15.63%, 50=21.29%, 100=16.34%, 250=37.89% lat (msec) : 500=6.61%, 750=0.07%, 1000=0.03% cpu : usr=0.04%, sys=1.18%, ctx=5171, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=151019: Fri Jun 26 11:39:21 2026 read: IOPS=4, BW=19.0KiB/s (19.5kB/s)(6028KiB/316807msec) clat (msec): min=5, max=444, avg=39.17, stdev=41.03 lat (msec): min=5, max=444, avg=39.17, stdev=41.04 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 16], | 30.00th=[ 19], 40.00th=[ 22], 50.00th=[ 26], 60.00th=[ 31], | 70.00th=[ 40], 80.00th=[ 53], 90.00th=[ 84], 95.00th=[ 115], | 99.00th=[ 203], 99.50th=[ 268], 99.90th=[ 397], 99.95th=[ 443], | 99.99th=[ 443] bw ( KiB/s): min= 7, max= 88, per=29.11%, avg=21.84, stdev=15.18, samples=531 iops : min= 1, max= 22, avg= 4.84, stdev= 3.84, samples=531 write: IOPS=4, BW=19.8KiB/s (20.2kB/s)(6260KiB/316807msec); 0 zone resets clat (msec): min=37, max=1079, avg=164.47, stdev=77.11 lat (msec): min=37, max=1079, avg=164.47, stdev=77.12 clat percentiles (msec): | 1.00th=[ 53], 5.00th=[ 72], 10.00th=[ 84], 20.00th=[ 102], | 30.00th=[ 120], 40.00th=[ 134], 50.00th=[ 150], 60.00th=[ 169], | 70.00th=[ 192], 80.00th=[ 220], 90.00th=[ 262], 95.00th=[ 300], | 99.00th=[ 393], 99.50th=[ 439], 99.90th=[ 684], 99.95th=[ 1083], | 99.99th=[ 1083] bw ( KiB/s): min= 7, max= 63, per=24.60%, avg=19.43, stdev= 9.14, samples=617 iops : min= 1, max= 15, avg= 4.24, stdev= 2.34, samples=617 lat (msec) : 10=2.67%, 20=14.55%, 50=21.61%, 100=16.34%, 250=38.31% lat (msec) : 500=6.41%, 750=0.07%, 2000=0.03% cpu : usr=0.04%, sys=1.17%, ctx=5164, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=151022: Fri Jun 26 11:39:21 2026 read: IOPS=4, BW=19.3KiB/s (19.8kB/s)(6052KiB/313611msec) clat (msec): min=5, max=415, avg=36.43, stdev=35.62 lat (msec): min=5, max=415, avg=36.44, stdev=35.62 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 12], 20.00th=[ 15], | 30.00th=[ 18], 40.00th=[ 21], 50.00th=[ 26], 60.00th=[ 30], | 70.00th=[ 36], 80.00th=[ 50], 90.00th=[ 78], 95.00th=[ 101], | 99.00th=[ 176], 99.50th=[ 226], 99.90th=[ 338], 99.95th=[ 414], | 99.99th=[ 414] bw ( KiB/s): min= 7, max= 103, per=30.50%, avg=22.88, stdev=16.25, samples=510 iops : min= 1, max= 25, avg= 5.10, stdev= 4.09, samples=510 write: IOPS=4, BW=19.9KiB/s (20.4kB/s)(6236KiB/313611msec); 0 zone resets clat (msec): min=33, max=967, avg=165.54, stdev=78.95 lat (msec): min=33, max=967, avg=165.54, stdev=78.95 clat percentiles (msec): | 1.00th=[ 51], 5.00th=[ 69], 10.00th=[ 82], 20.00th=[ 100], | 30.00th=[ 116], 40.00th=[ 133], 50.00th=[ 155], 60.00th=[ 174], | 70.00th=[ 194], 80.00th=[ 220], 90.00th=[ 262], 95.00th=[ 313], | 99.00th=[ 409], 99.50th=[ 468], 99.90th=[ 514], 99.95th=[ 969], | 99.99th=[ 969] bw ( KiB/s): min= 7, max= 55, per=24.84%, avg=19.62, stdev= 8.98, samples=609 iops : min= 1, max= 13, avg= 4.28, stdev= 2.30, samples=609 lat (msec) : 10=2.44%, 20=16.31%, 50=21.22%, 100=17.38%, 250=36.17% lat (msec) : 500=6.38%, 750=0.07%, 1000=0.03% cpu : usr=0.04%, sys=1.15%, ctx=5126, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=75.8KiB/s (77.6kB/s), 18.8KiB/s-19.3KiB/s (19.2kB/s-19.8kB/s), io=23.4MiB (24.6MB), run=313611-316807msec WRITE: bw=79.4KiB/s (81.3kB/s), 19.8KiB/s-20.1KiB/s (20.2kB/s-20.5kB/s), io=24.6MiB (25.7MB), run=313611-316807msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=151082: Fri Jun 26 11:40:10 2026 read: IOPS=9, BW=158KiB/s (162kB/s)(5920KiB/37459msec) clat (usec): min=33, max=320908, avg=50210.57, stdev=47028.34 lat (usec): min=33, max=320909, avg=50216.08, stdev=47034.04 clat percentiles (usec): | 1.00th=[ 39], 5.00th=[ 55], 10.00th=[ 59], 20.00th=[ 69], | 30.00th=[ 20579], 40.00th=[ 36439], 50.00th=[ 47973], 60.00th=[ 56886], | 70.00th=[ 65799], 80.00th=[ 82314], 90.00th=[102237], 95.00th=[126354], | 99.00th=[221250], 99.50th=[270533], 99.90th=[320865], 99.95th=[320865], | 99.99th=[320865] bw ( KiB/s): min= 30, max= 383, per=25.08%, avg=156.99, stdev=75.42, samples=73 iops : min= 1, max= 23, avg= 9.07, stdev= 4.81, samples=73 write: IOPS=10, BW=170KiB/s (174kB/s)(6368KiB/37459msec); 0 zone resets clat (usec): min=1503, max=313913, avg=46495.11, stdev=50727.19 lat (usec): min=1505, max=313915, avg=46515.72, stdev=50738.43 clat percentiles (usec): | 1.00th=[ 1647], 5.00th=[ 1795], 10.00th=[ 2073], 20.00th=[ 5604], | 30.00th=[ 8848], 40.00th=[ 14877], 50.00th=[ 25297], 60.00th=[ 43779], | 70.00th=[ 61080], 80.00th=[ 88605], 90.00th=[121111], 95.00th=[141558], | 99.00th=[198181], 99.50th=[299893], 99.90th=[312476], 99.95th=[312476], | 99.99th=[312476] bw ( KiB/s): min= 31, max= 555, per=26.13%, avg=172.22, stdev=88.23, samples=72 iops : min= 1, max= 34, avg=10.01, stdev= 5.56, samples=72 lat (usec) : 50=1.69%, 100=9.90%, 250=1.04%, 500=0.39%, 750=0.13% lat (msec) : 2=4.95%, 4=3.26%, 10=9.24%, 20=7.16%, 50=20.18% lat (msec) : 100=27.73%, 250=13.80%, 500=0.52% cpu : usr=0.05%, sys=4.66%, ctx=1355, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=151083: Fri Jun 26 11:40:10 2026 read: IOPS=9, BW=151KiB/s (154kB/s)(5744KiB/38139msec) clat (usec): min=34, max=322750, avg=52134.29, stdev=45044.19 lat (usec): min=34, max=322750, avg=52135.75, stdev=45044.20 clat percentiles (usec): | 1.00th=[ 40], 5.00th=[ 55], 10.00th=[ 62], 20.00th=[ 89], | 30.00th=[ 29230], 40.00th=[ 40633], 50.00th=[ 47449], 60.00th=[ 58459], | 70.00th=[ 67634], 80.00th=[ 80217], 90.00th=[106431], 95.00th=[135267], | 99.00th=[181404], 99.50th=[244319], 99.90th=[320865], 99.95th=[320865], | 99.99th=[320865] bw ( KiB/s): min= 31, max= 319, per=24.27%, avg=151.96, stdev=79.33, samples=73 iops : min= 1, max= 19, avg= 8.74, stdev= 5.00, samples=73 write: IOPS=10, BW=172KiB/s (176kB/s)(6544KiB/38139msec); 0 zone resets clat (usec): min=1499, max=272053, avg=46298.94, stdev=47668.01 lat (usec): min=1501, max=272056, avg=46301.82, stdev=47667.85 clat percentiles (usec): | 1.00th=[ 1565], 5.00th=[ 1827], 10.00th=[ 3294], 20.00th=[ 7504], | 30.00th=[ 11731], 40.00th=[ 19792], 50.00th=[ 27919], 60.00th=[ 43254], | 70.00th=[ 58983], 80.00th=[ 83362], 90.00th=[113771], 95.00th=[141558], | 99.00th=[212861], 99.50th=[221250], 99.90th=[270533], 99.95th=[270533], | 99.99th=[270533] bw ( KiB/s): min= 62, max= 383, per=26.64%, avg=175.58, stdev=78.41, samples=72 iops : min= 3, max= 23, avg=10.25, stdev= 5.00, samples=72 lat (usec) : 50=1.43%, 100=8.46%, 250=0.52%, 500=0.26%, 750=0.13% lat (msec) : 2=4.04%, 4=1.95%, 10=8.59%, 20=7.81%, 50=25.26% lat (msec) : 100=28.39%, 250=12.76%, 500=0.39% cpu : usr=0.07%, sys=5.22%, ctx=1430, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=151084: Fri Jun 26 11:40:10 2026 read: IOPS=10, BW=164KiB/s (168kB/s)(6256KiB/38226msec) clat (usec): min=33, max=293679, avg=52517.19, stdev=46987.98 lat (usec): min=33, max=293679, avg=52518.58, stdev=46988.09 clat percentiles (usec): | 1.00th=[ 37], 5.00th=[ 49], 10.00th=[ 60], 20.00th=[ 74], | 30.00th=[ 22938], 40.00th=[ 39060], 50.00th=[ 49546], 60.00th=[ 59507], | 70.00th=[ 70779], 80.00th=[ 85459], 90.00th=[111674], 95.00th=[141558], | 99.00th=[196084], 99.50th=[223347], 99.90th=[295699], 99.95th=[295699], | 99.99th=[295699] bw ( KiB/s): min= 31, max= 343, per=26.14%, avg=163.63, stdev=72.09, samples=75 iops : min= 1, max= 21, avg= 9.48, stdev= 4.57, samples=75 write: IOPS=9, BW=158KiB/s (162kB/s)(6032KiB/38226msec); 0 zone resets clat (usec): min=1539, max=342526, avg=46640.21, stdev=51374.40 lat (usec): min=1541, max=342529, avg=46642.41, stdev=51374.42 clat percentiles (usec): | 1.00th=[ 1598], 5.00th=[ 1795], 10.00th=[ 2114], 20.00th=[ 5211], | 30.00th=[ 9896], 40.00th=[ 13829], 50.00th=[ 27919], 60.00th=[ 44827], | 70.00th=[ 62653], 80.00th=[ 84411], 90.00th=[111674], 95.00th=[160433], | 99.00th=[196084], 99.50th=[246416], 99.90th=[341836], 99.95th=[341836], | 99.99th=[341836] bw ( KiB/s): min= 31, max= 348, per=23.80%, avg=156.83, stdev=66.96, samples=75 iops : min= 1, max= 21, avg= 9.07, stdev= 4.25, samples=75 lat (usec) : 50=2.86%, 100=9.38%, 250=0.26%, 500=0.13%, 750=0.13% lat (msec) : 2=4.82%, 4=3.39%, 10=7.81%, 20=8.46%, 50=19.53% lat (msec) : 100=29.43%, 250=13.54%, 500=0.26% cpu : usr=0.08%, sys=4.92%, ctx=1369, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=151085: Fri Jun 26 11:40:10 2026 read: IOPS=10, BW=160KiB/s (164kB/s)(6032KiB/37661msec) clat (usec): min=31, max=274606, avg=49933.32, stdev=47039.49 lat (usec): min=32, max=274607, avg=49935.13, stdev=47040.29 clat percentiles (usec): | 1.00th=[ 37], 5.00th=[ 53], 10.00th=[ 58], 20.00th=[ 67], | 30.00th=[ 16188], 40.00th=[ 34341], 50.00th=[ 45351], 60.00th=[ 56361], | 70.00th=[ 69731], 80.00th=[ 81265], 90.00th=[106431], 95.00th=[133694], | 99.00th=[212861], 99.50th=[238027], 99.90th=[274727], 99.95th=[274727], | 99.99th=[274727] bw ( KiB/s): min= 31, max= 320, per=25.87%, avg=161.95, stdev=68.05, samples=73 iops : min= 1, max= 20, avg= 9.37, stdev= 4.35, samples=73 write: IOPS=10, BW=166KiB/s (170kB/s)(6256KiB/37661msec); 0 zone resets clat (usec): min=1360, max=435873, avg=47359.86, stdev=53848.39 lat (usec): min=1363, max=435876, avg=47361.90, stdev=53848.32 clat percentiles (usec): | 1.00th=[ 1532], 5.00th=[ 1795], 10.00th=[ 2089], 20.00th=[ 6194], | 30.00th=[ 10028], 40.00th=[ 15401], 50.00th=[ 25560], 60.00th=[ 41157], | 70.00th=[ 62129], 80.00th=[ 88605], 90.00th=[122160], 95.00th=[145753], | 99.00th=[223347], 99.50th=[248513], 99.90th=[434111], 99.95th=[434111], | 99.99th=[434111] bw ( KiB/s): min= 30, max= 415, per=25.22%, avg=166.22, stdev=83.65, samples=74 iops : min= 1, max= 25, avg= 9.64, stdev= 5.27, samples=74 lat (usec) : 50=1.82%, 100=11.33%, 250=0.52%, 500=0.26% lat (msec) : 2=4.95%, 4=3.26%, 10=7.42%, 20=8.85%, 50=21.09% lat (msec) : 100=25.52%, 250=14.71%, 500=0.26% cpu : usr=0.06%, sys=5.03%, ctx=1360, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=627KiB/s (642kB/s), 151KiB/s-164KiB/s (154kB/s-168kB/s), io=23.4MiB (24.5MB), run=37459-38226msec WRITE: bw=659KiB/s (675kB/s), 158KiB/s-172KiB/s (162kB/s-176kB/s), io=24.6MiB (25.8MB), run=37459-38226msec rand-rw: (groupid=0, jobs=1): err= 0: pid=151086: Fri Jun 26 11:41:06 2026 read: IOPS=3, BW=62.0KiB/s (64.5kB/s)(5920KiB/94032msec) clat (msec): min=7, max=544, avg=46.90, stdev=56.49 lat (msec): min=7, max=544, avg=46.91, stdev=56.49 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 14], 20.00th=[ 17], | 30.00th=[ 21], 40.00th=[ 25], 50.00th=[ 30], 60.00th=[ 35], | 70.00th=[ 45], 80.00th=[ 63], 90.00th=[ 94], 95.00th=[ 130], | 99.00th=[ 317], 99.50th=[ 422], 99.90th=[ 542], 99.95th=[ 542], | 99.99th=[ 542] bw ( KiB/s): min= 30, max= 349, per=31.60%, avg=80.25, stdev=55.31, samples=143 iops : min= 1, max= 21, avg= 4.29, stdev= 3.56, samples=143 write: IOPS=4, BW=67.7KiB/s (69.3kB/s)(6368KiB/94032msec); 0 zone resets clat (msec): min=41, max=595, avg=192.27, stdev=113.38 lat (msec): min=41, max=595, avg=192.27, stdev=113.38 clat percentiles (msec): | 1.00th=[ 48], 5.00th=[ 64], 10.00th=[ 81], 20.00th=[ 99], | 30.00th=[ 116], 40.00th=[ 140], 50.00th=[ 161], 60.00th=[ 192], | 70.00th=[ 232], 80.00th=[ 268], 90.00th=[ 355], 95.00th=[ 430], | 99.00th=[ 575], 99.50th=[ 592], 99.90th=[ 592], 99.95th=[ 592], | 99.99th=[ 592] bw ( KiB/s): min= 29, max= 223, per=25.91%, avg=69.18, stdev=38.84, samples=179 iops : min= 1, max= 13, avg= 3.58, stdev= 2.52, samples=179 lat (msec) : 10=1.17%, 20=12.63%, 50=22.40%, 100=18.23%, 250=32.29% lat (msec) : 500=12.11%, 750=1.17% cpu : usr=0.03%, sys=1.03%, ctx=1280, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=151087: Fri Jun 26 11:41:06 2026 read: IOPS=3, BW=61.2KiB/s (62.7kB/s)(5744KiB/93829msec) clat (msec): min=7, max=492, avg=50.00, stdev=57.66 lat (msec): min=7, max=492, avg=50.01, stdev=57.66 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 18], | 30.00th=[ 22], 40.00th=[ 26], 50.00th=[ 32], 60.00th=[ 38], | 70.00th=[ 47], 80.00th=[ 65], 90.00th=[ 103], 95.00th=[ 176], | 99.00th=[ 313], 99.50th=[ 334], 99.90th=[ 493], 99.95th=[ 493], | 99.99th=[ 493] bw ( KiB/s): min= 29, max= 316, per=32.84%, avg=83.42, stdev=54.83, samples=135 iops : min= 1, max= 19, avg= 4.50, stdev= 3.47, samples=135 write: IOPS=4, BW=69.7KiB/s (71.4kB/s)(6544KiB/93829msec); 0 zone resets clat (msec): min=41, max=652, avg=184.32, stdev=107.03 lat (msec): min=41, max=652, avg=184.32, stdev=107.03 clat percentiles (msec): | 1.00th=[ 51], 5.00th=[ 64], 10.00th=[ 73], 20.00th=[ 95], | 30.00th=[ 113], 40.00th=[ 130], 50.00th=[ 153], 60.00th=[ 182], | 70.00th=[ 224], 80.00th=[ 271], 90.00th=[ 334], 95.00th=[ 393], | 99.00th=[ 514], 99.50th=[ 550], 99.90th=[ 651], 99.95th=[ 651], | 99.99th=[ 651] bw ( KiB/s): min= 30, max= 192, per=28.27%, avg=75.47, stdev=40.64, samples=170 iops : min= 1, max= 12, avg= 3.99, stdev= 2.64, samples=170 lat (msec) : 10=1.43%, 20=11.20%, 50=22.14%, 100=19.40%, 250=32.16% lat (msec) : 500=12.89%, 750=0.78% cpu : usr=0.03%, sys=1.14%, ctx=1341, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=151088: Fri Jun 26 11:41:06 2026 read: IOPS=4, BW=67.7KiB/s (69.3kB/s)(6256KiB/92460msec) clat (msec): min=6, max=546, avg=46.37, stdev=58.36 lat (msec): min=6, max=546, avg=46.38, stdev=58.36 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 17], | 30.00th=[ 20], 40.00th=[ 24], 50.00th=[ 29], 60.00th=[ 36], | 70.00th=[ 44], 80.00th=[ 56], 90.00th=[ 95], 95.00th=[ 142], | 99.00th=[ 305], 99.50th=[ 489], 99.90th=[ 550], 99.95th=[ 550], | 99.99th=[ 550] bw ( KiB/s): min= 30, max= 285, per=34.45%, avg=87.51, stdev=63.13, samples=141 iops : min= 1, max= 17, avg= 4.74, stdev= 4.02, samples=141 write: IOPS=4, BW=65.2KiB/s (66.8kB/s)(6032KiB/92460msec); 0 zone resets clat (msec): min=39, max=766, avg=196.08, stdev=118.47 lat (msec): min=39, max=766, avg=196.09, stdev=118.47 clat percentiles (msec): | 1.00th=[ 50], 5.00th=[ 66], 10.00th=[ 82], 20.00th=[ 104], | 30.00th=[ 118], 40.00th=[ 142], 50.00th=[ 167], 60.00th=[ 194], | 70.00th=[ 224], 80.00th=[ 275], 90.00th=[ 359], 95.00th=[ 430], | 99.00th=[ 609], 99.50th=[ 726], 99.90th=[ 768], 99.95th=[ 768], | 99.99th=[ 768] bw ( KiB/s): min= 30, max= 192, per=26.11%, avg=69.71, stdev=37.74, samples=170 iops : min= 1, max= 12, avg= 3.62, stdev= 2.47, samples=170 lat (msec) : 10=1.95%, 20=14.06%, 50=22.92%, 100=16.80%, 250=31.90% lat (msec) : 500=10.81%, 750=1.43%, 1000=0.13% cpu : usr=0.03%, sys=1.24%, ctx=1481, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=151089: Fri Jun 26 11:41:06 2026 read: IOPS=4, BW=64.2KiB/s (65.8kB/s)(6032KiB/93894msec) clat (msec): min=6, max=294, avg=44.32, stdev=43.76 lat (msec): min=6, max=294, avg=44.32, stdev=43.76 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 14], 20.00th=[ 17], | 30.00th=[ 21], 40.00th=[ 24], 50.00th=[ 30], 60.00th=[ 36], | 70.00th=[ 46], 80.00th=[ 58], 90.00th=[ 96], 95.00th=[ 138], | 99.00th=[ 239], 99.50th=[ 275], 99.90th=[ 296], 99.95th=[ 296], | 99.99th=[ 296] bw ( KiB/s): min= 30, max= 288, per=33.60%, avg=85.36, stdev=60.06, samples=138 iops : min= 1, max= 18, avg= 4.62, stdev= 3.85, samples=138 write: IOPS=4, BW=66.6KiB/s (68.2kB/s)(6256KiB/93894msec); 0 zone resets clat (msec): min=40, max=863, avg=196.10, stdev=113.31 lat (msec): min=40, max=863, avg=196.11, stdev=113.31 clat percentiles (msec): | 1.00th=[ 50], 5.00th=[ 70], 10.00th=[ 80], 20.00th=[ 99], | 30.00th=[ 121], 40.00th=[ 150], 50.00th=[ 176], 60.00th=[ 199], | 70.00th=[ 226], 80.00th=[ 284], 90.00th=[ 351], 95.00th=[ 409], | 99.00th=[ 575], 99.50th=[ 642], 99.90th=[ 860], 99.95th=[ 860], | 99.99th=[ 860] bw ( KiB/s): min= 29, max= 192, per=26.08%, avg=69.64, stdev=36.60, samples=176 iops : min= 1, max= 12, avg= 3.61, stdev= 2.39, samples=176 lat (msec) : 10=2.21%, 20=12.11%, 50=23.18%, 100=17.71%, 250=31.90% lat (msec) : 500=11.98%, 750=0.78%, 1000=0.13% cpu : usr=0.03%, sys=1.16%, ctx=1329, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=255KiB/s (261kB/s), 61.2KiB/s-67.7KiB/s (62.7kB/s-69.3kB/s), io=23.4MiB (24.5MB), run=92460-94032msec WRITE: bw=268KiB/s (274kB/s), 65.2KiB/s-69.7KiB/s (66.8kB/s-71.4kB/s), io=24.6MiB (25.8MB), run=92460-94032msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=151112: Fri Jun 26 11:41:17 2026 read: IOPS=1, BW=1637KiB/s (1677kB/s)(7168KiB/4378msec) clat (usec): min=415, max=2274.9k, avg=447143.42, stdev=818063.37 lat (usec): min=417, max=2274.9k, avg=447144.75, stdev=818063.86 clat percentiles (usec): | 1.00th=[ 416], 5.00th=[ 416], 10.00th=[ 416], | 20.00th=[ 45876], 30.00th=[ 93848], 40.00th=[ 93848], | 50.00th=[ 111674], 60.00th=[ 170918], 70.00th=[ 170918], | 80.00th=[ 434111], 90.00th=[2264925], 95.00th=[2264925], | 99.00th=[2264925], 99.50th=[2264925], 99.90th=[2264925], | 99.95th=[2264925], 99.99th=[2264925] bw ( KiB/s): min= 4071, max= 6107, per=100.00%, avg=5089.00, stdev=1439.67, samples=2 iops : min= 3, max= 5, avg= 4.00, stdev= 1.41, samples=2 write: IOPS=1, BW=1169KiB/s (1198kB/s)(5120KiB/4378msec); 0 zone resets clat (msec): min=148, max=323, avg=237.32, stdev=66.73 lat (msec): min=148, max=323, avg=237.60, stdev=66.90 clat percentiles (msec): | 1.00th=[ 148], 5.00th=[ 148], 10.00th=[ 148], 20.00th=[ 148], | 30.00th=[ 218], 40.00th=[ 218], 50.00th=[ 222], 60.00th=[ 222], | 70.00th=[ 279], 80.00th=[ 279], 90.00th=[ 326], 95.00th=[ 326], | 99.00th=[ 326], 99.50th=[ 326], 99.90th=[ 326], 99.95th=[ 326], | 99.99th=[ 326] bw ( KiB/s): min= 2027, max= 3657, per=45.45%, avg=2573.00, stdev=938.78, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (usec) : 500=8.33% lat (msec) : 50=8.33%, 100=8.33%, 250=41.67%, 500=25.00%, >=2000=8.33% cpu : usr=0.00%, sys=12.61%, ctx=615, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=151113: Fri Jun 26 11:41:17 2026 read: IOPS=0, BW=406KiB/s (416kB/s)(2048KiB/5040msec) clat (msec): min=2, max=188, avg=95.52, stdev=131.83 lat (msec): min=2, max=188, avg=95.52, stdev=131.83 clat percentiles (msec): | 1.00th=[ 3], 5.00th=[ 3], 10.00th=[ 3], 20.00th=[ 3], | 30.00th=[ 3], 40.00th=[ 3], 50.00th=[ 3], 60.00th=[ 188], | 70.00th=[ 188], 80.00th=[ 188], 90.00th=[ 188], 95.00th=[ 188], | 99.00th=[ 188], 99.50th=[ 188], 99.90th=[ 188], 99.95th=[ 188], | 99.99th=[ 188] bw ( KiB/s): min= 1828, max= 1851, per=45.49%, avg=1839.50, stdev=16.26, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=2032KiB/s (2081kB/s)(10.0MiB/5040msec); 0 zone resets clat (msec): min=62, max=2460, avg=481.26, stdev=713.18 lat (msec): min=63, max=2460, avg=481.35, stdev=713.18 clat percentiles (msec): | 1.00th=[ 64], 5.00th=[ 64], 10.00th=[ 64], 20.00th=[ 150], | 30.00th=[ 161], 40.00th=[ 201], 50.00th=[ 209], 60.00th=[ 253], | 70.00th=[ 259], 80.00th=[ 456], 90.00th=[ 609], 95.00th=[ 2467], | 99.00th=[ 2467], 99.50th=[ 2467], 99.90th=[ 2467], 99.95th=[ 2467], | 99.99th=[ 2467] bw ( KiB/s): min= 2027, max= 6107, per=69.94%, avg=3959.50, stdev=1677.84, samples=4 iops : min= 1, max= 5, avg= 3.00, stdev= 1.63, samples=4 lat (msec) : 4=8.33%, 100=8.33%, 250=41.67%, 500=25.00%, 750=8.33% lat (msec) : >=2000=8.33% cpu : usr=0.00%, sys=9.70%, ctx=130, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=151114: Fri Jun 26 11:41:17 2026 read: IOPS=1, BW=1213KiB/s (1242kB/s)(6144KiB/5064msec) clat (msec): min=18, max=301, avg=161.41, stdev=109.02 lat (msec): min=18, max=301, avg=161.41, stdev=109.02 clat percentiles (msec): | 1.00th=[ 19], 5.00th=[ 19], 10.00th=[ 19], 20.00th=[ 45], | 30.00th=[ 45], 40.00th=[ 178], 50.00th=[ 178], 60.00th=[ 209], | 70.00th=[ 218], 80.00th=[ 218], 90.00th=[ 300], 95.00th=[ 300], | 99.00th=[ 300], 99.50th=[ 300], 99.90th=[ 300], 99.95th=[ 300], | 99.99th=[ 300] bw ( KiB/s): min= 1828, max= 4071, per=61.50%, avg=2487.25, stdev=1059.91, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 write: IOPS=1, BW=1213KiB/s (1242kB/s)(6144KiB/5064msec); 0 zone resets clat (msec): min=116, max=2238, avg=662.11, stdev=799.92 lat (msec): min=116, max=2238, avg=662.35, stdev=799.81 clat percentiles (msec): | 1.00th=[ 117], 5.00th=[ 117], 10.00th=[ 117], 20.00th=[ 259], | 30.00th=[ 259], 40.00th=[ 279], 50.00th=[ 279], 60.00th=[ 338], | 70.00th=[ 735], 80.00th=[ 735], 90.00th=[ 2232], 95.00th=[ 2232], | 99.00th=[ 2232], 99.50th=[ 2232], 99.90th=[ 2232], 99.95th=[ 2232], | 99.99th=[ 2232] bw ( KiB/s): min= 1828, max= 3737, per=42.51%, avg=2406.75, stdev=891.99, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (msec) : 20=8.33%, 50=8.33%, 250=33.33%, 500=33.33%, 750=8.33% lat (msec) : >=2000=8.33% cpu : usr=0.04%, sys=8.10%, ctx=316, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=151115: Fri Jun 26 11:41:17 2026 read: IOPS=1, BW=1159KiB/s (1187kB/s)(5120KiB/4416msec) clat (usec): min=341, max=234270, avg=47185.52, stdev=104583.59 lat (usec): min=342, max=234271, avg=47265.97, stdev=104539.25 clat percentiles (usec): | 1.00th=[ 343], 5.00th=[ 343], 10.00th=[ 343], 20.00th=[ 343], | 30.00th=[ 392], 40.00th=[ 392], 50.00th=[ 429], 60.00th=[ 429], | 70.00th=[ 494], 80.00th=[ 494], 90.00th=[233833], 95.00th=[233833], | 99.00th=[233833], 99.50th=[233833], 99.90th=[233833], 99.95th=[233833], | 99.99th=[233833] bw ( KiB/s): min= 7314, max= 7314, per=100.00%, avg=7314.00, stdev= 0.00, samples=1 iops : min= 7, max= 7, avg= 7.00, stdev= 0.00, samples=1 write: IOPS=1, BW=1623KiB/s (1662kB/s)(7168KiB/4416msec); 0 zone resets clat (msec): min=120, max=2316, avg=580.25, stdev=777.95 lat (msec): min=120, max=2316, avg=580.49, stdev=777.88 clat percentiles (msec): | 1.00th=[ 121], 5.00th=[ 121], 10.00th=[ 121], 20.00th=[ 180], | 30.00th=[ 232], 40.00th=[ 232], 50.00th=[ 268], 60.00th=[ 451], | 70.00th=[ 451], 80.00th=[ 498], 90.00th=[ 2333], 95.00th=[ 2333], | 99.00th=[ 2333], 99.50th=[ 2333], 99.90th=[ 2333], 99.95th=[ 2333], | 99.99th=[ 2333] bw ( KiB/s): min= 1828, max= 4071, per=43.99%, avg=2490.25, stdev=1058.17, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (usec) : 500=33.33% lat (msec) : 250=33.33%, 500=25.00%, >=2000=8.33% cpu : usr=0.16%, sys=10.60%, ctx=120, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4044KiB/s (4141kB/s), 406KiB/s-1637KiB/s (416kB/s-1677kB/s), io=20.0MiB (20.0MB), run=4378-5064msec WRITE: bw=5662KiB/s (5798kB/s), 1169KiB/s-2032KiB/s (1198kB/s-2081kB/s), io=28.0MiB (29.4MB), run=4378-5064msec rand-rw: (groupid=0, jobs=1): err= 0: pid=151110: Fri Jun 26 11:41:18 2026 read: IOPS=1, BW=1252KiB/s (1282kB/s)(7168KiB/5727msec) clat (msec): min=68, max=2193, avg=605.97, stdev=770.85 lat (msec): min=68, max=2193, avg=605.97, stdev=770.85 clat percentiles (msec): | 1.00th=[ 69], 5.00th=[ 69], 10.00th=[ 69], 20.00th=[ 77], | 30.00th=[ 138], 40.00th=[ 138], 50.00th=[ 330], 60.00th=[ 439], | 70.00th=[ 439], 80.00th=[ 995], 90.00th=[ 2198], 95.00th=[ 2198], | 99.00th=[ 2198], 99.50th=[ 2198], 99.90th=[ 2198], 99.95th=[ 2198], | 99.99th=[ 2198] bw ( KiB/s): min= 2039, max= 4063, per=87.54%, avg=3031.50, stdev=1141.40, samples=4 iops : min= 1, max= 3, avg= 2.25, stdev= 0.96, samples=4 write: IOPS=0, BW=894KiB/s (915kB/s)(5120KiB/5727msec); 0 zone resets clat (msec): min=103, max=481, avg=284.71, stdev=154.66 lat (msec): min=103, max=481, avg=285.00, stdev=154.86 clat percentiles (msec): | 1.00th=[ 104], 5.00th=[ 104], 10.00th=[ 104], 20.00th=[ 104], | 30.00th=[ 194], 40.00th=[ 194], 50.00th=[ 241], 60.00th=[ 241], | 70.00th=[ 405], 80.00th=[ 405], 90.00th=[ 481], 95.00th=[ 481], | 99.00th=[ 481], 99.50th=[ 481], 99.90th=[ 481], 99.95th=[ 481], | 99.99th=[ 481] bw ( KiB/s): min= 2035, max= 6119, per=70.11%, avg=3399.00, stdev=2355.59, samples=3 iops : min= 1, max= 5, avg= 2.33, stdev= 2.31, samples=3 lat (msec) : 100=16.67%, 250=33.33%, 500=33.33%, 1000=8.33%, >=2000=8.33% cpu : usr=0.02%, sys=2.36%, ctx=65, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=151111: Fri Jun 26 11:41:18 2026 read: IOPS=0, BW=364KiB/s (373kB/s)(2048KiB/5627msec) clat (msec): min=134, max=142, avg=138.30, stdev= 6.00 lat (msec): min=134, max=142, avg=138.30, stdev= 6.00 clat percentiles (msec): | 1.00th=[ 134], 5.00th=[ 134], 10.00th=[ 134], 20.00th=[ 134], | 30.00th=[ 134], 40.00th=[ 134], 50.00th=[ 134], 60.00th=[ 142], | 70.00th=[ 142], 80.00th=[ 142], 90.00th=[ 142], 95.00th=[ 142], | 99.00th=[ 142], 99.50th=[ 142], 99.90th=[ 142], 99.95th=[ 142], | 99.99th=[ 142] bw ( KiB/s): min= 1505, max= 2035, per=51.11%, avg=1770.00, stdev=374.77, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1820KiB/s (1863kB/s)(10.0MiB/5627msec); 0 zone resets clat (msec): min=124, max=2163, avg=483.13, stdev=611.74 lat (msec): min=124, max=2163, avg=483.20, stdev=611.73 clat percentiles (msec): | 1.00th=[ 125], 5.00th=[ 125], 10.00th=[ 125], 20.00th=[ 130], | 30.00th=[ 130], 40.00th=[ 190], 50.00th=[ 279], 60.00th=[ 338], | 70.00th=[ 397], 80.00th=[ 542], 90.00th=[ 550], 95.00th=[ 2165], | 99.00th=[ 2165], 99.50th=[ 2165], 99.90th=[ 2165], 99.95th=[ 2165], | 99.99th=[ 2165] bw ( KiB/s): min= 2023, max= 3976, per=49.95%, avg=2421.60, stdev=868.97, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 lat (msec) : 250=50.00%, 500=25.00%, 750=16.67%, >=2000=8.33% cpu : usr=0.00%, sys=3.89%, ctx=78, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=151116: Fri Jun 26 11:41:18 2026 read: IOPS=1, BW=1127KiB/s (1154kB/s)(6144KiB/5451msec) clat (msec): min=88, max=524, avg=253.85, stdev=166.50 lat (msec): min=88, max=524, avg=253.85, stdev=166.50 clat percentiles (msec): | 1.00th=[ 89], 5.00th=[ 89], 10.00th=[ 89], 20.00th=[ 90], | 30.00th=[ 90], 40.00th=[ 205], 50.00th=[ 205], 60.00th=[ 275], | 70.00th=[ 342], 80.00th=[ 342], 90.00th=[ 527], 95.00th=[ 527], | 99.00th=[ 527], 99.50th=[ 527], 99.90th=[ 527], 99.95th=[ 527], | 99.99th=[ 527] bw ( KiB/s): min= 1988, max= 2043, per=58.45%, avg=2024.25, stdev=24.68, samples=4 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=4 write: IOPS=1, BW=1127KiB/s (1154kB/s)(6144KiB/5451msec); 0 zone resets clat (msec): min=123, max=2314, avg=593.18, stdev=853.15 lat (msec): min=123, max=2314, avg=593.26, stdev=853.15 clat percentiles (msec): | 1.00th=[ 124], 5.00th=[ 124], 10.00th=[ 124], 20.00th=[ 188], | 30.00th=[ 188], 40.00th=[ 207], 50.00th=[ 207], 60.00th=[ 228], | 70.00th=[ 502], 80.00th=[ 502], 90.00th=[ 2299], 95.00th=[ 2299], | 99.00th=[ 2299], 99.50th=[ 2299], 99.90th=[ 2299], 99.95th=[ 2299], | 99.99th=[ 2299] bw ( KiB/s): min= 1695, max= 2043, per=39.96%, avg=1937.25, stdev=163.09, samples=4 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=4 lat (msec) : 100=16.67%, 250=41.67%, 500=16.67%, 750=16.67%, >=2000=8.33% cpu : usr=0.00%, sys=3.63%, ctx=65, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=151117: Fri Jun 26 11:41:18 2026 read: IOPS=0, BW=866KiB/s (887kB/s)(5120KiB/5913msec) clat (msec): min=39, max=361, avg=188.03, stdev=125.69 lat (msec): min=39, max=361, avg=188.03, stdev=125.69 clat percentiles (msec): | 1.00th=[ 40], 5.00th=[ 40], 10.00th=[ 40], 20.00th=[ 40], | 30.00th=[ 138], 40.00th=[ 138], 50.00th=[ 138], 60.00th=[ 138], | 70.00th=[ 264], 80.00th=[ 264], 90.00th=[ 363], 95.00th=[ 363], | 99.00th=[ 363], 99.50th=[ 363], 99.90th=[ 363], 99.95th=[ 363], | 99.99th=[ 363] bw ( KiB/s): min= 1988, max= 6107, per=100.00%, avg=4047.50, stdev=2912.57, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 write: IOPS=1, BW=1212KiB/s (1241kB/s)(7168KiB/5913msec); 0 zone resets clat (msec): min=148, max=3274, avg=702.73, stdev=1137.35 lat (msec): min=148, max=3274, avg=702.82, stdev=1137.35 clat percentiles (msec): | 1.00th=[ 148], 5.00th=[ 148], 10.00th=[ 148], 20.00th=[ 190], | 30.00th=[ 255], 40.00th=[ 255], 50.00th=[ 309], 60.00th=[ 359], | 70.00th=[ 359], 80.00th=[ 384], 90.00th=[ 3272], 95.00th=[ 3272], | 99.00th=[ 3272], 99.50th=[ 3272], 99.90th=[ 3272], 99.95th=[ 3272], | 99.99th=[ 3272] bw ( KiB/s): min= 1418, max= 4079, per=47.69%, avg=2311.80, stdev=1021.99, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 lat (msec) : 50=8.33%, 250=33.33%, 500=50.00%, >=2000=8.33% cpu : usr=0.02%, sys=3.04%, ctx=144, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3464KiB/s (3547kB/s), 364KiB/s-1252KiB/s (373kB/s-1282kB/s), io=20.0MiB (20.0MB), run=5451-5913msec WRITE: bw=4849KiB/s (4965kB/s), 894KiB/s-1820KiB/s (915kB/s-1863kB/s), io=28.0MiB (29.4MB), run=5451-5913msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=151125: Fri Jun 26 11:41:28 2026 read: IOPS=1, BW=4735KiB/s (4849kB/s)(12.0MiB/2595msec) clat (msec): min=600, max=998, avg=849.17, stdev=216.41 lat (msec): min=600, max=998, avg=849.17, stdev=216.41 clat percentiles (msec): | 1.00th=[ 600], 5.00th=[ 600], 10.00th=[ 600], 20.00th=[ 600], | 30.00th=[ 600], 40.00th=[ 953], 50.00th=[ 953], 60.00th=[ 953], | 70.00th=[ 1003], 80.00th=[ 1003], 90.00th=[ 1003], 95.00th=[ 1003], | 99.00th=[ 1003], 99.50th=[ 1003], 99.90th=[ 1003], 99.95th=[ 1003], | 99.99th=[ 1003] bw ( KiB/s): min= 8078, max= 8159, per=100.00%, avg=8118.50, stdev=57.28, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 1000=66.67% cpu : usr=0.00%, sys=3.39%, ctx=58, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=151126: Fri Jun 26 11:41:28 2026 read: IOPS=0, BW=1468KiB/s (1503kB/s)(4096KiB/2790msec) clat (nsec): min=1240.0M, max=1240.0M, avg=1240045332.00, stdev= 0.00 lat (nsec): min=1240.0M, max=1240.0M, avg=1240047645.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1234], 5.00th=[ 1234], 10.00th=[ 1234], 20.00th=[ 1234], | 30.00th=[ 1234], 40.00th=[ 1234], 50.00th=[ 1234], 60.00th=[ 1234], | 70.00th=[ 1234], 80.00th=[ 1234], 90.00th=[ 1234], 95.00th=[ 1234], | 99.00th=[ 1234], 99.50th=[ 1234], 99.90th=[ 1234], 99.95th=[ 1234], | 99.99th=[ 1234] bw ( KiB/s): min= 8159, max= 8159, per=100.00%, avg=8159.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2936KiB/s (3007kB/s)(8192KiB/2790msec); 0 zone resets clat (msec): min=593, max=899, avg=746.55, stdev=215.92 lat (msec): min=594, max=899, avg=746.92, stdev=215.86 clat percentiles (msec): | 1.00th=[ 592], 5.00th=[ 592], 10.00th=[ 592], 20.00th=[ 592], | 30.00th=[ 592], 40.00th=[ 592], 50.00th=[ 592], 60.00th=[ 902], | 70.00th=[ 902], 80.00th=[ 902], 90.00th=[ 902], 95.00th=[ 902], | 99.00th=[ 902], 99.50th=[ 902], 99.90th=[ 902], 99.95th=[ 902], | 99.99th=[ 902] bw ( KiB/s): min= 8031, max= 8031, per=68.38%, avg=8031.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=5.20%, ctx=46, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=151127: Fri Jun 26 11:41:28 2026 write: IOPS=1, BW=7474KiB/s (7654kB/s)(12.0MiB/1644msec); 0 zone resets clat (msec): min=301, max=990, avg=535.88, stdev=394.17 lat (msec): min=301, max=991, avg=536.32, stdev=394.13 clat percentiles (msec): | 1.00th=[ 300], 5.00th=[ 300], 10.00th=[ 300], 20.00th=[ 300], | 30.00th=[ 300], 40.00th=[ 317], 50.00th=[ 317], 60.00th=[ 317], | 70.00th=[ 995], 80.00th=[ 995], 90.00th=[ 995], 95.00th=[ 995], | 99.00th=[ 995], 99.50th=[ 995], 99.90th=[ 995], 99.95th=[ 995], | 99.99th=[ 995] bw ( KiB/s): min= 7515, max= 8078, per=66.39%, avg=7796.50, stdev=398.10, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=66.67%, 1000=33.33% cpu : usr=0.00%, sys=5.90%, ctx=56, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=151128: Fri Jun 26 11:41:28 2026 write: IOPS=1, BW=6457KiB/s (6612kB/s)(12.0MiB/1903msec); 0 zone resets clat (msec): min=331, max=1045, avg=612.42, stdev=380.23 lat (msec): min=333, max=1045, avg=613.36, stdev=379.55 clat percentiles (msec): | 1.00th=[ 334], 5.00th=[ 334], 10.00th=[ 334], 20.00th=[ 334], | 30.00th=[ 334], 40.00th=[ 460], 50.00th=[ 460], 60.00th=[ 460], | 70.00th=[ 1045], 80.00th=[ 1045], 90.00th=[ 1045], 95.00th=[ 1045], | 99.00th=[ 1045], 99.50th=[ 1045], 99.90th=[ 1045], 99.95th=[ 1045], | 99.99th=[ 1045] bw ( KiB/s): min= 7420, max= 8078, per=65.98%, avg=7749.00, stdev=465.28, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=66.67%, 2000=33.33% cpu : usr=0.00%, sys=6.47%, ctx=59, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5872KiB/s (6013kB/s), 1468KiB/s-4735KiB/s (1503kB/s-4849kB/s), io=16.0MiB (16.8MB), run=2595-2790msec WRITE: bw=11.5MiB/s (12.0MB/s), 2936KiB/s-7474KiB/s (3007kB/s-7654kB/s), io=32.0MiB (33.6MB), run=1644-2790msec rand-rw: (groupid=0, jobs=1): err= 0: pid=151124: Fri Jun 26 11:41:28 2026 read: IOPS=1, BW=7425KiB/s (7603kB/s)(12.0MiB/1655msec) clat (msec): min=429, max=595, avg=539.86, stdev=95.50 lat (msec): min=429, max=595, avg=539.86, stdev=95.50 clat percentiles (msec): | 1.00th=[ 430], 5.00th=[ 430], 10.00th=[ 430], 20.00th=[ 430], | 30.00th=[ 430], 40.00th=[ 592], 50.00th=[ 592], 60.00th=[ 592], | 70.00th=[ 600], 80.00th=[ 600], 90.00th=[ 600], 95.00th=[ 600], | 99.00th=[ 600], 99.50th=[ 600], 99.90th=[ 600], 99.95th=[ 600], | 99.99th=[ 600] bw ( KiB/s): min= 6380, max= 8159, per=100.00%, avg=7269.50, stdev=1257.94, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 750=66.67% cpu : usr=0.00%, sys=22.97%, ctx=378, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=151129: Fri Jun 26 11:41:28 2026 read: IOPS=0, BW=1614KiB/s (1653kB/s)(4096KiB/2538msec) clat (nsec): min=705473k, max=705473k, avg=705472660.00, stdev= 0.00 lat (nsec): min=705475k, max=705475k, avg=705475361.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 709], 5.00th=[ 709], 10.00th=[ 709], 20.00th=[ 709], | 30.00th=[ 709], 40.00th=[ 709], 50.00th=[ 709], 60.00th=[ 709], | 70.00th=[ 709], 80.00th=[ 709], 90.00th=[ 709], 95.00th=[ 709], | 99.00th=[ 709], 99.50th=[ 709], 99.90th=[ 709], 99.95th=[ 709], | 99.99th=[ 709] bw ( KiB/s): min= 8159, max= 8159, per=100.00%, avg=8159.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=3228KiB/s (3305kB/s)(8192KiB/2538msec); 0 zone resets clat (msec): min=797, max=990, avg=893.70, stdev=136.64 lat (msec): min=797, max=990, avg=894.03, stdev=136.60 clat percentiles (msec): | 1.00th=[ 802], 5.00th=[ 802], 10.00th=[ 802], 20.00th=[ 802], | 30.00th=[ 802], 40.00th=[ 802], 50.00th=[ 802], 60.00th=[ 995], | 70.00th=[ 995], 80.00th=[ 995], 90.00th=[ 995], 95.00th=[ 995], | 99.00th=[ 995], 99.50th=[ 995], 99.90th=[ 995], 99.95th=[ 995], | 99.99th=[ 995] bw ( KiB/s): min= 7984, max= 7984, per=73.93%, avg=7984.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, 1000=66.67% cpu : usr=0.32%, sys=6.23%, ctx=126, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=151130: Fri Jun 26 11:41:28 2026 write: IOPS=0, BW=4050KiB/s (4147kB/s)(12.0MiB/3034msec); 0 zone resets clat (msec): min=164, max=2016, avg=973.62, stdev=948.16 lat (msec): min=165, max=2017, avg=974.05, stdev=948.02 clat percentiles (msec): | 1.00th=[ 165], 5.00th=[ 165], 10.00th=[ 165], 20.00th=[ 165], | 30.00th=[ 165], 40.00th=[ 743], 50.00th=[ 743], 60.00th=[ 743], | 70.00th=[ 2022], 80.00th=[ 2022], 90.00th=[ 2022], 95.00th=[ 2022], | 99.00th=[ 2022], 99.50th=[ 2022], 99.90th=[ 2022], 99.95th=[ 2022], | 99.99th=[ 2022] bw ( KiB/s): min= 7984, max= 7984, per=73.93%, avg=7984.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 750=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=3.96%, ctx=45, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=151131: Fri Jun 26 11:41:28 2026 write: IOPS=1, BW=4861KiB/s (4977kB/s)(12.0MiB/2528msec); 0 zone resets clat (msec): min=318, max=1425, avg=772.87, stdev=579.49 lat (msec): min=319, max=1425, avg=773.18, stdev=579.52 clat percentiles (msec): | 1.00th=[ 321], 5.00th=[ 321], 10.00th=[ 321], 20.00th=[ 321], | 30.00th=[ 321], 40.00th=[ 575], 50.00th=[ 575], 60.00th=[ 575], | 70.00th=[ 1418], 80.00th=[ 1418], 90.00th=[ 1418], 95.00th=[ 1418], | 99.00th=[ 1418], 99.50th=[ 1418], 99.90th=[ 1418], 99.95th=[ 1418], | 99.99th=[ 1418] bw ( KiB/s): min= 8159, max= 8159, per=75.55%, avg=8159.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.00%, sys=5.82%, ctx=71, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=6455KiB/s (6610kB/s), 1614KiB/s-7425KiB/s (1653kB/s-7603kB/s), io=16.0MiB (16.8MB), run=1655-2538msec WRITE: bw=10.5MiB/s (11.1MB/s), 3228KiB/s-4861KiB/s (3305kB/s-4977kB/s), io=32.0MiB (33.6MB), run=2528-3034msec