== sanity test 398b: DIO and buffer IO race ============== 18:49:16 (1777502956) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 2.47326 s, 20.4 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179644: Wed Apr 29 18:50:25 2026 read: IOPS=25, BW=103KiB/s (106kB/s)(5992KiB/58017msec) clat (usec): min=33, max=94660, avg=21074.30, stdev=11039.41 lat (usec): min=33, max=94662, avg=21075.34, stdev=11039.38 clat percentiles (usec): | 1.00th=[ 93], 5.00th=[ 8455], 10.00th=[10159], 20.00th=[12256], | 30.00th=[14222], 40.00th=[16712], 50.00th=[19268], 60.00th=[22152], | 70.00th=[25297], 80.00th=[28705], 90.00th=[34341], 95.00th=[39060], | 99.00th=[63177], 99.50th=[69731], 99.90th=[82314], 99.95th=[94897], | 99.99th=[94897] bw ( KiB/s): min= 47, max= 167, per=25.25%, avg=103.54, stdev=23.24, samples=114 iops : min= 11, max= 41, avg=25.45, stdev= 5.77, samples=114 write: IOPS=27, BW=109KiB/s (111kB/s)(6296KiB/58017msec); 0 zone resets clat (usec): min=951, max=721692, avg=16653.02, stdev=21820.87 lat (usec): min=952, max=721692, avg=16653.96, stdev=21820.87 clat percentiles (usec): | 1.00th=[ 1434], 5.00th=[ 2507], 10.00th=[ 3195], 20.00th=[ 4146], | 30.00th=[ 6652], 40.00th=[ 10814], 50.00th=[ 13698], 60.00th=[ 16712], | 70.00th=[ 20579], 80.00th=[ 26346], 90.00th=[ 33817], 95.00th=[ 40109], | 99.00th=[ 55837], 99.50th=[ 66323], 99.90th=[ 79168], 99.95th=[725615], | 99.99th=[725615] bw ( KiB/s): min= 32, max= 183, per=25.38%, avg=108.89, stdev=28.09, samples=114 iops : min= 8, max= 45, avg=26.78, stdev= 7.01, samples=114 lat (usec) : 50=0.07%, 100=0.46%, 250=0.55%, 500=0.07%, 1000=0.07% lat (msec) : 2=1.37%, 4=8.50%, 10=12.76%, 20=37.08%, 50=37.27% lat (msec) : 100=1.79%, 750=0.03% cpu : usr=0.09%, sys=21.71%, ctx=8761, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179645: Wed Apr 29 18:50:25 2026 read: IOPS=25, BW=103KiB/s (105kB/s)(5940KiB/57662msec) clat (usec): min=48, max=124493, avg=20776.96, stdev=11215.79 lat (usec): min=49, max=124494, avg=20777.79, stdev=11215.79 clat percentiles (usec): | 1.00th=[ 109], 5.00th=[ 8094], 10.00th=[ 10159], 20.00th=[ 12256], | 30.00th=[ 13960], 40.00th=[ 16450], 50.00th=[ 19006], 60.00th=[ 21627], | 70.00th=[ 24511], 80.00th=[ 27919], 90.00th=[ 33424], 95.00th=[ 39584], | 99.00th=[ 57410], 99.50th=[ 65799], 99.90th=[102237], 99.95th=[124257], | 99.99th=[124257] bw ( KiB/s): min= 47, max= 159, per=25.22%, avg=103.40, stdev=24.31, samples=113 iops : min= 11, max= 39, avg=25.42, stdev= 6.07, samples=113 write: IOPS=27, BW=110KiB/s (113kB/s)(6348KiB/57662msec); 0 zone resets clat (usec): min=790, max=695494, avg=16742.52, stdev=21371.02 lat (usec): min=790, max=695494, avg=16743.80, stdev=21370.92 clat percentiles (usec): | 1.00th=[ 1549], 5.00th=[ 2638], 10.00th=[ 3163], 20.00th=[ 4047], | 30.00th=[ 6194], 40.00th=[ 10683], 50.00th=[ 13829], 60.00th=[ 16909], | 70.00th=[ 20841], 80.00th=[ 26346], 90.00th=[ 34866], 95.00th=[ 41157], | 99.00th=[ 56886], 99.50th=[ 62129], 99.90th=[ 84411], 99.95th=[692061], | 99.99th=[692061] bw ( KiB/s): min= 39, max= 192, per=25.63%, avg=109.97, stdev=31.86, samples=113 iops : min= 9, max= 48, avg=27.06, stdev= 7.94, samples=113 lat (usec) : 50=0.03%, 100=0.36%, 250=0.49%, 500=0.16%, 750=0.03% lat (usec) : 1000=0.13% lat (msec) : 2=0.94%, 4=9.11%, 10=13.05%, 20=36.88%, 50=36.91% lat (msec) : 100=1.79%, 250=0.07%, 750=0.03% cpu : usr=0.14%, sys=21.83%, ctx=8678, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179646: Wed Apr 29 18:50:25 2026 read: IOPS=26, BW=104KiB/s (107kB/s)(6028KiB/57906msec) clat (usec): min=48, max=109849, avg=20896.07, stdev=11318.90 lat (usec): min=48, max=109850, avg=20897.08, stdev=11319.01 clat percentiles (usec): | 1.00th=[ 105], 5.00th=[ 8291], 10.00th=[ 10028], 20.00th=[ 12256], | 30.00th=[ 14222], 40.00th=[ 16319], 50.00th=[ 19006], 60.00th=[ 21627], | 70.00th=[ 24511], 80.00th=[ 28181], 90.00th=[ 33817], 95.00th=[ 41157], | 99.00th=[ 61604], 99.50th=[ 64226], 99.90th=[107480], 99.95th=[109577], | 99.99th=[109577] bw ( KiB/s): min= 56, max= 176, per=25.51%, avg=104.60, stdev=25.10, samples=114 iops : min= 14, max= 44, avg=25.71, stdev= 6.29, samples=114 write: IOPS=27, BW=108KiB/s (111kB/s)(6260KiB/57906msec); 0 zone resets clat (usec): min=1053, max=736446, avg=16722.24, stdev=22117.36 lat (usec): min=1054, max=736447, avg=16723.43, stdev=22117.38 clat percentiles (usec): | 1.00th=[ 1565], 5.00th=[ 2606], 10.00th=[ 3195], 20.00th=[ 4228], | 30.00th=[ 6587], 40.00th=[ 10814], 50.00th=[ 13566], 60.00th=[ 16581], | 70.00th=[ 20841], 80.00th=[ 26608], 90.00th=[ 34866], 95.00th=[ 40633], | 99.00th=[ 53216], 99.50th=[ 59507], 99.90th=[ 79168], 99.95th=[734004], | 99.99th=[734004] bw ( KiB/s): min= 47, max= 174, per=25.29%, avg=108.49, stdev=26.03, samples=114 iops : min= 11, max= 43, avg=26.68, stdev= 6.51, samples=114 lat (usec) : 50=0.03%, 100=0.29%, 250=0.65%, 500=0.13% lat (msec) : 2=1.04%, 4=8.33%, 10=13.31%, 20=37.86%, 50=36.46% lat (msec) : 100=1.79%, 250=0.07%, 750=0.03% cpu : usr=0.13%, sys=21.73%, ctx=8681, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179647: Wed Apr 29 18:50:25 2026 read: IOPS=25, BW=103KiB/s (106kB/s)(6052KiB/58497msec) clat (usec): min=55, max=115477, avg=21017.89, stdev=11226.36 lat (usec): min=57, max=115478, avg=21018.71, stdev=11226.38 clat percentiles (usec): | 1.00th=[ 117], 5.00th=[ 8160], 10.00th=[ 10028], 20.00th=[ 11994], | 30.00th=[ 14091], 40.00th=[ 16909], 50.00th=[ 19268], 60.00th=[ 21627], | 70.00th=[ 24773], 80.00th=[ 28705], 90.00th=[ 33817], 95.00th=[ 40633], | 99.00th=[ 56886], 99.50th=[ 68682], 99.90th=[103285], 99.95th=[115868], | 99.99th=[115868] bw ( KiB/s): min= 47, max= 152, per=25.30%, avg=103.72, stdev=22.61, samples=115 iops : min= 11, max= 38, avg=25.50, stdev= 5.62, samples=115 write: IOPS=26, BW=107KiB/s (109kB/s)(6236KiB/58497msec); 0 zone resets clat (usec): min=919, max=736696, avg=16976.02, stdev=22775.15 lat (usec): min=920, max=736697, avg=16977.13, stdev=22775.16 clat percentiles (usec): | 1.00th=[ 1418], 5.00th=[ 2507], 10.00th=[ 3097], 20.00th=[ 4113], | 30.00th=[ 6456], 40.00th=[ 10683], 50.00th=[ 13173], 60.00th=[ 16581], | 70.00th=[ 20579], 80.00th=[ 26870], 90.00th=[ 34866], 95.00th=[ 43254], | 99.00th=[ 60031], 99.50th=[ 73925], 99.90th=[117965], 99.95th=[734004], | 99.99th=[734004] bw ( KiB/s): min= 47, max= 175, per=24.92%, avg=106.90, stdev=26.69, samples=115 iops : min= 11, max= 43, avg=26.29, stdev= 6.69, samples=115 lat (usec) : 100=0.36%, 250=0.46%, 500=0.10%, 750=0.03%, 1000=0.07% lat (msec) : 2=1.30%, 4=8.33%, 10=13.61%, 20=36.62%, 50=37.21% lat (msec) : 100=1.79%, 250=0.10%, 750=0.03% cpu : usr=0.13%, sys=21.59%, ctx=8762, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=410KiB/s (420kB/s), 103KiB/s-104KiB/s (105kB/s-107kB/s), io=23.4MiB (24.6MB), run=57662-58497msec WRITE: bw=430KiB/s (440kB/s), 107KiB/s-110KiB/s (109kB/s-113kB/s), io=24.6MiB (25.7MB), run=57662-58497msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179649: Wed Apr 29 18:50:38 2026 read: IOPS=20, BW=83.9KiB/s (85.9kB/s)(5992KiB/71395msec) clat (msec): min=3, max=715, avg=19.39, stdev=23.11 lat (msec): min=3, max=715, avg=19.39, stdev=23.11 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 6], 10.00th=[ 7], 20.00th=[ 9], | 30.00th=[ 11], 40.00th=[ 12], 50.00th=[ 14], 60.00th=[ 17], | 70.00th=[ 21], 80.00th=[ 27], 90.00th=[ 40], 95.00th=[ 51], | 99.00th=[ 74], 99.50th=[ 83], 99.90th=[ 102], 99.95th=[ 718], | 99.99th=[ 718] bw ( KiB/s): min= 15, max= 224, per=25.11%, avg=83.85, stdev=45.68, samples=141 iops : min= 3, max= 56, avg=20.53, stdev=11.51, samples=141 write: IOPS=22, BW=88.2KiB/s (90.3kB/s)(6296KiB/71395msec); 0 zone resets clat (msec): min=5, max=134, avg=26.85, stdev=16.97 lat (msec): min=5, max=134, avg=26.86, stdev=16.97 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 12], 20.00th=[ 14], | 30.00th=[ 16], 40.00th=[ 19], 50.00th=[ 22], 60.00th=[ 26], | 70.00th=[ 31], 80.00th=[ 38], 90.00th=[ 50], 95.00th=[ 60], | 99.00th=[ 91], 99.50th=[ 100], 99.90th=[ 126], 99.95th=[ 136], | 99.99th=[ 136] bw ( KiB/s): min= 23, max= 224, per=25.21%, avg=88.23, stdev=44.81, samples=141 iops : min= 5, max= 56, avg=21.62, stdev=11.28, samples=141 lat (msec) : 4=0.07%, 10=16.28%, 20=40.85%, 50=35.55%, 100=6.97% lat (msec) : 250=0.26%, 750=0.03% cpu : usr=0.11%, sys=10.28%, ctx=5830, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179650: Wed Apr 29 18:50:38 2026 read: IOPS=20, BW=83.1KiB/s (85.1kB/s)(5940KiB/71464msec) clat (msec): min=2, max=750, avg=19.91, stdev=24.08 lat (msec): min=2, max=750, avg=19.91, stdev=24.08 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 6], 10.00th=[ 7], 20.00th=[ 9], | 30.00th=[ 11], 40.00th=[ 13], 50.00th=[ 15], 60.00th=[ 17], | 70.00th=[ 22], 80.00th=[ 29], 90.00th=[ 41], 95.00th=[ 52], | 99.00th=[ 74], 99.50th=[ 85], 99.90th=[ 102], 99.95th=[ 751], | 99.99th=[ 751] bw ( KiB/s): min= 16, max= 232, per=24.87%, avg=83.06, stdev=44.11, samples=141 iops : min= 4, max= 58, avg=20.33, stdev=11.11, samples=141 write: IOPS=22, BW=88.8KiB/s (90.0kB/s)(6348KiB/71464msec); 0 zone resets clat (msec): min=6, max=147, avg=26.36, stdev=16.03 lat (msec): min=6, max=147, avg=26.36, stdev=16.03 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 12], 20.00th=[ 14], | 30.00th=[ 16], 40.00th=[ 19], 50.00th=[ 22], 60.00th=[ 26], | 70.00th=[ 31], 80.00th=[ 38], 90.00th=[ 48], 95.00th=[ 59], | 99.00th=[ 81], 99.50th=[ 94], 99.90th=[ 111], 99.95th=[ 148], | 99.99th=[ 148] bw ( KiB/s): min= 23, max= 240, per=25.32%, avg=88.62, stdev=44.35, samples=141 iops : min= 5, max= 60, avg=21.72, stdev=11.14, samples=141 lat (msec) : 4=0.07%, 10=15.59%, 20=40.59%, 50=36.75%, 100=6.71% lat (msec) : 250=0.26%, 1000=0.03% cpu : usr=0.11%, sys=10.36%, ctx=5916, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179651: Wed Apr 29 18:50:38 2026 read: IOPS=20, BW=83.9KiB/s (85.9kB/s)(6028KiB/71827msec) clat (usec): min=3262, max=94294, avg=19124.70, stdev=14339.84 lat (usec): min=3263, max=94295, avg=19125.51, stdev=14339.83 clat percentiles (usec): | 1.00th=[ 4424], 5.00th=[ 5800], 10.00th=[ 6652], 20.00th=[ 8160], | 30.00th=[ 9765], 40.00th=[12125], 50.00th=[14222], 60.00th=[16909], | 70.00th=[21365], 80.00th=[27919], 90.00th=[40633], 95.00th=[50594], | 99.00th=[68682], 99.50th=[76022], 99.90th=[86508], 99.95th=[93848], | 99.99th=[93848] bw ( KiB/s): min= 15, max= 248, per=25.15%, avg=83.99, stdev=47.26, samples=142 iops : min= 3, max= 62, avg=20.57, stdev=11.91, samples=142 write: IOPS=21, BW=87.2KiB/s (89.2kB/s)(6260KiB/71827msec); 0 zone resets clat (msec): min=5, max=763, avg=27.44, stdev=25.40 lat (msec): min=5, max=763, avg=27.44, stdev=25.40 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 11], 20.00th=[ 14], | 30.00th=[ 16], 40.00th=[ 18], 50.00th=[ 22], 60.00th=[ 26], | 70.00th=[ 32], 80.00th=[ 39], 90.00th=[ 50], 95.00th=[ 61], | 99.00th=[ 88], 99.50th=[ 99], 99.90th=[ 150], 99.95th=[ 768], | 99.99th=[ 768] bw ( KiB/s): min= 31, max= 264, per=24.93%, avg=87.25, stdev=47.44, samples=142 iops : min= 7, max= 66, avg=21.39, stdev=11.94, samples=142 lat (msec) : 4=0.07%, 10=18.20%, 20=38.05%, 50=36.17%, 100=7.29% lat (msec) : 250=0.20%, 1000=0.03% cpu : usr=0.09%, sys=10.13%, ctx=5805, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179652: Wed Apr 29 18:50:38 2026 read: IOPS=21, BW=84.7KiB/s (86.7kB/s)(6052KiB/71487msec) clat (msec): min=3, max=105, avg=18.91, stdev=13.84 lat (msec): min=3, max=105, avg=18.92, stdev=13.84 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 7], 10.00th=[ 7], 20.00th=[ 9], | 30.00th=[ 11], 40.00th=[ 12], 50.00th=[ 14], 60.00th=[ 18], | 70.00th=[ 22], 80.00th=[ 27], 90.00th=[ 40], 95.00th=[ 49], | 99.00th=[ 65], 99.50th=[ 73], 99.90th=[ 97], 99.95th=[ 106], | 99.99th=[ 106] bw ( KiB/s): min= 23, max= 255, per=25.25%, avg=84.32, stdev=43.99, samples=141 iops : min= 5, max= 63, avg=20.65, stdev=11.06, samples=141 write: IOPS=21, BW=87.2KiB/s (89.3kB/s)(6236KiB/71487msec); 0 zone resets clat (msec): min=6, max=755, avg=27.45, stdev=24.70 lat (msec): min=6, max=755, avg=27.45, stdev=24.70 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 12], 20.00th=[ 14], | 30.00th=[ 17], 40.00th=[ 19], 50.00th=[ 22], 60.00th=[ 27], | 70.00th=[ 32], 80.00th=[ 40], 90.00th=[ 50], 95.00th=[ 59], | 99.00th=[ 84], 99.50th=[ 97], 99.90th=[ 125], 99.95th=[ 760], | 99.99th=[ 760] bw ( KiB/s): min= 39, max= 240, per=24.88%, avg=87.08, stdev=43.14, samples=141 iops : min= 9, max= 60, avg=21.34, stdev=10.87, samples=141 lat (msec) : 4=0.16%, 10=16.31%, 20=39.65%, 50=36.91%, 100=6.80% lat (msec) : 250=0.13%, 1000=0.03% cpu : usr=0.12%, sys=10.23%, ctx=5850, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=334KiB/s (342kB/s), 83.1KiB/s-84.7KiB/s (85.1kB/s-86.7kB/s), io=23.4MiB (24.6MB), run=71395-71827msec WRITE: bw=350KiB/s (358kB/s), 87.2KiB/s-88.8KiB/s (89.2kB/s-90.0kB/s), io=24.6MiB (25.7MB), run=71395-71827msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179684: Wed Apr 29 18:51:04 2026 read: IOPS=19, BW=319KiB/s (327kB/s)(5920KiB/18550msec) clat (usec): min=45, max=99765, avg=25008.56, stdev=15163.86 lat (usec): min=46, max=99765, avg=25009.47, stdev=15163.90 clat percentiles (usec): | 1.00th=[ 63], 5.00th=[ 120], 10.00th=[ 10421], 20.00th=[ 14746], | 30.00th=[ 17433], 40.00th=[ 19530], 50.00th=[ 22938], 60.00th=[ 26084], | 70.00th=[ 29230], 80.00th=[ 34341], 90.00th=[ 42206], 95.00th=[ 53740], | 99.00th=[ 81265], 99.50th=[ 83362], 99.90th=[100140], 99.95th=[100140], | 99.99th=[100140] bw ( KiB/s): min= 96, max= 542, per=24.32%, avg=313.06, stdev=98.26, samples=36 iops : min= 6, max= 33, avg=18.89, stdev= 6.21, samples=36 write: IOPS=21, BW=343KiB/s (352kB/s)(6368KiB/18550msec); 0 zone resets clat (usec): min=1706, max=110596, avg=23299.28, stdev=18784.29 lat (usec): min=1708, max=110597, avg=23301.19, stdev=18784.05 clat percentiles (msec): | 1.00th=[ 3], 5.00th=[ 4], 10.00th=[ 5], 20.00th=[ 7], | 30.00th=[ 10], 40.00th=[ 14], 50.00th=[ 19], 60.00th=[ 24], | 70.00th=[ 29], 80.00th=[ 39], 90.00th=[ 50], 95.00th=[ 62], | 99.00th=[ 80], 99.50th=[ 101], 99.90th=[ 111], 99.95th=[ 111], | 99.99th=[ 111] bw ( KiB/s): min= 64, max= 512, per=25.22%, avg=341.44, stdev=92.92, samples=36 iops : min= 4, max= 32, avg=20.69, stdev= 5.83, samples=36 lat (usec) : 50=0.13%, 100=1.30%, 250=1.69%, 500=0.52% lat (msec) : 2=0.39%, 4=3.39%, 10=12.89%, 20=26.17%, 50=45.44% lat (msec) : 100=7.81%, 250=0.26% cpu : usr=0.08%, sys=19.69%, ctx=2372, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179685: Wed Apr 29 18:51:04 2026 read: IOPS=19, BW=317KiB/s (325kB/s)(5744KiB/18097msec) clat (usec): min=44, max=116010, avg=26003.10, stdev=15188.05 lat (usec): min=45, max=116011, avg=26004.00, stdev=15188.06 clat percentiles (usec): | 1.00th=[ 65], 5.00th=[ 149], 10.00th=[ 11207], 20.00th=[ 15401], | 30.00th=[ 17695], 40.00th=[ 20579], 50.00th=[ 24249], 60.00th=[ 27132], | 70.00th=[ 30802], 80.00th=[ 35914], 90.00th=[ 43779], 95.00th=[ 52691], | 99.00th=[ 79168], 99.50th=[ 86508], 99.90th=[115868], 99.95th=[115868], | 99.99th=[115868] bw ( KiB/s): min= 159, max= 474, per=24.68%, avg=317.69, stdev=78.77, samples=35 iops : min= 9, max= 29, avg=19.17, stdev= 4.91, samples=35 write: IOPS=22, BW=362KiB/s (370kB/s)(6544KiB/18097msec); 0 zone resets clat (usec): min=1019, max=105402, avg=21360.66, stdev=16775.05 lat (usec): min=1020, max=105403, avg=21363.88, stdev=16773.79 clat percentiles (msec): | 1.00th=[ 3], 5.00th=[ 4], 10.00th=[ 5], 20.00th=[ 7], | 30.00th=[ 10], 40.00th=[ 15], 50.00th=[ 18], 60.00th=[ 22], | 70.00th=[ 27], 80.00th=[ 34], 90.00th=[ 43], 95.00th=[ 53], | 99.00th=[ 84], 99.50th=[ 88], 99.90th=[ 106], 99.95th=[ 106], | 99.99th=[ 106] bw ( KiB/s): min= 127, max= 510, per=26.31%, avg=356.29, stdev=94.76, samples=35 iops : min= 7, max= 31, avg=21.60, stdev= 5.97, samples=35 lat (usec) : 50=0.13%, 100=0.91%, 250=1.30%, 500=0.52% lat (msec) : 2=0.65%, 4=3.91%, 10=12.89%, 20=27.73%, 50=45.83% lat (msec) : 100=5.86%, 250=0.26% cpu : usr=0.12%, sys=20.05%, ctx=2285, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179686: Wed Apr 29 18:51:04 2026 read: IOPS=21, BW=336KiB/s (344kB/s)(6256KiB/18598msec) clat (usec): min=44, max=137068, avg=25093.74, stdev=16209.51 lat (usec): min=45, max=137069, avg=25094.68, stdev=16209.52 clat percentiles (usec): | 1.00th=[ 59], 5.00th=[ 106], 10.00th=[ 8717], 20.00th=[ 14353], | 30.00th=[ 17433], 40.00th=[ 20579], 50.00th=[ 23462], 60.00th=[ 26608], | 70.00th=[ 30016], 80.00th=[ 34866], 90.00th=[ 41681], 95.00th=[ 51119], | 99.00th=[ 94897], 99.50th=[116917], 99.90th=[137364], 99.95th=[137364], | 99.99th=[137364] bw ( KiB/s): min= 159, max= 512, per=26.03%, avg=334.97, stdev=101.21, samples=36 iops : min= 9, max= 32, avg=20.28, stdev= 6.37, samples=36 write: IOPS=20, BW=324KiB/s (332kB/s)(6032KiB/18598msec); 0 zone resets clat (usec): min=1644, max=102314, avg=23267.44, stdev=17743.03 lat (usec): min=1646, max=102316, avg=23269.36, stdev=17743.11 clat percentiles (msec): | 1.00th=[ 3], 5.00th=[ 4], 10.00th=[ 5], 20.00th=[ 7], | 30.00th=[ 11], 40.00th=[ 16], 50.00th=[ 21], 60.00th=[ 25], | 70.00th=[ 30], 80.00th=[ 39], 90.00th=[ 48], 95.00th=[ 56], | 99.00th=[ 80], 99.50th=[ 86], 99.90th=[ 103], 99.95th=[ 103], | 99.99th=[ 103] bw ( KiB/s): min= 159, max= 576, per=23.44%, avg=317.36, stdev=107.51, samples=36 iops : min= 9, max= 36, avg=19.17, stdev= 6.78, samples=36 lat (usec) : 50=0.26%, 100=1.56%, 250=1.95%, 500=0.65% lat (msec) : 2=0.39%, 4=3.26%, 10=11.85%, 20=24.09%, 50=49.22% lat (msec) : 100=6.38%, 250=0.39% cpu : usr=0.11%, sys=19.34%, ctx=2366, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179687: Wed Apr 29 18:51:04 2026 read: IOPS=20, BW=330KiB/s (338kB/s)(6032KiB/18290msec) clat (usec): min=36, max=114236, avg=25522.02, stdev=17082.04 lat (usec): min=37, max=114237, avg=25522.90, stdev=17082.08 clat percentiles (usec): | 1.00th=[ 58], 5.00th=[ 97], 10.00th=[ 137], 20.00th=[ 14091], | 30.00th=[ 17171], 40.00th=[ 19792], 50.00th=[ 23462], 60.00th=[ 27395], | 70.00th=[ 31327], 80.00th=[ 35914], 90.00th=[ 43779], 95.00th=[ 56886], | 99.00th=[ 90702], 99.50th=[101188], 99.90th=[113771], 99.95th=[113771], | 99.99th=[113771] bw ( KiB/s): min= 205, max= 510, per=25.44%, avg=327.42, stdev=76.70, samples=36 iops : min= 12, max= 31, avg=19.81, stdev= 4.76, samples=36 write: IOPS=21, BW=342KiB/s (350kB/s)(6256KiB/18290msec); 0 zone resets clat (usec): min=1744, max=90159, avg=22116.68, stdev=17070.72 lat (usec): min=1745, max=90161, avg=22118.98, stdev=17071.06 clat percentiles (usec): | 1.00th=[ 2343], 5.00th=[ 3523], 10.00th=[ 4555], 20.00th=[ 6456], | 30.00th=[10028], 40.00th=[14353], 50.00th=[17695], 60.00th=[21890], | 70.00th=[27395], 80.00th=[35390], 90.00th=[47449], 95.00th=[59507], | 99.00th=[71828], 99.50th=[72877], 99.90th=[89654], 99.95th=[89654], | 99.99th=[89654] bw ( KiB/s): min= 159, max= 608, per=25.22%, avg=341.53, stdev=104.30, samples=36 iops : min= 9, max= 38, avg=20.69, stdev= 6.61, samples=36 lat (usec) : 50=0.26%, 100=2.60%, 250=2.47%, 500=0.13% lat (msec) : 2=0.26%, 4=3.52%, 10=12.76%, 20=26.04%, 50=44.27% lat (msec) : 100=7.42%, 250=0.26% cpu : usr=0.13%, sys=19.50%, ctx=2281, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1288KiB/s (1319kB/s), 317KiB/s-336KiB/s (325kB/s-344kB/s), io=23.4MiB (24.5MB), run=18097-18598msec WRITE: bw=1355KiB/s (1388kB/s), 324KiB/s-362KiB/s (332kB/s-370kB/s), io=24.6MiB (25.8MB), run=18097-18598msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179679: Wed Apr 29 18:51:08 2026 read: IOPS=16, BW=259KiB/s (265kB/s)(5920KiB/22849msec) clat (msec): min=5, max=149, avg=24.22, stdev=19.86 lat (msec): min=5, max=149, avg=24.22, stdev=19.86 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 11], | 30.00th=[ 13], 40.00th=[ 16], 50.00th=[ 18], 60.00th=[ 22], | 70.00th=[ 27], 80.00th=[ 35], 90.00th=[ 47], 95.00th=[ 59], | 99.00th=[ 107], 99.50th=[ 138], 99.90th=[ 150], 99.95th=[ 150], | 99.99th=[ 150] bw ( KiB/s): min= 64, max= 672, per=24.52%, avg=255.98, stdev=146.89, samples=45 iops : min= 4, max= 42, avg=15.49, stdev= 9.38, samples=45 write: IOPS=17, BW=279KiB/s (285kB/s)(6368KiB/22849msec); 0 zone resets clat (msec): min=7, max=142, avg=34.74, stdev=23.11 lat (msec): min=7, max=142, avg=34.75, stdev=23.11 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 17], | 30.00th=[ 21], 40.00th=[ 24], 50.00th=[ 27], 60.00th=[ 33], | 70.00th=[ 41], 80.00th=[ 50], 90.00th=[ 68], 95.00th=[ 86], | 99.00th=[ 118], 99.50th=[ 126], 99.90th=[ 144], 99.95th=[ 144], | 99.99th=[ 144] bw ( KiB/s): min= 95, max= 768, per=25.25%, avg=277.24, stdev=142.96, samples=45 iops : min= 5, max= 48, avg=16.82, stdev= 9.11, samples=45 lat (msec) : 10=9.38%, 20=32.68%, 50=43.62%, 100=12.76%, 250=1.56% cpu : usr=0.11%, sys=8.47%, ctx=1496, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179680: Wed Apr 29 18:51:08 2026 read: IOPS=15, BW=252KiB/s (258kB/s)(5744KiB/22805msec) clat (msec): min=4, max=152, avg=25.14, stdev=21.51 lat (msec): min=4, max=152, avg=25.14, stdev=21.51 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 11], | 30.00th=[ 13], 40.00th=[ 16], 50.00th=[ 18], 60.00th=[ 21], | 70.00th=[ 27], 80.00th=[ 35], 90.00th=[ 57], 95.00th=[ 70], | 99.00th=[ 108], 99.50th=[ 132], 99.90th=[ 153], 99.95th=[ 153], | 99.99th=[ 153] bw ( KiB/s): min= 63, max= 672, per=23.95%, avg=250.00, stdev=144.52, samples=45 iops : min= 3, max= 42, avg=15.13, stdev= 9.17, samples=45 write: IOPS=17, BW=287KiB/s (294kB/s)(6544KiB/22805msec); 0 zone resets clat (msec): min=6, max=147, avg=33.61, stdev=20.86 lat (msec): min=6, max=147, avg=33.61, stdev=20.86 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 17], | 30.00th=[ 20], 40.00th=[ 24], 50.00th=[ 29], 60.00th=[ 34], | 70.00th=[ 41], 80.00th=[ 50], 90.00th=[ 63], 95.00th=[ 71], | 99.00th=[ 104], 99.50th=[ 126], 99.90th=[ 148], 99.95th=[ 148], | 99.99th=[ 148] bw ( KiB/s): min= 63, max= 1024, per=25.88%, avg=284.20, stdev=167.33, samples=45 iops : min= 3, max= 64, avg=17.27, stdev=10.62, samples=45 lat (msec) : 10=9.51%, 20=34.51%, 50=40.23%, 100=14.45%, 250=1.30% cpu : usr=0.07%, sys=8.73%, ctx=1505, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179681: Wed Apr 29 18:51:08 2026 read: IOPS=17, BW=273KiB/s (279kB/s)(6256KiB/22935msec) clat (msec): min=4, max=117, avg=25.19, stdev=20.16 lat (msec): min=4, max=117, avg=25.19, stdev=20.16 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 11], | 30.00th=[ 13], 40.00th=[ 16], 50.00th=[ 19], 60.00th=[ 22], | 70.00th=[ 28], 80.00th=[ 37], 90.00th=[ 51], 95.00th=[ 72], | 99.00th=[ 99], 99.50th=[ 107], 99.90th=[ 118], 99.95th=[ 118], | 99.99th=[ 118] bw ( KiB/s): min= 95, max= 800, per=25.91%, avg=270.51, stdev=158.40, samples=45 iops : min= 5, max= 50, avg=16.40, stdev=10.05, samples=45 write: IOPS=16, BW=263KiB/s (269kB/s)(6032KiB/22935msec); 0 zone resets clat (msec): min=6, max=183, avg=34.52, stdev=22.74 lat (msec): min=6, max=183, avg=34.53, stdev=22.74 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 13], 20.00th=[ 17], | 30.00th=[ 20], 40.00th=[ 23], 50.00th=[ 29], 60.00th=[ 36], | 70.00th=[ 41], 80.00th=[ 50], 90.00th=[ 67], 95.00th=[ 75], | 99.00th=[ 112], 99.50th=[ 130], 99.90th=[ 184], 99.95th=[ 184], | 99.99th=[ 184] bw ( KiB/s): min= 32, max= 704, per=23.38%, avg=256.76, stdev=147.59, samples=45 iops : min= 2, max= 44, avg=15.53, stdev= 9.38, samples=45 lat (msec) : 10=9.77%, 20=34.64%, 50=41.02%, 100=13.54%, 250=1.04% cpu : usr=0.09%, sys=8.58%, ctx=1524, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179682: Wed Apr 29 18:51:08 2026 read: IOPS=16, BW=264KiB/s (270kB/s)(6032KiB/22850msec) clat (msec): min=4, max=130, avg=24.03, stdev=18.72 lat (msec): min=4, max=130, avg=24.03, stdev=18.72 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 8], 10.00th=[ 8], 20.00th=[ 11], | 30.00th=[ 13], 40.00th=[ 15], 50.00th=[ 18], 60.00th=[ 22], | 70.00th=[ 26], 80.00th=[ 35], 90.00th=[ 51], 95.00th=[ 62], | 99.00th=[ 88], 99.50th=[ 103], 99.90th=[ 131], 99.95th=[ 131], | 99.99th=[ 131] bw ( KiB/s): min= 32, max= 736, per=24.94%, avg=260.42, stdev=153.35, samples=45 iops : min= 2, max= 46, avg=15.78, stdev= 9.69, samples=45 write: IOPS=17, BW=274KiB/s (280kB/s)(6256KiB/22850msec); 0 zone resets clat (msec): min=7, max=186, avg=35.14, stdev=24.14 lat (msec): min=7, max=186, avg=35.14, stdev=24.14 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 17], | 30.00th=[ 20], 40.00th=[ 24], 50.00th=[ 28], 60.00th=[ 34], | 70.00th=[ 41], 80.00th=[ 51], 90.00th=[ 66], 95.00th=[ 84], | 99.00th=[ 125], 99.50th=[ 144], 99.90th=[ 186], 99.95th=[ 186], | 99.99th=[ 186] bw ( KiB/s): min= 63, max= 704, per=24.75%, avg=271.71, stdev=143.16, samples=45 iops : min= 3, max= 44, avg=16.47, stdev= 9.12, samples=45 lat (msec) : 10=10.16%, 20=32.68%, 50=41.93%, 100=13.54%, 250=1.69% cpu : usr=0.12%, sys=8.54%, ctx=1518, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1044KiB/s (1069kB/s), 252KiB/s-273KiB/s (258kB/s-279kB/s), io=23.4MiB (24.5MB), run=22805-22935msec WRITE: bw=1099KiB/s (1125kB/s), 263KiB/s-287KiB/s (269kB/s-294kB/s), io=24.6MiB (25.8MB), run=22805-22935msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179700: Wed Apr 29 18:51:19 2026 read: IOPS=2, BW=2098KiB/s (2149kB/s)(7168KiB/3416msec) clat (msec): min=125, max=996, avg=281.11, stdev=316.71 lat (msec): min=125, max=996, avg=281.12, stdev=316.71 clat percentiles (msec): | 1.00th=[ 126], 5.00th=[ 126], 10.00th=[ 126], 20.00th=[ 140], | 30.00th=[ 159], 40.00th=[ 159], 50.00th=[ 159], 60.00th=[ 192], | 70.00th=[ 192], 80.00th=[ 197], 90.00th=[ 995], 95.00th=[ 995], | 99.00th=[ 995], 99.50th=[ 995], 99.90th=[ 995], 99.95th=[ 995], | 99.99th=[ 995] bw ( KiB/s): min= 1973, max= 4096, per=52.35%, avg=2720.50, stdev=988.26, samples=4 iops : min= 1, max= 4, avg= 2.00, stdev= 1.41, samples=4 write: IOPS=1, BW=1499KiB/s (1535kB/s)(5120KiB/3416msec); 0 zone resets clat (msec): min=60, max=532, avg=266.12, stdev=170.94 lat (msec): min=60, max=534, avg=266.50, stdev=171.42 clat percentiles (msec): | 1.00th=[ 62], 5.00th=[ 62], 10.00th=[ 62], 20.00th=[ 62], | 30.00th=[ 220], 40.00th=[ 220], 50.00th=[ 234], 60.00th=[ 234], | 70.00th=[ 284], 80.00th=[ 284], 90.00th=[ 535], 95.00th=[ 535], | 99.00th=[ 535], 99.50th=[ 535], 99.90th=[ 535], 99.95th=[ 535], | 99.99th=[ 535] bw ( KiB/s): min= 1973, max= 4063, per=34.72%, avg=2526.75, stdev=1024.64, samples=4 iops : min= 1, max= 3, avg= 1.75, stdev= 0.96, samples=4 lat (msec) : 100=8.33%, 250=66.67%, 500=8.33%, 750=8.33%, 1000=8.33% cpu : usr=0.00%, sys=38.16%, ctx=978, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179701: Wed Apr 29 18:51:19 2026 read: IOPS=0, BW=520KiB/s (532kB/s)(2048KiB/3940msec) clat (msec): min=133, max=162, avg=148.39, stdev=20.54 lat (msec): min=133, max=162, avg=148.39, stdev=20.54 clat percentiles (msec): | 1.00th=[ 134], 5.00th=[ 134], 10.00th=[ 134], 20.00th=[ 134], | 30.00th=[ 134], 40.00th=[ 134], 50.00th=[ 134], 60.00th=[ 163], | 70.00th=[ 163], 80.00th=[ 163], 90.00th=[ 163], 95.00th=[ 163], | 99.00th=[ 163], 99.50th=[ 163], 99.90th=[ 163], 99.95th=[ 163], | 99.99th=[ 163] bw ( KiB/s): min= 1374, max= 2031, per=32.76%, avg=1702.50, stdev=464.57, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2599KiB/s (2661kB/s)(10.0MiB/3940msec); 0 zone resets clat (msec): min=76, max=1310, avg=361.00, stdev=379.26 lat (msec): min=76, max=1311, avg=361.09, stdev=379.26 clat percentiles (msec): | 1.00th=[ 78], 5.00th=[ 78], 10.00th=[ 78], 20.00th=[ 89], | 30.00th=[ 123], 40.00th=[ 159], 50.00th=[ 176], 60.00th=[ 226], | 70.00th=[ 330], 80.00th=[ 523], 90.00th=[ 600], 95.00th=[ 1318], | 99.00th=[ 1318], 99.50th=[ 1318], 99.90th=[ 1318], 99.95th=[ 1318], | 99.99th=[ 1318] bw ( KiB/s): min= 2031, max= 8175, per=62.95%, avg=4581.00, stdev=2579.70, samples=4 iops : min= 1, max= 7, avg= 3.50, stdev= 2.52, samples=4 lat (msec) : 100=16.67%, 250=50.00%, 500=8.33%, 750=16.67%, 2000=8.33% cpu : usr=0.05%, sys=29.73%, ctx=308, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179702: Wed Apr 29 18:51:19 2026 read: IOPS=1, BW=1658KiB/s (1698kB/s)(6144KiB/3706msec) clat (usec): min=423, max=322220, avg=151479.87, stdev=140671.37 lat (usec): min=424, max=322220, avg=151481.00, stdev=140671.24 clat percentiles (usec): | 1.00th=[ 424], 5.00th=[ 424], 10.00th=[ 424], 20.00th=[ 922], | 30.00th=[ 922], 40.00th=[101188], 50.00th=[101188], 60.00th=[191890], | 70.00th=[291505], 80.00th=[291505], 90.00th=[320865], 95.00th=[320865], | 99.00th=[320865], 99.50th=[320865], 99.90th=[320865], 99.95th=[320865], | 99.99th=[320865] bw ( KiB/s): min= 4096, max= 6144, per=98.52%, avg=5120.00, stdev=1448.15, samples=2 iops : min= 4, max= 6, avg= 5.00, stdev= 1.41, samples=2 write: IOPS=1, BW=1658KiB/s (1698kB/s)(6144KiB/3706msec); 0 zone resets clat (msec): min=149, max=1448, avg=450.40, stdev=501.66 lat (msec): min=149, max=1448, avg=450.45, stdev=501.68 clat percentiles (msec): | 1.00th=[ 150], 5.00th=[ 150], 10.00th=[ 150], 20.00th=[ 169], | 30.00th=[ 169], 40.00th=[ 220], 50.00th=[ 220], 60.00th=[ 253], | 70.00th=[ 464], 80.00th=[ 464], 90.00th=[ 1452], 95.00th=[ 1452], | 99.00th=[ 1452], 99.50th=[ 1452], 99.90th=[ 1452], 99.95th=[ 1452], | 99.99th=[ 1452] bw ( KiB/s): min= 1973, max= 2048, per=27.68%, avg=2014.20, stdev=31.32, samples=5 iops : min= 1, max= 2, avg= 1.20, stdev= 0.45, samples=5 lat (usec) : 500=8.33%, 1000=8.33% lat (msec) : 250=41.67%, 500=33.33%, 2000=8.33% cpu : usr=0.03%, sys=30.85%, ctx=408, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179703: Wed Apr 29 18:51:19 2026 read: IOPS=1, BW=1498KiB/s (1534kB/s)(5120KiB/3417msec) clat (usec): min=453, max=214700, avg=43787.82, stdev=95548.23 lat (usec): min=454, max=214700, avg=43788.76, stdev=95547.88 clat percentiles (usec): | 1.00th=[ 453], 5.00th=[ 453], 10.00th=[ 453], 20.00th=[ 453], | 30.00th=[ 486], 40.00th=[ 486], 50.00th=[ 494], 60.00th=[ 494], | 70.00th=[ 2802], 80.00th=[ 2802], 90.00th=[214959], 95.00th=[214959], | 99.00th=[214959], 99.50th=[214959], 99.90th=[214959], 99.95th=[214959], | 99.99th=[214959] bw ( KiB/s): min= 2031, max= 6071, per=77.95%, avg=4051.00, stdev=2856.71, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 write: IOPS=2, BW=2098KiB/s (2148kB/s)(7168KiB/3417msec); 0 zone resets clat (msec): min=134, max=1645, avg=442.63, stdev=538.96 lat (msec): min=134, max=1645, avg=442.68, stdev=538.97 clat percentiles (msec): | 1.00th=[ 134], 5.00th=[ 134], 10.00th=[ 134], 20.00th=[ 144], | 30.00th=[ 234], 40.00th=[ 234], 50.00th=[ 241], 60.00th=[ 275], | 70.00th=[ 275], 80.00th=[ 426], 90.00th=[ 1653], 95.00th=[ 1653], | 99.00th=[ 1653], 99.50th=[ 1653], 99.90th=[ 1653], 99.95th=[ 1653], | 99.99th=[ 1653] bw ( KiB/s): min= 1370, max= 4063, per=32.39%, avg=2357.25, stdev=1175.25, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (usec) : 500=25.00% lat (msec) : 4=8.33%, 250=41.67%, 500=16.67%, 2000=8.33% cpu : usr=0.00%, sys=30.53%, ctx=300, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5198KiB/s (5323kB/s), 520KiB/s-2098KiB/s (532kB/s-2149kB/s), io=20.0MiB (20.0MB), run=3416-3940msec WRITE: bw=7277KiB/s (7452kB/s), 1499KiB/s-2599KiB/s (1535kB/s-2661kB/s), io=28.0MiB (29.4MB), run=3416-3940msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179696: Wed Apr 29 18:51:19 2026 read: IOPS=2, BW=2294KiB/s (2349kB/s)(7168KiB/3125msec) clat (msec): min=51, max=287, avg=157.54, stdev=97.46 lat (msec): min=51, max=287, avg=157.54, stdev=97.46 clat percentiles (msec): | 1.00th=[ 52], 5.00th=[ 52], 10.00th=[ 52], 20.00th=[ 70], | 30.00th=[ 101], 40.00th=[ 101], 50.00th=[ 122], 60.00th=[ 192], | 70.00th=[ 192], 80.00th=[ 284], 90.00th=[ 288], 95.00th=[ 288], | 99.00th=[ 288], 99.50th=[ 288], 99.90th=[ 288], 99.95th=[ 288], | 99.99th=[ 288] bw ( KiB/s): min= 2048, max= 5774, per=80.45%, avg=3972.67, stdev=1866.06, samples=3 iops : min= 2, max= 5, avg= 3.67, stdev= 1.53, samples=3 write: IOPS=1, BW=1638KiB/s (1678kB/s)(5120KiB/3125msec); 0 zone resets clat (msec): min=151, max=713, avg=401.22, stdev=231.30 lat (msec): min=151, max=713, avg=401.30, stdev=231.30 clat percentiles (msec): | 1.00th=[ 153], 5.00th=[ 153], 10.00th=[ 153], 20.00th=[ 153], | 30.00th=[ 224], 40.00th=[ 224], 50.00th=[ 372], 60.00th=[ 372], | 70.00th=[ 550], 80.00th=[ 550], 90.00th=[ 718], 95.00th=[ 718], | 99.00th=[ 718], 99.50th=[ 718], 99.90th=[ 718], 99.95th=[ 718], | 99.99th=[ 718] bw ( KiB/s): min= 1924, max= 3900, per=35.74%, avg=2470.75, stdev=954.25, samples=4 iops : min= 1, max= 3, avg= 1.75, stdev= 0.96, samples=4 lat (msec) : 100=16.67%, 250=41.67%, 500=25.00%, 750=16.67% cpu : usr=0.03%, sys=11.49%, ctx=120, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179697: Wed Apr 29 18:51:19 2026 read: IOPS=0, BW=494KiB/s (506kB/s)(2048KiB/4147msec) clat (msec): min=200, max=262, avg=231.55, stdev=43.39 lat (msec): min=200, max=262, avg=231.55, stdev=43.39 clat percentiles (msec): | 1.00th=[ 201], 5.00th=[ 201], 10.00th=[ 201], 20.00th=[ 201], | 30.00th=[ 201], 40.00th=[ 201], 50.00th=[ 201], 60.00th=[ 264], | 70.00th=[ 264], 80.00th=[ 264], 90.00th=[ 264], 95.00th=[ 264], | 99.00th=[ 264], 99.50th=[ 264], 99.90th=[ 264], 99.95th=[ 264], | 99.99th=[ 264] bw ( KiB/s): min= 1368, max= 2048, per=34.59%, avg=1708.00, stdev=480.83, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 write: IOPS=2, BW=2469KiB/s (2529kB/s)(10.0MiB/4147msec); 0 zone resets clat (msec): min=35, max=1233, avg=355.69, stdev=374.06 lat (msec): min=35, max=1233, avg=355.77, stdev=374.05 clat percentiles (msec): | 1.00th=[ 36], 5.00th=[ 36], 10.00th=[ 36], 20.00th=[ 82], | 30.00th=[ 117], 40.00th=[ 127], 50.00th=[ 169], 60.00th=[ 259], | 70.00th=[ 313], 80.00th=[ 502], 90.00th=[ 726], 95.00th=[ 1234], | 99.00th=[ 1234], 99.50th=[ 1234], 99.90th=[ 1234], 99.95th=[ 1234], | 99.99th=[ 1234] bw ( KiB/s): min= 1988, max= 4047, per=35.04%, avg=2422.00, stdev=908.74, samples=5 iops : min= 1, max= 3, avg= 1.60, stdev= 0.89, samples=5 lat (msec) : 50=8.33%, 100=8.33%, 250=33.33%, 500=33.33%, 750=8.33% lat (msec) : 2000=8.33% cpu : usr=0.00%, sys=13.24%, ctx=115, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179698: Wed Apr 29 18:51:19 2026 read: IOPS=1, BW=1524KiB/s (1561kB/s)(6144KiB/4031msec) clat (msec): min=43, max=629, avg=229.50, stdev=237.31 lat (msec): min=43, max=629, avg=229.50, stdev=237.31 clat percentiles (msec): | 1.00th=[ 44], 5.00th=[ 44], 10.00th=[ 44], 20.00th=[ 68], | 30.00th=[ 68], 40.00th=[ 110], 50.00th=[ 110], 60.00th=[ 116], | 70.00th=[ 414], 80.00th=[ 414], 90.00th=[ 634], 95.00th=[ 634], | 99.00th=[ 634], 99.50th=[ 634], 99.90th=[ 634], 99.95th=[ 634], | 99.99th=[ 634] bw ( KiB/s): min= 1950, max= 2048, per=40.79%, avg=2014.25, stdev=46.25, samples=4 iops : min= 1, max= 2, avg= 1.50, stdev= 0.58, samples=4 write: IOPS=1, BW=1524KiB/s (1561kB/s)(6144KiB/4031msec); 0 zone resets clat (msec): min=56, max=1433, avg=437.62, stdev=512.31 lat (msec): min=56, max=1433, avg=437.73, stdev=512.31 clat percentiles (msec): | 1.00th=[ 57], 5.00th=[ 57], 10.00th=[ 57], 20.00th=[ 66], | 30.00th=[ 66], 40.00th=[ 262], 50.00th=[ 262], 60.00th=[ 368], | 70.00th=[ 443], 80.00th=[ 443], 90.00th=[ 1435], 95.00th=[ 1435], | 99.00th=[ 1435], 99.50th=[ 1435], 99.90th=[ 1435], 99.95th=[ 1435], | 99.99th=[ 1435] bw ( KiB/s): min= 1950, max= 4007, per=38.42%, avg=2656.00, stdev=1170.40, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (msec) : 50=8.33%, 100=25.00%, 250=16.67%, 500=33.33%, 750=8.33% lat (msec) : 2000=8.33% cpu : usr=0.00%, sys=10.22%, ctx=114, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179699: Wed Apr 29 18:51:19 2026 read: IOPS=1, BW=1666KiB/s (1706kB/s)(5120KiB/3074msec) clat (msec): min=74, max=204, avg=130.82, stdev=47.17 lat (msec): min=74, max=204, avg=130.82, stdev=47.17 clat percentiles (msec): | 1.00th=[ 74], 5.00th=[ 74], 10.00th=[ 74], 20.00th=[ 74], | 30.00th=[ 118], 40.00th=[ 118], 50.00th=[ 124], 60.00th=[ 124], | 70.00th=[ 136], 80.00th=[ 136], 90.00th=[ 205], 95.00th=[ 205], | 99.00th=[ 205], 99.50th=[ 205], 99.90th=[ 205], 99.95th=[ 205], | 99.99th=[ 205] bw ( KiB/s): min= 1950, max= 6144, per=81.96%, avg=4047.00, stdev=2965.61, samples=2 iops : min= 1, max= 6, avg= 3.50, stdev= 3.54, samples=2 write: IOPS=2, BW=2332KiB/s (2388kB/s)(7168KiB/3074msec); 0 zone resets clat (msec): min=78, max=1214, avg=336.21, stdev=399.35 lat (msec): min=78, max=1214, avg=336.58, stdev=399.30 clat percentiles (msec): | 1.00th=[ 79], 5.00th=[ 79], 10.00th=[ 79], 20.00th=[ 93], | 30.00th=[ 124], 40.00th=[ 124], 50.00th=[ 226], 60.00th=[ 292], | 70.00th=[ 292], 80.00th=[ 330], 90.00th=[ 1217], 95.00th=[ 1217], | 99.00th=[ 1217], 99.50th=[ 1217], 99.90th=[ 1217], 99.95th=[ 1217], | 99.99th=[ 1217] bw ( KiB/s): min= 1943, max= 6035, per=66.68%, avg=4609.67, stdev=2311.23, samples=3 iops : min= 1, max= 5, avg= 3.67, stdev= 2.31, samples=3 lat (msec) : 100=25.00%, 250=50.00%, 500=16.67%, 2000=8.33% cpu : usr=0.00%, sys=14.32%, ctx=101, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4939KiB/s (5057kB/s), 494KiB/s-2294KiB/s (506kB/s-2349kB/s), io=20.0MiB (20.0MB), run=3074-4147msec WRITE: bw=6914KiB/s (7080kB/s), 1524KiB/s-2469KiB/s (1561kB/s-2529kB/s), io=28.0MiB (29.4MB), run=3074-4147msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179713: Wed Apr 29 18:51:29 2026 read: IOPS=1, BW=7618KiB/s (7801kB/s)(12.0MiB/1613msec) clat (msec): min=452, max=551, avg=505.63, stdev=50.29 lat (msec): min=452, max=551, avg=505.63, stdev=50.29 clat percentiles (msec): | 1.00th=[ 451], 5.00th=[ 451], 10.00th=[ 451], 20.00th=[ 451], | 30.00th=[ 451], 40.00th=[ 514], 50.00th=[ 514], 60.00th=[ 514], | 70.00th=[ 550], 80.00th=[ 550], 90.00th=[ 550], 95.00th=[ 550], | 99.00th=[ 550], 99.50th=[ 550], 99.90th=[ 550], 99.95th=[ 550], | 99.99th=[ 550] bw ( KiB/s): min= 6150, max= 8143, per=89.30%, avg=7146.50, stdev=1409.26, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 750=66.67% cpu : usr=0.00%, sys=47.70%, ctx=1649, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179715: Wed Apr 29 18:51:29 2026 read: IOPS=0, BW=2001KiB/s (2049kB/s)(4096KiB/2047msec) clat (nsec): min=521079k, max=521079k, avg=521078931.00, stdev= 0.00 lat (nsec): min=521081k, max=521081k, avg=521081328.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 523], 5.00th=[ 523], 10.00th=[ 523], 20.00th=[ 523], | 30.00th=[ 523], 40.00th=[ 523], 50.00th=[ 523], 60.00th=[ 523], | 70.00th=[ 523], 80.00th=[ 523], 90.00th=[ 523], 95.00th=[ 523], | 99.00th=[ 523], 99.50th=[ 523], 99.90th=[ 523], 99.95th=[ 523], | 99.99th=[ 523] bw ( KiB/s): min= 6196, max= 6196, per=77.42%, avg=6196.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=4002KiB/s (4098kB/s)(8192KiB/2047msec); 0 zone resets clat (msec): min=603, max=800, avg=701.61, stdev=139.19 lat (msec): min=603, max=800, avg=702.15, stdev=138.85 clat percentiles (msec): | 1.00th=[ 600], 5.00th=[ 600], 10.00th=[ 600], 20.00th=[ 600], | 30.00th=[ 600], 40.00th=[ 600], 50.00th=[ 600], 60.00th=[ 802], | 70.00th=[ 802], 80.00th=[ 802], 90.00th=[ 802], 95.00th=[ 802], | 99.00th=[ 802], 99.50th=[ 802], 99.90th=[ 802], 99.95th=[ 802], | 99.99th=[ 802] bw ( KiB/s): min= 8192, max= 8192, per=51.18%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 750=66.67%, 1000=33.33% cpu : usr=0.05%, sys=7.67%, ctx=469, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179716: Wed Apr 29 18:51:29 2026 write: IOPS=1, BW=6865KiB/s (7030kB/s)(12.0MiB/1790msec); 0 zone resets clat (msec): min=364, max=758, avg=587.72, stdev=202.34 lat (msec): min=364, max=759, avg=588.20, stdev=202.38 clat percentiles (msec): | 1.00th=[ 363], 5.00th=[ 363], 10.00th=[ 363], 20.00th=[ 363], | 30.00th=[ 363], 40.00th=[ 642], 50.00th=[ 642], 60.00th=[ 642], | 70.00th=[ 760], 80.00th=[ 760], 90.00th=[ 760], 95.00th=[ 760], | 99.00th=[ 760], 99.50th=[ 760], 99.90th=[ 760], 99.95th=[ 760], | 99.99th=[ 760] bw ( KiB/s): min= 8143, max= 8192, per=51.02%, avg=8167.50, stdev=34.65, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 500=33.33%, 750=33.33%, 1000=33.33% cpu : usr=0.11%, sys=19.96%, ctx=100, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179717: Wed Apr 29 18:51:29 2026 write: IOPS=1, BW=6393KiB/s (6547kB/s)(12.0MiB/1922msec); 0 zone resets clat (msec): min=430, max=828, avg=595.54, stdev=207.44 lat (msec): min=431, max=828, avg=595.93, stdev=207.36 clat percentiles (msec): | 1.00th=[ 430], 5.00th=[ 430], 10.00th=[ 430], 20.00th=[ 430], | 30.00th=[ 430], 40.00th=[ 527], 50.00th=[ 527], 60.00th=[ 527], | 70.00th=[ 827], 80.00th=[ 827], 90.00th=[ 827], 95.00th=[ 827], | 99.00th=[ 827], 99.50th=[ 827], 99.90th=[ 827], 99.95th=[ 827], | 99.99th=[ 827] bw ( KiB/s): min= 6168, max= 8143, per=44.70%, avg=7155.50, stdev=1396.54, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 750=33.33%, 1000=33.33% cpu : usr=0.00%, sys=13.48%, ctx=86, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=8004KiB/s (8196kB/s), 2001KiB/s-7618KiB/s (2049kB/s-7801kB/s), io=16.0MiB (16.8MB), run=1613-2047msec WRITE: bw=15.6MiB/s (16.4MB/s), 4002KiB/s-6865KiB/s (4098kB/s-7030kB/s), io=32.0MiB (33.6MB), run=1790-2047msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179710: Wed Apr 29 18:51:29 2026 read: IOPS=1, BW=5891KiB/s (6032kB/s)(12.0MiB/2086msec) clat (msec): min=182, max=1061, avg=674.12, stdev=449.05 lat (msec): min=182, max=1061, avg=674.12, stdev=449.05 clat percentiles (msec): | 1.00th=[ 182], 5.00th=[ 182], 10.00th=[ 182], 20.00th=[ 182], | 30.00th=[ 182], 40.00th=[ 776], 50.00th=[ 776], 60.00th=[ 776], | 70.00th=[ 1062], 80.00th=[ 1062], 90.00th=[ 1062], 95.00th=[ 1062], | 99.00th=[ 1062], 99.50th=[ 1062], 99.90th=[ 1062], 99.95th=[ 1062], | 99.99th=[ 1062] bw ( KiB/s): min= 8175, max= 8175, per=100.00%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=9.78%, ctx=63, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179711: Wed Apr 29 18:51:29 2026 read: IOPS=0, BW=2296KiB/s (2351kB/s)(4096KiB/1784msec) clat (nsec): min=175278k, max=175278k, avg=175278354.00, stdev= 0.00 lat (nsec): min=175281k, max=175281k, avg=175280659.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 176], 5.00th=[ 176], 10.00th=[ 176], 20.00th=[ 176], | 30.00th=[ 176], 40.00th=[ 176], 50.00th=[ 176], 60.00th=[ 176], | 70.00th=[ 176], 80.00th=[ 176], 90.00th=[ 176], 95.00th=[ 176], | 99.00th=[ 176], 99.50th=[ 176], 99.90th=[ 176], 99.95th=[ 176], | 99.99th=[ 176] bw ( KiB/s): min= 5936, max= 5936, per=75.58%, avg=5936.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=1, BW=4592KiB/s (4702kB/s)(8192KiB/1784msec); 0 zone resets clat (msec): min=742, max=805, avg=774.10, stdev=44.62 lat (msec): min=742, max=806, avg=774.47, stdev=44.64 clat percentiles (msec): | 1.00th=[ 743], 5.00th=[ 743], 10.00th=[ 743], 20.00th=[ 743], | 30.00th=[ 743], 40.00th=[ 743], 50.00th=[ 743], 60.00th=[ 810], | 70.00th=[ 810], 80.00th=[ 810], 90.00th=[ 810], 95.00th=[ 810], | 99.00th=[ 810], 99.50th=[ 810], 99.90th=[ 810], 99.95th=[ 810], | 99.99th=[ 810] bw ( KiB/s): min= 8175, max= 8175, per=55.94%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 750=33.33%, 1000=33.33% cpu : usr=0.06%, sys=13.80%, ctx=93, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179712: Wed Apr 29 18:51:29 2026 write: IOPS=1, BW=5481KiB/s (5612kB/s)(12.0MiB/2242msec); 0 zone resets clat (msec): min=74, max=1446, avg=736.33, stdev=687.51 lat (msec): min=74, max=1447, avg=736.68, stdev=687.61 clat percentiles (msec): | 1.00th=[ 75], 5.00th=[ 75], 10.00th=[ 75], 20.00th=[ 75], | 30.00th=[ 75], 40.00th=[ 684], 50.00th=[ 684], 60.00th=[ 684], | 70.00th=[ 1452], 80.00th=[ 1452], 90.00th=[ 1452], 95.00th=[ 1452], | 99.00th=[ 1452], 99.50th=[ 1452], 99.90th=[ 1452], 99.95th=[ 1452], | 99.99th=[ 1452] bw ( KiB/s): min= 8175, max= 8175, per=55.94%, avg=8175.00, stdev= 0.00, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 100=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.00%, sys=9.77%, ctx=49, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179714: Wed Apr 29 18:51:29 2026 write: IOPS=1, BW=7010KiB/s (7178kB/s)(12.0MiB/1753msec); 0 zone resets clat (msec): min=156, max=1212, avg=575.05, stdev=560.97 lat (msec): min=157, max=1213, avg=575.67, stdev=561.12 clat percentiles (msec): | 1.00th=[ 157], 5.00th=[ 157], 10.00th=[ 157], 20.00th=[ 157], | 30.00th=[ 157], 40.00th=[ 355], 50.00th=[ 355], 60.00th=[ 355], | 70.00th=[ 1217], 80.00th=[ 1217], 90.00th=[ 1217], 95.00th=[ 1217], | 99.00th=[ 1217], 99.50th=[ 1217], 99.90th=[ 1217], 99.95th=[ 1217], | 99.99th=[ 1217] bw ( KiB/s): min=12468, max=12468, per=85.31%, avg=12468.00, stdev= 0.00, samples=1 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 500=33.33%, 2000=33.33% cpu : usr=0.06%, sys=13.47%, ctx=79, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=7854KiB/s (8043kB/s), 2296KiB/s-5891KiB/s (2351kB/s-6032kB/s), io=16.0MiB (16.8MB), run=1784-2086msec WRITE: bw=14.3MiB/s (14.0MB/s), 4592KiB/s-7010KiB/s (4702kB/s-7178kB/s), io=32.0MiB (33.6MB), run=1753-2242msec