== sanity test 398b: DIO and buffer IO race ============== 03:01:38 (1778655698) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 3.7606 s, 13.4 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=149020: Wed May 13 03:03:46 2026 read: IOPS=13, BW=53.8KiB/s (55.1kB/s)(5992KiB/111354msec) clat (usec): min=32, max=486301, avg=37685.16, stdev=30180.24 lat (usec): min=33, max=486302, avg=37688.37, stdev=30182.03 clat percentiles (usec): | 1.00th=[ 49], 5.00th=[ 58], 10.00th=[ 11600], 20.00th=[ 18482], | 30.00th=[ 22938], 40.00th=[ 27657], 50.00th=[ 32375], 60.00th=[ 38536], | 70.00th=[ 46400], 80.00th=[ 54789], 90.00th=[ 67634], 95.00th=[ 80217], | 99.00th=[145753], 99.50th=[162530], 99.90th=[387974], 99.95th=[484443], | 99.99th=[484443] bw ( KiB/s): min= 7, max= 111, per=25.41%, avg=53.37, stdev=20.18, samples=220 iops : min= 1, max= 27, avg=12.72, stdev= 5.09, samples=220 write: IOPS=14, BW=56.5KiB/s (57.9kB/s)(6296KiB/111354msec); 0 zone resets clat (usec): min=1009, max=459574, avg=34800.33, stdev=36286.44 lat (usec): min=1009, max=459576, avg=34802.65, stdev=36287.68 clat percentiles (usec): | 1.00th=[ 1205], 5.00th=[ 1303], 10.00th=[ 1893], 20.00th=[ 4293], | 30.00th=[ 8455], 40.00th=[ 16188], 50.00th=[ 26084], 60.00th=[ 36439], | 70.00th=[ 45351], 80.00th=[ 59507], 90.00th=[ 80217], 95.00th=[100140], | 99.00th=[149947], 99.50th=[179307], 99.90th=[295699], 99.95th=[459277], | 99.99th=[459277] bw ( KiB/s): min= 15, max= 112, per=25.45%, avg=56.00, stdev=20.38, samples=220 iops : min= 3, max= 28, avg=13.38, stdev= 5.12, samples=220 lat (usec) : 50=0.81%, 100=2.99%, 250=0.13%, 500=0.07%, 750=0.03% lat (usec) : 1000=0.10% lat (msec) : 2=5.50%, 4=4.39%, 10=7.55%, 20=12.34%, 50=40.53% lat (msec) : 100=21.97%, 250=3.39%, 500=0.20% cpu : usr=0.08%, sys=5.63%, ctx=6634, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=149021: Wed May 13 03:03:46 2026 read: IOPS=13, BW=52.2KiB/s (53.5kB/s)(5940KiB/113725msec) clat (usec): min=27, max=401119, avg=37273.41, stdev=28604.34 lat (usec): min=28, max=401120, avg=37275.88, stdev=28605.49 clat percentiles (usec): | 1.00th=[ 48], 5.00th=[ 59], 10.00th=[ 8455], 20.00th=[ 17433], | 30.00th=[ 22152], 40.00th=[ 26870], 50.00th=[ 32375], 60.00th=[ 38536], | 70.00th=[ 45876], 80.00th=[ 55313], 90.00th=[ 70779], 95.00th=[ 83362], | 99.00th=[124257], 99.50th=[147850], 99.90th=[362808], 99.95th=[400557], | 99.99th=[400557] bw ( KiB/s): min= 6, max= 127, per=24.61%, avg=51.67, stdev=21.83, samples=224 iops : min= 1, max= 31, avg=12.28, stdev= 5.49, samples=224 write: IOPS=13, BW=55.8KiB/s (57.2kB/s)(6348KiB/113725msec); 0 zone resets clat (usec): min=1127, max=338973, avg=36703.20, stdev=35637.20 lat (usec): min=1128, max=338973, avg=36706.99, stdev=35635.94 clat percentiles (usec): | 1.00th=[ 1221], 5.00th=[ 1434], 10.00th=[ 2089], 20.00th=[ 4752], | 30.00th=[ 9372], 40.00th=[ 19006], 50.00th=[ 28967], 60.00th=[ 38011], | 70.00th=[ 49021], 80.00th=[ 61604], 90.00th=[ 84411], 95.00th=[106431], | 99.00th=[145753], 99.50th=[164627], 99.90th=[263193], 99.95th=[337642], | 99.99th=[337642] bw ( KiB/s): min= 7, max= 112, per=25.06%, avg=55.14, stdev=21.18, samples=224 iops : min= 1, max= 28, avg=13.16, stdev= 5.32, samples=224 lat (usec) : 50=0.68%, 100=3.39%, 250=0.26%, 500=0.16% lat (msec) : 2=5.14%, 4=4.13%, 10=7.36%, 20=11.59%, 50=40.01% lat (msec) : 100=23.27%, 250=3.87%, 500=0.13% cpu : usr=0.07%, sys=5.61%, ctx=6712, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=149022: Wed May 13 03:03:46 2026 read: IOPS=13, BW=53.0KiB/s (54.3kB/s)(6028KiB/113651msec) clat (usec): min=27, max=196218, avg=37235.74, stdev=26174.30 lat (usec): min=28, max=196220, avg=37239.89, stdev=26174.59 clat percentiles (usec): | 1.00th=[ 45], 5.00th=[ 57], 10.00th=[ 8455], 20.00th=[ 18220], | 30.00th=[ 22414], 40.00th=[ 27395], 50.00th=[ 31851], 60.00th=[ 38011], | 70.00th=[ 45876], 80.00th=[ 55313], 90.00th=[ 71828], 95.00th=[ 85459], | 99.00th=[119014], 99.50th=[147850], 99.90th=[193987], 99.95th=[196084], | 99.99th=[196084] bw ( KiB/s): min= 7, max= 112, per=24.99%, avg=52.48, stdev=21.19, samples=224 iops : min= 1, max= 28, avg=12.50, stdev= 5.35, samples=224 write: IOPS=13, BW=55.1KiB/s (56.4kB/s)(6260KiB/113651msec); 0 zone resets clat (usec): min=1100, max=714746, avg=36679.31, stdev=40934.24 lat (usec): min=1101, max=714747, avg=36688.53, stdev=40949.20 clat percentiles (usec): | 1.00th=[ 1221], 5.00th=[ 1352], 10.00th=[ 1991], 20.00th=[ 4424], | 30.00th=[ 8291], 40.00th=[ 17171], 50.00th=[ 26608], 60.00th=[ 36963], | 70.00th=[ 48497], 80.00th=[ 63177], 90.00th=[ 85459], 95.00th=[106431], | 99.00th=[147850], 99.50th=[154141], 99.90th=[517997], 99.95th=[717226], | 99.99th=[717226] bw ( KiB/s): min= 7, max= 126, per=24.86%, avg=54.70, stdev=20.65, samples=223 iops : min= 1, max= 31, avg=13.05, stdev= 5.20, samples=223 lat (usec) : 50=1.20%, 100=2.96%, 250=0.26%, 500=0.07%, 750=0.07% lat (msec) : 2=5.27%, 4=4.46%, 10=7.16%, 20=12.21%, 50=39.03% lat (msec) : 100=22.92%, 250=4.30%, 500=0.03%, 750=0.07% cpu : usr=0.07%, sys=5.49%, ctx=6763, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=149023: Wed May 13 03:03:46 2026 read: IOPS=13, BW=53.1KiB/s (54.4kB/s)(6052KiB/113966msec) clat (usec): min=33, max=327712, avg=37468.87, stdev=27999.56 lat (usec): min=33, max=327713, avg=37470.76, stdev=28000.43 clat percentiles (usec): | 1.00th=[ 49], 5.00th=[ 60], 10.00th=[ 8455], 20.00th=[ 18220], | 30.00th=[ 22676], 40.00th=[ 27395], 50.00th=[ 31851], 60.00th=[ 38011], | 70.00th=[ 45876], 80.00th=[ 54789], 90.00th=[ 69731], 95.00th=[ 85459], | 99.00th=[131597], 99.50th=[158335], 99.90th=[267387], 99.95th=[329253], | 99.99th=[329253] bw ( KiB/s): min= 7, max= 119, per=25.16%, avg=52.83, stdev=21.67, samples=224 iops : min= 1, max= 29, avg=12.58, stdev= 5.45, samples=224 write: IOPS=13, BW=54.7KiB/s (56.0kB/s)(6236KiB/113966msec); 0 zone resets clat (usec): min=1040, max=525549, avg=36656.72, stdev=39645.53 lat (usec): min=1042, max=525550, avg=36658.62, stdev=39645.35 clat percentiles (usec): | 1.00th=[ 1188], 5.00th=[ 1352], 10.00th=[ 2040], 20.00th=[ 4424], | 30.00th=[ 8455], 40.00th=[ 17695], 50.00th=[ 27657], 60.00th=[ 35914], | 70.00th=[ 47449], 80.00th=[ 59507], 90.00th=[ 86508], 95.00th=[107480], | 99.00th=[160433], 99.50th=[223347], 99.90th=[362808], 99.95th=[526386], | 99.99th=[526386] bw ( KiB/s): min= 7, max= 151, per=24.84%, avg=54.64, stdev=21.96, samples=223 iops : min= 1, max= 37, avg=13.04, stdev= 5.54, samples=223 lat (usec) : 50=0.65%, 100=3.52%, 250=0.29%, 500=0.20%, 750=0.03% lat (usec) : 1000=0.10% lat (msec) : 2=4.95%, 4=4.69%, 10=7.26%, 20=11.43%, 50=40.23% lat (msec) : 100=22.07%, 250=4.39%, 500=0.16%, 750=0.03% cpu : usr=0.05%, sys=5.57%, ctx=6781, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=211KiB/s (216kB/s), 52.2KiB/s-53.8KiB/s (53.5kB/s-55.1kB/s), io=23.4MiB (24.6MB), run=111354-113966msec WRITE: bw=221KiB/s (226kB/s), 54.7KiB/s-56.5KiB/s (56.0kB/s-57.9kB/s), io=24.6MiB (25.7MB), run=111354-113966msec rand-rw: (groupid=0, jobs=1): err= 0: pid=149015: Wed May 13 03:06:06 2026 read: IOPS=5, BW=23.6KiB/s (24.1kB/s)(5992KiB/254242msec) clat (msec): min=5, max=606, avg=31.84, stdev=34.38 lat (msec): min=5, max=606, avg=31.84, stdev=34.38 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 10], 10.00th=[ 11], 20.00th=[ 14], | 30.00th=[ 16], 40.00th=[ 19], 50.00th=[ 22], 60.00th=[ 26], | 70.00th=[ 32], 80.00th=[ 43], 90.00th=[ 67], 95.00th=[ 88], | 99.00th=[ 155], 99.50th=[ 190], 99.90th=[ 489], 99.95th=[ 609], | 99.99th=[ 609] bw ( KiB/s): min= 7, max= 87, per=27.06%, avg=25.43, stdev=17.36, samples=456 iops : min= 1, max= 21, avg= 5.73, stdev= 4.37, samples=456 write: IOPS=6, BW=24.8KiB/s (25.4kB/s)(6296KiB/254242msec); 0 zone resets clat (msec): min=39, max=693, avg=131.04, stdev=55.48 lat (msec): min=39, max=693, avg=131.04, stdev=55.48 clat percentiles (msec): | 1.00th=[ 50], 5.00th=[ 65], 10.00th=[ 74], 20.00th=[ 85], | 30.00th=[ 97], 40.00th=[ 110], 50.00th=[ 122], 60.00th=[ 136], | 70.00th=[ 150], 80.00th=[ 169], 90.00th=[ 203], 95.00th=[ 230], | 99.00th=[ 300], 99.50th=[ 334], 99.90th=[ 498], 99.95th=[ 693], | 99.99th=[ 693] bw ( KiB/s): min= 7, max= 48, per=24.77%, avg=24.28, stdev= 9.67, samples=501 iops : min= 1, max= 12, avg= 5.44, stdev= 2.48, samples=501 lat (msec) : 10=3.52%, 20=18.82%, 50=19.14%, 100=22.23%, 250=34.64% lat (msec) : 500=1.60%, 750=0.07% cpu : usr=0.04%, sys=1.33%, ctx=5195, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=149016: Wed May 13 03:06:06 2026 read: IOPS=5, BW=23.4KiB/s (23.9kB/s)(5940KiB/254041msec) clat (msec): min=5, max=711, avg=31.79, stdev=33.30 lat (msec): min=5, max=711, avg=31.79, stdev=33.29 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 11], 20.00th=[ 14], | 30.00th=[ 16], 40.00th=[ 19], 50.00th=[ 22], 60.00th=[ 26], | 70.00th=[ 32], 80.00th=[ 44], 90.00th=[ 67], 95.00th=[ 89], | 99.00th=[ 148], 99.50th=[ 174], 99.90th=[ 292], 99.95th=[ 709], | 99.99th=[ 709] bw ( KiB/s): min= 7, max= 103, per=27.59%, avg=25.93, stdev=17.02, samples=443 iops : min= 1, max= 25, avg= 5.85, stdev= 4.27, samples=443 write: IOPS=6, BW=24.0KiB/s (25.6kB/s)(6348KiB/254041msec); 0 zone resets clat (msec): min=35, max=724, avg=130.14, stdev=56.90 lat (msec): min=35, max=724, avg=130.14, stdev=56.90 clat percentiles (msec): | 1.00th=[ 50], 5.00th=[ 62], 10.00th=[ 72], 20.00th=[ 86], | 30.00th=[ 96], 40.00th=[ 109], 50.00th=[ 122], 60.00th=[ 133], | 70.00th=[ 148], 80.00th=[ 167], 90.00th=[ 201], 95.00th=[ 226], | 99.00th=[ 292], 99.50th=[ 355], 99.90th=[ 659], 99.95th=[ 726], | 99.99th=[ 726] bw ( KiB/s): min= 7, max= 48, per=24.95%, avg=24.45, stdev= 9.62, samples=501 iops : min= 1, max= 12, avg= 5.47, stdev= 2.45, samples=501 lat (msec) : 10=3.84%, 20=18.59%, 50=18.49%, 100=22.79%, 250=34.80% lat (msec) : 500=1.37%, 750=0.13% cpu : usr=0.04%, sys=1.34%, ctx=5092, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=149017: Wed May 13 03:06:06 2026 read: IOPS=5, BW=23.8KiB/s (24.4kB/s)(6028KiB/252880msec) clat (msec): min=5, max=459, avg=31.89, stdev=30.23 lat (msec): min=5, max=459, avg=31.89, stdev=30.23 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 11], 20.00th=[ 14], | 30.00th=[ 17], 40.00th=[ 20], 50.00th=[ 23], 60.00th=[ 27], | 70.00th=[ 33], 80.00th=[ 44], 90.00th=[ 66], 95.00th=[ 85], | 99.00th=[ 146], 99.50th=[ 171], 99.90th=[ 296], 99.95th=[ 460], | 99.99th=[ 460] bw ( KiB/s): min= 7, max= 95, per=26.76%, avg=25.15, stdev=16.34, samples=462 iops : min= 1, max= 23, avg= 5.66, stdev= 4.11, samples=462 write: IOPS=6, BW=24.8KiB/s (25.3kB/s)(6260KiB/252880msec); 0 zone resets clat (msec): min=36, max=751, avg=130.68, stdev=57.14 lat (msec): min=36, max=751, avg=130.68, stdev=57.15 clat percentiles (msec): | 1.00th=[ 50], 5.00th=[ 63], 10.00th=[ 74], 20.00th=[ 87], | 30.00th=[ 99], 40.00th=[ 109], 50.00th=[ 122], 60.00th=[ 133], | 70.00th=[ 148], 80.00th=[ 167], 90.00th=[ 199], 95.00th=[ 230], | 99.00th=[ 300], 99.50th=[ 363], 99.90th=[ 751], 99.95th=[ 751], | 99.99th=[ 751] bw ( KiB/s): min= 7, max= 55, per=24.84%, avg=24.34, stdev= 9.69, samples=495 iops : min= 1, max= 13, avg= 5.45, stdev= 2.46, samples=495 lat (msec) : 10=3.78%, 20=17.25%, 50=20.41%, 100=22.36%, 250=34.54% lat (msec) : 500=1.56%, 750=0.07%, 1000=0.03% cpu : usr=0.04%, sys=1.40%, ctx=5230, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=149018: Wed May 13 03:06:06 2026 read: IOPS=5, BW=23.0KiB/s (24.5kB/s)(6052KiB/252535msec) clat (msec): min=5, max=470, avg=31.60, stdev=30.45 lat (msec): min=5, max=470, avg=31.60, stdev=30.45 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 14], | 30.00th=[ 16], 40.00th=[ 19], 50.00th=[ 22], 60.00th=[ 26], | 70.00th=[ 32], 80.00th=[ 43], 90.00th=[ 70], 95.00th=[ 90], | 99.00th=[ 142], 99.50th=[ 171], 99.90th=[ 241], 99.95th=[ 472], | 99.99th=[ 472] bw ( KiB/s): min= 7, max= 95, per=28.04%, avg=26.36, stdev=17.53, samples=444 iops : min= 1, max= 23, avg= 5.96, stdev= 4.42, samples=444 write: IOPS=6, BW=24.7KiB/s (25.3kB/s)(6236KiB/252535msec); 0 zone resets clat (msec): min=31, max=749, avg=131.11, stdev=56.44 lat (msec): min=31, max=749, avg=131.11, stdev=56.44 clat percentiles (msec): | 1.00th=[ 50], 5.00th=[ 65], 10.00th=[ 75], 20.00th=[ 87], | 30.00th=[ 99], 40.00th=[ 110], 50.00th=[ 121], 60.00th=[ 134], | 70.00th=[ 148], 80.00th=[ 169], 90.00th=[ 199], 95.00th=[ 232], | 99.00th=[ 309], 99.50th=[ 347], 99.90th=[ 667], 99.95th=[ 751], | 99.99th=[ 751] bw ( KiB/s): min= 7, max= 47, per=24.82%, avg=24.33, stdev= 9.17, samples=494 iops : min= 1, max= 11, avg= 5.45, stdev= 2.36, samples=494 lat (msec) : 10=4.07%, 20=18.20%, 50=19.86%, 100=21.26%, 250=34.96% lat (msec) : 500=1.60%, 750=0.07% cpu : usr=0.04%, sys=1.32%, ctx=5115, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=94.4KiB/s (96.7kB/s), 23.4KiB/s-23.0KiB/s (23.9kB/s-24.5kB/s), io=23.4MiB (24.6MB), run=252535-254242msec WRITE: bw=98.9KiB/s (101kB/s), 24.7KiB/s-24.0KiB/s (25.3kB/s-25.6kB/s), io=24.6MiB (25.7MB), run=252535-254242msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=149071: Wed May 13 03:06:41 2026 read: IOPS=14, BW=238KiB/s (243kB/s)(5920KiB/24902msec) clat (usec): min=37, max=327497, avg=34600.21, stdev=31326.65 lat (usec): min=37, max=327498, avg=34601.34, stdev=31326.63 clat percentiles (usec): | 1.00th=[ 43], 5.00th=[ 53], 10.00th=[ 60], 20.00th=[ 92], | 30.00th=[ 19268], 40.00th=[ 26346], 50.00th=[ 30802], 60.00th=[ 37487], | 70.00th=[ 44827], 80.00th=[ 55837], 90.00th=[ 70779], 95.00th=[ 82314], | 99.00th=[111674], 99.50th=[160433], 99.90th=[329253], 99.95th=[329253], | 99.99th=[329253] bw ( KiB/s): min= 31, max= 416, per=26.47%, avg=242.23, stdev=80.68, samples=48 iops : min= 1, max= 26, avg=14.42, stdev= 5.12, samples=48 write: IOPS=15, BW=256KiB/s (262kB/s)(6368KiB/24902msec); 0 zone resets clat (usec): min=1527, max=250135, avg=29673.76, stdev=32921.07 lat (usec): min=1529, max=250137, avg=29676.51, stdev=32921.40 clat percentiles (usec): | 1.00th=[ 1614], 5.00th=[ 1844], 10.00th=[ 2966], 20.00th=[ 5211], | 30.00th=[ 7963], 40.00th=[ 11994], 50.00th=[ 18482], 60.00th=[ 27132], | 70.00th=[ 35390], 80.00th=[ 50070], 90.00th=[ 70779], 95.00th=[ 86508], | 99.00th=[160433], 99.50th=[196084], 99.90th=[250610], 99.95th=[250610], | 99.99th=[250610] bw ( KiB/s): min= 30, max= 416, per=26.56%, avg=255.53, stdev=106.77, samples=49 iops : min= 1, max= 26, avg=15.27, stdev= 6.70, samples=49 lat (usec) : 50=1.43%, 100=8.33%, 250=0.52%, 500=0.26% lat (msec) : 2=3.39%, 4=4.69%, 10=12.50%, 20=10.94%, 50=35.03% lat (msec) : 100=20.44%, 250=2.21%, 500=0.26% cpu : usr=0.10%, sys=6.16%, ctx=1478, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=149072: Wed May 13 03:06:41 2026 read: IOPS=13, BW=219KiB/s (225kB/s)(5744KiB/26171msec) clat (usec): min=48, max=197719, avg=36805.63, stdev=29419.13 lat (usec): min=50, max=197720, avg=36806.68, stdev=29419.09 clat percentiles (usec): | 1.00th=[ 51], 5.00th=[ 57], 10.00th=[ 63], 20.00th=[ 17433], | 30.00th=[ 24249], 40.00th=[ 29492], 50.00th=[ 32900], 60.00th=[ 37487], | 70.00th=[ 45351], 80.00th=[ 52167], 90.00th=[ 68682], 95.00th=[ 86508], | 99.00th=[143655], 99.50th=[193987], 99.90th=[198181], 99.95th=[198181], | 99.99th=[198181] bw ( KiB/s): min= 31, max= 416, per=24.38%, avg=223.12, stdev=92.86, samples=50 iops : min= 1, max= 26, avg=13.22, stdev= 5.85, samples=50 write: IOPS=15, BW=250KiB/s (256kB/s)(6544KiB/26171msec); 0 zone resets clat (usec): min=1510, max=250644, avg=30892.65, stdev=35492.92 lat (usec): min=1512, max=250645, avg=30895.57, stdev=35492.76 clat percentiles (usec): | 1.00th=[ 1631], 5.00th=[ 1844], 10.00th=[ 2802], 20.00th=[ 4555], | 30.00th=[ 6456], 40.00th=[ 10814], 50.00th=[ 17695], 60.00th=[ 26870], | 70.00th=[ 38011], 80.00th=[ 52691], 90.00th=[ 74974], 95.00th=[ 94897], | 99.00th=[168821], 99.50th=[181404], 99.90th=[250610], 99.95th=[250610], | 99.99th=[250610] bw ( KiB/s): min= 31, max= 536, per=25.99%, avg=250.02, stdev=109.85, samples=51 iops : min= 1, max= 33, avg=14.90, stdev= 6.91, samples=51 lat (usec) : 50=0.13%, 100=7.55%, 250=0.26%, 500=0.13% lat (msec) : 2=3.52%, 4=5.21%, 10=11.85%, 20=10.29%, 50=39.58% lat (msec) : 100=17.71%, 250=3.65%, 500=0.13% cpu : usr=0.07%, sys=6.16%, ctx=1546, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=149073: Wed May 13 03:06:41 2026 read: IOPS=15, BW=255KiB/s (261kB/s)(6256KiB/24541msec) clat (usec): min=37, max=159684, avg=35044.66, stdev=24999.81 lat (usec): min=37, max=159685, avg=35045.66, stdev=24999.82 clat percentiles (usec): | 1.00th=[ 40], 5.00th=[ 54], 10.00th=[ 64], 20.00th=[ 15795], | 30.00th=[ 24249], 40.00th=[ 28443], 50.00th=[ 32375], 60.00th=[ 39060], | 70.00th=[ 45351], 80.00th=[ 53216], 90.00th=[ 65799], 95.00th=[ 72877], | 99.00th=[115868], 99.50th=[158335], 99.90th=[160433], 99.95th=[160433], | 99.99th=[160433] bw ( KiB/s): min= 64, max= 508, per=28.07%, avg=256.83, stdev=94.54, samples=48 iops : min= 4, max= 31, avg=15.35, stdev= 5.88, samples=48 write: IOPS=15, BW=246KiB/s (252kB/s)(6032KiB/24541msec); 0 zone resets clat (usec): min=1511, max=188836, avg=28173.93, stdev=28969.59 lat (usec): min=1514, max=188837, avg=28186.12, stdev=28974.41 clat percentiles (usec): | 1.00th=[ 1647], 5.00th=[ 1893], 10.00th=[ 2540], 20.00th=[ 4621], | 30.00th=[ 7177], 40.00th=[ 11076], 50.00th=[ 18482], 60.00th=[ 26870], | 70.00th=[ 38011], 80.00th=[ 50594], 90.00th=[ 63701], 95.00th=[ 83362], | 99.00th=[127402], 99.50th=[173016], 99.90th=[189793], 99.95th=[189793], | 99.99th=[189793] bw ( KiB/s): min= 63, max= 504, per=25.32%, avg=243.54, stdev=92.11, samples=48 iops : min= 3, max= 31, avg=14.52, stdev= 5.82, samples=48 lat (usec) : 50=1.43%, 100=6.38%, 250=0.52%, 500=0.13%, 750=0.13% lat (msec) : 2=2.86%, 4=6.25%, 10=9.90%, 20=9.38%, 50=40.89% lat (msec) : 100=19.79%, 250=2.34% cpu : usr=0.07%, sys=6.48%, ctx=1596, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=149075: Wed May 13 03:06:41 2026 read: IOPS=14, BW=234KiB/s (240kB/s)(6032KiB/25758msec) clat (usec): min=38, max=301076, avg=36010.97, stdev=31722.64 lat (usec): min=38, max=301077, avg=36014.36, stdev=31723.69 clat percentiles (usec): | 1.00th=[ 47], 5.00th=[ 55], 10.00th=[ 59], 20.00th=[ 4817], | 30.00th=[ 21890], 40.00th=[ 27132], 50.00th=[ 32637], 60.00th=[ 38536], | 70.00th=[ 44827], 80.00th=[ 54264], 90.00th=[ 68682], 95.00th=[ 82314], | 99.00th=[160433], 99.50th=[179307], 99.90th=[299893], 99.95th=[299893], | 99.99th=[299893] bw ( KiB/s): min= 95, max= 352, per=25.49%, avg=233.22, stdev=74.06, samples=50 iops : min= 5, max= 22, avg=13.86, stdev= 4.62, samples=50 write: IOPS=15, BW=243KiB/s (249kB/s)(6256KiB/25758msec); 0 zone resets clat (usec): min=1460, max=228534, avg=31019.72, stdev=33501.35 lat (usec): min=1462, max=228535, avg=31025.56, stdev=33499.16 clat percentiles (usec): | 1.00th=[ 1516], 5.00th=[ 1811], 10.00th=[ 2442], 20.00th=[ 4490], | 30.00th=[ 7701], 40.00th=[ 12649], 50.00th=[ 18482], 60.00th=[ 27657], | 70.00th=[ 40109], 80.00th=[ 53216], 90.00th=[ 73925], 95.00th=[ 94897], | 99.00th=[152044], 99.50th=[191890], 99.90th=[227541], 99.95th=[227541], | 99.99th=[227541] bw ( KiB/s): min= 64, max= 448, per=25.10%, avg=241.44, stdev=105.61, samples=50 iops : min= 4, max= 28, avg=14.38, stdev= 6.69, samples=50 lat (usec) : 50=1.30%, 100=7.16%, 250=0.91%, 500=0.26% lat (msec) : 2=3.52%, 4=6.38%, 10=8.59%, 20=11.33%, 50=36.85% lat (msec) : 100=19.79%, 250=3.78%, 500=0.13% cpu : usr=0.05%, sys=6.12%, ctx=1509, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=915KiB/s (937kB/s), 219KiB/s-255KiB/s (225kB/s-261kB/s), io=23.4MiB (24.5MB), run=24541-26171msec WRITE: bw=963KiB/s (986kB/s), 243KiB/s-256KiB/s (249kB/s-262kB/s), io=24.6MiB (25.8MB), run=24541-26171msec rand-rw: (groupid=0, jobs=1): err= 0: pid=149074: Wed May 13 03:07:19 2026 read: IOPS=5, BW=93.7KiB/s (95.9kB/s)(5920KiB/63183msec) clat (msec): min=6, max=316, avg=34.16, stdev=33.08 lat (msec): min=6, max=316, avg=34.16, stdev=33.08 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 16], | 30.00th=[ 19], 40.00th=[ 22], 50.00th=[ 24], 60.00th=[ 28], | 70.00th=[ 34], 80.00th=[ 45], 90.00th=[ 63], 95.00th=[ 88], | 99.00th=[ 190], 99.50th=[ 213], 99.90th=[ 317], 99.95th=[ 317], | 99.99th=[ 317] bw ( KiB/s): min= 31, max= 320, per=26.82%, avg=99.77, stdev=60.05, samples=115 iops : min= 1, max= 20, avg= 5.52, stdev= 3.81, samples=115 write: IOPS=6, BW=101KiB/s (103kB/s)(6368KiB/63183msec); 0 zone resets clat (msec): min=51, max=366, avg=126.80, stdev=51.11 lat (msec): min=51, max=366, avg=126.81, stdev=51.12 clat percentiles (msec): | 1.00th=[ 55], 5.00th=[ 66], 10.00th=[ 74], 20.00th=[ 86], | 30.00th=[ 95], 40.00th=[ 105], 50.00th=[ 115], 60.00th=[ 131], | 70.00th=[ 142], 80.00th=[ 161], 90.00th=[ 197], 95.00th=[ 228], | 99.00th=[ 288], 99.50th=[ 363], 99.90th=[ 368], 99.95th=[ 368], | 99.99th=[ 368] bw ( KiB/s): min= 31, max= 192, per=25.57%, avg=100.22, stdev=39.74, samples=124 iops : min= 1, max= 12, avg= 5.55, stdev= 2.59, samples=124 lat (msec) : 10=1.82%, 20=15.23%, 50=23.57%, 100=23.96%, 250=33.72% lat (msec) : 500=1.69% cpu : usr=0.04%, sys=1.37%, ctx=1309, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=149076: Wed May 13 03:07:19 2026 read: IOPS=5, BW=89.4KiB/s (91.5kB/s)(5744KiB/64275msec) clat (msec): min=6, max=367, avg=35.51, stdev=36.75 lat (msec): min=6, max=367, avg=35.51, stdev=36.75 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 16], | 30.00th=[ 18], 40.00th=[ 21], 50.00th=[ 24], 60.00th=[ 28], | 70.00th=[ 33], 80.00th=[ 45], 90.00th=[ 74], 95.00th=[ 106], | 99.00th=[ 194], 99.50th=[ 245], 99.90th=[ 368], 99.95th=[ 368], | 99.99th=[ 368] bw ( KiB/s): min= 21, max= 320, per=26.57%, avg=98.83, stdev=63.33, samples=115 iops : min= 1, max= 20, avg= 5.47, stdev= 4.01, samples=115 write: IOPS=6, BW=102KiB/s (104kB/s)(6544KiB/64275msec); 0 zone resets clat (msec): min=40, max=354, avg=125.49, stdev=53.24 lat (msec): min=40, max=354, avg=125.49, stdev=53.24 clat percentiles (msec): | 1.00th=[ 48], 5.00th=[ 62], 10.00th=[ 72], 20.00th=[ 83], | 30.00th=[ 94], 40.00th=[ 105], 50.00th=[ 116], 60.00th=[ 129], | 70.00th=[ 140], 80.00th=[ 159], 90.00th=[ 199], 95.00th=[ 230], | 99.00th=[ 317], 99.50th=[ 347], 99.90th=[ 355], 99.95th=[ 355], | 99.99th=[ 355] bw ( KiB/s): min= 31, max= 255, per=26.05%, avg=102.11, stdev=46.03, samples=126 iops : min= 1, max= 15, avg= 5.67, stdev= 3.01, samples=126 lat (msec) : 10=1.82%, 20=15.63%, 50=22.01%, 100=23.18%, 250=35.81% lat (msec) : 500=1.56% cpu : usr=0.03%, sys=1.45%, ctx=1334, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=149077: Wed May 13 03:07:19 2026 read: IOPS=6, BW=99.0KiB/s (102kB/s)(6256KiB/62590msec) clat (msec): min=8, max=366, avg=34.78, stdev=33.76 lat (msec): min=8, max=366, avg=34.78, stdev=33.76 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 16], | 30.00th=[ 19], 40.00th=[ 22], 50.00th=[ 25], 60.00th=[ 28], | 70.00th=[ 34], 80.00th=[ 46], 90.00th=[ 70], 95.00th=[ 97], | 99.00th=[ 157], 99.50th=[ 271], 99.90th=[ 368], 99.95th=[ 368], | 99.99th=[ 368] bw ( KiB/s): min= 31, max= 416, per=28.99%, avg=107.86, stdev=75.84, samples=115 iops : min= 1, max= 26, avg= 6.03, stdev= 4.86, samples=115 write: IOPS=6, BW=96.4KiB/s (98.7kB/s)(6032KiB/62590msec); 0 zone resets clat (msec): min=46, max=424, avg=129.25, stdev=54.86 lat (msec): min=46, max=424, avg=129.25, stdev=54.86 clat percentiles (msec): | 1.00th=[ 53], 5.00th=[ 65], 10.00th=[ 75], 20.00th=[ 87], | 30.00th=[ 95], 40.00th=[ 105], 50.00th=[ 117], 60.00th=[ 130], | 70.00th=[ 146], 80.00th=[ 167], 90.00th=[ 203], 95.00th=[ 239], | 99.00th=[ 330], 99.50th=[ 363], 99.90th=[ 426], 99.95th=[ 426], | 99.99th=[ 426] bw ( KiB/s): min= 31, max= 160, per=24.44%, avg=95.80, stdev=36.42, samples=123 iops : min= 1, max= 10, avg= 5.28, stdev= 2.44, samples=123 lat (msec) : 10=1.69%, 20=16.67%, 50=23.70%, 100=23.44%, 250=32.68% lat (msec) : 500=1.82% cpu : usr=0.04%, sys=1.50%, ctx=1320, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=149078: Wed May 13 03:07:19 2026 read: IOPS=5, BW=95.4KiB/s (97.7kB/s)(6032KiB/63217msec) clat (msec): min=6, max=290, avg=33.02, stdev=29.57 lat (msec): min=6, max=290, avg=33.04, stdev=29.57 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 12], 20.00th=[ 15], | 30.00th=[ 18], 40.00th=[ 21], 50.00th=[ 24], 60.00th=[ 27], | 70.00th=[ 33], 80.00th=[ 46], 90.00th=[ 68], 95.00th=[ 100], | 99.00th=[ 144], 99.50th=[ 161], 99.90th=[ 292], 99.95th=[ 292], | 99.99th=[ 292] bw ( KiB/s): min= 31, max= 288, per=28.61%, avg=106.41, stdev=64.96, samples=112 iops : min= 1, max= 18, avg= 5.93, stdev= 4.15, samples=112 write: IOPS=6, BW=98.0KiB/s (101kB/s)(6256KiB/63217msec); 0 zone resets clat (msec): min=44, max=432, avg=129.25, stdev=53.20 lat (msec): min=44, max=432, avg=129.26, stdev=53.20 clat percentiles (msec): | 1.00th=[ 47], 5.00th=[ 67], 10.00th=[ 78], 20.00th=[ 90], | 30.00th=[ 97], 40.00th=[ 109], 50.00th=[ 120], 60.00th=[ 128], | 70.00th=[ 142], 80.00th=[ 161], 90.00th=[ 194], 95.00th=[ 226], | 99.00th=[ 313], 99.50th=[ 380], 99.90th=[ 435], 99.95th=[ 435], | 99.99th=[ 435] bw ( KiB/s): min= 31, max= 192, per=25.39%, avg=99.55, stdev=39.21, samples=124 iops : min= 1, max= 12, avg= 5.51, stdev= 2.60, samples=124 lat (msec) : 10=2.21%, 20=16.54%, 50=23.05%, 100=21.74%, 250=34.77% lat (msec) : 500=1.69% cpu : usr=0.03%, sys=1.41%, ctx=1340, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=373KiB/s (382kB/s), 89.4KiB/s-99.0KiB/s (91.5kB/s-102kB/s), io=23.4MiB (24.5MB), run=62590-64275msec WRITE: bw=392KiB/s (401kB/s), 96.4KiB/s-102KiB/s (98.7kB/s-104kB/s), io=24.6MiB (25.8MB), run=62590-64275msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=149097: Wed May 13 03:07:35 2026 read: IOPS=1, BW=1785KiB/s (1828kB/s)(7168KiB/4016msec) clat (msec): min=76, max=433, avg=164.91, stdev=124.64 lat (msec): min=76, max=433, avg=164.91, stdev=124.64 clat percentiles (msec): | 1.00th=[ 77], 5.00th=[ 77], 10.00th=[ 77], 20.00th=[ 87], | 30.00th=[ 101], 40.00th=[ 101], 50.00th=[ 131], 60.00th=[ 136], | 70.00th=[ 136], 80.00th=[ 192], 90.00th=[ 435], 95.00th=[ 435], | 99.00th=[ 435], 99.50th=[ 435], 99.90th=[ 435], 99.95th=[ 435], | 99.99th=[ 435] bw ( KiB/s): min= 2035, max= 4407, per=85.09%, avg=3499.00, stdev=1280.02, samples=3 iops : min= 1, max= 4, avg= 2.67, stdev= 1.53, samples=3 write: IOPS=1, BW=1275KiB/s (1305kB/s)(5120KiB/4016msec); 0 zone resets clat (msec): min=295, max=1035, avg=533.37, stdev=294.53 lat (msec): min=295, max=1035, avg=533.45, stdev=294.52 clat percentiles (msec): | 1.00th=[ 296], 5.00th=[ 296], 10.00th=[ 296], 20.00th=[ 296], | 30.00th=[ 380], 40.00th=[ 380], 50.00th=[ 414], 60.00th=[ 414], | 70.00th=[ 542], 80.00th=[ 542], 90.00th=[ 1036], 95.00th=[ 1036], | 99.00th=[ 1036], 99.50th=[ 1036], 99.90th=[ 1036], 99.95th=[ 1036], | 99.99th=[ 1036] bw ( KiB/s): min= 1996, max= 4071, per=46.93%, avg=2702.00, stdev=1185.78, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (msec) : 100=16.67%, 250=33.33%, 500=33.33%, 750=8.33%, 2000=8.33% cpu : usr=0.00%, sys=3.66%, ctx=56, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=149098: Wed May 13 03:07:35 2026 read: IOPS=0, BW=411KiB/s (421kB/s)(2048KiB/4980msec) clat (msec): min=117, max=142, avg=130.16, stdev=17.89 lat (msec): min=117, max=142, avg=130.16, stdev=17.89 clat percentiles (msec): | 1.00th=[ 118], 5.00th=[ 118], 10.00th=[ 118], 20.00th=[ 118], | 30.00th=[ 118], 40.00th=[ 118], 50.00th=[ 118], 60.00th=[ 144], | 70.00th=[ 144], 80.00th=[ 144], 90.00th=[ 144], 95.00th=[ 144], | 99.00th=[ 144], 99.50th=[ 144], 99.90th=[ 144], 99.95th=[ 144], | 99.99th=[ 144] bw ( KiB/s): min= 1446, max= 2035, per=42.33%, avg=1740.50, stdev=416.49, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2056KiB/s (2106kB/s)(10.0MiB/4980msec); 0 zone resets clat (msec): min=219, max=895, avg=467.37, stdev=221.78 lat (msec): min=219, max=895, avg=467.50, stdev=221.77 clat percentiles (msec): | 1.00th=[ 220], 5.00th=[ 220], 10.00th=[ 220], 20.00th=[ 224], | 30.00th=[ 279], 40.00th=[ 334], 50.00th=[ 363], 60.00th=[ 527], | 70.00th=[ 550], 80.00th=[ 584], 90.00th=[ 693], 95.00th=[ 894], | 99.00th=[ 894], 99.50th=[ 894], 99.90th=[ 894], 99.95th=[ 894], | 99.99th=[ 894] bw ( KiB/s): min= 2007, max= 2892, per=37.17%, avg=2139.62, stdev=304.21, samples=8 iops : min= 1, max= 2, avg= 1.12, stdev= 0.35, samples=8 lat (msec) : 250=33.33%, 500=25.00%, 750=33.33%, 1000=8.33% cpu : usr=0.02%, sys=4.66%, ctx=91, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=149099: Wed May 13 03:07:35 2026 read: IOPS=1, BW=1467KiB/s (1502kB/s)(6144KiB/4189msec) clat (msec): min=111, max=287, avg=214.19, stdev=69.70 lat (msec): min=111, max=287, avg=214.19, stdev=69.70 clat percentiles (msec): | 1.00th=[ 111], 5.00th=[ 111], 10.00th=[ 111], 20.00th=[ 178], | 30.00th=[ 178], 40.00th=[ 178], 50.00th=[ 178], 60.00th=[ 266], | 70.00th=[ 268], 80.00th=[ 268], 90.00th=[ 288], 95.00th=[ 288], | 99.00th=[ 288], 99.50th=[ 288], 99.90th=[ 288], 99.95th=[ 288], | 99.99th=[ 288] bw ( KiB/s): min= 1996, max= 2039, per=49.28%, avg=2026.40, stdev=17.54, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 write: IOPS=1, BW=1467KiB/s (1502kB/s)(6144KiB/4189msec); 0 zone resets clat (msec): min=194, max=948, avg=463.03, stdev=297.12 lat (msec): min=194, max=948, avg=463.12, stdev=297.12 clat percentiles (msec): | 1.00th=[ 194], 5.00th=[ 194], 10.00th=[ 194], 20.00th=[ 215], | 30.00th=[ 215], 40.00th=[ 342], 50.00th=[ 342], 60.00th=[ 388], | 70.00th=[ 693], 80.00th=[ 693], 90.00th=[ 953], 95.00th=[ 953], | 99.00th=[ 953], 99.50th=[ 953], 99.90th=[ 953], 99.95th=[ 953], | 99.99th=[ 953] bw ( KiB/s): min= 2027, max= 3007, per=39.55%, avg=2277.00, stdev=486.69, samples=4 iops : min= 1, max= 2, avg= 1.25, stdev= 0.50, samples=4 lat (msec) : 250=41.67%, 500=41.67%, 750=8.33%, 1000=8.33% cpu : usr=0.00%, sys=3.58%, ctx=102, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=149100: Wed May 13 03:07:35 2026 read: IOPS=1, BW=1209KiB/s (1238kB/s)(5120KiB/4234msec) clat (msec): min=119, max=450, avg=222.01, stdev=131.32 lat (msec): min=119, max=450, avg=222.01, stdev=131.32 clat percentiles (msec): | 1.00th=[ 121], 5.00th=[ 121], 10.00th=[ 121], 20.00th=[ 121], | 30.00th=[ 165], 40.00th=[ 165], 50.00th=[ 171], 60.00th=[ 171], | 70.00th=[ 205], 80.00th=[ 205], 90.00th=[ 451], 95.00th=[ 451], | 99.00th=[ 451], 99.50th=[ 451], 99.90th=[ 451], 99.95th=[ 451], | 99.99th=[ 451] bw ( KiB/s): min= 1996, max= 6107, per=98.53%, avg=4051.50, stdev=2906.92, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 write: IOPS=1, BW=1693KiB/s (1734kB/s)(7168KiB/4234msec); 0 zone resets clat (msec): min=257, max=668, avg=425.90, stdev=131.88 lat (msec): min=257, max=668, avg=425.96, stdev=131.86 clat percentiles (msec): | 1.00th=[ 257], 5.00th=[ 257], 10.00th=[ 257], 20.00th=[ 351], | 30.00th=[ 355], 40.00th=[ 355], 50.00th=[ 401], 60.00th=[ 468], | 70.00th=[ 468], 80.00th=[ 485], 90.00th=[ 667], 95.00th=[ 667], | 99.00th=[ 667], 99.50th=[ 667], 99.90th=[ 667], 99.95th=[ 667], | 99.99th=[ 667] bw ( KiB/s): min= 1448, max= 4055, per=40.35%, avg=2323.20, stdev=1001.21, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 lat (msec) : 250=33.33%, 500=58.33%, 750=8.33% cpu : usr=0.00%, sys=3.38%, ctx=108, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4112KiB/s (4211kB/s), 411KiB/s-1785KiB/s (421kB/s-1828kB/s), io=20.0MiB (20.0MB), run=4016-4980msec WRITE: bw=5757KiB/s (5896kB/s), 1275KiB/s-2056KiB/s (1305kB/s-2106kB/s), io=28.0MiB (29.4MB), run=4016-4980msec rand-rw: (groupid=0, jobs=1): err= 0: pid=149102: Wed May 13 03:07:35 2026 read: IOPS=1, BW=1726KiB/s (1767kB/s)(7168KiB/4153msec) clat (msec): min=158, max=378, avg=243.85, stdev=77.55 lat (msec): min=158, max=378, avg=243.85, stdev=77.55 clat percentiles (msec): | 1.00th=[ 159], 5.00th=[ 159], 10.00th=[ 159], 20.00th=[ 199], | 30.00th=[ 207], 40.00th=[ 207], 50.00th=[ 215], 60.00th=[ 228], | 70.00th=[ 228], 80.00th=[ 321], 90.00th=[ 380], 95.00th=[ 380], | 99.00th=[ 380], 99.50th=[ 380], 99.90th=[ 380], 99.95th=[ 380], | 99.99th=[ 380] bw ( KiB/s): min= 1943, max= 4079, per=54.09%, avg=2416.80, stdev=930.03, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 write: IOPS=1, BW=1233KiB/s (1262kB/s)(5120KiB/4153msec); 0 zone resets clat (msec): min=174, max=783, avg=488.78, stdev=222.41 lat (msec): min=175, max=783, avg=488.95, stdev=222.28 clat percentiles (msec): | 1.00th=[ 176], 5.00th=[ 176], 10.00th=[ 176], 20.00th=[ 176], | 30.00th=[ 443], 40.00th=[ 443], 50.00th=[ 460], 60.00th=[ 460], | 70.00th=[ 584], 80.00th=[ 584], 90.00th=[ 785], 95.00th=[ 785], | 99.00th=[ 785], 99.50th=[ 785], 99.90th=[ 785], 99.95th=[ 785], | 99.99th=[ 785] bw ( KiB/s): min= 1896, max= 4087, per=39.77%, avg=2487.75, stdev=1066.98, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (msec) : 250=50.00%, 500=33.33%, 750=8.33%, 1000=8.33% cpu : usr=0.00%, sys=10.57%, ctx=255, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=149103: Wed May 13 03:07:35 2026 read: IOPS=0, BW=447KiB/s (458kB/s)(2048KiB/4583msec) clat (msec): min=237, max=243, avg=240.52, stdev= 3.74 lat (msec): min=237, max=243, avg=240.52, stdev= 3.74 clat percentiles (msec): | 1.00th=[ 239], 5.00th=[ 239], 10.00th=[ 239], 20.00th=[ 239], | 30.00th=[ 239], 40.00th=[ 239], 50.00th=[ 239], 60.00th=[ 243], | 70.00th=[ 243], 80.00th=[ 243], 90.00th=[ 243], 95.00th=[ 243], | 99.00th=[ 243], 99.50th=[ 243], 99.90th=[ 243], 99.95th=[ 243], | 99.99th=[ 243] bw ( KiB/s): min= 1896, max= 1957, per=43.12%, avg=1926.50, stdev=43.13, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2234KiB/s (2288kB/s)(10.0MiB/4583msec); 0 zone resets clat (msec): min=133, max=635, avg=408.56, stdev=203.81 lat (msec): min=133, max=635, avg=408.67, stdev=203.76 clat percentiles (msec): | 1.00th=[ 134], 5.00th=[ 134], 10.00th=[ 134], 20.00th=[ 136], | 30.00th=[ 188], 40.00th=[ 296], 50.00th=[ 456], 60.00th=[ 460], | 70.00th=[ 558], 80.00th=[ 592], 90.00th=[ 634], 95.00th=[ 634], | 99.00th=[ 634], 99.50th=[ 634], 99.90th=[ 634], 99.95th=[ 634], | 99.99th=[ 634] bw ( KiB/s): min= 1896, max= 6119, per=48.17%, avg=3013.50, stdev=1741.84, samples=6 iops : min= 1, max= 5, avg= 2.00, stdev= 1.67, samples=6 lat (msec) : 250=41.67%, 500=25.00%, 750=33.33% cpu : usr=0.00%, sys=10.50%, ctx=115, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=149104: Wed May 13 03:07:35 2026 read: IOPS=1, BW=1556KiB/s (1593kB/s)(6144KiB/3949msec) clat (msec): min=200, max=349, avg=255.19, stdev=63.18 lat (msec): min=200, max=349, avg=255.19, stdev=63.18 clat percentiles (msec): | 1.00th=[ 201], 5.00th=[ 201], 10.00th=[ 201], 20.00th=[ 207], | 30.00th=[ 207], 40.00th=[ 213], 50.00th=[ 213], 60.00th=[ 247], | 70.00th=[ 317], 80.00th=[ 317], 90.00th=[ 351], 95.00th=[ 351], | 99.00th=[ 351], 99.50th=[ 351], 99.90th=[ 351], 99.95th=[ 351], | 99.99th=[ 351] bw ( KiB/s): min= 1896, max= 4063, per=55.67%, avg=2487.50, stdev=1051.46, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 write: IOPS=1, BW=1556KiB/s (1593kB/s)(6144KiB/3949msec); 0 zone resets clat (msec): min=162, max=1062, avg=401.74, stdev=350.34 lat (msec): min=162, max=1062, avg=401.81, stdev=350.35 clat percentiles (msec): | 1.00th=[ 163], 5.00th=[ 163], 10.00th=[ 163], 20.00th=[ 188], | 30.00th=[ 188], 40.00th=[ 205], 50.00th=[ 205], 60.00th=[ 264], | 70.00th=[ 531], 80.00th=[ 531], 90.00th=[ 1062], 95.00th=[ 1062], | 99.00th=[ 1062], 99.50th=[ 1062], 99.90th=[ 1062], 99.95th=[ 1062], | 99.99th=[ 1062] bw ( KiB/s): min= 1896, max= 3771, per=38.63%, avg=2416.50, stdev=904.37, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (msec) : 250=58.33%, 500=25.00%, 750=8.33%, 2000=8.33% cpu : usr=0.00%, sys=11.65%, ctx=290, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=149105: Wed May 13 03:07:35 2026 read: IOPS=1, BW=1224KiB/s (1253kB/s)(5120KiB/4183msec) clat (usec): min=501, max=387677, avg=151808.45, stdev=186539.76 lat (usec): min=502, max=387678, avg=151809.50, stdev=186539.70 clat percentiles (usec): | 1.00th=[ 502], 5.00th=[ 502], 10.00th=[ 502], 20.00th=[ 502], | 30.00th=[ 1057], 40.00th=[ 1057], 50.00th=[ 51119], 60.00th=[ 51119], | 70.00th=[316670], 80.00th=[316670], 90.00th=[387974], 95.00th=[387974], | 99.00th=[387974], 99.50th=[387974], 99.90th=[387974], 99.95th=[387974], | 99.99th=[387974] bw ( KiB/s): min= 1896, max= 6035, per=88.75%, avg=3965.50, stdev=2926.71, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 write: IOPS=1, BW=1714KiB/s (1755kB/s)(7168KiB/4183msec); 0 zone resets clat (msec): min=158, max=847, avg=488.49, stdev=265.34 lat (msec): min=158, max=847, avg=488.55, stdev=265.35 clat percentiles (msec): | 1.00th=[ 159], 5.00th=[ 159], 10.00th=[ 159], 20.00th=[ 305], | 30.00th=[ 321], 40.00th=[ 321], 50.00th=[ 422], 60.00th=[ 550], | 70.00th=[ 550], 80.00th=[ 827], 90.00th=[ 852], 95.00th=[ 852], | 99.00th=[ 852], 99.50th=[ 852], 99.90th=[ 852], 99.95th=[ 852], | 99.99th=[ 852] bw ( KiB/s): min= 1896, max= 2043, per=31.61%, avg=1977.67, stdev=57.20, samples=6 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=6 lat (usec) : 750=8.33% lat (msec) : 2=8.33%, 100=8.33%, 250=8.33%, 500=41.67%, 750=8.33% lat (msec) : 1000=16.67% cpu : usr=0.05%, sys=10.59%, ctx=155, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4469KiB/s (4576kB/s), 447KiB/s-1726KiB/s (458kB/s-1767kB/s), io=20.0MiB (20.0MB), run=3949-4583msec WRITE: bw=6256KiB/s (6406kB/s), 1233KiB/s-2234KiB/s (1262kB/s-2288kB/s), io=28.0MiB (29.4MB), run=3949-4583msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=149113: Wed May 13 03:07:48 2026 read: IOPS=1, BW=5172KiB/s (5296kB/s)(12.0MiB/2376msec) clat (msec): min=556, max=797, avg=698.09, stdev=125.74 lat (msec): min=556, max=797, avg=698.09, stdev=125.74 clat percentiles (msec): | 1.00th=[ 558], 5.00th=[ 558], 10.00th=[ 558], 20.00th=[ 558], | 30.00th=[ 558], 40.00th=[ 743], 50.00th=[ 743], 60.00th=[ 743], | 70.00th=[ 802], 80.00th=[ 802], 90.00th=[ 802], 95.00th=[ 802], | 99.00th=[ 802], 99.50th=[ 802], 99.90th=[ 802], 99.95th=[ 802], | 99.99th=[ 802] bw ( KiB/s): min= 8078, max= 8159, per=100.00%, avg=8118.50, stdev=57.28, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=66.67%, 1000=33.33% cpu : usr=0.00%, sys=14.65%, ctx=430, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=149114: Wed May 13 03:07:48 2026 read: IOPS=0, BW=1326KiB/s (1358kB/s)(4096KiB/3088msec) clat (nsec): min=765427k, max=765427k, avg=765426823.00, stdev= 0.00 lat (nsec): min=765430k, max=765430k, avg=765429674.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 768], 5.00th=[ 768], 10.00th=[ 768], 20.00th=[ 768], | 30.00th=[ 768], 40.00th=[ 768], 50.00th=[ 768], 60.00th=[ 768], | 70.00th=[ 768], 80.00th=[ 768], 90.00th=[ 768], 95.00th=[ 768], | 99.00th=[ 768], 99.50th=[ 768], 99.90th=[ 768], 99.95th=[ 768], | 99.99th=[ 768] bw ( KiB/s): min= 8159, max= 8159, per=100.00%, avg=8159.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2653KiB/s (2717kB/s)(8192KiB/3088msec); 0 zone resets clat (msec): min=691, max=1383, avg=1037.34, stdev=488.94 lat (msec): min=691, max=1383, avg=1037.67, stdev=488.99 clat percentiles (msec): | 1.00th=[ 693], 5.00th=[ 693], 10.00th=[ 693], 20.00th=[ 693], | 30.00th=[ 693], 40.00th=[ 693], 50.00th=[ 693], 60.00th=[ 1385], | 70.00th=[ 1385], 80.00th=[ 1385], 90.00th=[ 1385], 95.00th=[ 1385], | 99.00th=[ 1385], 99.50th=[ 1385], 99.90th=[ 1385], 99.95th=[ 1385], | 99.99th=[ 1385] bw ( KiB/s): min= 8078, max= 8078, per=76.13%, avg=8078.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=6.84%, ctx=205, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=149115: Wed May 13 03:07:48 2026 write: IOPS=1, BW=4357KiB/s (4462kB/s)(12.0MiB/2820msec); 0 zone resets clat (msec): min=294, max=1305, avg=872.32, stdev=520.73 lat (msec): min=297, max=1307, avg=874.05, stdev=520.26 clat percentiles (msec): | 1.00th=[ 296], 5.00th=[ 296], 10.00th=[ 296], 20.00th=[ 296], | 30.00th=[ 296], 40.00th=[ 1020], 50.00th=[ 1020], 60.00th=[ 1020], | 70.00th=[ 1301], 80.00th=[ 1301], 90.00th=[ 1301], 95.00th=[ 1301], | 99.00th=[ 1301], 99.50th=[ 1301], 99.90th=[ 1301], 99.95th=[ 1301], | 99.99th=[ 1301] bw ( KiB/s): min= 7772, max= 8159, per=75.07%, avg=7965.50, stdev=273.65, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.00%, sys=5.39%, ctx=74, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=149116: Wed May 13 03:07:48 2026 write: IOPS=1, BW=6390KiB/s (6543kB/s)(12.0MiB/1923msec); 0 zone resets clat (msec): min=297, max=1033, avg=577.74, stdev=398.22 lat (msec): min=297, max=1035, avg=578.71, stdev=398.82 clat percentiles (msec): | 1.00th=[ 296], 5.00th=[ 296], 10.00th=[ 296], 20.00th=[ 296], | 30.00th=[ 296], 40.00th=[ 401], 50.00th=[ 401], 60.00th=[ 401], | 70.00th=[ 1036], 80.00th=[ 1036], 90.00th=[ 1036], 95.00th=[ 1036], | 99.00th=[ 1036], 99.50th=[ 1036], 99.90th=[ 1036], 99.95th=[ 1036], | 99.99th=[ 1036] bw ( KiB/s): min= 5512, max= 7772, per=62.60%, avg=6642.00, stdev=1598.06, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=66.67%, 2000=33.33% cpu : usr=0.00%, sys=7.02%, ctx=48, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5306KiB/s (5433kB/s), 1326KiB/s-5172KiB/s (1358kB/s-5296kB/s), io=16.0MiB (16.8MB), run=2376-3088msec WRITE: bw=10.4MiB/s (10.9MB/s), 2653KiB/s-6390KiB/s (2717kB/s-6543kB/s), io=32.0MiB (33.6MB), run=1923-3088msec rand-rw: (groupid=0, jobs=1): err= 0: pid=149117: Wed May 13 03:07:48 2026 read: IOPS=1, BW=4443KiB/s (4549kB/s)(12.0MiB/2766msec) clat (msec): min=225, max=1336, avg=908.88, stdev=597.83 lat (msec): min=225, max=1336, avg=908.88, stdev=597.83 clat percentiles (msec): | 1.00th=[ 226], 5.00th=[ 226], 10.00th=[ 226], 20.00th=[ 226], | 30.00th=[ 226], 40.00th=[ 1167], 50.00th=[ 1167], 60.00th=[ 1167], | 70.00th=[ 1334], 80.00th=[ 1334], 90.00th=[ 1334], 95.00th=[ 1334], | 99.00th=[ 1334], 99.50th=[ 1334], 99.90th=[ 1334], 99.95th=[ 1334], | 99.99th=[ 1334] bw ( KiB/s): min= 8031, max= 8175, per=100.00%, avg=8103.00, stdev=101.82, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 250=33.33%, 2000=66.67% cpu : usr=0.00%, sys=4.48%, ctx=148, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=149118: Wed May 13 03:07:48 2026 read: IOPS=0, BW=2185KiB/s (2237kB/s)(4096KiB/1875msec) clat (nsec): min=317303k, max=317303k, avg=317303245.00, stdev= 0.00 lat (nsec): min=317306k, max=317306k, avg=317306075.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 317], 5.00th=[ 317], 10.00th=[ 317], 20.00th=[ 317], | 30.00th=[ 317], 40.00th=[ 317], 50.00th=[ 317], 60.00th=[ 317], | 70.00th=[ 317], 80.00th=[ 317], 90.00th=[ 317], 95.00th=[ 317], | 99.00th=[ 317], 99.50th=[ 317], 99.90th=[ 317], 99.95th=[ 317], | 99.99th=[ 317] bw ( KiB/s): min= 5382, max= 5382, per=90.87%, avg=5382.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=1, BW=4369KiB/s (4474kB/s)(8192KiB/1875msec); 0 zone resets clat (msec): min=712, max=739, avg=726.04, stdev=19.14 lat (msec): min=714, max=741, avg=728.16, stdev=19.32 clat percentiles (msec): | 1.00th=[ 709], 5.00th=[ 709], 10.00th=[ 709], 20.00th=[ 709], | 30.00th=[ 709], 40.00th=[ 709], 50.00th=[ 709], 60.00th=[ 743], | 70.00th=[ 743], 80.00th=[ 743], 90.00th=[ 743], 95.00th=[ 743], | 99.00th=[ 743], 99.50th=[ 743], 99.90th=[ 743], 99.95th=[ 743], | 99.99th=[ 743] bw ( KiB/s): min= 7861, max= 7861, per=79.05%, avg=7861.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 750=66.67% cpu : usr=0.11%, sys=9.71%, ctx=60, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=149119: Wed May 13 03:07:48 2026 write: IOPS=0, BW=3729KiB/s (3819kB/s)(12.0MiB/3295msec); 0 zone resets clat (msec): min=256, max=1604, avg=1083.55, stdev=724.41 lat (msec): min=257, max=1605, avg=1084.22, stdev=723.86 clat percentiles (msec): | 1.00th=[ 257], 5.00th=[ 257], 10.00th=[ 257], 20.00th=[ 257], | 30.00th=[ 257], 40.00th=[ 1385], 50.00th=[ 1385], 60.00th=[ 1385], | 70.00th=[ 1603], 80.00th=[ 1603], 90.00th=[ 1603], 95.00th=[ 1603], | 99.00th=[ 1603], 99.50th=[ 1603], 99.90th=[ 1603], 99.95th=[ 1603], | 99.99th=[ 1603] bw ( KiB/s): min= 8175, max= 8175, per=82.21%, avg=8175.00, stdev= 0.00, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.00%, sys=2.94%, ctx=37, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=149120: Wed May 13 03:07:48 2026 write: IOPS=1, BW=6071KiB/s (6217kB/s)(12.0MiB/2024msec); 0 zone resets clat (msec): min=343, max=948, avg=649.74, stdev=302.53 lat (msec): min=344, max=949, avg=650.56, stdev=302.71 clat percentiles (msec): | 1.00th=[ 342], 5.00th=[ 342], 10.00th=[ 342], 20.00th=[ 342], | 30.00th=[ 342], 40.00th=[ 659], 50.00th=[ 659], 60.00th=[ 659], | 70.00th=[ 953], 80.00th=[ 953], 90.00th=[ 953], 95.00th=[ 953], | 99.00th=[ 953], 99.50th=[ 953], 99.90th=[ 953], 99.95th=[ 953], | 99.99th=[ 953] bw ( KiB/s): min=15723, max=15723, per=100.00%, avg=15723.00, stdev= 0.00, samples=1 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 750=33.33%, 1000=33.33% cpu : usr=0.00%, sys=6.52%, ctx=71, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5923KiB/s (6066kB/s), 2185KiB/s-4443KiB/s (2237kB/s-4549kB/s), io=16.0MiB (16.8MB), run=1875-2766msec WRITE: bw=9945KiB/s (10.2MB/s), 3729KiB/s-6071KiB/s (3819kB/s-6217kB/s), io=32.0MiB (33.6MB), run=1875-3295msec