== sanity test 398b: DIO and buffer IO race ============== 16:45:26 (1775767526) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 5.24773 s, 9.6 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=147192: Thu Apr 9 16:47:38 2026 read: IOPS=13, BW=53.5KiB/s (54.7kB/s)(5992KiB/112070msec) clat (usec): min=29, max=722474, avg=35974.41, stdev=33236.46 lat (usec): min=30, max=722475, avg=35975.94, stdev=33236.55 clat percentiles (usec): | 1.00th=[ 46], 5.00th=[ 56], 10.00th=[ 69], 20.00th=[ 15270], | 30.00th=[ 20317], 40.00th=[ 26084], 50.00th=[ 31065], 60.00th=[ 36439], | 70.00th=[ 43779], 80.00th=[ 55313], 90.00th=[ 68682], 95.00th=[ 82314], | 99.00th=[126354], 99.50th=[147850], 99.90th=[316670], 99.95th=[725615], | 99.99th=[725615] bw ( KiB/s): min= 7, max= 119, per=25.73%, avg=53.77, stdev=21.91, samples=218 iops : min= 1, max= 29, avg=12.82, stdev= 5.52, samples=218 write: IOPS=14, BW=56.2KiB/s (57.5kB/s)(6296KiB/112070msec); 0 zone resets clat (usec): min=828, max=306805, avg=36863.38, stdev=36719.16 lat (usec): min=829, max=306806, avg=36870.20, stdev=36715.58 clat percentiles (usec): | 1.00th=[ 1139], 5.00th=[ 1319], 10.00th=[ 1549], 20.00th=[ 4047], | 30.00th=[ 8225], 40.00th=[ 17433], 50.00th=[ 28443], 60.00th=[ 38011], | 70.00th=[ 50594], 80.00th=[ 65274], 90.00th=[ 84411], 95.00th=[105382], | 99.00th=[162530], 99.50th=[175113], 99.90th=[283116], 99.95th=[308282], | 99.99th=[308282] bw ( KiB/s): min= 7, max= 127, per=25.53%, avg=55.90, stdev=20.99, samples=220 iops : min= 1, max= 31, avg=13.35, stdev= 5.30, samples=220 lat (usec) : 50=0.91%, 100=4.69%, 250=0.52%, 1000=0.26% lat (msec) : 2=6.18%, 4=3.91%, 10=7.45%, 20=12.14%, 50=36.59% lat (msec) : 100=23.21%, 250=3.97%, 500=0.13%, 750=0.03% cpu : usr=0.07%, sys=5.82%, ctx=6434, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147193: Thu Apr 9 16:47:38 2026 read: IOPS=13, BW=52.8KiB/s (54.0kB/s)(5940KiB/112539msec) clat (usec): min=25, max=632735, avg=35689.08, stdev=30096.08 lat (usec): min=26, max=632736, avg=35690.40, stdev=30096.07 clat percentiles (usec): | 1.00th=[ 45], 5.00th=[ 57], 10.00th=[ 72], 20.00th=[ 16909], | 30.00th=[ 21627], 40.00th=[ 25560], 50.00th=[ 30016], 60.00th=[ 36439], | 70.00th=[ 43779], 80.00th=[ 54264], 90.00th=[ 69731], 95.00th=[ 82314], | 99.00th=[111674], 99.50th=[137364], 99.90th=[231736], 99.95th=[633340], | 99.99th=[633340] bw ( KiB/s): min= 7, max= 127, per=25.29%, avg=52.86, stdev=22.48, samples=219 iops : min= 1, max= 31, avg=12.59, stdev= 5.64, samples=219 write: IOPS=14, BW=56.4KiB/s (57.8kB/s)(6348KiB/112539msec); 0 zone resets clat (usec): min=847, max=367030, avg=37434.89, stdev=41002.21 lat (usec): min=848, max=367031, avg=37436.82, stdev=41001.96 clat percentiles (usec): | 1.00th=[ 1188], 5.00th=[ 1319], 10.00th=[ 1713], 20.00th=[ 4424], | 30.00th=[ 8029], 40.00th=[ 17171], 50.00th=[ 27132], 60.00th=[ 36439], | 70.00th=[ 47449], 80.00th=[ 62653], 90.00th=[ 87557], 95.00th=[110625], | 99.00th=[187696], 99.50th=[217056], 99.90th=[362808], 99.95th=[367002], | 99.99th=[367002] bw ( KiB/s): min= 7, max= 125, per=25.52%, avg=55.89, stdev=22.61, samples=221 iops : min= 1, max= 31, avg=13.36, stdev= 5.73, samples=221 lat (usec) : 50=1.01%, 100=4.39%, 250=0.36%, 500=0.07%, 750=0.03% lat (usec) : 1000=0.10% lat (msec) : 2=6.12%, 4=3.55%, 10=7.75%, 20=11.43%, 50=39.52% lat (msec) : 100=20.83%, 250=4.69%, 500=0.13%, 750=0.03% cpu : usr=0.08%, sys=5.81%, ctx=6365, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147194: Thu Apr 9 16:47:38 2026 read: IOPS=13, BW=52.7KiB/s (53.9kB/s)(6028KiB/114435msec) clat (usec): min=21, max=456936, avg=35383.93, stdev=28580.51 lat (usec): min=21, max=456937, avg=35386.85, stdev=28578.68 clat percentiles (usec): | 1.00th=[ 40], 5.00th=[ 56], 10.00th=[ 83], 20.00th=[ 15139], | 30.00th=[ 20841], 40.00th=[ 25560], 50.00th=[ 30802], 60.00th=[ 36963], | 70.00th=[ 43779], 80.00th=[ 54789], 90.00th=[ 67634], 95.00th=[ 80217], | 99.00th=[108528], 99.50th=[143655], 99.90th=[291505], 99.95th=[455082], | 99.99th=[455082] bw ( KiB/s): min= 7, max= 136, per=25.17%, avg=52.60, stdev=23.93, samples=224 iops : min= 1, max= 34, avg=12.54, stdev= 6.06, samples=224 write: IOPS=13, BW=54.7KiB/s (56.0kB/s)(6260KiB/114435msec); 0 zone resets clat (usec): min=850, max=719482, avg=38926.12, stdev=44897.96 lat (usec): min=851, max=719487, avg=38966.57, stdev=44970.10 clat percentiles (usec): | 1.00th=[ 1188], 5.00th=[ 1369], 10.00th=[ 1975], 20.00th=[ 4228], | 30.00th=[ 8291], 40.00th=[ 17695], 50.00th=[ 28967], 60.00th=[ 39584], | 70.00th=[ 50070], 80.00th=[ 65799], 90.00th=[ 91751], 95.00th=[112722], | 99.00th=[158335], 99.50th=[177210], 99.90th=[700449], 99.95th=[717226], | 99.99th=[717226] bw ( KiB/s): min= 7, max= 160, per=24.93%, avg=54.60, stdev=22.65, samples=224 iops : min= 1, max= 40, avg=13.04, stdev= 5.72, samples=224 lat (usec) : 50=1.04%, 100=4.23%, 250=0.26%, 500=0.10%, 750=0.03% lat (usec) : 1000=0.23% lat (msec) : 2=5.27%, 4=4.75%, 10=7.23%, 20=11.72%, 50=38.25% lat (msec) : 100=22.10%, 250=4.59%, 500=0.13%, 750=0.07% cpu : usr=0.07%, sys=5.77%, ctx=6489, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147195: Thu Apr 9 16:47:38 2026 read: IOPS=13, BW=53.7KiB/s (54.0kB/s)(6052KiB/112695msec) clat (usec): min=32, max=206340, avg=35295.54, stdev=26734.28 lat (usec): min=32, max=206342, avg=35297.00, stdev=26734.22 clat percentiles (usec): | 1.00th=[ 43], 5.00th=[ 55], 10.00th=[ 67], 20.00th=[ 15795], | 30.00th=[ 20841], 40.00th=[ 25297], 50.00th=[ 31065], 60.00th=[ 36439], | 70.00th=[ 43779], 80.00th=[ 53740], 90.00th=[ 69731], 95.00th=[ 83362], | 99.00th=[126354], 99.50th=[143655], 99.90th=[196084], 99.95th=[206570], | 99.99th=[206570] bw ( KiB/s): min= 8, max= 120, per=25.72%, avg=53.75, stdev=22.59, samples=219 iops : min= 2, max= 30, avg=12.82, stdev= 5.69, samples=219 write: IOPS=13, BW=55.3KiB/s (56.7kB/s)(6236KiB/112695msec); 0 zone resets clat (usec): min=861, max=803352, avg=37944.44, stdev=44414.50 lat (usec): min=862, max=803353, avg=37949.04, stdev=44415.64 clat percentiles (usec): | 1.00th=[ 1139], 5.00th=[ 1287], 10.00th=[ 1532], 20.00th=[ 3916], | 30.00th=[ 7308], 40.00th=[ 16450], 50.00th=[ 27395], 60.00th=[ 36439], | 70.00th=[ 50594], 80.00th=[ 65799], 90.00th=[ 86508], 95.00th=[107480], | 99.00th=[173016], 99.50th=[235930], 99.90th=[333448], 99.95th=[801113], | 99.99th=[801113] bw ( KiB/s): min= 7, max= 143, per=25.10%, avg=54.98, stdev=21.56, samples=221 iops : min= 1, max= 35, avg=13.13, stdev= 5.44, samples=221 lat (usec) : 50=1.33%, 100=4.33%, 250=0.33%, 500=0.10%, 750=0.03% lat (usec) : 1000=0.33% lat (msec) : 2=6.22%, 4=4.00%, 10=7.03%, 20=12.04%, 50=37.53% lat (msec) : 100=22.04%, 250=4.49%, 500=0.16%, 1000=0.03% cpu : usr=0.08%, sys=5.71%, ctx=6397, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=210KiB/s (215kB/s), 52.7KiB/s-53.7KiB/s (53.9kB/s-54.0kB/s), io=23.4MiB (24.6MB), run=112070-114435msec WRITE: bw=220KiB/s (225kB/s), 54.7KiB/s-56.4KiB/s (56.0kB/s-57.8kB/s), io=24.6MiB (25.7MB), run=112070-114435msec rand-rw: (groupid=0, jobs=1): err= 0: pid=147187: Thu Apr 9 16:50:06 2026 read: IOPS=5, BW=22.0KiB/s (23.5kB/s)(5992KiB/260930msec) clat (msec): min=4, max=791, avg=34.92, stdev=36.63 lat (msec): min=4, max=791, avg=34.92, stdev=36.63 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 15], | 30.00th=[ 18], 40.00th=[ 22], 50.00th=[ 26], 60.00th=[ 31], | 70.00th=[ 36], 80.00th=[ 47], 90.00th=[ 70], 95.00th=[ 93], | 99.00th=[ 157], 99.50th=[ 220], 99.90th=[ 288], 99.95th=[ 793], | 99.99th=[ 793] bw ( KiB/s): min= 7, max= 87, per=27.76%, avg=25.26, stdev=16.42, samples=459 iops : min= 1, max= 21, avg= 5.70, stdev= 4.14, samples=459 write: IOPS=6, BW=24.1KiB/s (24.7kB/s)(6296KiB/260930msec); 0 zone resets clat (msec): min=29, max=446, avg=132.35, stdev=57.04 lat (msec): min=29, max=446, avg=132.35, stdev=57.04 clat percentiles (msec): | 1.00th=[ 47], 5.00th=[ 59], 10.00th=[ 71], 20.00th=[ 84], | 30.00th=[ 95], 40.00th=[ 108], 50.00th=[ 123], 60.00th=[ 138], | 70.00th=[ 155], 80.00th=[ 176], 90.00th=[ 207], 95.00th=[ 241], | 99.00th=[ 305], 99.50th=[ 334], 99.90th=[ 439], 99.95th=[ 447], | 99.99th=[ 447] bw ( KiB/s): min= 7, max= 64, per=24.92%, avg=23.67, stdev=10.17, samples=513 iops : min= 1, max= 16, avg= 5.30, stdev= 2.59, samples=513 lat (msec) : 10=3.84%, 20=14.06%, 50=23.11%, 100=23.11%, 250=33.56% lat (msec) : 500=2.28%, 1000=0.03% cpu : usr=0.04%, sys=1.33%, ctx=5468, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147188: Thu Apr 9 16:50:06 2026 read: IOPS=5, BW=22.6KiB/s (23.1kB/s)(5940KiB/263011msec) clat (msec): min=4, max=731, avg=35.12, stdev=36.01 lat (msec): min=4, max=731, avg=35.12, stdev=36.01 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 15], | 30.00th=[ 18], 40.00th=[ 22], 50.00th=[ 26], 60.00th=[ 30], | 70.00th=[ 37], 80.00th=[ 48], 90.00th=[ 68], 95.00th=[ 93], | 99.00th=[ 165], 99.50th=[ 197], 99.90th=[ 401], 99.95th=[ 735], | 99.99th=[ 735] bw ( KiB/s): min= 7, max= 103, per=28.03%, avg=25.51, stdev=16.63, samples=450 iops : min= 1, max= 25, avg= 5.76, stdev= 4.20, samples=450 write: IOPS=6, BW=24.1KiB/s (24.7kB/s)(6348KiB/263011msec); 0 zone resets clat (msec): min=33, max=796, avg=132.68, stdev=58.51 lat (msec): min=33, max=796, avg=132.68, stdev=58.51 clat percentiles (msec): | 1.00th=[ 50], 5.00th=[ 62], 10.00th=[ 70], 20.00th=[ 86], | 30.00th=[ 97], 40.00th=[ 108], 50.00th=[ 122], 60.00th=[ 138], | 70.00th=[ 155], 80.00th=[ 176], 90.00th=[ 207], 95.00th=[ 239], | 99.00th=[ 309], 99.50th=[ 338], 99.90th=[ 498], 99.95th=[ 802], | 99.99th=[ 802] bw ( KiB/s): min= 7, max= 56, per=24.99%, avg=23.74, stdev= 9.77, samples=516 iops : min= 1, max= 14, avg= 5.32, stdev= 2.50, samples=516 lat (msec) : 10=2.54%, 20=15.14%, 50=22.10%, 100=23.76%, 250=34.28% lat (msec) : 500=2.12%, 750=0.03%, 1000=0.03% cpu : usr=0.04%, sys=1.41%, ctx=5377, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147189: Thu Apr 9 16:50:06 2026 read: IOPS=5, BW=22.9KiB/s (23.5kB/s)(6028KiB/262749msec) clat (msec): min=5, max=365, avg=35.68, stdev=32.30 lat (msec): min=5, max=365, avg=35.69, stdev=32.30 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 15], | 30.00th=[ 19], 40.00th=[ 22], 50.00th=[ 27], 60.00th=[ 32], | 70.00th=[ 39], 80.00th=[ 49], 90.00th=[ 72], 95.00th=[ 93], | 99.00th=[ 169], 99.50th=[ 199], 99.90th=[ 330], 99.95th=[ 368], | 99.99th=[ 368] bw ( KiB/s): min= 7, max= 112, per=26.91%, avg=24.49, stdev=16.42, samples=475 iops : min= 1, max= 28, avg= 5.50, stdev= 4.17, samples=475 write: IOPS=5, BW=23.8KiB/s (24.4kB/s)(6260KiB/262749msec); 0 zone resets clat (msec): min=35, max=798, avg=133.32, stdev=61.20 lat (msec): min=35, max=798, avg=133.33, stdev=61.19 clat percentiles (msec): | 1.00th=[ 46], 5.00th=[ 61], 10.00th=[ 70], 20.00th=[ 84], | 30.00th=[ 96], 40.00th=[ 110], 50.00th=[ 124], 60.00th=[ 138], | 70.00th=[ 155], 80.00th=[ 176], 90.00th=[ 209], 95.00th=[ 241], | 99.00th=[ 317], 99.50th=[ 351], 99.90th=[ 785], 99.95th=[ 802], | 99.99th=[ 802] bw ( KiB/s): min= 7, max= 63, per=24.69%, avg=23.46, stdev=10.07, samples=514 iops : min= 1, max= 15, avg= 5.25, stdev= 2.57, samples=514 lat (msec) : 10=3.06%, 20=14.10%, 50=23.37%, 100=23.14%, 250=34.15% lat (msec) : 500=2.12%, 1000=0.07% cpu : usr=0.05%, sys=1.39%, ctx=5359, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147190: Thu Apr 9 16:50:06 2026 read: IOPS=5, BW=23.0KiB/s (23.6kB/s)(6052KiB/262581msec) clat (msec): min=5, max=399, avg=35.37, stdev=32.86 lat (msec): min=5, max=399, avg=35.38, stdev=32.86 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 15], | 30.00th=[ 18], 40.00th=[ 21], 50.00th=[ 26], 60.00th=[ 32], | 70.00th=[ 38], 80.00th=[ 48], 90.00th=[ 71], 95.00th=[ 103], | 99.00th=[ 159], 99.50th=[ 190], 99.90th=[ 326], 99.95th=[ 401], | 99.99th=[ 401] bw ( KiB/s): min= 7, max= 103, per=28.10%, avg=25.57, stdev=16.91, samples=458 iops : min= 1, max= 25, avg= 5.78, stdev= 4.26, samples=458 write: IOPS=5, BW=23.7KiB/s (24.3kB/s)(6236KiB/262581msec); 0 zone resets clat (msec): min=28, max=901, avg=133.89, stdev=60.54 lat (msec): min=28, max=901, avg=133.90, stdev=60.54 clat percentiles (msec): | 1.00th=[ 48], 5.00th=[ 62], 10.00th=[ 72], 20.00th=[ 86], | 30.00th=[ 96], 40.00th=[ 110], 50.00th=[ 124], 60.00th=[ 138], | 70.00th=[ 155], 80.00th=[ 176], 90.00th=[ 207], 95.00th=[ 239], | 99.00th=[ 326], 99.50th=[ 359], 99.90th=[ 498], 99.95th=[ 902], | 99.99th=[ 902] bw ( KiB/s): min= 7, max= 56, per=24.58%, avg=23.35, stdev=10.03, samples=515 iops : min= 1, max= 14, avg= 5.22, stdev= 2.56, samples=515 lat (msec) : 10=3.84%, 20=14.71%, 50=22.40%, 100=22.40%, 250=34.51% lat (msec) : 500=2.12%, 1000=0.03% cpu : usr=0.04%, sys=1.34%, ctx=5458, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=91.3KiB/s (93.5kB/s), 22.6KiB/s-23.0KiB/s (23.1kB/s-23.6kB/s), io=23.4MiB (24.6MB), run=260930-263011msec WRITE: bw=95.6KiB/s (97.9kB/s), 23.7KiB/s-24.1KiB/s (24.3kB/s-24.7kB/s), io=24.6MiB (25.7MB), run=260930-263011msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=147255: Thu Apr 9 16:50:47 2026 read: IOPS=11, BW=188KiB/s (193kB/s)(5920KiB/31443msec) clat (usec): min=30, max=213089, avg=41984.73, stdev=35668.47 lat (usec): min=31, max=213090, avg=41987.15, stdev=35669.01 clat percentiles (usec): | 1.00th=[ 35], 5.00th=[ 53], 10.00th=[ 62], 20.00th=[ 157], | 30.00th=[ 24511], 40.00th=[ 30802], 50.00th=[ 38536], 60.00th=[ 45351], | 70.00th=[ 53740], 80.00th=[ 66847], 90.00th=[ 84411], 95.00th=[102237], | 99.00th=[179307], 99.50th=[212861], 99.90th=[212861], 99.95th=[212861], | 99.99th=[212861] bw ( KiB/s): min= 61, max= 480, per=25.06%, avg=190.73, stdev=85.05, samples=60 iops : min= 3, max= 30, avg=11.18, stdev= 5.40, samples=60 write: IOPS=12, BW=203KiB/s (207kB/s)(6368KiB/31443msec); 0 zone resets clat (usec): min=1007, max=386580, avg=39832.66, stdev=46293.58 lat (usec): min=1008, max=386582, avg=39854.47, stdev=46295.41 clat percentiles (usec): | 1.00th=[ 1483], 5.00th=[ 1729], 10.00th=[ 2442], 20.00th=[ 5407], | 30.00th=[ 9110], 40.00th=[ 14877], 50.00th=[ 21627], 60.00th=[ 31851], | 70.00th=[ 49546], 80.00th=[ 66323], 90.00th=[101188], 95.00th=[133694], | 99.00th=[196084], 99.50th=[244319], 99.90th=[387974], 99.95th=[387974], | 99.99th=[387974] bw ( KiB/s): min= 56, max= 400, per=25.30%, avg=202.64, stdev=85.47, samples=61 iops : min= 3, max= 25, avg=11.95, stdev= 5.45, samples=61 lat (usec) : 50=2.08%, 100=7.29%, 250=0.39%, 500=0.26%, 750=0.13% lat (msec) : 2=4.56%, 4=4.17%, 10=8.33%, 20=9.77%, 50=31.12% lat (msec) : 100=23.96%, 250=7.81%, 500=0.13% cpu : usr=0.06%, sys=5.81%, ctx=1483, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147256: Thu Apr 9 16:50:47 2026 read: IOPS=11, BW=186KiB/s (190kB/s)(5744KiB/30912msec) clat (usec): min=33, max=235997, avg=44155.40, stdev=35784.89 lat (usec): min=34, max=235999, avg=44156.66, stdev=35784.98 clat percentiles (usec): | 1.00th=[ 43], 5.00th=[ 56], 10.00th=[ 62], 20.00th=[ 14877], | 30.00th=[ 25822], 40.00th=[ 33817], 50.00th=[ 40109], 60.00th=[ 45351], | 70.00th=[ 53216], 80.00th=[ 71828], 90.00th=[ 87557], 95.00th=[108528], | 99.00th=[160433], 99.50th=[175113], 99.90th=[235930], 99.95th=[235930], | 99.99th=[235930] bw ( KiB/s): min= 29, max= 381, per=24.78%, avg=188.54, stdev=80.36, samples=59 iops : min= 1, max= 23, avg=11.03, stdev= 5.09, samples=59 write: IOPS=13, BW=212KiB/s (217kB/s)(6544KiB/30912msec); 0 zone resets clat (usec): min=1346, max=257177, avg=36694.81, stdev=43571.47 lat (usec): min=1348, max=257179, avg=36702.00, stdev=43580.23 clat percentiles (usec): | 1.00th=[ 1467], 5.00th=[ 1745], 10.00th=[ 2409], 20.00th=[ 5669], | 30.00th=[ 8225], 40.00th=[ 11863], 50.00th=[ 19792], 60.00th=[ 29492], | 70.00th=[ 42730], 80.00th=[ 62129], 90.00th=[ 94897], 95.00th=[123208], | 99.00th=[198181], 99.50th=[225444], 99.90th=[256902], 99.95th=[256902], | 99.99th=[256902] bw ( KiB/s): min= 31, max= 446, per=26.36%, avg=211.12, stdev=97.57, samples=60 iops : min= 1, max= 27, avg=12.47, stdev= 6.15, samples=60 lat (usec) : 50=1.17%, 100=6.90%, 250=0.26%, 500=0.26% lat (msec) : 2=4.43%, 4=3.78%, 10=10.55%, 20=10.55%, 50=31.51% lat (msec) : 100=22.40%, 250=8.07%, 500=0.13% cpu : usr=0.06%, sys=5.43%, ctx=1438, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147257: Thu Apr 9 16:50:47 2026 read: IOPS=12, BW=203KiB/s (208kB/s)(6256KiB/30765msec) clat (usec): min=31, max=166286, avg=41206.20, stdev=32069.50 lat (usec): min=31, max=166288, avg=41208.12, stdev=32068.75 clat percentiles (usec): | 1.00th=[ 40], 5.00th=[ 55], 10.00th=[ 66], 20.00th=[ 11863], | 30.00th=[ 25822], 40.00th=[ 32113], 50.00th=[ 37487], 60.00th=[ 43254], | 70.00th=[ 53216], 80.00th=[ 64750], 90.00th=[ 83362], 95.00th=[100140], | 99.00th=[147850], 99.50th=[166724], 99.90th=[166724], 99.95th=[166724], | 99.99th=[166724] bw ( KiB/s): min= 31, max= 479, per=26.84%, avg=204.25, stdev=84.59, samples=60 iops : min= 1, max= 29, avg=12.02, stdev= 5.32, samples=60 write: IOPS=12, BW=196KiB/s (201kB/s)(6032KiB/30765msec); 0 zone resets clat (usec): min=1212, max=214705, avg=38452.33, stdev=41293.73 lat (usec): min=1214, max=214706, avg=38460.06, stdev=41295.65 clat percentiles (usec): | 1.00th=[ 1582], 5.00th=[ 1860], 10.00th=[ 3064], 20.00th=[ 5538], | 30.00th=[ 9634], 40.00th=[ 15664], 50.00th=[ 24249], 60.00th=[ 35914], | 70.00th=[ 47973], 80.00th=[ 64226], 90.00th=[ 95945], 95.00th=[132645], | 99.00th=[181404], 99.50th=[212861], 99.90th=[214959], 99.95th=[214959], | 99.99th=[214959] bw ( KiB/s): min= 63, max= 447, per=24.22%, avg=193.98, stdev=88.58, samples=60 iops : min= 3, max= 27, avg=11.37, stdev= 5.54, samples=60 lat (usec) : 50=1.30%, 100=7.16%, 250=0.91%, 500=0.26% lat (msec) : 2=2.86%, 4=4.95%, 10=7.94%, 20=8.98%, 50=35.16% lat (msec) : 100=23.57%, 250=6.90% cpu : usr=0.07%, sys=5.39%, ctx=1478, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147258: Thu Apr 9 16:50:47 2026 read: IOPS=12, BW=198KiB/s (202kB/s)(6032KiB/30531msec) clat (usec): min=31, max=303937, avg=41221.75, stdev=33846.41 lat (usec): min=32, max=303939, avg=41226.87, stdev=33847.48 clat percentiles (usec): | 1.00th=[ 40], 5.00th=[ 57], 10.00th=[ 61], 20.00th=[ 103], | 30.00th=[ 26608], 40.00th=[ 33817], 50.00th=[ 39584], 60.00th=[ 45876], | 70.00th=[ 54264], 80.00th=[ 64750], 90.00th=[ 80217], 95.00th=[ 99091], | 99.00th=[143655], 99.50th=[158335], 99.90th=[304088], 99.95th=[304088], | 99.99th=[304088] bw ( KiB/s): min= 31, max= 351, per=25.82%, avg=196.49, stdev=79.92, samples=59 iops : min= 1, max= 21, avg=11.54, stdev= 5.06, samples=59 write: IOPS=12, BW=205KiB/s (210kB/s)(6256KiB/30531msec); 0 zone resets clat (usec): min=1457, max=389754, avg=38238.27, stdev=43805.85 lat (usec): min=1458, max=389756, avg=38240.44, stdev=43805.89 clat percentiles (usec): | 1.00th=[ 1549], 5.00th=[ 1811], 10.00th=[ 2409], 20.00th=[ 4883], | 30.00th=[ 8356], 40.00th=[ 13960], 50.00th=[ 23200], 60.00th=[ 34866], | 70.00th=[ 47449], 80.00th=[ 66323], 90.00th=[ 92799], 95.00th=[125305], | 99.00th=[177210], 99.50th=[187696], 99.90th=[387974], 99.95th=[387974], | 99.99th=[387974] bw ( KiB/s): min= 31, max= 411, per=25.41%, avg=203.56, stdev=82.40, samples=59 iops : min= 1, max= 25, avg=11.98, stdev= 5.20, samples=59 lat (usec) : 50=1.17%, 100=8.59%, 250=1.04%, 500=0.13%, 1000=0.13% lat (msec) : 2=4.04%, 4=4.56%, 10=9.11%, 20=8.20%, 50=30.73% lat (msec) : 100=25.39%, 250=6.64%, 500=0.26% cpu : usr=0.08%, sys=5.71%, ctx=1517, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=762KiB/s (780kB/s), 186KiB/s-203KiB/s (190kB/s-208kB/s), io=23.4MiB (24.5MB), run=30531-31443msec WRITE: bw=801KiB/s (821kB/s), 196KiB/s-212KiB/s (201kB/s-217kB/s), io=24.6MiB (25.8MB), run=30531-31443msec rand-rw: (groupid=0, jobs=1): err= 0: pid=147250: Thu Apr 9 16:51:33 2026 read: IOPS=4, BW=76.1KiB/s (77.9kB/s)(5920KiB/77836msec) clat (msec): min=7, max=307, avg=43.60, stdev=38.52 lat (msec): min=7, max=307, avg=43.60, stdev=38.52 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 15], 20.00th=[ 19], | 30.00th=[ 22], 40.00th=[ 26], 50.00th=[ 31], 60.00th=[ 39], | 70.00th=[ 47], 80.00th=[ 62], 90.00th=[ 85], 95.00th=[ 123], | 99.00th=[ 199], 99.50th=[ 218], 99.90th=[ 309], 99.95th=[ 309], | 99.99th=[ 309] bw ( KiB/s): min= 31, max= 352, per=28.10%, avg=86.27, stdev=55.32, samples=133 iops : min= 1, max= 22, avg= 4.59, stdev= 3.54, samples=133 write: IOPS=5, BW=81.8KiB/s (83.8kB/s)(6368KiB/77836msec); 0 zone resets clat (msec): min=34, max=537, avg=154.66, stdev=74.04 lat (msec): min=34, max=537, avg=154.67, stdev=74.04 clat percentiles (msec): | 1.00th=[ 50], 5.00th=[ 70], 10.00th=[ 83], 20.00th=[ 100], | 30.00th=[ 113], 40.00th=[ 123], 50.00th=[ 136], 60.00th=[ 153], | 70.00th=[ 174], 80.00th=[ 201], 90.00th=[ 243], 95.00th=[ 300], | 99.00th=[ 439], 99.50th=[ 456], 99.90th=[ 542], 99.95th=[ 542], | 99.99th=[ 542] bw ( KiB/s): min= 26, max= 190, per=25.61%, avg=82.71, stdev=35.96, samples=150 iops : min= 1, max= 11, avg= 4.37, stdev= 2.32, samples=150 lat (msec) : 10=1.04%, 20=11.07%, 50=23.05%, 100=20.57%, 250=39.19% lat (msec) : 500=4.95%, 750=0.13% cpu : usr=0.03%, sys=1.34%, ctx=1295, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147251: Thu Apr 9 16:51:33 2026 read: IOPS=4, BW=73.7KiB/s (75.4kB/s)(5744KiB/77989msec) clat (msec): min=6, max=327, avg=41.28, stdev=37.59 lat (msec): min=6, max=327, avg=41.28, stdev=37.59 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 18], | 30.00th=[ 21], 40.00th=[ 25], 50.00th=[ 32], 60.00th=[ 36], | 70.00th=[ 44], 80.00th=[ 56], 90.00th=[ 83], 95.00th=[ 115], | 99.00th=[ 190], 99.50th=[ 305], 99.90th=[ 326], 99.95th=[ 326], | 99.99th=[ 326] bw ( KiB/s): min= 26, max= 286, per=29.25%, avg=89.79, stdev=57.66, samples=126 iops : min= 1, max= 17, avg= 4.82, stdev= 3.65, samples=126 write: IOPS=5, BW=83.9KiB/s (85.9kB/s)(6544KiB/77989msec); 0 zone resets clat (msec): min=44, max=472, avg=154.11, stdev=69.10 lat (msec): min=44, max=472, avg=154.11, stdev=69.10 clat percentiles (msec): | 1.00th=[ 51], 5.00th=[ 74], 10.00th=[ 85], 20.00th=[ 97], | 30.00th=[ 110], 40.00th=[ 122], 50.00th=[ 138], 60.00th=[ 157], | 70.00th=[ 182], 80.00th=[ 207], 90.00th=[ 243], 95.00th=[ 279], | 99.00th=[ 372], 99.50th=[ 426], 99.90th=[ 472], 99.95th=[ 472], | 99.99th=[ 472] bw ( KiB/s): min= 29, max= 160, per=26.00%, avg=83.97, stdev=34.76, samples=153 iops : min= 1, max= 10, avg= 4.44, stdev= 2.22, samples=153 lat (msec) : 10=1.04%, 20=11.46%, 50=24.09%, 100=18.36%, 250=40.49% lat (msec) : 500=4.56% cpu : usr=0.04%, sys=1.24%, ctx=1275, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147252: Thu Apr 9 16:51:33 2026 read: IOPS=5, BW=81.6KiB/s (83.5kB/s)(6256KiB/76689msec) clat (msec): min=6, max=337, avg=44.09, stdev=43.21 lat (msec): min=6, max=337, avg=44.09, stdev=43.21 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 14], 20.00th=[ 19], | 30.00th=[ 22], 40.00th=[ 26], 50.00th=[ 32], 60.00th=[ 37], | 70.00th=[ 45], 80.00th=[ 58], 90.00th=[ 84], 95.00th=[ 122], | 99.00th=[ 234], 99.50th=[ 313], 99.90th=[ 338], 99.95th=[ 338], | 99.99th=[ 338] bw ( KiB/s): min= 30, max= 285, per=30.67%, avg=94.15, stdev=57.90, samples=131 iops : min= 1, max= 17, avg= 5.07, stdev= 3.66, samples=131 write: IOPS=4, BW=78.7KiB/s (80.5kB/s)(6032KiB/76689msec); 0 zone resets clat (msec): min=46, max=464, avg=157.48, stdev=75.44 lat (msec): min=46, max=464, avg=157.49, stdev=75.44 clat percentiles (msec): | 1.00th=[ 56], 5.00th=[ 67], 10.00th=[ 85], 20.00th=[ 97], | 30.00th=[ 110], 40.00th=[ 126], 50.00th=[ 142], 60.00th=[ 157], | 70.00th=[ 178], 80.00th=[ 209], 90.00th=[ 266], 95.00th=[ 296], | 99.00th=[ 443], 99.50th=[ 447], 99.90th=[ 464], 99.95th=[ 464], | 99.99th=[ 464] bw ( KiB/s): min= 29, max= 222, per=24.61%, avg=79.49, stdev=36.20, samples=148 iops : min= 1, max= 13, avg= 4.16, stdev= 2.36, samples=148 lat (msec) : 10=1.56%, 20=10.94%, 50=26.30%, 100=18.75%, 250=36.20% lat (msec) : 500=6.25% cpu : usr=0.03%, sys=1.24%, ctx=1311, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147253: Thu Apr 9 16:51:33 2026 read: IOPS=4, BW=77.7KiB/s (79.6kB/s)(6032KiB/77641msec) clat (msec): min=6, max=225, avg=42.72, stdev=35.67 lat (msec): min=6, max=225, avg=42.73, stdev=35.67 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 17], | 30.00th=[ 23], 40.00th=[ 28], 50.00th=[ 33], 60.00th=[ 39], | 70.00th=[ 47], 80.00th=[ 57], 90.00th=[ 87], 95.00th=[ 120], | 99.00th=[ 201], 99.50th=[ 211], 99.90th=[ 226], 99.95th=[ 226], | 99.99th=[ 226] bw ( KiB/s): min= 31, max= 317, per=29.44%, avg=90.37, stdev=56.37, samples=130 iops : min= 1, max= 19, avg= 4.85, stdev= 3.59, samples=130 write: IOPS=5, BW=80.6KiB/s (82.5kB/s)(6256KiB/77641msec); 0 zone resets clat (msec): min=46, max=700, avg=157.02, stdev=77.51 lat (msec): min=46, max=700, avg=157.02, stdev=77.51 clat percentiles (msec): | 1.00th=[ 55], 5.00th=[ 70], 10.00th=[ 79], 20.00th=[ 99], | 30.00th=[ 111], 40.00th=[ 126], 50.00th=[ 140], 60.00th=[ 157], | 70.00th=[ 178], 80.00th=[ 205], 90.00th=[ 257], 95.00th=[ 296], | 99.00th=[ 435], 99.50th=[ 468], 99.90th=[ 701], 99.95th=[ 701], | 99.99th=[ 701] bw ( KiB/s): min= 30, max= 192, per=25.10%, avg=81.09, stdev=36.57, samples=151 iops : min= 1, max= 12, avg= 4.26, stdev= 2.36, samples=151 lat (msec) : 10=1.56%, 20=10.42%, 50=24.74%, 100=19.66%, 250=37.50% lat (msec) : 500=5.99%, 750=0.13% cpu : usr=0.03%, sys=1.31%, ctx=1404, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=307KiB/s (314kB/s), 73.7KiB/s-81.6KiB/s (75.4kB/s-83.5kB/s), io=23.4MiB (24.5MB), run=76689-77989msec WRITE: bw=323KiB/s (331kB/s), 78.7KiB/s-83.9KiB/s (80.5kB/s-85.9kB/s), io=24.6MiB (25.8MB), run=76689-77989msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=147284: Thu Apr 9 16:51:48 2026 read: IOPS=1, BW=1888KiB/s (1933kB/s)(7168KiB/3797msec) clat (msec): min=127, max=392, avg=263.02, stdev=119.18 lat (msec): min=127, max=392, avg=263.02, stdev=119.18 clat percentiles (msec): | 1.00th=[ 128], 5.00th=[ 128], 10.00th=[ 128], 20.00th=[ 132], | 30.00th=[ 171], 40.00th=[ 171], 50.00th=[ 275], 60.00th=[ 368], | 70.00th=[ 368], 80.00th=[ 380], 90.00th=[ 393], 95.00th=[ 393], | 99.00th=[ 393], 99.50th=[ 393], 99.90th=[ 393], 99.95th=[ 393], | 99.99th=[ 393] bw ( KiB/s): min= 2031, max= 4296, per=69.62%, avg=3444.67, stdev=1232.77, samples=3 iops : min= 1, max= 4, avg= 2.67, stdev= 1.53, samples=3 write: IOPS=1, BW=1348KiB/s (1381kB/s)(5120KiB/3797msec); 0 zone resets clat (msec): min=235, max=618, avg=381.61, stdev=143.51 lat (msec): min=235, max=618, avg=381.71, stdev=143.49 clat percentiles (msec): | 1.00th=[ 236], 5.00th=[ 236], 10.00th=[ 236], 20.00th=[ 236], | 30.00th=[ 317], 40.00th=[ 317], 50.00th=[ 355], 60.00th=[ 355], | 70.00th=[ 384], 80.00th=[ 384], 90.00th=[ 617], 95.00th=[ 617], | 99.00th=[ 617], 99.50th=[ 617], 99.90th=[ 617], 99.95th=[ 617], | 99.99th=[ 617] bw ( KiB/s): min= 1954, max= 3984, per=38.39%, avg=2659.00, stdev=1148.27, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (msec) : 250=33.33%, 500=58.33%, 750=8.33% cpu : usr=0.00%, sys=11.59%, ctx=224, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147285: Thu Apr 9 16:51:48 2026 read: IOPS=0, BW=495KiB/s (507kB/s)(2048KiB/4139msec) clat (msec): min=8, max=159, avg=83.96, stdev=106.68 lat (msec): min=8, max=159, avg=83.96, stdev=106.68 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 9], 10.00th=[ 9], 20.00th=[ 9], | 30.00th=[ 9], 40.00th=[ 9], 50.00th=[ 9], 60.00th=[ 161], | 70.00th=[ 161], 80.00th=[ 161], 90.00th=[ 161], 95.00th=[ 161], | 99.00th=[ 161], 99.50th=[ 161], 99.90th=[ 161], 99.95th=[ 161], | 99.99th=[ 161] bw ( KiB/s): min= 1438, max= 1992, per=34.66%, avg=1715.00, stdev=391.74, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2474KiB/s (2533kB/s)(10.0MiB/4139msec); 0 zone resets clat (msec): min=163, max=756, avg=386.11, stdev=213.00 lat (msec): min=163, max=756, avg=386.38, stdev=213.20 clat percentiles (msec): | 1.00th=[ 163], 5.00th=[ 163], 10.00th=[ 163], 20.00th=[ 169], | 30.00th=[ 169], 40.00th=[ 207], 50.00th=[ 355], 60.00th=[ 376], | 70.00th=[ 502], 80.00th=[ 558], 90.00th=[ 617], 95.00th=[ 760], | 99.00th=[ 760], 99.50th=[ 760], 99.90th=[ 760], 99.95th=[ 760], | 99.99th=[ 760] bw ( KiB/s): min= 1954, max= 5657, per=42.51%, avg=2944.67, stdev=1546.62, samples=6 iops : min= 1, max= 5, avg= 2.00, stdev= 1.67, samples=6 lat (msec) : 10=8.33%, 250=41.67%, 500=25.00%, 750=16.67%, 1000=8.33% cpu : usr=0.00%, sys=11.87%, ctx=138, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147286: Thu Apr 9 16:51:48 2026 read: IOPS=2, BW=2150KiB/s (2201kB/s)(6144KiB/2858msec) clat (usec): min=782, max=302298, avg=140472.91, stdev=125235.36 lat (usec): min=783, max=302300, avg=140474.22, stdev=125235.25 clat percentiles (usec): | 1.00th=[ 783], 5.00th=[ 783], 10.00th=[ 783], 20.00th=[ 1401], | 30.00th=[ 1401], 40.00th=[137364], 50.00th=[137364], 60.00th=[145753], | 70.00th=[256902], 80.00th=[256902], 90.00th=[304088], 95.00th=[304088], | 99.00th=[304088], 99.50th=[304088], 99.90th=[304088], 99.95th=[304088], | 99.99th=[304088] bw ( KiB/s): min= 1992, max= 5862, per=66.40%, avg=3285.67, stdev=2231.18, samples=3 iops : min= 1, max= 5, avg= 2.33, stdev= 2.31, samples=3 write: IOPS=2, BW=2150KiB/s (2201kB/s)(6144KiB/2858msec); 0 zone resets clat (msec): min=162, max=539, avg=317.67, stdev=147.28 lat (msec): min=162, max=539, avg=318.22, stdev=147.19 clat percentiles (msec): | 1.00th=[ 163], 5.00th=[ 163], 10.00th=[ 163], 20.00th=[ 201], | 30.00th=[ 201], 40.00th=[ 266], 50.00th=[ 266], 60.00th=[ 292], | 70.00th=[ 451], 80.00th=[ 451], 90.00th=[ 542], 95.00th=[ 542], | 99.00th=[ 542], 99.50th=[ 542], 99.90th=[ 542], 99.95th=[ 542], | 99.99th=[ 542] bw ( KiB/s): min= 1444, max= 2039, per=27.23%, avg=1886.40, stdev=249.16, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 lat (usec) : 1000=8.33% lat (msec) : 2=8.33%, 250=33.33%, 500=41.67%, 750=8.33% cpu : usr=0.00%, sys=10.01%, ctx=174, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147287: Thu Apr 9 16:51:48 2026 read: IOPS=1, BW=1452KiB/s (1487kB/s)(5120KiB/3526msec) clat (usec): min=504, max=168713, avg=64883.54, stdev=87416.89 lat (usec): min=505, max=168715, avg=64884.75, stdev=87416.95 clat percentiles (usec): | 1.00th=[ 506], 5.00th=[ 506], 10.00th=[ 506], 20.00th=[ 506], | 30.00th=[ 1270], 40.00th=[ 1270], 50.00th=[ 1795], 60.00th=[ 1795], | 70.00th=[152044], 80.00th=[152044], 90.00th=[168821], 95.00th=[168821], | 99.00th=[168821], 99.50th=[168821], 99.90th=[168821], 99.95th=[168821], | 99.99th=[168821] bw ( KiB/s): min= 7816, max= 7816, per=100.00%, avg=7816.00, stdev= 0.00, samples=1 iops : min= 7, max= 7, avg= 7.00, stdev= 0.00, samples=1 write: IOPS=1, BW=2033KiB/s (2082kB/s)(7168KiB/3526msec); 0 zone resets clat (msec): min=231, max=643, avg=447.18, stdev=136.00 lat (msec): min=231, max=643, avg=447.38, stdev=135.99 clat percentiles (msec): | 1.00th=[ 232], 5.00th=[ 232], 10.00th=[ 232], 20.00th=[ 351], | 30.00th=[ 435], 40.00th=[ 435], 50.00th=[ 439], 60.00th=[ 460], | 70.00th=[ 460], 80.00th=[ 575], 90.00th=[ 642], 95.00th=[ 642], | 99.00th=[ 642], 99.50th=[ 642], 99.90th=[ 642], 99.95th=[ 642], | 99.99th=[ 642] bw ( KiB/s): min= 1954, max= 4079, per=34.82%, avg=2411.80, stdev=932.40, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 lat (usec) : 750=8.33% lat (msec) : 2=16.67%, 250=25.00%, 500=33.33%, 750=16.67% cpu : usr=0.06%, sys=10.33%, ctx=239, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4948KiB/s (5067kB/s), 495KiB/s-2150KiB/s (507kB/s-2201kB/s), io=20.0MiB (20.0MB), run=2858-4139msec WRITE: bw=6927KiB/s (7094kB/s), 1348KiB/s-2474KiB/s (1381kB/s-2533kB/s), io=28.0MiB (29.4MB), run=2858-4139msec rand-rw: (groupid=0, jobs=1): err= 0: pid=147289: Thu Apr 9 16:51:49 2026 read: IOPS=1, BW=1574KiB/s (1612kB/s)(7168KiB/4554msec) clat (msec): min=81, max=944, avg=385.65, stdev=344.71 lat (msec): min=81, max=944, avg=385.65, stdev=344.71 clat percentiles (msec): | 1.00th=[ 82], 5.00th=[ 82], 10.00th=[ 82], 20.00th=[ 97], | 30.00th=[ 122], 40.00th=[ 122], 50.00th=[ 239], 60.00th=[ 481], | 70.00th=[ 481], 80.00th=[ 735], 90.00th=[ 944], 95.00th=[ 944], | 99.00th=[ 944], 99.50th=[ 944], 99.90th=[ 944], 99.95th=[ 944], | 99.99th=[ 944] bw ( KiB/s): min= 1932, max= 3792, per=56.48%, avg=2436.75, stdev=904.37, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 write: IOPS=1, BW=1124KiB/s (1151kB/s)(5120KiB/4554msec); 0 zone resets clat (msec): min=202, max=518, avg=335.25, stdev=126.73 lat (msec): min=202, max=518, avg=335.34, stdev=126.74 clat percentiles (msec): | 1.00th=[ 203], 5.00th=[ 203], 10.00th=[ 203], 20.00th=[ 203], | 30.00th=[ 230], 40.00th=[ 230], 50.00th=[ 347], 60.00th=[ 347], | 70.00th=[ 380], 80.00th=[ 380], 90.00th=[ 518], 95.00th=[ 518], | 99.00th=[ 518], 99.50th=[ 518], 99.90th=[ 518], 99.95th=[ 518], | 99.99th=[ 518] bw ( KiB/s): min= 2027, max= 2043, per=33.65%, avg=2032.33, stdev= 9.24, samples=3 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=3 lat (msec) : 100=16.67%, 250=33.33%, 500=25.00%, 750=16.67%, 1000=8.33% cpu : usr=0.00%, sys=3.95%, ctx=71, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147290: Thu Apr 9 16:51:49 2026 read: IOPS=0, BW=445KiB/s (456kB/s)(2048KiB/4602msec) clat (msec): min=391, max=466, avg=429.11, stdev=53.36 lat (msec): min=391, max=466, avg=429.11, stdev=53.36 clat percentiles (msec): | 1.00th=[ 393], 5.00th=[ 393], 10.00th=[ 393], 20.00th=[ 393], | 30.00th=[ 393], 40.00th=[ 393], 50.00th=[ 393], 60.00th=[ 468], | 70.00th=[ 468], 80.00th=[ 468], 90.00th=[ 468], 95.00th=[ 468], | 99.00th=[ 468], 99.50th=[ 468], 99.90th=[ 468], 99.95th=[ 468], | 99.99th=[ 468] bw ( KiB/s): min= 1400, max= 2027, per=39.72%, avg=1713.50, stdev=443.36, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2225KiB/s (2279kB/s)(10.0MiB/4602msec); 0 zone resets clat (msec): min=143, max=870, avg=360.42, stdev=220.64 lat (msec): min=143, max=870, avg=360.54, stdev=220.66 clat percentiles (msec): | 1.00th=[ 144], 5.00th=[ 144], 10.00th=[ 144], 20.00th=[ 155], | 30.00th=[ 224], 40.00th=[ 226], 50.00th=[ 342], 60.00th=[ 347], | 70.00th=[ 355], 80.00th=[ 363], 90.00th=[ 584], 95.00th=[ 869], | 99.00th=[ 869], 99.50th=[ 869], 99.90th=[ 869], 99.95th=[ 869], | 99.99th=[ 869] bw ( KiB/s): min= 1899, max= 4087, per=44.43%, avg=2683.83, stdev=1087.83, samples=6 iops : min= 1, max= 3, avg= 1.67, stdev= 1.03, samples=6 lat (msec) : 250=33.33%, 500=50.00%, 750=8.33%, 1000=8.33% cpu : usr=0.00%, sys=3.80%, ctx=65, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147291: Thu Apr 9 16:51:49 2026 read: IOPS=1, BW=1445KiB/s (1480kB/s)(6144KiB/4252msec) clat (msec): min=104, max=670, avg=233.77, stdev=219.99 lat (msec): min=104, max=670, avg=233.77, stdev=219.99 clat percentiles (msec): | 1.00th=[ 105], 5.00th=[ 105], 10.00th=[ 105], 20.00th=[ 115], | 30.00th=[ 115], 40.00th=[ 125], 50.00th=[ 125], 60.00th=[ 142], | 70.00th=[ 247], 80.00th=[ 247], 90.00th=[ 667], 95.00th=[ 667], | 99.00th=[ 667], 99.50th=[ 667], 99.90th=[ 667], 99.95th=[ 667], | 99.99th=[ 667] bw ( KiB/s): min= 1932, max= 4087, per=58.37%, avg=2518.25, stdev=1046.79, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 write: IOPS=1, BW=1445KiB/s (1480kB/s)(6144KiB/4252msec); 0 zone resets clat (msec): min=147, max=785, avg=433.66, stdev=215.01 lat (msec): min=147, max=785, avg=434.00, stdev=214.77 clat percentiles (msec): | 1.00th=[ 148], 5.00th=[ 148], 10.00th=[ 148], 20.00th=[ 305], | 30.00th=[ 305], 40.00th=[ 393], 50.00th=[ 393], 60.00th=[ 456], | 70.00th=[ 514], 80.00th=[ 514], 90.00th=[ 785], 95.00th=[ 785], | 99.00th=[ 785], 99.50th=[ 785], 99.90th=[ 785], 99.95th=[ 785], | 99.99th=[ 785] bw ( KiB/s): min= 1896, max= 3886, per=40.32%, avg=2435.25, stdev=968.74, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (msec) : 250=50.00%, 500=25.00%, 750=16.67%, 1000=8.33% cpu : usr=0.00%, sys=2.68%, ctx=83, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147292: Thu Apr 9 16:51:49 2026 read: IOPS=1, BW=1079KiB/s (1104kB/s)(5120KiB/4747msec) clat (msec): min=56, max=531, avg=286.83, stdev=205.83 lat (msec): min=56, max=531, avg=286.83, stdev=205.83 clat percentiles (msec): | 1.00th=[ 57], 5.00th=[ 57], 10.00th=[ 57], 20.00th=[ 57], | 30.00th=[ 157], 40.00th=[ 157], 50.00th=[ 218], 60.00th=[ 218], | 70.00th=[ 472], 80.00th=[ 472], 90.00th=[ 531], 95.00th=[ 531], | 99.00th=[ 531], 99.50th=[ 531], 99.90th=[ 531], 99.95th=[ 531], | 99.99th=[ 531] bw ( KiB/s): min= 1896, max= 4087, per=61.89%, avg=2670.00, stdev=1228.90, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 write: IOPS=1, BW=1510KiB/s (1546kB/s)(7168KiB/4747msec); 0 zone resets clat (msec): min=168, max=697, avg=404.89, stdev=210.37 lat (msec): min=168, max=698, avg=405.24, stdev=210.35 clat percentiles (msec): | 1.00th=[ 169], 5.00th=[ 169], 10.00th=[ 169], 20.00th=[ 241], | 30.00th=[ 255], 40.00th=[ 255], 50.00th=[ 347], 60.00th=[ 460], | 70.00th=[ 460], 80.00th=[ 667], 90.00th=[ 701], 95.00th=[ 701], | 99.00th=[ 701], 99.50th=[ 701], 99.90th=[ 701], 99.95th=[ 701], | 99.99th=[ 701] bw ( KiB/s): min= 1896, max= 4079, per=39.33%, avg=2375.40, stdev=953.55, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 lat (msec) : 100=8.33%, 250=33.33%, 500=33.33%, 750=25.00% cpu : usr=0.04%, sys=3.83%, ctx=65, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4314KiB/s (4418kB/s), 445KiB/s-1574KiB/s (456kB/s-1612kB/s), io=20.0MiB (20.0MB), run=4252-4747msec WRITE: bw=6040KiB/s (6185kB/s), 1124KiB/s-2225KiB/s (1151kB/s-2279kB/s), io=28.0MiB (29.4MB), run=4252-4747msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=147300: Thu Apr 9 16:52:04 2026 read: IOPS=0, BW=3994KiB/s (4089kB/s)(12.0MiB/3077msec) clat (msec): min=846, max=1153, avg=1010.37, stdev=154.89 lat (msec): min=846, max=1153, avg=1010.37, stdev=154.89 clat percentiles (msec): | 1.00th=[ 844], 5.00th=[ 844], 10.00th=[ 844], 20.00th=[ 844], | 30.00th=[ 844], 40.00th=[ 1028], 50.00th=[ 1028], 60.00th=[ 1028], | 70.00th=[ 1150], 80.00th=[ 1150], 90.00th=[ 1150], 95.00th=[ 1150], | 99.00th=[ 1150], 99.50th=[ 1150], 99.90th=[ 1150], 99.95th=[ 1150], | 99.99th=[ 1150] bw ( KiB/s): min= 7816, max= 8192, per=100.00%, avg=8004.00, stdev=265.87, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 1000=33.33%, 2000=66.67% cpu : usr=0.00%, sys=9.46%, ctx=283, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147301: Thu Apr 9 16:52:04 2026 read: IOPS=0, BW=929KiB/s (951kB/s)(4096KiB/4410msec) clat (nsec): min=1139.8M, max=1139.8M, avg=1139825837.00, stdev= 0.00 lat (nsec): min=1139.8M, max=1139.8M, avg=1139828650.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1133], 5.00th=[ 1133], 10.00th=[ 1133], 20.00th=[ 1133], | 30.00th=[ 1133], 40.00th=[ 1133], 50.00th=[ 1133], 60.00th=[ 1133], | 70.00th=[ 1133], 80.00th=[ 1133], 90.00th=[ 1133], 95.00th=[ 1133], | 99.00th=[ 1133], 99.50th=[ 1133], 99.90th=[ 1133], 99.95th=[ 1133], | 99.99th=[ 1133] bw ( KiB/s): min= 7816, max= 7816, per=100.00%, avg=7816.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=1858KiB/s (1902kB/s)(8192KiB/4410msec); 0 zone resets clat (msec): min=898, max=2279, avg=1589.18, stdev=976.20 lat (msec): min=899, max=2279, avg=1589.83, stdev=975.82 clat percentiles (msec): | 1.00th=[ 902], 5.00th=[ 902], 10.00th=[ 902], 20.00th=[ 902], | 30.00th=[ 902], 40.00th=[ 902], 50.00th=[ 902], 60.00th=[ 2265], | 70.00th=[ 2265], 80.00th=[ 2265], 90.00th=[ 2265], 95.00th=[ 2265], | 99.00th=[ 2265], 99.50th=[ 2265], 99.90th=[ 2265], 99.95th=[ 2265], | 99.99th=[ 2265] bw ( KiB/s): min= 8094, max= 8094, per=100.00%, avg=8094.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 1000=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.02%, sys=3.74%, ctx=180, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147302: Thu Apr 9 16:52:04 2026 write: IOPS=0, BW=3037KiB/s (3110kB/s)(12.0MiB/4046msec); 0 zone resets clat (msec): min=411, max=1872, avg=1298.19, stdev=779.13 lat (msec): min=411, max=1878, avg=1300.76, stdev=781.37 clat percentiles (msec): | 1.00th=[ 414], 5.00th=[ 414], 10.00th=[ 414], 20.00th=[ 414], | 30.00th=[ 414], 40.00th=[ 1620], 50.00th=[ 1620], 60.00th=[ 1620], | 70.00th=[ 1871], 80.00th=[ 1871], 90.00th=[ 1871], 95.00th=[ 1871], | 99.00th=[ 1871], 99.50th=[ 1871], 99.90th=[ 1871], 99.95th=[ 1871], | 99.99th=[ 1871] bw ( KiB/s): min= 7529, max= 8094, per=100.00%, avg=7811.50, stdev=399.52, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.02%, sys=2.82%, ctx=53, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147303: Thu Apr 9 16:52:04 2026 write: IOPS=0, BW=2504KiB/s (2564kB/s)(12.0MiB/4907msec); 0 zone resets clat (msec): min=404, max=3512, avg=1590.80, stdev=1679.57 lat (msec): min=406, max=3513, avg=1591.72, stdev=1679.04 clat percentiles (msec): | 1.00th=[ 405], 5.00th=[ 405], 10.00th=[ 405], 20.00th=[ 405], | 30.00th=[ 405], 40.00th=[ 852], 50.00th=[ 852], 60.00th=[ 852], | 70.00th=[ 3507], 80.00th=[ 3507], 90.00th=[ 3507], 95.00th=[ 3507], | 99.00th=[ 3507], 99.50th=[ 3507], 99.90th=[ 3507], 99.95th=[ 3507], | 99.99th=[ 3507] bw ( KiB/s): min= 7953, max= 8110, per=100.00%, avg=8031.50, stdev=111.02, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 1000=33.33%, >=2000=33.33% cpu : usr=0.04%, sys=3.26%, ctx=65, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3715KiB/s (3804kB/s), 929KiB/s-3994KiB/s (951kB/s-4089kB/s), io=16.0MiB (16.8MB), run=3077-4410msec WRITE: bw=6678KiB/s (6838kB/s), 1858KiB/s-3037KiB/s (1902kB/s-3110kB/s), io=32.0MiB (33.6MB), run=4046-4907msec rand-rw: (groupid=0, jobs=1): err= 0: pid=147304: Thu Apr 9 16:52:04 2026 read: IOPS=0, BW=2935KiB/s (3005kB/s)(12.0MiB/4187msec) clat (msec): min=362, max=1938, avg=1380.10, stdev=882.96 lat (msec): min=362, max=1938, avg=1380.11, stdev=882.96 clat percentiles (msec): | 1.00th=[ 363], 5.00th=[ 363], 10.00th=[ 363], 20.00th=[ 363], | 30.00th=[ 363], 40.00th=[ 1838], 50.00th=[ 1838], 60.00th=[ 1838], | 70.00th=[ 1938], 80.00th=[ 1938], 90.00th=[ 1938], 95.00th=[ 1938], | 99.00th=[ 1938], 99.50th=[ 1938], 99.90th=[ 1938], 99.95th=[ 1938], | 99.99th=[ 1938] bw ( KiB/s): min= 7831, max= 8192, per=100.00%, avg=8011.50, stdev=255.27, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.05%, sys=2.22%, ctx=65, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147305: Thu Apr 9 16:52:04 2026 read: IOPS=0, BW=855KiB/s (876kB/s)(4096KiB/4788msec) clat (nsec): min=2273.1M, max=2273.1M, avg=2273083912.00, stdev= 0.00 lat (nsec): min=2274.5M, max=2274.5M, avg=2274466308.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 2265], 5.00th=[ 2265], 10.00th=[ 2265], 20.00th=[ 2265], | 30.00th=[ 2265], 40.00th=[ 2265], 50.00th=[ 2265], 60.00th=[ 2265], | 70.00th=[ 2265], 80.00th=[ 2265], 90.00th=[ 2265], 95.00th=[ 2265], | 99.00th=[ 2265], 99.50th=[ 2265], 99.90th=[ 2265], 99.95th=[ 2265], | 99.99th=[ 2265] bw ( KiB/s): min= 7713, max= 7713, per=100.00%, avg=7713.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=1711KiB/s (1752kB/s)(8192KiB/4788msec); 0 zone resets clat (msec): min=1011, max=1433, avg=1222.34, stdev=298.09 lat (msec): min=1014, max=1433, avg=1223.84, stdev=296.43 clat percentiles (msec): | 1.00th=[ 1011], 5.00th=[ 1011], 10.00th=[ 1011], 20.00th=[ 1011], | 30.00th=[ 1011], 40.00th=[ 1011], 50.00th=[ 1011], 60.00th=[ 1435], | 70.00th=[ 1435], 80.00th=[ 1435], 90.00th=[ 1435], 95.00th=[ 1435], | 99.00th=[ 1435], 99.50th=[ 1435], 99.90th=[ 1435], 99.95th=[ 1435], | 99.99th=[ 1435] bw ( KiB/s): min= 8126, max= 8126, per=100.00%, avg=8126.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 2000=66.67%, >=2000=33.33% cpu : usr=0.02%, sys=3.05%, ctx=70, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147306: Thu Apr 9 16:52:04 2026 write: IOPS=1, BW=4488KiB/s (4596kB/s)(12.0MiB/2738msec); 0 zone resets clat (msec): min=715, max=944, avg=868.00, stdev=132.25 lat (msec): min=716, max=945, avg=868.69, stdev=132.22 clat percentiles (msec): | 1.00th=[ 718], 5.00th=[ 718], 10.00th=[ 718], 20.00th=[ 718], | 30.00th=[ 718], 40.00th=[ 944], 50.00th=[ 944], 60.00th=[ 944], | 70.00th=[ 944], 80.00th=[ 944], 90.00th=[ 944], 95.00th=[ 944], | 99.00th=[ 944], 99.50th=[ 944], 99.90th=[ 944], 99.95th=[ 944], | 99.99th=[ 944] bw ( KiB/s): min= 7831, max= 8159, per=100.00%, avg=7995.00, stdev=231.93, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 1000=66.67% cpu : usr=0.04%, sys=4.75%, ctx=59, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147307: Thu Apr 9 16:52:04 2026 write: IOPS=0, BW=3625KiB/s (3712kB/s)(12.0MiB/3390msec); 0 zone resets clat (msec): min=557, max=1484, avg=1102.54, stdev=484.82 lat (msec): min=557, max=1485, avg=1102.94, stdev=484.78 clat percentiles (msec): | 1.00th=[ 558], 5.00th=[ 558], 10.00th=[ 558], 20.00th=[ 558], | 30.00th=[ 558], 40.00th=[ 1267], 50.00th=[ 1267], 60.00th=[ 1267], | 70.00th=[ 1485], 80.00th=[ 1485], 90.00th=[ 1485], 95.00th=[ 1485], | 99.00th=[ 1485], 99.50th=[ 1485], 99.90th=[ 1485], 99.95th=[ 1485], | 99.99th=[ 1485] bw ( KiB/s): min= 7831, max= 8143, per=100.00%, avg=7987.00, stdev=220.62, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 2000=66.67% cpu : usr=0.00%, sys=2.51%, ctx=47, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3422KiB/s (3504kB/s), 855KiB/s-2935KiB/s (876kB/s-3005kB/s), io=16.0MiB (16.8MB), run=4187-4788msec WRITE: bw=6844KiB/s (7008kB/s), 1711KiB/s-4488KiB/s (1752kB/s-4596kB/s), io=32.0MiB (33.6MB), run=2738-4788msec