== sanity test 398b: DIO and buffer IO race ============== 02:54:17 (1776927257) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 7.31348 s, 6.9 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=146274: Thu Apr 23 02:57:12 2026 read: IOPS=10, BW=40.3KiB/s (41.2kB/s)(5992KiB/148792msec) clat (usec): min=64, max=1591.7k, avg=48793.95, stdev=52670.64 lat (usec): min=65, max=1591.7k, avg=48804.50, stdev=52669.48 clat percentiles (usec): | 1.00th=[ 92], 5.00th=[ 174], 10.00th=[ 3064], | 20.00th=[ 24773], 30.00th=[ 30278], 40.00th=[ 34866], | 50.00th=[ 40633], 60.00th=[ 47449], 70.00th=[ 57410], | 80.00th=[ 70779], 90.00th=[ 88605], 95.00th=[ 108528], | 99.00th=[ 168821], 99.50th=[ 212861], 99.90th=[ 404751], | 99.95th=[1585447], 99.99th=[1585447] bw ( KiB/s): min= 6, max= 96, per=25.72%, avg=40.63, stdev=17.63, samples=287 iops : min= 1, max= 24, avg= 9.46, stdev= 4.43, samples=287 write: IOPS=10, BW=42.3KiB/s (43.3kB/s)(6296KiB/148792msec); 0 zone resets clat (msec): min=2, max=414, avg=47.66, stdev=45.38 lat (msec): min=2, max=414, avg=47.67, stdev=45.38 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 5], 10.00th=[ 6], 20.00th=[ 9], | 30.00th=[ 14], 40.00th=[ 26], 50.00th=[ 37], 60.00th=[ 48], | 70.00th=[ 61], 80.00th=[ 80], 90.00th=[ 109], 95.00th=[ 131], | 99.00th=[ 205], 99.50th=[ 228], 99.90th=[ 351], 99.95th=[ 414], | 99.99th=[ 414] bw ( KiB/s): min= 7, max= 103, per=25.52%, avg=42.36, stdev=18.90, samples=289 iops : min= 1, max= 25, avg= 9.91, stdev= 4.75, samples=289 lat (usec) : 100=0.72%, 250=2.99%, 500=0.59%, 750=0.29%, 1000=0.13% lat (msec) : 2=0.07%, 4=1.50%, 10=10.64%, 20=7.71%, 50=37.96% lat (msec) : 100=27.96%, 250=9.18%, 500=0.23%, 2000=0.03% cpu : usr=0.09%, sys=15.72%, ctx=8920, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146275: Thu Apr 23 02:57:12 2026 read: IOPS=9, BW=39.2KiB/s (40.2kB/s)(5940KiB/151395msec) clat (usec): min=50, max=484860, avg=48584.36, stdev=35140.34 lat (usec): min=51, max=484861, avg=48590.38, stdev=35139.45 clat percentiles (usec): | 1.00th=[ 87], 5.00th=[ 172], 10.00th=[ 16450], 20.00th=[ 25297], | 30.00th=[ 30540], 40.00th=[ 35390], 50.00th=[ 40109], 60.00th=[ 48497], | 70.00th=[ 57934], 80.00th=[ 70779], 90.00th=[ 90702], 95.00th=[108528], | 99.00th=[156238], 99.50th=[173016], 99.90th=[295699], 99.95th=[484443], | 99.99th=[484443] bw ( KiB/s): min= 6, max= 111, per=24.95%, avg=39.41, stdev=17.30, samples=294 iops : min= 1, max= 27, avg= 9.17, stdev= 4.33, samples=294 write: IOPS=10, BW=41.9KiB/s (42.9kB/s)(6348KiB/151395msec); 0 zone resets clat (usec): min=1876, max=1563.9k, avg=49510.02, stdev=61328.28 lat (usec): min=1878, max=1563.9k, avg=49518.26, stdev=61331.34 clat percentiles (msec): | 1.00th=[ 3], 5.00th=[ 5], 10.00th=[ 7], 20.00th=[ 10], | 30.00th=[ 14], 40.00th=[ 25], 50.00th=[ 37], 60.00th=[ 49], | 70.00th=[ 63], 80.00th=[ 81], 90.00th=[ 108], 95.00th=[ 138], | 99.00th=[ 207], 99.50th=[ 264], 99.90th=[ 625], 99.95th=[ 1569], | 99.99th=[ 1569] bw ( KiB/s): min= 7, max= 120, per=25.13%, avg=41.71, stdev=18.71, samples=297 iops : min= 1, max= 30, avg= 9.75, stdev= 4.69, samples=297 lat (usec) : 100=0.88%, 250=2.70%, 500=0.49%, 750=0.33%, 1000=0.03% lat (msec) : 2=0.16%, 4=1.79%, 10=9.34%, 20=9.18%, 50=35.81% lat (msec) : 100=29.75%, 250=9.15%, 500=0.33%, 750=0.03%, 2000=0.03% cpu : usr=0.09%, sys=15.60%, ctx=8999, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146276: Thu Apr 23 02:57:12 2026 read: IOPS=10, BW=40.5KiB/s (41.4kB/s)(6028KiB/148942msec) clat (usec): min=63, max=320315, avg=47087.29, stdev=35721.55 lat (usec): min=65, max=320317, avg=47096.72, stdev=35719.06 clat percentiles (usec): | 1.00th=[ 90], 5.00th=[ 169], 10.00th=[ 13960], 20.00th=[ 23987], | 30.00th=[ 28705], 40.00th=[ 33162], 50.00th=[ 38536], 60.00th=[ 45351], | 70.00th=[ 54264], 80.00th=[ 69731], 90.00th=[ 90702], 95.00th=[114820], | 99.00th=[170918], 99.50th=[219153], 99.90th=[304088], 99.95th=[320865], | 99.99th=[320865] bw ( KiB/s): min= 7, max= 87, per=25.84%, avg=40.83, stdev=16.96, samples=288 iops : min= 1, max= 21, avg= 9.52, stdev= 4.24, samples=288 write: IOPS=10, BW=42.0KiB/s (43.0kB/s)(6260KiB/148942msec); 0 zone resets clat (usec): min=1901, max=1537.0k, avg=49409.14, stdev=57567.33 lat (usec): min=1903, max=1537.0k, avg=49413.42, stdev=57568.22 clat percentiles (msec): | 1.00th=[ 3], 5.00th=[ 5], 10.00th=[ 6], 20.00th=[ 10], | 30.00th=[ 16], 40.00th=[ 28], 50.00th=[ 40], 60.00th=[ 51], | 70.00th=[ 63], 80.00th=[ 80], 90.00th=[ 109], 95.00th=[ 134], | 99.00th=[ 201], 99.50th=[ 232], 99.90th=[ 288], 99.95th=[ 1536], | 99.99th=[ 1536] bw ( KiB/s): min= 6, max= 111, per=25.18%, avg=41.79, stdev=17.92, samples=292 iops : min= 1, max= 27, avg= 9.76, stdev= 4.47, samples=292 lat (usec) : 100=0.75%, 250=3.03%, 500=0.46%, 750=0.16%, 1000=0.13% lat (msec) : 2=0.29%, 4=2.08%, 10=9.02%, 20=8.63%, 50=38.18% lat (msec) : 100=27.70%, 250=9.41%, 500=0.13%, 2000=0.03% cpu : usr=0.09%, sys=15.83%, ctx=8930, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146277: Thu Apr 23 02:57:12 2026 read: IOPS=10, BW=40.5KiB/s (41.5kB/s)(6052KiB/149320msec) clat (usec): min=55, max=364051, avg=46665.76, stdev=33758.33 lat (usec): min=56, max=364053, avg=46670.40, stdev=33758.59 clat percentiles (usec): | 1.00th=[ 84], 5.00th=[ 172], 10.00th=[ 2900], 20.00th=[ 23987], | 30.00th=[ 28967], 40.00th=[ 34341], 50.00th=[ 39584], 60.00th=[ 47973], | 70.00th=[ 55837], 80.00th=[ 67634], 90.00th=[ 87557], 95.00th=[107480], | 99.00th=[160433], 99.50th=[204473], 99.90th=[278922], 99.95th=[362808], | 99.99th=[362808] bw ( KiB/s): min= 7, max= 95, per=25.80%, avg=40.76, stdev=16.81, samples=289 iops : min= 1, max= 23, avg= 9.51, stdev= 4.19, samples=289 write: IOPS=10, BW=41.8KiB/s (42.8kB/s)(6236KiB/149320msec); 0 zone resets clat (msec): min=2, max=1657, avg=50.06, stdev=61.09 lat (msec): min=2, max=1657, avg=50.06, stdev=61.09 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 6], 10.00th=[ 7], 20.00th=[ 10], | 30.00th=[ 16], 40.00th=[ 27], 50.00th=[ 40], 60.00th=[ 50], | 70.00th=[ 63], 80.00th=[ 79], 90.00th=[ 106], 95.00th=[ 140], | 99.00th=[ 205], 99.50th=[ 268], 99.90th=[ 305], 99.95th=[ 1653], | 99.99th=[ 1653] bw ( KiB/s): min= 7, max= 95, per=25.12%, avg=41.69, stdev=17.72, samples=291 iops : min= 1, max= 23, avg= 9.74, stdev= 4.44, samples=291 lat (usec) : 100=1.11%, 250=2.70%, 500=0.85%, 750=0.16%, 1000=0.07% lat (msec) : 4=1.53%, 10=9.54%, 20=8.43%, 50=37.37%, 100=29.13% lat (msec) : 250=8.79%, 500=0.29%, 2000=0.03% cpu : usr=0.09%, sys=15.92%, ctx=8907, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=159KiB/s (162kB/s), 39.2KiB/s-40.5KiB/s (40.2kB/s-41.5kB/s), io=23.4MiB (24.6MB), run=148792-151395msec WRITE: bw=166KiB/s (170kB/s), 41.8KiB/s-42.3KiB/s (42.8kB/s-43.3kB/s), io=24.6MiB (25.7MB), run=148792-151395msec rand-rw: (groupid=0, jobs=1): err= 0: pid=146278: Thu Apr 23 02:59:33 2026 read: IOPS=5, BW=20.5KiB/s (21.0kB/s)(5992KiB/291911msec) clat (msec): min=7, max=1603, avg=44.78, stdev=58.00 lat (msec): min=7, max=1603, avg=44.79, stdev=58.00 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 13], 10.00th=[ 15], 20.00th=[ 18], | 30.00th=[ 21], 40.00th=[ 25], 50.00th=[ 30], 60.00th=[ 36], | 70.00th=[ 44], 80.00th=[ 62], 90.00th=[ 95], 95.00th=[ 130], | 99.00th=[ 218], 99.50th=[ 253], 99.90th=[ 422], 99.95th=[ 1603], | 99.99th=[ 1603] bw ( KiB/s): min= 7, max= 111, per=27.98%, avg=22.94, stdev=15.55, samples=502 iops : min= 1, max= 27, avg= 5.08, stdev= 3.89, samples=502 write: IOPS=5, BW=21.6KiB/s (22.1kB/s)(6296KiB/291911msec); 0 zone resets clat (msec): min=44, max=696, avg=142.47, stdev=66.98 lat (msec): min=44, max=696, avg=142.47, stdev=66.98 clat percentiles (msec): | 1.00th=[ 54], 5.00th=[ 70], 10.00th=[ 77], 20.00th=[ 88], | 30.00th=[ 101], 40.00th=[ 113], 50.00th=[ 127], 60.00th=[ 142], | 70.00th=[ 161], 80.00th=[ 188], 90.00th=[ 230], 95.00th=[ 275], | 99.00th=[ 355], 99.50th=[ 401], 99.90th=[ 575], 99.95th=[ 701], | 99.99th=[ 701] bw ( KiB/s): min= 7, max= 48, per=25.10%, avg=21.33, stdev= 9.88, samples=565 iops : min= 1, max= 12, avg= 4.67, stdev= 2.53, samples=565 lat (msec) : 10=0.65%, 20=13.09%, 50=22.88%, 100=22.85%, 250=36.36% lat (msec) : 500=4.07%, 750=0.07%, 2000=0.03% cpu : usr=0.05%, sys=3.84%, ctx=6657, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146279: Thu Apr 23 02:59:33 2026 read: IOPS=5, BW=20.3KiB/s (20.8kB/s)(5940KiB/292619msec) clat (msec): min=7, max=1546, avg=44.31, stdev=56.96 lat (msec): min=7, max=1546, avg=44.32, stdev=56.96 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 13], 10.00th=[ 15], 20.00th=[ 18], | 30.00th=[ 21], 40.00th=[ 25], 50.00th=[ 29], 60.00th=[ 35], | 70.00th=[ 44], 80.00th=[ 61], 90.00th=[ 92], 95.00th=[ 123], | 99.00th=[ 211], 99.50th=[ 264], 99.90th=[ 430], 99.95th=[ 1552], | 99.99th=[ 1552] bw ( KiB/s): min= 7, max= 103, per=28.24%, avg=23.16, stdev=15.85, samples=494 iops : min= 1, max= 25, avg= 5.13, stdev= 3.98, samples=494 write: IOPS=5, BW=21.7KiB/s (22.2kB/s)(6348KiB/292619msec); 0 zone resets clat (msec): min=42, max=712, avg=142.53, stdev=67.34 lat (msec): min=42, max=712, avg=142.54, stdev=67.34 clat percentiles (msec): | 1.00th=[ 54], 5.00th=[ 67], 10.00th=[ 77], 20.00th=[ 90], | 30.00th=[ 101], 40.00th=[ 113], 50.00th=[ 127], 60.00th=[ 142], | 70.00th=[ 163], 80.00th=[ 188], 90.00th=[ 232], 95.00th=[ 271], | 99.00th=[ 355], 99.50th=[ 393], 99.90th=[ 659], 99.95th=[ 709], | 99.99th=[ 709] bw ( KiB/s): min= 7, max= 56, per=25.27%, avg=21.48, stdev=10.20, samples=567 iops : min= 1, max= 14, avg= 4.71, stdev= 2.60, samples=567 lat (msec) : 10=0.59%, 20=13.22%, 50=22.72%, 100=22.92%, 250=36.20% lat (msec) : 500=4.23%, 750=0.10%, 2000=0.03% cpu : usr=0.05%, sys=3.84%, ctx=6685, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146280: Thu Apr 23 02:59:33 2026 read: IOPS=5, BW=20.7KiB/s (21.2kB/s)(6028KiB/290689msec) clat (msec): min=8, max=458, avg=44.12, stdev=42.85 lat (msec): min=8, max=458, avg=44.13, stdev=42.85 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 14], 10.00th=[ 16], 20.00th=[ 19], | 30.00th=[ 23], 40.00th=[ 26], 50.00th=[ 31], 60.00th=[ 36], | 70.00th=[ 45], 80.00th=[ 58], 90.00th=[ 90], 95.00th=[ 120], | 99.00th=[ 239], 99.50th=[ 279], 99.90th=[ 426], 99.95th=[ 460], | 99.99th=[ 460] bw ( KiB/s): min= 7, max= 95, per=28.29%, avg=23.19, stdev=15.49, samples=500 iops : min= 1, max= 23, avg= 5.14, stdev= 3.89, samples=500 write: IOPS=5, BW=21.5KiB/s (22.1kB/s)(6260KiB/290689msec); 0 zone resets clat (msec): min=44, max=1678, avg=142.88, stdev=78.02 lat (msec): min=44, max=1678, avg=142.89, stdev=78.03 clat percentiles (msec): | 1.00th=[ 57], 5.00th=[ 68], 10.00th=[ 75], 20.00th=[ 88], | 30.00th=[ 101], 40.00th=[ 111], 50.00th=[ 126], 60.00th=[ 142], | 70.00th=[ 161], 80.00th=[ 184], 90.00th=[ 239], 95.00th=[ 275], | 99.00th=[ 388], 99.50th=[ 439], 99.90th=[ 642], 99.95th=[ 1687], | 99.99th=[ 1687] bw ( KiB/s): min= 7, max= 47, per=25.31%, avg=21.52, stdev= 9.92, samples=558 iops : min= 1, max= 11, avg= 4.72, stdev= 2.51, samples=558 lat (msec) : 10=0.23%, 20=11.72%, 50=25.20%, 100=23.54%, 250=34.96% lat (msec) : 500=4.23%, 750=0.10%, 2000=0.03% cpu : usr=0.05%, sys=3.87%, ctx=6818, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146281: Thu Apr 23 02:59:33 2026 read: IOPS=5, BW=20.8KiB/s (21.3kB/s)(6052KiB/290669msec) clat (msec): min=7, max=472, avg=43.17, stdev=42.37 lat (msec): min=7, max=472, avg=43.18, stdev=42.37 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 13], 10.00th=[ 15], 20.00th=[ 18], | 30.00th=[ 21], 40.00th=[ 24], 50.00th=[ 29], 60.00th=[ 35], | 70.00th=[ 44], 80.00th=[ 61], 90.00th=[ 91], 95.00th=[ 122], | 99.00th=[ 215], 99.50th=[ 288], 99.90th=[ 355], 99.95th=[ 472], | 99.99th=[ 472] bw ( KiB/s): min= 7, max= 111, per=29.27%, avg=24.00, stdev=16.20, samples=486 iops : min= 1, max= 27, avg= 5.35, stdev= 4.07, samples=486 write: IOPS=5, BW=21.5KiB/s (21.0kB/s)(6236KiB/290669msec); 0 zone resets clat (msec): min=45, max=1635, avg=144.17, stdev=78.22 lat (msec): min=45, max=1635, avg=144.18, stdev=78.22 clat percentiles (msec): | 1.00th=[ 53], 5.00th=[ 66], 10.00th=[ 74], 20.00th=[ 88], | 30.00th=[ 102], 40.00th=[ 113], 50.00th=[ 128], 60.00th=[ 142], | 70.00th=[ 161], 80.00th=[ 192], 90.00th=[ 241], 95.00th=[ 279], | 99.00th=[ 368], 99.50th=[ 422], 99.90th=[ 592], 99.95th=[ 1636], | 99.99th=[ 1636] bw ( KiB/s): min= 7, max= 55, per=25.00%, avg=21.25, stdev= 9.82, samples=562 iops : min= 1, max= 13, avg= 4.65, stdev= 2.48, samples=562 lat (msec) : 10=0.49%, 20=13.09%, 50=23.89%, 100=22.82%, 250=35.25% lat (msec) : 500=4.36%, 750=0.07%, 2000=0.03% cpu : usr=0.06%, sys=3.79%, ctx=6680, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=82.1KiB/s (84.0kB/s), 20.3KiB/s-20.8KiB/s (20.8kB/s-21.3kB/s), io=23.4MiB (24.6MB), run=290669-292619msec WRITE: bw=85.9KiB/s (87.0kB/s), 21.5KiB/s-21.7KiB/s (21.0kB/s-22.2kB/s), io=24.6MiB (25.7MB), run=290669-292619msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=146343: Thu Apr 23 03:00:19 2026 read: IOPS=11, BW=192KiB/s (196kB/s)(5920KiB/30886msec) clat (usec): min=68, max=161938, avg=38620.62, stdev=30288.40 lat (usec): min=70, max=161941, avg=38624.19, stdev=30288.98 clat percentiles (usec): | 1.00th=[ 77], 5.00th=[ 117], 10.00th=[ 169], 20.00th=[ 400], | 30.00th=[ 25297], 40.00th=[ 31589], 50.00th=[ 36439], 60.00th=[ 43779], | 70.00th=[ 51643], 80.00th=[ 62129], 90.00th=[ 78119], 95.00th=[ 90702], | 99.00th=[129500], 99.50th=[152044], 99.90th=[162530], 99.95th=[162530], | 99.99th=[162530] bw ( KiB/s): min= 31, max= 352, per=25.41%, avg=192.57, stdev=70.84, samples=61 iops : min= 1, max= 22, avg=11.28, stdev= 4.52, samples=61 write: IOPS=12, BW=206KiB/s (211kB/s)(6368KiB/30886msec); 0 zone resets clat (msec): min=3, max=218, avg=41.42, stdev=38.77 lat (msec): min=3, max=218, avg=41.43, stdev=38.77 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 12], | 30.00th=[ 14], 40.00th=[ 19], 50.00th=[ 26], 60.00th=[ 39], | 70.00th=[ 51], 80.00th=[ 71], 90.00th=[ 100], 95.00th=[ 118], | 99.00th=[ 188], 99.50th=[ 211], 99.90th=[ 220], 99.95th=[ 220], | 99.99th=[ 220] bw ( KiB/s): min= 31, max= 383, per=25.92%, avg=206.61, stdev=67.79, samples=61 iops : min= 1, max= 23, avg=12.16, stdev= 4.24, samples=61 lat (usec) : 100=1.30%, 250=6.51%, 500=2.21%, 750=0.65%, 1000=0.52% lat (msec) : 2=0.39%, 4=0.39%, 10=7.29%, 20=15.36%, 50=34.64% lat (msec) : 100=24.09%, 250=6.64% cpu : usr=0.09%, sys=21.91%, ctx=2415, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146344: Thu Apr 23 03:00:19 2026 read: IOPS=11, BW=184KiB/s (189kB/s)(5744KiB/31147msec) clat (usec): min=61, max=279173, avg=42948.82, stdev=32319.75 lat (usec): min=61, max=279176, avg=42951.30, stdev=32319.89 clat percentiles (usec): | 1.00th=[ 97], 5.00th=[ 165], 10.00th=[ 217], 20.00th=[ 21365], | 30.00th=[ 30016], 40.00th=[ 33817], 50.00th=[ 39060], 60.00th=[ 46400], | 70.00th=[ 54789], 80.00th=[ 66323], 90.00th=[ 80217], 95.00th=[ 95945], | 99.00th=[124257], 99.50th=[181404], 99.90th=[278922], 99.95th=[278922], | 99.99th=[278922] bw ( KiB/s): min= 62, max= 378, per=24.23%, avg=183.64, stdev=68.73, samples=61 iops : min= 3, max= 23, avg=10.72, stdev= 4.31, samples=61 write: IOPS=13, BW=210KiB/s (215kB/s)(6544KiB/31147msec); 0 zone resets clat (msec): min=3, max=209, avg=38.09, stdev=35.39 lat (msec): min=3, max=209, avg=38.09, stdev=35.39 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 11], | 30.00th=[ 14], 40.00th=[ 19], 50.00th=[ 27], 60.00th=[ 36], | 70.00th=[ 44], 80.00th=[ 58], 90.00th=[ 87], 95.00th=[ 107], | 99.00th=[ 178], 99.50th=[ 192], 99.90th=[ 209], 99.95th=[ 209], | 99.99th=[ 209] bw ( KiB/s): min= 31, max= 381, per=26.25%, avg=209.20, stdev=69.44, samples=61 iops : min= 1, max= 23, avg=12.33, stdev= 4.43, samples=61 lat (usec) : 100=0.78%, 250=4.43%, 500=1.95%, 750=0.52%, 1000=0.26% lat (msec) : 2=0.65%, 4=0.26%, 10=8.20%, 20=14.71%, 50=38.41% lat (msec) : 100=24.61%, 250=5.08%, 500=0.13% cpu : usr=0.12%, sys=22.65%, ctx=2386, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146345: Thu Apr 23 03:00:19 2026 read: IOPS=12, BW=198KiB/s (203kB/s)(6256KiB/31596msec) clat (usec): min=58, max=403940, avg=42668.78, stdev=34694.62 lat (usec): min=59, max=403944, avg=42673.74, stdev=34699.88 clat percentiles (usec): | 1.00th=[ 91], 5.00th=[ 139], 10.00th=[ 190], 20.00th=[ 20579], | 30.00th=[ 29754], 40.00th=[ 34866], 50.00th=[ 40633], 60.00th=[ 47449], | 70.00th=[ 52691], 80.00th=[ 62653], 90.00th=[ 78119], 95.00th=[ 93848], | 99.00th=[132645], 99.50th=[177210], 99.90th=[404751], 99.95th=[404751], | 99.99th=[404751] bw ( KiB/s): min= 63, max= 383, per=26.65%, avg=201.98, stdev=75.50, samples=61 iops : min= 3, max= 23, avg=11.87, stdev= 4.84, samples=61 write: IOPS=11, BW=191KiB/s (195kB/s)(6032KiB/31596msec); 0 zone resets clat (msec): min=3, max=468, avg=39.11, stdev=37.54 lat (msec): min=3, max=468, avg=39.12, stdev=37.54 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 7], 10.00th=[ 9], 20.00th=[ 12], | 30.00th=[ 15], 40.00th=[ 22], 50.00th=[ 30], 60.00th=[ 39], | 70.00th=[ 51], 80.00th=[ 62], 90.00th=[ 83], 95.00th=[ 100], | 99.00th=[ 144], 99.50th=[ 153], 99.90th=[ 468], 99.95th=[ 468], | 99.99th=[ 468] bw ( KiB/s): min= 31, max= 349, per=23.58%, avg=187.95, stdev=75.86, samples=62 iops : min= 1, max= 21, avg=10.98, stdev= 4.80, samples=62 lat (usec) : 100=1.17%, 250=6.12%, 500=1.17%, 750=0.26%, 1000=0.39% lat (msec) : 2=0.39%, 4=0.65%, 10=7.94%, 20=10.68%, 50=38.67% lat (msec) : 100=28.13%, 250=4.17%, 500=0.26% cpu : usr=0.11%, sys=21.90%, ctx=2465, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146346: Thu Apr 23 03:00:19 2026 read: IOPS=12, BW=204KiB/s (209kB/s)(6032KiB/29601msec) clat (usec): min=50, max=220651, avg=38100.43, stdev=33265.82 lat (usec): min=51, max=220655, avg=38104.60, stdev=33273.59 clat percentiles (usec): | 1.00th=[ 81], 5.00th=[ 120], 10.00th=[ 159], 20.00th=[ 253], | 30.00th=[ 21627], 40.00th=[ 30802], 50.00th=[ 35914], 60.00th=[ 42730], | 70.00th=[ 51643], 80.00th=[ 63701], 90.00th=[ 74974], 95.00th=[ 90702], | 99.00th=[175113], 99.50th=[191890], 99.90th=[221250], 99.95th=[221250], | 99.99th=[221250] bw ( KiB/s): min= 31, max= 447, per=26.43%, avg=200.34, stdev=96.63, samples=58 iops : min= 1, max= 27, avg=11.78, stdev= 6.06, samples=58 write: IOPS=13, BW=211KiB/s (216kB/s)(6256KiB/29601msec); 0 zone resets clat (msec): min=3, max=192, avg=38.62, stdev=34.79 lat (msec): min=3, max=192, avg=38.63, stdev=34.79 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 7], 10.00th=[ 9], 20.00th=[ 11], | 30.00th=[ 14], 40.00th=[ 20], 50.00th=[ 27], 60.00th=[ 36], | 70.00th=[ 49], 80.00th=[ 59], 90.00th=[ 88], 95.00th=[ 108], | 99.00th=[ 163], 99.50th=[ 192], 99.90th=[ 194], 99.95th=[ 194], | 99.99th=[ 194] bw ( KiB/s): min= 94, max= 349, per=26.17%, avg=208.60, stdev=65.99, samples=58 iops : min= 5, max= 21, avg=12.29, stdev= 4.22, samples=58 lat (usec) : 100=1.43%, 250=8.33%, 500=2.08%, 750=0.91%, 1000=1.04% lat (msec) : 4=0.91%, 10=8.07%, 20=12.63%, 50=34.77%, 100=24.87% lat (msec) : 250=4.95% cpu : usr=0.09%, sys=22.52%, ctx=2282, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=758KiB/s (776kB/s), 184KiB/s-204KiB/s (189kB/s-209kB/s), io=23.4MiB (24.5MB), run=29601-31596msec WRITE: bw=798KiB/s (817kB/s), 191KiB/s-211KiB/s (195kB/s-216kB/s), io=24.6MiB (25.8MB), run=29601-31596msec rand-rw: (groupid=0, jobs=1): err= 0: pid=146348: Thu Apr 23 03:00:55 2026 read: IOPS=5, BW=88.3KiB/s (90.4kB/s)(5920KiB/67062msec) clat (msec): min=8, max=277, avg=40.58, stdev=40.64 lat (msec): min=8, max=277, avg=40.58, stdev=40.65 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 17], | 30.00th=[ 20], 40.00th=[ 22], 50.00th=[ 25], 60.00th=[ 31], | 70.00th=[ 40], 80.00th=[ 52], 90.00th=[ 88], 95.00th=[ 125], | 99.00th=[ 211], 99.50th=[ 220], 99.90th=[ 279], 99.95th=[ 279], | 99.99th=[ 279] bw ( KiB/s): min= 31, max= 288, per=28.24%, avg=100.24, stdev=57.62, samples=117 iops : min= 1, max= 18, avg= 5.50, stdev= 3.67, samples=117 write: IOPS=5, BW=94.0KiB/s (97.2kB/s)(6368KiB/67062msec); 0 zone resets clat (msec): min=40, max=577, avg=129.93, stdev=65.20 lat (msec): min=40, max=577, avg=129.94, stdev=65.20 clat percentiles (msec): | 1.00th=[ 48], 5.00th=[ 63], 10.00th=[ 71], 20.00th=[ 83], | 30.00th=[ 91], 40.00th=[ 103], 50.00th=[ 113], 60.00th=[ 126], | 70.00th=[ 144], 80.00th=[ 165], 90.00th=[ 205], 95.00th=[ 266], | 99.00th=[ 397], 99.50th=[ 426], 99.90th=[ 575], 99.95th=[ 575], | 99.99th=[ 575] bw ( KiB/s): min= 30, max= 224, per=25.94%, avg=96.76, stdev=44.87, samples=130 iops : min= 1, max= 14, avg= 5.27, stdev= 2.92, samples=130 lat (msec) : 10=0.26%, 20=16.02%, 50=22.92%, 100=24.87%, 250=32.68% lat (msec) : 500=3.12%, 750=0.13% cpu : usr=0.05%, sys=4.67%, ctx=1774, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146349: Thu Apr 23 03:00:55 2026 read: IOPS=5, BW=85.1KiB/s (87.2kB/s)(5744KiB/67470msec) clat (msec): min=8, max=295, avg=39.53, stdev=41.56 lat (msec): min=8, max=295, avg=39.53, stdev=41.56 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 13], 10.00th=[ 15], 20.00th=[ 17], | 30.00th=[ 19], 40.00th=[ 21], 50.00th=[ 25], 60.00th=[ 28], | 70.00th=[ 37], 80.00th=[ 53], 90.00th=[ 89], 95.00th=[ 127], | 99.00th=[ 236], 99.50th=[ 266], 99.90th=[ 296], 99.95th=[ 296], | 99.99th=[ 296] bw ( KiB/s): min= 30, max= 383, per=27.38%, avg=97.20, stdev=65.41, samples=117 iops : min= 1, max= 23, avg= 5.30, stdev= 4.16, samples=117 write: IOPS=6, BW=96.0KiB/s (99.3kB/s)(6544KiB/67470msec); 0 zone resets clat (msec): min=39, max=500, avg=129.58, stdev=61.03 lat (msec): min=39, max=500, avg=129.58, stdev=61.03 clat percentiles (msec): | 1.00th=[ 48], 5.00th=[ 59], 10.00th=[ 69], 20.00th=[ 84], | 30.00th=[ 92], 40.00th=[ 104], 50.00th=[ 115], 60.00th=[ 127], | 70.00th=[ 144], 80.00th=[ 169], 90.00th=[ 211], 95.00th=[ 249], | 99.00th=[ 317], 99.50th=[ 342], 99.90th=[ 502], 99.95th=[ 502], | 99.99th=[ 502] bw ( KiB/s): min= 31, max= 256, per=26.06%, avg=97.19, stdev=45.39, samples=133 iops : min= 1, max= 16, avg= 5.29, stdev= 2.95, samples=133 lat (msec) : 10=0.39%, 20=16.54%, 50=21.09%, 100=25.13%, 250=33.85% lat (msec) : 500=2.86%, 750=0.13% cpu : usr=0.06%, sys=4.67%, ctx=1813, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146350: Thu Apr 23 03:00:55 2026 read: IOPS=5, BW=95.6KiB/s (97.9kB/s)(6256KiB/65455msec) clat (msec): min=10, max=297, avg=38.91, stdev=39.78 lat (msec): min=10, max=297, avg=38.91, stdev=39.78 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 14], 10.00th=[ 16], 20.00th=[ 17], | 30.00th=[ 20], 40.00th=[ 22], 50.00th=[ 25], 60.00th=[ 28], | 70.00th=[ 35], 80.00th=[ 50], 90.00th=[ 82], 95.00th=[ 127], | 99.00th=[ 228], 99.50th=[ 275], 99.90th=[ 296], 99.95th=[ 296], | 99.99th=[ 296] bw ( KiB/s): min= 30, max= 384, per=29.59%, avg=105.06, stdev=72.23, samples=118 iops : min= 1, max= 24, avg= 5.78, stdev= 4.59, samples=118 write: IOPS=5, BW=92.2KiB/s (94.4kB/s)(6032KiB/65455msec); 0 zone resets clat (msec): min=46, max=430, avg=132.95, stdev=60.48 lat (msec): min=46, max=430, avg=132.96, stdev=60.48 clat percentiles (msec): | 1.00th=[ 53], 5.00th=[ 61], 10.00th=[ 71], 20.00th=[ 83], | 30.00th=[ 94], 40.00th=[ 104], 50.00th=[ 118], 60.00th=[ 132], | 70.00th=[ 150], 80.00th=[ 188], 90.00th=[ 218], 95.00th=[ 247], | 99.00th=[ 313], 99.50th=[ 359], 99.90th=[ 430], 99.95th=[ 430], | 99.99th=[ 430] bw ( KiB/s): min= 30, max= 190, per=25.34%, avg=94.52, stdev=38.43, samples=126 iops : min= 1, max= 11, avg= 5.12, stdev= 2.46, samples=126 lat (msec) : 20=17.32%, 50=24.09%, 100=23.70%, 250=32.16%, 500=2.73% cpu : usr=0.08%, sys=4.79%, ctx=1876, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146351: Thu Apr 23 03:00:55 2026 read: IOPS=5, BW=91.7KiB/s (93.9kB/s)(6032KiB/65755msec) clat (msec): min=8, max=260, avg=39.81, stdev=36.87 lat (msec): min=8, max=260, avg=39.82, stdev=36.88 clat percentiles (msec): | 1.00th=[ 12], 5.00th=[ 15], 10.00th=[ 16], 20.00th=[ 18], | 30.00th=[ 21], 40.00th=[ 23], 50.00th=[ 26], 60.00th=[ 30], | 70.00th=[ 38], 80.00th=[ 56], 90.00th=[ 80], 95.00th=[ 132], | 99.00th=[ 169], 99.50th=[ 255], 99.90th=[ 262], 99.95th=[ 262], | 99.99th=[ 262] bw ( KiB/s): min= 30, max= 287, per=28.30%, avg=100.48, stdev=63.36, samples=117 iops : min= 1, max= 17, avg= 5.49, stdev= 3.96, samples=117 write: IOPS=5, BW=95.1KiB/s (97.4kB/s)(6256KiB/65755msec); 0 zone resets clat (msec): min=46, max=434, avg=129.24, stdev=57.31 lat (msec): min=46, max=434, avg=129.25, stdev=57.31 clat percentiles (msec): | 1.00th=[ 53], 5.00th=[ 64], 10.00th=[ 72], 20.00th=[ 85], | 30.00th=[ 94], 40.00th=[ 105], 50.00th=[ 114], 60.00th=[ 128], | 70.00th=[ 148], 80.00th=[ 167], 90.00th=[ 203], 95.00th=[ 234], | 99.00th=[ 326], 99.50th=[ 388], 99.90th=[ 435], 99.95th=[ 435], | 99.99th=[ 435] bw ( KiB/s): min= 31, max= 192, per=25.35%, avg=94.55, stdev=41.90, samples=130 iops : min= 1, max= 12, avg= 5.12, stdev= 2.72, samples=130 lat (msec) : 10=0.39%, 20=14.19%, 50=23.70%, 100=25.65%, 250=33.72% lat (msec) : 500=2.34% cpu : usr=0.08%, sys=4.84%, ctx=1848, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=355KiB/s (364kB/s), 85.1KiB/s-95.6KiB/s (87.2kB/s-97.9kB/s), io=23.4MiB (24.5MB), run=65455-67470msec WRITE: bw=373KiB/s (382kB/s), 92.2KiB/s-96.0KiB/s (94.4kB/s-99.3kB/s), io=24.6MiB (25.8MB), run=65455-67470msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=146379: Thu Apr 23 03:01:17 2026 read: IOPS=0, BW=996KiB/s (1020kB/s)(7168KiB/7197msec) clat (usec): min=982, max=4523.1k, avg=793722.29, stdev=1654553.40 lat (usec): min=985, max=4523.1k, avg=793725.47, stdev=1654553.16 clat percentiles (usec): | 1.00th=[ 979], 5.00th=[ 979], 10.00th=[ 979], | 20.00th=[ 2540], 30.00th=[ 2737], 40.00th=[ 2737], | 50.00th=[ 270533], 60.00th=[ 283116], 70.00th=[ 283116], | 80.00th=[ 471860], 90.00th=[4529849], 95.00th=[4529849], | 99.00th=[4529849], 99.50th=[4529849], 99.90th=[4529849], | 99.95th=[4529849], 99.99th=[4529849] bw ( KiB/s): min= 1841, max= 4096, per=93.51%, avg=2405.20, stdev=948.85, samples=5 iops : min= 1, max= 4, avg= 1.60, stdev= 1.34, samples=5 write: IOPS=0, BW=711KiB/s (728kB/s)(5120KiB/7197msec); 0 zone resets clat (msec): min=167, max=441, avg=314.73, stdev=110.11 lat (msec): min=167, max=441, avg=314.81, stdev=110.12 clat percentiles (msec): | 1.00th=[ 167], 5.00th=[ 167], 10.00th=[ 167], 20.00th=[ 167], | 30.00th=[ 264], 40.00th=[ 264], 50.00th=[ 300], 60.00th=[ 300], | 70.00th=[ 401], 80.00th=[ 401], 90.00th=[ 443], 95.00th=[ 443], | 99.00th=[ 443], 99.50th=[ 443], 99.90th=[ 443], 99.95th=[ 443], | 99.99th=[ 443] bw ( KiB/s): min= 2035, max= 4087, per=75.63%, avg=2723.33, stdev=1180.99, samples=3 iops : min= 1, max= 3, avg= 2.00, stdev= 1.00, samples=3 lat (usec) : 1000=8.33% lat (msec) : 4=16.67%, 250=8.33%, 500=58.33%, >=2000=8.33% cpu : usr=0.06%, sys=26.60%, ctx=498, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146381: Thu Apr 23 03:01:17 2026 read: IOPS=0, BW=257KiB/s (263kB/s)(2048KiB/7962msec) clat (msec): min=339, max=479, avg=409.42, stdev=99.04 lat (msec): min=339, max=479, avg=409.42, stdev=99.04 clat percentiles (msec): | 1.00th=[ 338], 5.00th=[ 338], 10.00th=[ 338], 20.00th=[ 338], | 30.00th=[ 338], 40.00th=[ 338], 50.00th=[ 338], 60.00th=[ 481], | 70.00th=[ 481], 80.00th=[ 481], 90.00th=[ 481], 95.00th=[ 481], | 99.00th=[ 481], 99.50th=[ 481], 99.90th=[ 481], 99.95th=[ 481], | 99.99th=[ 481] bw ( KiB/s): min= 2003, max= 2039, per=78.58%, avg=2021.00, stdev=25.46, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1286KiB/s (1317kB/s)(10.0MiB/7962msec); 0 zone resets clat (msec): min=221, max=2405, avg=686.88, stdev=669.00 lat (msec): min=221, max=2405, avg=687.02, stdev=668.99 clat percentiles (msec): | 1.00th=[ 222], 5.00th=[ 222], 10.00th=[ 222], 20.00th=[ 239], | 30.00th=[ 296], 40.00th=[ 351], 50.00th=[ 397], 60.00th=[ 447], | 70.00th=[ 542], 80.00th=[ 835], 90.00th=[ 1150], 95.00th=[ 2400], | 99.00th=[ 2400], 99.50th=[ 2400], 99.90th=[ 2400], 99.95th=[ 2400], | 99.99th=[ 2400] bw ( KiB/s): min= 1928, max= 4071, per=72.08%, avg=2595.71, stdev=989.65, samples=7 iops : min= 1, max= 3, avg= 1.57, stdev= 0.98, samples=7 lat (msec) : 250=16.67%, 500=50.00%, 750=8.33%, 1000=8.33%, 2000=8.33% lat (msec) : >=2000=8.33% cpu : usr=0.03%, sys=32.31%, ctx=411, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146383: Thu Apr 23 03:01:17 2026 read: IOPS=0, BW=900KiB/s (921kB/s)(6144KiB/6830msec) clat (usec): min=999, max=441986, avg=199309.41, stdev=219335.09 lat (usec): min=1002, max=441988, avg=199312.12, stdev=219334.91 clat percentiles (usec): | 1.00th=[ 1004], 5.00th=[ 1004], 10.00th=[ 1004], 20.00th=[ 1172], | 30.00th=[ 1172], 40.00th=[ 4178], 50.00th=[ 4178], 60.00th=[329253], | 70.00th=[417334], 80.00th=[417334], 90.00th=[442500], 95.00th=[442500], | 99.00th=[442500], 99.50th=[442500], 99.90th=[442500], 99.95th=[442500], | 99.99th=[442500] bw ( KiB/s): min= 2035, max= 4079, per=100.00%, avg=3392.33, stdev=1175.51, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 write: IOPS=0, BW=900KiB/s (921kB/s)(6144KiB/6830msec); 0 zone resets clat (msec): min=263, max=1878, avg=903.80, stdev=737.92 lat (msec): min=263, max=1878, avg=903.88, stdev=737.90 clat percentiles (msec): | 1.00th=[ 264], 5.00th=[ 264], 10.00th=[ 264], 20.00th=[ 334], | 30.00th=[ 334], 40.00th=[ 372], 50.00th=[ 372], 60.00th=[ 810], | 70.00th=[ 1770], 80.00th=[ 1770], 90.00th=[ 1871], 95.00th=[ 1871], | 99.00th=[ 1871], 99.50th=[ 1871], 99.90th=[ 1871], 99.95th=[ 1871], | 99.99th=[ 1871] bw ( KiB/s): min= 1815, max= 2048, per=55.21%, avg=1988.00, stdev=98.19, samples=5 iops : min= 1, max= 2, avg= 1.20, stdev= 0.45, samples=5 lat (usec) : 1000=8.33% lat (msec) : 2=8.33%, 10=8.33%, 500=50.00%, 1000=8.33%, 2000=16.67% cpu : usr=0.00%, sys=29.78%, ctx=530, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146384: Thu Apr 23 03:01:17 2026 read: IOPS=0, BW=774KiB/s (793kB/s)(5120KiB/6613msec) clat (usec): min=904, max=353381, avg=216519.53, stdev=165753.36 lat (usec): min=906, max=353384, avg=216522.61, stdev=165753.25 clat percentiles (usec): | 1.00th=[ 906], 5.00th=[ 906], 10.00th=[ 906], 20.00th=[ 906], | 30.00th=[ 74974], 40.00th=[ 74974], 50.00th=[316670], 60.00th=[316670], | 70.00th=[337642], 80.00th=[337642], 90.00th=[354419], 95.00th=[354419], | 99.00th=[354419], 99.50th=[354419], 99.90th=[354419], 99.95th=[354419], | 99.99th=[354419] bw ( KiB/s): min= 2007, max= 4079, per=100.00%, avg=2711.33, stdev=1184.61, samples=3 iops : min= 1, max= 3, avg= 2.00, stdev= 1.00, samples=3 write: IOPS=1, BW=1084KiB/s (1110kB/s)(7168KiB/6613msec); 0 zone resets clat (msec): min=238, max=2740, avg=785.81, stdev=928.54 lat (msec): min=238, max=2740, avg=785.89, stdev=928.53 clat percentiles (msec): | 1.00th=[ 239], 5.00th=[ 239], 10.00th=[ 239], 20.00th=[ 279], | 30.00th=[ 321], 40.00th=[ 321], 50.00th=[ 338], 60.00th=[ 351], | 70.00th=[ 351], 80.00th=[ 1234], 90.00th=[ 2735], 95.00th=[ 2735], | 99.00th=[ 2735], 99.50th=[ 2735], 99.90th=[ 2735], 99.95th=[ 2735], | 99.99th=[ 2735] bw ( KiB/s): min= 1659, max= 2048, per=53.79%, avg=1937.00, stdev=162.65, samples=5 iops : min= 1, max= 2, avg= 1.20, stdev= 0.45, samples=5 lat (usec) : 1000=8.33% lat (msec) : 100=8.33%, 250=8.33%, 500=58.33%, 2000=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=33.23%, ctx=402, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2572KiB/s (2634kB/s), 257KiB/s-996KiB/s (263kB/s-1020kB/s), io=20.0MiB (20.0MB), run=6613-7962msec WRITE: bw=3601KiB/s (3688kB/s), 711KiB/s-1286KiB/s (728kB/s-1317kB/s), io=28.0MiB (29.4MB), run=6613-7962msec rand-rw: (groupid=0, jobs=1): err= 0: pid=146380: Thu Apr 23 03:01:18 2026 read: IOPS=0, BW=803KiB/s (822kB/s)(7168KiB/8925msec) clat (msec): min=90, max=3441, avg=976.88, stdev=1208.79 lat (msec): min=90, max=3441, avg=976.89, stdev=1208.79 clat percentiles (msec): | 1.00th=[ 91], 5.00th=[ 91], 10.00th=[ 91], 20.00th=[ 120], | 30.00th=[ 142], 40.00th=[ 142], 50.00th=[ 498], 60.00th=[ 1099], | 70.00th=[ 1099], 80.00th=[ 1452], 90.00th=[ 3440], 95.00th=[ 3440], | 99.00th=[ 3440], 99.50th=[ 3440], 99.90th=[ 3440], 99.95th=[ 3440], | 99.99th=[ 3440] bw ( KiB/s): min= 2039, max= 4096, per=100.00%, avg=2452.80, stdev=918.58, samples=5 iops : min= 1, max= 4, avg= 1.60, stdev= 1.34, samples=5 write: IOPS=0, BW=574KiB/s (587kB/s)(5120KiB/8925msec); 0 zone resets clat (msec): min=175, max=676, avg=393.48, stdev=215.91 lat (msec): min=175, max=676, avg=393.60, stdev=215.92 clat percentiles (msec): | 1.00th=[ 176], 5.00th=[ 176], 10.00th=[ 176], 20.00th=[ 176], | 30.00th=[ 199], 40.00th=[ 199], 50.00th=[ 380], 60.00th=[ 380], | 70.00th=[ 542], 80.00th=[ 542], 90.00th=[ 676], 95.00th=[ 676], | 99.00th=[ 676], 99.50th=[ 676], 99.90th=[ 676], 99.95th=[ 676], | 99.99th=[ 676] bw ( KiB/s): min= 1969, max= 4087, per=83.63%, avg=2686.33, stdev=1213.13, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (msec) : 100=8.33%, 250=33.33%, 500=16.67%, 750=16.67%, 2000=16.67% lat (msec) : >=2000=8.33% cpu : usr=0.02%, sys=7.59%, ctx=132, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146382: Thu Apr 23 03:01:18 2026 read: IOPS=0, BW=242KiB/s (248kB/s)(2048KiB/8467msec) clat (msec): min=154, max=787, avg=471.24, stdev=447.92 lat (msec): min=154, max=787, avg=471.25, stdev=447.92 clat percentiles (msec): | 1.00th=[ 155], 5.00th=[ 155], 10.00th=[ 155], 20.00th=[ 155], | 30.00th=[ 155], 40.00th=[ 155], 50.00th=[ 155], 60.00th=[ 785], | 70.00th=[ 785], 80.00th=[ 785], 90.00th=[ 785], 95.00th=[ 785], | 99.00th=[ 785], 99.50th=[ 785], 99.90th=[ 785], 99.95th=[ 785], | 99.99th=[ 785] bw ( KiB/s): min= 2043, max= 2043, per=89.06%, avg=2043.00, stdev= 0.00, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1209KiB/s (1238kB/s)(10.0MiB/8467msec); 0 zone resets clat (msec): min=168, max=2384, avg=728.40, stdev=729.14 lat (msec): min=168, max=2384, avg=728.55, stdev=729.12 clat percentiles (msec): | 1.00th=[ 169], 5.00th=[ 169], 10.00th=[ 169], 20.00th=[ 262], | 30.00th=[ 330], 40.00th=[ 355], 50.00th=[ 380], 60.00th=[ 451], | 70.00th=[ 506], 80.00th=[ 743], 90.00th=[ 1703], 95.00th=[ 2400], | 99.00th=[ 2400], 99.50th=[ 2400], 99.90th=[ 2400], 99.95th=[ 2400], | 99.99th=[ 2400] bw ( KiB/s): min= 1969, max= 4079, per=81.12%, avg=2605.71, stdev=998.67, samples=7 iops : min= 1, max= 3, avg= 1.71, stdev= 0.95, samples=7 lat (msec) : 250=16.67%, 500=41.67%, 750=16.67%, 1000=8.33%, 2000=8.33% lat (msec) : >=2000=8.33% cpu : usr=0.00%, sys=11.19%, ctx=168, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146385: Thu Apr 23 03:01:18 2026 read: IOPS=0, BW=729KiB/s (746kB/s)(6144KiB/8429msec) clat (msec): min=151, max=608, avg=322.34, stdev=182.25 lat (msec): min=151, max=608, avg=322.35, stdev=182.25 clat percentiles (msec): | 1.00th=[ 153], 5.00th=[ 153], 10.00th=[ 153], 20.00th=[ 165], | 30.00th=[ 165], 40.00th=[ 230], 50.00th=[ 230], 60.00th=[ 313], | 70.00th=[ 468], 80.00th=[ 468], 90.00th=[ 609], 95.00th=[ 609], | 99.00th=[ 609], 99.50th=[ 609], 99.90th=[ 609], 99.95th=[ 609], | 99.99th=[ 609] bw ( KiB/s): min= 2003, max= 4087, per=100.00%, avg=2545.25, stdev=1028.03, samples=4 iops : min= 1, max= 3, avg= 1.75, stdev= 0.96, samples=4 write: IOPS=0, BW=729KiB/s (746kB/s)(6144KiB/8429msec); 0 zone resets clat (msec): min=307, max=2669, avg=1043.95, stdev=972.82 lat (msec): min=307, max=2669, avg=1044.06, stdev=972.82 clat percentiles (msec): | 1.00th=[ 309], 5.00th=[ 309], 10.00th=[ 309], 20.00th=[ 326], | 30.00th=[ 326], 40.00th=[ 338], 50.00th=[ 338], 60.00th=[ 877], | 70.00th=[ 1754], 80.00th=[ 1754], 90.00th=[ 2668], 95.00th=[ 2668], | 99.00th=[ 2668], 99.50th=[ 2668], 99.90th=[ 2668], 99.95th=[ 2668], | 99.99th=[ 2668] bw ( KiB/s): min= 2003, max= 3828, per=74.50%, avg=2393.00, stdev=802.39, samples=5 iops : min= 1, max= 3, avg= 1.60, stdev= 0.89, samples=5 lat (msec) : 250=25.00%, 500=41.67%, 750=8.33%, 1000=8.33%, 2000=8.33% lat (msec) : >=2000=8.33% cpu : usr=0.01%, sys=9.20%, ctx=283, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146386: Thu Apr 23 03:01:18 2026 read: IOPS=0, BW=596KiB/s (610kB/s)(5120KiB/8592msec) clat (msec): min=72, max=955, avg=290.40, stdev=374.46 lat (msec): min=72, max=955, avg=290.40, stdev=374.46 clat percentiles (msec): | 1.00th=[ 72], 5.00th=[ 72], 10.00th=[ 72], 20.00th=[ 72], | 30.00th=[ 109], 40.00th=[ 109], 50.00th=[ 121], 60.00th=[ 121], | 70.00th=[ 197], 80.00th=[ 197], 90.00th=[ 953], 95.00th=[ 953], | 99.00th=[ 953], 99.50th=[ 953], 99.90th=[ 953], 99.95th=[ 953], | 99.99th=[ 953] bw ( KiB/s): min= 2039, max= 2048, per=89.03%, avg=2042.25, stdev= 4.27, samples=4 iops : min= 1, max= 2, avg= 1.25, stdev= 0.50, samples=4 write: IOPS=0, BW=834KiB/s (854kB/s)(7168KiB/8592msec); 0 zone resets clat (msec): min=158, max=2694, avg=1013.18, stdev=874.93 lat (msec): min=158, max=2694, avg=1013.53, stdev=874.71 clat percentiles (msec): | 1.00th=[ 159], 5.00th=[ 159], 10.00th=[ 159], 20.00th=[ 338], | 30.00th=[ 550], 40.00th=[ 550], 50.00th=[ 802], 60.00th=[ 978], | 70.00th=[ 978], 80.00th=[ 1569], 90.00th=[ 2702], 95.00th=[ 2702], | 99.00th=[ 2702], 99.50th=[ 2702], 99.90th=[ 2702], 99.95th=[ 2702], | 99.99th=[ 2702] bw ( KiB/s): min= 1858, max= 2048, per=62.14%, avg=1995.80, stdev=79.00, samples=5 iops : min= 1, max= 2, avg= 1.20, stdev= 0.45, samples=5 lat (msec) : 100=8.33%, 250=33.33%, 500=8.33%, 750=8.33%, 1000=25.00% lat (msec) : 2000=8.33%, >=2000=8.33% cpu : usr=0.02%, sys=8.57%, ctx=171, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2295KiB/s (2350kB/s), 242KiB/s-803KiB/s (248kB/s-822kB/s), io=20.0MiB (20.0MB), run=8429-8925msec WRITE: bw=3213KiB/s (3290kB/s), 574KiB/s-1209KiB/s (587kB/s-1238kB/s), io=28.0MiB (29.4MB), run=8429-8925msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=146395: Thu Apr 23 03:01:38 2026 read: IOPS=0, BW=2571KiB/s (2632kB/s)(12.0MiB/4780msec) clat (msec): min=1346, max=1608, avg=1484.41, stdev=131.87 lat (msec): min=1346, max=1608, avg=1484.41, stdev=131.87 clat percentiles (msec): | 1.00th=[ 1351], 5.00th=[ 1351], 10.00th=[ 1351], 20.00th=[ 1351], | 30.00th=[ 1351], 40.00th=[ 1502], 50.00th=[ 1502], 60.00th=[ 1502], | 70.00th=[ 1603], 80.00th=[ 1603], 90.00th=[ 1603], 95.00th=[ 1603], | 99.00th=[ 1603], 99.50th=[ 1603], 99.90th=[ 1603], 99.95th=[ 1603], | 99.99th=[ 1603] bw ( KiB/s): min= 8126, max= 8192, per=100.00%, avg=8159.00, stdev=46.67, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 2000=100.00% cpu : usr=0.00%, sys=32.48%, ctx=832, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146396: Thu Apr 23 03:01:38 2026 read: IOPS=0, BW=814KiB/s (833kB/s)(4096KiB/5035msec) clat (nsec): min=1507.7M, max=1507.7M, avg=1507741294.00, stdev= 0.00 lat (nsec): min=1507.7M, max=1507.7M, avg=1507748052.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1502], 5.00th=[ 1502], 10.00th=[ 1502], 20.00th=[ 1502], | 30.00th=[ 1502], 40.00th=[ 1502], 50.00th=[ 1502], 60.00th=[ 1502], | 70.00th=[ 1502], 80.00th=[ 1502], 90.00th=[ 1502], 95.00th=[ 1502], | 99.00th=[ 1502], 99.50th=[ 1502], 99.90th=[ 1502], 99.95th=[ 1502], | 99.99th=[ 1502] bw ( KiB/s): min= 8192, max= 8192, per=100.00%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 write: IOPS=0, BW=1627KiB/s (1666kB/s)(8192KiB/5035msec); 0 zone resets clat (msec): min=870, max=2271, avg=1571.09, stdev=990.55 lat (msec): min=877, max=2271, avg=1574.43, stdev=986.10 clat percentiles (msec): | 1.00th=[ 869], 5.00th=[ 869], 10.00th=[ 869], 20.00th=[ 869], | 30.00th=[ 869], 40.00th=[ 869], 50.00th=[ 869], 60.00th=[ 2265], | 70.00th=[ 2265], 80.00th=[ 2265], 90.00th=[ 2265], 95.00th=[ 2265], | 99.00th=[ 2265], 99.50th=[ 2265], 99.90th=[ 2265], 99.95th=[ 2265], | 99.99th=[ 2265] bw ( KiB/s): min= 8062, max= 8062, per=100.00%, avg=8062.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 1000=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=19.77%, ctx=485, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146398: Thu Apr 23 03:01:38 2026 write: IOPS=0, BW=2443KiB/s (2502kB/s)(12.0MiB/5029msec); 0 zone resets clat (msec): min=582, max=2161, avg=1582.43, stdev=869.70 lat (msec): min=583, max=2162, avg=1583.09, stdev=869.62 clat percentiles (msec): | 1.00th=[ 584], 5.00th=[ 584], 10.00th=[ 584], 20.00th=[ 584], | 30.00th=[ 584], 40.00th=[ 2005], 50.00th=[ 2005], 60.00th=[ 2005], | 70.00th=[ 2165], 80.00th=[ 2165], 90.00th=[ 2165], 95.00th=[ 2165], | 99.00th=[ 2165], 99.50th=[ 2165], 99.90th=[ 2165], 99.95th=[ 2165], | 99.99th=[ 2165] bw ( KiB/s): min= 8143, max= 8159, per=100.00%, avg=8151.00, stdev=11.31, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, >=2000=66.67% cpu : usr=0.00%, sys=17.40%, ctx=111, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146401: Thu Apr 23 03:01:38 2026 write: IOPS=0, BW=3685KiB/s (3773kB/s)(12.0MiB/3335msec); 0 zone resets clat (msec): min=553, max=1772, avg=1089.70, stdev=622.41 lat (msec): min=554, max=1777, avg=1091.90, stdev=624.79 clat percentiles (msec): | 1.00th=[ 558], 5.00th=[ 558], 10.00th=[ 558], 20.00th=[ 558], | 30.00th=[ 558], 40.00th=[ 944], 50.00th=[ 944], 60.00th=[ 944], | 70.00th=[ 1770], 80.00th=[ 1770], 90.00th=[ 1770], 95.00th=[ 1770], | 99.00th=[ 1770], 99.50th=[ 1770], 99.90th=[ 1770], 99.95th=[ 1770], | 99.99th=[ 1770] bw ( KiB/s): min= 7937, max= 8175, per=100.00%, avg=8056.00, stdev=168.29, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.06%, sys=19.29%, ctx=104, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3254KiB/s (3332kB/s), 814KiB/s-2571KiB/s (833kB/s-2632kB/s), io=16.0MiB (16.8MB), run=4780-5035msec WRITE: bw=6508KiB/s (6664kB/s), 1627KiB/s-3685KiB/s (1666kB/s-3773kB/s), io=32.0MiB (33.6MB), run=3335-5035msec rand-rw: (groupid=0, jobs=1): err= 0: pid=146394: Thu Apr 23 03:01:38 2026 read: IOPS=1, BW=5420KiB/s (5550kB/s)(12.0MiB/2267msec) clat (msec): min=308, max=1352, avg=748.51, stdev=541.03 lat (msec): min=308, max=1352, avg=748.52, stdev=541.03 clat percentiles (msec): | 1.00th=[ 309], 5.00th=[ 309], 10.00th=[ 309], 20.00th=[ 309], | 30.00th=[ 309], 40.00th=[ 584], 50.00th=[ 584], 60.00th=[ 584], | 70.00th=[ 1351], 80.00th=[ 1351], 90.00th=[ 1351], 95.00th=[ 1351], | 99.00th=[ 1351], 99.50th=[ 1351], 99.90th=[ 1351], 99.95th=[ 1351], | 99.99th=[ 1351] bw ( KiB/s): min= 7301, max= 8192, per=100.00%, avg=7746.50, stdev=630.03, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 500=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.00%, sys=24.71%, ctx=131, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146397: Thu Apr 23 03:01:38 2026 read: IOPS=0, BW=779KiB/s (798kB/s)(4096KiB/5259msec) clat (nsec): min=2330.3M, max=2330.3M, avg=2330280662.00, stdev= 0.00 lat (nsec): min=2330.3M, max=2330.3M, avg=2330285172.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 2333], 5.00th=[ 2333], 10.00th=[ 2333], 20.00th=[ 2333], | 30.00th=[ 2333], 40.00th=[ 2333], 50.00th=[ 2333], 60.00th=[ 2333], | 70.00th=[ 2333], 80.00th=[ 2333], 90.00th=[ 2333], 95.00th=[ 2333], | 99.00th=[ 2333], 99.50th=[ 2333], 99.90th=[ 2333], 99.95th=[ 2333], | 99.99th=[ 2333] bw ( KiB/s): min= 7816, max= 7816, per=100.00%, avg=7816.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=1558KiB/s (1595kB/s)(8192KiB/5259msec); 0 zone resets clat (msec): min=1235, max=1270, avg=1253.13, stdev=24.32 lat (msec): min=1236, max=1271, avg=1253.79, stdev=24.67 clat percentiles (msec): | 1.00th=[ 1234], 5.00th=[ 1234], 10.00th=[ 1234], 20.00th=[ 1234], | 30.00th=[ 1234], 40.00th=[ 1234], 50.00th=[ 1234], 60.00th=[ 1267], | 70.00th=[ 1267], 80.00th=[ 1267], 90.00th=[ 1267], 95.00th=[ 1267], | 99.00th=[ 1267], 99.50th=[ 1267], 99.90th=[ 1267], 99.95th=[ 1267], | 99.99th=[ 1267] bw ( KiB/s): min= 8175, max= 8175, per=100.00%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 2000=66.67%, >=2000=33.33% cpu : usr=0.00%, sys=8.96%, ctx=113, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146399: Thu Apr 23 03:01:38 2026 write: IOPS=0, BW=3601KiB/s (3688kB/s)(12.0MiB/3412msec); 0 zone resets clat (msec): min=600, max=1275, avg=1038.11, stdev=379.12 lat (msec): min=601, max=1275, avg=1038.61, stdev=379.01 clat percentiles (msec): | 1.00th=[ 600], 5.00th=[ 600], 10.00th=[ 600], 20.00th=[ 600], | 30.00th=[ 600], 40.00th=[ 1234], 50.00th=[ 1234], 60.00th=[ 1234], | 70.00th=[ 1284], 80.00th=[ 1284], 90.00th=[ 1284], 95.00th=[ 1284], | 99.00th=[ 1284], 99.50th=[ 1284], 99.90th=[ 1284], 99.95th=[ 1284], | 99.99th=[ 1284] bw ( KiB/s): min= 7728, max= 8000, per=100.00%, avg=7864.00, stdev=192.33, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 2000=66.67% cpu : usr=0.00%, sys=20.17%, ctx=197, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146400: Thu Apr 23 03:01:38 2026 write: IOPS=0, BW=2666KiB/s (2729kB/s)(12.0MiB/4610msec); 0 zone resets clat (msec): min=771, max=2146, avg=1487.96, stdev=688.97 lat (msec): min=772, max=2148, avg=1489.13, stdev=690.00 clat percentiles (msec): | 1.00th=[ 776], 5.00th=[ 776], 10.00th=[ 776], 20.00th=[ 776], | 30.00th=[ 776], 40.00th=[ 1552], 50.00th=[ 1552], 60.00th=[ 1552], | 70.00th=[ 2140], 80.00th=[ 2140], 90.00th=[ 2140], 95.00th=[ 2140], | 99.00th=[ 2140], 99.50th=[ 2140], 99.90th=[ 2140], 99.95th=[ 2140], | 99.99th=[ 2140] bw ( KiB/s): min= 7393, max= 8175, per=100.00%, avg=7784.00, stdev=552.96, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=19.98%, ctx=147, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3115KiB/s (3190kB/s), 779KiB/s-5420KiB/s (798kB/s-5550kB/s), io=16.0MiB (16.8MB), run=2267-5259msec WRITE: bw=6231KiB/s (6380kB/s), 1558KiB/s-3601KiB/s (1595kB/s-3688kB/s), io=32.0MiB (33.6MB), run=3412-5259msec