== sanity test 398b: DIO and buffer IO race ============== 17:57:00 (1787608620) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 5.52316 s, 9.1 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144875: Mon Aug 24 17:59:34 2026 read: IOPS=11, BW=44.2KiB/s (45.3kB/s)(5992KiB/135467msec) clat (usec): min=34, max=807676, avg=45335.01, stdev=40022.73 lat (usec): min=34, max=807677, avg=45338.05, stdev=40022.23 clat percentiles (usec): | 1.00th=[ 50], 5.00th=[ 71], 10.00th=[ 9896], 20.00th=[ 20317], | 30.00th=[ 26084], 40.00th=[ 32113], 50.00th=[ 37487], 60.00th=[ 44827], | 70.00th=[ 54264], 80.00th=[ 67634], 90.00th=[ 86508], 95.00th=[105382], | 99.00th=[164627], 99.50th=[217056], 99.90th=[350225], 99.95th=[809501], | 99.99th=[809501] bw ( KiB/s): min= 7, max= 111, per=25.12%, avg=43.95, stdev=21.24, samples=264 iops : min= 1, max= 27, avg=10.34, stdev= 5.37, samples=264 write: IOPS=11, BW=46.5KiB/s (47.6kB/s)(6296KiB/135467msec); 0 zone resets clat (usec): min=974, max=582324, avg=42592.17, stdev=46255.51 lat (usec): min=976, max=582327, avg=42594.86, stdev=46255.57 clat percentiles (usec): | 1.00th=[ 1139], 5.00th=[ 1352], 10.00th=[ 2008], 20.00th=[ 5211], | 30.00th=[ 10028], 40.00th=[ 19792], 50.00th=[ 29230], 60.00th=[ 41157], | 70.00th=[ 53740], 80.00th=[ 71828], 90.00th=[101188], 95.00th=[131597], | 99.00th=[204473], 99.50th=[219153], 99.90th=[421528], 99.95th=[583009], | 99.99th=[583009] bw ( KiB/s): min= 7, max= 111, per=25.16%, avg=46.30, stdev=22.09, samples=264 iops : min= 1, max= 27, avg=10.92, stdev= 5.57, samples=264 lat (usec) : 50=0.52%, 100=3.32%, 250=0.52%, 500=0.10%, 1000=0.07% lat (msec) : 2=5.21%, 4=3.58%, 10=6.97%, 20=10.06%, 50=36.26% lat (msec) : 100=25.07%, 250=8.07%, 500=0.20%, 750=0.03%, 1000=0.03% cpu : usr=0.08%, sys=5.22%, ctx=6611, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144878: Mon Aug 24 17:59:34 2026 read: IOPS=11, BW=44.7KiB/s (45.7kB/s)(5940KiB/132964msec) clat (usec): min=31, max=372160, avg=43654.03, stdev=33543.65 lat (usec): min=31, max=372161, avg=43660.71, stdev=33546.31 clat percentiles (usec): | 1.00th=[ 56], 5.00th=[ 71], 10.00th=[ 10814], 20.00th=[ 20579], | 30.00th=[ 25822], 40.00th=[ 31065], 50.00th=[ 36963], 60.00th=[ 43779], | 70.00th=[ 52691], 80.00th=[ 63177], 90.00th=[ 82314], 95.00th=[101188], | 99.00th=[164627], 99.50th=[183501], 99.90th=[316670], 99.95th=[371196], | 99.99th=[371196] bw ( KiB/s): min= 5, max= 111, per=25.46%, avg=44.56, stdev=21.46, samples=259 iops : min= 1, max= 27, avg=10.49, stdev= 5.41, samples=259 write: IOPS=11, BW=47.7KiB/s (48.9kB/s)(6348KiB/132964msec); 0 zone resets clat (usec): min=940, max=814826, avg=42618.87, stdev=49520.91 lat (usec): min=940, max=814829, avg=42622.44, stdev=49521.78 clat percentiles (usec): | 1.00th=[ 1156], 5.00th=[ 1336], 10.00th=[ 1713], 20.00th=[ 4883], | 30.00th=[ 9634], 40.00th=[ 19530], 50.00th=[ 30016], 60.00th=[ 40109], | 70.00th=[ 53740], 80.00th=[ 70779], 90.00th=[101188], 95.00th=[130548], | 99.00th=[187696], 99.50th=[212861], 99.90th=[591397], 99.95th=[817890], | 99.99th=[817890] bw ( KiB/s): min= 7, max= 117, per=25.73%, avg=47.34, stdev=23.10, samples=260 iops : min= 1, max= 29, avg=11.19, stdev= 5.84, samples=260 lat (usec) : 50=0.20%, 100=3.81%, 250=0.33%, 500=0.03%, 750=0.03% lat (usec) : 1000=0.10% lat (msec) : 2=5.83%, 4=3.42%, 10=6.74%, 20=9.51%, 50=37.14% lat (msec) : 100=24.93%, 250=7.71%, 500=0.16%, 750=0.03%, 1000=0.03% cpu : usr=0.09%, sys=5.05%, ctx=6484, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144881: Mon Aug 24 17:59:34 2026 read: IOPS=11, BW=44.5KiB/s (45.6kB/s)(6028KiB/135483msec) clat (usec): min=32, max=424300, avg=42554.95, stdev=32660.58 lat (usec): min=32, max=424301, avg=42559.92, stdev=32658.60 clat percentiles (usec): | 1.00th=[ 55], 5.00th=[ 70], 10.00th=[ 865], 20.00th=[ 20055], | 30.00th=[ 25297], 40.00th=[ 30540], 50.00th=[ 36439], 60.00th=[ 42206], | 70.00th=[ 51119], 80.00th=[ 63701], 90.00th=[ 82314], 95.00th=[103285], | 99.00th=[137364], 99.50th=[162530], 99.90th=[274727], 99.95th=[425722], | 99.99th=[425722] bw ( KiB/s): min= 7, max= 108, per=25.42%, avg=44.48, stdev=21.18, samples=263 iops : min= 1, max= 27, avg=10.47, stdev= 5.36, samples=263 write: IOPS=11, BW=46.2KiB/s (47.3kB/s)(6260KiB/135483msec); 0 zone resets clat (usec): min=905, max=790453, avg=45258.51, stdev=53739.86 lat (usec): min=906, max=790456, avg=45264.48, stdev=53740.14 clat percentiles (usec): | 1.00th=[ 1106], 5.00th=[ 1385], 10.00th=[ 1909], 20.00th=[ 4817], | 30.00th=[ 9765], 40.00th=[ 20841], 50.00th=[ 32113], 60.00th=[ 43254], | 70.00th=[ 56361], 80.00th=[ 76022], 90.00th=[105382], 95.00th=[135267], | 99.00th=[212861], 99.50th=[270533], 99.90th=[784335], 99.95th=[792724], | 99.99th=[792724] bw ( KiB/s): min= 7, max= 110, per=24.83%, avg=45.69, stdev=19.89, samples=266 iops : min= 1, max= 27, avg=10.77, stdev= 5.05, samples=266 lat (usec) : 50=0.33%, 100=4.00%, 250=0.42%, 500=0.03%, 750=0.07% lat (usec) : 1000=0.23% lat (msec) : 2=5.21%, 4=3.74%, 10=6.61%, 20=9.11%, 50=37.27% lat (msec) : 100=24.35%, 250=8.27%, 500=0.29%, 1000=0.07% cpu : usr=0.09%, sys=5.10%, ctx=6564, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144882: Mon Aug 24 17:59:34 2026 read: IOPS=11, BW=44.4KiB/s (45.4kB/s)(6052KiB/136451msec) clat (usec): min=29, max=361540, avg=43938.26, stdev=34551.96 lat (usec): min=29, max=361541, avg=43940.33, stdev=34551.93 clat percentiles (usec): | 1.00th=[ 52], 5.00th=[ 69], 10.00th=[ 4555], 20.00th=[ 19530], | 30.00th=[ 25035], 40.00th=[ 30802], 50.00th=[ 37487], 60.00th=[ 44303], | 70.00th=[ 53216], 80.00th=[ 65274], 90.00th=[ 84411], 95.00th=[106431], | 99.00th=[158335], 99.50th=[193987], 99.90th=[346031], 99.95th=[362808], | 99.99th=[362808] bw ( KiB/s): min= 7, max= 111, per=25.26%, avg=44.21, stdev=20.76, samples=264 iops : min= 1, max= 27, avg=10.39, stdev= 5.25, samples=264 write: IOPS=11, BW=45.7KiB/s (46.8kB/s)(6236KiB/136451msec); 0 zone resets clat (usec): min=886, max=1257.2k, avg=44546.36, stdev=54961.99 lat (usec): min=889, max=1257.2k, avg=44551.35, stdev=54963.38 clat percentiles (usec): | 1.00th=[ 1106], 5.00th=[ 1336], 10.00th=[ 1893], | 20.00th=[ 4752], 30.00th=[ 9896], 40.00th=[ 20841], | 50.00th=[ 32637], 60.00th=[ 44827], 70.00th=[ 58459], | 80.00th=[ 73925], 90.00th=[ 99091], 95.00th=[ 129500], | 99.00th=[ 210764], 99.50th=[ 254804], 99.90th=[ 379585], | 99.95th=[1249903], 99.99th=[1249903] bw ( KiB/s): min= 7, max= 131, per=24.72%, avg=45.48, stdev=20.14, samples=265 iops : min= 1, max= 32, avg=10.72, stdev= 5.09, samples=265 lat (usec) : 50=0.46%, 100=3.81%, 250=0.26%, 500=0.10%, 750=0.03% lat (usec) : 1000=0.10% lat (msec) : 2=5.60%, 4=3.84%, 10=6.38%, 20=9.64%, 50=35.32% lat (msec) : 100=26.50%, 250=7.58%, 500=0.36%, 2000=0.03% cpu : usr=0.09%, sys=5.06%, ctx=6557, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=176KiB/s (180kB/s), 44.2KiB/s-44.7KiB/s (45.3kB/s-45.7kB/s), io=23.4MiB (24.6MB), run=132964-136451msec WRITE: bw=184KiB/s (189kB/s), 45.7KiB/s-47.7KiB/s (46.8kB/s-48.9kB/s), io=24.6MiB (25.7MB), run=132964-136451msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144876: Mon Aug 24 18:02:01 2026 read: IOPS=5, BW=21.2KiB/s (21.7kB/s)(5992KiB/282791msec) clat (msec): min=5, max=882, avg=38.76, stdev=41.84 lat (msec): min=5, max=882, avg=38.77, stdev=41.85 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 15], | 30.00th=[ 19], 40.00th=[ 23], 50.00th=[ 27], 60.00th=[ 33], | 70.00th=[ 41], 80.00th=[ 54], 90.00th=[ 81], 95.00th=[ 107], | 99.00th=[ 184], 99.50th=[ 228], 99.90th=[ 368], 99.95th=[ 885], | 99.99th=[ 885] bw ( KiB/s): min= 7, max= 95, per=29.13%, avg=24.47, stdev=16.28, samples=473 iops : min= 1, max= 23, avg= 5.48, stdev= 4.11, samples=473 write: IOPS=5, BW=22.3KiB/s (22.8kB/s)(6296KiB/282791msec); 0 zone resets clat (msec): min=39, max=790, avg=142.45, stdev=73.26 lat (msec): min=39, max=790, avg=142.46, stdev=73.26 clat percentiles (msec): | 1.00th=[ 47], 5.00th=[ 62], 10.00th=[ 70], 20.00th=[ 85], | 30.00th=[ 99], 40.00th=[ 111], 50.00th=[ 126], 60.00th=[ 144], | 70.00th=[ 161], 80.00th=[ 188], 90.00th=[ 236], 95.00th=[ 284], | 99.00th=[ 397], 99.50th=[ 447], 99.90th=[ 558], 99.95th=[ 793], | 99.99th=[ 793] bw ( KiB/s): min= 7, max= 55, per=25.04%, avg=22.04, stdev=10.44, samples=549 iops : min= 1, max= 13, avg= 4.87, stdev= 2.68, samples=549 lat (msec) : 10=2.70%, 20=14.26%, 50=22.04%, 100=23.01%, 250=33.69% lat (msec) : 500=4.17%, 750=0.07%, 1000=0.07% cpu : usr=0.05%, sys=1.21%, ctx=5414, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144877: Mon Aug 24 18:02:01 2026 read: IOPS=5, BW=21.0KiB/s (21.5kB/s)(5940KiB/282260msec) clat (msec): min=5, max=971, avg=37.59, stdev=43.25 lat (msec): min=5, max=971, avg=37.59, stdev=43.25 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 14], | 30.00th=[ 18], 40.00th=[ 21], 50.00th=[ 26], 60.00th=[ 31], | 70.00th=[ 40], 80.00th=[ 53], 90.00th=[ 79], 95.00th=[ 108], | 99.00th=[ 188], 99.50th=[ 220], 99.90th=[ 414], 99.95th=[ 969], | 99.99th=[ 969] bw ( KiB/s): min= 7, max= 87, per=29.07%, avg=24.42, stdev=16.93, samples=469 iops : min= 1, max= 21, avg= 5.48, stdev= 4.28, samples=469 write: IOPS=5, BW=22.5KiB/s (23.0kB/s)(6348KiB/282260msec); 0 zone resets clat (msec): min=30, max=552, avg=142.37, stdev=72.48 lat (msec): min=30, max=552, avg=142.37, stdev=72.48 clat percentiles (msec): | 1.00th=[ 45], 5.00th=[ 61], 10.00th=[ 70], 20.00th=[ 87], | 30.00th=[ 100], 40.00th=[ 113], 50.00th=[ 126], 60.00th=[ 142], | 70.00th=[ 161], 80.00th=[ 186], 90.00th=[ 232], 95.00th=[ 292], | 99.00th=[ 405], 99.50th=[ 439], 99.90th=[ 542], 99.95th=[ 550], | 99.99th=[ 550] bw ( KiB/s): min= 7, max= 55, per=25.11%, avg=22.10, stdev=10.49, samples=552 iops : min= 1, max= 13, avg= 4.88, stdev= 2.69, samples=552 lat (msec) : 10=3.58%, 20=14.97%, 50=20.38%, 100=22.04%, 250=35.09% lat (msec) : 500=3.81%, 750=0.10%, 1000=0.03% cpu : usr=0.05%, sys=1.19%, ctx=5328, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144879: Mon Aug 24 18:02:01 2026 read: IOPS=5, BW=21.4KiB/s (21.9kB/s)(6028KiB/282006msec) clat (msec): min=5, max=372, avg=38.75, stdev=35.14 lat (msec): min=5, max=372, avg=38.75, stdev=35.14 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 15], | 30.00th=[ 19], 40.00th=[ 23], 50.00th=[ 28], 60.00th=[ 33], | 70.00th=[ 42], 80.00th=[ 56], 90.00th=[ 84], 95.00th=[ 106], | 99.00th=[ 167], 99.50th=[ 213], 99.90th=[ 359], 99.95th=[ 372], | 99.99th=[ 372] bw ( KiB/s): min= 7, max= 111, per=28.57%, avg=24.00, stdev=16.57, samples=484 iops : min= 1, max= 27, avg= 5.36, stdev= 4.19, samples=484 write: IOPS=5, BW=22.2KiB/s (22.7kB/s)(6260KiB/282006msec); 0 zone resets clat (msec): min=31, max=1052, avg=142.57, stdev=77.96 lat (msec): min=31, max=1052, avg=142.57, stdev=77.96 clat percentiles (msec): | 1.00th=[ 47], 5.00th=[ 61], 10.00th=[ 71], 20.00th=[ 85], | 30.00th=[ 99], 40.00th=[ 111], 50.00th=[ 125], 60.00th=[ 142], | 70.00th=[ 163], 80.00th=[ 186], 90.00th=[ 234], 95.00th=[ 288], | 99.00th=[ 405], 99.50th=[ 472], 99.90th=[ 793], 99.95th=[ 1053], | 99.99th=[ 1053] bw ( KiB/s): min= 7, max= 64, per=25.05%, avg=22.04, stdev=10.55, samples=545 iops : min= 1, max= 16, avg= 4.88, stdev= 2.70, samples=545 lat (msec) : 10=3.16%, 20=13.35%, 50=21.68%, 100=24.22%, 250=33.63% lat (msec) : 500=3.84%, 750=0.07%, 1000=0.03%, 2000=0.03% cpu : usr=0.05%, sys=1.21%, ctx=5289, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144880: Mon Aug 24 18:02:01 2026 read: IOPS=5, BW=21.5KiB/s (21.0kB/s)(6052KiB/281908msec) clat (msec): min=5, max=412, avg=37.00, stdev=36.19 lat (msec): min=5, max=412, avg=37.01, stdev=36.19 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 15], | 30.00th=[ 18], 40.00th=[ 22], 50.00th=[ 27], 60.00th=[ 32], | 70.00th=[ 40], 80.00th=[ 51], 90.00th=[ 74], 95.00th=[ 101], | 99.00th=[ 182], 99.50th=[ 243], 99.90th=[ 368], 99.95th=[ 414], | 99.99th=[ 414] bw ( KiB/s): min= 7, max= 87, per=29.66%, avg=24.92, stdev=17.31, samples=469 iops : min= 1, max= 21, avg= 5.60, stdev= 4.36, samples=469 write: IOPS=5, BW=22.1KiB/s (22.7kB/s)(6236KiB/281908msec); 0 zone resets clat (msec): min=32, max=1215, avg=144.59, stdev=76.68 lat (msec): min=32, max=1215, avg=144.59, stdev=76.68 clat percentiles (msec): | 1.00th=[ 45], 5.00th=[ 61], 10.00th=[ 71], 20.00th=[ 87], | 30.00th=[ 101], 40.00th=[ 114], 50.00th=[ 130], 60.00th=[ 146], | 70.00th=[ 165], 80.00th=[ 190], 90.00th=[ 232], 95.00th=[ 279], | 99.00th=[ 405], 99.50th=[ 472], 99.90th=[ 642], 99.95th=[ 1217], | 99.99th=[ 1217] bw ( KiB/s): min= 7, max= 64, per=24.89%, avg=21.90, stdev=10.27, samples=547 iops : min= 1, max= 16, avg= 4.84, stdev= 2.63, samples=547 lat (msec) : 10=3.16%, 20=14.75%, 50=22.69%, 100=21.06%, 250=34.18% lat (msec) : 500=4.07%, 750=0.07%, 2000=0.03% cpu : usr=0.05%, sys=1.18%, ctx=5288, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=84.9KiB/s (86.9kB/s), 21.0KiB/s-21.5KiB/s (21.5kB/s-21.0kB/s), io=23.4MiB (24.6MB), run=281908-282791msec WRITE: bw=88.9KiB/s (91.0kB/s), 22.1KiB/s-22.5KiB/s (22.7kB/s-23.0kB/s), io=24.6MiB (25.7MB), run=281908-282791msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144951: Mon Aug 24 18:02:48 2026 read: IOPS=11, BW=179KiB/s (183kB/s)(5920KiB/33156msec) clat (usec): min=34, max=188322, avg=44363.82, stdev=39831.08 lat (usec): min=34, max=188324, avg=44365.37, stdev=39831.10 clat percentiles (usec): | 1.00th=[ 44], 5.00th=[ 61], 10.00th=[ 70], 20.00th=[ 95], | 30.00th=[ 19530], 40.00th=[ 30278], 50.00th=[ 39060], 60.00th=[ 47449], | 70.00th=[ 59507], 80.00th=[ 74974], 90.00th=[ 95945], 95.00th=[124257], | 99.00th=[170918], 99.50th=[183501], 99.90th=[187696], 99.95th=[187696], | 99.99th=[187696] bw ( KiB/s): min= 27, max= 381, per=27.89%, avg=178.22, stdev=86.34, samples=64 iops : min= 1, max= 23, avg=10.41, stdev= 5.42, samples=64 write: IOPS=12, BW=192KiB/s (197kB/s)(6368KiB/33156msec); 0 zone resets clat (usec): min=1528, max=278346, avg=41194.61, stdev=45131.71 lat (usec): min=1531, max=278349, avg=41197.85, stdev=45131.60 clat percentiles (usec): | 1.00th=[ 1614], 5.00th=[ 1876], 10.00th=[ 3032], 20.00th=[ 7111], | 30.00th=[ 10683], 40.00th=[ 14615], 50.00th=[ 22938], 60.00th=[ 35914], | 70.00th=[ 53216], 80.00th=[ 71828], 90.00th=[103285], 95.00th=[129500], | 99.00th=[191890], 99.50th=[242222], 99.90th=[278922], 99.95th=[278922], | 99.99th=[278922] bw ( KiB/s): min= 62, max= 411, per=28.68%, avg=193.05, stdev=88.37, samples=64 iops : min= 3, max= 25, avg=11.34, stdev= 5.55, samples=64 lat (usec) : 50=0.91%, 100=8.98%, 250=1.43%, 500=0.13%, 750=0.26% lat (msec) : 2=3.39%, 4=3.12%, 10=8.98%, 20=11.98%, 50=26.17% lat (msec) : 100=24.87%, 250=9.64%, 500=0.13% cpu : usr=0.12%, sys=5.78%, ctx=1400, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144952: Mon Aug 24 18:02:48 2026 read: IOPS=9, BW=153KiB/s (157kB/s)(5744KiB/37444msec) clat (usec): min=25, max=319971, avg=47357.29, stdev=42804.39 lat (usec): min=25, max=319973, avg=47359.09, stdev=42804.33 clat percentiles (usec): | 1.00th=[ 42], 5.00th=[ 63], 10.00th=[ 70], 20.00th=[ 91], | 30.00th=[ 21365], 40.00th=[ 34341], 50.00th=[ 42206], 60.00th=[ 48497], | 70.00th=[ 63177], 80.00th=[ 82314], 90.00th=[105382], 95.00th=[124257], | 99.00th=[156238], 99.50th=[187696], 99.90th=[320865], 99.95th=[320865], | 99.99th=[320865] bw ( KiB/s): min= 22, max= 403, per=25.39%, avg=162.23, stdev=88.67, samples=69 iops : min= 1, max= 25, avg= 9.41, stdev= 5.61, samples=69 write: IOPS=10, BW=175KiB/s (179kB/s)(6544KiB/37444msec); 0 zone resets clat (usec): min=1371, max=323089, avg=48847.15, stdev=58561.19 lat (usec): min=1373, max=323091, avg=48850.26, stdev=58561.15 clat percentiles (usec): | 1.00th=[ 1680], 5.00th=[ 1827], 10.00th=[ 2376], 20.00th=[ 7046], | 30.00th=[ 11207], 40.00th=[ 18744], 50.00th=[ 28967], 60.00th=[ 38536], | 70.00th=[ 52691], 80.00th=[ 79168], 90.00th=[129500], 95.00th=[185598], | 99.00th=[263193], 99.50th=[270533], 99.90th=[325059], 99.95th=[325059], | 99.99th=[325059] bw ( KiB/s): min= 30, max= 479, per=26.29%, avg=176.93, stdev=102.11, samples=72 iops : min= 1, max= 29, avg=10.32, stdev= 6.46, samples=72 lat (usec) : 50=0.78%, 100=9.24%, 250=0.65%, 500=0.26%, 1000=0.26% lat (msec) : 2=4.95%, 4=2.99%, 10=7.42%, 20=8.85%, 50=30.34% lat (msec) : 100=21.74%, 250=11.33%, 500=1.17% cpu : usr=0.09%, sys=5.12%, ctx=1456, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144954: Mon Aug 24 18:02:48 2026 read: IOPS=11, BW=181KiB/s (186kB/s)(6256KiB/34483msec) clat (usec): min=39, max=447884, avg=48121.15, stdev=46742.07 lat (usec): min=39, max=447886, avg=48122.94, stdev=46742.42 clat percentiles (usec): | 1.00th=[ 43], 5.00th=[ 62], 10.00th=[ 68], 20.00th=[ 98], | 30.00th=[ 26870], 40.00th=[ 34341], 50.00th=[ 42206], 60.00th=[ 50594], | 70.00th=[ 60031], 80.00th=[ 73925], 90.00th=[ 99091], 95.00th=[117965], | 99.00th=[270533], 99.50th=[329253], 99.90th=[446694], 99.95th=[446694], | 99.99th=[446694] bw ( KiB/s): min= 31, max= 382, per=28.98%, avg=185.17, stdev=78.06, samples=66 iops : min= 1, max= 23, avg=10.83, stdev= 4.90, samples=66 write: IOPS=10, BW=175KiB/s (179kB/s)(6032KiB/34483msec); 0 zone resets clat (usec): min=1401, max=248281, avg=40934.80, stdev=41990.20 lat (usec): min=1402, max=248282, avg=40937.21, stdev=41990.12 clat percentiles (usec): | 1.00th=[ 1614], 5.00th=[ 1844], 10.00th=[ 2040], 20.00th=[ 5800], | 30.00th=[ 9765], 40.00th=[ 15926], 50.00th=[ 29230], 60.00th=[ 38536], | 70.00th=[ 55313], 80.00th=[ 72877], 90.00th=[ 99091], 95.00th=[117965], | 99.00th=[179307], 99.50th=[223347], 99.90th=[248513], 99.95th=[248513], | 99.99th=[248513] bw ( KiB/s): min= 31, max= 541, per=26.26%, avg=176.74, stdev=88.25, samples=66 iops : min= 1, max= 33, avg=10.30, stdev= 5.53, samples=66 lat (usec) : 50=1.30%, 100=8.98%, 250=0.52%, 500=0.13%, 750=0.13% lat (usec) : 1000=0.26% lat (msec) : 2=4.43%, 4=2.73%, 10=7.81%, 20=7.55%, 50=29.56% lat (msec) : 100=27.21%, 250=8.85%, 500=0.52% cpu : usr=0.09%, sys=5.34%, ctx=1452, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144955: Mon Aug 24 18:02:48 2026 read: IOPS=11, BW=185KiB/s (189kB/s)(6032KiB/32688msec) clat (usec): min=36, max=259760, avg=46339.71, stdev=39509.58 lat (usec): min=36, max=259760, avg=46341.19, stdev=39509.55 clat percentiles (usec): | 1.00th=[ 39], 5.00th=[ 57], 10.00th=[ 68], 20.00th=[ 91], | 30.00th=[ 23987], 40.00th=[ 35914], 50.00th=[ 44303], 60.00th=[ 52167], | 70.00th=[ 61080], 80.00th=[ 71828], 90.00th=[ 96994], 95.00th=[119014], | 99.00th=[164627], 99.50th=[233833], 99.90th=[258999], 99.95th=[258999], | 99.99th=[258999] bw ( KiB/s): min= 31, max= 416, per=29.26%, avg=187.00, stdev=75.46, samples=62 iops : min= 1, max= 26, avg=10.95, stdev= 4.81, samples=62 write: IOPS=11, BW=191KiB/s (196kB/s)(6256KiB/32688msec); 0 zone resets clat (usec): min=1533, max=267163, avg=38707.85, stdev=44836.64 lat (usec): min=1535, max=267163, avg=38710.53, stdev=44836.71 clat percentiles (usec): | 1.00th=[ 1565], 5.00th=[ 1778], 10.00th=[ 2040], 20.00th=[ 4686], | 30.00th=[ 8848], 40.00th=[ 15664], 50.00th=[ 22676], 60.00th=[ 31065], | 70.00th=[ 47973], 80.00th=[ 68682], 90.00th=[ 92799], 95.00th=[126354], | 99.00th=[238027], 99.50th=[240124], 99.90th=[267387], 99.95th=[267387], | 99.99th=[267387] bw ( KiB/s): min= 30, max= 350, per=28.47%, avg=191.59, stdev=75.23, samples=63 iops : min= 1, max= 21, avg=11.24, stdev= 4.75, samples=63 lat (usec) : 50=1.69%, 100=8.46%, 250=1.17%, 500=0.13% lat (msec) : 2=4.95%, 4=4.43%, 10=7.55%, 20=8.46%, 50=26.95% lat (msec) : 100=27.34%, 250=8.59%, 500=0.26% cpu : usr=0.08%, sys=5.57%, ctx=1358, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=640KiB/s (655kB/s), 153KiB/s-185KiB/s (157kB/s-189kB/s), io=23.4MiB (24.5MB), run=32688-37444msec WRITE: bw=673KiB/s (689kB/s), 175KiB/s-192KiB/s (179kB/s-197kB/s), io=24.6MiB (25.8MB), run=32688-37444msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144953: Mon Aug 24 18:03:24 2026 read: IOPS=5, BW=81.1KiB/s (83.1kB/s)(5920KiB/72966msec) clat (msec): min=6, max=361, avg=43.18, stdev=50.11 lat (msec): min=6, max=361, avg=43.18, stdev=50.11 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 12], 20.00th=[ 15], | 30.00th=[ 18], 40.00th=[ 21], 50.00th=[ 24], 60.00th=[ 30], | 70.00th=[ 41], 80.00th=[ 58], 90.00th=[ 97], 95.00th=[ 132], | 99.00th=[ 279], 99.50th=[ 338], 99.90th=[ 363], 99.95th=[ 363], | 99.99th=[ 363] bw ( KiB/s): min= 29, max= 316, per=29.04%, avg=94.39, stdev=61.48, samples=122 iops : min= 1, max= 19, avg= 5.18, stdev= 3.95, samples=122 write: IOPS=5, BW=87.3KiB/s (89.4kB/s)(6368KiB/72966msec); 0 zone resets clat (msec): min=37, max=679, avg=142.38, stdev=86.83 lat (msec): min=37, max=679, avg=142.38, stdev=86.83 clat percentiles (msec): | 1.00th=[ 47], 5.00th=[ 58], 10.00th=[ 66], 20.00th=[ 80], | 30.00th=[ 89], 40.00th=[ 101], 50.00th=[ 112], 60.00th=[ 129], | 70.00th=[ 157], 80.00th=[ 199], 90.00th=[ 268], 95.00th=[ 321], | 99.00th=[ 439], 99.50th=[ 489], 99.90th=[ 684], 99.95th=[ 684], | 99.99th=[ 684] bw ( KiB/s): min= 29, max= 223, per=26.40%, avg=90.28, stdev=49.43, samples=138 iops : min= 1, max= 13, avg= 4.88, stdev= 3.17, samples=138 lat (msec) : 10=2.08%, 20=16.41%, 50=19.14%, 100=26.69%, 250=28.91% lat (msec) : 500=6.64%, 750=0.13% cpu : usr=0.06%, sys=1.17%, ctx=1323, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144956: Mon Aug 24 18:03:24 2026 read: IOPS=4, BW=78.1KiB/s (79.9kB/s)(5744KiB/73584msec) clat (msec): min=5, max=310, avg=41.37, stdev=45.90 lat (msec): min=5, max=310, avg=41.37, stdev=45.90 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 15], | 30.00th=[ 17], 40.00th=[ 20], 50.00th=[ 24], 60.00th=[ 30], | 70.00th=[ 38], 80.00th=[ 55], 90.00th=[ 102], 95.00th=[ 136], | 99.00th=[ 236], 99.50th=[ 292], 99.90th=[ 309], 99.95th=[ 309], | 99.99th=[ 309] bw ( KiB/s): min= 21, max= 408, per=28.28%, avg=91.90, stdev=68.37, samples=121 iops : min= 1, max= 25, avg= 5.00, stdev= 4.36, samples=121 write: IOPS=5, BW=88.9KiB/s (91.1kB/s)(6544KiB/73584msec); 0 zone resets clat (msec): min=26, max=705, avg=143.38, stdev=90.99 lat (msec): min=26, max=705, avg=143.39, stdev=90.99 clat percentiles (msec): | 1.00th=[ 47], 5.00th=[ 58], 10.00th=[ 66], 20.00th=[ 80], | 30.00th=[ 91], 40.00th=[ 102], 50.00th=[ 115], 60.00th=[ 130], | 70.00th=[ 148], 80.00th=[ 194], 90.00th=[ 271], 95.00th=[ 330], | 99.00th=[ 481], 99.50th=[ 506], 99.90th=[ 709], 99.95th=[ 709], | 99.99th=[ 709] bw ( KiB/s): min= 30, max= 223, per=26.03%, avg=89.02, stdev=49.55, samples=142 iops : min= 1, max= 13, avg= 4.80, stdev= 3.21, samples=142 lat (msec) : 10=2.47%, 20=16.67%, 50=17.06%, 100=26.95%, 250=29.43% lat (msec) : 500=7.03%, 750=0.39% cpu : usr=0.05%, sys=1.14%, ctx=1328, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144957: Mon Aug 24 18:03:24 2026 read: IOPS=5, BW=88.6KiB/s (90.7kB/s)(6256KiB/70642msec) clat (msec): min=6, max=427, avg=42.02, stdev=49.75 lat (msec): min=6, max=427, avg=42.02, stdev=49.75 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 16], | 30.00th=[ 19], 40.00th=[ 22], 50.00th=[ 26], 60.00th=[ 30], | 70.00th=[ 38], 80.00th=[ 48], 90.00th=[ 101], 95.00th=[ 148], | 99.00th=[ 279], 99.50th=[ 313], 99.90th=[ 430], 99.95th=[ 430], | 99.99th=[ 430] bw ( KiB/s): min= 29, max= 380, per=32.10%, avg=104.31, stdev=75.14, samples=118 iops : min= 1, max= 23, avg= 5.77, stdev= 4.80, samples=118 write: IOPS=5, BW=85.4KiB/s (87.4kB/s)(6032KiB/70642msec); 0 zone resets clat (msec): min=31, max=671, avg=143.01, stdev=89.74 lat (msec): min=31, max=671, avg=143.01, stdev=89.74 clat percentiles (msec): | 1.00th=[ 45], 5.00th=[ 57], 10.00th=[ 66], 20.00th=[ 80], | 30.00th=[ 89], 40.00th=[ 100], 50.00th=[ 113], 60.00th=[ 128], | 70.00th=[ 157], 80.00th=[ 203], 90.00th=[ 271], 95.00th=[ 334], | 99.00th=[ 418], 99.50th=[ 575], 99.90th=[ 676], 99.95th=[ 676], | 99.99th=[ 676] bw ( KiB/s): min= 21, max= 223, per=25.71%, avg=87.92, stdev=47.50, samples=133 iops : min= 1, max= 13, avg= 4.74, stdev= 3.06, samples=133 lat (msec) : 10=2.86%, 20=15.76%, 50=24.09%, 100=23.31%, 250=27.34% lat (msec) : 500=6.25%, 750=0.39% cpu : usr=0.05%, sys=1.22%, ctx=1369, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144958: Mon Aug 24 18:03:24 2026 read: IOPS=5, BW=82.5KiB/s (84.5kB/s)(6032KiB/73123msec) clat (msec): min=5, max=417, avg=43.88, stdev=53.46 lat (msec): min=5, max=417, avg=43.89, stdev=53.46 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 15], | 30.00th=[ 18], 40.00th=[ 21], 50.00th=[ 26], 60.00th=[ 29], | 70.00th=[ 37], 80.00th=[ 56], 90.00th=[ 112], 95.00th=[ 155], | 99.00th=[ 259], 99.50th=[ 388], 99.90th=[ 418], 99.95th=[ 418], | 99.99th=[ 418] bw ( KiB/s): min= 29, max= 350, per=29.93%, avg=97.28, stdev=66.11, samples=120 iops : min= 1, max= 21, avg= 5.32, stdev= 4.22, samples=120 write: IOPS=5, BW=85.6KiB/s (87.6kB/s)(6256KiB/73123msec); 0 zone resets clat (msec): min=32, max=536, avg=143.72, stdev=84.01 lat (msec): min=32, max=536, avg=143.72, stdev=84.01 clat percentiles (msec): | 1.00th=[ 49], 5.00th=[ 62], 10.00th=[ 72], 20.00th=[ 84], | 30.00th=[ 91], 40.00th=[ 101], 50.00th=[ 111], 60.00th=[ 131], | 70.00th=[ 161], 80.00th=[ 201], 90.00th=[ 271], 95.00th=[ 300], | 99.00th=[ 447], 99.50th=[ 523], 99.90th=[ 535], 99.95th=[ 535], | 99.99th=[ 535] bw ( KiB/s): min= 22, max= 191, per=25.76%, avg=88.09, stdev=46.36, samples=138 iops : min= 1, max= 11, avg= 4.75, stdev= 2.98, samples=138 lat (msec) : 10=3.26%, 20=15.76%, 50=20.70%, 100=24.48%, 250=29.30% lat (msec) : 500=6.12%, 750=0.39% cpu : usr=0.06%, sys=1.25%, ctx=1285, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=326KiB/s (333kB/s), 78.1KiB/s-88.6KiB/s (79.9kB/s-90.7kB/s), io=23.4MiB (24.5MB), run=70642-73584msec WRITE: bw=342KiB/s (351kB/s), 85.4KiB/s-88.9KiB/s (87.4kB/s-91.1kB/s), io=24.6MiB (25.8MB), run=70642-73584msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144978: Mon Aug 24 18:03:42 2026 read: IOPS=1, BW=1990KiB/s (2038kB/s)(7168KiB/3602msec) clat (usec): min=534, max=1067.9k, avg=313681.27, stdev=346688.20 lat (usec): min=535, max=1067.9k, avg=313682.72, stdev=346688.24 clat percentiles (usec): | 1.00th=[ 537], 5.00th=[ 537], 10.00th=[ 537], | 20.00th=[ 179307], 30.00th=[ 187696], 40.00th=[ 187696], | 50.00th=[ 210764], 60.00th=[ 217056], 70.00th=[ 217056], | 80.00th=[ 333448], 90.00th=[1069548], 95.00th=[1069548], | 99.00th=[1069548], 99.50th=[1069548], 99.90th=[1069548], | 99.95th=[1069548], 99.99th=[1069548] bw ( KiB/s): min= 1976, max= 2892, per=57.36%, avg=2190.60, stdev=392.81, samples=5 iops : min= 1, max= 2, avg= 1.20, stdev= 0.45, samples=5 write: IOPS=1, BW=1421KiB/s (1456kB/s)(5120KiB/3602msec); 0 zone resets clat (msec): min=137, max=470, avg=274.04, stdev=122.44 lat (msec): min=137, max=470, avg=274.10, stdev=122.42 clat percentiles (msec): | 1.00th=[ 138], 5.00th=[ 138], 10.00th=[ 138], 20.00th=[ 138], | 30.00th=[ 226], 40.00th=[ 226], 50.00th=[ 253], 60.00th=[ 253], | 70.00th=[ 284], 80.00th=[ 284], 90.00th=[ 472], 95.00th=[ 472], | 99.00th=[ 472], 99.50th=[ 472], 99.90th=[ 472], 99.95th=[ 472], | 99.99th=[ 472] bw ( KiB/s): min= 2019, max= 4079, per=50.65%, avg=2708.33, stdev=1187.04, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (usec) : 750=8.33% lat (msec) : 250=50.00%, 500=33.33%, 2000=8.33% cpu : usr=0.00%, sys=13.55%, ctx=278, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144979: Mon Aug 24 18:03:42 2026 read: IOPS=0, BW=382KiB/s (391kB/s)(2048KiB/5362msec) clat (msec): min=175, max=258, avg=217.17, stdev=58.31 lat (msec): min=175, max=258, avg=217.17, stdev=58.31 clat percentiles (msec): | 1.00th=[ 176], 5.00th=[ 176], 10.00th=[ 176], 20.00th=[ 176], | 30.00th=[ 176], 40.00th=[ 176], 50.00th=[ 176], 60.00th=[ 259], | 70.00th=[ 259], 80.00th=[ 259], 90.00th=[ 259], 95.00th=[ 259], | 99.00th=[ 259], 99.50th=[ 259], 99.90th=[ 259], 99.95th=[ 259], | 99.99th=[ 259] bw ( KiB/s): min= 1575, max= 1996, per=46.75%, avg=1785.50, stdev=297.69, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1910KiB/s (1956kB/s)(10.0MiB/5362msec); 0 zone resets clat (msec): min=89, max=920, avg=488.24, stdev=268.00 lat (msec): min=89, max=920, avg=488.54, stdev=268.11 clat percentiles (msec): | 1.00th=[ 90], 5.00th=[ 90], 10.00th=[ 90], 20.00th=[ 153], | 30.00th=[ 275], 40.00th=[ 393], 50.00th=[ 426], 60.00th=[ 609], | 70.00th=[ 625], 80.00th=[ 625], 90.00th=[ 760], 95.00th=[ 919], | 99.00th=[ 919], 99.50th=[ 919], 99.90th=[ 919], 99.95th=[ 919], | 99.99th=[ 919] bw ( KiB/s): min= 1996, max= 4039, per=43.27%, avg=2313.43, stdev=761.04, samples=7 iops : min= 1, max= 3, avg= 1.29, stdev= 0.76, samples=7 lat (msec) : 100=8.33%, 250=16.67%, 500=33.33%, 750=25.00%, 1000=16.67% cpu : usr=0.00%, sys=10.80%, ctx=245, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144983: Mon Aug 24 18:03:42 2026 read: IOPS=1, BW=1742KiB/s (1784kB/s)(6144KiB/3526msec) clat (usec): min=563, max=206692, avg=53555.84, stdev=87262.78 lat (usec): min=565, max=206693, avg=53557.19, stdev=87262.50 clat percentiles (usec): | 1.00th=[ 562], 5.00th=[ 562], 10.00th=[ 562], 20.00th=[ 611], | 30.00th=[ 611], 40.00th=[ 611], 50.00th=[ 611], 60.00th=[ 791], | 70.00th=[111674], 80.00th=[111674], 90.00th=[206570], 95.00th=[206570], | 99.00th=[206570], 99.50th=[206570], 99.90th=[206570], 99.95th=[206570], | 99.99th=[206570] bw ( KiB/s): min= 4055, max= 6119, per=100.00%, avg=5087.00, stdev=1459.47, samples=2 iops : min= 3, max= 5, avg= 4.00, stdev= 1.41, samples=2 write: IOPS=1, BW=1742KiB/s (1784kB/s)(6144KiB/3526msec); 0 zone resets clat (msec): min=270, max=1137, avg=520.62, stdev=318.92 lat (msec): min=270, max=1137, avg=520.94, stdev=318.84 clat percentiles (msec): | 1.00th=[ 271], 5.00th=[ 271], 10.00th=[ 271], 20.00th=[ 296], | 30.00th=[ 296], 40.00th=[ 409], 50.00th=[ 409], 60.00th=[ 477], | 70.00th=[ 535], 80.00th=[ 535], 90.00th=[ 1133], 95.00th=[ 1133], | 99.00th=[ 1133], 99.50th=[ 1133], 99.90th=[ 1133], 99.95th=[ 1133], | 99.99th=[ 1133] bw ( KiB/s): min= 2019, max= 4071, per=47.48%, avg=2539.00, stdev=1021.37, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (usec) : 750=25.00%, 1000=8.33% lat (msec) : 250=16.67%, 500=33.33%, 750=8.33%, 2000=8.33% cpu : usr=0.00%, sys=13.53%, ctx=113, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144984: Mon Aug 24 18:03:42 2026 read: IOPS=1, BW=1215KiB/s (1244kB/s)(5120KiB/4215msec) clat (usec): min=479, max=192102, avg=42129.05, stdev=84130.21 lat (usec): min=481, max=192102, avg=42130.16, stdev=84129.95 clat percentiles (usec): | 1.00th=[ 482], 5.00th=[ 482], 10.00th=[ 482], 20.00th=[ 482], | 30.00th=[ 529], 40.00th=[ 529], 50.00th=[ 758], 60.00th=[ 758], | 70.00th=[ 16909], 80.00th=[ 16909], 90.00th=[191890], 95.00th=[191890], | 99.00th=[191890], 99.50th=[191890], 99.90th=[191890], 99.95th=[191890], | 99.99th=[191890] bw ( KiB/s): min= 8143, max= 8143, per=100.00%, avg=8143.00, stdev= 0.00, samples=1 iops : min= 7, max= 7, avg= 7.00, stdev= 0.00, samples=1 write: IOPS=1, BW=1701KiB/s (1741kB/s)(7168KiB/4215msec); 0 zone resets clat (msec): min=70, max=1229, avg=561.77, stdev=510.55 lat (msec): min=71, max=1229, avg=561.98, stdev=510.70 clat percentiles (msec): | 1.00th=[ 71], 5.00th=[ 71], 10.00th=[ 71], 20.00th=[ 106], | 30.00th=[ 163], 40.00th=[ 163], 50.00th=[ 326], 60.00th=[ 894], | 70.00th=[ 894], 80.00th=[ 1150], 90.00th=[ 1234], 95.00th=[ 1234], | 99.00th=[ 1234], 99.50th=[ 1234], 99.90th=[ 1234], 99.95th=[ 1234], | 99.99th=[ 1234] bw ( KiB/s): min= 1996, max= 6107, per=56.93%, avg=3044.25, stdev=2041.93, samples=4 iops : min= 1, max= 5, avg= 2.00, stdev= 2.00, samples=4 lat (usec) : 500=8.33%, 750=8.33%, 1000=8.33% lat (msec) : 20=8.33%, 100=8.33%, 250=25.00%, 500=8.33%, 1000=8.33% lat (msec) : 2000=16.67% cpu : usr=0.00%, sys=8.59%, ctx=99, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3819KiB/s (3911kB/s), 382KiB/s-1990KiB/s (391kB/s-2038kB/s), io=20.0MiB (20.0MB), run=3526-5362msec WRITE: bw=5347KiB/s (5476kB/s), 1421KiB/s-1910KiB/s (1456kB/s-1956kB/s), io=28.0MiB (29.4MB), run=3526-5362msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144980: Mon Aug 24 18:03:42 2026 read: IOPS=1, BW=1390KiB/s (1423kB/s)(7168KiB/5157msec) clat (msec): min=62, max=1063, avg=426.81, stdev=395.29 lat (msec): min=62, max=1063, avg=426.92, stdev=395.23 clat percentiles (msec): | 1.00th=[ 63], 5.00th=[ 63], 10.00th=[ 63], 20.00th=[ 93], | 30.00th=[ 213], 40.00th=[ 213], 50.00th=[ 284], 60.00th=[ 380], | 70.00th=[ 380], 80.00th=[ 894], 90.00th=[ 1062], 95.00th=[ 1062], | 99.00th=[ 1062], 99.50th=[ 1062], 99.90th=[ 1062], 99.95th=[ 1062], | 99.99th=[ 1062] bw ( KiB/s): min= 1750, max= 2048, per=53.87%, avg=1973.83, stdev=110.82, samples=6 iops : min= 1, max= 2, avg= 1.17, stdev= 0.41, samples=6 write: IOPS=0, BW=993KiB/s (1017kB/s)(5120KiB/5157msec); 0 zone resets clat (msec): min=308, max=604, avg=403.86, stdev=126.64 lat (msec): min=309, max=604, avg=403.96, stdev=126.62 clat percentiles (msec): | 1.00th=[ 309], 5.00th=[ 309], 10.00th=[ 309], 20.00th=[ 309], | 30.00th=[ 321], 40.00th=[ 321], 50.00th=[ 330], 60.00th=[ 330], | 70.00th=[ 456], 80.00th=[ 456], 90.00th=[ 609], 95.00th=[ 609], | 99.00th=[ 609], 99.50th=[ 609], 99.90th=[ 609], 99.95th=[ 609], | 99.99th=[ 609] bw ( KiB/s): min= 2027, max= 4039, per=49.45%, avg=2537.00, stdev=1001.36, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (msec) : 100=16.67%, 250=8.33%, 500=50.00%, 750=8.33%, 1000=8.33% lat (msec) : 2000=8.33% cpu : usr=0.00%, sys=3.86%, ctx=71, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144981: Mon Aug 24 18:03:42 2026 read: IOPS=0, BW=387KiB/s (396kB/s)(2048KiB/5292msec) clat (msec): min=132, max=199, avg=165.71, stdev=47.57 lat (msec): min=132, max=199, avg=165.71, stdev=47.57 clat percentiles (msec): | 1.00th=[ 132], 5.00th=[ 132], 10.00th=[ 132], 20.00th=[ 132], | 30.00th=[ 132], 40.00th=[ 132], 50.00th=[ 132], 60.00th=[ 201], | 70.00th=[ 201], 80.00th=[ 201], 90.00th=[ 201], 95.00th=[ 201], | 99.00th=[ 201], 99.50th=[ 201], 99.90th=[ 201], 99.95th=[ 201], | 99.99th=[ 201] bw ( KiB/s): min= 1481, max= 2015, per=47.71%, avg=1748.00, stdev=377.60, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1935KiB/s (1981kB/s)(10.0MiB/5292msec); 0 zone resets clat (msec): min=251, max=1003, avg=491.82, stdev=242.03 lat (msec): min=252, max=1003, avg=491.96, stdev=241.99 clat percentiles (msec): | 1.00th=[ 253], 5.00th=[ 253], 10.00th=[ 253], 20.00th=[ 284], | 30.00th=[ 288], 40.00th=[ 368], 50.00th=[ 372], 60.00th=[ 401], | 70.00th=[ 600], 80.00th=[ 642], 90.00th=[ 718], 95.00th=[ 1003], | 99.00th=[ 1003], 99.50th=[ 1003], 99.90th=[ 1003], 99.95th=[ 1003], | 99.99th=[ 1003] bw ( KiB/s): min= 2011, max= 4079, per=50.70%, avg=2601.00, stdev=983.03, samples=7 iops : min= 1, max= 3, avg= 1.71, stdev= 0.95, samples=7 lat (msec) : 250=16.67%, 500=50.00%, 750=25.00%, 2000=8.33% cpu : usr=0.02%, sys=3.46%, ctx=61, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144982: Mon Aug 24 18:03:42 2026 read: IOPS=1, BW=1217KiB/s (1246kB/s)(6144KiB/5049msec) clat (msec): min=79, max=390, avg=215.15, stdev=113.88 lat (msec): min=79, max=390, avg=215.15, stdev=113.88 clat percentiles (msec): | 1.00th=[ 80], 5.00th=[ 80], 10.00th=[ 80], 20.00th=[ 150], | 30.00th=[ 150], 40.00th=[ 157], 50.00th=[ 157], 60.00th=[ 211], | 70.00th=[ 305], 80.00th=[ 305], 90.00th=[ 393], 95.00th=[ 393], | 99.00th=[ 393], 99.50th=[ 393], 99.90th=[ 393], 99.95th=[ 393], | 99.99th=[ 393] bw ( KiB/s): min= 2011, max= 4055, per=73.52%, avg=2693.67, stdev=1178.95, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 write: IOPS=1, BW=1217KiB/s (1246kB/s)(6144KiB/5049msec); 0 zone resets clat (msec): min=261, max=1345, avg=605.11, stdev=450.09 lat (msec): min=261, max=1345, avg=605.21, stdev=450.07 clat percentiles (msec): | 1.00th=[ 262], 5.00th=[ 262], 10.00th=[ 262], 20.00th=[ 271], | 30.00th=[ 271], 40.00th=[ 309], 50.00th=[ 309], 60.00th=[ 477], | 70.00th=[ 969], 80.00th=[ 969], 90.00th=[ 1351], 95.00th=[ 1351], | 99.00th=[ 1351], 99.50th=[ 1351], 99.90th=[ 1351], 99.95th=[ 1351], | 99.99th=[ 1351] bw ( KiB/s): min= 2011, max= 4000, per=49.11%, avg=2519.25, stdev=987.23, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (msec) : 100=8.33%, 250=25.00%, 500=50.00%, 1000=8.33%, 2000=8.33% cpu : usr=0.00%, sys=4.14%, ctx=125, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144985: Mon Aug 24 18:03:42 2026 read: IOPS=0, BW=916KiB/s (938kB/s)(5120KiB/5588msec) clat (msec): min=76, max=402, avg=190.58, stdev=129.95 lat (msec): min=76, max=402, avg=190.58, stdev=129.95 clat percentiles (msec): | 1.00th=[ 77], 5.00th=[ 77], 10.00th=[ 77], 20.00th=[ 77], | 30.00th=[ 101], 40.00th=[ 101], 50.00th=[ 161], 60.00th=[ 161], | 70.00th=[ 213], 80.00th=[ 213], 90.00th=[ 401], 95.00th=[ 401], | 99.00th=[ 401], 99.50th=[ 401], 99.90th=[ 401], 99.95th=[ 401], | 99.99th=[ 401] bw ( KiB/s): min= 2015, max= 4055, per=73.77%, avg=2703.00, stdev=1170.93, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 write: IOPS=1, BW=1283KiB/s (1314kB/s)(7168KiB/5588msec); 0 zone resets clat (msec): min=169, max=1226, avg=656.80, stdev=371.79 lat (msec): min=170, max=1226, avg=657.12, stdev=371.65 clat percentiles (msec): | 1.00th=[ 171], 5.00th=[ 171], 10.00th=[ 171], 20.00th=[ 430], | 30.00th=[ 451], 40.00th=[ 451], 50.00th=[ 609], 60.00th=[ 642], | 70.00th=[ 642], 80.00th=[ 1070], 90.00th=[ 1234], 95.00th=[ 1234], | 99.00th=[ 1234], 99.50th=[ 1234], 99.90th=[ 1234], 99.95th=[ 1234], | 99.99th=[ 1234] bw ( KiB/s): min= 1597, max= 2048, per=37.78%, avg=1938.00, stdev=191.18, samples=5 iops : min= 1, max= 2, avg= 1.20, stdev= 0.45, samples=5 lat (msec) : 100=8.33%, 250=33.33%, 500=25.00%, 750=16.67%, 2000=16.67% cpu : usr=0.00%, sys=3.29%, ctx=66, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3665KiB/s (3753kB/s), 387KiB/s-1390KiB/s (396kB/s-1423kB/s), io=20.0MiB (20.0MB), run=5049-5588msec WRITE: bw=5131KiB/s (5254kB/s), 993KiB/s-1935KiB/s (1017kB/s-1981kB/s), io=28.0MiB (29.4MB), run=5049-5588msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144996: Mon Aug 24 18:03:57 2026 read: IOPS=1, BW=4813KiB/s (4929kB/s)(12.0MiB/2553msec) clat (msec): min=808, max=902, avg=850.49, stdev=48.03 lat (msec): min=808, max=902, avg=850.50, stdev=48.03 clat percentiles (msec): | 1.00th=[ 810], 5.00th=[ 810], 10.00th=[ 810], 20.00th=[ 810], | 30.00th=[ 810], 40.00th=[ 844], 50.00th=[ 844], 60.00th=[ 844], | 70.00th=[ 902], 80.00th=[ 902], 90.00th=[ 902], 95.00th=[ 902], | 99.00th=[ 902], 99.50th=[ 902], 99.90th=[ 902], 99.95th=[ 902], | 99.99th=[ 902] bw ( KiB/s): min= 7968, max= 8062, per=100.00%, avg=8015.00, stdev=66.47, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=100.00% cpu : usr=0.00%, sys=13.68%, ctx=261, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144997: Mon Aug 24 18:03:57 2026 read: IOPS=0, BW=1593KiB/s (1631kB/s)(4096KiB/2571msec) clat (nsec): min=954401k, max=954401k, avg=954400762.00, stdev= 0.00 lat (nsec): min=954403k, max=954403k, avg=954402817.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 953], 5.00th=[ 953], 10.00th=[ 953], 20.00th=[ 953], | 30.00th=[ 953], 40.00th=[ 953], 50.00th=[ 953], 60.00th=[ 953], | 70.00th=[ 953], 80.00th=[ 953], 90.00th=[ 953], 95.00th=[ 953], | 99.00th=[ 953], 99.50th=[ 953], 99.90th=[ 953], 99.95th=[ 953], | 99.99th=[ 953] bw ( KiB/s): min= 8031, max= 8031, per=100.00%, avg=8031.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=3186KiB/s (3263kB/s)(8192KiB/2571msec); 0 zone resets clat (msec): min=505, max=1108, avg=807.03, stdev=426.23 lat (msec): min=506, max=1108, avg=807.69, stdev=425.98 clat percentiles (msec): | 1.00th=[ 506], 5.00th=[ 506], 10.00th=[ 506], 20.00th=[ 506], | 30.00th=[ 506], 40.00th=[ 506], 50.00th=[ 506], 60.00th=[ 1116], | 70.00th=[ 1116], 80.00th=[ 1116], 90.00th=[ 1116], 95.00th=[ 1116], | 99.00th=[ 1116], 99.50th=[ 1116], 99.90th=[ 1116], 99.95th=[ 1116], | 99.99th=[ 1116] bw ( KiB/s): min= 8078, max= 8078, per=93.12%, avg=8078.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=6.30%, ctx=160, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144998: Mon Aug 24 18:03:57 2026 write: IOPS=0, BW=3253KiB/s (3331kB/s)(12.0MiB/3777msec); 0 zone resets clat (msec): min=519, max=2026, avg=1255.87, stdev=753.83 lat (msec): min=520, max=2030, avg=1257.61, stdev=755.44 clat percentiles (msec): | 1.00th=[ 518], 5.00th=[ 518], 10.00th=[ 518], 20.00th=[ 518], | 30.00th=[ 518], 40.00th=[ 1217], 50.00th=[ 1217], 60.00th=[ 1217], | 70.00th=[ 2022], 80.00th=[ 2022], 90.00th=[ 2022], 95.00th=[ 2022], | 99.00th=[ 2022], 99.50th=[ 2022], 99.90th=[ 2022], 99.95th=[ 2022], | 99.99th=[ 2022] bw ( KiB/s): min= 7816, max= 8126, per=91.88%, avg=7971.00, stdev=219.20, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=3.02%, ctx=49, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144999: Mon Aug 24 18:03:57 2026 write: IOPS=1, BW=4396KiB/s (4502kB/s)(12.0MiB/2795msec); 0 zone resets clat (msec): min=503, max=1569, avg=930.66, stdev=563.69 lat (msec): min=504, max=1570, avg=931.19, stdev=563.68 clat percentiles (msec): | 1.00th=[ 506], 5.00th=[ 506], 10.00th=[ 506], 20.00th=[ 506], | 30.00th=[ 506], 40.00th=[ 718], 50.00th=[ 718], 60.00th=[ 718], | 70.00th=[ 1569], 80.00th=[ 1569], 90.00th=[ 1569], 95.00th=[ 1569], | 99.00th=[ 1569], 99.50th=[ 1569], 99.90th=[ 1569], 99.95th=[ 1569], | 99.99th=[ 1569] bw ( KiB/s): min= 7968, max= 8062, per=92.39%, avg=8015.00, stdev=66.47, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=66.67%, 2000=33.33% cpu : usr=0.00%, sys=3.72%, ctx=49, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=6373KiB/s (6526kB/s), 1593KiB/s-4813KiB/s (1631kB/s-4929kB/s), io=16.0MiB (16.8MB), run=2553-2571msec WRITE: bw=8676KiB/s (8884kB/s), 3186KiB/s-4396KiB/s (3263kB/s-4502kB/s), io=32.0MiB (33.6MB), run=2571-3777msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144992: Mon Aug 24 18:03:57 2026 read: IOPS=2, BW=8258KiB/s (8456kB/s)(12.0MiB/1488msec) clat (msec): min=351, max=571, avg=459.20, stdev=110.48 lat (msec): min=351, max=571, avg=459.20, stdev=110.48 clat percentiles (msec): | 1.00th=[ 351], 5.00th=[ 351], 10.00th=[ 351], 20.00th=[ 351], | 30.00th=[ 351], 40.00th=[ 456], 50.00th=[ 456], 60.00th=[ 456], | 70.00th=[ 575], 80.00th=[ 575], 90.00th=[ 575], 95.00th=[ 575], | 99.00th=[ 575], 99.50th=[ 575], 99.90th=[ 575], 99.95th=[ 575], | 99.99th=[ 575] bw ( KiB/s): min= 5769, max= 8159, per=100.00%, avg=6964.00, stdev=1689.99, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=66.67%, 750=33.33% cpu : usr=0.00%, sys=7.87%, ctx=62, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144993: Mon Aug 24 18:03:57 2026 read: IOPS=0, BW=1050KiB/s (1075kB/s)(4096KiB/3901msec) clat (nsec): min=1751.2M, max=1751.2M, avg=1751178947.00, stdev= 0.00 lat (nsec): min=1751.2M, max=1751.2M, avg=1751180950.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1754], 5.00th=[ 1754], 10.00th=[ 1754], 20.00th=[ 1754], | 30.00th=[ 1754], 40.00th=[ 1754], 50.00th=[ 1754], 60.00th=[ 1754], | 70.00th=[ 1754], 80.00th=[ 1754], 90.00th=[ 1754], 95.00th=[ 1754], | 99.00th=[ 1754], 99.50th=[ 1754], 99.90th=[ 1754], 99.95th=[ 1754], | 99.99th=[ 1754] bw ( KiB/s): min= 8175, max= 8175, per=100.00%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2100KiB/s (2150kB/s)(8192KiB/3901msec); 0 zone resets clat (msec): min=939, max=1208, avg=1073.86, stdev=189.93 lat (msec): min=939, max=1208, avg=1074.12, stdev=189.91 clat percentiles (msec): | 1.00th=[ 944], 5.00th=[ 944], 10.00th=[ 944], 20.00th=[ 944], | 30.00th=[ 944], 40.00th=[ 944], 50.00th=[ 944], 60.00th=[ 1217], | 70.00th=[ 1217], 80.00th=[ 1217], 90.00th=[ 1217], 95.00th=[ 1217], | 99.00th=[ 1217], 99.50th=[ 1217], 99.90th=[ 1217], 99.95th=[ 1217], | 99.99th=[ 1217] bw ( KiB/s): min= 8078, max= 8078, per=96.18%, avg=8078.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 1000=33.33%, 2000=66.67% cpu : usr=0.00%, sys=2.26%, ctx=33, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144994: Mon Aug 24 18:03:57 2026 write: IOPS=0, BW=3246KiB/s (3324kB/s)(12.0MiB/3785msec); 0 zone resets clat (msec): min=595, max=1752, avg=1257.05, stdev=596.26 lat (msec): min=599, max=1752, avg=1258.72, stdev=594.27 clat percentiles (msec): | 1.00th=[ 592], 5.00th=[ 592], 10.00th=[ 592], 20.00th=[ 592], | 30.00th=[ 592], 40.00th=[ 1418], 50.00th=[ 1418], 60.00th=[ 1418], | 70.00th=[ 1754], 80.00th=[ 1754], 90.00th=[ 1754], 95.00th=[ 1754], | 99.00th=[ 1754], 99.50th=[ 1754], 99.90th=[ 1754], 99.95th=[ 1754], | 99.99th=[ 1754] bw ( KiB/s): min= 8078, max= 8159, per=96.66%, avg=8118.50, stdev=57.28, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 2000=66.67% cpu : usr=0.00%, sys=4.41%, ctx=100, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144995: Mon Aug 24 18:03:57 2026 write: IOPS=1, BW=4255KiB/s (4357kB/s)(12.0MiB/2888msec); 0 zone resets clat (msec): min=452, max=1656, avg=942.07, stdev=632.82 lat (msec): min=452, max=1657, avg=942.52, stdev=632.96 clat percentiles (msec): | 1.00th=[ 451], 5.00th=[ 451], 10.00th=[ 451], 20.00th=[ 451], | 30.00th=[ 451], 40.00th=[ 718], 50.00th=[ 718], 60.00th=[ 718], | 70.00th=[ 1653], 80.00th=[ 1653], 90.00th=[ 1653], 95.00th=[ 1653], | 99.00th=[ 1653], 99.50th=[ 1653], 99.90th=[ 1653], 99.95th=[ 1653], | 99.99th=[ 1653] bw ( KiB/s): min= 6177, max= 8159, per=85.34%, avg=7168.00, stdev=1401.49, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.00%, sys=3.74%, ctx=40, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4200KiB/s (4301kB/s), 1050KiB/s-8258KiB/s (1075kB/s-8456kB/s), io=16.0MiB (16.8MB), run=1488-3901msec WRITE: bw=8400KiB/s (8601kB/s), 2100KiB/s-4255KiB/s (2150kB/s-4357kB/s), io=32.0MiB (33.6MB), run=2888-3901msec