== sanity test 398b: DIO and buffer IO race ============== 13:59:06 (1788976746) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 5.6999 s, 8.8 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=180260: Wed Sep 9 14:01:57 2026 read: IOPS=10, BW=40.4KiB/s (41.3kB/s)(5992KiB/148479msec) clat (usec): min=43, max=522705, avg=54681.14, stdev=42048.70 lat (usec): min=43, max=522706, avg=54683.97, stdev=42047.97 clat percentiles (usec): | 1.00th=[ 53], 5.00th=[ 13304], 10.00th=[ 17957], 20.00th=[ 25035], | 30.00th=[ 31065], 40.00th=[ 38011], 50.00th=[ 45876], 60.00th=[ 53216], | 70.00th=[ 64226], 80.00th=[ 77071], 90.00th=[100140], 95.00th=[127402], | 99.00th=[225444], 99.50th=[254804], 99.90th=[413139], 99.95th=[522191], | 99.99th=[522191] bw ( KiB/s): min= 7, max= 102, per=25.14%, avg=40.22, stdev=19.23, samples=288 iops : min= 1, max= 25, avg= 9.39, stdev= 4.86, samples=288 write: IOPS=10, BW=42.4KiB/s (43.4kB/s)(6296KiB/148479msec); 0 zone resets clat (usec): min=949, max=345890, avg=42169.70, stdev=46507.77 lat (usec): min=951, max=345891, avg=42172.06, stdev=46508.68 clat percentiles (usec): | 1.00th=[ 1074], 5.00th=[ 1237], 10.00th=[ 1663], 20.00th=[ 4015], | 30.00th=[ 9110], 40.00th=[ 20317], 50.00th=[ 28443], 60.00th=[ 37487], | 70.00th=[ 52167], 80.00th=[ 72877], 90.00th=[102237], 95.00th=[135267], | 99.00th=[208667], 99.50th=[267387], 99.90th=[325059], 99.95th=[346031], | 99.99th=[346031] bw ( KiB/s): min= 7, max= 142, per=25.21%, avg=42.36, stdev=23.72, samples=288 iops : min= 1, max= 35, avg= 9.93, stdev= 5.96, samples=288 lat (usec) : 50=0.26%, 100=1.40%, 250=0.13%, 500=0.03%, 1000=0.13% lat (msec) : 2=5.96%, 4=4.17%, 10=5.66%, 20=9.15%, 50=35.35% lat (msec) : 100=27.31%, 250=9.90%, 500=0.52%, 750=0.03% cpu : usr=0.06%, sys=4.14%, ctx=6420, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180261: Wed Sep 9 14:01:57 2026 read: IOPS=10, BW=40.4KiB/s (41.3kB/s)(5940KiB/147157msec) clat (usec): min=45, max=340669, avg=54522.60, stdev=42167.41 lat (usec): min=45, max=340671, avg=54524.60, stdev=42167.46 clat percentiles (usec): | 1.00th=[ 58], 5.00th=[ 11994], 10.00th=[ 16909], 20.00th=[ 24249], | 30.00th=[ 30540], 40.00th=[ 36963], 50.00th=[ 44827], 60.00th=[ 53216], | 70.00th=[ 62653], 80.00th=[ 77071], 90.00th=[102237], 95.00th=[135267], | 99.00th=[227541], 99.50th=[252707], 99.90th=[337642], 99.95th=[341836], | 99.99th=[341836] bw ( KiB/s): min= 7, max= 111, per=25.16%, avg=40.25, stdev=19.85, samples=287 iops : min= 1, max= 27, avg= 9.40, stdev= 5.00, samples=287 write: IOPS=10, BW=43.1KiB/s (44.2kB/s)(6348KiB/147157msec); 0 zone resets clat (usec): min=847, max=397450, avg=41593.69, stdev=46063.59 lat (usec): min=848, max=397451, avg=41596.15, stdev=46063.36 clat percentiles (usec): | 1.00th=[ 1090], 5.00th=[ 1221], 10.00th=[ 1696], 20.00th=[ 3982], | 30.00th=[ 8586], 40.00th=[ 18220], 50.00th=[ 28181], 60.00th=[ 39060], | 70.00th=[ 52167], 80.00th=[ 69731], 90.00th=[102237], 95.00th=[127402], | 99.00th=[206570], 99.50th=[256902], 99.90th=[383779], 99.95th=[396362], | 99.99th=[396362] bw ( KiB/s): min= 7, max= 133, per=25.56%, avg=42.94, stdev=22.01, samples=288 iops : min= 1, max= 33, avg=10.07, stdev= 5.55, samples=288 lat (usec) : 50=0.16%, 100=1.20%, 250=0.20%, 500=0.03%, 750=0.07% lat (usec) : 1000=0.10% lat (msec) : 2=6.15%, 4=4.13%, 10=6.48%, 20=9.51%, 50=34.51% lat (msec) : 100=26.86%, 250=10.03%, 500=0.59% cpu : usr=0.07%, sys=4.14%, ctx=6566, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180262: Wed Sep 9 14:01:57 2026 read: IOPS=10, BW=41.5KiB/s (42.5kB/s)(6028KiB/145296msec) clat (usec): min=33, max=418092, avg=53847.19, stdev=40308.17 lat (usec): min=33, max=418095, avg=53850.79, stdev=40308.49 clat percentiles (usec): | 1.00th=[ 53], 5.00th=[ 11863], 10.00th=[ 17957], 20.00th=[ 24773], | 30.00th=[ 30802], 40.00th=[ 36439], 50.00th=[ 43779], 60.00th=[ 52691], | 70.00th=[ 62129], 80.00th=[ 78119], 90.00th=[103285], 95.00th=[123208], | 99.00th=[210764], 99.50th=[233833], 99.90th=[329253], 99.95th=[417334], | 99.99th=[417334] bw ( KiB/s): min= 7, max= 111, per=25.96%, avg=41.54, stdev=19.01, samples=282 iops : min= 1, max= 27, avg= 9.71, stdev= 4.77, samples=282 write: IOPS=10, BW=43.1KiB/s (44.1kB/s)(6260KiB/145296msec); 0 zone resets clat (usec): min=927, max=310878, avg=40894.26, stdev=44258.13 lat (usec): min=928, max=310880, avg=40897.60, stdev=44258.00 clat percentiles (usec): | 1.00th=[ 1123], 5.00th=[ 1237], 10.00th=[ 1713], 20.00th=[ 4015], | 30.00th=[ 8094], 40.00th=[ 16712], 50.00th=[ 27919], 60.00th=[ 38536], | 70.00th=[ 51643], 80.00th=[ 70779], 90.00th=[104334], 95.00th=[128451], | 99.00th=[193987], 99.50th=[217056], 99.90th=[295699], 99.95th=[312476], | 99.99th=[312476] bw ( KiB/s): min= 7, max= 111, per=25.75%, avg=43.26, stdev=20.84, samples=281 iops : min= 1, max= 27, avg=10.16, stdev= 5.27, samples=281 lat (usec) : 50=0.36%, 100=1.40%, 250=0.07%, 500=0.03%, 750=0.03% lat (usec) : 1000=0.10% lat (msec) : 2=5.73%, 4=4.33%, 10=6.45%, 20=9.51%, 50=34.86% lat (msec) : 100=26.56%, 250=10.25%, 500=0.33% cpu : usr=0.07%, sys=4.20%, ctx=6333, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180263: Wed Sep 9 14:01:57 2026 read: IOPS=10, BW=40.5KiB/s (41.4kB/s)(6052KiB/149588msec) clat (usec): min=44, max=382874, avg=54272.75, stdev=39626.97 lat (usec): min=44, max=382875, avg=54276.01, stdev=39626.52 clat percentiles (usec): | 1.00th=[ 56], 5.00th=[ 12518], 10.00th=[ 18482], 20.00th=[ 25035], | 30.00th=[ 31065], 40.00th=[ 37487], 50.00th=[ 45351], 60.00th=[ 54264], | 70.00th=[ 64750], 80.00th=[ 76022], 90.00th=[ 99091], 95.00th=[127402], | 99.00th=[206570], 99.50th=[242222], 99.90th=[308282], 99.95th=[383779], | 99.99th=[383779] bw ( KiB/s): min= 7, max= 102, per=25.30%, avg=40.47, stdev=19.35, samples=288 iops : min= 1, max= 25, avg= 9.44, stdev= 4.89, samples=288 write: IOPS=10, BW=41.7KiB/s (42.7kB/s)(6236KiB/149588msec); 0 zone resets clat (usec): min=1019, max=417016, avg=43164.14, stdev=49270.26 lat (usec): min=1020, max=417020, avg=43166.72, stdev=49269.97 clat percentiles (usec): | 1.00th=[ 1090], 5.00th=[ 1237], 10.00th=[ 1696], 20.00th=[ 4555], | 30.00th=[ 9503], 40.00th=[ 18744], 50.00th=[ 28967], 60.00th=[ 38011], | 70.00th=[ 52691], 80.00th=[ 70779], 90.00th=[102237], 95.00th=[137364], | 99.00th=[240124], 99.50th=[274727], 99.90th=[354419], 99.95th=[417334], | 99.99th=[417334] bw ( KiB/s): min= 7, max= 127, per=24.53%, avg=41.22, stdev=22.41, samples=292 iops : min= 1, max= 31, avg= 9.65, stdev= 5.64, samples=292 lat (usec) : 50=0.13%, 100=1.37%, 250=0.10%, 500=0.10%, 750=0.03% lat (msec) : 2=5.79%, 4=3.84%, 10=6.09%, 20=9.60%, 50=34.73% lat (msec) : 100=27.83%, 250=9.80%, 500=0.59% cpu : usr=0.06%, sys=4.13%, ctx=6450, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=161KiB/s (164kB/s), 40.4KiB/s-41.5KiB/s (41.3kB/s-42.5kB/s), io=23.4MiB (24.6MB), run=145296-149588msec WRITE: bw=168KiB/s (172kB/s), 41.7KiB/s-43.1KiB/s (42.7kB/s-44.2kB/s), io=24.6MiB (25.7MB), run=145296-149588msec rand-rw: (groupid=0, jobs=1): err= 0: pid=180255: Wed Sep 9 14:02:40 2026 read: IOPS=7, BW=30.9KiB/s (31.6kB/s)(5992KiB/194027msec) clat (msec): min=4, max=1190, avg=51.77, stdev=62.20 lat (msec): min=4, max=1190, avg=51.77, stdev=62.20 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 18], | 30.00th=[ 22], 40.00th=[ 27], 50.00th=[ 33], 60.00th=[ 41], | 70.00th=[ 53], 80.00th=[ 73], 90.00th=[ 113], 95.00th=[ 153], | 99.00th=[ 296], 99.50th=[ 351], 99.90th=[ 498], 99.95th=[ 1183], | 99.99th=[ 1183] bw ( KiB/s): min= 7, max= 120, per=26.15%, avg=32.16, stdev=24.09, samples=359 iops : min= 1, max= 30, avg= 7.37, stdev= 6.08, samples=359 write: IOPS=8, BW=32.4KiB/s (33.2kB/s)(6296KiB/194027msec); 0 zone resets clat (msec): min=9, max=783, avg=73.76, stdev=62.04 lat (msec): min=9, max=783, avg=73.76, stdev=62.04 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 21], 10.00th=[ 26], 20.00th=[ 31], | 30.00th=[ 38], 40.00th=[ 45], 50.00th=[ 55], 60.00th=[ 66], | 70.00th=[ 83], 80.00th=[ 107], 90.00th=[ 146], 95.00th=[ 186], | 99.00th=[ 296], 99.50th=[ 334], 99.90th=[ 609], 99.95th=[ 785], | 99.99th=[ 785] bw ( KiB/s): min= 7, max= 136, per=25.42%, avg=32.79, stdev=22.30, samples=370 iops : min= 1, max= 34, avg= 7.53, stdev= 5.62, samples=370 lat (msec) : 10=2.05%, 20=13.28%, 50=41.93%, 100=25.23%, 250=15.56% lat (msec) : 500=1.86%, 750=0.03%, 1000=0.03%, 2000=0.03% cpu : usr=0.05%, sys=1.47%, ctx=4826, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180256: Wed Sep 9 14:02:40 2026 read: IOPS=7, BW=30.7KiB/s (31.5kB/s)(5940KiB/193265msec) clat (msec): min=4, max=1522, avg=50.66, stdev=64.78 lat (msec): min=4, max=1522, avg=50.66, stdev=64.78 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 17], | 30.00th=[ 21], 40.00th=[ 26], 50.00th=[ 31], 60.00th=[ 40], | 70.00th=[ 52], 80.00th=[ 71], 90.00th=[ 113], 95.00th=[ 150], | 99.00th=[ 253], 99.50th=[ 347], 99.90th=[ 498], 99.95th=[ 1519], | 99.99th=[ 1519] bw ( KiB/s): min= 7, max= 135, per=26.27%, avg=32.31, stdev=24.42, samples=356 iops : min= 1, max= 33, avg= 7.42, stdev= 6.16, samples=356 write: IOPS=8, BW=32.8KiB/s (33.6kB/s)(6348KiB/193265msec); 0 zone resets clat (msec): min=10, max=510, avg=74.14, stdev=61.03 lat (msec): min=10, max=510, avg=74.14, stdev=61.03 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 21], 10.00th=[ 25], 20.00th=[ 32], | 30.00th=[ 36], 40.00th=[ 44], 50.00th=[ 53], 60.00th=[ 67], | 70.00th=[ 85], 80.00th=[ 108], 90.00th=[ 150], 95.00th=[ 197], | 99.00th=[ 305], 99.50th=[ 342], 99.90th=[ 493], 99.95th=[ 510], | 99.99th=[ 510] bw ( KiB/s): min= 7, max= 128, per=25.97%, avg=33.50, stdev=22.52, samples=367 iops : min= 1, max= 32, avg= 7.71, stdev= 5.68, samples=367 lat (msec) : 10=1.99%, 20=13.77%, 50=42.32%, 100=24.22%, 250=15.98% lat (msec) : 500=1.66%, 750=0.03%, 2000=0.03% cpu : usr=0.05%, sys=1.51%, ctx=4863, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180257: Wed Sep 9 14:02:40 2026 read: IOPS=7, BW=31.5KiB/s (32.2kB/s)(6028KiB/191452msec) clat (msec): min=4, max=413, avg=49.47, stdev=49.87 lat (msec): min=4, max=413, avg=49.47, stdev=49.87 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 14], 20.00th=[ 18], | 30.00th=[ 22], 40.00th=[ 27], 50.00th=[ 32], 60.00th=[ 40], | 70.00th=[ 52], 80.00th=[ 71], 90.00th=[ 110], 95.00th=[ 144], | 99.00th=[ 249], 99.50th=[ 309], 99.90th=[ 409], 99.95th=[ 414], | 99.99th=[ 414] bw ( KiB/s): min= 7, max= 135, per=26.56%, avg=32.66, stdev=23.39, samples=357 iops : min= 1, max= 33, avg= 7.50, stdev= 5.90, samples=357 write: IOPS=8, BW=32.7KiB/s (33.5kB/s)(6260KiB/191452msec); 0 zone resets clat (msec): min=11, max=1553, avg=74.48, stdev=71.84 lat (msec): min=11, max=1553, avg=74.48, stdev=71.84 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 21], 10.00th=[ 25], 20.00th=[ 31], | 30.00th=[ 37], 40.00th=[ 45], 50.00th=[ 53], 60.00th=[ 66], | 70.00th=[ 84], 80.00th=[ 110], 90.00th=[ 148], 95.00th=[ 192], | 99.00th=[ 309], 99.50th=[ 355], 99.90th=[ 776], 99.95th=[ 1552], | 99.99th=[ 1552] bw ( KiB/s): min= 7, max= 120, per=25.75%, avg=33.21, stdev=22.77, samples=364 iops : min= 1, max= 30, avg= 7.64, stdev= 5.74, samples=364 lat (msec) : 10=1.92%, 20=12.53%, 50=43.59%, 100=24.25%, 250=16.28% lat (msec) : 500=1.33%, 750=0.03%, 1000=0.03%, 2000=0.03% cpu : usr=0.04%, sys=1.45%, ctx=4729, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180258: Wed Sep 9 14:02:40 2026 read: IOPS=7, BW=31.6KiB/s (32.4kB/s)(6052KiB/191350msec) clat (msec): min=5, max=497, avg=49.99, stdev=51.87 lat (msec): min=5, max=497, avg=49.99, stdev=51.87 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 14], 20.00th=[ 18], | 30.00th=[ 22], 40.00th=[ 26], 50.00th=[ 32], 60.00th=[ 40], | 70.00th=[ 50], 80.00th=[ 72], 90.00th=[ 116], 95.00th=[ 157], | 99.00th=[ 249], 99.50th=[ 292], 99.90th=[ 426], 99.95th=[ 498], | 99.99th=[ 498] bw ( KiB/s): min= 7, max= 144, per=27.34%, avg=33.62, stdev=24.08, samples=349 iops : min= 1, max= 36, avg= 7.74, stdev= 6.07, samples=349 write: IOPS=8, BW=32.6KiB/s (33.4kB/s)(6236KiB/191350msec); 0 zone resets clat (msec): min=10, max=1573, avg=73.97, stdev=69.72 lat (msec): min=10, max=1573, avg=73.97, stdev=69.72 clat percentiles (msec): | 1.00th=[ 15], 5.00th=[ 22], 10.00th=[ 25], 20.00th=[ 31], | 30.00th=[ 37], 40.00th=[ 44], 50.00th=[ 53], 60.00th=[ 65], | 70.00th=[ 81], 80.00th=[ 108], 90.00th=[ 153], 95.00th=[ 199], | 99.00th=[ 284], 99.50th=[ 313], 99.90th=[ 485], 99.95th=[ 1569], | 99.99th=[ 1569] bw ( KiB/s): min= 7, max= 118, per=25.50%, avg=32.90, stdev=22.80, samples=367 iops : min= 1, max= 29, avg= 7.56, stdev= 5.76, samples=367 lat (msec) : 10=2.21%, 20=13.64%, 50=42.81%, 100=23.86%, 250=16.08% lat (msec) : 500=1.37%, 2000=0.03% cpu : usr=0.04%, sys=1.55%, ctx=4730, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=124KiB/s (127kB/s), 30.7KiB/s-31.6KiB/s (31.5kB/s-32.4kB/s), io=23.4MiB (24.6MB), run=191350-194027msec WRITE: bw=130KiB/s (133kB/s), 32.4KiB/s-32.8KiB/s (33.2kB/s-33.6kB/s), io=24.6MiB (25.7MB), run=191350-194027msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=180323: Wed Sep 9 14:03:22 2026 read: IOPS=12, BW=198KiB/s (203kB/s)(5920KiB/29893msec) clat (usec): min=33, max=334004, avg=44517.56, stdev=33157.16 lat (usec): min=34, max=334005, avg=44520.48, stdev=33158.04 clat percentiles (usec): | 1.00th=[ 48], 5.00th=[ 62], 10.00th=[ 124], 20.00th=[ 21890], | 30.00th=[ 28181], 40.00th=[ 33424], 50.00th=[ 40109], 60.00th=[ 45351], | 70.00th=[ 55313], 80.00th=[ 63177], 90.00th=[ 82314], 95.00th=[ 98042], | 99.00th=[145753], 99.50th=[198181], 99.90th=[333448], 99.95th=[333448], | 99.99th=[333448] bw ( KiB/s): min= 63, max= 378, per=26.42%, avg=198.12, stdev=64.10, samples=59 iops : min= 3, max= 23, avg=11.66, stdev= 4.04, samples=59 write: IOPS=13, BW=213KiB/s (218kB/s)(6368KiB/29893msec); 0 zone resets clat (usec): min=1349, max=181108, avg=33410.20, stdev=32434.43 lat (usec): min=1351, max=181111, avg=33412.38, stdev=32434.49 clat percentiles (usec): | 1.00th=[ 1663], 5.00th=[ 1991], 10.00th=[ 2802], 20.00th=[ 5473], | 30.00th=[ 8586], 40.00th=[ 16188], 50.00th=[ 24511], 60.00th=[ 32900], | 70.00th=[ 44303], 80.00th=[ 57410], 90.00th=[ 83362], 95.00th=[ 94897], | 99.00th=[149947], 99.50th=[175113], 99.90th=[181404], 99.95th=[181404], | 99.99th=[181404] bw ( KiB/s): min= 31, max= 414, per=27.43%, avg=216.43, stdev=86.68, samples=58 iops : min= 1, max= 25, avg=12.83, stdev= 5.49, samples=58 lat (usec) : 50=0.52%, 100=4.17%, 250=0.13%, 750=0.13%, 1000=0.13% lat (msec) : 2=2.86%, 4=4.95%, 10=9.64%, 20=9.11%, 50=38.80% lat (msec) : 100=25.65%, 250=3.78%, 500=0.13% cpu : usr=0.06%, sys=5.11%, ctx=1644, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180325: Wed Sep 9 14:03:22 2026 read: IOPS=11, BW=180KiB/s (184kB/s)(5744KiB/31924msec) clat (usec): min=40, max=166218, avg=45993.59, stdev=30294.33 lat (usec): min=40, max=166219, avg=45996.34, stdev=30296.86 clat percentiles (usec): | 1.00th=[ 51], 5.00th=[ 72], 10.00th=[ 11207], 20.00th=[ 25035], | 30.00th=[ 30278], 40.00th=[ 35390], 50.00th=[ 40109], 60.00th=[ 46924], | 70.00th=[ 56361], 80.00th=[ 64750], 90.00th=[ 85459], 95.00th=[108528], | 99.00th=[143655], 99.50th=[162530], 99.90th=[166724], 99.95th=[166724], | 99.99th=[166724] bw ( KiB/s): min= 31, max= 382, per=24.02%, avg=180.13, stdev=74.42, samples=63 iops : min= 1, max= 23, avg=10.52, stdev= 4.73, samples=63 write: IOPS=12, BW=205KiB/s (210kB/s)(6544KiB/31924msec); 0 zone resets clat (usec): min=1345, max=194985, avg=36862.03, stdev=33595.44 lat (usec): min=1346, max=194988, avg=36907.52, stdev=33583.10 clat percentiles (usec): | 1.00th=[ 1778], 5.00th=[ 2606], 10.00th=[ 3949], 20.00th=[ 7046], | 30.00th=[ 14222], 40.00th=[ 20841], 50.00th=[ 27919], 60.00th=[ 36439], | 70.00th=[ 46924], 80.00th=[ 60031], 90.00th=[ 82314], 95.00th=[110625], | 99.00th=[147850], 99.50th=[154141], 99.90th=[193987], 99.95th=[193987], | 99.99th=[193987] bw ( KiB/s): min= 32, max= 480, per=25.88%, avg=204.19, stdev=82.92, samples=63 iops : min= 2, max= 30, avg=12.03, stdev= 5.23, samples=63 lat (usec) : 50=0.13%, 100=3.39%, 250=0.52%, 500=0.13%, 750=0.13% lat (usec) : 1000=0.13% lat (msec) : 2=1.43%, 4=4.04%, 10=7.81%, 20=9.11%, 50=41.41% lat (msec) : 100=25.78%, 250=5.99% cpu : usr=0.06%, sys=5.32%, ctx=1679, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180326: Wed Sep 9 14:03:22 2026 read: IOPS=12, BW=197KiB/s (202kB/s)(6256KiB/31750msec) clat (usec): min=34, max=149641, avg=46958.96, stdev=28631.16 lat (usec): min=35, max=149641, avg=46960.18, stdev=28631.19 clat percentiles (usec): | 1.00th=[ 55], 5.00th=[ 68], 10.00th=[ 14746], 20.00th=[ 26084], | 30.00th=[ 32375], 40.00th=[ 37487], 50.00th=[ 42206], 60.00th=[ 49546], | 70.00th=[ 56361], 80.00th=[ 66323], 90.00th=[ 85459], 95.00th=[105382], | 99.00th=[128451], 99.50th=[131597], 99.90th=[149947], 99.95th=[149947], | 99.99th=[149947] bw ( KiB/s): min= 62, max= 381, per=26.35%, avg=197.60, stdev=69.95, samples=62 iops : min= 3, max= 23, avg=11.65, stdev= 4.39, samples=62 write: IOPS=11, BW=190KiB/s (195kB/s)(6032KiB/31750msec); 0 zone resets clat (usec): min=1482, max=190274, avg=34800.48, stdev=33569.46 lat (usec): min=1484, max=190276, avg=34802.71, stdev=33569.33 clat percentiles (usec): | 1.00th=[ 1598], 5.00th=[ 2114], 10.00th=[ 3556], 20.00th=[ 6783], | 30.00th=[ 10028], 40.00th=[ 17695], 50.00th=[ 27395], 60.00th=[ 34341], | 70.00th=[ 44827], 80.00th=[ 58459], 90.00th=[ 80217], 95.00th=[100140], | 99.00th=[147850], 99.50th=[168821], 99.90th=[189793], 99.95th=[189793], | 99.99th=[189793] bw ( KiB/s): min= 31, max= 414, per=23.69%, avg=186.89, stdev=72.47, samples=62 iops : min= 1, max= 25, avg=10.97, stdev= 4.67, samples=62 lat (usec) : 50=0.26%, 100=3.26%, 250=0.52%, 750=0.13% lat (msec) : 2=2.34%, 4=3.65%, 10=8.85%, 20=9.90%, 50=38.41% lat (msec) : 100=27.21%, 250=5.47% cpu : usr=0.05%, sys=5.04%, ctx=1766, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180327: Wed Sep 9 14:03:22 2026 read: IOPS=12, BW=195KiB/s (200kB/s)(6032KiB/30914msec) clat (usec): min=40, max=198991, avg=44049.34, stdev=32156.83 lat (usec): min=40, max=198993, avg=44052.06, stdev=32154.77 clat percentiles (usec): | 1.00th=[ 51], 5.00th=[ 64], 10.00th=[ 86], 20.00th=[ 22152], | 30.00th=[ 27395], 40.00th=[ 33162], 50.00th=[ 38536], 60.00th=[ 44827], | 70.00th=[ 52691], 80.00th=[ 62653], 90.00th=[ 86508], 95.00th=[107480], | 99.00th=[154141], 99.50th=[166724], 99.90th=[198181], 99.95th=[198181], | 99.99th=[198181] bw ( KiB/s): min= 31, max= 352, per=25.95%, avg=194.59, stdev=75.61, samples=61 iops : min= 1, max= 22, avg=11.46, stdev= 4.77, samples=61 write: IOPS=12, BW=202KiB/s (207kB/s)(6256KiB/30914msec); 0 zone resets clat (usec): min=1494, max=188719, avg=35953.82, stdev=35118.24 lat (usec): min=1496, max=188721, avg=35956.13, stdev=35118.25 clat percentiles (usec): | 1.00th=[ 1713], 5.00th=[ 1909], 10.00th=[ 3097], 20.00th=[ 6128], | 30.00th=[ 10159], 40.00th=[ 16581], 50.00th=[ 26084], 60.00th=[ 34866], | 70.00th=[ 43254], 80.00th=[ 59507], 90.00th=[ 94897], 95.00th=[111674], | 99.00th=[135267], 99.50th=[152044], 99.90th=[187696], 99.95th=[187696], | 99.99th=[187696] bw ( KiB/s): min= 31, max= 412, per=25.66%, avg=202.43, stdev=76.51, samples=61 iops : min= 1, max= 25, avg=11.95, stdev= 4.87, samples=61 lat (usec) : 50=0.39%, 100=4.69%, 250=0.65%, 500=0.13% lat (msec) : 2=2.73%, 4=4.17%, 10=8.33%, 20=9.38%, 50=39.97% lat (msec) : 100=21.74%, 250=7.81% cpu : usr=0.06%, sys=5.42%, ctx=1627, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=750KiB/s (768kB/s), 180KiB/s-198KiB/s (184kB/s-203kB/s), io=23.4MiB (24.5MB), run=29893-31924msec WRITE: bw=789KiB/s (808kB/s), 190KiB/s-213KiB/s (195kB/s-218kB/s), io=24.6MiB (25.8MB), run=29893-31924msec rand-rw: (groupid=0, jobs=1): err= 0: pid=180320: Wed Sep 9 14:03:34 2026 read: IOPS=8, BW=136KiB/s (139kB/s)(5920KiB/43662msec) clat (msec): min=8, max=216, avg=45.34, stdev=39.88 lat (msec): min=8, max=216, avg=45.34, stdev=39.88 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 13], 10.00th=[ 16], 20.00th=[ 18], | 30.00th=[ 22], 40.00th=[ 26], 50.00th=[ 31], 60.00th=[ 37], | 70.00th=[ 46], 80.00th=[ 61], 90.00th=[ 99], 95.00th=[ 146], | 99.00th=[ 188], 99.50th=[ 209], 99.90th=[ 218], 99.95th=[ 218], | 99.99th=[ 218] bw ( KiB/s): min= 31, max= 380, per=25.23%, avg=137.02, stdev=81.69, samples=84 iops : min= 1, max= 23, avg= 7.71, stdev= 5.14, samples=84 write: IOPS=9, BW=146KiB/s (149kB/s)(6368KiB/43662msec); 0 zone resets clat (msec): min=15, max=358, avg=67.30, stdev=44.85 lat (msec): min=15, max=358, avg=67.31, stdev=44.85 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 24], 10.00th=[ 28], 20.00th=[ 35], | 30.00th=[ 40], 40.00th=[ 47], 50.00th=[ 54], 60.00th=[ 63], | 70.00th=[ 77], 80.00th=[ 95], 90.00th=[ 129], 95.00th=[ 150], | 99.00th=[ 220], 99.50th=[ 309], 99.90th=[ 359], 99.95th=[ 359], | 99.99th=[ 359] bw ( KiB/s): min= 31, max= 383, per=25.33%, avg=144.64, stdev=79.59, samples=86 iops : min= 1, max= 23, avg= 8.20, stdev= 5.01, samples=86 lat (msec) : 10=0.65%, 20=12.24%, 50=45.57%, 100=28.39%, 250=12.89% lat (msec) : 500=0.26% cpu : usr=0.04%, sys=1.65%, ctx=1154, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180321: Wed Sep 9 14:03:34 2026 read: IOPS=8, BW=130KiB/s (133kB/s)(5744KiB/44059msec) clat (msec): min=6, max=313, avg=45.27, stdev=38.71 lat (msec): min=6, max=313, avg=45.27, stdev=38.71 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 13], 10.00th=[ 16], 20.00th=[ 20], | 30.00th=[ 23], 40.00th=[ 28], 50.00th=[ 31], 60.00th=[ 39], | 70.00th=[ 47], 80.00th=[ 64], 90.00th=[ 102], 95.00th=[ 126], | 99.00th=[ 192], 99.50th=[ 215], 99.90th=[ 313], 99.95th=[ 313], | 99.99th=[ 313] bw ( KiB/s): min= 28, max= 383, per=24.73%, avg=134.27, stdev=83.60, samples=84 iops : min= 1, max= 23, avg= 7.54, stdev= 5.24, samples=84 write: IOPS=9, BW=149KiB/s (152kB/s)(6544KiB/44059msec); 0 zone resets clat (msec): min=14, max=300, avg=67.27, stdev=43.09 lat (msec): min=14, max=300, avg=67.27, stdev=43.09 clat percentiles (msec): | 1.00th=[ 19], 5.00th=[ 25], 10.00th=[ 28], 20.00th=[ 34], | 30.00th=[ 40], 40.00th=[ 45], 50.00th=[ 54], 60.00th=[ 63], | 70.00th=[ 80], 80.00th=[ 101], 90.00th=[ 126], 95.00th=[ 150], | 99.00th=[ 213], 99.50th=[ 259], 99.90th=[ 300], 99.95th=[ 300], | 99.99th=[ 300] bw ( KiB/s): min= 28, max= 383, per=25.88%, avg=147.77, stdev=80.54, samples=87 iops : min= 1, max= 23, avg= 8.39, stdev= 5.07, samples=87 lat (msec) : 10=0.78%, 20=10.94%, 50=47.40%, 100=25.26%, 250=15.10% lat (msec) : 500=0.52% cpu : usr=0.06%, sys=1.56%, ctx=1140, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180322: Wed Sep 9 14:03:34 2026 read: IOPS=8, BW=142KiB/s (145kB/s)(6256KiB/44042msec) clat (msec): min=7, max=234, avg=45.35, stdev=37.71 lat (msec): min=7, max=234, avg=45.35, stdev=37.71 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 15], 20.00th=[ 19], | 30.00th=[ 23], 40.00th=[ 27], 50.00th=[ 32], 60.00th=[ 40], | 70.00th=[ 48], 80.00th=[ 68], 90.00th=[ 102], 95.00th=[ 127], | 99.00th=[ 190], 99.50th=[ 213], 99.90th=[ 234], 99.95th=[ 234], | 99.99th=[ 234] bw ( KiB/s): min= 31, max= 415, per=27.40%, avg=148.81, stdev=95.14, samples=83 iops : min= 1, max= 25, avg= 8.46, stdev= 5.97, samples=83 write: IOPS=8, BW=137KiB/s (140kB/s)(6032KiB/44042msec); 0 zone resets clat (msec): min=17, max=363, avg=69.00, stdev=45.73 lat (msec): min=17, max=363, avg=69.00, stdev=45.73 clat percentiles (msec): | 1.00th=[ 21], 5.00th=[ 24], 10.00th=[ 29], 20.00th=[ 36], | 30.00th=[ 40], 40.00th=[ 46], 50.00th=[ 55], 60.00th=[ 65], | 70.00th=[ 78], 80.00th=[ 100], 90.00th=[ 125], 95.00th=[ 165], | 99.00th=[ 213], 99.50th=[ 262], 99.90th=[ 363], 99.95th=[ 363], | 99.99th=[ 363] bw ( KiB/s): min= 31, max= 351, per=23.83%, avg=136.08, stdev=77.14, samples=87 iops : min= 1, max= 21, avg= 7.66, stdev= 4.84, samples=87 lat (msec) : 10=1.43%, 20=11.20%, 50=45.31%, 100=27.21%, 250=14.58% lat (msec) : 500=0.26% cpu : usr=0.07%, sys=1.65%, ctx=1108, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180324: Wed Sep 9 14:03:34 2026 read: IOPS=8, BW=138KiB/s (142kB/s)(6032KiB/43561msec) clat (msec): min=6, max=265, avg=44.51, stdev=34.98 lat (msec): min=6, max=265, avg=44.52, stdev=34.98 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 13], 10.00th=[ 16], 20.00th=[ 20], | 30.00th=[ 24], 40.00th=[ 28], 50.00th=[ 35], 60.00th=[ 41], | 70.00th=[ 50], 80.00th=[ 67], 90.00th=[ 89], 95.00th=[ 114], | 99.00th=[ 180], 99.50th=[ 228], 99.90th=[ 266], 99.95th=[ 266], | 99.99th=[ 266] bw ( KiB/s): min= 31, max= 441, per=25.51%, avg=138.49, stdev=83.86, samples=85 iops : min= 1, max= 27, avg= 7.81, stdev= 5.29, samples=85 write: IOPS=8, BW=144KiB/s (147kB/s)(6256KiB/43561msec); 0 zone resets clat (msec): min=16, max=363, avg=67.80, stdev=48.09 lat (msec): min=16, max=363, avg=67.80, stdev=48.09 clat percentiles (msec): | 1.00th=[ 20], 5.00th=[ 23], 10.00th=[ 28], 20.00th=[ 33], | 30.00th=[ 39], 40.00th=[ 42], 50.00th=[ 48], 60.00th=[ 62], | 70.00th=[ 80], 80.00th=[ 99], 90.00th=[ 128], 95.00th=[ 161], | 99.00th=[ 257], 99.50th=[ 264], 99.90th=[ 363], 99.95th=[ 363], | 99.99th=[ 363] bw ( KiB/s): min= 31, max= 383, per=25.44%, avg=145.25, stdev=84.00, samples=85 iops : min= 1, max= 23, avg= 8.24, stdev= 5.28, samples=85 lat (msec) : 10=0.78%, 20=11.20%, 50=48.83%, 100=26.43%, 250=12.11% lat (msec) : 500=0.65% cpu : usr=0.03%, sys=1.48%, ctx=1107, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=544KiB/s (557kB/s), 130KiB/s-142KiB/s (133kB/s-145kB/s), io=23.4MiB (24.5MB), run=43561-44059msec WRITE: bw=572KiB/s (586kB/s), 137KiB/s-149KiB/s (140kB/s-152kB/s), io=24.6MiB (25.8MB), run=43561-44059msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=180352: Wed Sep 9 14:03:52 2026 read: IOPS=1, BW=1696KiB/s (1737kB/s)(7168KiB/4226msec) clat (usec): min=729, max=1476.7k, avg=393876.03, stdev=491755.36 lat (usec): min=730, max=1476.7k, avg=393877.64, stdev=491755.48 clat percentiles (usec): | 1.00th=[ 734], 5.00th=[ 734], 10.00th=[ 734], | 20.00th=[ 166724], 30.00th=[ 204473], 40.00th=[ 204473], | 50.00th=[ 246416], 60.00th=[ 274727], 70.00th=[ 274727], | 80.00th=[ 387974], 90.00th=[1484784], 95.00th=[1484784], | 99.00th=[1484784], 99.50th=[1484784], 99.90th=[1484784], | 99.95th=[1484784], 99.99th=[1484784] bw ( KiB/s): min= 1848, max= 4063, per=57.34%, avg=2396.80, stdev=934.65, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 write: IOPS=1, BW=1212KiB/s (1241kB/s)(5120KiB/4226msec); 0 zone resets clat (msec): min=195, max=531, avg=289.45, stdev=138.95 lat (msec): min=195, max=532, avg=289.95, stdev=139.64 clat percentiles (msec): | 1.00th=[ 197], 5.00th=[ 197], 10.00th=[ 197], 20.00th=[ 197], | 30.00th=[ 199], 40.00th=[ 199], 50.00th=[ 262], 60.00th=[ 262], | 70.00th=[ 262], 80.00th=[ 262], 90.00th=[ 531], 95.00th=[ 531], | 99.00th=[ 531], 99.50th=[ 531], 99.90th=[ 531], 99.95th=[ 531], | 99.99th=[ 531] bw ( KiB/s): min= 2007, max= 3764, per=44.40%, avg=2598.00, stdev=1009.82, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (usec) : 750=8.33% lat (msec) : 250=41.67%, 500=33.33%, 750=8.33%, 2000=8.33% cpu : usr=0.02%, sys=10.91%, ctx=402, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180353: Wed Sep 9 14:03:52 2026 read: IOPS=0, BW=418KiB/s (428kB/s)(2048KiB/4899msec) clat (msec): min=2, max=173, avg=88.06, stdev=121.42 lat (msec): min=2, max=173, avg=88.06, stdev=121.42 clat percentiles (msec): | 1.00th=[ 3], 5.00th=[ 3], 10.00th=[ 3], 20.00th=[ 3], | 30.00th=[ 3], 40.00th=[ 3], 50.00th=[ 3], 60.00th=[ 174], | 70.00th=[ 174], 80.00th=[ 174], 90.00th=[ 174], 95.00th=[ 174], | 99.00th=[ 174], 99.50th=[ 174], 99.90th=[ 174], 99.95th=[ 174], | 99.99th=[ 174] bw ( KiB/s): min= 1845, max= 2023, per=46.27%, avg=1934.00, stdev=125.87, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2090KiB/s (2140kB/s)(10.0MiB/4899msec); 0 zone resets clat (msec): min=180, max=1755, avg=471.77, stdev=466.90 lat (msec): min=180, max=1755, avg=472.11, stdev=466.82 clat percentiles (msec): | 1.00th=[ 180], 5.00th=[ 180], 10.00th=[ 180], 20.00th=[ 201], | 30.00th=[ 226], 40.00th=[ 275], 50.00th=[ 321], 60.00th=[ 338], | 70.00th=[ 401], 80.00th=[ 460], 90.00th=[ 567], 95.00th=[ 1754], | 99.00th=[ 1754], 99.50th=[ 1754], 99.90th=[ 1754], 99.95th=[ 1754], | 99.99th=[ 1754] bw ( KiB/s): min= 2023, max= 6144, per=51.44%, avg=3010.17, stdev=1683.33, samples=6 iops : min= 1, max= 6, avg= 2.33, stdev= 1.97, samples=6 lat (msec) : 4=8.33%, 250=33.33%, 500=41.67%, 750=8.33%, 2000=8.33% cpu : usr=0.04%, sys=9.51%, ctx=121, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180354: Wed Sep 9 14:03:52 2026 read: IOPS=1, BW=1318KiB/s (1350kB/s)(6144KiB/4662msec) clat (usec): min=590, max=299211, avg=139864.69, stdev=153155.43 lat (usec): min=591, max=299214, avg=139866.29, stdev=153155.49 clat percentiles (usec): | 1.00th=[ 594], 5.00th=[ 594], 10.00th=[ 594], 20.00th=[ 873], | 30.00th=[ 873], 40.00th=[ 3064], 50.00th=[ 3064], 60.00th=[238027], | 70.00th=[295699], 80.00th=[295699], 90.00th=[299893], 95.00th=[299893], | 99.00th=[299893], 99.50th=[299893], 99.90th=[299893], 99.95th=[299893], | 99.99th=[299893] bw ( KiB/s): min= 1861, max= 4087, per=60.01%, avg=2508.50, stdev=1055.82, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 write: IOPS=1, BW=1318KiB/s (1350kB/s)(6144KiB/4662msec); 0 zone resets clat (msec): min=157, max=1833, avg=635.66, stdev=604.82 lat (msec): min=164, max=1833, avg=636.93, stdev=603.72 clat percentiles (msec): | 1.00th=[ 159], 5.00th=[ 159], 10.00th=[ 159], 20.00th=[ 359], | 30.00th=[ 359], 40.00th=[ 376], 50.00th=[ 376], 60.00th=[ 506], | 70.00th=[ 584], 80.00th=[ 584], 90.00th=[ 1838], 95.00th=[ 1838], | 99.00th=[ 1838], 99.50th=[ 1838], 99.90th=[ 1838], 99.95th=[ 1838], | 99.99th=[ 1838] bw ( KiB/s): min= 2043, max= 2737, per=37.88%, avg=2216.50, stdev=347.00, samples=4 iops : min= 1, max= 2, avg= 1.25, stdev= 0.50, samples=4 lat (usec) : 750=8.33%, 1000=8.33% lat (msec) : 4=8.33%, 250=16.67%, 500=33.33%, 750=16.67%, 2000=8.33% cpu : usr=0.00%, sys=7.38%, ctx=130, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180355: Wed Sep 9 14:03:52 2026 read: IOPS=1, BW=1288KiB/s (1319kB/s)(5120KiB/3974msec) clat (usec): min=525, max=296597, avg=123257.56, stdev=142365.64 lat (usec): min=526, max=296599, avg=123259.21, stdev=142366.08 clat percentiles (usec): | 1.00th=[ 529], 5.00th=[ 529], 10.00th=[ 529], 20.00th=[ 529], | 30.00th=[ 1057], 40.00th=[ 1057], 50.00th=[ 63177], 60.00th=[ 63177], | 70.00th=[254804], 80.00th=[254804], 90.00th=[295699], 95.00th=[295699], | 99.00th=[295699], 99.50th=[295699], 99.90th=[295699], 99.95th=[295699], | 99.99th=[295699] bw ( KiB/s): min= 2023, max= 5647, per=91.75%, avg=3835.00, stdev=2562.55, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 write: IOPS=1, BW=1804KiB/s (1847kB/s)(7168KiB/3974msec); 0 zone resets clat (msec): min=198, max=1527, avg=478.39, stdev=468.49 lat (msec): min=198, max=1528, avg=478.66, stdev=468.48 clat percentiles (msec): | 1.00th=[ 199], 5.00th=[ 199], 10.00th=[ 199], 20.00th=[ 230], | 30.00th=[ 284], 40.00th=[ 284], 50.00th=[ 334], 60.00th=[ 388], | 70.00th=[ 388], 80.00th=[ 388], 90.00th=[ 1536], 95.00th=[ 1536], | 99.00th=[ 1536], 99.50th=[ 1536], 99.90th=[ 1536], 99.95th=[ 1536], | 99.99th=[ 1536] bw ( KiB/s): min= 1882, max= 2031, per=33.72%, avg=1973.40, stdev=66.52, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 lat (usec) : 750=8.33% lat (msec) : 2=8.33%, 100=8.33%, 250=16.67%, 500=50.00%, 2000=8.33% cpu : usr=0.03%, sys=10.34%, ctx=174, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4180KiB/s (4281kB/s), 418KiB/s-1696KiB/s (428kB/s-1737kB/s), io=20.0MiB (20.0MB), run=3974-4899msec WRITE: bw=5853KiB/s (5993kB/s), 1212KiB/s-2090KiB/s (1241kB/s-2140kB/s), io=28.0MiB (29.4MB), run=3974-4899msec rand-rw: (groupid=0, jobs=1): err= 0: pid=180347: Wed Sep 9 14:03:52 2026 read: IOPS=2, BW=2066KiB/s (2115kB/s)(7168KiB/3470msec) clat (msec): min=119, max=947, avg=313.61, stdev=295.08 lat (msec): min=119, max=947, avg=313.61, stdev=295.08 clat percentiles (msec): | 1.00th=[ 120], 5.00th=[ 120], 10.00th=[ 120], 20.00th=[ 128], | 30.00th=[ 144], 40.00th=[ 144], 50.00th=[ 205], 60.00th=[ 271], | 70.00th=[ 271], 80.00th=[ 384], 90.00th=[ 944], 95.00th=[ 944], | 99.00th=[ 944], 99.50th=[ 944], 99.90th=[ 944], 99.95th=[ 944], | 99.99th=[ 944] bw ( KiB/s): min= 1950, max= 4007, per=81.49%, avg=2835.75, stdev=1022.79, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 1.15, samples=4 write: IOPS=1, BW=1476KiB/s (1511kB/s)(5120KiB/3470msec); 0 zone resets clat (msec): min=144, max=504, avg=237.00, stdev=150.71 lat (msec): min=144, max=504, avg=237.18, stdev=150.66 clat percentiles (msec): | 1.00th=[ 144], 5.00th=[ 144], 10.00th=[ 144], 20.00th=[ 144], | 30.00th=[ 167], 40.00th=[ 167], 50.00th=[ 180], 60.00th=[ 180], | 70.00th=[ 192], 80.00th=[ 192], 90.00th=[ 506], 95.00th=[ 506], | 99.00th=[ 506], 99.50th=[ 506], 99.90th=[ 506], 99.95th=[ 506], | 99.99th=[ 506] bw ( KiB/s): min= 2035, max= 4007, per=68.02%, avg=3314.00, stdev=1108.94, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 lat (msec) : 250=66.67%, 500=16.67%, 750=8.33%, 1000=8.33% cpu : usr=0.03%, sys=2.97%, ctx=55, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180348: Wed Sep 9 14:03:52 2026 read: IOPS=0, BW=348KiB/s (356kB/s)(2048KiB/5885msec) clat (msec): min=94, max=438, avg=266.73, stdev=243.19 lat (msec): min=94, max=438, avg=266.73, stdev=243.19 clat percentiles (msec): | 1.00th=[ 95], 5.00th=[ 95], 10.00th=[ 95], 20.00th=[ 95], | 30.00th=[ 95], 40.00th=[ 95], 50.00th=[ 95], 60.00th=[ 439], | 70.00th=[ 439], 80.00th=[ 439], 90.00th=[ 439], 95.00th=[ 439], | 99.00th=[ 439], 99.50th=[ 439], 99.90th=[ 439], 99.95th=[ 439], | 99.99th=[ 439] bw ( KiB/s): min= 1686, max= 2007, per=53.06%, avg=1846.50, stdev=226.98, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1740KiB/s (1782kB/s)(10.0MiB/5885msec); 0 zone resets clat (msec): min=116, max=1805, avg=532.34, stdev=531.93 lat (msec): min=116, max=1806, avg=532.56, stdev=532.17 clat percentiles (msec): | 1.00th=[ 116], 5.00th=[ 116], 10.00th=[ 116], 20.00th=[ 123], | 30.00th=[ 161], 40.00th=[ 199], 50.00th=[ 313], 60.00th=[ 401], | 70.00th=[ 567], 80.00th=[ 592], 90.00th=[ 1045], 95.00th=[ 1804], | 99.00th=[ 1804], 99.50th=[ 1804], 99.90th=[ 1804], 99.95th=[ 1804], | 99.99th=[ 1804] bw ( KiB/s): min= 1950, max= 4087, per=51.32%, avg=2500.29, stdev=865.48, samples=7 iops : min= 1, max= 3, avg= 1.57, stdev= 0.98, samples=7 lat (msec) : 100=8.33%, 250=33.33%, 500=25.00%, 750=16.67%, 2000=16.67% cpu : usr=0.02%, sys=3.81%, ctx=86, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180349: Wed Sep 9 14:03:52 2026 read: IOPS=1, BW=1150KiB/s (1178kB/s)(6144KiB/5342msec) clat (msec): min=78, max=487, avg=345.26, stdev=159.84 lat (msec): min=78, max=487, avg=345.26, stdev=159.84 clat percentiles (msec): | 1.00th=[ 80], 5.00th=[ 80], 10.00th=[ 80], 20.00th=[ 234], | 30.00th=[ 234], 40.00th=[ 363], 50.00th=[ 363], 60.00th=[ 443], | 70.00th=[ 468], 80.00th=[ 468], 90.00th=[ 489], 95.00th=[ 489], | 99.00th=[ 489], 99.50th=[ 489], 99.90th=[ 489], 99.95th=[ 489], | 99.99th=[ 489] bw ( KiB/s): min= 1950, max= 2043, per=57.55%, avg=2002.80, stdev=33.50, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 write: IOPS=1, BW=1150KiB/s (1178kB/s)(6144KiB/5342msec); 0 zone resets clat (msec): min=86, max=1848, avg=527.05, stdev=703.26 lat (msec): min=86, max=1848, avg=527.80, stdev=702.80 clat percentiles (msec): | 1.00th=[ 87], 5.00th=[ 87], 10.00th=[ 87], 20.00th=[ 105], | 30.00th=[ 105], 40.00th=[ 130], 50.00th=[ 130], 60.00th=[ 186], | 70.00th=[ 810], 80.00th=[ 810], 90.00th=[ 1854], 95.00th=[ 1854], | 99.00th=[ 1854], 99.50th=[ 1854], 99.90th=[ 1854], 99.95th=[ 1854], | 99.99th=[ 1854] bw ( KiB/s): min= 1950, max= 3396, per=46.79%, avg=2279.80, stdev=624.86, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 lat (msec) : 100=16.67%, 250=33.33%, 500=33.33%, 1000=8.33%, 2000=8.33% cpu : usr=0.04%, sys=3.76%, ctx=96, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180350: Wed Sep 9 14:03:52 2026 read: IOPS=1, BW=1459KiB/s (1494kB/s)(5120KiB/3509msec) clat (msec): min=112, max=698, avg=388.03, stdev=228.59 lat (msec): min=112, max=698, avg=388.03, stdev=228.59 clat percentiles (msec): | 1.00th=[ 113], 5.00th=[ 113], 10.00th=[ 113], 20.00th=[ 113], | 30.00th=[ 241], 40.00th=[ 241], 50.00th=[ 376], 60.00th=[ 376], | 70.00th=[ 510], 80.00th=[ 510], 90.00th=[ 701], 95.00th=[ 701], | 99.00th=[ 701], 99.50th=[ 701], 99.90th=[ 701], 99.95th=[ 701], | 99.99th=[ 701] bw ( KiB/s): min= 2035, max= 4007, per=77.44%, avg=2695.00, stdev=1136.23, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 write: IOPS=1, BW=2043KiB/s (2092kB/s)(7168KiB/3509msec); 0 zone resets clat (msec): min=99, max=503, avg=218.31, stdev=144.77 lat (msec): min=99, max=504, avg=218.45, stdev=144.83 clat percentiles (msec): | 1.00th=[ 100], 5.00th=[ 100], 10.00th=[ 100], 20.00th=[ 105], | 30.00th=[ 125], 40.00th=[ 125], 50.00th=[ 163], 60.00th=[ 257], | 70.00th=[ 257], 80.00th=[ 275], 90.00th=[ 506], 95.00th=[ 506], | 99.00th=[ 506], 99.50th=[ 506], 99.90th=[ 506], 99.95th=[ 506], | 99.99th=[ 506] bw ( KiB/s): min= 2007, max= 5380, per=77.22%, avg=3762.33, stdev=1690.71, samples=3 iops : min= 1, max= 5, avg= 3.00, stdev= 2.00, samples=3 lat (msec) : 100=8.33%, 250=41.67%, 500=25.00%, 750=25.00% cpu : usr=0.03%, sys=3.93%, ctx=66, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3480KiB/s (3564kB/s), 348KiB/s-2066KiB/s (356kB/s-2115kB/s), io=20.0MiB (20.0MB), run=3470-5885msec WRITE: bw=4872KiB/s (4989kB/s), 1150KiB/s-2043KiB/s (1178kB/s-2092kB/s), io=28.0MiB (29.4MB), run=3470-5885msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=180361: Wed Sep 9 14:04:06 2026 read: IOPS=0, BW=3458KiB/s (3540kB/s)(12.0MiB/3554msec) clat (msec): min=828, max=1423, avg=1124.55, stdev=297.27 lat (msec): min=828, max=1423, avg=1124.56, stdev=297.27 clat percentiles (msec): | 1.00th=[ 827], 5.00th=[ 827], 10.00th=[ 827], 20.00th=[ 827], | 30.00th=[ 827], 40.00th=[ 1116], 50.00th=[ 1116], 60.00th=[ 1116], | 70.00th=[ 1418], 80.00th=[ 1418], 90.00th=[ 1418], 95.00th=[ 1418], | 99.00th=[ 1418], 99.50th=[ 1418], 99.90th=[ 1418], 99.95th=[ 1418], | 99.99th=[ 1418] bw ( KiB/s): min= 8000, max= 8078, per=100.00%, avg=8039.00, stdev=55.15, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=33.33%, 2000=66.67% cpu : usr=0.08%, sys=10.81%, ctx=251, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180362: Wed Sep 9 14:04:06 2026 read: IOPS=0, BW=1014KiB/s (1038kB/s)(4096KiB/4040msec) clat (nsec): min=1137.2M, max=1137.2M, avg=1137244870.00, stdev= 0.00 lat (nsec): min=1137.2M, max=1137.2M, avg=1137245880.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1133], 5.00th=[ 1133], 10.00th=[ 1133], 20.00th=[ 1133], | 30.00th=[ 1133], 40.00th=[ 1133], 50.00th=[ 1133], 60.00th=[ 1133], | 70.00th=[ 1133], 80.00th=[ 1133], 90.00th=[ 1133], 95.00th=[ 1133], | 99.00th=[ 1133], 99.50th=[ 1133], 99.90th=[ 1133], 99.95th=[ 1133], | 99.99th=[ 1133] bw ( KiB/s): min= 8078, max= 8078, per=100.00%, avg=8078.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2028KiB/s (2076kB/s)(8192KiB/4040msec); 0 zone resets clat (msec): min=594, max=2179, avg=1386.95, stdev=1120.81 lat (msec): min=594, max=2180, avg=1387.40, stdev=1121.00 clat percentiles (msec): | 1.00th=[ 592], 5.00th=[ 592], 10.00th=[ 592], 20.00th=[ 592], | 30.00th=[ 592], 40.00th=[ 592], 50.00th=[ 592], 60.00th=[ 2165], | 70.00th=[ 2165], 80.00th=[ 2165], 90.00th=[ 2165], 95.00th=[ 2165], | 99.00th=[ 2165], 99.50th=[ 2165], 99.90th=[ 2165], 99.95th=[ 2165], | 99.99th=[ 2165] bw ( KiB/s): min= 8143, max= 8143, per=100.00%, avg=8143.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.02%, sys=3.76%, ctx=93, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180363: Wed Sep 9 14:04:06 2026 write: IOPS=0, BW=3156KiB/s (3231kB/s)(12.0MiB/3894msec); 0 zone resets clat (msec): min=307, max=2241, avg=1292.45, stdev=967.13 lat (msec): min=310, max=2247, avg=1296.20, stdev=969.06 clat percentiles (msec): | 1.00th=[ 309], 5.00th=[ 309], 10.00th=[ 309], 20.00th=[ 309], | 30.00th=[ 309], 40.00th=[ 1334], 50.00th=[ 1334], 60.00th=[ 1334], | 70.00th=[ 2232], 80.00th=[ 2232], 90.00th=[ 2232], 95.00th=[ 2232], | 99.00th=[ 2232], 99.50th=[ 2232], 99.90th=[ 2232], 99.95th=[ 2232], | 99.99th=[ 2232] bw ( KiB/s): min= 8047, max= 8078, per=99.41%, avg=8062.50, stdev=21.92, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.03%, sys=2.11%, ctx=76, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180364: Wed Sep 9 14:04:06 2026 write: IOPS=1, BW=4295KiB/s (4398kB/s)(12.0MiB/2861msec); 0 zone resets clat (msec): min=264, max=1813, avg=925.64, stdev=799.39 lat (msec): min=264, max=1814, avg=927.38, stdev=799.15 clat percentiles (msec): | 1.00th=[ 264], 5.00th=[ 264], 10.00th=[ 264], 20.00th=[ 264], | 30.00th=[ 264], 40.00th=[ 701], 50.00th=[ 701], 60.00th=[ 701], | 70.00th=[ 1821], 80.00th=[ 1821], 90.00th=[ 1821], 95.00th=[ 1821], | 99.00th=[ 1821], 99.50th=[ 1821], 99.90th=[ 1821], 99.95th=[ 1821], | 99.99th=[ 1821] bw ( KiB/s): min= 6330, max= 8143, per=89.23%, avg=7236.50, stdev=1281.98, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.00%, sys=3.53%, ctx=50, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4055KiB/s (4153kB/s), 1014KiB/s-3458KiB/s (1038kB/s-3540kB/s), io=16.0MiB (16.8MB), run=3554-4040msec WRITE: bw=8111KiB/s (8306kB/s), 2028KiB/s-4295KiB/s (2076kB/s-4398kB/s), io=32.0MiB (33.6MB), run=2861-4040msec rand-rw: (groupid=0, jobs=1): err= 0: pid=180366: Wed Sep 9 14:04:07 2026 read: IOPS=0, BW=3508KiB/s (3592kB/s)(12.0MiB/3503msec) clat (msec): min=328, max=2043, avg=1166.45, stdev=858.14 lat (msec): min=328, max=2043, avg=1166.45, stdev=858.14 clat percentiles (msec): | 1.00th=[ 330], 5.00th=[ 330], 10.00th=[ 330], 20.00th=[ 330], | 30.00th=[ 330], 40.00th=[ 1133], 50.00th=[ 1133], 60.00th=[ 1133], | 70.00th=[ 2039], 80.00th=[ 2039], 90.00th=[ 2039], 95.00th=[ 2039], | 99.00th=[ 2039], 99.50th=[ 2039], 99.90th=[ 2039], 99.95th=[ 2039], | 99.99th=[ 2039] bw ( KiB/s): min= 8062, max= 8062, per=100.00%, avg=8062.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=2.71%, ctx=24, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180367: Wed Sep 9 14:04:07 2026 read: IOPS=0, BW=1169KiB/s (1197kB/s)(4096KiB/3504msec) clat (nsec): min=894457k, max=894457k, avg=894456895.00, stdev= 0.00 lat (nsec): min=894462k, max=894462k, avg=894462367.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 894], 5.00th=[ 894], 10.00th=[ 894], 20.00th=[ 894], | 30.00th=[ 894], 40.00th=[ 894], 50.00th=[ 894], 60.00th=[ 894], | 70.00th=[ 894], 80.00th=[ 894], 90.00th=[ 894], 95.00th=[ 894], | 99.00th=[ 894], 99.50th=[ 894], 99.90th=[ 894], 99.95th=[ 894], | 99.99th=[ 894] bw ( KiB/s): min= 8126, max= 8126, per=100.00%, avg=8126.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2338KiB/s (2394kB/s)(8192KiB/3504msec); 0 zone resets clat (msec): min=381, max=2224, avg=1303.29, stdev=1303.37 lat (msec): min=382, max=2225, avg=1303.66, stdev=1303.22 clat percentiles (msec): | 1.00th=[ 380], 5.00th=[ 380], 10.00th=[ 380], 20.00th=[ 380], | 30.00th=[ 380], 40.00th=[ 380], 50.00th=[ 380], 60.00th=[ 2232], | 70.00th=[ 2232], 80.00th=[ 2232], 90.00th=[ 2232], 95.00th=[ 2232], | 99.00th=[ 2232], 99.50th=[ 2232], 99.90th=[ 2232], 99.95th=[ 2232], | 99.99th=[ 2232] bw ( KiB/s): min= 8062, max= 8062, per=100.00%, avg=8062.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 1000=33.33%, >=2000=33.33% cpu : usr=0.06%, sys=3.31%, ctx=47, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180368: Wed Sep 9 14:04:07 2026 write: IOPS=0, BW=3057KiB/s (3130kB/s)(12.0MiB/4020msec); 0 zone resets clat (msec): min=319, max=2377, avg=1337.65, stdev=1029.11 lat (msec): min=323, max=2377, avg=1339.44, stdev=1027.07 clat percentiles (msec): | 1.00th=[ 321], 5.00th=[ 321], 10.00th=[ 321], 20.00th=[ 321], | 30.00th=[ 321], 40.00th=[ 1318], 50.00th=[ 1318], 60.00th=[ 1318], | 70.00th=[ 2366], 80.00th=[ 2366], 90.00th=[ 2366], 95.00th=[ 2366], | 99.00th=[ 2366], 99.50th=[ 2366], 99.90th=[ 2366], 99.95th=[ 2366], | 99.99th=[ 2366] bw ( KiB/s): min= 8062, max= 8062, per=100.00%, avg=8062.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=2.91%, ctx=30, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180369: Wed Sep 9 14:04:07 2026 write: IOPS=0, BW=2922KiB/s (2992kB/s)(12.0MiB/4205msec); 0 zone resets clat (msec): min=253, max=3421, avg=1400.61, stdev=1755.86 lat (msec): min=253, max=3422, avg=1401.13, stdev=1755.92 clat percentiles (msec): | 1.00th=[ 253], 5.00th=[ 253], 10.00th=[ 253], 20.00th=[ 253], | 30.00th=[ 253], 40.00th=[ 527], 50.00th=[ 527], 60.00th=[ 527], | 70.00th=[ 3406], 80.00th=[ 3406], 90.00th=[ 3406], 95.00th=[ 3406], | 99.00th=[ 3406], 99.50th=[ 3406], 99.90th=[ 3406], 99.95th=[ 3406], | 99.99th=[ 3406] bw ( KiB/s): min= 6430, max= 8143, per=93.51%, avg=7286.50, stdev=1211.27, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 750=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=2.81%, ctx=54, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4676KiB/s (4788kB/s), 1169KiB/s-3508KiB/s (1197kB/s-3592kB/s), io=16.0MiB (16.8MB), run=3503-3504msec WRITE: bw=7793KiB/s (7980kB/s), 2338KiB/s-3057KiB/s (2394kB/s-3130kB/s), io=32.0MiB (33.6MB), run=3504-4205msec