== sanity test 398b: DIO and buffer IO race ============== 16:00:27 (1764795627) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 5.17732 s, 9.7 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=183762: Wed Dec 3 16:02:23 2025 read: IOPS=15, BW=60.1KiB/s (61.5kB/s)(5992KiB/99698msec) clat (usec): min=126, max=211442, avg=36530.09, stdev=22090.99 lat (usec): min=126, max=211443, avg=36533.48, stdev=22089.89 clat percentiles (usec): | 1.00th=[ 167], 5.00th=[ 9372], 10.00th=[ 15008], 20.00th=[ 20317], | 30.00th=[ 23987], 40.00th=[ 27657], 50.00th=[ 32375], 60.00th=[ 37487], | 70.00th=[ 43254], 80.00th=[ 50070], 90.00th=[ 63701], 95.00th=[ 77071], | 99.00th=[111674], 99.50th=[124257], 99.90th=[166724], 99.95th=[210764], | 99.99th=[210764] bw ( KiB/s): min= 15, max= 111, per=24.81%, avg=59.54, stdev=19.88, samples=197 iops : min= 3, max= 27, avg=14.24, stdev= 4.99, samples=197 write: IOPS=15, BW=63.2KiB/s (64.7kB/s)(6296KiB/99698msec); 0 zone resets clat (usec): min=990, max=706071, avg=28309.13, stdev=32762.26 lat (usec): min=991, max=706073, avg=28316.30, stdev=32763.38 clat percentiles (usec): | 1.00th=[ 1074], 5.00th=[ 1237], 10.00th=[ 1450], 20.00th=[ 3458], | 30.00th=[ 7504], 40.00th=[ 14484], 50.00th=[ 20579], 60.00th=[ 26870], | 70.00th=[ 35390], 80.00th=[ 47973], 90.00th=[ 66847], 95.00th=[ 83362], | 99.00th=[119014], 99.50th=[162530], 99.90th=[219153], 99.95th=[708838], | 99.99th=[708838] bw ( KiB/s): min= 15, max= 135, per=24.93%, avg=62.83, stdev=23.95, samples=196 iops : min= 3, max= 33, avg=15.06, stdev= 6.01, samples=196 lat (usec) : 250=1.30%, 500=0.52%, 750=0.10%, 1000=0.20% lat (msec) : 2=7.65%, 4=3.35%, 10=6.67%, 20=14.10%, 50=46.94% lat (msec) : 100=17.35%, 250=1.79%, 750=0.03% cpu : usr=0.15%, sys=7.73%, ctx=6850, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183763: Wed Dec 3 16:02:23 2025 read: IOPS=14, BW=59.8KiB/s (61.3kB/s)(5940KiB/99253msec) clat (usec): min=123, max=172598, avg=37202.35, stdev=21464.08 lat (usec): min=124, max=172600, avg=37203.96, stdev=21464.18 clat percentiles (usec): | 1.00th=[ 165], 5.00th=[ 12387], 10.00th=[ 15533], 20.00th=[ 19530], | 30.00th=[ 23725], 40.00th=[ 28443], 50.00th=[ 33424], 60.00th=[ 38536], | 70.00th=[ 44827], 80.00th=[ 52167], 90.00th=[ 64226], 95.00th=[ 77071], | 99.00th=[107480], 99.50th=[117965], 99.90th=[160433], 99.95th=[173016], | 99.99th=[173016] bw ( KiB/s): min= 6, max= 118, per=24.82%, avg=59.56, stdev=20.31, samples=195 iops : min= 1, max= 29, avg=14.24, stdev= 5.09, samples=195 write: IOPS=15, BW=63.0KiB/s (65.5kB/s)(6348KiB/99253msec); 0 zone resets clat (usec): min=918, max=738501, avg=27473.05, stdev=31206.00 lat (usec): min=919, max=738503, avg=27474.92, stdev=31206.18 clat percentiles (usec): | 1.00th=[ 1074], 5.00th=[ 1237], 10.00th=[ 1434], 20.00th=[ 3359], | 30.00th=[ 7177], 40.00th=[ 14746], 50.00th=[ 21365], 60.00th=[ 27657], | 70.00th=[ 35390], 80.00th=[ 48497], 90.00th=[ 62129], 95.00th=[ 74974], | 99.00th=[107480], 99.50th=[122160], 99.90th=[210764], 99.95th=[742392], | 99.99th=[742392] bw ( KiB/s): min= 6, max= 159, per=25.09%, avg=63.22, stdev=24.77, samples=196 iops : min= 1, max= 39, avg=15.16, stdev= 6.25, samples=196 lat (usec) : 250=0.88%, 500=0.26%, 750=0.03%, 1000=0.20% lat (msec) : 2=7.52%, 4=3.97%, 10=6.58%, 20=15.72%, 50=44.47% lat (msec) : 100=19.08%, 250=1.27%, 750=0.03% cpu : usr=0.11%, sys=7.73%, ctx=6875, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183764: Wed Dec 3 16:02:23 2025 read: IOPS=15, BW=61.1KiB/s (62.5kB/s)(6028KiB/98697msec) clat (usec): min=136, max=766439, avg=37246.89, stdev=29362.86 lat (usec): min=137, max=766441, avg=37249.22, stdev=29363.40 clat percentiles (usec): | 1.00th=[ 165], 5.00th=[ 10683], 10.00th=[ 14877], 20.00th=[ 19792], | 30.00th=[ 23725], 40.00th=[ 27657], 50.00th=[ 32113], 60.00th=[ 37487], | 70.00th=[ 43254], 80.00th=[ 52167], 90.00th=[ 64750], 95.00th=[ 77071], | 99.00th=[117965], 99.50th=[135267], 99.90th=[183501], 99.95th=[767558], | 99.99th=[767558] bw ( KiB/s): min= 15, max= 127, per=25.35%, avg=60.84, stdev=21.07, samples=194 iops : min= 3, max= 31, avg=14.56, stdev= 5.30, samples=194 write: IOPS=15, BW=63.4KiB/s (64.9kB/s)(6260KiB/98697msec); 0 zone resets clat (usec): min=908, max=256579, avg=26963.39, stdev=27787.06 lat (usec): min=909, max=256581, avg=26965.64, stdev=27786.76 clat percentiles (usec): | 1.00th=[ 1106], 5.00th=[ 1254], 10.00th=[ 1483], 20.00th=[ 3097], | 30.00th=[ 6194], 40.00th=[ 12518], 50.00th=[ 19792], 60.00th=[ 26346], | 70.00th=[ 35390], 80.00th=[ 45876], 90.00th=[ 62653], 95.00th=[ 80217], | 99.00th=[122160], 99.50th=[141558], 99.90th=[227541], 99.95th=[256902], | 99.99th=[256902] bw ( KiB/s): min= 7, max= 143, per=24.94%, avg=62.84, stdev=24.47, samples=195 iops : min= 1, max= 35, avg=15.07, stdev= 6.16, samples=195 lat (usec) : 250=1.53%, 500=0.23%, 750=0.03%, 1000=0.16% lat (msec) : 2=7.55%, 4=4.30%, 10=7.39%, 20=14.62%, 50=44.40% lat (msec) : 100=17.84%, 250=1.89%, 500=0.03%, 1000=0.03% cpu : usr=0.11%, sys=7.60%, ctx=6788, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183765: Wed Dec 3 16:02:23 2025 read: IOPS=15, BW=61.4KiB/s (62.9kB/s)(6052KiB/98525msec) clat (usec): min=120, max=172730, avg=36665.05, stdev=22443.22 lat (usec): min=121, max=172732, avg=36674.86, stdev=22455.03 clat percentiles (usec): | 1.00th=[ 163], 5.00th=[ 10421], 10.00th=[ 15139], 20.00th=[ 19792], | 30.00th=[ 23987], 40.00th=[ 27919], 50.00th=[ 32375], 60.00th=[ 36963], | 70.00th=[ 43254], 80.00th=[ 50070], 90.00th=[ 64226], 95.00th=[ 77071], | 99.00th=[119014], 99.50th=[128451], 99.90th=[162530], 99.95th=[173016], | 99.99th=[173016] bw ( KiB/s): min= 15, max= 143, per=25.69%, avg=61.66, stdev=20.57, samples=193 iops : min= 3, max= 35, avg=14.77, stdev= 5.13, samples=193 write: IOPS=15, BW=63.3KiB/s (64.8kB/s)(6236KiB/98525msec); 0 zone resets clat (usec): min=896, max=800482, avg=27398.66, stdev=32411.50 lat (usec): min=898, max=800483, avg=27401.43, stdev=32411.38 clat percentiles (usec): | 1.00th=[ 1090], 5.00th=[ 1205], 10.00th=[ 1352], 20.00th=[ 2638], | 30.00th=[ 6652], 40.00th=[ 14484], 50.00th=[ 21103], 60.00th=[ 27919], | 70.00th=[ 35914], 80.00th=[ 46924], 90.00th=[ 62129], 95.00th=[ 79168], | 99.00th=[104334], 99.50th=[127402], 99.90th=[193987], 99.95th=[801113], | 99.99th=[801113] bw ( KiB/s): min= 7, max= 135, per=25.08%, avg=63.20, stdev=23.52, samples=194 iops : min= 1, max= 33, avg=15.15, stdev= 5.93, samples=194 lat (usec) : 250=1.53%, 500=0.33%, 750=0.10%, 1000=0.13% lat (msec) : 2=8.37%, 4=3.71%, 10=6.12%, 20=14.23%, 50=46.74% lat (msec) : 100=17.25%, 250=1.46%, 1000=0.03% cpu : usr=0.10%, sys=7.69%, ctx=6762, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=241KiB/s (247kB/s), 59.8KiB/s-61.4KiB/s (61.3kB/s-62.9kB/s), io=23.4MiB (24.6MB), run=98525-99698msec WRITE: bw=252KiB/s (258kB/s), 63.2KiB/s-63.0KiB/s (64.7kB/s-65.5kB/s), io=24.6MiB (25.7MB), run=98525-99698msec rand-rw: (groupid=0, jobs=1): err= 0: pid=183767: Wed Dec 3 16:03:00 2025 read: IOPS=10, BW=43.7KiB/s (44.8kB/s)(5992KiB/137080msec) clat (msec): min=6, max=699, avg=35.96, stdev=35.00 lat (msec): min=6, max=699, avg=35.96, stdev=35.00 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 15], | 30.00th=[ 18], 40.00th=[ 21], 50.00th=[ 25], 60.00th=[ 31], | 70.00th=[ 39], 80.00th=[ 52], 90.00th=[ 78], 95.00th=[ 100], | 99.00th=[ 144], 99.50th=[ 182], 99.90th=[ 300], 99.95th=[ 701], | 99.99th=[ 701] bw ( KiB/s): min= 7, max= 144, per=25.14%, avg=43.99, stdev=27.53, samples=266 iops : min= 1, max= 36, avg=10.36, stdev= 6.94, samples=266 write: IOPS=11, BW=45.9KiB/s (47.0kB/s)(6296KiB/137080msec); 0 zone resets clat (msec): min=9, max=281, avg=52.71, stdev=34.62 lat (msec): min=9, max=281, avg=52.71, stdev=34.62 clat percentiles (msec): | 1.00th=[ 14], 5.00th=[ 18], 10.00th=[ 22], 20.00th=[ 26], | 30.00th=[ 31], 40.00th=[ 36], 50.00th=[ 42], 60.00th=[ 51], | 70.00th=[ 62], 80.00th=[ 78], 90.00th=[ 101], 95.00th=[ 122], | 99.00th=[ 163], 99.50th=[ 220], 99.90th=[ 262], 99.95th=[ 284], | 99.99th=[ 284] bw ( KiB/s): min= 7, max= 136, per=24.95%, avg=45.67, stdev=25.70, samples=269 iops : min= 1, max= 34, avg=10.78, stdev= 6.48, samples=269 lat (msec) : 10=3.35%, 20=19.37%, 50=46.06%, 100=23.80%, 250=7.29% lat (msec) : 500=0.10%, 750=0.03% cpu : usr=0.08%, sys=2.73%, ctx=5187, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183768: Wed Dec 3 16:03:00 2025 read: IOPS=10, BW=43.6KiB/s (44.6kB/s)(5940KiB/136359msec) clat (msec): min=5, max=676, avg=36.26, stdev=35.24 lat (msec): min=5, max=676, avg=36.26, stdev=35.24 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 15], | 30.00th=[ 18], 40.00th=[ 22], 50.00th=[ 26], 60.00th=[ 31], | 70.00th=[ 39], 80.00th=[ 51], 90.00th=[ 77], 95.00th=[ 100], | 99.00th=[ 150], 99.50th=[ 184], 99.90th=[ 266], 99.95th=[ 676], | 99.99th=[ 676] bw ( KiB/s): min= 7, max= 142, per=24.72%, avg=43.26, stdev=27.48, samples=267 iops : min= 1, max= 35, avg=10.18, stdev= 6.93, samples=267 write: IOPS=11, BW=46.6KiB/s (47.7kB/s)(6348KiB/136359msec); 0 zone resets clat (msec): min=10, max=263, avg=51.83, stdev=32.73 lat (msec): min=10, max=263, avg=51.83, stdev=32.72 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 20], 10.00th=[ 22], 20.00th=[ 27], | 30.00th=[ 31], 40.00th=[ 35], 50.00th=[ 42], 60.00th=[ 50], | 70.00th=[ 61], 80.00th=[ 74], 90.00th=[ 97], 95.00th=[ 117], | 99.00th=[ 163], 99.50th=[ 186], 99.90th=[ 211], 99.95th=[ 264], | 99.99th=[ 264] bw ( KiB/s): min= 7, max= 128, per=25.16%, avg=46.04, stdev=25.27, samples=268 iops : min= 1, max= 32, avg=10.87, stdev= 6.37, samples=268 lat (msec) : 10=2.70%, 20=18.52%, 50=48.60%, 100=23.40%, 250=6.61% lat (msec) : 500=0.13%, 750=0.03% cpu : usr=0.09%, sys=2.71%, ctx=5035, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183769: Wed Dec 3 16:03:00 2025 read: IOPS=11, BW=44.3KiB/s (45.3kB/s)(6028KiB/136205msec) clat (msec): min=5, max=300, avg=35.28, stdev=29.17 lat (msec): min=5, max=300, avg=35.28, stdev=29.17 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 15], | 30.00th=[ 18], 40.00th=[ 22], 50.00th=[ 26], 60.00th=[ 32], | 70.00th=[ 40], 80.00th=[ 52], 90.00th=[ 73], 95.00th=[ 95], | 99.00th=[ 134], 99.50th=[ 167], 99.90th=[ 255], 99.95th=[ 300], | 99.99th=[ 300] bw ( KiB/s): min= 7, max= 159, per=25.44%, avg=44.51, stdev=25.90, samples=264 iops : min= 1, max= 39, avg=10.49, stdev= 6.51, samples=264 write: IOPS=11, BW=45.0KiB/s (47.1kB/s)(6260KiB/136205msec); 0 zone resets clat (msec): min=10, max=753, avg=52.92, stdev=39.03 lat (msec): min=10, max=753, avg=52.92, stdev=39.03 clat percentiles (msec): | 1.00th=[ 14], 5.00th=[ 20], 10.00th=[ 22], 20.00th=[ 26], | 30.00th=[ 31], 40.00th=[ 36], 50.00th=[ 43], 60.00th=[ 51], | 70.00th=[ 60], 80.00th=[ 72], 90.00th=[ 99], 95.00th=[ 121], | 99.00th=[ 176], 99.50th=[ 224], 99.90th=[ 351], 99.95th=[ 751], | 99.99th=[ 751] bw ( KiB/s): min= 7, max= 143, per=25.07%, avg=45.88, stdev=25.54, samples=266 iops : min= 1, max= 35, avg=10.83, stdev= 6.45, samples=266 lat (msec) : 10=2.57%, 20=19.37%, 50=47.30%, 100=23.80%, 250=6.80% lat (msec) : 500=0.13%, 1000=0.03% cpu : usr=0.08%, sys=2.72%, ctx=5134, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183770: Wed Dec 3 16:03:00 2025 read: IOPS=11, BW=44.6KiB/s (45.7kB/s)(6052KiB/135551msec) clat (msec): min=4, max=230, avg=34.93, stdev=28.39 lat (msec): min=4, max=230, avg=34.93, stdev=28.39 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 15], | 30.00th=[ 18], 40.00th=[ 22], 50.00th=[ 26], 60.00th=[ 32], | 70.00th=[ 39], 80.00th=[ 50], 90.00th=[ 71], 95.00th=[ 94], | 99.00th=[ 142], 99.50th=[ 163], 99.90th=[ 224], 99.95th=[ 232], | 99.99th=[ 232] bw ( KiB/s): min= 7, max= 143, per=25.70%, avg=44.97, stdev=26.36, samples=263 iops : min= 1, max= 35, avg=10.61, stdev= 6.65, samples=263 write: IOPS=11, BW=46.0KiB/s (47.1kB/s)(6236KiB/135551msec); 0 zone resets clat (msec): min=10, max=783, avg=52.92, stdev=38.48 lat (msec): min=10, max=783, avg=52.92, stdev=38.48 clat percentiles (msec): | 1.00th=[ 15], 5.00th=[ 20], 10.00th=[ 23], 20.00th=[ 27], | 30.00th=[ 32], 40.00th=[ 37], 50.00th=[ 44], 60.00th=[ 51], | 70.00th=[ 60], 80.00th=[ 74], 90.00th=[ 94], 95.00th=[ 118], | 99.00th=[ 174], 99.50th=[ 207], 99.90th=[ 351], 99.95th=[ 785], | 99.99th=[ 785] bw ( KiB/s): min= 7, max= 144, per=24.95%, avg=45.65, stdev=24.59, samples=267 iops : min= 1, max= 36, avg=10.78, stdev= 6.21, samples=267 lat (msec) : 10=2.96%, 20=18.20%, 50=48.80%, 100=23.76%, 250=6.18% lat (msec) : 500=0.07%, 1000=0.03% cpu : usr=0.08%, sys=2.79%, ctx=5078, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=175KiB/s (179kB/s), 43.6KiB/s-44.6KiB/s (44.6kB/s-45.7kB/s), io=23.4MiB (24.6MB), run=135551-137080msec WRITE: bw=183KiB/s (188kB/s), 45.9KiB/s-46.6KiB/s (47.0kB/s-47.7kB/s), io=24.6MiB (25.7MB), run=135551-137080msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=183816: Wed Dec 3 16:03:38 2025 read: IOPS=12, BW=193KiB/s (198kB/s)(5920KiB/30634msec) clat (usec): min=129, max=195335, avg=44580.33, stdev=30324.06 lat (usec): min=130, max=195336, avg=44581.97, stdev=30324.13 clat percentiles (usec): | 1.00th=[ 169], 5.00th=[ 441], 10.00th=[ 14877], 20.00th=[ 22152], | 30.00th=[ 26084], 40.00th=[ 31327], 50.00th=[ 37487], 60.00th=[ 43779], | 70.00th=[ 54789], 80.00th=[ 65799], 90.00th=[ 82314], 95.00th=[102237], | 99.00th=[141558], 99.50th=[158335], 99.90th=[196084], 99.95th=[196084], | 99.99th=[196084] bw ( KiB/s): min= 62, max= 380, per=24.67%, avg=192.70, stdev=76.67, samples=60 iops : min= 3, max= 23, avg=11.33, stdev= 4.78, samples=60 write: IOPS=12, BW=208KiB/s (213kB/s)(6368KiB/30634msec); 0 zone resets clat (usec): min=1386, max=202712, avg=35373.67, stdev=33410.83 lat (usec): min=1388, max=202716, avg=35376.64, stdev=33411.03 clat percentiles (usec): | 1.00th=[ 1631], 5.00th=[ 1958], 10.00th=[ 2802], 20.00th=[ 6128], | 30.00th=[ 11207], 40.00th=[ 19530], 50.00th=[ 25297], 60.00th=[ 34341], | 70.00th=[ 44303], 80.00th=[ 62129], 90.00th=[ 84411], 95.00th=[101188], | 99.00th=[145753], 99.50th=[162530], 99.90th=[202376], 99.95th=[202376], | 99.99th=[202376] bw ( KiB/s): min= 60, max= 445, per=25.71%, avg=211.05, stdev=84.80, samples=59 iops : min= 3, max= 27, avg=12.49, stdev= 5.34, samples=59 lat (usec) : 250=1.56%, 500=0.91%, 750=0.26% lat (msec) : 2=3.26%, 4=4.56%, 10=7.68%, 20=10.68%, 50=41.54% lat (msec) : 100=24.09%, 250=5.47% cpu : usr=0.11%, sys=8.04%, ctx=1871, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183817: Wed Dec 3 16:03:38 2025 read: IOPS=11, BW=187KiB/s (192kB/s)(5744KiB/30659msec) clat (usec): min=115, max=216436, avg=45213.70, stdev=29443.51 lat (usec): min=116, max=216439, avg=45215.52, stdev=29443.43 clat percentiles (usec): | 1.00th=[ 163], 5.00th=[ 396], 10.00th=[ 17695], 20.00th=[ 24511], | 30.00th=[ 30278], 40.00th=[ 35390], 50.00th=[ 40109], 60.00th=[ 45876], | 70.00th=[ 51643], 80.00th=[ 61080], 90.00th=[ 80217], 95.00th=[ 99091], | 99.00th=[164627], 99.50th=[179307], 99.90th=[217056], 99.95th=[217056], | 99.99th=[217056] bw ( KiB/s): min= 62, max= 382, per=24.03%, avg=187.70, stdev=73.02, samples=60 iops : min= 3, max= 23, avg=11.03, stdev= 4.58, samples=60 write: IOPS=13, BW=213KiB/s (219kB/s)(6544KiB/30659msec); 0 zone resets clat (usec): min=1495, max=193763, avg=34955.62, stdev=32575.81 lat (usec): min=1496, max=193765, avg=34958.48, stdev=32575.83 clat percentiles (usec): | 1.00th=[ 1729], 5.00th=[ 1991], 10.00th=[ 2507], 20.00th=[ 6980], | 30.00th=[ 13435], 40.00th=[ 20579], 50.00th=[ 27132], 60.00th=[ 34866], | 70.00th=[ 45351], 80.00th=[ 56361], 90.00th=[ 77071], 95.00th=[ 95945], | 99.00th=[156238], 99.50th=[177210], 99.90th=[193987], 99.95th=[193987], | 99.99th=[193987] bw ( KiB/s): min= 63, max= 412, per=25.86%, avg=212.33, stdev=76.49, samples=60 iops : min= 3, max= 25, avg=12.60, stdev= 4.77, samples=60 lat (usec) : 250=1.82%, 500=0.52%, 1000=0.13% lat (msec) : 2=2.99%, 4=5.21%, 10=5.60%, 20=10.55%, 50=44.40% lat (msec) : 100=24.74%, 250=4.04% cpu : usr=0.18%, sys=8.10%, ctx=1922, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183818: Wed Dec 3 16:03:38 2025 read: IOPS=13, BW=210KiB/s (215kB/s)(6256KiB/29849msec) clat (usec): min=132, max=211826, avg=41662.21, stdev=29011.29 lat (usec): min=133, max=211827, avg=41665.79, stdev=29010.62 clat percentiles (usec): | 1.00th=[ 157], 5.00th=[ 297], 10.00th=[ 13829], 20.00th=[ 20317], | 30.00th=[ 27132], 40.00th=[ 32900], 50.00th=[ 36439], 60.00th=[ 42730], | 70.00th=[ 48497], 80.00th=[ 57934], 90.00th=[ 76022], 95.00th=[ 92799], | 99.00th=[183501], 99.50th=[189793], 99.90th=[212861], 99.95th=[212861], | 99.99th=[212861] bw ( KiB/s): min= 90, max= 351, per=26.96%, avg=210.55, stdev=66.15, samples=58 iops : min= 5, max= 21, avg=12.45, stdev= 4.13, samples=58 write: IOPS=12, BW=202KiB/s (207kB/s)(6032KiB/29849msec); 0 zone resets clat (usec): min=1487, max=334928, avg=35585.35, stdev=35789.93 lat (usec): min=1489, max=334940, avg=35588.01, stdev=35790.16 clat percentiles (usec): | 1.00th=[ 1614], 5.00th=[ 1909], 10.00th=[ 2900], 20.00th=[ 7635], | 30.00th=[ 13566], 40.00th=[ 20055], 50.00th=[ 26346], 60.00th=[ 34341], | 70.00th=[ 44827], 80.00th=[ 55837], 90.00th=[ 76022], 95.00th=[ 99091], | 99.00th=[166724], 99.50th=[200279], 99.90th=[333448], 99.95th=[333448], | 99.99th=[333448] bw ( KiB/s): min= 29, max= 412, per=24.35%, avg=199.95, stdev=92.77, samples=58 iops : min= 1, max= 25, avg=11.83, stdev= 5.85, samples=58 lat (usec) : 250=2.34%, 500=1.17%, 750=0.13%, 1000=0.13% lat (msec) : 2=3.39%, 4=3.78%, 10=5.73%, 20=12.63%, 50=44.79% lat (msec) : 100=21.61%, 250=4.17%, 500=0.13% cpu : usr=0.09%, sys=7.87%, ctx=1846, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183819: Wed Dec 3 16:03:38 2025 read: IOPS=12, BW=206KiB/s (210kB/s)(6032KiB/29344msec) clat (usec): min=114, max=164165, avg=42671.41, stdev=28533.08 lat (usec): min=115, max=164166, avg=42673.77, stdev=28532.72 clat percentiles (usec): | 1.00th=[ 161], 5.00th=[ 182], 10.00th=[ 537], 20.00th=[ 21627], | 30.00th=[ 27919], 40.00th=[ 33817], 50.00th=[ 38011], 60.00th=[ 44303], | 70.00th=[ 52167], 80.00th=[ 62129], 90.00th=[ 79168], 95.00th=[101188], | 99.00th=[145753], 99.50th=[147850], 99.90th=[164627], 99.95th=[164627], | 99.99th=[164627] bw ( KiB/s): min= 31, max= 383, per=26.16%, avg=204.28, stdev=74.57, samples=57 iops : min= 1, max= 23, avg=12.07, stdev= 4.68, samples=57 write: IOPS=13, BW=213KiB/s (218kB/s)(6256KiB/29344msec); 0 zone resets clat (usec): min=1636, max=173944, avg=33432.86, stdev=30110.48 lat (usec): min=1636, max=173947, avg=33435.47, stdev=30110.34 clat percentiles (usec): | 1.00th=[ 1745], 5.00th=[ 1926], 10.00th=[ 2900], 20.00th=[ 7111], | 30.00th=[ 12911], 40.00th=[ 20055], 50.00th=[ 24773], 60.00th=[ 31851], | 70.00th=[ 40633], 80.00th=[ 54789], 90.00th=[ 77071], 95.00th=[ 96994], | 99.00th=[135267], 99.50th=[139461], 99.90th=[173016], 99.95th=[173016], | 99.99th=[173016] bw ( KiB/s): min= 32, max= 448, per=25.97%, avg=213.19, stdev=83.39, samples=57 iops : min= 2, max= 28, avg=12.63, stdev= 5.27, samples=57 lat (usec) : 250=3.78%, 500=1.04%, 750=0.26% lat (msec) : 2=3.26%, 4=3.12%, 10=5.86%, 20=11.07%, 50=43.62% lat (msec) : 100=23.18%, 250=4.82% cpu : usr=0.12%, sys=7.95%, ctx=1788, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=781KiB/s (800kB/s), 187KiB/s-210KiB/s (192kB/s-215kB/s), io=23.4MiB (24.5MB), run=29344-30659msec WRITE: bw=822KiB/s (842kB/s), 202KiB/s-213KiB/s (207kB/s-219kB/s), io=24.6MiB (25.8MB), run=29344-30659msec rand-rw: (groupid=0, jobs=1): err= 0: pid=183821: Wed Dec 3 16:03:48 2025 read: IOPS=9, BW=149KiB/s (153kB/s)(5920KiB/39604msec) clat (msec): min=6, max=321, avg=41.96, stdev=40.11 lat (msec): min=6, max=321, avg=41.96, stdev=40.11 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 17], | 30.00th=[ 20], 40.00th=[ 23], 50.00th=[ 27], 60.00th=[ 32], | 70.00th=[ 41], 80.00th=[ 65], 90.00th=[ 97], 95.00th=[ 120], | 99.00th=[ 188], 99.50th=[ 251], 99.90th=[ 321], 99.95th=[ 321], | 99.99th=[ 321] bw ( KiB/s): min= 30, max= 448, per=25.40%, avg=149.88, stdev=98.94, samples=76 iops : min= 1, max= 28, avg= 8.59, stdev= 6.26, samples=76 write: IOPS=10, BW=161KiB/s (165kB/s)(6368KiB/39604msec); 0 zone resets clat (msec): min=12, max=292, avg=60.33, stdev=41.76 lat (msec): min=12, max=292, avg=60.34, stdev=41.76 clat percentiles (msec): | 1.00th=[ 15], 5.00th=[ 21], 10.00th=[ 24], 20.00th=[ 31], | 30.00th=[ 35], 40.00th=[ 41], 50.00th=[ 47], 60.00th=[ 57], | 70.00th=[ 69], 80.00th=[ 86], 90.00th=[ 112], 95.00th=[ 136], | 99.00th=[ 234], 99.50th=[ 288], 99.90th=[ 292], 99.95th=[ 292], | 99.99th=[ 292] bw ( KiB/s): min= 31, max= 439, per=25.73%, avg=159.77, stdev=89.42, samples=77 iops : min= 1, max= 27, avg= 9.21, stdev= 5.68, samples=77 lat (msec) : 10=0.78%, 20=17.19%, 50=45.83%, 100=25.52%, 250=10.16% lat (msec) : 500=0.52% cpu : usr=0.07%, sys=2.60%, ctx=1247, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183822: Wed Dec 3 16:03:48 2025 read: IOPS=8, BW=142KiB/s (145kB/s)(5744KiB/40540msec) clat (msec): min=6, max=421, avg=41.08, stdev=41.55 lat (msec): min=6, max=421, avg=41.08, stdev=41.55 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 16], | 30.00th=[ 19], 40.00th=[ 23], 50.00th=[ 27], 60.00th=[ 32], | 70.00th=[ 41], 80.00th=[ 61], 90.00th=[ 94], 95.00th=[ 124], | 99.00th=[ 186], 99.50th=[ 220], 99.90th=[ 422], 99.95th=[ 422], | 99.99th=[ 422] bw ( KiB/s): min= 31, max= 383, per=24.38%, avg=143.84, stdev=93.78, samples=77 iops : min= 1, max= 23, avg= 8.19, stdev= 5.94, samples=77 write: IOPS=10, BW=161KiB/s (165kB/s)(6544KiB/40540msec); 0 zone resets clat (msec): min=9, max=259, avg=62.95, stdev=43.94 lat (msec): min=9, max=259, avg=62.96, stdev=43.94 clat percentiles (msec): | 1.00th=[ 12], 5.00th=[ 19], 10.00th=[ 23], 20.00th=[ 30], | 30.00th=[ 36], 40.00th=[ 41], 50.00th=[ 47], 60.00th=[ 59], | 70.00th=[ 75], 80.00th=[ 94], 90.00th=[ 122], 95.00th=[ 157], | 99.00th=[ 220], 99.50th=[ 239], 99.90th=[ 259], 99.95th=[ 259], | 99.99th=[ 259] bw ( KiB/s): min= 30, max= 508, per=25.60%, avg=158.99, stdev=103.01, samples=79 iops : min= 1, max= 31, avg= 9.16, stdev= 6.52, samples=79 lat (msec) : 10=2.73%, 20=15.76%, 50=44.40%, 100=24.22%, 250=12.50% lat (msec) : 500=0.39% cpu : usr=0.07%, sys=2.50%, ctx=1245, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183823: Wed Dec 3 16:03:48 2025 read: IOPS=9, BW=159KiB/s (163kB/s)(6256KiB/39407msec) clat (msec): min=6, max=246, avg=41.52, stdev=37.82 lat (msec): min=6, max=246, avg=41.53, stdev=37.82 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 17], | 30.00th=[ 21], 40.00th=[ 24], 50.00th=[ 29], 60.00th=[ 33], | 70.00th=[ 42], 80.00th=[ 62], 90.00th=[ 91], 95.00th=[ 123], | 99.00th=[ 201], 99.50th=[ 232], 99.90th=[ 247], 99.95th=[ 247], | 99.99th=[ 247] bw ( KiB/s): min= 30, max= 508, per=27.35%, avg=161.38, stdev=99.53, samples=76 iops : min= 1, max= 31, avg= 9.32, stdev= 6.31, samples=76 write: IOPS=9, BW=153KiB/s (157kB/s)(6032KiB/39407msec); 0 zone resets clat (msec): min=12, max=265, avg=61.33, stdev=42.26 lat (msec): min=12, max=265, avg=61.33, stdev=42.26 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 22], 10.00th=[ 25], 20.00th=[ 30], | 30.00th=[ 34], 40.00th=[ 41], 50.00th=[ 49], 60.00th=[ 58], | 70.00th=[ 68], 80.00th=[ 88], 90.00th=[ 116], 95.00th=[ 150], | 99.00th=[ 215], 99.50th=[ 239], 99.90th=[ 266], 99.95th=[ 266], | 99.99th=[ 266] bw ( KiB/s): min= 30, max= 447, per=24.43%, avg=151.69, stdev=91.63, samples=77 iops : min= 1, max= 27, avg= 8.70, stdev= 5.81, samples=77 lat (msec) : 10=1.17%, 20=14.97%, 50=48.31%, 100=24.48%, 250=10.94% lat (msec) : 500=0.13% cpu : usr=0.07%, sys=2.46%, ctx=1220, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183824: Wed Dec 3 16:03:48 2025 read: IOPS=9, BW=152KiB/s (156kB/s)(6032KiB/39666msec) clat (msec): min=6, max=224, avg=41.76, stdev=38.65 lat (msec): min=6, max=224, avg=41.76, stdev=38.65 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 17], | 30.00th=[ 20], 40.00th=[ 23], 50.00th=[ 27], 60.00th=[ 32], | 70.00th=[ 43], 80.00th=[ 62], 90.00th=[ 99], 95.00th=[ 131], | 99.00th=[ 203], 99.50th=[ 222], 99.90th=[ 224], 99.95th=[ 224], | 99.99th=[ 224] bw ( KiB/s): min= 30, max= 447, per=26.16%, avg=154.35, stdev=99.05, samples=75 iops : min= 1, max= 27, avg= 8.88, stdev= 6.25, samples=75 write: IOPS=9, BW=158KiB/s (162kB/s)(6256KiB/39666msec); 0 zone resets clat (msec): min=14, max=291, avg=61.07, stdev=41.98 lat (msec): min=14, max=291, avg=61.07, stdev=41.98 clat percentiles (msec): | 1.00th=[ 18], 5.00th=[ 24], 10.00th=[ 26], 20.00th=[ 31], | 30.00th=[ 36], 40.00th=[ 41], 50.00th=[ 48], 60.00th=[ 56], | 70.00th=[ 70], 80.00th=[ 85], 90.00th=[ 114], 95.00th=[ 136], | 99.00th=[ 232], 99.50th=[ 268], 99.90th=[ 292], 99.95th=[ 292], | 99.99th=[ 292] bw ( KiB/s): min= 31, max= 383, per=25.44%, avg=157.96, stdev=88.33, samples=76 iops : min= 1, max= 23, avg= 9.09, stdev= 5.61, samples=76 lat (msec) : 10=1.30%, 20=14.71%, 50=47.66%, 100=23.96%, 250=11.98% lat (msec) : 500=0.39% cpu : usr=0.07%, sys=2.44%, ctx=1222, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=591KiB/s (605kB/s), 142KiB/s-159KiB/s (145kB/s-163kB/s), io=23.4MiB (24.5MB), run=39407-40540msec WRITE: bw=622KiB/s (637kB/s), 153KiB/s-161KiB/s (157kB/s-165kB/s), io=24.6MiB (25.8MB), run=39407-40540msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=183842: Wed Dec 3 16:04:04 2025 read: IOPS=1, BW=1089KiB/s (1115kB/s)(7168KiB/6581msec) clat (msec): min=101, max=2983, avg=588.24, stdev=1057.44 lat (msec): min=101, max=2983, avg=588.24, stdev=1057.44 clat percentiles (msec): | 1.00th=[ 103], 5.00th=[ 103], 10.00th=[ 103], 20.00th=[ 142], | 30.00th=[ 207], 40.00th=[ 207], 50.00th=[ 220], 60.00th=[ 228], | 70.00th=[ 228], 80.00th=[ 239], 90.00th=[ 2970], 95.00th=[ 2970], | 99.00th=[ 2970], 99.50th=[ 2970], 99.90th=[ 2970], 99.95th=[ 2970], | 99.99th=[ 2970] bw ( KiB/s): min= 2039, max= 6011, per=100.00%, avg=4043.00, stdev=1986.24, samples=3 iops : min= 1, max= 5, avg= 3.00, stdev= 2.00, samples=3 write: IOPS=0, BW=778KiB/s (797kB/s)(5120KiB/6581msec); 0 zone resets clat (msec): min=133, max=976, avg=475.46, stdev=313.40 lat (msec): min=133, max=976, avg=475.57, stdev=313.40 clat percentiles (msec): | 1.00th=[ 134], 5.00th=[ 134], 10.00th=[ 134], 20.00th=[ 134], | 30.00th=[ 326], 40.00th=[ 326], 50.00th=[ 443], 60.00th=[ 443], | 70.00th=[ 502], 80.00th=[ 502], 90.00th=[ 978], 95.00th=[ 978], | 99.00th=[ 978], 99.50th=[ 978], 99.90th=[ 978], 99.95th=[ 978], | 99.99th=[ 978] bw ( KiB/s): min= 1969, max= 2039, per=47.62%, avg=2009.50, stdev=30.87, samples=4 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=4 lat (msec) : 250=58.33%, 500=16.67%, 750=8.33%, 1000=8.33%, >=2000=8.33% cpu : usr=0.02%, sys=12.89%, ctx=764, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183843: Wed Dec 3 16:04:04 2025 read: IOPS=0, BW=301KiB/s (309kB/s)(2048KiB/6793msec) clat (msec): min=219, max=289, avg=254.57, stdev=49.37 lat (msec): min=219, max=289, avg=254.57, stdev=49.37 clat percentiles (msec): | 1.00th=[ 220], 5.00th=[ 220], 10.00th=[ 220], 20.00th=[ 220], | 30.00th=[ 220], 40.00th=[ 220], 50.00th=[ 220], 60.00th=[ 292], | 70.00th=[ 292], 80.00th=[ 292], 90.00th=[ 292], 95.00th=[ 292], | 99.00th=[ 292], 99.50th=[ 292], 99.90th=[ 292], 99.95th=[ 292], | 99.99th=[ 292] bw ( KiB/s): min= 1396, max= 2039, per=56.98%, avg=1717.50, stdev=454.67, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1507KiB/s (1544kB/s)(10.0MiB/6793msec); 0 zone resets clat (msec): min=109, max=3153, avg=621.13, stdev=950.83 lat (msec): min=109, max=3153, avg=621.24, stdev=950.82 clat percentiles (msec): | 1.00th=[ 110], 5.00th=[ 110], 10.00th=[ 110], 20.00th=[ 124], | 30.00th=[ 155], 40.00th=[ 180], 50.00th=[ 209], 60.00th=[ 228], | 70.00th=[ 338], 80.00th=[ 485], 90.00th=[ 1234], 95.00th=[ 3138], | 99.00th=[ 3138], 99.50th=[ 3138], 99.90th=[ 3138], 99.95th=[ 3138], | 99.99th=[ 3138] bw ( KiB/s): min= 1961, max= 8094, per=100.00%, avg=4549.25, stdev=2563.97, samples=4 iops : min= 1, max= 7, avg= 3.50, stdev= 2.52, samples=4 lat (msec) : 250=58.33%, 500=25.00%, 2000=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=13.38%, ctx=139, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183844: Wed Dec 3 16:04:04 2025 read: IOPS=1, BW=1114KiB/s (1141kB/s)(6144KiB/5516msec) clat (usec): min=696, max=333701, avg=84896.71, stdev=139822.91 lat (usec): min=697, max=333703, avg=84898.28, stdev=139822.84 clat percentiles (usec): | 1.00th=[ 701], 5.00th=[ 701], 10.00th=[ 701], 20.00th=[ 750], | 30.00th=[ 750], 40.00th=[ 1004], 50.00th=[ 1004], 60.00th=[ 1074], | 70.00th=[173016], 80.00th=[173016], 90.00th=[333448], 95.00th=[333448], | 99.00th=[333448], 99.50th=[333448], 99.90th=[333448], 99.95th=[333448], | 99.99th=[333448] bw ( KiB/s): min= 2027, max= 4079, per=100.00%, avg=3368.67, stdev=1162.59, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 write: IOPS=1, BW=1114KiB/s (1141kB/s)(6144KiB/5516msec); 0 zone resets clat (msec): min=189, max=3312, avg=830.13, stdev=1221.23 lat (msec): min=189, max=3312, avg=830.30, stdev=1221.25 clat percentiles (msec): | 1.00th=[ 190], 5.00th=[ 190], 10.00th=[ 190], 20.00th=[ 234], | 30.00th=[ 234], 40.00th=[ 355], 50.00th=[ 355], 60.00th=[ 384], | 70.00th=[ 506], 80.00th=[ 506], 90.00th=[ 3306], 95.00th=[ 3306], | 99.00th=[ 3306], 99.50th=[ 3306], 99.90th=[ 3306], 99.95th=[ 3306], | 99.99th=[ 3306] bw ( KiB/s): min= 1992, max= 2048, per=47.90%, avg=2021.20, stdev=24.35, samples=5 iops : min= 1, max= 2, avg= 1.20, stdev= 0.45, samples=5 lat (usec) : 750=16.67% lat (msec) : 2=16.67%, 250=25.00%, 500=25.00%, 750=8.33%, >=2000=8.33% cpu : usr=0.02%, sys=10.17%, ctx=113, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183845: Wed Dec 3 16:04:04 2025 read: IOPS=0, BW=867KiB/s (888kB/s)(5120KiB/5903msec) clat (msec): min=2, max=283, avg=120.18, stdev=118.91 lat (msec): min=2, max=283, avg=120.18, stdev=118.91 clat percentiles (msec): | 1.00th=[ 3], 5.00th=[ 3], 10.00th=[ 3], 20.00th=[ 3], | 30.00th=[ 6], 40.00th=[ 6], 50.00th=[ 140], 60.00th=[ 140], | 70.00th=[ 171], 80.00th=[ 171], 90.00th=[ 284], 95.00th=[ 284], | 99.00th=[ 284], 99.50th=[ 284], 99.90th=[ 284], 99.95th=[ 284], | 99.99th=[ 284] bw ( KiB/s): min= 4000, max= 4055, per=100.00%, avg=4027.50, stdev=38.89, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1214KiB/s (1243kB/s)(7168KiB/5903msec); 0 zone resets clat (msec): min=174, max=3154, avg=742.35, stdev=1068.71 lat (msec): min=174, max=3154, avg=743.25, stdev=1068.47 clat percentiles (msec): | 1.00th=[ 176], 5.00th=[ 176], 10.00th=[ 176], 20.00th=[ 284], | 30.00th=[ 300], 40.00th=[ 300], 50.00th=[ 355], 60.00th=[ 460], | 70.00th=[ 460], 80.00th=[ 472], 90.00th=[ 3171], 95.00th=[ 3171], | 99.00th=[ 3171], 99.50th=[ 3171], 99.90th=[ 3171], 99.95th=[ 3171], | 99.99th=[ 3171] bw ( KiB/s): min= 1969, max= 4079, per=57.32%, avg=2418.80, stdev=928.35, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 lat (msec) : 4=8.33%, 10=8.33%, 250=25.00%, 500=50.00%, >=2000=8.33% cpu : usr=0.03%, sys=11.17%, ctx=240, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3015KiB/s (3087kB/s), 301KiB/s-1114KiB/s (309kB/s-1141kB/s), io=20.0MiB (20.0MB), run=5516-6793msec WRITE: bw=4221KiB/s (4322kB/s), 778KiB/s-1507KiB/s (797kB/s-1544kB/s), io=28.0MiB (29.4MB), run=5516-6793msec rand-rw: (groupid=0, jobs=1): err= 0: pid=183848: Wed Dec 3 16:04:05 2025 read: IOPS=0, BW=1020KiB/s (1044kB/s)(7168KiB/7029msec) clat (msec): min=102, max=2666, avg=859.34, stdev=999.39 lat (msec): min=102, max=2666, avg=859.34, stdev=999.39 clat percentiles (msec): | 1.00th=[ 103], 5.00th=[ 103], 10.00th=[ 103], 20.00th=[ 128], | 30.00th=[ 142], 40.00th=[ 142], 50.00th=[ 351], 60.00th=[ 852], | 70.00th=[ 852], 80.00th=[ 1770], 90.00th=[ 2668], 95.00th=[ 2668], | 99.00th=[ 2668], 99.50th=[ 2668], 99.90th=[ 2668], 99.95th=[ 2668], | 99.99th=[ 2668] bw ( KiB/s): min= 1961, max= 4023, per=89.02%, avg=2515.75, stdev=1005.54, samples=4 iops : min= 1, max= 3, avg= 1.75, stdev= 0.96, samples=4 write: IOPS=0, BW=728KiB/s (746kB/s)(5120KiB/7029msec); 0 zone resets clat (msec): min=108, max=366, avg=176.72, stdev=108.69 lat (msec): min=108, max=366, avg=176.82, stdev=108.68 clat percentiles (msec): | 1.00th=[ 109], 5.00th=[ 109], 10.00th=[ 109], 20.00th=[ 109], | 30.00th=[ 113], 40.00th=[ 113], 50.00th=[ 131], 60.00th=[ 131], | 70.00th=[ 167], 80.00th=[ 167], 90.00th=[ 368], 95.00th=[ 368], | 99.00th=[ 368], 99.50th=[ 368], 99.90th=[ 368], 99.95th=[ 368], | 99.99th=[ 368] bw ( KiB/s): min= 1961, max= 4071, per=67.75%, avg=2681.00, stdev=1204.03, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (msec) : 250=58.33%, 500=16.67%, 1000=8.33%, 2000=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=3.39%, ctx=99, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183849: Wed Dec 3 16:04:05 2025 read: IOPS=0, BW=296KiB/s (303kB/s)(2048KiB/6916msec) clat (msec): min=412, max=514, avg=463.24, stdev=72.07 lat (msec): min=412, max=514, avg=463.25, stdev=72.07 clat percentiles (msec): | 1.00th=[ 414], 5.00th=[ 414], 10.00th=[ 414], 20.00th=[ 414], | 30.00th=[ 414], 40.00th=[ 414], 50.00th=[ 414], 60.00th=[ 514], | 70.00th=[ 514], 80.00th=[ 514], 90.00th=[ 514], 95.00th=[ 514], | 99.00th=[ 514], 99.50th=[ 514], 99.90th=[ 514], 99.95th=[ 514], | 99.99th=[ 514] bw ( KiB/s): min= 1617, max= 2011, per=64.19%, avg=1814.00, stdev=278.60, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1481KiB/s (1516kB/s)(10.0MiB/6916msec); 0 zone resets clat (msec): min=105, max=3645, avg=589.06, stdev=1082.82 lat (msec): min=105, max=3645, avg=589.28, stdev=1082.77 clat percentiles (msec): | 1.00th=[ 106], 5.00th=[ 106], 10.00th=[ 106], 20.00th=[ 127], | 30.00th=[ 133], 40.00th=[ 150], 50.00th=[ 207], 60.00th=[ 279], | 70.00th=[ 313], 80.00th=[ 384], 90.00th=[ 550], 95.00th=[ 3641], | 99.00th=[ 3641], 99.50th=[ 3641], 99.90th=[ 3641], 99.95th=[ 3641], | 99.99th=[ 3641] bw ( KiB/s): min= 1906, max= 4087, per=80.86%, avg=3199.60, stdev=1135.37, samples=5 iops : min= 1, max= 3, avg= 2.20, stdev= 1.10, samples=5 lat (msec) : 250=41.67%, 500=33.33%, 750=16.67%, >=2000=8.33% cpu : usr=0.00%, sys=4.89%, ctx=107, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183850: Wed Dec 3 16:04:05 2025 read: IOPS=0, BW=974KiB/s (997kB/s)(6144KiB/6310msec) clat (msec): min=77, max=466, avg=215.80, stdev=158.38 lat (msec): min=77, max=466, avg=215.80, stdev=158.38 clat percentiles (msec): | 1.00th=[ 78], 5.00th=[ 78], 10.00th=[ 78], 20.00th=[ 100], | 30.00th=[ 100], 40.00th=[ 136], 50.00th=[ 136], 60.00th=[ 159], | 70.00th=[ 359], 80.00th=[ 359], 90.00th=[ 468], 95.00th=[ 468], | 99.00th=[ 468], 99.50th=[ 468], 99.90th=[ 468], 99.95th=[ 468], | 99.99th=[ 468] bw ( KiB/s): min= 2011, max= 3923, per=88.54%, avg=2502.00, stdev=947.43, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 write: IOPS=0, BW=974KiB/s (997kB/s)(6144KiB/6310msec); 0 zone resets clat (msec): min=72, max=3692, avg=831.98, stdev=1408.59 lat (msec): min=72, max=3692, avg=832.08, stdev=1408.57 clat percentiles (msec): | 1.00th=[ 72], 5.00th=[ 72], 10.00th=[ 72], 20.00th=[ 111], | 30.00th=[ 111], 40.00th=[ 321], 50.00th=[ 321], 60.00th=[ 376], | 70.00th=[ 418], 80.00th=[ 418], 90.00th=[ 3708], 95.00th=[ 3708], | 99.00th=[ 3708], 99.50th=[ 3708], 99.90th=[ 3708], 99.95th=[ 3708], | 99.99th=[ 3708] bw ( KiB/s): min= 2011, max= 3923, per=73.93%, avg=2925.50, stdev=1047.22, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 1.15, samples=4 lat (msec) : 100=25.00%, 250=25.00%, 500=41.67%, >=2000=8.33% cpu : usr=0.00%, sys=3.68%, ctx=85, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183851: Wed Dec 3 16:04:05 2025 read: IOPS=0, BW=707KiB/s (724kB/s)(5120KiB/7245msec) clat (msec): min=59, max=510, avg=290.48, stdev=188.73 lat (msec): min=59, max=510, avg=290.48, stdev=188.73 clat percentiles (msec): | 1.00th=[ 61], 5.00th=[ 61], 10.00th=[ 61], 20.00th=[ 61], | 30.00th=[ 155], 40.00th=[ 155], 50.00th=[ 288], 60.00th=[ 288], | 70.00th=[ 439], 80.00th=[ 439], 90.00th=[ 510], 95.00th=[ 510], | 99.00th=[ 510], 99.50th=[ 510], 99.90th=[ 510], 99.95th=[ 510], | 99.99th=[ 510] bw ( KiB/s): min= 2011, max= 4071, per=100.00%, avg=3041.00, stdev=1456.64, samples=2 iops : min= 1, max= 3, avg= 2.00, stdev= 1.41, samples=2 write: IOPS=0, BW=989KiB/s (1013kB/s)(7168KiB/7245msec); 0 zone resets clat (msec): min=117, max=3670, avg=810.41, stdev=1280.46 lat (msec): min=117, max=3670, avg=810.55, stdev=1280.47 clat percentiles (msec): | 1.00th=[ 118], 5.00th=[ 118], 10.00th=[ 118], 20.00th=[ 122], | 30.00th=[ 129], 40.00th=[ 129], 50.00th=[ 426], 60.00th=[ 550], | 70.00th=[ 550], 80.00th=[ 667], 90.00th=[ 3675], 95.00th=[ 3675], | 99.00th=[ 3675], 99.50th=[ 3675], 99.90th=[ 3675], 99.95th=[ 3675], | 99.99th=[ 3675] bw ( KiB/s): min= 1544, max= 2043, per=47.09%, avg=1863.50, stdev=220.31, samples=4 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=4 lat (msec) : 100=8.33%, 250=33.33%, 500=25.00%, 750=25.00%, >=2000=8.33% cpu : usr=0.03%, sys=5.01%, ctx=99, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2827KiB/s (2895kB/s), 296KiB/s-1020KiB/s (303kB/s-1044kB/s), io=20.0MiB (20.0MB), run=6310-7245msec WRITE: bw=3957KiB/s (4052kB/s), 728KiB/s-1481KiB/s (746kB/s-1516kB/s), io=28.0MiB (29.4MB), run=6310-7245msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=183861: Wed Dec 3 16:04:19 2025 read: IOPS=0, BW=4035KiB/s (4132kB/s)(12.0MiB/3045msec) clat (msec): min=942, max=1065, avg=987.34, stdev=67.73 lat (msec): min=942, max=1065, avg=987.34, stdev=67.73 clat percentiles (msec): | 1.00th=[ 944], 5.00th=[ 944], 10.00th=[ 944], 20.00th=[ 944], | 30.00th=[ 944], 40.00th=[ 953], 50.00th=[ 953], 60.00th=[ 953], | 70.00th=[ 1062], 80.00th=[ 1062], 90.00th=[ 1062], 95.00th=[ 1062], | 99.00th=[ 1062], 99.50th=[ 1062], 99.90th=[ 1062], 99.95th=[ 1062], | 99.99th=[ 1062] bw ( KiB/s): min= 8015, max= 8192, per=100.00%, avg=8103.50, stdev=125.16, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 1000=66.67%, 2000=33.33% cpu : usr=0.07%, sys=12.75%, ctx=281, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183862: Wed Dec 3 16:04:19 2025 read: IOPS=0, BW=1216KiB/s (1245kB/s)(4096KiB/3369msec) clat (nsec): min=850718k, max=850718k, avg=850717867.00, stdev= 0.00 lat (nsec): min=850720k, max=850720k, avg=850720414.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 852], 5.00th=[ 852], 10.00th=[ 852], 20.00th=[ 852], | 30.00th=[ 852], 40.00th=[ 852], 50.00th=[ 852], 60.00th=[ 852], | 70.00th=[ 852], 80.00th=[ 852], 90.00th=[ 852], 95.00th=[ 852], | 99.00th=[ 852], 99.50th=[ 852], 99.90th=[ 852], 99.95th=[ 852], | 99.99th=[ 852] bw ( KiB/s): min= 8192, max= 8192, per=100.00%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2432KiB/s (2490kB/s)(8192KiB/3369msec); 0 zone resets clat (msec): min=554, max=1863, avg=1208.98, stdev=925.44 lat (msec): min=554, max=1863, avg=1209.18, stdev=925.47 clat percentiles (msec): | 1.00th=[ 558], 5.00th=[ 558], 10.00th=[ 558], 20.00th=[ 558], | 30.00th=[ 558], 40.00th=[ 558], 50.00th=[ 558], 60.00th=[ 1871], | 70.00th=[ 1871], 80.00th=[ 1871], 90.00th=[ 1871], 95.00th=[ 1871], | 99.00th=[ 1871], 99.50th=[ 1871], 99.90th=[ 1871], 99.95th=[ 1871], | 99.99th=[ 1871] bw ( KiB/s): min= 7968, max= 7968, per=81.92%, avg=7968.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.09%, sys=6.50%, ctx=146, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183865: Wed Dec 3 16:04:19 2025 write: IOPS=0, BW=3677KiB/s (3765kB/s)(12.0MiB/3342msec); 0 zone resets clat (msec): min=215, max=1616, avg=1050.42, stdev=737.91 lat (msec): min=215, max=1616, avg=1050.72, stdev=738.00 clat percentiles (msec): | 1.00th=[ 215], 5.00th=[ 215], 10.00th=[ 215], 20.00th=[ 215], | 30.00th=[ 215], 40.00th=[ 1318], 50.00th=[ 1318], 60.00th=[ 1318], | 70.00th=[ 1620], 80.00th=[ 1620], 90.00th=[ 1620], 95.00th=[ 1620], | 99.00th=[ 1620], 99.50th=[ 1620], 99.90th=[ 1620], 99.95th=[ 1620], | 99.99th=[ 1620] bw ( KiB/s): min= 7968, max= 7968, per=81.92%, avg=7968.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 2000=66.67% cpu : usr=0.00%, sys=5.27%, ctx=58, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183866: Wed Dec 3 16:04:19 2025 write: IOPS=0, BW=3827KiB/s (3919kB/s)(12.0MiB/3211msec); 0 zone resets clat (msec): min=576, max=1431, avg=959.79, stdev=434.45 lat (msec): min=576, max=1437, avg=961.93, stdev=437.39 clat percentiles (msec): | 1.00th=[ 575], 5.00th=[ 575], 10.00th=[ 575], 20.00th=[ 575], | 30.00th=[ 575], 40.00th=[ 869], 50.00th=[ 869], 60.00th=[ 869], | 70.00th=[ 1435], 80.00th=[ 1435], 90.00th=[ 1435], 95.00th=[ 1435], | 99.00th=[ 1435], 99.50th=[ 1435], 99.90th=[ 1435], 99.95th=[ 1435], | 99.99th=[ 1435] bw ( KiB/s): min= 7968, max= 8175, per=82.99%, avg=8071.50, stdev=146.37, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.12%, sys=5.95%, ctx=117, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4863KiB/s (4980kB/s), 1216KiB/s-4035KiB/s (1245kB/s-4132kB/s), io=16.0MiB (16.8MB), run=3045-3369msec WRITE: bw=9726KiB/s (9960kB/s), 2432KiB/s-3827KiB/s (2490kB/s-3919kB/s), io=32.0MiB (33.6MB), run=3211-3369msec rand-rw: (groupid=0, jobs=1): err= 0: pid=183859: Wed Dec 3 16:04:19 2025 read: IOPS=0, BW=3887KiB/s (3981kB/s)(12.0MiB/3161msec) clat (msec): min=934, max=1071, avg=1015.57, stdev=72.11 lat (msec): min=934, max=1072, avg=1015.57, stdev=72.11 clat percentiles (msec): | 1.00th=[ 936], 5.00th=[ 936], 10.00th=[ 936], 20.00th=[ 936], | 30.00th=[ 936], 40.00th=[ 1045], 50.00th=[ 1045], 60.00th=[ 1045], | 70.00th=[ 1070], 80.00th=[ 1070], 90.00th=[ 1070], 95.00th=[ 1070], | 99.00th=[ 1070], 99.50th=[ 1070], 99.90th=[ 1070], 99.95th=[ 1070], | 99.99th=[ 1070] bw ( KiB/s): min= 8110, max= 8175, per=100.00%, avg=8142.50, stdev=45.96, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=33.33%, 2000=66.67% cpu : usr=0.00%, sys=2.44%, ctx=35, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183860: Wed Dec 3 16:04:19 2025 read: IOPS=0, BW=1014KiB/s (1039kB/s)(4096KiB/4038msec) clat (nsec): min=1678.6M, max=1678.6M, avg=1678634868.00, stdev= 0.00 lat (nsec): min=1678.6M, max=1678.6M, avg=1678636873.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1687], 5.00th=[ 1687], 10.00th=[ 1687], 20.00th=[ 1687], | 30.00th=[ 1687], 40.00th=[ 1687], 50.00th=[ 1687], 60.00th=[ 1687], | 70.00th=[ 1687], 80.00th=[ 1687], 90.00th=[ 1687], 95.00th=[ 1687], | 99.00th=[ 1687], 99.50th=[ 1687], 99.90th=[ 1687], 99.95th=[ 1687], | 99.99th=[ 1687] bw ( KiB/s): min= 8192, max= 8192, per=100.00%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2029KiB/s (2077kB/s)(8192KiB/4038msec); 0 zone resets clat (msec): min=340, max=1820, avg=1080.92, stdev=1046.62 lat (msec): min=341, max=1821, avg=1081.24, stdev=1046.63 clat percentiles (msec): | 1.00th=[ 342], 5.00th=[ 342], 10.00th=[ 342], 20.00th=[ 342], | 30.00th=[ 342], 40.00th=[ 342], 50.00th=[ 342], 60.00th=[ 1821], | 70.00th=[ 1821], 80.00th=[ 1821], 90.00th=[ 1821], 95.00th=[ 1821], | 99.00th=[ 1821], 99.50th=[ 1821], 99.90th=[ 1821], 99.95th=[ 1821], | 99.99th=[ 1821] bw ( KiB/s): min= 8175, max= 8175, per=100.00%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.00%, sys=3.29%, ctx=48, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183863: Wed Dec 3 16:04:19 2025 write: IOPS=0, BW=3079KiB/s (3153kB/s)(12.0MiB/3991msec); 0 zone resets clat (msec): min=509, max=1864, avg=1288.51, stdev=699.91 lat (msec): min=509, max=1865, avg=1288.97, stdev=699.93 clat percentiles (msec): | 1.00th=[ 510], 5.00th=[ 510], 10.00th=[ 510], 20.00th=[ 510], | 30.00th=[ 510], 40.00th=[ 1485], 50.00th=[ 1485], 60.00th=[ 1485], | 70.00th=[ 1871], 80.00th=[ 1871], 90.00th=[ 1871], 95.00th=[ 1871], | 99.00th=[ 1871], 99.50th=[ 1871], 99.90th=[ 1871], 99.95th=[ 1871], | 99.99th=[ 1871] bw ( KiB/s): min= 7801, max= 8192, per=98.55%, avg=7996.50, stdev=276.48, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 750=33.33%, 2000=66.67% cpu : usr=0.00%, sys=2.11%, ctx=30, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183864: Wed Dec 3 16:04:19 2025 write: IOPS=1, BW=5473KiB/s (5605kB/s)(12.0MiB/2245msec); 0 zone resets clat (msec): min=339, max=1095, avg=692.52, stdev=380.68 lat (msec): min=339, max=1096, avg=692.83, stdev=380.71 clat percentiles (msec): | 1.00th=[ 338], 5.00th=[ 338], 10.00th=[ 338], 20.00th=[ 338], | 30.00th=[ 338], 40.00th=[ 642], 50.00th=[ 642], 60.00th=[ 642], | 70.00th=[ 1099], 80.00th=[ 1099], 90.00th=[ 1099], 95.00th=[ 1099], | 99.00th=[ 1099], 99.50th=[ 1099], 99.90th=[ 1099], 99.95th=[ 1099], | 99.99th=[ 1099] bw ( KiB/s): min= 8110, max= 8143, per=100.00%, avg=8126.50, stdev=23.33, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.00%, sys=5.04%, ctx=51, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4057KiB/s (4155kB/s), 1014KiB/s-3887KiB/s (1039kB/s-3981kB/s), io=16.0MiB (16.8MB), run=3161-4038msec WRITE: bw=8115KiB/s (8310kB/s), 2029KiB/s-5473KiB/s (2077kB/s-5605kB/s), io=32.0MiB (33.6MB), run=2245-4038msec