== sanity test 398b: DIO and buffer IO race ============== 23:31:43 (1789270303) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 6.36186 s, 7.9 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=183116: Sat Sep 12 23:34:26 2026 read: IOPS=10, BW=41.5KiB/s (42.5kB/s)(5992KiB/144221msec) clat (usec): min=52, max=774170, avg=53484.73, stdev=40664.73 lat (usec): min=54, max=774171, avg=53487.36, stdev=40664.85 clat percentiles (usec): | 1.00th=[ 60], 5.00th=[ 10552], 10.00th=[ 17957], 20.00th=[ 25560], | 30.00th=[ 31589], 40.00th=[ 39060], 50.00th=[ 45876], 60.00th=[ 53216], | 70.00th=[ 63177], 80.00th=[ 77071], 90.00th=[ 98042], 95.00th=[115868], | 99.00th=[187696], 99.50th=[225444], 99.90th=[320865], 99.95th=[775947], | 99.99th=[775947] bw ( KiB/s): min= 5, max= 102, per=24.96%, avg=41.43, stdev=17.42, samples=281 iops : min= 1, max= 25, avg= 9.69, stdev= 4.38, samples=281 write: IOPS=10, BW=43.7KiB/s (44.7kB/s)(6296KiB/144221msec); 0 zone resets clat (usec): min=971, max=255275, avg=40367.79, stdev=40733.65 lat (usec): min=971, max=255277, avg=40374.26, stdev=40732.77 clat percentiles (usec): | 1.00th=[ 1139], 5.00th=[ 1336], 10.00th=[ 1893], 20.00th=[ 4752], | 30.00th=[ 9634], 40.00th=[ 20317], 50.00th=[ 30540], 60.00th=[ 40633], | 70.00th=[ 51119], 80.00th=[ 66847], 90.00th=[ 95945], 95.00th=[117965], | 99.00th=[193987], 99.50th=[210764], 99.90th=[242222], 99.95th=[254804], | 99.99th=[254804] bw ( KiB/s): min= 7, max= 126, per=24.99%, avg=43.49, stdev=20.83, samples=281 iops : min= 1, max= 31, avg=10.22, stdev= 5.26, samples=281 lat (usec) : 100=1.69%, 250=0.23%, 500=0.07%, 1000=0.03% lat (msec) : 2=5.57%, 4=3.65%, 10=6.74%, 20=8.30%, 50=36.43% lat (msec) : 100=28.26%, 250=8.89%, 500=0.13%, 1000=0.03% cpu : usr=0.08%, sys=4.58%, ctx=6660, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183119: Sat Sep 12 23:34:26 2026 read: IOPS=10, BW=42.5KiB/s (43.5kB/s)(5940KiB/139703msec) clat (usec): min=49, max=882233, avg=51762.71, stdev=40380.17 lat (usec): min=49, max=882235, avg=51764.95, stdev=40379.55 clat percentiles (usec): | 1.00th=[ 62], 5.00th=[ 10421], 10.00th=[ 17957], 20.00th=[ 25297], | 30.00th=[ 31589], 40.00th=[ 37487], 50.00th=[ 43779], 60.00th=[ 52167], | 70.00th=[ 61604], 80.00th=[ 73925], 90.00th=[ 92799], 95.00th=[111674], | 99.00th=[168821], 99.50th=[208667], 99.90th=[295699], 99.95th=[884999], | 99.99th=[884999] bw ( KiB/s): min= 7, max= 103, per=25.55%, avg=42.41, stdev=17.62, samples=272 iops : min= 1, max= 25, avg= 9.94, stdev= 4.41, samples=272 write: IOPS=11, BW=45.4KiB/s (46.5kB/s)(6348KiB/139703msec); 0 zone resets clat (usec): min=818, max=255722, avg=39285.10, stdev=40314.70 lat (usec): min=818, max=255725, avg=39290.80, stdev=40312.14 clat percentiles (usec): | 1.00th=[ 1090], 5.00th=[ 1270], 10.00th=[ 1549], 20.00th=[ 4015], | 30.00th=[ 7832], 40.00th=[ 18482], 50.00th=[ 27919], 60.00th=[ 39060], | 70.00th=[ 51643], 80.00th=[ 68682], 90.00th=[ 95945], 95.00th=[117965], | 99.00th=[181404], 99.50th=[196084], 99.90th=[227541], 99.95th=[254804], | 99.99th=[254804] bw ( KiB/s): min= 7, max= 126, per=26.11%, avg=45.43, stdev=22.44, samples=271 iops : min= 1, max= 31, avg=10.70, stdev= 5.65, samples=271 lat (usec) : 50=0.03%, 100=1.60%, 250=0.23%, 500=0.16%, 1000=0.16% lat (msec) : 2=6.54%, 4=3.68%, 10=7.06%, 20=8.04%, 50=36.17% lat (msec) : 100=27.73%, 250=8.43%, 500=0.13%, 1000=0.03% cpu : usr=0.08%, sys=4.57%, ctx=6493, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183121: Sat Sep 12 23:34:26 2026 read: IOPS=10, BW=41.0KiB/s (42.0kB/s)(6028KiB/143632msec) clat (usec): min=35, max=248877, avg=49989.45, stdev=32967.37 lat (usec): min=35, max=248878, avg=49995.42, stdev=32968.25 clat percentiles (usec): | 1.00th=[ 61], 5.00th=[ 11469], 10.00th=[ 17695], 20.00th=[ 24773], | 30.00th=[ 30540], 40.00th=[ 36963], 50.00th=[ 43254], 60.00th=[ 50070], | 70.00th=[ 60031], 80.00th=[ 71828], 90.00th=[ 89654], 95.00th=[111674], | 99.00th=[168821], 99.50th=[187696], 99.90th=[214959], 99.95th=[248513], | 99.99th=[248513] bw ( KiB/s): min= 7, max= 95, per=25.33%, avg=42.05, stdev=18.11, samples=279 iops : min= 1, max= 23, avg= 9.86, stdev= 4.56, samples=279 write: IOPS=10, BW=43.6KiB/s (44.6kB/s)(6260KiB/143632msec); 0 zone resets clat (usec): min=808, max=892506, avg=43277.90, stdev=48724.04 lat (usec): min=809, max=892509, avg=43281.95, stdev=48724.28 clat percentiles (usec): | 1.00th=[ 1090], 5.00th=[ 1319], 10.00th=[ 1844], 20.00th=[ 4948], | 30.00th=[ 9896], 40.00th=[ 21365], 50.00th=[ 31589], 60.00th=[ 43254], | 70.00th=[ 54789], 80.00th=[ 72877], 90.00th=[101188], 95.00th=[127402], | 99.00th=[191890], 99.50th=[242222], 99.90th=[421528], 99.95th=[893387], | 99.99th=[893387] bw ( KiB/s): min= 7, max= 123, per=24.91%, avg=43.35, stdev=20.85, samples=281 iops : min= 1, max= 30, avg=10.17, stdev= 5.23, samples=281 lat (usec) : 50=0.07%, 100=1.63%, 250=0.20%, 500=0.03%, 750=0.03% lat (usec) : 1000=0.16% lat (msec) : 2=5.70%, 4=3.32%, 10=6.41%, 20=8.56%, 50=36.95% lat (msec) : 100=28.35%, 250=8.40%, 500=0.16%, 1000=0.03% cpu : usr=0.07%, sys=4.43%, ctx=6532, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183123: Sat Sep 12 23:34:26 2026 read: IOPS=10, BW=42.6KiB/s (43.6kB/s)(6052KiB/142160msec) clat (usec): min=26, max=281841, avg=51999.65, stdev=34699.72 lat (usec): min=26, max=281843, avg=52003.15, stdev=34698.62 clat percentiles (usec): | 1.00th=[ 57], 5.00th=[ 9372], 10.00th=[ 17171], 20.00th=[ 25297], | 30.00th=[ 32375], 40.00th=[ 38536], 50.00th=[ 45351], 60.00th=[ 53740], | 70.00th=[ 63177], 80.00th=[ 76022], 90.00th=[ 94897], 95.00th=[113771], | 99.00th=[162530], 99.50th=[214959], 99.90th=[263193], 99.95th=[283116], | 99.99th=[283116] bw ( KiB/s): min= 7, max= 110, per=25.57%, avg=42.45, stdev=18.16, samples=278 iops : min= 1, max= 27, avg= 9.95, stdev= 4.57, samples=278 write: IOPS=10, BW=43.9KiB/s (44.9kB/s)(6236KiB/142160msec); 0 zone resets clat (usec): min=897, max=846174, avg=40336.78, stdev=46115.14 lat (usec): min=898, max=846176, avg=40341.79, stdev=46118.38 clat percentiles (usec): | 1.00th=[ 1123], 5.00th=[ 1352], 10.00th=[ 1958], 20.00th=[ 4621], | 30.00th=[ 8848], 40.00th=[ 19268], 50.00th=[ 28443], 60.00th=[ 37487], | 70.00th=[ 50070], 80.00th=[ 69731], 90.00th=[ 95945], 95.00th=[124257], | 99.00th=[183501], 99.50th=[208667], 99.90th=[283116], 99.95th=[843056], | 99.99th=[843056] bw ( KiB/s): min= 7, max= 118, per=25.03%, avg=43.55, stdev=20.77, samples=279 iops : min= 1, max= 29, avg=10.24, stdev= 5.22, samples=279 lat (usec) : 50=0.16%, 100=1.82%, 250=0.29%, 1000=0.16% lat (msec) : 2=5.21%, 4=3.48%, 10=7.26%, 20=8.53%, 50=36.07% lat (msec) : 100=28.65%, 250=8.11%, 500=0.23%, 1000=0.03% cpu : usr=0.09%, sys=4.57%, ctx=6730, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=166KiB/s (170kB/s), 41.5KiB/s-42.6KiB/s (42.5kB/s-43.6kB/s), io=23.4MiB (24.6MB), run=139703-144221msec WRITE: bw=174KiB/s (178kB/s), 43.6KiB/s-45.4KiB/s (44.6kB/s-46.5kB/s), io=24.6MiB (25.7MB), run=139703-144221msec rand-rw: (groupid=0, jobs=1): err= 0: pid=183117: Sat Sep 12 23:35:15 2026 read: IOPS=7, BW=31.1KiB/s (31.8kB/s)(5992KiB/192673msec) clat (msec): min=5, max=817, avg=51.10, stdev=50.41 lat (msec): min=5, max=817, avg=51.10, stdev=50.41 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 12], 10.00th=[ 15], 20.00th=[ 19], | 30.00th=[ 24], 40.00th=[ 29], 50.00th=[ 35], 60.00th=[ 43], | 70.00th=[ 55], 80.00th=[ 73], 90.00th=[ 111], 95.00th=[ 142], | 99.00th=[ 243], 99.50th=[ 255], 99.90th=[ 397], 99.95th=[ 818], | 99.99th=[ 818] bw ( KiB/s): min= 7, max= 143, per=25.94%, avg=32.17, stdev=21.94, samples=361 iops : min= 1, max= 35, avg= 7.38, stdev= 5.53, samples=361 write: IOPS=8, BW=32.7KiB/s (33.5kB/s)(6296KiB/192673msec); 0 zone resets clat (msec): min=11, max=437, avg=73.45, stdev=51.71 lat (msec): min=11, max=437, avg=73.45, stdev=51.71 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 23], 10.00th=[ 27], 20.00th=[ 34], | 30.00th=[ 41], 40.00th=[ 50], 50.00th=[ 58], 60.00th=[ 69], | 70.00th=[ 84], 80.00th=[ 107], 90.00th=[ 144], 95.00th=[ 176], | 99.00th=[ 271], 99.50th=[ 305], 99.90th=[ 372], 99.95th=[ 439], | 99.99th=[ 439] bw ( KiB/s): min= 7, max= 127, per=25.28%, avg=32.87, stdev=19.60, samples=371 iops : min= 1, max= 31, avg= 7.55, stdev= 4.93, samples=371 lat (msec) : 10=1.37%, 20=11.13%, 50=41.18%, 100=28.94%, 250=16.41% lat (msec) : 500=0.94%, 1000=0.03% cpu : usr=0.07%, sys=1.51%, ctx=4592, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183118: Sat Sep 12 23:35:15 2026 read: IOPS=7, BW=30.9KiB/s (31.6kB/s)(5940KiB/192224msec) clat (msec): min=5, max=891, avg=49.12, stdev=47.26 lat (msec): min=5, max=891, avg=49.13, stdev=47.26 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 15], 20.00th=[ 20], | 30.00th=[ 24], 40.00th=[ 29], 50.00th=[ 35], 60.00th=[ 43], | 70.00th=[ 53], 80.00th=[ 72], 90.00th=[ 103], 95.00th=[ 140], | 99.00th=[ 213], 99.50th=[ 232], 99.90th=[ 347], 99.95th=[ 894], | 99.99th=[ 894] bw ( KiB/s): min= 7, max= 127, per=25.31%, avg=31.39, stdev=21.87, samples=366 iops : min= 1, max= 31, avg= 7.18, stdev= 5.50, samples=366 write: IOPS=8, BW=33.0KiB/s (33.8kB/s)(6348KiB/192224msec); 0 zone resets clat (msec): min=11, max=367, avg=74.86, stdev=51.29 lat (msec): min=11, max=367, avg=74.87, stdev=51.29 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 22], 10.00th=[ 27], 20.00th=[ 36], | 30.00th=[ 43], 40.00th=[ 50], 50.00th=[ 60], 60.00th=[ 71], | 70.00th=[ 86], 80.00th=[ 108], 90.00th=[ 146], 95.00th=[ 180], | 99.00th=[ 253], 99.50th=[ 284], 99.90th=[ 363], 99.95th=[ 368], | 99.99th=[ 368] bw ( KiB/s): min= 7, max= 119, per=25.43%, avg=33.06, stdev=19.75, samples=372 iops : min= 1, max= 29, avg= 7.60, stdev= 4.97, samples=372 lat (msec) : 10=1.20%, 20=11.33%, 50=41.57%, 100=28.58%, 250=16.57% lat (msec) : 500=0.72%, 1000=0.03% cpu : usr=0.06%, sys=1.58%, ctx=4588, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183120: Sat Sep 12 23:35:15 2026 read: IOPS=7, BW=31.5KiB/s (32.3kB/s)(6028KiB/191187msec) clat (msec): min=6, max=394, avg=50.13, stdev=44.37 lat (msec): min=6, max=394, avg=50.13, stdev=44.38 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 12], 10.00th=[ 15], 20.00th=[ 20], | 30.00th=[ 24], 40.00th=[ 29], 50.00th=[ 36], 60.00th=[ 44], | 70.00th=[ 55], 80.00th=[ 73], 90.00th=[ 106], 95.00th=[ 144], | 99.00th=[ 230], 99.50th=[ 257], 99.90th=[ 279], 99.95th=[ 393], | 99.99th=[ 393] bw ( KiB/s): min= 7, max= 167, per=25.74%, avg=31.92, stdev=22.04, samples=366 iops : min= 1, max= 41, avg= 7.31, stdev= 5.53, samples=366 write: IOPS=8, BW=32.7KiB/s (33.5kB/s)(6260KiB/191187msec); 0 zone resets clat (msec): min=8, max=880, avg=73.60, stdev=54.70 lat (msec): min=8, max=880, avg=73.60, stdev=54.70 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 23], 10.00th=[ 27], 20.00th=[ 35], | 30.00th=[ 42], 40.00th=[ 48], 50.00th=[ 58], 60.00th=[ 70], | 70.00th=[ 86], 80.00th=[ 108], 90.00th=[ 138], 95.00th=[ 171], | 99.00th=[ 257], 99.50th=[ 305], 99.90th=[ 506], 99.95th=[ 877], | 99.99th=[ 877] bw ( KiB/s): min= 7, max= 110, per=25.29%, avg=32.88, stdev=20.11, samples=369 iops : min= 1, max= 27, avg= 7.55, stdev= 5.07, samples=369 lat (msec) : 10=1.79%, 20=10.68%, 50=41.63%, 100=28.78%, 250=16.28% lat (msec) : 500=0.78%, 750=0.03%, 1000=0.03% cpu : usr=0.06%, sys=1.54%, ctx=4599, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183122: Sat Sep 12 23:35:15 2026 read: IOPS=7, BW=31.5KiB/s (32.3kB/s)(6052KiB/191818msec) clat (msec): min=5, max=311, avg=50.95, stdev=44.47 lat (msec): min=5, max=311, avg=50.95, stdev=44.47 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 16], 20.00th=[ 21], | 30.00th=[ 25], 40.00th=[ 30], 50.00th=[ 36], 60.00th=[ 44], | 70.00th=[ 56], 80.00th=[ 73], 90.00th=[ 111], 95.00th=[ 146], | 99.00th=[ 218], 99.50th=[ 259], 99.90th=[ 309], 99.95th=[ 313], | 99.99th=[ 313] bw ( KiB/s): min= 7, max= 119, per=26.17%, avg=32.45, stdev=21.01, samples=361 iops : min= 1, max= 29, avg= 7.44, stdev= 5.28, samples=361 write: IOPS=8, BW=32.5KiB/s (33.3kB/s)(6236KiB/191818msec); 0 zone resets clat (msec): min=12, max=848, avg=73.25, stdev=52.39 lat (msec): min=12, max=848, avg=73.26, stdev=52.39 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 23], 10.00th=[ 27], 20.00th=[ 35], | 30.00th=[ 42], 40.00th=[ 50], 50.00th=[ 59], 60.00th=[ 70], | 70.00th=[ 84], 80.00th=[ 107], 90.00th=[ 140], 95.00th=[ 174], | 99.00th=[ 234], 99.50th=[ 257], 99.90th=[ 506], 99.95th=[ 852], | 99.99th=[ 852] bw ( KiB/s): min= 7, max= 127, per=24.99%, avg=32.49, stdev=19.50, samples=371 iops : min= 1, max= 31, avg= 7.46, stdev= 4.91, samples=371 lat (msec) : 10=1.20%, 20=10.03%, 50=42.51%, 100=28.74%, 250=16.89% lat (msec) : 500=0.55%, 750=0.03%, 1000=0.03% cpu : usr=0.06%, sys=1.57%, ctx=4566, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=125KiB/s (128kB/s), 30.9KiB/s-31.5KiB/s (31.6kB/s-32.3kB/s), io=23.4MiB (24.6MB), run=191187-192673msec WRITE: bw=130KiB/s (134kB/s), 32.5KiB/s-33.0KiB/s (33.3kB/s-33.8kB/s), io=24.6MiB (25.7MB), run=191187-192673msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=183168: Sat Sep 12 23:36:02 2026 read: IOPS=11, BW=176KiB/s (181kB/s)(5920KiB/33542msec) clat (usec): min=38, max=269044, avg=46366.76, stdev=31698.45 lat (usec): min=38, max=269045, avg=46386.50, stdev=31699.77 clat percentiles (usec): | 1.00th=[ 49], 5.00th=[ 80], 10.00th=[ 13829], 20.00th=[ 24773], | 30.00th=[ 29754], 40.00th=[ 35390], 50.00th=[ 41157], 60.00th=[ 49021], | 70.00th=[ 56361], 80.00th=[ 65274], 90.00th=[ 80217], 95.00th=[103285], | 99.00th=[149947], 99.50th=[223347], 99.90th=[270533], 99.95th=[270533], | 99.99th=[270533] bw ( KiB/s): min= 31, max= 480, per=24.84%, avg=176.38, stdev=81.03, samples=66 iops : min= 1, max= 30, avg=10.26, stdev= 5.15, samples=66 write: IOPS=11, BW=190KiB/s (194kB/s)(6368KiB/33542msec); 0 zone resets clat (usec): min=1261, max=220446, avg=40239.87, stdev=38748.59 lat (usec): min=1263, max=220449, avg=40249.53, stdev=38744.31 clat percentiles (usec): | 1.00th=[ 1713], 5.00th=[ 2147], 10.00th=[ 3261], 20.00th=[ 5735], | 30.00th=[ 12649], 40.00th=[ 21365], 50.00th=[ 29492], 60.00th=[ 39060], | 70.00th=[ 53216], 80.00th=[ 67634], 90.00th=[ 95945], 95.00th=[119014], | 99.00th=[175113], 99.50th=[198181], 99.90th=[221250], 99.95th=[221250], | 99.99th=[221250] bw ( KiB/s): min= 62, max= 540, per=25.74%, avg=192.29, stdev=86.56, samples=65 iops : min= 3, max= 33, avg=11.26, stdev= 5.48, samples=65 lat (usec) : 50=0.52%, 100=2.73%, 250=0.13%, 500=0.39% lat (msec) : 2=2.21%, 4=4.82%, 10=8.20%, 20=8.33%, 50=37.76% lat (msec) : 100=27.34%, 250=7.42%, 500=0.13% cpu : usr=0.06%, sys=5.38%, ctx=1834, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183170: Sat Sep 12 23:36:02 2026 read: IOPS=11, BW=177KiB/s (181kB/s)(5744KiB/32457msec) clat (usec): min=50, max=267021, avg=50129.26, stdev=34502.24 lat (usec): min=51, max=267024, avg=50133.19, stdev=34505.13 clat percentiles (usec): | 1.00th=[ 60], 5.00th=[ 81], 10.00th=[ 16909], 20.00th=[ 24773], | 30.00th=[ 32113], 40.00th=[ 38011], 50.00th=[ 44303], 60.00th=[ 53216], | 70.00th=[ 61080], 80.00th=[ 70779], 90.00th=[ 87557], 95.00th=[111674], | 99.00th=[181404], 99.50th=[242222], 99.90th=[267387], 99.95th=[267387], | 99.99th=[267387] bw ( KiB/s): min= 31, max= 313, per=24.89%, avg=176.69, stdev=66.32, samples=64 iops : min= 1, max= 19, avg=10.28, stdev= 4.15, samples=64 write: IOPS=12, BW=202KiB/s (206kB/s)(6544KiB/32457msec); 0 zone resets clat (usec): min=1288, max=214216, avg=34916.97, stdev=34948.78 lat (usec): min=1290, max=214217, avg=34926.06, stdev=34950.32 clat percentiles (usec): | 1.00th=[ 1844], 5.00th=[ 2507], 10.00th=[ 3556], 20.00th=[ 6652], | 30.00th=[ 10290], 40.00th=[ 16188], 50.00th=[ 23725], 60.00th=[ 34866], | 70.00th=[ 45876], 80.00th=[ 56886], 90.00th=[ 81265], 95.00th=[107480], | 99.00th=[143655], 99.50th=[173016], 99.90th=[214959], 99.95th=[214959], | 99.99th=[214959] bw ( KiB/s): min= 31, max= 544, per=26.91%, avg=201.05, stdev=91.98, samples=64 iops : min= 1, max= 34, avg=11.81, stdev= 5.80, samples=64 lat (usec) : 100=2.47%, 250=0.78%, 500=0.13%, 1000=0.13% lat (msec) : 2=1.43%, 4=4.95%, 10=9.64%, 20=10.68%, 50=36.33% lat (msec) : 100=26.56%, 250=6.77%, 500=0.13% cpu : usr=0.10%, sys=5.87%, ctx=1818, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183171: Sat Sep 12 23:36:02 2026 read: IOPS=11, BW=187KiB/s (191kB/s)(6256KiB/33508msec) clat (usec): min=51, max=289171, avg=48586.39, stdev=32055.60 lat (usec): min=52, max=289173, avg=48588.25, stdev=32055.74 clat percentiles (usec): | 1.00th=[ 58], 5.00th=[ 83], 10.00th=[ 18220], 20.00th=[ 26870], | 30.00th=[ 32113], 40.00th=[ 36963], 50.00th=[ 44827], 60.00th=[ 51119], | 70.00th=[ 57410], 80.00th=[ 65799], 90.00th=[ 82314], 95.00th=[106431], | 99.00th=[156238], 99.50th=[173016], 99.90th=[287310], 99.95th=[287310], | 99.99th=[287310] bw ( KiB/s): min= 31, max= 378, per=26.32%, avg=186.89, stdev=76.76, samples=66 iops : min= 1, max= 23, avg=10.92, stdev= 4.85, samples=66 write: IOPS=11, BW=180KiB/s (184kB/s)(6032KiB/33508msec); 0 zone resets clat (usec): min=1625, max=211347, avg=37565.47, stdev=36498.32 lat (usec): min=1628, max=211351, avg=37576.92, stdev=36505.26 clat percentiles (usec): | 1.00th=[ 1680], 5.00th=[ 2442], 10.00th=[ 3654], 20.00th=[ 6456], | 30.00th=[ 11469], 40.00th=[ 20317], 50.00th=[ 27395], 60.00th=[ 36439], | 70.00th=[ 45351], 80.00th=[ 63701], 90.00th=[ 84411], 95.00th=[115868], | 99.00th=[173016], 99.50th=[191890], 99.90th=[210764], 99.95th=[210764], | 99.99th=[210764] bw ( KiB/s): min= 31, max= 413, per=23.94%, avg=178.82, stdev=90.41, samples=66 iops : min= 1, max= 25, avg=10.41, stdev= 5.71, samples=66 lat (usec) : 100=2.86%, 250=0.52%, 750=0.13%, 1000=0.13% lat (msec) : 2=1.30%, 4=4.56%, 10=7.94%, 20=7.81%, 50=40.76% lat (msec) : 100=27.47%, 250=6.38%, 500=0.13% cpu : usr=0.08%, sys=5.65%, ctx=1818, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183172: Sat Sep 12 23:36:02 2026 read: IOPS=11, BW=179KiB/s (183kB/s)(6032KiB/33692msec) clat (usec): min=44, max=187498, avg=47581.77, stdev=30805.63 lat (usec): min=44, max=187499, avg=47583.49, stdev=30805.65 clat percentiles (usec): | 1.00th=[ 55], 5.00th=[ 77], 10.00th=[ 12649], 20.00th=[ 24773], | 30.00th=[ 30540], 40.00th=[ 35914], 50.00th=[ 44303], 60.00th=[ 50070], | 70.00th=[ 59507], 80.00th=[ 69731], 90.00th=[ 86508], 95.00th=[103285], | 99.00th=[147850], 99.50th=[166724], 99.90th=[187696], 99.95th=[187696], | 99.99th=[187696] bw ( KiB/s): min= 63, max= 381, per=25.29%, avg=179.54, stdev=72.84, samples=65 iops : min= 3, max= 23, avg=10.46, stdev= 4.60, samples=65 write: IOPS=11, BW=186KiB/s (190kB/s)(6256KiB/33692msec); 0 zone resets clat (usec): min=1466, max=187358, avg=39133.25, stdev=37513.77 lat (usec): min=1468, max=187360, avg=39137.84, stdev=37513.80 clat percentiles (usec): | 1.00th=[ 1713], 5.00th=[ 2409], 10.00th=[ 3818], 20.00th=[ 7701], | 30.00th=[ 12256], 40.00th=[ 19530], 50.00th=[ 28443], 60.00th=[ 36963], | 70.00th=[ 48497], 80.00th=[ 65274], 90.00th=[ 91751], 95.00th=[115868], | 99.00th=[168821], 99.50th=[183501], 99.90th=[187696], 99.95th=[187696], | 99.99th=[187696] bw ( KiB/s): min= 62, max= 352, per=24.71%, avg=184.56, stdev=79.23, samples=66 iops : min= 3, max= 22, avg=10.77, stdev= 5.04, samples=66 lat (usec) : 50=0.26%, 100=3.26%, 250=0.52%, 500=0.13%, 750=0.26% lat (usec) : 1000=0.13% lat (msec) : 2=1.95%, 4=3.65%, 10=7.55%, 20=10.29%, 50=36.98% lat (msec) : 100=27.99%, 250=7.03% cpu : usr=0.06%, sys=5.38%, ctx=1807, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=711KiB/s (728kB/s), 176KiB/s-187KiB/s (181kB/s-191kB/s), io=23.4MiB (24.5MB), run=32457-33692msec WRITE: bw=748KiB/s (766kB/s), 180KiB/s-202KiB/s (184kB/s-206kB/s), io=24.6MiB (25.8MB), run=32457-33692msec rand-rw: (groupid=0, jobs=1): err= 0: pid=183165: Sat Sep 12 23:36:12 2026 read: IOPS=8, BW=134KiB/s (137kB/s)(5920KiB/44115msec) clat (msec): min=5, max=259, avg=47.12, stdev=41.37 lat (msec): min=5, max=259, avg=47.12, stdev=41.37 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 14], 20.00th=[ 18], | 30.00th=[ 22], 40.00th=[ 27], 50.00th=[ 33], 60.00th=[ 41], | 70.00th=[ 52], 80.00th=[ 71], 90.00th=[ 97], 95.00th=[ 129], | 99.00th=[ 207], 99.50th=[ 253], 99.90th=[ 259], 99.95th=[ 259], | 99.99th=[ 259] bw ( KiB/s): min= 31, max= 478, per=25.44%, avg=136.34, stdev=89.82, samples=85 iops : min= 1, max= 29, avg= 7.72, stdev= 5.67, samples=85 write: IOPS=9, BW=144KiB/s (148kB/s)(6368KiB/44115msec); 0 zone resets clat (msec): min=12, max=312, avg=66.34, stdev=46.96 lat (msec): min=12, max=312, avg=66.35, stdev=46.96 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 24], 10.00th=[ 27], 20.00th=[ 31], | 30.00th=[ 37], 40.00th=[ 45], 50.00th=[ 53], 60.00th=[ 61], | 70.00th=[ 74], 80.00th=[ 96], 90.00th=[ 128], 95.00th=[ 161], | 99.00th=[ 245], 99.50th=[ 296], 99.90th=[ 313], 99.95th=[ 313], | 99.99th=[ 313] bw ( KiB/s): min= 29, max= 381, per=25.45%, avg=143.52, stdev=86.29, samples=87 iops : min= 1, max= 23, avg= 8.16, stdev= 5.48, samples=87 lat (msec) : 10=1.56%, 20=11.98%, 50=44.14%, 100=28.52%, 250=13.15% lat (msec) : 500=0.65% cpu : usr=0.05%, sys=1.73%, ctx=1155, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183166: Sat Sep 12 23:36:12 2026 read: IOPS=8, BW=129KiB/s (132kB/s)(5744KiB/44680msec) clat (msec): min=5, max=253, avg=45.25, stdev=41.23 lat (msec): min=5, max=253, avg=45.25, stdev=41.23 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 15], 20.00th=[ 20], | 30.00th=[ 23], 40.00th=[ 26], 50.00th=[ 32], 60.00th=[ 39], | 70.00th=[ 47], 80.00th=[ 63], 90.00th=[ 94], 95.00th=[ 142], | 99.00th=[ 211], 99.50th=[ 249], 99.90th=[ 253], 99.95th=[ 253], | 99.99th=[ 253] bw ( KiB/s): min= 29, max= 444, per=24.63%, avg=132.01, stdev=94.81, samples=85 iops : min= 1, max= 27, avg= 7.44, stdev= 5.99, samples=85 write: IOPS=9, BW=146KiB/s (150kB/s)(6544KiB/44680msec); 0 zone resets clat (msec): min=15, max=312, avg=68.36, stdev=49.47 lat (msec): min=15, max=312, avg=68.37, stdev=49.47 clat percentiles (msec): | 1.00th=[ 18], 5.00th=[ 23], 10.00th=[ 26], 20.00th=[ 31], | 30.00th=[ 36], 40.00th=[ 41], 50.00th=[ 50], 60.00th=[ 64], | 70.00th=[ 82], 80.00th=[ 102], 90.00th=[ 140], 95.00th=[ 167], | 99.00th=[ 243], 99.50th=[ 288], 99.90th=[ 313], 99.95th=[ 313], | 99.99th=[ 313] bw ( KiB/s): min= 31, max= 411, per=26.14%, avg=147.44, stdev=88.68, samples=87 iops : min= 1, max= 25, avg= 8.41, stdev= 5.62, samples=87 lat (msec) : 10=1.30%, 20=10.29%, 50=50.13%, 100=23.18%, 250=14.45% lat (msec) : 500=0.65% cpu : usr=0.08%, sys=1.69%, ctx=1178, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183167: Sat Sep 12 23:36:12 2026 read: IOPS=8, BW=141KiB/s (144kB/s)(6256KiB/44430msec) clat (msec): min=7, max=334, avg=46.85, stdev=41.44 lat (msec): min=7, max=334, avg=46.85, stdev=41.44 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 15], 20.00th=[ 19], | 30.00th=[ 23], 40.00th=[ 27], 50.00th=[ 32], 60.00th=[ 40], | 70.00th=[ 54], 80.00th=[ 68], 90.00th=[ 102], 95.00th=[ 127], | 99.00th=[ 211], 99.50th=[ 255], 99.90th=[ 334], 99.95th=[ 334], | 99.99th=[ 334] bw ( KiB/s): min= 31, max= 510, per=26.79%, avg=143.58, stdev=99.43, samples=85 iops : min= 1, max= 31, avg= 8.16, stdev= 6.28, samples=85 write: IOPS=8, BW=136KiB/s (139kB/s)(6032KiB/44430msec); 0 zone resets clat (msec): min=13, max=293, avg=68.09, stdev=45.54 lat (msec): min=13, max=293, avg=68.09, stdev=45.54 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 22], 10.00th=[ 26], 20.00th=[ 32], | 30.00th=[ 37], 40.00th=[ 44], 50.00th=[ 54], 60.00th=[ 67], | 70.00th=[ 81], 80.00th=[ 105], 90.00th=[ 131], 95.00th=[ 161], | 99.00th=[ 218], 99.50th=[ 226], 99.90th=[ 292], 99.95th=[ 292], | 99.99th=[ 292] bw ( KiB/s): min= 29, max= 406, per=23.63%, avg=133.26, stdev=80.82, samples=87 iops : min= 1, max= 25, avg= 7.52, stdev= 5.11, samples=87 lat (msec) : 10=1.30%, 20=12.63%, 50=44.01%, 100=25.91%, 250=15.76% lat (msec) : 500=0.39% cpu : usr=0.05%, sys=1.71%, ctx=1192, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183169: Sat Sep 12 23:36:12 2026 read: IOPS=8, BW=136KiB/s (140kB/s)(6032KiB/44238msec) clat (msec): min=6, max=333, avg=46.73, stdev=42.99 lat (msec): min=6, max=333, avg=46.74, stdev=43.00 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 13], 10.00th=[ 14], 20.00th=[ 18], | 30.00th=[ 22], 40.00th=[ 26], 50.00th=[ 32], 60.00th=[ 38], | 70.00th=[ 48], 80.00th=[ 63], 90.00th=[ 114], 95.00th=[ 140], | 99.00th=[ 205], 99.50th=[ 224], 99.90th=[ 334], 99.95th=[ 334], | 99.99th=[ 334] bw ( KiB/s): min= 29, max= 445, per=25.36%, avg=135.94, stdev=90.25, samples=86 iops : min= 1, max= 27, avg= 7.67, stdev= 5.70, samples=86 write: IOPS=8, BW=141KiB/s (145kB/s)(6256KiB/44238msec); 0 zone resets clat (msec): min=15, max=291, avg=67.82, stdev=46.38 lat (msec): min=15, max=291, avg=67.83, stdev=46.40 clat percentiles (msec): | 1.00th=[ 18], 5.00th=[ 22], 10.00th=[ 25], 20.00th=[ 31], | 30.00th=[ 37], 40.00th=[ 45], 50.00th=[ 52], 60.00th=[ 65], | 70.00th=[ 83], 80.00th=[ 99], 90.00th=[ 134], 95.00th=[ 157], | 99.00th=[ 259], 99.50th=[ 288], 99.90th=[ 292], 99.95th=[ 292], | 99.99th=[ 292] bw ( KiB/s): min= 31, max= 382, per=24.91%, avg=140.48, stdev=84.15, samples=87 iops : min= 1, max= 23, avg= 7.98, stdev= 5.34, samples=87 lat (msec) : 10=1.30%, 20=13.54%, 50=44.01%, 100=25.91%, 250=14.58% lat (msec) : 500=0.65% cpu : usr=0.05%, sys=1.76%, ctx=1152, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=536KiB/s (549kB/s), 129KiB/s-141KiB/s (132kB/s-144kB/s), io=23.4MiB (24.5MB), run=44115-44680msec WRITE: bw=564KiB/s (578kB/s), 136KiB/s-146KiB/s (139kB/s-150kB/s), io=24.6MiB (25.8MB), run=44115-44680msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=183191: Sat Sep 12 23:36:24 2026 read: IOPS=2, BW=2317KiB/s (2373kB/s)(7168KiB/3093msec) clat (usec): min=524, max=1034.4k, avg=256770.15, stdev=356345.26 lat (usec): min=525, max=1034.4k, avg=256771.54, stdev=356345.17 clat percentiles (usec): | 1.00th=[ 523], 5.00th=[ 523], 10.00th=[ 523], | 20.00th=[ 553], 30.00th=[ 143655], 40.00th=[ 143655], | 50.00th=[ 170918], 60.00th=[ 181404], 70.00th=[ 181404], | 80.00th=[ 265290], 90.00th=[1035994], 95.00th=[1035994], | 99.00th=[1035994], 99.50th=[1035994], 99.90th=[1035994], | 99.95th=[1035994], 99.99th=[1035994] bw ( KiB/s): min= 4071, max= 4537, per=81.07%, avg=4304.00, stdev=329.51, samples=2 iops : min= 3, max= 4, avg= 3.50, stdev= 0.71, samples=2 write: IOPS=1, BW=1655KiB/s (1695kB/s)(5120KiB/3093msec); 0 zone resets clat (msec): min=72, max=436, avg=233.38, stdev=150.38 lat (msec): min=72, max=436, avg=233.49, stdev=150.40 clat percentiles (msec): | 1.00th=[ 73], 5.00th=[ 73], 10.00th=[ 73], 20.00th=[ 73], | 30.00th=[ 103], 40.00th=[ 103], 50.00th=[ 243], 60.00th=[ 243], | 70.00th=[ 313], 80.00th=[ 313], 90.00th=[ 439], 95.00th=[ 439], | 99.00th=[ 439], 99.50th=[ 439], 99.90th=[ 439], 99.95th=[ 439], | 99.99th=[ 439] bw ( KiB/s): min= 1965, max= 4063, per=36.16%, avg=2687.67, stdev=1191.59, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (usec) : 750=16.67% lat (msec) : 100=8.33%, 250=41.67%, 500=25.00%, 2000=8.33% cpu : usr=0.00%, sys=15.30%, ctx=186, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183192: Sat Sep 12 23:36:24 2026 read: IOPS=0, BW=531KiB/s (544kB/s)(2048KiB/3857msec) clat (msec): min=169, max=174, avg=171.89, stdev= 3.29 lat (msec): min=169, max=174, avg=171.89, stdev= 3.29 clat percentiles (msec): | 1.00th=[ 169], 5.00th=[ 169], 10.00th=[ 169], 20.00th=[ 169], | 30.00th=[ 169], 40.00th=[ 169], 50.00th=[ 169], 60.00th=[ 176], | 70.00th=[ 176], 80.00th=[ 176], 90.00th=[ 176], 95.00th=[ 176], | 99.00th=[ 176], 99.50th=[ 176], 99.90th=[ 176], 99.95th=[ 176], | 99.99th=[ 176] bw ( KiB/s): min= 1410, max= 2031, per=32.41%, avg=1720.50, stdev=439.11, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2655KiB/s (2719kB/s)(10.0MiB/3857msec); 0 zone resets clat (msec): min=162, max=753, avg=344.94, stdev=196.16 lat (msec): min=162, max=753, avg=345.03, stdev=196.15 clat percentiles (msec): | 1.00th=[ 163], 5.00th=[ 163], 10.00th=[ 163], 20.00th=[ 188], | 30.00th=[ 215], 40.00th=[ 230], 50.00th=[ 243], 60.00th=[ 271], | 70.00th=[ 376], 80.00th=[ 401], 90.00th=[ 609], 95.00th=[ 751], | 99.00th=[ 751], 99.50th=[ 751], 99.90th=[ 751], 99.95th=[ 751], | 99.99th=[ 751] bw ( KiB/s): min= 2011, max= 4096, per=39.62%, avg=2945.00, stdev=1021.54, samples=6 iops : min= 1, max= 4, avg= 2.17, stdev= 1.33, samples=6 lat (msec) : 250=58.33%, 500=25.00%, 750=8.33%, 1000=8.33% cpu : usr=0.03%, sys=14.81%, ctx=262, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183193: Sat Sep 12 23:36:24 2026 read: IOPS=1, BW=1793KiB/s (1836kB/s)(6144KiB/3426msec) clat (msec): min=116, max=288, avg=222.17, stdev=68.45 lat (msec): min=116, max=288, avg=222.17, stdev=68.45 clat percentiles (msec): | 1.00th=[ 117], 5.00th=[ 117], 10.00th=[ 117], 20.00th=[ 174], | 30.00th=[ 174], 40.00th=[ 211], 50.00th=[ 211], 60.00th=[ 262], | 70.00th=[ 284], 80.00th=[ 284], 90.00th=[ 288], 95.00th=[ 288], | 99.00th=[ 288], 99.50th=[ 288], 99.90th=[ 288], 99.95th=[ 288], | 99.99th=[ 288] bw ( KiB/s): min= 2011, max= 3567, per=45.41%, avg=2411.00, stdev=770.74, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 write: IOPS=1, BW=1793KiB/s (1836kB/s)(6144KiB/3426msec); 0 zone resets clat (msec): min=178, max=565, avg=326.57, stdev=134.76 lat (msec): min=178, max=566, avg=326.67, stdev=134.75 clat percentiles (msec): | 1.00th=[ 178], 5.00th=[ 178], 10.00th=[ 178], 20.00th=[ 228], | 30.00th=[ 228], 40.00th=[ 309], 50.00th=[ 309], 60.00th=[ 317], | 70.00th=[ 363], 80.00th=[ 363], 90.00th=[ 567], 95.00th=[ 567], | 99.00th=[ 567], 99.50th=[ 567], 99.90th=[ 567], 99.95th=[ 567], | 99.99th=[ 567] bw ( KiB/s): min= 1965, max= 2913, per=29.48%, avg=2191.00, stdev=404.57, samples=5 iops : min= 1, max= 2, avg= 1.20, stdev= 0.45, samples=5 lat (msec) : 250=41.67%, 500=50.00%, 750=8.33% cpu : usr=0.00%, sys=16.26%, ctx=210, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183194: Sat Sep 12 23:36:24 2026 read: IOPS=1, BW=1577KiB/s (1615kB/s)(5120KiB/3247msec) clat (usec): min=440, max=695348, avg=176516.86, stdev=294619.14 lat (usec): min=441, max=695350, avg=176518.17, stdev=294619.26 clat percentiles (usec): | 1.00th=[ 441], 5.00th=[ 441], 10.00th=[ 441], 20.00th=[ 441], | 30.00th=[ 627], 40.00th=[ 627], 50.00th=[ 60031], 60.00th=[ 60031], | 70.00th=[126354], 80.00th=[126354], 90.00th=[692061], 95.00th=[692061], | 99.00th=[692061], 99.50th=[692061], 99.90th=[692061], 99.95th=[692061], | 99.99th=[692061] bw ( KiB/s): min= 8126, max= 8126, per=100.00%, avg=8126.00, stdev= 0.00, samples=1 iops : min= 7, max= 7, avg= 7.00, stdev= 0.00, samples=1 write: IOPS=2, BW=2208KiB/s (2261kB/s)(7168KiB/3247msec); 0 zone resets clat (msec): min=112, max=487, avg=317.58, stdev=133.73 lat (msec): min=112, max=488, avg=317.74, stdev=133.87 clat percentiles (msec): | 1.00th=[ 113], 5.00th=[ 113], 10.00th=[ 113], 20.00th=[ 197], | 30.00th=[ 305], 40.00th=[ 305], 50.00th=[ 330], 60.00th=[ 330], | 70.00th=[ 330], 80.00th=[ 464], 90.00th=[ 489], 95.00th=[ 489], | 99.00th=[ 489], 99.50th=[ 489], 99.90th=[ 489], 99.95th=[ 489], | 99.99th=[ 489] bw ( KiB/s): min= 1526, max= 3930, per=32.46%, avg=2413.00, stdev=1320.03, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (usec) : 500=8.33%, 750=8.33% lat (msec) : 100=8.33%, 250=25.00%, 500=41.67%, 750=8.33% cpu : usr=0.03%, sys=14.88%, ctx=160, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5310KiB/s (5437kB/s), 531KiB/s-2317KiB/s (544kB/s-2373kB/s), io=20.0MiB (20.0MB), run=3093-3857msec WRITE: bw=7434KiB/s (7612kB/s), 1655KiB/s-2655KiB/s (1695kB/s-2719kB/s), io=28.0MiB (29.4MB), run=3093-3857msec rand-rw: (groupid=0, jobs=1): err= 0: pid=183196: Sat Sep 12 23:36:25 2026 read: IOPS=2, BW=2092KiB/s (2142kB/s)(7168KiB/3426msec) clat (msec): min=75, max=685, avg=325.79, stdev=282.32 lat (msec): min=75, max=685, avg=325.79, stdev=282.32 clat percentiles (msec): | 1.00th=[ 77], 5.00th=[ 77], 10.00th=[ 77], 20.00th=[ 102], | 30.00th=[ 115], 40.00th=[ 115], 50.00th=[ 115], 60.00th=[ 558], | 70.00th=[ 558], 80.00th=[ 625], 90.00th=[ 684], 95.00th=[ 684], | 99.00th=[ 684], 99.50th=[ 684], 99.90th=[ 684], 99.95th=[ 684], | 99.99th=[ 684] bw ( KiB/s): min= 1969, max= 4063, per=47.61%, avg=2528.50, stdev=1023.56, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 write: IOPS=1, BW=1494KiB/s (1530kB/s)(5120KiB/3426msec); 0 zone resets clat (msec): min=95, max=137, avg=116.70, stdev=15.67 lat (msec): min=95, max=138, avg=116.79, stdev=15.65 clat percentiles (msec): | 1.00th=[ 95], 5.00th=[ 95], 10.00th=[ 95], 20.00th=[ 95], | 30.00th=[ 111], 40.00th=[ 111], 50.00th=[ 118], 60.00th=[ 118], | 70.00th=[ 123], 80.00th=[ 123], 90.00th=[ 138], 95.00th=[ 138], | 99.00th=[ 138], 99.50th=[ 138], 99.90th=[ 138], 99.95th=[ 138], | 99.99th=[ 138] bw ( KiB/s): min= 6095, max= 6095, per=81.98%, avg=6095.00, stdev= 0.00, samples=1 iops : min= 5, max= 5, avg= 5.00, stdev= 0.00, samples=1 lat (msec) : 100=16.67%, 250=58.33%, 750=25.00% cpu : usr=0.00%, sys=5.55%, ctx=82, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183197: Sat Sep 12 23:36:25 2026 read: IOPS=0, BW=578KiB/s (592kB/s)(2048KiB/3542msec) clat (msec): min=102, max=530, avg=316.72, stdev=302.39 lat (msec): min=102, max=530, avg=316.72, stdev=302.39 clat percentiles (msec): | 1.00th=[ 104], 5.00th=[ 104], 10.00th=[ 104], 20.00th=[ 104], | 30.00th=[ 104], 40.00th=[ 104], 50.00th=[ 104], 60.00th=[ 531], | 70.00th=[ 531], 80.00th=[ 531], 90.00th=[ 531], 95.00th=[ 531], | 99.00th=[ 531], 99.50th=[ 531], 99.90th=[ 531], 99.95th=[ 531], | 99.99th=[ 531] bw ( KiB/s): min= 1980, max= 2031, per=37.76%, avg=2005.50, stdev=36.06, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2891KiB/s (2960kB/s)(10.0MiB/3542msec); 0 zone resets clat (msec): min=100, max=933, avg=269.72, stdev=250.10 lat (msec): min=101, max=933, avg=269.81, stdev=250.11 clat percentiles (msec): | 1.00th=[ 102], 5.00th=[ 102], 10.00th=[ 102], 20.00th=[ 110], | 30.00th=[ 131], 40.00th=[ 131], 50.00th=[ 146], 60.00th=[ 205], | 70.00th=[ 266], 80.00th=[ 313], 90.00th=[ 363], 95.00th=[ 936], | 99.00th=[ 936], 99.50th=[ 936], 99.90th=[ 936], 99.95th=[ 936], | 99.99th=[ 936] bw ( KiB/s): min= 4063, max= 4087, per=54.83%, avg=4076.33, stdev=12.22, samples=3 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=3 lat (msec) : 250=58.33%, 500=25.00%, 750=8.33%, 1000=8.33% cpu : usr=0.06%, sys=5.00%, ctx=75, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183198: Sat Sep 12 23:36:25 2026 read: IOPS=1, BW=1688KiB/s (1728kB/s)(6144KiB/3640msec) clat (msec): min=86, max=614, avg=187.53, stdev=209.67 lat (msec): min=86, max=614, avg=187.53, stdev=209.67 clat percentiles (msec): | 1.00th=[ 87], 5.00th=[ 87], 10.00th=[ 87], 20.00th=[ 101], | 30.00th=[ 101], 40.00th=[ 102], 50.00th=[ 102], 60.00th=[ 103], | 70.00th=[ 121], 80.00th=[ 121], 90.00th=[ 617], 95.00th=[ 617], | 99.00th=[ 617], 99.50th=[ 617], 99.90th=[ 617], 99.95th=[ 617], | 99.99th=[ 617] bw ( KiB/s): min= 2031, max= 4079, per=47.98%, avg=2548.00, stdev=1020.68, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 write: IOPS=1, BW=1688KiB/s (1728kB/s)(6144KiB/3640msec); 0 zone resets clat (msec): min=116, max=582, avg=317.50, stdev=194.16 lat (msec): min=116, max=582, avg=317.66, stdev=194.11 clat percentiles (msec): | 1.00th=[ 117], 5.00th=[ 117], 10.00th=[ 117], 20.00th=[ 157], | 30.00th=[ 157], 40.00th=[ 203], 50.00th=[ 203], 60.00th=[ 334], | 70.00th=[ 514], 80.00th=[ 514], 90.00th=[ 584], 95.00th=[ 584], | 99.00th=[ 584], 99.50th=[ 584], 99.90th=[ 584], 99.95th=[ 584], | 99.99th=[ 584] bw ( KiB/s): min= 1969, max= 4079, per=32.58%, avg=2422.00, stdev=926.90, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 lat (msec) : 100=8.33%, 250=58.33%, 500=8.33%, 750=25.00% cpu : usr=0.00%, sys=5.80%, ctx=96, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183199: Sat Sep 12 23:36:25 2026 read: IOPS=1, BW=1328KiB/s (1360kB/s)(5120KiB/3856msec) clat (msec): min=101, max=586, avg=275.58, stdev=225.83 lat (msec): min=101, max=586, avg=275.58, stdev=225.83 clat percentiles (msec): | 1.00th=[ 102], 5.00th=[ 102], 10.00th=[ 102], 20.00th=[ 102], | 30.00th=[ 113], 40.00th=[ 113], 50.00th=[ 131], 60.00th=[ 131], | 70.00th=[ 447], 80.00th=[ 447], 90.00th=[ 584], 95.00th=[ 584], | 99.00th=[ 584], 99.50th=[ 584], 99.90th=[ 584], 99.95th=[ 584], | 99.99th=[ 584] bw ( KiB/s): min= 2039, max= 4063, per=51.12%, avg=2715.00, stdev=1167.40, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 write: IOPS=1, BW=1859KiB/s (1904kB/s)(7168KiB/3856msec); 0 zone resets clat (msec): min=114, max=632, avg=328.78, stdev=211.43 lat (msec): min=114, max=632, avg=328.89, stdev=211.42 clat percentiles (msec): | 1.00th=[ 115], 5.00th=[ 115], 10.00th=[ 115], 20.00th=[ 117], | 30.00th=[ 134], 40.00th=[ 134], 50.00th=[ 380], 60.00th=[ 397], | 70.00th=[ 397], 80.00th=[ 531], 90.00th=[ 634], 95.00th=[ 634], | 99.00th=[ 634], 99.50th=[ 634], 99.90th=[ 634], 99.95th=[ 634], | 99.99th=[ 634] bw ( KiB/s): min= 1969, max= 2043, per=27.09%, avg=2014.00, stdev=36.30, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 lat (msec) : 250=50.00%, 500=25.00%, 750=25.00% cpu : usr=0.00%, sys=5.63%, ctx=64, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5311KiB/s (5439kB/s), 578KiB/s-2092KiB/s (592kB/s-2142kB/s), io=20.0MiB (20.0MB), run=3426-3856msec WRITE: bw=7436KiB/s (7614kB/s), 1494KiB/s-2891KiB/s (1530kB/s-2960kB/s), io=28.0MiB (29.4MB), run=3426-3856msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=183205: Sat Sep 12 23:36:40 2026 read: IOPS=1, BW=4737KiB/s (4851kB/s)(12.0MiB/2594msec) clat (msec): min=823, max=859, avg=840.45, stdev=18.13 lat (msec): min=823, max=859, avg=840.45, stdev=18.13 clat percentiles (msec): | 1.00th=[ 827], 5.00th=[ 827], 10.00th=[ 827], 20.00th=[ 827], | 30.00th=[ 827], 40.00th=[ 835], 50.00th=[ 835], 60.00th=[ 835], | 70.00th=[ 860], 80.00th=[ 860], 90.00th=[ 860], 95.00th=[ 860], | 99.00th=[ 860], 99.50th=[ 860], 99.90th=[ 860], 99.95th=[ 860], | 99.99th=[ 860] bw ( KiB/s): min= 8062, max= 8110, per=100.00%, avg=8086.00, stdev=33.94, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=100.00% cpu : usr=0.00%, sys=13.11%, ctx=380, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183206: Sat Sep 12 23:36:40 2026 read: IOPS=0, BW=1433KiB/s (1468kB/s)(4096KiB/2858msec) clat (nsec): min=817106k, max=817106k, avg=817106454.00, stdev= 0.00 lat (nsec): min=817109k, max=817109k, avg=817108674.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 818], 5.00th=[ 818], 10.00th=[ 818], 20.00th=[ 818], | 30.00th=[ 818], 40.00th=[ 818], 50.00th=[ 818], 60.00th=[ 818], | 70.00th=[ 818], 80.00th=[ 818], 90.00th=[ 818], 95.00th=[ 818], | 99.00th=[ 818], 99.50th=[ 818], 99.90th=[ 818], 99.95th=[ 818], | 99.99th=[ 818] bw ( KiB/s): min= 8062, max= 8062, per=100.00%, avg=8062.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2866KiB/s (2935kB/s)(8192KiB/2858msec); 0 zone resets clat (msec): min=836, max=1014, avg=925.34, stdev=125.86 lat (msec): min=836, max=1016, avg=926.45, stdev=126.87 clat percentiles (msec): | 1.00th=[ 835], 5.00th=[ 835], 10.00th=[ 835], 20.00th=[ 835], | 30.00th=[ 835], 40.00th=[ 835], 50.00th=[ 835], 60.00th=[ 1011], | 70.00th=[ 1011], 80.00th=[ 1011], 90.00th=[ 1011], 95.00th=[ 1011], | 99.00th=[ 1011], 99.50th=[ 1011], 99.90th=[ 1011], 99.95th=[ 1011], | 99.99th=[ 1011] bw ( KiB/s): min= 8110, max= 8110, per=94.52%, avg=8110.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 1000=66.67%, 2000=33.33% cpu : usr=0.00%, sys=4.87%, ctx=103, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183207: Sat Sep 12 23:36:40 2026 write: IOPS=0, BW=3218KiB/s (3295kB/s)(12.0MiB/3819msec); 0 zone resets clat (msec): min=226, max=2355, avg=1255.65, stdev=1066.25 lat (msec): min=226, max=2355, avg=1256.03, stdev=1066.26 clat percentiles (msec): | 1.00th=[ 226], 5.00th=[ 226], 10.00th=[ 226], 20.00th=[ 226], | 30.00th=[ 226], 40.00th=[ 1183], 50.00th=[ 1183], 60.00th=[ 1183], | 70.00th=[ 2366], 80.00th=[ 2366], 90.00th=[ 2366], 95.00th=[ 2366], | 99.00th=[ 2366], 99.50th=[ 2366], 99.90th=[ 2366], 99.95th=[ 2366], | 99.99th=[ 2366] bw ( KiB/s): min= 8000, max= 8062, per=93.60%, avg=8031.00, stdev=43.84, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 250=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.05%, sys=3.64%, ctx=98, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183208: Sat Sep 12 23:36:40 2026 write: IOPS=1, BW=4637KiB/s (4748kB/s)(12.0MiB/2650msec); 0 zone resets clat (msec): min=592, max=1187, avg=874.22, stdev=298.81 lat (msec): min=593, max=1188, avg=875.26, stdev=298.68 clat percentiles (msec): | 1.00th=[ 592], 5.00th=[ 592], 10.00th=[ 592], 20.00th=[ 592], | 30.00th=[ 592], 40.00th=[ 844], 50.00th=[ 844], 60.00th=[ 844], | 70.00th=[ 1183], 80.00th=[ 1183], 90.00th=[ 1183], 95.00th=[ 1183], | 99.00th=[ 1183], 99.50th=[ 1183], 99.90th=[ 1183], 99.95th=[ 1183], | 99.99th=[ 1183] bw ( KiB/s): min= 8062, max= 8078, per=94.06%, avg=8070.00, stdev=11.31, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=4.19%, ctx=49, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5733KiB/s (5870kB/s), 1433KiB/s-4737KiB/s (1468kB/s-4851kB/s), io=16.0MiB (16.8MB), run=2594-2858msec WRITE: bw=8580KiB/s (8786kB/s), 2866KiB/s-4637KiB/s (2935kB/s-4748kB/s), io=32.0MiB (33.6MB), run=2650-3819msec rand-rw: (groupid=0, jobs=1): err= 0: pid=183210: Sat Sep 12 23:36:40 2026 read: IOPS=0, BW=4010KiB/s (4107kB/s)(12.0MiB/3064msec) clat (msec): min=248, max=1786, avg=1018.26, stdev=769.05 lat (msec): min=248, max=1786, avg=1018.26, stdev=769.05 clat percentiles (msec): | 1.00th=[ 249], 5.00th=[ 249], 10.00th=[ 249], 20.00th=[ 249], | 30.00th=[ 249], 40.00th=[ 1020], 50.00th=[ 1020], 60.00th=[ 1020], | 70.00th=[ 1787], 80.00th=[ 1787], 90.00th=[ 1787], 95.00th=[ 1787], | 99.00th=[ 1787], 99.50th=[ 1787], 99.90th=[ 1787], 99.95th=[ 1787], | 99.99th=[ 1787] bw ( KiB/s): min= 8175, max= 8175, per=100.00%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 2000=66.67% cpu : usr=0.00%, sys=2.55%, ctx=129, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183211: Sat Sep 12 23:36:40 2026 read: IOPS=0, BW=1218KiB/s (1247kB/s)(4096KiB/3363msec) clat (nsec): min=1210.9M, max=1210.9M, avg=1210927641.00, stdev= 0.00 lat (nsec): min=1210.9M, max=1210.9M, avg=1210930779.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1217], 5.00th=[ 1217], 10.00th=[ 1217], 20.00th=[ 1217], | 30.00th=[ 1217], 40.00th=[ 1217], 50.00th=[ 1217], 60.00th=[ 1217], | 70.00th=[ 1217], 80.00th=[ 1217], 90.00th=[ 1217], 95.00th=[ 1217], | 99.00th=[ 1217], 99.50th=[ 1217], 99.90th=[ 1217], 99.95th=[ 1217], | 99.99th=[ 1217] bw ( KiB/s): min= 8159, max= 8159, per=100.00%, avg=8159.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2436KiB/s (2494kB/s)(8192KiB/3363msec); 0 zone resets clat (msec): min=1045, max=1079, avg=1062.54, stdev=23.90 lat (msec): min=1045, max=1079, avg=1062.84, stdev=24.02 clat percentiles (msec): | 1.00th=[ 1045], 5.00th=[ 1045], 10.00th=[ 1045], 20.00th=[ 1045], | 30.00th=[ 1045], 40.00th=[ 1045], 50.00th=[ 1045], 60.00th=[ 1083], | 70.00th=[ 1083], 80.00th=[ 1083], 90.00th=[ 1083], 95.00th=[ 1083], | 99.00th=[ 1083], 99.50th=[ 1083], 99.90th=[ 1083], 99.95th=[ 1083], | 99.99th=[ 1083] bw ( KiB/s): min= 8175, max= 8175, per=83.91%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 2000=100.00% cpu : usr=0.06%, sys=3.96%, ctx=56, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183212: Sat Sep 12 23:36:40 2026 write: IOPS=1, BW=4400KiB/s (4505kB/s)(12.0MiB/2793msec); 0 zone resets clat (msec): min=268, max=1567, avg=922.43, stdev=649.67 lat (msec): min=268, max=1567, avg=923.22, stdev=649.65 clat percentiles (msec): | 1.00th=[ 268], 5.00th=[ 268], 10.00th=[ 268], 20.00th=[ 268], | 30.00th=[ 268], 40.00th=[ 936], 50.00th=[ 936], 60.00th=[ 936], | 70.00th=[ 1569], 80.00th=[ 1569], 90.00th=[ 1569], 95.00th=[ 1569], | 99.00th=[ 1569], 99.50th=[ 1569], 99.90th=[ 1569], 99.95th=[ 1569], | 99.99th=[ 1569] bw ( KiB/s): min= 7907, max= 8094, per=82.12%, avg=8000.50, stdev=132.23, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.07%, sys=2.36%, ctx=33, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183213: Sat Sep 12 23:36:40 2026 write: IOPS=1, BW=4923KiB/s (5041kB/s)(12.0MiB/2496msec); 0 zone resets clat (msec): min=692, max=1012, avg=830.49, stdev=164.82 lat (msec): min=692, max=1013, avg=831.49, stdev=164.82 clat percentiles (msec): | 1.00th=[ 693], 5.00th=[ 693], 10.00th=[ 693], 20.00th=[ 693], | 30.00th=[ 693], 40.00th=[ 785], 50.00th=[ 785], 60.00th=[ 785], | 70.00th=[ 1011], 80.00th=[ 1011], 90.00th=[ 1011], 95.00th=[ 1011], | 99.00th=[ 1011], 99.50th=[ 1011], 99.90th=[ 1011], 99.95th=[ 1011], | 99.99th=[ 1011] bw ( KiB/s): min= 8159, max= 8175, per=83.82%, avg=8167.00, stdev=11.31, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=5.29%, ctx=52, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4872KiB/s (4989kB/s), 1218KiB/s-4010KiB/s (1247kB/s-4107kB/s), io=16.0MiB (16.8MB), run=3064-3363msec WRITE: bw=9744KiB/s (9978kB/s), 2436KiB/s-4923KiB/s (2494kB/s-5041kB/s), io=32.0MiB (33.6MB), run=2496-3363msec