== sanity test 398b: DIO and buffer IO race ============== 11:44:54 (1788363894) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 3.06886 s, 16.4 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=181303: Wed Sep 2 11:46:03 2026 read: IOPS=25, BW=101KiB/s (104kB/s)(5992KiB/59169msec) clat (usec): min=61, max=720734, avg=21293.91, stdev=21262.15 lat (usec): min=62, max=720736, avg=21297.20, stdev=21262.79 clat percentiles (usec): | 1.00th=[ 110], 5.00th=[ 7635], 10.00th=[ 9765], 20.00th=[ 11994], | 30.00th=[ 14091], 40.00th=[ 16450], 50.00th=[ 19006], 60.00th=[ 21365], | 70.00th=[ 24511], 80.00th=[ 28705], 90.00th=[ 35390], 95.00th=[ 41157], | 99.00th=[ 61080], 99.50th=[ 69731], 99.90th=[ 96994], 99.95th=[717226], | 99.99th=[717226] bw ( KiB/s): min= 13, max= 176, per=25.25%, avg=100.98, stdev=28.49, samples=117 iops : min= 3, max= 44, avg=24.83, stdev= 7.18, samples=117 write: IOPS=26, BW=106KiB/s (109kB/s)(6296KiB/59169msec); 0 zone resets clat (usec): min=956, max=97354, avg=17174.55, stdev=14160.21 lat (usec): min=957, max=97354, avg=17175.85, stdev=14160.44 clat percentiles (usec): | 1.00th=[ 1254], 5.00th=[ 2212], 10.00th=[ 2933], 20.00th=[ 4359], | 30.00th=[ 6849], 40.00th=[10683], 50.00th=[14091], 60.00th=[17433], | 70.00th=[21627], 80.00th=[27919], 90.00th=[36963], 95.00th=[46400], | 99.00th=[59507], 99.50th=[65274], 99.90th=[85459], 99.95th=[96994], | 99.99th=[96994] bw ( KiB/s): min= 40, max= 192, per=25.57%, avg=107.12, stdev=27.79, samples=116 iops : min= 10, max= 48, avg=26.36, stdev= 6.98, samples=116 lat (usec) : 100=0.29%, 250=0.78%, 500=0.10%, 750=0.03%, 1000=0.10% lat (msec) : 2=1.95%, 4=7.39%, 10=14.26%, 20=35.77%, 50=36.46% lat (msec) : 100=2.83%, 750=0.03% cpu : usr=0.13%, sys=20.65%, ctx=8905, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181304: Wed Sep 2 11:46:03 2026 read: IOPS=24, BW=99.8KiB/s (102kB/s)(5940KiB/59493msec) clat (usec): min=32, max=708294, avg=21753.15, stdev=21177.75 lat (usec): min=32, max=708294, avg=21754.18, stdev=21177.81 clat percentiles (usec): | 1.00th=[ 106], 5.00th=[ 8586], 10.00th=[ 10028], 20.00th=[ 12649], | 30.00th=[ 14615], 40.00th=[ 16712], 50.00th=[ 19006], 60.00th=[ 21890], | 70.00th=[ 25297], 80.00th=[ 29230], 90.00th=[ 35390], 95.00th=[ 41157], | 99.00th=[ 64226], 99.50th=[ 68682], 99.90th=[116917], 99.95th=[708838], | 99.99th=[708838] bw ( KiB/s): min= 16, max= 168, per=25.12%, avg=100.48, stdev=26.01, samples=117 iops : min= 4, max= 42, avg=24.70, stdev= 6.63, samples=117 write: IOPS=26, BW=107KiB/s (109kB/s)(6348KiB/59493msec); 0 zone resets clat (usec): min=843, max=94208, avg=16968.72, stdev=13847.08 lat (usec): min=844, max=94210, avg=16970.94, stdev=13846.36 clat percentiles (usec): | 1.00th=[ 1352], 5.00th=[ 2343], 10.00th=[ 2966], 20.00th=[ 4178], | 30.00th=[ 7439], 40.00th=[11076], 50.00th=[14091], 60.00th=[16909], | 70.00th=[21365], 80.00th=[27132], 90.00th=[35914], 95.00th=[43254], | 99.00th=[63701], 99.50th=[73925], 99.90th=[90702], 99.95th=[93848], | 99.99th=[93848] bw ( KiB/s): min= 39, max= 208, per=25.58%, avg=107.17, stdev=30.51, samples=117 iops : min= 9, max= 52, avg=26.38, stdev= 7.61, samples=117 lat (usec) : 50=0.07%, 100=0.26%, 250=0.88%, 750=0.03%, 1000=0.07% lat (msec) : 2=1.73%, 4=7.98%, 10=12.76%, 20=37.01%, 50=36.59% lat (msec) : 100=2.57%, 250=0.03%, 750=0.03% cpu : usr=0.12%, sys=20.65%, ctx=8971, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181305: Wed Sep 2 11:46:03 2026 read: IOPS=25, BW=100KiB/s (103kB/s)(6028KiB/59999msec) clat (usec): min=36, max=131372, avg=21134.35, stdev=12118.73 lat (usec): min=37, max=131373, avg=21137.14, stdev=12119.91 clat percentiles (usec): | 1.00th=[ 93], 5.00th=[ 7504], 10.00th=[ 9372], 20.00th=[ 12125], | 30.00th=[ 14353], 40.00th=[ 16450], 50.00th=[ 19006], 60.00th=[ 22152], | 70.00th=[ 24773], 80.00th=[ 28705], 90.00th=[ 34866], 95.00th=[ 41681], | 99.00th=[ 60556], 99.50th=[ 74974], 99.90th=[113771], 99.95th=[131597], | 99.99th=[131597] bw ( KiB/s): min= 32, max= 215, per=25.17%, avg=100.69, stdev=27.19, samples=118 iops : min= 8, max= 53, avg=24.75, stdev= 6.83, samples=118 write: IOPS=26, BW=104KiB/s (107kB/s)(6260KiB/59999msec); 0 zone resets clat (usec): min=860, max=705802, avg=17833.33, stdev=22351.08 lat (usec): min=861, max=705805, avg=17834.79, stdev=22351.05 clat percentiles (usec): | 1.00th=[ 1188], 5.00th=[ 2245], 10.00th=[ 3032], 20.00th=[ 4621], | 30.00th=[ 7570], 40.00th=[ 11207], 50.00th=[ 14222], 60.00th=[ 17433], | 70.00th=[ 21890], 80.00th=[ 27919], 90.00th=[ 38011], 95.00th=[ 45351], | 99.00th=[ 61604], 99.50th=[ 66847], 99.90th=[ 98042], 99.95th=[708838], | 99.99th=[708838] bw ( KiB/s): min= 32, max= 223, per=24.89%, avg=104.28, stdev=29.62, samples=118 iops : min= 8, max= 55, avg=25.65, stdev= 7.46, samples=118 lat (usec) : 50=0.03%, 100=0.52%, 250=1.01%, 500=0.03%, 1000=0.13% lat (msec) : 2=1.86%, 4=6.67%, 10=14.16%, 20=35.42%, 50=37.30% lat (msec) : 100=2.77%, 250=0.07%, 750=0.03% cpu : usr=0.16%, sys=20.44%, ctx=9022, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181306: Wed Sep 2 11:46:03 2026 read: IOPS=25, BW=102KiB/s (104kB/s)(6052KiB/59364msec) clat (usec): min=47, max=79968, avg=21204.58, stdev=11468.78 lat (usec): min=49, max=79970, avg=21205.64, stdev=11468.69 clat percentiles (usec): | 1.00th=[ 97], 5.00th=[ 7701], 10.00th=[ 9896], 20.00th=[11863], | 30.00th=[14353], 40.00th=[16712], 50.00th=[19268], 60.00th=[22152], | 70.00th=[25297], 80.00th=[29230], 90.00th=[34866], 95.00th=[42730], | 99.00th=[60031], 99.50th=[66323], 99.90th=[80217], 99.95th=[80217], | 99.99th=[80217] bw ( KiB/s): min= 55, max= 160, per=25.63%, avg=102.51, stdev=25.08, samples=117 iops : min= 13, max= 40, avg=25.21, stdev= 6.30, samples=117 write: IOPS=26, BW=105KiB/s (108kB/s)(6236KiB/59364msec); 0 zone resets clat (usec): min=844, max=696251, avg=17331.88, stdev=21758.09 lat (usec): min=845, max=696252, avg=17337.80, stdev=21763.24 clat percentiles (usec): | 1.00th=[ 1254], 5.00th=[ 2180], 10.00th=[ 2835], 20.00th=[ 4146], | 30.00th=[ 7177], 40.00th=[ 10814], 50.00th=[ 14222], 60.00th=[ 17957], | 70.00th=[ 21627], 80.00th=[ 27657], 90.00th=[ 35914], 95.00th=[ 42730], | 99.00th=[ 55837], 99.50th=[ 64750], 99.90th=[ 82314], 99.95th=[692061], | 99.99th=[692061] bw ( KiB/s): min= 13, max= 214, per=24.96%, avg=104.60, stdev=31.14, samples=118 iops : min= 3, max= 53, avg=25.74, stdev= 7.86, samples=118 lat (usec) : 50=0.03%, 100=0.55%, 250=0.81%, 750=0.07%, 1000=0.26% lat (msec) : 2=1.69%, 4=7.78%, 10=12.76%, 20=35.87%, 50=37.96% lat (msec) : 100=2.18%, 750=0.03% cpu : usr=0.17%, sys=20.72%, ctx=8927, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=400KiB/s (410kB/s), 99.8KiB/s-102KiB/s (102kB/s-104kB/s), io=23.4MiB (24.6MB), run=59169-59999msec WRITE: bw=419KiB/s (429kB/s), 104KiB/s-107KiB/s (107kB/s-109kB/s), io=24.6MiB (25.7MB), run=59169-59999msec rand-rw: (groupid=0, jobs=1): err= 0: pid=181307: Wed Sep 2 11:46:15 2026 read: IOPS=20, BW=83.0KiB/s (85.0kB/s)(5992KiB/72170msec) clat (msec): min=3, max=723, avg=20.12, stdev=24.00 lat (msec): min=3, max=723, avg=20.12, stdev=24.00 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 6], 10.00th=[ 7], 20.00th=[ 8], | 30.00th=[ 10], 40.00th=[ 12], 50.00th=[ 15], 60.00th=[ 18], | 70.00th=[ 22], 80.00th=[ 31], 90.00th=[ 43], 95.00th=[ 52], | 99.00th=[ 75], 99.50th=[ 88], 99.90th=[ 132], 99.95th=[ 726], | 99.99th=[ 726] bw ( KiB/s): min= 23, max= 288, per=25.02%, avg=83.08, stdev=52.49, samples=142 iops : min= 5, max= 72, avg=20.34, stdev=13.20, samples=142 write: IOPS=21, BW=87.2KiB/s (89.3kB/s)(6296KiB/72170msec); 0 zone resets clat (msec): min=5, max=118, avg=26.56, stdev=17.12 lat (msec): min=5, max=118, avg=26.56, stdev=17.12 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 9], 10.00th=[ 10], 20.00th=[ 13], | 30.00th=[ 15], 40.00th=[ 18], 50.00th=[ 22], 60.00th=[ 27], | 70.00th=[ 33], 80.00th=[ 39], 90.00th=[ 51], 95.00th=[ 60], | 99.00th=[ 85], 99.50th=[ 94], 99.90th=[ 117], 99.95th=[ 120], | 99.99th=[ 120] bw ( KiB/s): min= 23, max= 272, per=25.10%, avg=87.35, stdev=51.09, samples=142 iops : min= 5, max= 68, avg=21.41, stdev=12.89, samples=142 lat (msec) : 4=0.26%, 10=20.54%, 20=35.19%, 50=35.90%, 100=7.71% lat (msec) : 250=0.36%, 750=0.03% cpu : usr=0.12%, sys=10.29%, ctx=6015, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181308: Wed Sep 2 11:46:15 2026 read: IOPS=20, BW=82.8KiB/s (84.7kB/s)(5940KiB/71775msec) clat (msec): min=3, max=700, avg=20.07, stdev=23.46 lat (msec): min=3, max=700, avg=20.07, stdev=23.46 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 6], 10.00th=[ 7], 20.00th=[ 8], | 30.00th=[ 10], 40.00th=[ 12], 50.00th=[ 15], 60.00th=[ 18], | 70.00th=[ 22], 80.00th=[ 30], 90.00th=[ 42], 95.00th=[ 53], | 99.00th=[ 77], 99.50th=[ 84], 99.90th=[ 116], 99.95th=[ 701], | 99.99th=[ 701] bw ( KiB/s): min= 15, max= 272, per=24.96%, avg=82.86, stdev=53.26, samples=141 iops : min= 3, max= 68, avg=20.28, stdev=13.44, samples=141 write: IOPS=22, BW=88.4KiB/s (90.6kB/s)(6348KiB/71775msec); 0 zone resets clat (msec): min=5, max=116, avg=26.31, stdev=16.79 lat (msec): min=5, max=116, avg=26.32, stdev=16.79 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 13], | 30.00th=[ 15], 40.00th=[ 18], 50.00th=[ 22], 60.00th=[ 26], | 70.00th=[ 32], 80.00th=[ 39], 90.00th=[ 50], 95.00th=[ 60], | 99.00th=[ 84], 99.50th=[ 92], 99.90th=[ 106], 99.95th=[ 117], | 99.99th=[ 117] bw ( KiB/s): min= 23, max= 256, per=25.38%, avg=88.32, stdev=49.37, samples=141 iops : min= 5, max= 64, avg=21.65, stdev=12.43, samples=141 lat (msec) : 4=0.13%, 10=19.73%, 20=36.85%, 50=35.74%, 100=7.32% lat (msec) : 250=0.20%, 750=0.03% cpu : usr=0.12%, sys=10.48%, ctx=6001, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181309: Wed Sep 2 11:46:15 2026 read: IOPS=21, BW=84.1KiB/s (86.1kB/s)(6028KiB/71697msec) clat (msec): min=3, max=104, avg=19.49, stdev=15.31 lat (msec): min=3, max=104, avg=19.49, stdev=15.31 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 6], 10.00th=[ 7], 20.00th=[ 8], | 30.00th=[ 10], 40.00th=[ 12], 50.00th=[ 15], 60.00th=[ 18], | 70.00th=[ 22], 80.00th=[ 29], 90.00th=[ 42], 95.00th=[ 52], | 99.00th=[ 75], 99.50th=[ 86], 99.90th=[ 94], 99.95th=[ 105], | 99.99th=[ 105] bw ( KiB/s): min= 7, max= 288, per=25.35%, avg=84.17, stdev=52.61, samples=141 iops : min= 1, max= 72, avg=20.61, stdev=13.25, samples=141 write: IOPS=21, BW=87.3KiB/s (89.4kB/s)(6260KiB/71697msec); 0 zone resets clat (msec): min=5, max=707, avg=26.92, stdev=24.60 lat (msec): min=5, max=707, avg=26.92, stdev=24.60 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 9], 10.00th=[ 10], 20.00th=[ 13], | 30.00th=[ 15], 40.00th=[ 18], 50.00th=[ 22], 60.00th=[ 27], | 70.00th=[ 32], 80.00th=[ 40], 90.00th=[ 51], 95.00th=[ 59], | 99.00th=[ 90], 99.50th=[ 109], 99.90th=[ 126], 99.95th=[ 709], | 99.99th=[ 709] bw ( KiB/s): min= 31, max= 248, per=25.07%, avg=87.23, stdev=51.00, samples=141 iops : min= 7, max= 62, avg=21.38, stdev=12.87, samples=141 lat (msec) : 4=0.13%, 10=21.03%, 20=35.61%, 50=35.16%, 100=7.71% lat (msec) : 250=0.33%, 750=0.03% cpu : usr=0.12%, sys=10.46%, ctx=6095, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181310: Wed Sep 2 11:46:15 2026 read: IOPS=21, BW=84.8KiB/s (86.8kB/s)(6052KiB/71367msec) clat (msec): min=3, max=129, avg=19.91, stdev=16.29 lat (msec): min=3, max=129, avg=19.91, stdev=16.29 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 6], 10.00th=[ 7], 20.00th=[ 8], | 30.00th=[ 10], 40.00th=[ 12], 50.00th=[ 15], 60.00th=[ 18], | 70.00th=[ 22], 80.00th=[ 31], 90.00th=[ 44], 95.00th=[ 54], | 99.00th=[ 74], 99.50th=[ 88], 99.90th=[ 114], 99.95th=[ 130], | 99.99th=[ 130] bw ( KiB/s): min= 24, max= 304, per=25.66%, avg=85.20, stdev=51.84, samples=141 iops : min= 6, max= 76, avg=20.87, stdev=13.05, samples=141 write: IOPS=21, BW=87.4KiB/s (89.5kB/s)(6236KiB/71367msec); 0 zone resets clat (msec): min=5, max=705, avg=26.32, stdev=23.99 lat (msec): min=5, max=705, avg=26.32, stdev=23.99 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 9], 10.00th=[ 10], 20.00th=[ 12], | 30.00th=[ 14], 40.00th=[ 18], 50.00th=[ 22], 60.00th=[ 26], | 70.00th=[ 32], 80.00th=[ 39], 90.00th=[ 50], 95.00th=[ 58], | 99.00th=[ 85], 99.50th=[ 93], 99.90th=[ 131], 99.95th=[ 709], | 99.99th=[ 709] bw ( KiB/s): min= 24, max= 248, per=25.21%, avg=87.74, stdev=50.99, samples=141 iops : min= 6, max= 62, avg=21.50, stdev=12.85, samples=141 lat (msec) : 4=0.26%, 10=20.96%, 20=36.10%, 50=34.73%, 100=7.65% lat (msec) : 250=0.26%, 750=0.03% cpu : usr=0.13%, sys=10.46%, ctx=5862, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=333KiB/s (341kB/s), 82.8KiB/s-84.8KiB/s (84.7kB/s-86.8kB/s), io=23.4MiB (24.6MB), run=71367-72170msec WRITE: bw=348KiB/s (357kB/s), 87.2KiB/s-88.4KiB/s (89.3kB/s-90.6kB/s), io=24.6MiB (25.7MB), run=71367-72170msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=181338: Wed Sep 2 11:46:38 2026 read: IOPS=21, BW=348KiB/s (356kB/s)(5920KiB/17030msec) clat (usec): min=49, max=67375, avg=23765.85, stdev=12625.02 lat (usec): min=50, max=67375, avg=23766.85, stdev=12625.06 clat percentiles (usec): | 1.00th=[ 97], 5.00th=[ 200], 10.00th=[ 9503], 20.00th=[13698], | 30.00th=[16712], 40.00th=[19530], 50.00th=[22676], 60.00th=[25560], | 70.00th=[28967], 80.00th=[33162], 90.00th=[40633], 95.00th=[46400], | 99.00th=[58459], 99.50th=[66847], 99.90th=[67634], 99.95th=[67634], | 99.99th=[67634] bw ( KiB/s): min= 220, max= 544, per=24.48%, avg=344.24, stdev=97.26, samples=33 iops : min= 13, max= 34, avg=20.91, stdev= 6.16, samples=33 write: IOPS=23, BW=374KiB/s (383kB/s)(6368KiB/17030msec); 0 zone resets clat (usec): min=1496, max=80040, avg=20282.35, stdev=14958.20 lat (usec): min=1498, max=80043, avg=20284.61, stdev=14958.48 clat percentiles (usec): | 1.00th=[ 2442], 5.00th=[ 3851], 10.00th=[ 4817], 20.00th=[ 6783], | 30.00th=[10552], 40.00th=[13435], 50.00th=[16712], 60.00th=[20055], | 70.00th=[24773], 80.00th=[31851], 90.00th=[41681], 95.00th=[49546], | 99.00th=[70779], 99.50th=[80217], 99.90th=[80217], 99.95th=[80217], | 99.99th=[80217] bw ( KiB/s): min= 64, max= 608, per=25.26%, avg=373.55, stdev=123.28, samples=33 iops : min= 4, max= 38, avg=22.73, stdev= 7.74, samples=33 lat (usec) : 50=0.13%, 100=0.39%, 250=2.08%, 500=0.13% lat (msec) : 2=0.26%, 4=2.60%, 10=14.06%, 20=31.38%, 50=45.57% lat (msec) : 100=3.39% cpu : usr=0.12%, sys=21.15%, ctx=2515, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181339: Wed Sep 2 11:46:38 2026 read: IOPS=21, BW=342KiB/s (350kB/s)(5744KiB/16819msec) clat (usec): min=35, max=87374, avg=23229.73, stdev=12576.62 lat (usec): min=36, max=87375, avg=23230.91, stdev=12576.66 clat percentiles (usec): | 1.00th=[ 74], 5.00th=[ 169], 10.00th=[10421], 20.00th=[13698], | 30.00th=[16581], 40.00th=[19268], 50.00th=[22414], 60.00th=[25035], | 70.00th=[27919], 80.00th=[31589], 90.00th=[38011], 95.00th=[44303], | 99.00th=[63701], 99.50th=[70779], 99.90th=[87557], 99.95th=[87557], | 99.99th=[87557] bw ( KiB/s): min= 63, max= 542, per=24.13%, avg=339.24, stdev=102.58, samples=33 iops : min= 3, max= 33, avg=20.55, stdev= 6.39, samples=33 write: IOPS=24, BW=389KiB/s (398kB/s)(6544KiB/16819msec); 0 zone resets clat (usec): min=2456, max=85978, avg=20273.56, stdev=15595.14 lat (usec): min=2458, max=85980, avg=20275.82, stdev=15595.26 clat percentiles (usec): | 1.00th=[ 3163], 5.00th=[ 3884], 10.00th=[ 4621], 20.00th=[ 5735], | 30.00th=[ 8848], 40.00th=[12649], 50.00th=[15270], 60.00th=[20579], | 70.00th=[27132], 80.00th=[33817], 90.00th=[40633], 95.00th=[49546], | 99.00th=[70779], 99.50th=[77071], 99.90th=[85459], 99.95th=[85459], | 99.99th=[85459] bw ( KiB/s): min= 191, max= 606, per=25.88%, avg=382.79, stdev=102.00, samples=33 iops : min= 11, max= 37, avg=23.27, stdev= 6.39, samples=33 lat (usec) : 50=0.13%, 100=0.65%, 250=1.82%, 500=0.13%, 750=0.13% lat (msec) : 4=3.26%, 10=16.41%, 20=27.99%, 50=45.31%, 100=4.17% cpu : usr=0.13%, sys=21.44%, ctx=2457, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181341: Wed Sep 2 11:46:38 2026 read: IOPS=23, BW=379KiB/s (388kB/s)(6256KiB/16492msec) clat (usec): min=44, max=138824, avg=22890.67, stdev=14371.90 lat (usec): min=46, max=138826, avg=22899.13, stdev=14370.25 clat percentiles (usec): | 1.00th=[ 73], 5.00th=[ 141], 10.00th=[ 10028], 20.00th=[ 13304], | 30.00th=[ 16057], 40.00th=[ 18482], 50.00th=[ 21627], 60.00th=[ 23987], | 70.00th=[ 26870], 80.00th=[ 31851], 90.00th=[ 37487], 95.00th=[ 45351], | 99.00th=[ 72877], 99.50th=[ 83362], 99.90th=[139461], 99.95th=[139461], | 99.99th=[139461] bw ( KiB/s): min= 222, max= 608, per=27.18%, avg=382.22, stdev=89.20, samples=32 iops : min= 13, max= 38, avg=23.25, stdev= 5.61, samples=32 write: IOPS=22, BW=366KiB/s (375kB/s)(6032KiB/16492msec); 0 zone resets clat (usec): min=1930, max=85897, avg=19597.60, stdev=15248.84 lat (usec): min=1933, max=85898, avg=19600.07, stdev=15248.55 clat percentiles (usec): | 1.00th=[ 2008], 5.00th=[ 3720], 10.00th=[ 4490], 20.00th=[ 6128], | 30.00th=[ 8979], 40.00th=[11863], 50.00th=[14877], 60.00th=[19792], | 70.00th=[25035], 80.00th=[30540], 90.00th=[39584], 95.00th=[52691], | 99.00th=[65799], 99.50th=[77071], 99.90th=[85459], 99.95th=[85459], | 99.99th=[85459] bw ( KiB/s): min= 128, max= 512, per=24.46%, avg=361.78, stdev=102.41, samples=32 iops : min= 8, max= 32, avg=22.00, stdev= 6.45, samples=32 lat (usec) : 50=0.13%, 100=1.04%, 250=2.86%, 500=0.13% lat (msec) : 2=0.39%, 4=2.73%, 10=14.06%, 20=31.38%, 50=42.71% lat (msec) : 100=4.43%, 250=0.13% cpu : usr=0.18%, sys=21.41%, ctx=2393, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181343: Wed Sep 2 11:46:38 2026 read: IOPS=22, BW=362KiB/s (371kB/s)(6032KiB/16653msec) clat (usec): min=44, max=94144, avg=22978.28, stdev=14845.49 lat (usec): min=45, max=94145, avg=22979.27, stdev=14845.57 clat percentiles (usec): | 1.00th=[ 62], 5.00th=[ 124], 10.00th=[ 8455], 20.00th=[12911], | 30.00th=[15401], 40.00th=[17957], 50.00th=[19792], 60.00th=[23462], | 70.00th=[27657], 80.00th=[32900], 90.00th=[42730], 95.00th=[48497], | 99.00th=[71828], 99.50th=[92799], 99.90th=[93848], 99.95th=[93848], | 99.99th=[93848] bw ( KiB/s): min= 159, max= 638, per=25.44%, avg=357.70, stdev=96.49, samples=33 iops : min= 9, max= 39, avg=21.73, stdev= 6.03, samples=33 write: IOPS=23, BW=376KiB/s (385kB/s)(6256KiB/16653msec); 0 zone resets clat (usec): min=1291, max=78855, avg=20162.79, stdev=15120.45 lat (usec): min=1293, max=78857, avg=20168.14, stdev=15118.34 clat percentiles (usec): | 1.00th=[ 1729], 5.00th=[ 3458], 10.00th=[ 4490], 20.00th=[ 6456], | 30.00th=[ 9503], 40.00th=[12911], 50.00th=[17171], 60.00th=[21103], | 70.00th=[25822], 80.00th=[32113], 90.00th=[40633], 95.00th=[47973], | 99.00th=[70779], 99.50th=[78119], 99.90th=[79168], 99.95th=[79168], | 99.99th=[79168] bw ( KiB/s): min= 191, max= 638, per=25.37%, avg=375.15, stdev=93.01, samples=33 iops : min= 11, max= 39, avg=22.82, stdev= 5.84, samples=33 lat (usec) : 50=0.13%, 100=1.04%, 250=2.73%, 500=0.52% lat (msec) : 2=0.52%, 4=3.26%, 10=13.93%, 20=32.29%, 50=40.89% lat (msec) : 100=4.69% cpu : usr=0.13%, sys=20.83%, ctx=2398, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1406KiB/s (1440kB/s), 342KiB/s-379KiB/s (350kB/s-388kB/s), io=23.4MiB (24.5MB), run=16492-17030msec WRITE: bw=1480KiB/s (1515kB/s), 366KiB/s-389KiB/s (375kB/s-398kB/s), io=24.6MiB (25.8MB), run=16492-17030msec rand-rw: (groupid=0, jobs=1): err= 0: pid=181340: Wed Sep 2 11:46:42 2026 read: IOPS=18, BW=291KiB/s (298kB/s)(5920KiB/20371msec) clat (usec): min=4437, max=89661, avg=22675.20, stdev=17039.92 lat (usec): min=4438, max=89662, avg=22676.44, stdev=17040.09 clat percentiles (usec): | 1.00th=[ 4752], 5.00th=[ 6783], 10.00th=[ 7504], 20.00th=[ 9110], | 30.00th=[11469], 40.00th=[13829], 50.00th=[16188], 60.00th=[19268], | 70.00th=[23725], 80.00th=[36439], 90.00th=[50594], 95.00th=[60556], | 99.00th=[72877], 99.50th=[76022], 99.90th=[89654], 99.95th=[89654], | 99.99th=[89654] bw ( KiB/s): min= 64, max= 768, per=24.77%, avg=290.02, stdev=169.82, samples=40 iops : min= 4, max= 48, avg=17.57, stdev=10.79, samples=40 write: IOPS=19, BW=313KiB/s (320kB/s)(6368KiB/20371msec); 0 zone resets clat (msec): min=7, max=112, avg=30.00, stdev=19.75 lat (msec): min=7, max=112, avg=30.01, stdev=19.75 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 12], 20.00th=[ 14], | 30.00th=[ 17], 40.00th=[ 20], 50.00th=[ 24], 60.00th=[ 29], | 70.00th=[ 36], 80.00th=[ 45], 90.00th=[ 57], 95.00th=[ 68], | 99.00th=[ 100], 99.50th=[ 110], 99.90th=[ 113], 99.95th=[ 113], | 99.99th=[ 113] bw ( KiB/s): min= 126, max= 832, per=25.43%, avg=313.33, stdev=164.70, samples=40 iops : min= 7, max= 52, avg=19.03, stdev=10.45, samples=40 lat (msec) : 10=12.50%, 20=38.54%, 50=36.33%, 100=12.24%, 250=0.39% cpu : usr=0.07%, sys=9.94%, ctx=1600, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181342: Wed Sep 2 11:46:42 2026 read: IOPS=17, BW=281KiB/s (288kB/s)(5744KiB/20446msec) clat (usec): min=4079, max=96778, avg=21756.95, stdev=16433.09 lat (usec): min=4081, max=96778, avg=21760.95, stdev=16431.69 clat percentiles (usec): | 1.00th=[ 5080], 5.00th=[ 6521], 10.00th=[ 7701], 20.00th=[ 9110], | 30.00th=[10683], 40.00th=[13566], 50.00th=[16188], 60.00th=[19530], | 70.00th=[24511], 80.00th=[30278], 90.00th=[45876], 95.00th=[58459], | 99.00th=[83362], 99.50th=[91751], 99.90th=[96994], 99.95th=[96994], | 99.99th=[96994] bw ( KiB/s): min= 63, max= 736, per=23.95%, avg=280.45, stdev=158.43, samples=40 iops : min= 3, max= 46, avg=16.98, stdev=10.01, samples=40 write: IOPS=20, BW=320KiB/s (328kB/s)(6544KiB/20446msec); 0 zone resets clat (msec): min=6, max=125, avg=30.59, stdev=20.85 lat (msec): min=6, max=125, avg=30.59, stdev=20.85 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 12], 20.00th=[ 14], | 30.00th=[ 16], 40.00th=[ 20], 50.00th=[ 24], 60.00th=[ 29], | 70.00th=[ 36], 80.00th=[ 46], 90.00th=[ 62], 95.00th=[ 74], | 99.00th=[ 100], 99.50th=[ 109], 99.90th=[ 126], 99.95th=[ 126], | 99.99th=[ 126] bw ( KiB/s): min= 126, max= 928, per=25.88%, avg=318.88, stdev=179.15, samples=40 iops : min= 7, max= 58, avg=19.37, stdev=11.35, samples=40 lat (msec) : 10=14.06%, 20=35.94%, 50=37.63%, 100=11.85%, 250=0.52% cpu : usr=0.12%, sys=9.82%, ctx=1531, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181344: Wed Sep 2 11:46:42 2026 read: IOPS=19, BW=312KiB/s (319kB/s)(6256KiB/20063msec) clat (msec): min=4, max=102, avg=22.29, stdev=16.45 lat (msec): min=4, max=102, avg=22.30, stdev=16.45 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 7], 10.00th=[ 8], 20.00th=[ 11], | 30.00th=[ 13], 40.00th=[ 15], 50.00th=[ 17], 60.00th=[ 20], | 70.00th=[ 24], 80.00th=[ 32], 90.00th=[ 47], 95.00th=[ 58], | 99.00th=[ 80], 99.50th=[ 86], 99.90th=[ 103], 99.95th=[ 103], | 99.99th=[ 103] bw ( KiB/s): min= 95, max= 928, per=26.69%, avg=312.56, stdev=177.21, samples=39 iops : min= 5, max= 58, avg=18.97, stdev=11.26, samples=39 write: IOPS=18, BW=301KiB/s (308kB/s)(6032KiB/20063msec); 0 zone resets clat (msec): min=8, max=147, avg=29.59, stdev=18.11 lat (msec): min=8, max=147, avg=29.60, stdev=18.11 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 11], 10.00th=[ 12], 20.00th=[ 16], | 30.00th=[ 18], 40.00th=[ 21], 50.00th=[ 24], 60.00th=[ 29], | 70.00th=[ 36], 80.00th=[ 44], 90.00th=[ 56], 95.00th=[ 63], | 99.00th=[ 89], 99.50th=[ 90], 99.90th=[ 148], 99.95th=[ 148], | 99.99th=[ 148] bw ( KiB/s): min= 126, max= 704, per=23.99%, avg=295.62, stdev=142.40, samples=39 iops : min= 7, max= 44, avg=17.92, stdev= 9.06, samples=39 lat (msec) : 10=11.59%, 20=39.06%, 50=38.41%, 100=10.68%, 250=0.26% cpu : usr=0.12%, sys=10.22%, ctx=1625, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181345: Wed Sep 2 11:46:42 2026 read: IOPS=18, BW=296KiB/s (303kB/s)(6032KiB/20359msec) clat (usec): min=4386, max=92322, avg=23249.74, stdev=17587.04 lat (usec): min=4388, max=92323, avg=23251.28, stdev=17586.85 clat percentiles (usec): | 1.00th=[ 5080], 5.00th=[ 6849], 10.00th=[ 7570], 20.00th=[ 9765], | 30.00th=[12125], 40.00th=[14615], 50.00th=[16909], 60.00th=[19268], | 70.00th=[23462], 80.00th=[36439], 90.00th=[52691], 95.00th=[61604], | 99.00th=[74974], 99.50th=[81265], 99.90th=[92799], 99.95th=[92799], | 99.99th=[92799] bw ( KiB/s): min= 95, max= 896, per=25.29%, avg=296.20, stdev=180.85, samples=40 iops : min= 5, max= 56, avg=17.95, stdev=11.41, samples=40 write: IOPS=19, BW=307KiB/s (315kB/s)(6256KiB/20359msec); 0 zone resets clat (msec): min=7, max=142, avg=29.19, stdev=19.40 lat (msec): min=7, max=142, avg=29.20, stdev=19.40 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 12], 20.00th=[ 14], | 30.00th=[ 17], 40.00th=[ 19], 50.00th=[ 23], 60.00th=[ 28], | 70.00th=[ 35], 80.00th=[ 43], 90.00th=[ 57], 95.00th=[ 67], | 99.00th=[ 96], 99.50th=[ 105], 99.90th=[ 144], 99.95th=[ 144], | 99.99th=[ 144] bw ( KiB/s): min= 127, max= 832, per=25.11%, avg=309.30, stdev=167.26, samples=40 iops : min= 7, max= 52, avg=18.77, stdev=10.62, samples=40 lat (msec) : 10=12.24%, 20=40.49%, 50=33.33%, 100=13.54%, 250=0.39% cpu : usr=0.12%, sys=9.90%, ctx=1627, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1171KiB/s (1200kB/s), 281KiB/s-312KiB/s (288kB/s-319kB/s), io=23.4MiB (24.5MB), run=20063-20446msec WRITE: bw=1233KiB/s (1262kB/s), 301KiB/s-320KiB/s (308kB/s-328kB/s), io=24.6MiB (25.8MB), run=20063-20446msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=181353: Wed Sep 2 11:46:53 2026 read: IOPS=1, BW=1642KiB/s (1681kB/s)(7168KiB/4366msec) clat (msec): min=117, max=2716, avg=515.49, stdev=971.16 lat (msec): min=117, max=2716, avg=515.49, stdev=971.16 clat percentiles (msec): | 1.00th=[ 118], 5.00th=[ 118], 10.00th=[ 118], 20.00th=[ 122], | 30.00th=[ 131], 40.00th=[ 131], 50.00th=[ 136], 60.00th=[ 188], | 70.00th=[ 188], 80.00th=[ 201], 90.00th=[ 2702], 95.00th=[ 2702], | 99.00th=[ 2702], 99.50th=[ 2702], 99.90th=[ 2702], 99.95th=[ 2702], | 99.99th=[ 2702] bw ( KiB/s): min= 2043, max= 6144, per=89.76%, avg=3893.67, stdev=2079.51, samples=3 iops : min= 1, max= 6, avg= 3.33, stdev= 2.52, samples=3 write: IOPS=1, BW=1173KiB/s (1201kB/s)(5120KiB/4366msec); 0 zone resets clat (msec): min=96, max=208, avg=137.45, stdev=44.94 lat (msec): min=96, max=208, avg=137.53, stdev=44.95 clat percentiles (msec): | 1.00th=[ 97], 5.00th=[ 97], 10.00th=[ 97], 20.00th=[ 97], | 30.00th=[ 102], 40.00th=[ 102], 50.00th=[ 140], 60.00th=[ 140], | 70.00th=[ 142], 80.00th=[ 142], 90.00th=[ 209], 95.00th=[ 209], | 99.00th=[ 209], 99.50th=[ 209], 99.90th=[ 209], 99.95th=[ 209], | 99.99th=[ 209] bw ( KiB/s): min= 2048, max= 6131, per=67.33%, avg=4089.50, stdev=2887.12, samples=2 iops : min= 2, max= 5, avg= 3.50, stdev= 2.12, samples=2 lat (msec) : 100=8.33%, 250=83.33%, >=2000=8.33% cpu : usr=0.00%, sys=29.16%, ctx=1421, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181354: Wed Sep 2 11:46:53 2026 read: IOPS=0, BW=528KiB/s (540kB/s)(2048KiB/3881msec) clat (msec): min=138, max=184, avg=161.73, stdev=32.63 lat (msec): min=138, max=184, avg=161.73, stdev=32.63 clat percentiles (msec): | 1.00th=[ 140], 5.00th=[ 140], 10.00th=[ 140], 20.00th=[ 140], | 30.00th=[ 140], 40.00th=[ 140], 50.00th=[ 140], 60.00th=[ 186], | 70.00th=[ 186], 80.00th=[ 186], 90.00th=[ 186], 95.00th=[ 186], | 99.00th=[ 186], 99.50th=[ 186], 99.90th=[ 186], 99.95th=[ 186], | 99.99th=[ 186] bw ( KiB/s): min= 1762, max= 2048, per=43.91%, avg=1905.00, stdev=202.23, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 write: IOPS=2, BW=2638KiB/s (2702kB/s)(10.0MiB/3881msec); 0 zone resets clat (msec): min=93, max=1068, avg=348.28, stdev=312.55 lat (msec): min=93, max=1069, avg=348.41, stdev=312.54 clat percentiles (msec): | 1.00th=[ 93], 5.00th=[ 93], 10.00th=[ 93], 20.00th=[ 101], | 30.00th=[ 111], 40.00th=[ 211], 50.00th=[ 218], 60.00th=[ 241], | 70.00th=[ 292], 80.00th=[ 468], 90.00th=[ 684], 95.00th=[ 1070], | 99.00th=[ 1070], 99.50th=[ 1070], 99.90th=[ 1070], 99.95th=[ 1070], | 99.99th=[ 1070] bw ( KiB/s): min= 2048, max= 6144, per=67.40%, avg=4093.75, stdev=1672.19, samples=4 iops : min= 2, max= 6, avg= 3.75, stdev= 1.71, samples=4 lat (msec) : 100=8.33%, 250=58.33%, 500=16.67%, 750=8.33%, 2000=8.33% cpu : usr=0.08%, sys=35.13%, ctx=522, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181355: Wed Sep 2 11:46:53 2026 read: IOPS=1, BW=1302KiB/s (1333kB/s)(6144KiB/4720msec) clat (msec): min=78, max=151, avg=114.88, stdev=28.88 lat (msec): min=78, max=151, avg=114.88, stdev=28.88 clat percentiles (msec): | 1.00th=[ 80], 5.00th=[ 80], 10.00th=[ 80], 20.00th=[ 94], | 30.00th=[ 94], 40.00th=[ 97], 50.00th=[ 97], 60.00th=[ 132], | 70.00th=[ 138], 80.00th=[ 138], 90.00th=[ 153], 95.00th=[ 153], | 99.00th=[ 153], 99.50th=[ 153], 99.90th=[ 153], 99.95th=[ 153], | 99.99th=[ 153] bw ( KiB/s): min= 2043, max= 4096, per=58.98%, avg=2558.75, stdev=1024.84, samples=4 iops : min= 1, max= 4, avg= 2.25, stdev= 1.26, samples=4 write: IOPS=1, BW=1302KiB/s (1333kB/s)(6144KiB/4720msec); 0 zone resets clat (msec): min=134, max=1499, avg=648.24, stdev=472.97 lat (msec): min=134, max=1499, avg=648.34, stdev=472.95 clat percentiles (msec): | 1.00th=[ 136], 5.00th=[ 136], 10.00th=[ 136], 20.00th=[ 414], | 30.00th=[ 414], 40.00th=[ 472], 50.00th=[ 472], 60.00th=[ 550], | 70.00th=[ 827], 80.00th=[ 827], 90.00th=[ 1502], 95.00th=[ 1502], | 99.00th=[ 1502], 99.50th=[ 1502], 99.90th=[ 1502], 99.95th=[ 1502], | 99.99th=[ 1502] bw ( KiB/s): min= 1747, max= 2048, per=32.71%, avg=1986.80, stdev=134.07, samples=5 iops : min= 1, max= 2, avg= 1.60, stdev= 0.55, samples=5 lat (msec) : 100=25.00%, 250=33.33%, 500=16.67%, 750=8.33%, 1000=8.33% lat (msec) : 2000=8.33% cpu : usr=0.00%, sys=23.54%, ctx=863, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181356: Wed Sep 2 11:46:53 2026 read: IOPS=1, BW=1379KiB/s (1412kB/s)(5120KiB/3712msec) clat (usec): min=772, max=178794, avg=120174.24, stdev=69970.41 lat (usec): min=773, max=178796, avg=120175.45, stdev=69970.66 clat percentiles (usec): | 1.00th=[ 775], 5.00th=[ 775], 10.00th=[ 775], 20.00th=[ 775], | 30.00th=[124257], 40.00th=[124257], 50.00th=[137364], 60.00th=[137364], | 70.00th=[160433], 80.00th=[160433], 90.00th=[179307], 95.00th=[179307], | 99.00th=[179307], 99.50th=[179307], 99.90th=[179307], 99.95th=[179307], | 99.99th=[179307] bw ( KiB/s): min= 2048, max= 6131, per=94.27%, avg=4089.50, stdev=2887.12, samples=2 iops : min= 2, max= 5, avg= 3.50, stdev= 2.12, samples=2 write: IOPS=1, BW=1931KiB/s (1977kB/s)(7168KiB/3712msec); 0 zone resets clat (msec): min=127, max=1653, avg=441.08, stdev=547.94 lat (msec): min=127, max=1653, avg=441.21, stdev=547.93 clat percentiles (msec): | 1.00th=[ 128], 5.00th=[ 128], 10.00th=[ 128], 20.00th=[ 146], | 30.00th=[ 205], 40.00th=[ 205], 50.00th=[ 211], 60.00th=[ 255], | 70.00th=[ 255], 80.00th=[ 493], 90.00th=[ 1653], 95.00th=[ 1653], | 99.00th=[ 1653], 99.50th=[ 1653], 99.90th=[ 1653], 99.95th=[ 1653], | 99.99th=[ 1653] bw ( KiB/s): min= 1756, max= 6144, per=57.78%, avg=3509.75, stdev=2042.05, samples=4 iops : min= 1, max= 6, avg= 3.00, stdev= 2.45, samples=4 lat (usec) : 1000=8.33% lat (msec) : 250=66.67%, 500=16.67%, 2000=8.33% cpu : usr=0.03%, sys=33.31%, ctx=465, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4339KiB/s (4443kB/s), 528KiB/s-1642KiB/s (540kB/s-1681kB/s), io=20.0MiB (20.0MB), run=3712-4720msec WRITE: bw=6075KiB/s (6220kB/s), 1173KiB/s-2638KiB/s (1201kB/s-2702kB/s), io=28.0MiB (29.4MB), run=3712-4720msec rand-rw: (groupid=0, jobs=1): err= 0: pid=181358: Wed Sep 2 11:46:53 2026 read: IOPS=1, BW=1511KiB/s (1548kB/s)(7168KiB/4743msec) clat (msec): min=23, max=1724, avg=480.10, stdev=663.28 lat (msec): min=23, max=1724, avg=480.16, stdev=663.23 clat percentiles (msec): | 1.00th=[ 24], 5.00th=[ 24], 10.00th=[ 24], 20.00th=[ 54], | 30.00th=[ 100], 40.00th=[ 100], 50.00th=[ 120], 60.00th=[ 251], | 70.00th=[ 251], 80.00th=[ 1083], 90.00th=[ 1720], 95.00th=[ 1720], | 99.00th=[ 1720], 99.50th=[ 1720], 99.90th=[ 1720], 99.95th=[ 1720], | 99.99th=[ 1720] bw ( KiB/s): min= 1812, max= 4079, per=57.81%, avg=2495.50, stdev=1061.39, samples=4 iops : min= 1, max= 3, avg= 1.75, stdev= 0.96, samples=4 write: IOPS=1, BW=1079KiB/s (1105kB/s)(5120KiB/4743msec); 0 zone resets clat (msec): min=53, max=472, avg=242.24, stdev=180.95 lat (msec): min=53, max=473, avg=242.36, stdev=180.97 clat percentiles (msec): | 1.00th=[ 54], 5.00th=[ 54], 10.00th=[ 54], 20.00th=[ 54], | 30.00th=[ 101], 40.00th=[ 101], 50.00th=[ 201], 60.00th=[ 201], | 70.00th=[ 384], 80.00th=[ 384], 90.00th=[ 472], 95.00th=[ 472], | 99.00th=[ 472], 99.50th=[ 472], 99.90th=[ 472], 99.95th=[ 472], | 99.99th=[ 472] bw ( KiB/s): min= 2039, max= 4079, per=45.03%, avg=2722.00, stdev=1175.21, samples=3 iops : min= 1, max= 3, avg= 2.00, stdev= 1.00, samples=3 lat (msec) : 50=8.33%, 100=25.00%, 250=25.00%, 500=25.00%, 2000=16.67% cpu : usr=0.06%, sys=9.64%, ctx=123, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181359: Wed Sep 2 11:46:53 2026 read: IOPS=0, BW=448KiB/s (459kB/s)(2048KiB/4572msec) clat (msec): min=162, max=272, avg=217.72, stdev=77.47 lat (msec): min=162, max=272, avg=217.72, stdev=77.47 clat percentiles (msec): | 1.00th=[ 163], 5.00th=[ 163], 10.00th=[ 163], 20.00th=[ 163], | 30.00th=[ 163], 40.00th=[ 163], 50.00th=[ 163], 60.00th=[ 271], | 70.00th=[ 271], 80.00th=[ 271], 90.00th=[ 271], 95.00th=[ 271], | 99.00th=[ 271], 99.50th=[ 271], 99.90th=[ 271], 99.95th=[ 271], | 99.99th=[ 271] bw ( KiB/s): min= 1812, max= 2048, per=44.71%, avg=1930.00, stdev=166.88, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 write: IOPS=2, BW=2240KiB/s (2293kB/s)(10.0MiB/4572msec); 0 zone resets clat (msec): min=36, max=1523, avg=407.91, stdev=488.26 lat (msec): min=36, max=1523, avg=408.02, stdev=488.25 clat percentiles (msec): | 1.00th=[ 36], 5.00th=[ 36], 10.00th=[ 36], 20.00th=[ 80], | 30.00th=[ 103], 40.00th=[ 124], 50.00th=[ 171], 60.00th=[ 218], | 70.00th=[ 355], 80.00th=[ 447], 90.00th=[ 1028], 95.00th=[ 1519], | 99.00th=[ 1519], 99.50th=[ 1519], 99.90th=[ 1519], 99.95th=[ 1519], | 99.99th=[ 1519] bw ( KiB/s): min= 2043, max= 6144, per=67.72%, avg=4093.50, stdev=2367.71, samples=4 iops : min= 1, max= 6, avg= 3.50, stdev= 2.89, samples=4 lat (msec) : 50=8.33%, 100=8.33%, 250=41.67%, 500=25.00%, 2000=16.67% cpu : usr=0.07%, sys=11.81%, ctx=106, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181360: Wed Sep 2 11:46:53 2026 read: IOPS=1, BW=1403KiB/s (1436kB/s)(6144KiB/4380msec) clat (msec): min=62, max=437, avg=180.56, stdev=143.65 lat (msec): min=62, max=437, avg=180.56, stdev=143.65 clat percentiles (msec): | 1.00th=[ 63], 5.00th=[ 63], 10.00th=[ 63], 20.00th=[ 80], | 30.00th=[ 80], 40.00th=[ 99], 50.00th=[ 99], 60.00th=[ 150], | 70.00th=[ 255], 80.00th=[ 255], 90.00th=[ 439], 95.00th=[ 439], | 99.00th=[ 439], 99.50th=[ 439], 99.90th=[ 439], 99.95th=[ 439], | 99.99th=[ 439] bw ( KiB/s): min= 2048, max= 4096, per=79.00%, avg=3410.33, stdev=1179.82, samples=3 iops : min= 2, max= 4, avg= 3.00, stdev= 1.00, samples=3 write: IOPS=1, BW=1403KiB/s (1436kB/s)(6144KiB/4380msec); 0 zone resets clat (msec): min=198, max=1125, avg=543.98, stdev=421.19 lat (msec): min=198, max=1125, avg=544.08, stdev=421.19 clat percentiles (msec): | 1.00th=[ 199], 5.00th=[ 199], 10.00th=[ 199], 20.00th=[ 284], | 30.00th=[ 284], 40.00th=[ 284], 50.00th=[ 284], 60.00th=[ 334], | 70.00th=[ 1045], 80.00th=[ 1045], 90.00th=[ 1133], 95.00th=[ 1133], | 99.00th=[ 1133], 99.50th=[ 1133], 99.90th=[ 1133], 99.95th=[ 1133], | 99.99th=[ 1133] bw ( KiB/s): min= 1796, max= 4087, per=38.98%, avg=2356.40, stdev=974.84, samples=5 iops : min= 1, max= 3, avg= 1.60, stdev= 0.89, samples=5 lat (msec) : 100=25.00%, 250=16.67%, 500=41.67%, 2000=16.67% cpu : usr=0.05%, sys=6.37%, ctx=101, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181361: Wed Sep 2 11:46:53 2026 read: IOPS=1, BW=1141KiB/s (1169kB/s)(5120KiB/4486msec) clat (msec): min=58, max=453, avg=175.35, stdev=159.93 lat (msec): min=58, max=453, avg=175.36, stdev=159.93 clat percentiles (msec): | 1.00th=[ 59], 5.00th=[ 59], 10.00th=[ 59], 20.00th=[ 59], | 30.00th=[ 84], 40.00th=[ 84], 50.00th=[ 124], 60.00th=[ 124], | 70.00th=[ 159], 80.00th=[ 159], 90.00th=[ 456], 95.00th=[ 456], | 99.00th=[ 456], 99.50th=[ 456], 99.90th=[ 456], 99.95th=[ 456], | 99.99th=[ 456] bw ( KiB/s): min= 2048, max= 4087, per=63.18%, avg=2727.67, stdev=1177.22, samples=3 iops : min= 2, max= 3, avg= 2.33, stdev= 0.58, samples=3 write: IOPS=1, BW=1598KiB/s (1636kB/s)(7168KiB/4486msec); 0 zone resets clat (msec): min=79, max=1249, avg=502.04, stdev=503.63 lat (msec): min=79, max=1249, avg=502.13, stdev=503.63 clat percentiles (msec): | 1.00th=[ 81], 5.00th=[ 81], 10.00th=[ 81], 20.00th=[ 81], | 30.00th=[ 203], 40.00th=[ 203], 50.00th=[ 266], 60.00th=[ 460], | 70.00th=[ 460], 80.00th=[ 1183], 90.00th=[ 1250], 95.00th=[ 1250], | 99.00th=[ 1250], 99.50th=[ 1250], 99.90th=[ 1250], 99.95th=[ 1250], | 99.99th=[ 1250] bw ( KiB/s): min= 1809, max= 4087, per=41.30%, avg=2496.75, stdev=1066.01, samples=4 iops : min= 1, max= 3, avg= 1.75, stdev= 0.96, samples=4 lat (msec) : 100=33.33%, 250=25.00%, 500=25.00%, 2000=16.67% cpu : usr=0.04%, sys=9.99%, ctx=133, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4318KiB/s (4422kB/s), 448KiB/s-1511KiB/s (459kB/s-1548kB/s), io=20.0MiB (20.0MB), run=4380-4743msec WRITE: bw=6045KiB/s (6190kB/s), 1079KiB/s-2240KiB/s (1105kB/s-2293kB/s), io=28.0MiB (29.4MB), run=4380-4743msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=181367: Wed Sep 2 11:47:00 2026 read: IOPS=1, BW=5939KiB/s (6082kB/s)(12.0MiB/2069msec) clat (msec): min=464, max=964, avg=682.43, stdev=255.70 lat (msec): min=464, max=964, avg=682.43, stdev=255.70 clat percentiles (msec): | 1.00th=[ 464], 5.00th=[ 464], 10.00th=[ 464], 20.00th=[ 464], | 30.00th=[ 464], 40.00th=[ 617], 50.00th=[ 617], 60.00th=[ 617], | 70.00th=[ 961], 80.00th=[ 961], 90.00th=[ 961], 95.00th=[ 961], | 99.00th=[ 961], 99.50th=[ 961], 99.90th=[ 961], 99.95th=[ 961], | 99.99th=[ 961] bw ( KiB/s): min= 7892, max= 8192, per=100.00%, avg=8042.00, stdev=212.13, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 500=33.33%, 750=33.33%, 1000=33.33% cpu : usr=0.00%, sys=16.39%, ctx=94, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181368: Wed Sep 2 11:47:00 2026 read: IOPS=0, BW=2310KiB/s (2366kB/s)(4096KiB/1773msec) clat (nsec): min=131471k, max=131471k, avg=131470649.00, stdev= 0.00 lat (nsec): min=131473k, max=131473k, avg=131473052.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 132], 5.00th=[ 132], 10.00th=[ 132], 20.00th=[ 132], | 30.00th=[ 132], 40.00th=[ 132], 50.00th=[ 132], 60.00th=[ 132], | 70.00th=[ 132], 80.00th=[ 132], 90.00th=[ 132], 95.00th=[ 132], | 99.00th=[ 132], 99.50th=[ 132], 99.90th=[ 132], 99.95th=[ 132], | 99.99th=[ 132] bw ( KiB/s): min= 7599, max= 7599, per=95.97%, avg=7599.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=1, BW=4620KiB/s (4731kB/s)(8192KiB/1773msec); 0 zone resets clat (msec): min=531, max=1084, avg=807.78, stdev=391.40 lat (msec): min=531, max=1084, avg=808.35, stdev=391.22 clat percentiles (msec): | 1.00th=[ 531], 5.00th=[ 531], 10.00th=[ 531], 20.00th=[ 531], | 30.00th=[ 531], 40.00th=[ 531], 50.00th=[ 531], 60.00th=[ 1083], | 70.00th=[ 1083], 80.00th=[ 1083], 90.00th=[ 1083], 95.00th=[ 1083], | 99.00th=[ 1083], 99.50th=[ 1083], 99.90th=[ 1083], 99.95th=[ 1083], | 99.99th=[ 1083] bw ( KiB/s): min= 8192, max= 8192, per=56.10%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.06%, sys=17.10%, ctx=78, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181369: Wed Sep 2 11:47:00 2026 write: IOPS=1, BW=5476KiB/s (5607kB/s)(12.0MiB/2244msec); 0 zone resets clat (msec): min=162, max=1133, avg=732.55, stdev=507.06 lat (msec): min=163, max=1134, avg=733.02, stdev=507.08 clat percentiles (msec): | 1.00th=[ 163], 5.00th=[ 163], 10.00th=[ 163], 20.00th=[ 163], | 30.00th=[ 163], 40.00th=[ 902], 50.00th=[ 902], 60.00th=[ 902], | 70.00th=[ 1133], 80.00th=[ 1133], 90.00th=[ 1133], 95.00th=[ 1133], | 99.00th=[ 1133], 99.50th=[ 1133], 99.90th=[ 1133], 99.95th=[ 1133], | 99.99th=[ 1133] bw ( KiB/s): min= 8192, max= 8192, per=56.10%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=14.80%, ctx=91, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181370: Wed Sep 2 11:47:00 2026 write: IOPS=1, BW=5879KiB/s (6021kB/s)(12.0MiB/2090msec); 0 zone resets clat (msec): min=188, max=1409, avg=691.44, stdev=638.49 lat (msec): min=188, max=1410, avg=691.83, stdev=638.59 clat percentiles (msec): | 1.00th=[ 188], 5.00th=[ 188], 10.00th=[ 188], 20.00th=[ 188], | 30.00th=[ 188], 40.00th=[ 477], 50.00th=[ 477], 60.00th=[ 477], | 70.00th=[ 1418], 80.00th=[ 1418], 90.00th=[ 1418], 95.00th=[ 1418], | 99.00th=[ 1418], 99.50th=[ 1418], 99.90th=[ 1418], 99.95th=[ 1418], | 99.99th=[ 1418] bw ( KiB/s): min= 7772, max= 8192, per=54.66%, avg=7982.00, stdev=296.98, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 250=33.33%, 500=33.33%, 2000=33.33% cpu : usr=0.00%, sys=12.54%, ctx=66, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=7919KiB/s (8109kB/s), 2310KiB/s-5939KiB/s (2366kB/s-6082kB/s), io=16.0MiB (16.8MB), run=1773-2069msec WRITE: bw=14.3MiB/s (14.0MB/s), 4620KiB/s-5879KiB/s (4731kB/s-6021kB/s), io=32.0MiB (33.6MB), run=1773-2244msec rand-rw: (groupid=0, jobs=1): err= 0: pid=181372: Wed Sep 2 11:47:00 2026 read: IOPS=1, BW=6954KiB/s (7121kB/s)(12.0MiB/1767msec) clat (msec): min=470, max=639, avg=569.58, stdev=88.32 lat (msec): min=470, max=639, avg=569.59, stdev=88.31 clat percentiles (msec): | 1.00th=[ 472], 5.00th=[ 472], 10.00th=[ 472], 20.00th=[ 472], | 30.00th=[ 472], 40.00th=[ 600], 50.00th=[ 600], 60.00th=[ 600], | 70.00th=[ 642], 80.00th=[ 642], 90.00th=[ 642], 95.00th=[ 642], | 99.00th=[ 642], 99.50th=[ 642], 99.90th=[ 642], 99.95th=[ 642], | 99.99th=[ 642] bw ( KiB/s): min= 8192, max= 8192, per=100.00%, avg=8192.00, stdev= 0.00, samples=2 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 750=66.67% cpu : usr=0.00%, sys=51.70%, ctx=2141, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181373: Wed Sep 2 11:47:00 2026 read: IOPS=0, BW=1843KiB/s (1888kB/s)(4096KiB/2222msec) clat (nsec): min=494349k, max=494349k, avg=494349194.00, stdev= 0.00 lat (nsec): min=494352k, max=494352k, avg=494352134.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 493], 5.00th=[ 493], 10.00th=[ 493], 20.00th=[ 493], | 30.00th=[ 493], 40.00th=[ 493], 50.00th=[ 493], 60.00th=[ 493], | 70.00th=[ 493], 80.00th=[ 493], 90.00th=[ 493], 95.00th=[ 493], | 99.00th=[ 493], 99.50th=[ 493], 99.90th=[ 493], 99.95th=[ 493], | 99.99th=[ 493] bw ( KiB/s): min= 8192, max= 8192, per=100.00%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 write: IOPS=0, BW=3687KiB/s (3775kB/s)(8192KiB/2222msec); 0 zone resets clat (msec): min=606, max=1084, avg=845.09, stdev=338.11 lat (msec): min=606, max=1084, avg=845.63, stdev=337.90 clat percentiles (msec): | 1.00th=[ 609], 5.00th=[ 609], 10.00th=[ 609], 20.00th=[ 609], | 30.00th=[ 609], 40.00th=[ 609], 50.00th=[ 609], 60.00th=[ 1083], | 70.00th=[ 1083], 80.00th=[ 1083], 90.00th=[ 1083], 95.00th=[ 1083], | 99.00th=[ 1083], 99.50th=[ 1083], 99.90th=[ 1083], 99.95th=[ 1083], | 99.99th=[ 1083] bw ( KiB/s): min= 8192, max= 8192, per=59.28%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.05%, sys=16.25%, ctx=804, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181374: Wed Sep 2 11:47:00 2026 write: IOPS=1, BW=5183KiB/s (5307kB/s)(12.0MiB/2371msec); 0 zone resets clat (msec): min=84, max=1525, avg=763.18, stdev=724.16 lat (msec): min=85, max=1525, avg=763.61, stdev=724.13 clat percentiles (msec): | 1.00th=[ 85], 5.00th=[ 85], 10.00th=[ 85], 20.00th=[ 85], | 30.00th=[ 85], 40.00th=[ 676], 50.00th=[ 676], 60.00th=[ 676], | 70.00th=[ 1519], 80.00th=[ 1519], 90.00th=[ 1519], 95.00th=[ 1519], | 99.00th=[ 1519], 99.50th=[ 1519], 99.90th=[ 1519], 99.95th=[ 1519], | 99.99th=[ 1519] bw ( KiB/s): min= 8192, max= 8192, per=59.28%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 100=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.00%, sys=9.83%, ctx=75, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181375: Wed Sep 2 11:47:00 2026 write: IOPS=1, BW=5734KiB/s (5872kB/s)(12.0MiB/2143msec); 0 zone resets clat (msec): min=142, max=1018, avg=701.57, stdev=485.22 lat (msec): min=143, max=1019, avg=702.14, stdev=485.25 clat percentiles (msec): | 1.00th=[ 144], 5.00th=[ 144], 10.00th=[ 144], 20.00th=[ 144], | 30.00th=[ 144], 40.00th=[ 944], 50.00th=[ 944], 60.00th=[ 944], | 70.00th=[ 1020], 80.00th=[ 1020], 90.00th=[ 1020], 95.00th=[ 1020], | 99.00th=[ 1020], 99.50th=[ 1020], 99.90th=[ 1020], 99.95th=[ 1020], | 99.99th=[ 1020] bw ( KiB/s): min= 8192, max= 8192, per=59.28%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=14.80%, ctx=74, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=7374KiB/s (7551kB/s), 1843KiB/s-6954KiB/s (1888kB/s-7121kB/s), io=16.0MiB (16.8MB), run=1767-2222msec WRITE: bw=13.5MiB/s (14.2MB/s), 3687KiB/s-5734KiB/s (3775kB/s-5872kB/s), io=32.0MiB (33.6MB), run=2143-2371msec