== sanity test 398b: DIO and buffer IO race ============== 23:20:11 (1784172011) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 2.42293 s, 20.8 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=193452: Wed Jul 15 23:21:20 2026 read: IOPS=24, BW=99.3KiB/s (102kB/s)(5992KiB/60347msec) clat (usec): min=32, max=697479, avg=21875.24, stdev=21212.09 lat (usec): min=33, max=697480, avg=21875.78, stdev=21212.08 clat percentiles (usec): | 1.00th=[ 127], 5.00th=[ 8094], 10.00th=[ 9634], 20.00th=[ 11863], | 30.00th=[ 14222], 40.00th=[ 16581], 50.00th=[ 19006], 60.00th=[ 21365], | 70.00th=[ 24773], 80.00th=[ 29230], 90.00th=[ 36963], 95.00th=[ 43779], | 99.00th=[ 63701], 99.50th=[ 72877], 99.90th=[ 96994], 99.95th=[700449], | 99.99th=[700449] bw ( KiB/s): min= 13, max= 223, per=24.96%, avg=99.10, stdev=33.17, samples=120 iops : min= 3, max= 55, avg=24.40, stdev= 8.33, samples=120 write: IOPS=26, BW=104KiB/s (107kB/s)(6296KiB/60347msec); 0 zone resets clat (usec): min=782, max=96853, avg=17394.08, stdev=13218.62 lat (usec): min=783, max=96853, avg=17394.69, stdev=13218.61 clat percentiles (usec): | 1.00th=[ 873], 5.00th=[ 2900], 10.00th=[ 3621], 20.00th=[ 5604], | 30.00th=[ 8979], 40.00th=[11600], 50.00th=[14091], 60.00th=[17171], | 70.00th=[21627], 80.00th=[27657], 90.00th=[35914], 95.00th=[43254], | 99.00th=[57934], 99.50th=[62129], 99.90th=[85459], 99.95th=[96994], | 99.99th=[96994] bw ( KiB/s): min= 31, max= 239, per=25.23%, avg=104.94, stdev=38.18, samples=119 iops : min= 7, max= 59, avg=25.86, stdev= 9.59, samples=119 lat (usec) : 50=0.10%, 100=0.26%, 250=0.49%, 500=0.07%, 1000=0.68% lat (msec) : 2=0.91%, 4=5.21%, 10=15.27%, 20=37.53%, 50=36.72% lat (msec) : 100=2.73%, 750=0.03% cpu : usr=0.07%, sys=25.01%, ctx=9890, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=193453: Wed Jul 15 23:21:20 2026 read: IOPS=24, BW=99.4KiB/s (102kB/s)(5940KiB/59729msec) clat (usec): min=31, max=98733, avg=21305.06, stdev=12038.24 lat (usec): min=31, max=98734, avg=21305.58, stdev=12038.27 clat percentiles (usec): | 1.00th=[ 119], 5.00th=[ 8291], 10.00th=[ 9896], 20.00th=[11994], | 30.00th=[14353], 40.00th=[16909], 50.00th=[18744], 60.00th=[21627], | 70.00th=[24511], 80.00th=[28705], 90.00th=[35390], 95.00th=[42206], | 99.00th=[66323], 99.50th=[77071], 99.90th=[90702], 99.95th=[99091], | 99.99th=[99091] bw ( KiB/s): min= 6, max= 199, per=24.88%, avg=98.77, stdev=33.45, samples=118 iops : min= 1, max= 49, avg=24.31, stdev= 8.42, samples=118 write: IOPS=26, BW=106KiB/s (109kB/s)(6348KiB/59729msec); 0 zone resets clat (usec): min=789, max=645099, avg=17577.53, stdev=20690.36 lat (usec): min=789, max=645099, avg=17578.09, stdev=20690.37 clat percentiles (usec): | 1.00th=[ 914], 5.00th=[ 2704], 10.00th=[ 3458], 20.00th=[ 5014], | 30.00th=[ 8160], 40.00th=[ 10945], 50.00th=[ 13829], 60.00th=[ 17695], | 70.00th=[ 21890], 80.00th=[ 27132], 90.00th=[ 36439], 95.00th=[ 44303], | 99.00th=[ 64750], 99.50th=[ 68682], 99.90th=[ 84411], 99.95th=[641729], | 99.99th=[641729] bw ( KiB/s): min= 6, max= 192, per=25.28%, avg=105.18, stdev=37.42, samples=118 iops : min= 1, max= 48, avg=25.92, stdev= 9.39, samples=118 lat (usec) : 50=0.03%, 100=0.23%, 250=0.68%, 1000=0.68% lat (msec) : 2=1.11%, 4=6.28%, 10=15.01%, 20=35.90%, 50=37.63% lat (msec) : 100=2.41%, 750=0.03% cpu : usr=0.06%, sys=25.06%, ctx=9562, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=193454: Wed Jul 15 23:21:20 2026 read: IOPS=25, BW=101KiB/s (104kB/s)(6028KiB/59627msec) clat (usec): min=34, max=78379, avg=21252.45, stdev=11610.86 lat (usec): min=34, max=78380, avg=21253.09, stdev=11610.99 clat percentiles (usec): | 1.00th=[ 121], 5.00th=[ 7963], 10.00th=[ 9634], 20.00th=[11863], | 30.00th=[13829], 40.00th=[16581], 50.00th=[19006], 60.00th=[21890], | 70.00th=[25035], 80.00th=[28705], 90.00th=[36439], 95.00th=[43254], | 99.00th=[58983], 99.50th=[65274], 99.90th=[76022], 99.95th=[78119], | 99.99th=[78119] bw ( KiB/s): min= 32, max= 191, per=25.60%, avg=101.62, stdev=32.19, samples=117 iops : min= 8, max= 47, avg=25.03, stdev= 8.09, samples=117 write: IOPS=26, BW=105KiB/s (108kB/s)(6260KiB/59627msec); 0 zone resets clat (usec): min=735, max=666944, avg=17512.63, stdev=21177.99 lat (usec): min=736, max=666945, avg=17513.28, stdev=21178.01 clat percentiles (usec): | 1.00th=[ 881], 5.00th=[ 2606], 10.00th=[ 3425], 20.00th=[ 4817], | 30.00th=[ 7832], 40.00th=[ 11076], 50.00th=[ 13960], 60.00th=[ 17433], | 70.00th=[ 21627], 80.00th=[ 27919], 90.00th=[ 36439], 95.00th=[ 42206], | 99.00th=[ 56886], 99.50th=[ 65274], 99.90th=[102237], 99.95th=[666895], | 99.99th=[666895] bw ( KiB/s): min= 32, max= 200, per=25.31%, avg=105.28, stdev=36.59, samples=117 iops : min= 8, max= 50, avg=25.95, stdev= 9.22, samples=117 lat (usec) : 50=0.10%, 100=0.13%, 250=0.72%, 500=0.07%, 750=0.10% lat (usec) : 1000=0.88% lat (msec) : 2=0.68%, 4=6.90%, 10=14.94%, 20=35.48%, 50=37.24% lat (msec) : 100=2.70%, 250=0.03%, 750=0.03% cpu : usr=0.08%, sys=25.09%, ctx=9705, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=193455: Wed Jul 15 23:21:20 2026 read: IOPS=25, BW=101KiB/s (104kB/s)(6052KiB/59835msec) clat (usec): min=31, max=116739, avg=21382.97, stdev=11701.06 lat (usec): min=31, max=116740, avg=21383.52, stdev=11701.11 clat percentiles (usec): | 1.00th=[ 112], 5.00th=[ 7635], 10.00th=[ 9765], 20.00th=[ 11994], | 30.00th=[ 14484], 40.00th=[ 16909], 50.00th=[ 19268], 60.00th=[ 21890], | 70.00th=[ 24773], 80.00th=[ 29492], 90.00th=[ 36439], 95.00th=[ 42206], | 99.00th=[ 59507], 99.50th=[ 66847], 99.90th=[ 86508], 99.95th=[116917], | 99.99th=[116917] bw ( KiB/s): min= 47, max= 176, per=25.67%, avg=101.90, stdev=30.02, samples=118 iops : min= 11, max= 44, avg=25.10, stdev= 7.59, samples=118 write: IOPS=26, BW=104KiB/s (107kB/s)(6236KiB/59835msec); 0 zone resets clat (usec): min=736, max=651989, avg=17501.77, stdev=20982.73 lat (usec): min=737, max=651989, avg=17503.11, stdev=20982.74 clat percentiles (usec): | 1.00th=[ 881], 5.00th=[ 2802], 10.00th=[ 3458], 20.00th=[ 4686], | 30.00th=[ 8029], 40.00th=[ 10945], 50.00th=[ 13829], 60.00th=[ 17433], | 70.00th=[ 21365], 80.00th=[ 27395], 90.00th=[ 35390], 95.00th=[ 43254], | 99.00th=[ 60556], 99.50th=[ 69731], 99.90th=[ 98042], 99.95th=[650118], | 99.99th=[650118] bw ( KiB/s): min= 19, max= 232, per=25.01%, avg=104.05, stdev=39.38, samples=119 iops : min= 4, max= 58, avg=25.63, stdev= 9.92, samples=119 lat (usec) : 50=0.13%, 100=0.16%, 250=0.75%, 500=0.07%, 750=0.03% lat (usec) : 1000=0.81% lat (msec) : 2=0.75%, 4=6.58%, 10=14.52%, 20=36.07%, 50=37.89% lat (msec) : 100=2.18%, 250=0.03%, 750=0.03% cpu : usr=0.07%, sys=24.93%, ctx=9892, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=398KiB/s (407kB/s), 99.3KiB/s-101KiB/s (102kB/s-104kB/s), io=23.4MiB (24.6MB), run=59627-60347msec WRITE: bw=417KiB/s (427kB/s), 104KiB/s-106KiB/s (107kB/s-109kB/s), io=24.6MiB (25.7MB), run=59627-60347msec rand-rw: (groupid=0, jobs=1): err= 0: pid=193457: Wed Jul 15 23:21:27 2026 read: IOPS=22, BW=88.8KiB/s (90.9kB/s)(5992KiB/67464msec) clat (msec): min=2, max=707, avg=19.97, stdev=23.66 lat (msec): min=2, max=707, avg=19.98, stdev=23.66 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 5], 10.00th=[ 6], 20.00th=[ 6], | 30.00th=[ 9], 40.00th=[ 12], 50.00th=[ 16], 60.00th=[ 20], | 70.00th=[ 24], 80.00th=[ 31], 90.00th=[ 43], 95.00th=[ 52], | 99.00th=[ 73], 99.50th=[ 84], 99.90th=[ 115], 99.95th=[ 709], | 99.99th=[ 709] bw ( KiB/s): min= 15, max= 360, per=25.05%, avg=88.91, stdev=69.24, samples=133 iops : min= 3, max= 90, avg=21.83, stdev=17.44, samples=133 write: IOPS=23, BW=93.3KiB/s (95.6kB/s)(6296KiB/67464msec); 0 zone resets clat (msec): min=4, max=120, avg=23.77, stdev=17.37 lat (msec): min=4, max=120, avg=23.77, stdev=17.37 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 7], 10.00th=[ 7], 20.00th=[ 9], | 30.00th=[ 11], 40.00th=[ 16], 50.00th=[ 20], 60.00th=[ 25], | 70.00th=[ 31], 80.00th=[ 36], 90.00th=[ 48], 95.00th=[ 57], | 99.00th=[ 80], 99.50th=[ 99], 99.90th=[ 112], 99.95th=[ 121], | 99.99th=[ 121] bw ( KiB/s): min= 15, max= 351, per=25.16%, avg=93.60, stdev=70.60, samples=133 iops : min= 3, max= 87, avg=23.00, stdev=17.77, samples=133 lat (msec) : 4=0.65%, 10=31.25%, 20=24.90%, 50=36.26%, 100=6.71% lat (msec) : 250=0.20%, 750=0.03% cpu : usr=0.06%, sys=13.75%, ctx=6666, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=193458: Wed Jul 15 23:21:27 2026 read: IOPS=22, BW=88.2KiB/s (90.4kB/s)(5940KiB/67318msec) clat (msec): min=2, max=658, avg=19.59, stdev=22.75 lat (msec): min=2, max=658, avg=19.59, stdev=22.75 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 5], 10.00th=[ 6], 20.00th=[ 6], | 30.00th=[ 8], 40.00th=[ 12], 50.00th=[ 15], 60.00th=[ 18], | 70.00th=[ 23], 80.00th=[ 30], 90.00th=[ 43], 95.00th=[ 52], | 99.00th=[ 73], 99.50th=[ 83], 99.90th=[ 103], 99.95th=[ 659], | 99.99th=[ 659] bw ( KiB/s): min= 15, max= 368, per=25.01%, avg=88.79, stdev=71.16, samples=133 iops : min= 3, max= 92, avg=21.80, stdev=17.92, samples=133 write: IOPS=23, BW=94.3KiB/s (96.6kB/s)(6348KiB/67318msec); 0 zone resets clat (msec): min=4, max=149, avg=24.02, stdev=18.27 lat (msec): min=4, max=149, avg=24.02, stdev=18.27 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 7], 10.00th=[ 7], 20.00th=[ 9], | 30.00th=[ 11], 40.00th=[ 16], 50.00th=[ 20], 60.00th=[ 25], | 70.00th=[ 31], 80.00th=[ 37], 90.00th=[ 48], 95.00th=[ 59], | 99.00th=[ 88], 99.50th=[ 102], 99.90th=[ 124], 99.95th=[ 150], | 99.99th=[ 150] bw ( KiB/s): min= 23, max= 359, per=25.50%, avg=94.86, stdev=71.60, samples=133 iops : min= 5, max= 89, avg=23.32, stdev=18.03, samples=133 lat (msec) : 4=0.59%, 10=31.35%, 20=26.27%, 50=34.70%, 100=6.67% lat (msec) : 250=0.39%, 750=0.03% cpu : usr=0.05%, sys=13.77%, ctx=6632, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=193459: Wed Jul 15 23:21:27 2026 read: IOPS=22, BW=89.3KiB/s (91.4kB/s)(6028KiB/67509msec) clat (msec): min=2, max=102, avg=19.39, stdev=16.05 lat (msec): min=2, max=102, avg=19.39, stdev=16.05 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 5], 10.00th=[ 6], 20.00th=[ 7], | 30.00th=[ 8], 40.00th=[ 12], 50.00th=[ 15], 60.00th=[ 18], | 70.00th=[ 23], 80.00th=[ 31], 90.00th=[ 42], 95.00th=[ 52], | 99.00th=[ 74], 99.50th=[ 91], 99.90th=[ 99], 99.95th=[ 103], | 99.99th=[ 103] bw ( KiB/s): min= 15, max= 392, per=25.16%, avg=89.33, stdev=70.81, samples=133 iops : min= 3, max= 98, avg=21.93, stdev=17.81, samples=133 write: IOPS=23, BW=92.7KiB/s (94.0kB/s)(6260KiB/67509msec); 0 zone resets clat (msec): min=4, max=658, avg=24.39, stdev=23.86 lat (msec): min=4, max=658, avg=24.39, stdev=23.86 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 7], 10.00th=[ 7], 20.00th=[ 9], | 30.00th=[ 11], 40.00th=[ 16], 50.00th=[ 20], 60.00th=[ 25], | 70.00th=[ 31], 80.00th=[ 38], 90.00th=[ 48], 95.00th=[ 59], | 99.00th=[ 89], 99.50th=[ 95], 99.90th=[ 109], 99.95th=[ 659], | 99.99th=[ 659] bw ( KiB/s): min= 15, max= 344, per=24.88%, avg=92.57, stdev=69.98, samples=133 iops : min= 3, max= 86, avg=22.74, stdev=17.64, samples=133 lat (msec) : 4=0.85%, 10=31.32%, 20=25.33%, 50=35.55%, 100=6.77% lat (msec) : 250=0.16%, 750=0.03% cpu : usr=0.06%, sys=13.58%, ctx=6592, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=193460: Wed Jul 15 23:21:27 2026 read: IOPS=22, BW=89.8KiB/s (91.0kB/s)(6052KiB/67375msec) clat (usec): min=3063, max=96169, avg=19400.93, stdev=15212.94 lat (usec): min=3064, max=96170, avg=19401.47, stdev=15212.98 clat percentiles (usec): | 1.00th=[ 3949], 5.00th=[ 4686], 10.00th=[ 5145], 20.00th=[ 6063], | 30.00th=[ 8094], 40.00th=[11863], 50.00th=[15401], 60.00th=[18744], | 70.00th=[23200], 80.00th=[29754], 90.00th=[41157], 95.00th=[51119], | 99.00th=[70779], 99.50th=[74974], 99.90th=[84411], 99.95th=[95945], | 99.99th=[95945] bw ( KiB/s): min= 23, max= 344, per=25.45%, avg=90.35, stdev=69.87, samples=133 iops : min= 5, max= 86, avg=22.19, stdev=17.59, samples=133 write: IOPS=23, BW=92.6KiB/s (94.8kB/s)(6236KiB/67375msec); 0 zone resets clat (msec): min=4, max=663, avg=24.31, stdev=24.42 lat (msec): min=4, max=663, avg=24.31, stdev=24.42 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 7], 10.00th=[ 7], 20.00th=[ 9], | 30.00th=[ 11], 40.00th=[ 15], 50.00th=[ 20], 60.00th=[ 25], | 70.00th=[ 31], 80.00th=[ 38], 90.00th=[ 48], 95.00th=[ 58], | 99.00th=[ 92], 99.50th=[ 104], 99.90th=[ 159], 99.95th=[ 667], | 99.99th=[ 667] bw ( KiB/s): min= 31, max= 360, per=25.01%, avg=93.05, stdev=71.39, samples=133 iops : min= 7, max= 90, avg=22.86, stdev=17.98, samples=133 lat (msec) : 4=0.62%, 10=31.48%, 20=25.23%, 50=35.97%, 100=6.38% lat (msec) : 250=0.29%, 750=0.03% cpu : usr=0.04%, sys=13.67%, ctx=6761, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=356KiB/s (364kB/s), 88.2KiB/s-89.8KiB/s (90.4kB/s-91.0kB/s), io=23.4MiB (24.6MB), run=67318-67509msec WRITE: bw=372KiB/s (381kB/s), 92.6KiB/s-94.3KiB/s (94.8kB/s-96.6kB/s), io=24.6MiB (25.7MB), run=67318-67509msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=193491: Wed Jul 15 23:21:47 2026 read: IOPS=25, BW=414KiB/s (424kB/s)(5920KiB/14310msec) clat (usec): min=50, max=81399, avg=20150.14, stdev=10859.44 lat (usec): min=51, max=81400, avg=20150.67, stdev=10859.29 clat percentiles (usec): | 1.00th=[ 85], 5.00th=[ 127], 10.00th=[ 9241], 20.00th=[12518], | 30.00th=[14353], 40.00th=[16909], 50.00th=[18744], 60.00th=[21627], | 70.00th=[24773], 80.00th=[27919], 90.00th=[32375], 95.00th=[37487], | 99.00th=[54789], 99.50th=[59507], 99.90th=[81265], 99.95th=[81265], | 99.99th=[81265] bw ( KiB/s): min= 318, max= 573, per=25.55%, avg=413.96, stdev=69.06, samples=28 iops : min= 19, max= 35, avg=25.29, stdev= 4.38, samples=28 write: IOPS=27, BW=445KiB/s (456kB/s)(6368KiB/14310msec); 0 zone resets clat (usec): min=1047, max=90325, avg=17171.46, stdev=12250.65 lat (usec): min=1047, max=90326, avg=17172.26, stdev=12250.64 clat percentiles (usec): | 1.00th=[ 1237], 5.00th=[ 3949], 10.00th=[ 4948], 20.00th=[ 6128], | 30.00th=[ 8717], 40.00th=[11731], 50.00th=[13698], 60.00th=[17171], | 70.00th=[22152], 80.00th=[26346], 90.00th=[35914], 95.00th=[40109], | 99.00th=[55313], 99.50th=[58983], 99.90th=[90702], 99.95th=[90702], | 99.99th=[90702] bw ( KiB/s): min= 127, max= 669, per=26.14%, avg=445.36, stdev=116.60, samples=28 iops : min= 7, max= 41, avg=27.25, stdev= 7.26, samples=28 lat (usec) : 100=0.91%, 250=2.34%, 500=0.13%, 750=0.13% lat (msec) : 2=1.30%, 4=1.43%, 10=16.41%, 20=37.89%, 50=38.02% lat (msec) : 100=1.43% cpu : usr=0.08%, sys=26.98%, ctx=2767, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=193492: Wed Jul 15 23:21:47 2026 read: IOPS=24, BW=389KiB/s (398kB/s)(5744KiB/14782msec) clat (usec): min=33, max=83454, avg=21480.56, stdev=10861.91 lat (usec): min=34, max=83454, avg=21481.01, stdev=10861.91 clat percentiles (usec): | 1.00th=[ 113], 5.00th=[ 8586], 10.00th=[11207], 20.00th=[13960], | 30.00th=[16319], 40.00th=[18482], 50.00th=[20055], 60.00th=[22676], | 70.00th=[24511], 80.00th=[27657], 90.00th=[33162], 95.00th=[40633], | 99.00th=[62129], 99.50th=[70779], 99.90th=[83362], 99.95th=[83362], | 99.99th=[83362] bw ( KiB/s): min= 192, max= 544, per=23.95%, avg=388.07, stdev=91.06, samples=29 iops : min= 12, max= 34, avg=23.66, stdev= 5.63, samples=29 write: IOPS=27, BW=443KiB/s (453kB/s)(6544KiB/14782msec); 0 zone resets clat (usec): min=1051, max=67926, avg=17138.06, stdev=12519.20 lat (usec): min=1052, max=67927, avg=17138.87, stdev=12519.30 clat percentiles (usec): | 1.00th=[ 1696], 5.00th=[ 3687], 10.00th=[ 5080], 20.00th=[ 5932], | 30.00th=[ 7963], 40.00th=[11338], 50.00th=[14615], 60.00th=[16909], | 70.00th=[20579], 80.00th=[25822], 90.00th=[35390], 95.00th=[42206], | 99.00th=[57410], 99.50th=[62129], 99.90th=[67634], 99.95th=[67634], | 99.99th=[67634] bw ( KiB/s): min= 256, max= 733, per=25.91%, avg=441.45, stdev=109.05, samples=29 iops : min= 16, max= 45, avg=27.00, stdev= 6.74, samples=29 lat (usec) : 50=0.13%, 100=0.26%, 250=1.82% lat (msec) : 2=0.65%, 4=2.21%, 10=16.67%, 20=37.37%, 50=38.67% lat (msec) : 100=2.21% cpu : usr=0.09%, sys=26.97%, ctx=2940, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=193493: Wed Jul 15 23:21:47 2026 read: IOPS=26, BW=425KiB/s (435kB/s)(6256KiB/14713msec) clat (usec): min=36, max=120732, avg=20132.33, stdev=11349.72 lat (usec): min=37, max=120733, avg=20132.93, stdev=11349.69 clat percentiles (usec): | 1.00th=[ 69], 5.00th=[ 133], 10.00th=[ 10159], 20.00th=[ 12518], | 30.00th=[ 14222], 40.00th=[ 16581], 50.00th=[ 18482], 60.00th=[ 21103], | 70.00th=[ 23987], 80.00th=[ 27132], 90.00th=[ 32900], 95.00th=[ 36963], | 99.00th=[ 55837], 99.50th=[ 64750], 99.90th=[121111], 99.95th=[121111], | 99.99th=[121111] bw ( KiB/s): min= 254, max= 667, per=26.38%, avg=427.34, stdev=108.31, samples=29 iops : min= 15, max= 41, avg=26.10, stdev= 6.86, samples=29 write: IOPS=25, BW=410KiB/s (420kB/s)(6032KiB/14713msec); 0 zone resets clat (usec): min=992, max=82147, avg=17818.80, stdev=13239.88 lat (usec): min=993, max=82148, avg=17819.59, stdev=13239.90 clat percentiles (usec): | 1.00th=[ 1319], 5.00th=[ 3326], 10.00th=[ 5080], 20.00th=[ 6456], | 30.00th=[ 9241], 40.00th=[11338], 50.00th=[14484], 60.00th=[17695], | 70.00th=[22414], 80.00th=[27919], 90.00th=[36439], 95.00th=[42730], | 99.00th=[57934], 99.50th=[79168], 99.90th=[82314], 99.95th=[82314], | 99.99th=[82314] bw ( KiB/s): min= 160, max= 733, per=23.90%, avg=407.28, stdev=113.67, samples=29 iops : min= 10, max= 45, avg=24.86, stdev= 7.07, samples=29 lat (usec) : 50=0.39%, 100=0.91%, 250=1.69%, 750=0.13%, 1000=0.13% lat (msec) : 2=1.17%, 4=1.82%, 10=14.71%, 20=40.10%, 50=36.72% lat (msec) : 100=2.08%, 250=0.13% cpu : usr=0.06%, sys=26.58%, ctx=2907, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=193494: Wed Jul 15 23:21:47 2026 read: IOPS=26, BW=423KiB/s (433kB/s)(6032KiB/14255msec) clat (usec): min=34, max=70914, avg=19471.82, stdev=11651.52 lat (usec): min=35, max=70914, avg=19472.34, stdev=11651.57 clat percentiles (usec): | 1.00th=[ 71], 5.00th=[ 118], 10.00th=[ 174], 20.00th=[12256], | 30.00th=[13829], 40.00th=[15795], 50.00th=[17957], 60.00th=[21103], | 70.00th=[24249], 80.00th=[27132], 90.00th=[32375], 95.00th=[40633], | 99.00th=[59507], 99.50th=[64226], 99.90th=[70779], 99.95th=[70779], | 99.99th=[70779] bw ( KiB/s): min= 256, max= 574, per=26.06%, avg=422.18, stdev=78.01, samples=28 iops : min= 16, max= 35, avg=25.79, stdev= 4.83, samples=28 write: IOPS=27, BW=439KiB/s (449kB/s)(6256KiB/14255msec); 0 zone resets clat (usec): min=1139, max=89400, avg=17419.63, stdev=12165.56 lat (usec): min=1140, max=89401, avg=17420.44, stdev=12165.57 clat percentiles (usec): | 1.00th=[ 1532], 5.00th=[ 3884], 10.00th=[ 4817], 20.00th=[ 6325], | 30.00th=[ 8979], 40.00th=[12649], 50.00th=[14877], 60.00th=[17433], | 70.00th=[20841], 80.00th=[27395], 90.00th=[34341], 95.00th=[40109], | 99.00th=[54264], 99.50th=[64226], 99.90th=[89654], 99.95th=[89654], | 99.99th=[89654] bw ( KiB/s): min= 254, max= 699, per=25.90%, avg=441.29, stdev=109.90, samples=28 iops : min= 15, max= 43, avg=27.00, stdev= 6.87, samples=28 lat (usec) : 50=0.39%, 100=0.65%, 250=4.17% lat (msec) : 2=0.91%, 4=1.95%, 10=16.02%, 20=36.98%, 50=37.37% lat (msec) : 100=1.56% cpu : usr=0.04%, sys=27.09%, ctx=2735, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1620KiB/s (1659kB/s), 389KiB/s-425KiB/s (398kB/s-435kB/s), io=23.4MiB (24.5MB), run=14255-14782msec WRITE: bw=1705KiB/s (1746kB/s), 410KiB/s-445KiB/s (420kB/s-456kB/s), io=24.6MiB (25.8MB), run=14255-14782msec rand-rw: (groupid=0, jobs=1): err= 0: pid=193487: Wed Jul 15 23:21:50 2026 read: IOPS=21, BW=350KiB/s (359kB/s)(5920KiB/16894msec) clat (usec): min=3440, max=96928, avg=18779.66, stdev=14886.80 lat (usec): min=3440, max=96929, avg=18780.16, stdev=14886.81 clat percentiles (usec): | 1.00th=[ 4080], 5.00th=[ 5342], 10.00th=[ 5932], 20.00th=[ 6652], | 30.00th=[ 9503], 40.00th=[11731], 50.00th=[14091], 60.00th=[16581], | 70.00th=[20579], 80.00th=[28181], 90.00th=[39584], 95.00th=[49021], | 99.00th=[73925], 99.50th=[87557], 99.90th=[96994], 99.95th=[96994], | 99.99th=[96994] bw ( KiB/s): min= 64, max= 928, per=23.82%, avg=337.55, stdev=216.62, samples=33 iops : min= 4, max= 58, avg=20.64, stdev=13.61, samples=33 write: IOPS=23, BW=377KiB/s (386kB/s)(6368KiB/16894msec); 0 zone resets clat (msec): min=6, max=101, avg=24.56, stdev=17.12 lat (msec): min=6, max=101, avg=24.56, stdev=17.12 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 8], 20.00th=[ 10], | 30.00th=[ 12], 40.00th=[ 16], 50.00th=[ 19], 60.00th=[ 26], | 70.00th=[ 31], 80.00th=[ 39], 90.00th=[ 49], 95.00th=[ 55], | 99.00th=[ 89], 99.50th=[ 91], 99.90th=[ 102], 99.95th=[ 102], | 99.99th=[ 102] bw ( KiB/s): min= 127, max= 1056, per=24.76%, avg=369.12, stdev=222.91, samples=33 iops : min= 7, max= 66, avg=22.61, stdev=14.07, samples=33 lat (msec) : 4=0.39%, 10=26.43%, 20=33.33%, 50=33.07%, 100=6.64% lat (msec) : 250=0.13% cpu : usr=0.05%, sys=13.25%, ctx=1761, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=193488: Wed Jul 15 23:21:50 2026 read: IOPS=21, BW=342KiB/s (350kB/s)(5744KiB/16807msec) clat (usec): min=3735, max=82709, avg=19177.01, stdev=14093.34 lat (usec): min=3735, max=82709, avg=19177.68, stdev=14093.39 clat percentiles (usec): | 1.00th=[ 5145], 5.00th=[ 5997], 10.00th=[ 6652], 20.00th=[ 8160], | 30.00th=[10683], 40.00th=[12387], 50.00th=[14091], 60.00th=[16909], | 70.00th=[21627], 80.00th=[27657], 90.00th=[39060], 95.00th=[47973], | 99.00th=[72877], 99.50th=[78119], 99.90th=[82314], 99.95th=[82314], | 99.99th=[82314] bw ( KiB/s): min= 127, max= 832, per=23.78%, avg=337.03, stdev=177.46, samples=33 iops : min= 7, max= 52, avg=20.61, stdev=11.24, samples=33 write: IOPS=24, BW=389KiB/s (399kB/s)(6544KiB/16807msec); 0 zone resets clat (msec): min=5, max=120, avg=24.13, stdev=16.47 lat (msec): min=5, max=120, avg=24.13, stdev=16.47 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 10], | 30.00th=[ 12], 40.00th=[ 17], 50.00th=[ 21], 60.00th=[ 24], | 70.00th=[ 30], 80.00th=[ 36], 90.00th=[ 46], 95.00th=[ 54], | 99.00th=[ 75], 99.50th=[ 94], 99.90th=[ 121], 99.95th=[ 121], | 99.99th=[ 121] bw ( KiB/s): min= 159, max= 1024, per=25.57%, avg=381.30, stdev=226.51, samples=33 iops : min= 9, max= 64, avg=23.39, stdev=14.27, samples=33 lat (msec) : 4=0.13%, 10=23.44%, 20=33.72%, 50=36.59%, 100=5.86% lat (msec) : 250=0.26% cpu : usr=0.10%, sys=13.55%, ctx=1752, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=193489: Wed Jul 15 23:21:50 2026 read: IOPS=23, BW=372KiB/s (381kB/s)(6256KiB/16823msec) clat (usec): min=3748, max=97219, avg=19644.16, stdev=15029.38 lat (usec): min=3749, max=97220, avg=19644.77, stdev=15029.37 clat percentiles (usec): | 1.00th=[ 4752], 5.00th=[ 5604], 10.00th=[ 6259], 20.00th=[ 7504], | 30.00th=[10159], 40.00th=[12780], 50.00th=[14615], 60.00th=[17433], | 70.00th=[23200], 80.00th=[29230], 90.00th=[39584], 95.00th=[52167], | 99.00th=[69731], 99.50th=[83362], 99.90th=[96994], 99.95th=[96994], | 99.99th=[96994] bw ( KiB/s): min= 128, max= 1152, per=26.01%, avg=368.61, stdev=239.82, samples=33 iops : min= 8, max= 72, avg=22.58, stdev=15.11, samples=33 write: IOPS=22, BW=359KiB/s (367kB/s)(6032KiB/16823msec); 0 zone resets clat (usec): min=5751, max=97183, avg=24196.34, stdev=15774.86 lat (usec): min=5752, max=97185, avg=24197.40, stdev=15774.92 clat percentiles (usec): | 1.00th=[ 6325], 5.00th=[ 7308], 10.00th=[ 8029], 20.00th=[ 9765], | 30.00th=[12780], 40.00th=[15795], 50.00th=[19530], 60.00th=[25560], | 70.00th=[29754], 80.00th=[37487], 90.00th=[46924], 95.00th=[54264], | 99.00th=[70779], 99.50th=[87557], 99.90th=[96994], 99.95th=[96994], | 99.99th=[96994] bw ( KiB/s): min= 128, max= 1056, per=23.48%, avg=350.06, stdev=205.91, samples=33 iops : min= 8, max= 66, avg=21.42, stdev=13.01, samples=33 lat (msec) : 4=0.13%, 10=25.78%, 20=32.55%, 50=35.03%, 100=6.51% cpu : usr=0.05%, sys=13.27%, ctx=1754, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=193490: Wed Jul 15 23:21:50 2026 read: IOPS=22, BW=357KiB/s (366kB/s)(6032KiB/16894msec) clat (usec): min=3457, max=92688, avg=19758.43, stdev=15463.16 lat (usec): min=3457, max=92690, avg=19758.94, stdev=15463.17 clat percentiles (usec): | 1.00th=[ 4359], 5.00th=[ 5473], 10.00th=[ 6194], 20.00th=[ 7373], | 30.00th=[ 9110], 40.00th=[12387], 50.00th=[14746], 60.00th=[17695], | 70.00th=[22152], 80.00th=[30802], 90.00th=[43254], 95.00th=[51643], | 99.00th=[71828], 99.50th=[86508], 99.90th=[92799], 99.95th=[92799], | 99.99th=[92799] bw ( KiB/s): min= 159, max= 1152, per=24.50%, avg=347.21, stdev=216.90, samples=33 iops : min= 9, max= 72, avg=21.24, stdev=13.70, samples=33 write: IOPS=23, BW=370KiB/s (379kB/s)(6256KiB/16894msec); 0 zone resets clat (msec): min=4, max=120, avg=23.88, stdev=16.20 lat (msec): min=4, max=120, avg=23.88, stdev=16.20 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 11], | 30.00th=[ 13], 40.00th=[ 16], 50.00th=[ 19], 60.00th=[ 24], | 70.00th=[ 31], 80.00th=[ 38], 90.00th=[ 45], 95.00th=[ 54], | 99.00th=[ 77], 99.50th=[ 103], 99.90th=[ 122], 99.95th=[ 122], | 99.99th=[ 122] bw ( KiB/s): min= 159, max= 960, per=24.29%, avg=362.18, stdev=211.59, samples=33 iops : min= 9, max= 60, avg=22.18, stdev=13.34, samples=33 lat (msec) : 4=0.26%, 10=25.78%, 20=33.98%, 50=33.46%, 100=6.25% lat (msec) : 250=0.26% cpu : usr=0.05%, sys=13.49%, ctx=1765, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1418KiB/s (1452kB/s), 342KiB/s-372KiB/s (350kB/s-381kB/s), io=23.4MiB (24.5MB), run=16807-16894msec WRITE: bw=1492KiB/s (1527kB/s), 359KiB/s-389KiB/s (367kB/s-399kB/s), io=24.6MiB (25.8MB), run=16807-16894msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=193501: Wed Jul 15 23:21:59 2026 read: IOPS=3, BW=3885KiB/s (3978kB/s)(7168KiB/1845msec) clat (usec): min=390, max=206260, avg=105500.79, stdev=78781.52 lat (usec): min=391, max=206262, avg=105501.75, stdev=78781.74 clat percentiles (usec): | 1.00th=[ 392], 5.00th=[ 392], 10.00th=[ 392], 20.00th=[ 478], | 30.00th=[106431], 40.00th=[106431], 50.00th=[115868], 60.00th=[145753], | 70.00th=[145753], 80.00th=[162530], 90.00th=[206570], 95.00th=[206570], | 99.00th=[206570], 99.50th=[206570], 99.90th=[206570], 99.95th=[206570], | 99.99th=[206570] bw ( KiB/s): min= 3886, max= 5251, per=74.73%, avg=4568.50, stdev=965.20, samples=2 iops : min= 3, max= 5, avg= 4.00, stdev= 1.41, samples=2 write: IOPS=2, BW=2775KiB/s (2842kB/s)(5120KiB/1845msec); 0 zone resets clat (msec): min=151, max=334, avg=212.61, stdev=72.79 lat (msec): min=151, max=334, avg=212.65, stdev=72.81 clat percentiles (msec): | 1.00th=[ 153], 5.00th=[ 153], 10.00th=[ 153], 20.00th=[ 153], | 30.00th=[ 163], 40.00th=[ 163], 50.00th=[ 199], 60.00th=[ 199], | 70.00th=[ 215], 80.00th=[ 215], 90.00th=[ 334], 95.00th=[ 334], | 99.00th=[ 334], 99.50th=[ 334], 99.90th=[ 334], 99.95th=[ 334], | 99.99th=[ 334] bw ( KiB/s): min= 3676, max= 3886, per=44.18%, avg=3781.00, stdev=148.49, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 lat (usec) : 500=16.67% lat (msec) : 250=75.00%, 500=8.33% cpu : usr=0.00%, sys=61.23%, ctx=788, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=193502: Wed Jul 15 23:21:59 2026 read: IOPS=0, BW=611KiB/s (626kB/s)(2048KiB/3350msec) clat (usec): min=498, max=564600, avg=282549.96, stdev=398880.36 lat (usec): min=499, max=564602, avg=282551.02, stdev=398880.56 clat percentiles (usec): | 1.00th=[ 498], 5.00th=[ 498], 10.00th=[ 498], 20.00th=[ 498], | 30.00th=[ 498], 40.00th=[ 498], 50.00th=[ 498], 60.00th=[566232], | 70.00th=[566232], 80.00th=[566232], 90.00th=[566232], 95.00th=[566232], | 99.00th=[566232], 99.50th=[566232], 99.90th=[566232], 99.95th=[566232], | 99.99th=[566232] bw ( KiB/s): min= 1899, max= 1943, per=31.42%, avg=1921.00, stdev=31.11, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=3057KiB/s (3130kB/s)(10.0MiB/3350msec); 0 zone resets clat (msec): min=157, max=628, avg=274.34, stdev=174.11 lat (msec): min=157, max=628, avg=274.39, stdev=174.11 clat percentiles (msec): | 1.00th=[ 159], 5.00th=[ 159], 10.00th=[ 159], 20.00th=[ 161], | 30.00th=[ 167], 40.00th=[ 167], 50.00th=[ 184], 60.00th=[ 215], | 70.00th=[ 222], 80.00th=[ 284], 90.00th=[ 558], 95.00th=[ 625], | 99.00th=[ 625], 99.50th=[ 625], 99.90th=[ 625], 99.95th=[ 625], | 99.99th=[ 625] bw ( KiB/s): min= 1838, max= 5699, per=40.84%, avg=3495.20, stdev=1618.86, samples=5 iops : min= 1, max= 5, avg= 2.80, stdev= 1.79, samples=5 lat (usec) : 500=8.33% lat (msec) : 250=58.33%, 500=8.33%, 750=25.00% cpu : usr=0.00%, sys=44.10%, ctx=386, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=193503: Wed Jul 15 23:21:59 2026 read: IOPS=2, BW=2474KiB/s (2534kB/s)(6144KiB/2483msec) clat (usec): min=413, max=256185, avg=127993.99, stdev=105859.07 lat (usec): min=413, max=256186, avg=127994.79, stdev=105859.23 clat percentiles (usec): | 1.00th=[ 412], 5.00th=[ 412], 10.00th=[ 412], 20.00th=[ 562], | 30.00th=[ 562], 40.00th=[145753], 50.00th=[145753], 60.00th=[162530], | 70.00th=[202376], 80.00th=[202376], 90.00th=[256902], 95.00th=[256902], | 99.00th=[256902], 99.50th=[256902], 99.90th=[256902], 99.95th=[256902], | 99.99th=[256902] bw ( KiB/s): min= 3886, max= 5873, per=79.82%, avg=4879.50, stdev=1405.02, samples=2 iops : min= 3, max= 5, avg= 4.00, stdev= 1.41, samples=2 write: IOPS=2, BW=2474KiB/s (2534kB/s)(6144KiB/2483msec); 0 zone resets clat (msec): min=184, max=473, avg=280.06, stdev=103.37 lat (msec): min=184, max=473, avg=280.11, stdev=103.37 clat percentiles (msec): | 1.00th=[ 184], 5.00th=[ 184], 10.00th=[ 184], 20.00th=[ 203], | 30.00th=[ 203], 40.00th=[ 253], 50.00th=[ 253], 60.00th=[ 279], | 70.00th=[ 292], 80.00th=[ 292], 90.00th=[ 472], 95.00th=[ 472], | 99.00th=[ 472], 99.50th=[ 472], 99.90th=[ 472], 99.95th=[ 472], | 99.99th=[ 472] bw ( KiB/s): min= 1838, max= 3453, per=26.85%, avg=2297.75, stdev=772.00, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (usec) : 500=8.33%, 750=8.33% lat (msec) : 250=41.67%, 500=41.67% cpu : usr=0.00%, sys=49.80%, ctx=332, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=193504: Wed Jul 15 23:21:59 2026 read: IOPS=1, BW=1809KiB/s (1853kB/s)(5120KiB/2830msec) clat (usec): min=540, max=181486, avg=130265.67, stdev=73754.70 lat (usec): min=541, max=181487, avg=130266.62, stdev=73754.96 clat percentiles (usec): | 1.00th=[ 545], 5.00th=[ 545], 10.00th=[ 545], 20.00th=[ 545], | 30.00th=[145753], 40.00th=[145753], 50.00th=[154141], 60.00th=[154141], | 70.00th=[168821], 80.00th=[168821], 90.00th=[181404], 95.00th=[181404], | 99.00th=[181404], 99.50th=[181404], 99.90th=[181404], 99.95th=[181404], | 99.99th=[181404] bw ( KiB/s): min= 1838, max= 5873, per=63.07%, avg=3855.50, stdev=2853.18, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 write: IOPS=2, BW=2533KiB/s (2594kB/s)(7168KiB/2830msec); 0 zone resets clat (msec): min=137, max=453, avg=309.90, stdev=141.16 lat (msec): min=137, max=453, avg=309.96, stdev=141.16 clat percentiles (msec): | 1.00th=[ 138], 5.00th=[ 138], 10.00th=[ 138], 20.00th=[ 169], | 30.00th=[ 178], 40.00th=[ 178], 50.00th=[ 388], 60.00th=[ 401], | 70.00th=[ 401], 80.00th=[ 443], 90.00th=[ 456], 95.00th=[ 456], | 99.00th=[ 456], 99.50th=[ 456], 99.90th=[ 456], 99.95th=[ 456], | 99.99th=[ 456] bw ( KiB/s): min= 1838, max= 3799, per=32.31%, avg=2765.50, stdev=1019.52, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 1.15, samples=4 lat (usec) : 750=8.33% lat (msec) : 250=58.33%, 500=33.33% cpu : usr=0.00%, sys=48.21%, ctx=550, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=6113KiB/s (6260kB/s), 611KiB/s-3885KiB/s (626kB/s-3978kB/s), io=20.0MiB (20.0MB), run=1845-3350msec WRITE: bw=8559KiB/s (8764kB/s), 2474KiB/s-3057KiB/s (2534kB/s-3130kB/s), io=28.0MiB (29.4MB), run=1845-3350msec rand-rw: (groupid=0, jobs=1): err= 0: pid=193506: Wed Jul 15 23:21:59 2026 read: IOPS=2, BW=2656KiB/s (2720kB/s)(7168KiB/2699msec) clat (msec): min=34, max=510, avg=160.80, stdev=164.18 lat (msec): min=34, max=510, avg=160.80, stdev=164.18 clat percentiles (msec): | 1.00th=[ 35], 5.00th=[ 35], 10.00th=[ 35], 20.00th=[ 63], | 30.00th=[ 85], 40.00th=[ 85], 50.00th=[ 107], 60.00th=[ 113], | 70.00th=[ 113], 80.00th=[ 215], 90.00th=[ 510], 95.00th=[ 510], | 99.00th=[ 510], 99.50th=[ 510], 99.90th=[ 510], 99.95th=[ 510], | 99.99th=[ 510] bw ( KiB/s): min= 2000, max= 4096, per=41.46%, avg=2721.25, stdev=977.04, samples=4 iops : min= 1, max= 4, avg= 2.25, stdev= 1.26, samples=4 write: IOPS=1, BW=1897KiB/s (1943kB/s)(5120KiB/2699msec); 0 zone resets clat (msec): min=101, max=473, avg=294.78, stdev=166.15 lat (msec): min=101, max=473, avg=294.83, stdev=166.15 clat percentiles (msec): | 1.00th=[ 103], 5.00th=[ 103], 10.00th=[ 103], 20.00th=[ 103], | 30.00th=[ 150], 40.00th=[ 150], 50.00th=[ 309], 60.00th=[ 309], | 70.00th=[ 439], 80.00th=[ 439], 90.00th=[ 472], 95.00th=[ 472], | 99.00th=[ 472], 99.50th=[ 472], 99.90th=[ 472], 99.95th=[ 472], | 99.99th=[ 472] bw ( KiB/s): min= 2048, max= 6000, per=43.79%, avg=4024.00, stdev=2794.49, samples=2 iops : min= 2, max= 5, avg= 3.50, stdev= 2.12, samples=2 lat (msec) : 50=8.33%, 100=16.67%, 250=41.67%, 500=25.00%, 750=8.33% cpu : usr=0.00%, sys=20.42%, ctx=312, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=193507: Wed Jul 15 23:21:59 2026 read: IOPS=0, BW=656KiB/s (672kB/s)(2048KiB/3120msec) clat (msec): min=78, max=282, avg=180.34, stdev=144.29 lat (msec): min=78, max=282, avg=180.34, stdev=144.29 clat percentiles (msec): | 1.00th=[ 79], 5.00th=[ 79], 10.00th=[ 79], 20.00th=[ 79], | 30.00th=[ 79], 40.00th=[ 79], 50.00th=[ 79], 60.00th=[ 284], | 70.00th=[ 284], 80.00th=[ 284], 90.00th=[ 284], 95.00th=[ 284], | 99.00th=[ 284], 99.50th=[ 284], 99.90th=[ 284], 99.95th=[ 284], | 99.99th=[ 284] bw ( KiB/s): min= 1420, max= 2048, per=26.42%, avg=1734.00, stdev=444.06, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 write: IOPS=3, BW=3282KiB/s (3361kB/s)(10.0MiB/3120msec); 0 zone resets clat (msec): min=54, max=633, avg=269.29, stdev=190.59 lat (msec): min=54, max=633, avg=269.35, stdev=190.60 clat percentiles (msec): | 1.00th=[ 55], 5.00th=[ 55], 10.00th=[ 55], 20.00th=[ 61], | 30.00th=[ 92], 40.00th=[ 148], 50.00th=[ 234], 60.00th=[ 253], | 70.00th=[ 393], 80.00th=[ 393], 90.00th=[ 430], 95.00th=[ 634], | 99.00th=[ 634], 99.50th=[ 634], 99.90th=[ 634], 99.95th=[ 634], | 99.99th=[ 634] bw ( KiB/s): min= 2000, max= 6144, per=38.87%, avg=3572.00, stdev=1973.45, samples=4 iops : min= 1, max= 6, avg= 3.25, stdev= 2.22, samples=4 lat (msec) : 100=33.33%, 250=16.67%, 500=41.67%, 750=8.33% cpu : usr=0.00%, sys=22.06%, ctx=363, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=193508: Wed Jul 15 23:21:59 2026 read: IOPS=1, BW=2016KiB/s (2065kB/s)(6144KiB/3047msec) clat (msec): min=49, max=514, avg=268.40, stdev=204.38 lat (msec): min=49, max=514, avg=268.40, stdev=204.38 clat percentiles (msec): | 1.00th=[ 51], 5.00th=[ 51], 10.00th=[ 51], 20.00th=[ 61], | 30.00th=[ 61], 40.00th=[ 155], 50.00th=[ 155], 60.00th=[ 405], | 70.00th=[ 430], 80.00th=[ 430], 90.00th=[ 514], 95.00th=[ 514], | 99.00th=[ 514], 99.50th=[ 514], 99.90th=[ 514], 99.95th=[ 514], | 99.99th=[ 514] bw ( KiB/s): min= 2000, max= 2048, per=31.02%, avg=2036.00, stdev=24.00, samples=4 iops : min= 1, max= 2, avg= 1.75, stdev= 0.50, samples=4 write: IOPS=1, BW=2016KiB/s (2065kB/s)(6144KiB/3047msec); 0 zone resets clat (msec): min=41, max=590, avg=236.63, stdev=209.26 lat (msec): min=41, max=590, avg=236.69, stdev=209.27 clat percentiles (msec): | 1.00th=[ 42], 5.00th=[ 42], 10.00th=[ 42], 20.00th=[ 82], | 30.00th=[ 82], 40.00th=[ 108], 50.00th=[ 108], 60.00th=[ 241], | 70.00th=[ 359], 80.00th=[ 359], 90.00th=[ 592], 95.00th=[ 592], | 99.00th=[ 592], 99.50th=[ 592], 99.90th=[ 592], 99.95th=[ 592], | 99.99th=[ 592] bw ( KiB/s): min= 2000, max= 3103, per=25.94%, avg=2383.67, stdev=623.42, samples=3 iops : min= 1, max= 3, avg= 2.00, stdev= 1.00, samples=3 lat (msec) : 50=16.67%, 100=16.67%, 250=25.00%, 500=25.00%, 750=16.67% cpu : usr=0.00%, sys=14.84%, ctx=102, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=193509: Wed Jul 15 23:21:59 2026 read: IOPS=1, BW=1753KiB/s (1795kB/s)(5120KiB/2921msec) clat (msec): min=62, max=290, avg=150.64, stdev=114.95 lat (msec): min=62, max=290, avg=150.64, stdev=114.95 clat percentiles (msec): | 1.00th=[ 63], 5.00th=[ 63], 10.00th=[ 63], 20.00th=[ 63], | 30.00th=[ 69], 40.00th=[ 69], 50.00th=[ 70], 60.00th=[ 70], | 70.00th=[ 262], 80.00th=[ 262], 90.00th=[ 292], 95.00th=[ 292], | 99.00th=[ 292], 99.50th=[ 292], 99.90th=[ 292], 99.95th=[ 292], | 99.99th=[ 292] bw ( KiB/s): min= 4000, max= 4096, per=61.67%, avg=4048.00, stdev=67.88, samples=2 iops : min= 3, max= 4, avg= 3.50, stdev= 0.71, samples=2 write: IOPS=2, BW=2454KiB/s (2513kB/s)(7168KiB/2921msec); 0 zone resets clat (msec): min=45, max=820, avg=296.81, stdev=284.68 lat (msec): min=45, max=820, avg=296.88, stdev=284.68 clat percentiles (msec): | 1.00th=[ 46], 5.00th=[ 46], 10.00th=[ 46], 20.00th=[ 95], | 30.00th=[ 171], 40.00th=[ 171], 50.00th=[ 188], 60.00th=[ 197], | 70.00th=[ 197], 80.00th=[ 558], 90.00th=[ 818], 95.00th=[ 818], | 99.00th=[ 818], 99.50th=[ 818], 99.90th=[ 818], 99.95th=[ 818], | 99.99th=[ 818] bw ( KiB/s): min= 1374, max= 2048, per=20.72%, avg=1903.60, stdev=296.78, samples=5 iops : min= 1, max= 2, avg= 1.60, stdev= 0.55, samples=5 lat (msec) : 50=8.33%, 100=33.33%, 250=25.00%, 500=16.67%, 750=8.33% lat (msec) : 1000=8.33% cpu : usr=0.00%, sys=16.92%, ctx=96, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=6564KiB/s (6722kB/s), 656KiB/s-2656KiB/s (672kB/s-2720kB/s), io=20.0MiB (20.0MB), run=2699-3120msec WRITE: bw=9190KiB/s (9410kB/s), 1897KiB/s-3282KiB/s (1943kB/s-3361kB/s), io=28.0MiB (29.4MB), run=2699-3120msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=193516: Wed Jul 15 23:22:07 2026 read: IOPS=2, BW=9102KiB/s (9321kB/s)(12.0MiB/1350msec) clat (msec): min=379, max=552, avg=445.73, stdev=93.26 lat (msec): min=379, max=552, avg=445.73, stdev=93.26 clat percentiles (msec): | 1.00th=[ 380], 5.00th=[ 380], 10.00th=[ 380], 20.00th=[ 380], | 30.00th=[ 380], 40.00th=[ 405], 50.00th=[ 405], 60.00th=[ 405], | 70.00th=[ 550], 80.00th=[ 550], 90.00th=[ 550], 95.00th=[ 550], | 99.00th=[ 550], 99.50th=[ 550], 99.90th=[ 550], 99.95th=[ 550], | 99.99th=[ 550] bw ( KiB/s): min= 5626, max= 8192, per=62.75%, avg=6909.00, stdev=1814.44, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 500=66.67%, 750=33.33% cpu : usr=0.00%, sys=54.48%, ctx=2485, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=193517: Wed Jul 15 23:22:07 2026 read: IOPS=0, BW=2753KiB/s (2819kB/s)(4096KiB/1488msec) clat (nsec): min=387600k, max=387600k, avg=387599653.00, stdev= 0.00 lat (nsec): min=387602k, max=387602k, avg=387601780.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 388], 5.00th=[ 388], 10.00th=[ 388], 20.00th=[ 388], | 30.00th=[ 388], 40.00th=[ 388], 50.00th=[ 388], 60.00th=[ 388], | 70.00th=[ 388], 80.00th=[ 388], 90.00th=[ 388], 95.00th=[ 388], | 99.00th=[ 388], 99.50th=[ 388], 99.90th=[ 388], 99.95th=[ 388], | 99.99th=[ 388] bw ( KiB/s): min= 8143, max= 8143, per=73.96%, avg=8143.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=1, BW=5505KiB/s (5638kB/s)(8192KiB/1488msec); 0 zone resets clat (msec): min=431, max=638, avg=534.98, stdev=146.48 lat (msec): min=431, max=638, avg=535.24, stdev=146.48 clat percentiles (msec): | 1.00th=[ 430], 5.00th=[ 430], 10.00th=[ 430], 20.00th=[ 430], | 30.00th=[ 430], 40.00th=[ 430], 50.00th=[ 430], 60.00th=[ 642], | 70.00th=[ 642], 80.00th=[ 642], 90.00th=[ 642], 95.00th=[ 642], | 99.00th=[ 642], 99.50th=[ 642], 99.90th=[ 642], 99.95th=[ 642], | 99.99th=[ 642] bw ( KiB/s): min= 8192, max= 8192, per=48.08%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 500=66.67%, 750=33.33% cpu : usr=0.07%, sys=20.98%, ctx=805, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=193518: Wed Jul 15 23:22:07 2026 write: IOPS=1, BW=6390KiB/s (6543kB/s)(12.0MiB/1923msec); 0 zone resets clat (msec): min=246, max=1179, avg=633.48, stdev=486.29 lat (msec): min=246, max=1179, avg=633.65, stdev=486.27 clat percentiles (msec): | 1.00th=[ 247], 5.00th=[ 247], 10.00th=[ 247], 20.00th=[ 247], | 30.00th=[ 247], 40.00th=[ 477], 50.00th=[ 477], 60.00th=[ 477], | 70.00th=[ 1183], 80.00th=[ 1183], 90.00th=[ 1183], 95.00th=[ 1183], | 99.00th=[ 1183], 99.50th=[ 1183], 99.90th=[ 1183], 99.95th=[ 1183], | 99.99th=[ 1183] bw ( KiB/s): min= 5497, max= 8192, per=40.17%, avg=6844.50, stdev=1905.65, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 250=33.33%, 500=33.33%, 2000=33.33% cpu : usr=0.00%, sys=24.71%, ctx=93, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=193519: Wed Jul 15 23:22:07 2026 write: IOPS=2, BW=8428KiB/s (8630kB/s)(12.0MiB/1458msec); 0 zone resets clat (msec): min=265, max=835, avg=483.18, stdev=307.69 lat (msec): min=265, max=835, avg=483.51, stdev=307.64 clat percentiles (msec): | 1.00th=[ 266], 5.00th=[ 266], 10.00th=[ 266], 20.00th=[ 266], | 30.00th=[ 266], 40.00th=[ 351], 50.00th=[ 351], 60.00th=[ 351], | 70.00th=[ 835], 80.00th=[ 835], 90.00th=[ 835], 95.00th=[ 835], | 99.00th=[ 835], 99.50th=[ 835], 99.90th=[ 835], 99.95th=[ 835], | 99.99th=[ 835] bw ( KiB/s): min=11441, max=11441, per=67.14%, avg=11441.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 500=66.67%, 1000=33.33% cpu : usr=0.14%, sys=20.04%, ctx=58, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=10.8MiB/s (11.3MB/s), 2753KiB/s-9102KiB/s (2819kB/s-9321kB/s), io=16.0MiB (16.8MB), run=1350-1488msec WRITE: bw=16.6MiB/s (17.4MB/s), 5505KiB/s-8428KiB/s (5638kB/s-8630kB/s), io=32.0MiB (33.6MB), run=1458-1923msec rand-rw: (groupid=0, jobs=1): err= 0: pid=193520: Wed Jul 15 23:22:07 2026 read: IOPS=1, BW=7046KiB/s (7215kB/s)(12.0MiB/1744msec) clat (msec): min=163, max=810, avg=567.18, stdev=351.91 lat (msec): min=163, max=810, avg=567.19, stdev=351.91 clat percentiles (msec): | 1.00th=[ 165], 5.00th=[ 165], 10.00th=[ 165], 20.00th=[ 165], | 30.00th=[ 165], 40.00th=[ 726], 50.00th=[ 726], 60.00th=[ 726], | 70.00th=[ 810], 80.00th=[ 810], 90.00th=[ 810], 95.00th=[ 810], | 99.00th=[ 810], 99.50th=[ 810], 99.90th=[ 810], 99.95th=[ 810], | 99.99th=[ 810] bw ( KiB/s): min= 8192, max= 8192, per=94.61%, avg=8192.00, stdev= 0.00, samples=2 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=2 lat (msec) : 250=33.33%, 750=33.33%, 1000=33.33% cpu : usr=0.00%, sys=14.52%, ctx=122, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=193521: Wed Jul 15 23:22:07 2026 read: IOPS=0, BW=2165KiB/s (2217kB/s)(4096KiB/1892msec) clat (nsec): min=623386k, max=623386k, avg=623386285.00, stdev= 0.00 lat (nsec): min=623389k, max=623389k, avg=623388595.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 625], 5.00th=[ 625], 10.00th=[ 625], 20.00th=[ 625], | 30.00th=[ 625], 40.00th=[ 625], 50.00th=[ 625], 60.00th=[ 625], | 70.00th=[ 625], 80.00th=[ 625], 90.00th=[ 625], 95.00th=[ 625], | 99.00th=[ 625], 99.50th=[ 625], 99.90th=[ 625], 99.95th=[ 625], | 99.99th=[ 625] bw ( KiB/s): min= 5572, max= 5572, per=64.35%, avg=5572.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=1, BW=4330KiB/s (4434kB/s)(8192KiB/1892msec); 0 zone resets clat (msec): min=551, max=667, avg=609.45, stdev=81.80 lat (msec): min=551, max=667, avg=609.76, stdev=81.84 clat percentiles (msec): | 1.00th=[ 550], 5.00th=[ 550], 10.00th=[ 550], 20.00th=[ 550], | 30.00th=[ 550], 40.00th=[ 550], 50.00th=[ 550], 60.00th=[ 667], | 70.00th=[ 667], 80.00th=[ 667], 90.00th=[ 667], 95.00th=[ 667], | 99.00th=[ 667], 99.50th=[ 667], 99.90th=[ 667], 99.95th=[ 667], | 99.99th=[ 667] bw ( KiB/s): min= 8192, max= 8192, per=48.60%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 750=100.00% cpu : usr=0.05%, sys=15.07%, ctx=95, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=193522: Wed Jul 15 23:22:07 2026 write: IOPS=1, BW=6321KiB/s (6473kB/s)(12.0MiB/1944msec); 0 zone resets clat (msec): min=193, max=1165, avg=633.97, stdev=492.20 lat (msec): min=193, max=1165, avg=634.29, stdev=492.15 clat percentiles (msec): | 1.00th=[ 194], 5.00th=[ 194], 10.00th=[ 194], 20.00th=[ 194], | 30.00th=[ 194], 40.00th=[ 542], 50.00th=[ 542], 60.00th=[ 542], | 70.00th=[ 1167], 80.00th=[ 1167], 90.00th=[ 1167], 95.00th=[ 1167], | 99.00th=[ 1167], 99.50th=[ 1167], 99.90th=[ 1167], 99.95th=[ 1167], | 99.99th=[ 1167] bw ( KiB/s): min= 8192, max= 8192, per=48.60%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.05%, sys=12.45%, ctx=63, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=193523: Wed Jul 15 23:22:07 2026 write: IOPS=1, BW=7618KiB/s (7801kB/s)(12.0MiB/1613msec); 0 zone resets clat (msec): min=302, max=675, avg=532.11, stdev=200.90 lat (msec): min=302, max=675, avg=532.36, stdev=200.83 clat percentiles (msec): | 1.00th=[ 305], 5.00th=[ 305], 10.00th=[ 305], 20.00th=[ 305], | 30.00th=[ 305], 40.00th=[ 617], 50.00th=[ 617], 60.00th=[ 617], | 70.00th=[ 676], 80.00th=[ 676], 90.00th=[ 676], 95.00th=[ 676], | 99.00th=[ 676], 99.50th=[ 676], 99.90th=[ 676], 99.95th=[ 676], | 99.99th=[ 676] bw ( KiB/s): min= 5512, max= 5512, per=32.70%, avg=5512.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 750=66.67% cpu : usr=0.06%, sys=16.25%, ctx=70, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=8660KiB/s (8867kB/s), 2165KiB/s-7046KiB/s (2217kB/s-7215kB/s), io=16.0MiB (16.8MB), run=1744-1892msec WRITE: bw=16.5MiB/s (17.3MB/s), 4330KiB/s-7618KiB/s (4434kB/s-7801kB/s), io=32.0MiB (33.6MB), run=1613-1944msec