== sanity test 398b: DIO and buffer IO race ============== 19:56:11 (1788911771) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 2.84851 s, 17.7 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=186413: Tue Sep 8 19:57:20 2026 read: IOPS=25, BW=101KiB/s (103kB/s)(5992KiB/59444msec) clat (usec): min=43, max=550638, avg=21185.90, stdev=17270.46 lat (usec): min=43, max=550640, avg=21186.58, stdev=17270.53 clat percentiles (usec): | 1.00th=[ 157], 5.00th=[ 7898], 10.00th=[ 9896], 20.00th=[ 12518], | 30.00th=[ 14353], 40.00th=[ 16581], 50.00th=[ 18744], 60.00th=[ 21627], | 70.00th=[ 25035], 80.00th=[ 28967], 90.00th=[ 34341], 95.00th=[ 38536], | 99.00th=[ 54789], 99.50th=[ 64750], 99.90th=[ 82314], 99.95th=[549454], | 99.99th=[549454] bw ( KiB/s): min= 39, max= 191, per=25.59%, avg=101.34, stdev=26.34, samples=117 iops : min= 9, max= 47, avg=24.91, stdev= 6.63, samples=117 write: IOPS=26, BW=106KiB/s (108kB/s)(6296KiB/59444msec); 0 zone resets clat (usec): min=690, max=91253, avg=17559.33, stdev=12736.73 lat (usec): min=691, max=91254, avg=17560.78, stdev=12737.13 clat percentiles (usec): | 1.00th=[ 1303], 5.00th=[ 3032], 10.00th=[ 4047], 20.00th=[ 5669], | 30.00th=[ 8848], 40.00th=[12256], 50.00th=[15008], 60.00th=[17957], | 70.00th=[21890], 80.00th=[27657], 90.00th=[36439], 95.00th=[42206], | 99.00th=[55313], 99.50th=[59507], 99.90th=[82314], 99.95th=[91751], | 99.99th=[91751] bw ( KiB/s): min= 39, max= 168, per=25.66%, avg=106.47, stdev=28.36, samples=117 iops : min= 9, max= 42, avg=26.20, stdev= 7.17, samples=117 lat (usec) : 50=0.03%, 100=0.07%, 250=0.85%, 500=0.16%, 750=0.07% lat (usec) : 1000=0.23% lat (msec) : 2=0.65%, 4=4.07%, 10=16.18%, 20=37.53%, 50=38.35% lat (msec) : 100=1.79%, 750=0.03% cpu : usr=0.09%, sys=26.48%, ctx=9525, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=186414: Tue Sep 8 19:57:20 2026 read: IOPS=24, BW=98.1KiB/s (100kB/s)(5940KiB/60568msec) clat (usec): min=31, max=571218, avg=21448.01, stdev=17969.24 lat (usec): min=31, max=571218, avg=21448.62, stdev=17969.26 clat percentiles (usec): | 1.00th=[ 163], 5.00th=[ 7635], 10.00th=[ 9896], 20.00th=[ 12518], | 30.00th=[ 14877], 40.00th=[ 16909], 50.00th=[ 19006], 60.00th=[ 22152], | 70.00th=[ 25297], 80.00th=[ 28967], 90.00th=[ 33817], 95.00th=[ 40109], | 99.00th=[ 57934], 99.50th=[ 64226], 99.90th=[111674], 99.95th=[574620], | 99.99th=[574620] bw ( KiB/s): min= 55, max= 167, per=24.74%, avg=97.97, stdev=25.88, samples=119 iops : min= 13, max= 41, avg=24.07, stdev= 6.52, samples=119 write: IOPS=26, BW=105KiB/s (107kB/s)(6348KiB/60568msec); 0 zone resets clat (usec): min=612, max=84463, avg=18047.88, stdev=12928.21 lat (usec): min=613, max=84464, avg=18049.05, stdev=12928.03 clat percentiles (usec): | 1.00th=[ 898], 5.00th=[ 2737], 10.00th=[ 3818], 20.00th=[ 5800], | 30.00th=[ 9372], 40.00th=[13042], 50.00th=[15795], 60.00th=[18482], | 70.00th=[22676], 80.00th=[27657], 90.00th=[36439], 95.00th=[43254], | 99.00th=[54789], 99.50th=[61080], 99.90th=[76022], 99.95th=[84411], | 99.99th=[84411] bw ( KiB/s): min= 39, max= 248, per=25.12%, avg=104.25, stdev=32.96, samples=119 iops : min= 9, max= 62, avg=25.65, stdev= 8.29, samples=119 lat (usec) : 50=0.07%, 100=0.03%, 250=0.85%, 500=0.03%, 750=0.29% lat (usec) : 1000=0.36% lat (msec) : 2=0.75%, 4=4.26%, 10=15.04%, 20=37.04%, 50=39.13% lat (msec) : 100=2.08%, 250=0.03%, 750=0.03% cpu : usr=0.09%, sys=26.00%, ctx=9624, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=186415: Tue Sep 8 19:57:20 2026 read: IOPS=25, BW=102KiB/s (104kB/s)(6028KiB/59179msec) clat (usec): min=66, max=69753, avg=20939.98, stdev=10461.46 lat (usec): min=67, max=69754, avg=20940.70, stdev=10461.53 clat percentiles (usec): | 1.00th=[ 151], 5.00th=[ 8225], 10.00th=[10290], 20.00th=[12780], | 30.00th=[14746], 40.00th=[16712], 50.00th=[19006], 60.00th=[21627], | 70.00th=[24511], 80.00th=[28181], 90.00th=[34341], 95.00th=[39584], | 99.00th=[55837], 99.50th=[60031], 99.90th=[65799], 99.95th=[69731], | 99.99th=[69731] bw ( KiB/s): min= 16, max= 191, per=25.86%, avg=102.41, stdev=26.13, samples=116 iops : min= 4, max= 47, avg=25.18, stdev= 6.59, samples=116 write: IOPS=26, BW=106KiB/s (108kB/s)(6260KiB/59179msec); 0 zone resets clat (usec): min=679, max=584640, avg=17616.50, stdev=19040.72 lat (usec): min=679, max=584640, avg=17618.25, stdev=19040.75 clat percentiles (usec): | 1.00th=[ 1237], 5.00th=[ 3163], 10.00th=[ 3982], 20.00th=[ 5538], | 30.00th=[ 8586], 40.00th=[ 11863], 50.00th=[ 14615], 60.00th=[ 17433], | 70.00th=[ 21890], 80.00th=[ 26346], 90.00th=[ 34866], 95.00th=[ 42206], | 99.00th=[ 55837], 99.50th=[ 62129], 99.90th=[ 80217], 99.95th=[583009], | 99.99th=[583009] bw ( KiB/s): min= 48, max= 183, per=25.61%, avg=106.27, stdev=30.55, samples=116 iops : min= 12, max= 45, avg=26.15, stdev= 7.66, samples=116 lat (usec) : 100=0.23%, 250=0.88%, 500=0.07%, 750=0.07%, 1000=0.26% lat (msec) : 2=0.85%, 4=4.13%, 10=15.36%, 20=38.31%, 50=37.79% lat (msec) : 100=2.02%, 750=0.03% cpu : usr=0.08%, sys=26.66%, ctx=9629, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=186416: Tue Sep 8 19:57:20 2026 read: IOPS=25, BW=101KiB/s (103kB/s)(6052KiB/60198msec) clat (usec): min=47, max=86197, avg=21381.94, stdev=11301.25 lat (usec): min=48, max=86198, avg=21382.64, stdev=11301.28 clat percentiles (usec): | 1.00th=[ 153], 5.00th=[ 8029], 10.00th=[10028], 20.00th=[12518], | 30.00th=[14746], 40.00th=[16909], 50.00th=[19268], 60.00th=[21890], | 70.00th=[25035], 80.00th=[28967], 90.00th=[34866], 95.00th=[42206], | 99.00th=[58983], 99.50th=[66847], 99.90th=[85459], 99.95th=[86508], | 99.99th=[86508] bw ( KiB/s): min= 48, max= 216, per=25.42%, avg=100.68, stdev=26.47, samples=118 iops : min= 12, max= 54, avg=24.75, stdev= 6.71, samples=118 write: IOPS=25, BW=104KiB/s (106kB/s)(6236KiB/60198msec); 0 zone resets clat (usec): min=592, max=584344, avg=17832.52, stdev=19046.12 lat (usec): min=593, max=584345, avg=17833.39, stdev=19046.14 clat percentiles (usec): | 1.00th=[ 1012], 5.00th=[ 2900], 10.00th=[ 4047], 20.00th=[ 5407], | 30.00th=[ 8586], 40.00th=[ 12256], 50.00th=[ 15270], 60.00th=[ 18482], | 70.00th=[ 22414], 80.00th=[ 27395], 90.00th=[ 34866], 95.00th=[ 42206], | 99.00th=[ 56361], 99.50th=[ 61604], 99.90th=[ 72877], 99.95th=[583009], | 99.99th=[583009] bw ( KiB/s): min= 40, max= 191, per=25.06%, avg=104.00, stdev=30.44, samples=118 iops : min= 10, max= 47, avg=25.58, stdev= 7.60, samples=118 lat (usec) : 50=0.03%, 100=0.26%, 250=0.72%, 500=0.03%, 750=0.23% lat (usec) : 1000=0.26% lat (msec) : 2=1.01%, 4=3.45%, 10=16.24%, 20=36.30%, 50=39.03% lat (msec) : 100=2.41%, 750=0.03% cpu : usr=0.08%, sys=26.39%, ctx=9528, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=396KiB/s (406kB/s), 98.1KiB/s-102KiB/s (100kB/s-104kB/s), io=23.4MiB (24.6MB), run=59179-60568msec WRITE: bw=415KiB/s (425kB/s), 104KiB/s-106KiB/s (106kB/s-108kB/s), io=24.6MiB (25.7MB), run=59179-60568msec rand-rw: (groupid=0, jobs=1): err= 0: pid=186408: Tue Sep 8 19:57:26 2026 read: IOPS=22, BW=90.6KiB/s (92.8kB/s)(5992KiB/66116msec) clat (msec): min=2, max=605, avg=19.41, stdev=21.08 lat (msec): min=2, max=605, avg=19.41, stdev=21.08 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 4], 10.00th=[ 5], 20.00th=[ 7], | 30.00th=[ 10], 40.00th=[ 13], 50.00th=[ 15], 60.00th=[ 18], | 70.00th=[ 23], 80.00th=[ 30], 90.00th=[ 41], 95.00th=[ 50], | 99.00th=[ 68], 99.50th=[ 75], 99.90th=[ 102], 99.95th=[ 609], | 99.99th=[ 609] bw ( KiB/s): min= 23, max= 368, per=25.02%, avg=90.58, stdev=64.67, samples=130 iops : min= 5, max= 92, avg=22.24, stdev=16.28, samples=130 write: IOPS=23, BW=95.2KiB/s (97.5kB/s)(6296KiB/66116msec); 0 zone resets clat (msec): min=3, max=113, avg=23.42, stdev=16.62 lat (msec): min=3, max=113, avg=23.42, stdev=16.62 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 6], 10.00th=[ 7], 20.00th=[ 9], | 30.00th=[ 12], 40.00th=[ 16], 50.00th=[ 20], 60.00th=[ 24], | 70.00th=[ 30], 80.00th=[ 37], 90.00th=[ 46], 95.00th=[ 54], | 99.00th=[ 79], 99.50th=[ 90], 99.90th=[ 112], 99.95th=[ 114], | 99.99th=[ 114] bw ( KiB/s): min= 23, max= 400, per=25.02%, avg=94.83, stdev=67.83, samples=130 iops : min= 5, max= 100, avg=23.30, stdev=17.08, samples=130 lat (msec) : 4=2.51%, 10=25.26%, 20=30.92%, 50=35.35%, 100=5.76% lat (msec) : 250=0.16%, 750=0.03% cpu : usr=0.09%, sys=12.73%, ctx=5747, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=186409: Tue Sep 8 19:57:26 2026 read: IOPS=22, BW=89.0KiB/s (92.1kB/s)(5940KiB/66018msec) clat (msec): min=2, max=630, avg=19.24, stdev=21.54 lat (msec): min=2, max=630, avg=19.24, stdev=21.54 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 5], 10.00th=[ 5], 20.00th=[ 7], | 30.00th=[ 10], 40.00th=[ 13], 50.00th=[ 15], 60.00th=[ 18], | 70.00th=[ 23], 80.00th=[ 30], 90.00th=[ 41], 95.00th=[ 50], | 99.00th=[ 68], 99.50th=[ 77], 99.90th=[ 94], 99.95th=[ 634], | 99.99th=[ 634] bw ( KiB/s): min= 7, max= 408, per=24.92%, avg=90.21, stdev=69.01, samples=130 iops : min= 1, max= 102, avg=22.15, stdev=17.35, samples=130 write: IOPS=24, BW=96.2KiB/s (98.5kB/s)(6348KiB/66018msec); 0 zone resets clat (msec): min=4, max=114, avg=23.48, stdev=15.96 lat (msec): min=4, max=114, avg=23.49, stdev=15.96 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 6], 10.00th=[ 7], 20.00th=[ 9], | 30.00th=[ 13], 40.00th=[ 16], 50.00th=[ 20], 60.00th=[ 25], | 70.00th=[ 31], 80.00th=[ 37], 90.00th=[ 45], 95.00th=[ 53], | 99.00th=[ 74], 99.50th=[ 87], 99.90th=[ 113], 99.95th=[ 115], | 99.99th=[ 115] bw ( KiB/s): min= 32, max= 400, per=25.39%, avg=96.25, stdev=65.66, samples=130 iops : min= 8, max= 100, avg=23.65, stdev=16.54, samples=130 lat (msec) : 4=2.08%, 10=24.84%, 20=31.12%, 50=36.75%, 100=5.05% lat (msec) : 250=0.13%, 750=0.03% cpu : usr=0.09%, sys=12.67%, ctx=5935, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=186410: Tue Sep 8 19:57:26 2026 read: IOPS=22, BW=90.0KiB/s (93.1kB/s)(6028KiB/66272msec) clat (usec): min=2084, max=95843, avg=19453.39, stdev=15586.93 lat (usec): min=2085, max=95844, avg=19454.19, stdev=15587.01 clat percentiles (usec): | 1.00th=[ 2671], 5.00th=[ 3949], 10.00th=[ 4555], 20.00th=[ 6194], | 30.00th=[ 9372], 40.00th=[12518], 50.00th=[14877], 60.00th=[17695], | 70.00th=[22414], 80.00th=[30540], 90.00th=[43779], 95.00th=[50594], | 99.00th=[70779], 99.50th=[79168], 99.90th=[87557], 99.95th=[95945], | 99.99th=[95945] bw ( KiB/s): min= 24, max= 368, per=24.82%, avg=89.85, stdev=69.69, samples=130 iops : min= 6, max= 92, avg=22.05, stdev=17.55, samples=130 write: IOPS=23, BW=94.5KiB/s (96.7kB/s)(6260KiB/66272msec); 0 zone resets clat (msec): min=3, max=637, avg=23.50, stdev=22.23 lat (msec): min=3, max=637, avg=23.50, stdev=22.23 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 6], 10.00th=[ 7], 20.00th=[ 8], | 30.00th=[ 12], 40.00th=[ 16], 50.00th=[ 20], 60.00th=[ 24], | 70.00th=[ 30], 80.00th=[ 36], 90.00th=[ 46], 95.00th=[ 54], | 99.00th=[ 73], 99.50th=[ 82], 99.90th=[ 111], 99.95th=[ 642], | 99.99th=[ 642] bw ( KiB/s): min= 32, max= 392, per=24.57%, avg=93.11, stdev=65.23, samples=130 iops : min= 8, max= 98, avg=22.87, stdev=16.43, samples=130 lat (msec) : 4=2.70%, 10=25.78%, 20=30.31%, 50=35.29%, 100=5.86% lat (msec) : 250=0.03%, 750=0.03% cpu : usr=0.10%, sys=12.54%, ctx=5809, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=186411: Tue Sep 8 19:57:26 2026 read: IOPS=22, BW=91.7KiB/s (93.9kB/s)(6052KiB/66009msec) clat (usec): min=2547, max=95353, avg=18860.56, stdev=14286.37 lat (usec): min=2548, max=95353, avg=18861.39, stdev=14286.41 clat percentiles (usec): | 1.00th=[ 3294], 5.00th=[ 4047], 10.00th=[ 4883], 20.00th=[ 6783], | 30.00th=[ 9896], 40.00th=[12256], 50.00th=[14484], 60.00th=[17433], | 70.00th=[21890], 80.00th=[28967], 90.00th=[40109], 95.00th=[49021], | 99.00th=[63701], 99.50th=[69731], 99.90th=[87557], 99.95th=[94897], | 99.99th=[94897] bw ( KiB/s): min= 15, max= 424, per=25.36%, avg=91.82, stdev=64.39, samples=130 iops : min= 3, max= 106, avg=22.55, stdev=16.22, samples=130 write: IOPS=23, BW=94.5KiB/s (96.7kB/s)(6236KiB/66009msec); 0 zone resets clat (msec): min=4, max=635, avg=23.93, stdev=22.52 lat (msec): min=4, max=635, avg=23.93, stdev=22.52 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 6], 10.00th=[ 7], 20.00th=[ 9], | 30.00th=[ 13], 40.00th=[ 16], 50.00th=[ 20], 60.00th=[ 24], | 70.00th=[ 30], 80.00th=[ 37], 90.00th=[ 48], 95.00th=[ 55], | 99.00th=[ 75], 99.50th=[ 88], 99.90th=[ 109], 99.95th=[ 634], | 99.99th=[ 634] bw ( KiB/s): min= 39, max= 400, per=24.97%, avg=94.65, stdev=67.71, samples=130 iops : min= 9, max= 100, avg=23.25, stdev=17.03, samples=130 lat (msec) : 4=2.34%, 10=24.90%, 20=31.71%, 50=34.60%, 100=6.35% lat (msec) : 250=0.07%, 750=0.03% cpu : usr=0.07%, sys=12.78%, ctx=5859, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=362KiB/s (371kB/s), 89.0KiB/s-91.7KiB/s (92.1kB/s-93.9kB/s), io=23.4MiB (24.6MB), run=66009-66272msec WRITE: bw=379KiB/s (388kB/s), 94.5KiB/s-96.2KiB/s (96.7kB/s-98.5kB/s), io=24.6MiB (25.7MB), run=66009-66272msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=186437: Tue Sep 8 19:57:46 2026 read: IOPS=27, BW=432KiB/s (443kB/s)(5920KiB/13697msec) clat (usec): min=62, max=71841, avg=18290.07, stdev=11276.14 lat (usec): min=62, max=71842, avg=18290.68, stdev=11276.17 clat percentiles (usec): | 1.00th=[ 89], 5.00th=[ 131], 10.00th=[ 7308], 20.00th=[10159], | 30.00th=[11994], 40.00th=[14484], 50.00th=[16581], 60.00th=[18744], | 70.00th=[21890], 80.00th=[26084], 90.00th=[33162], 95.00th=[39584], | 99.00th=[52167], 99.50th=[54789], 99.90th=[71828], 99.95th=[71828], | 99.99th=[71828] bw ( KiB/s): min= 159, max= 672, per=26.11%, avg=432.59, stdev=137.25, samples=27 iops : min= 9, max= 42, avg=26.56, stdev= 8.74, samples=27 write: IOPS=29, BW=465KiB/s (476kB/s)(6368KiB/13697msec); 0 zone resets clat (usec): min=1105, max=67743, avg=17244.48, stdev=12308.17 lat (usec): min=1106, max=67744, avg=17245.67, stdev=12308.22 clat percentiles (usec): | 1.00th=[ 1598], 5.00th=[ 3490], 10.00th=[ 4424], 20.00th=[ 6915], | 30.00th=[ 9110], 40.00th=[11600], 50.00th=[14615], 60.00th=[17433], | 70.00th=[20841], 80.00th=[25560], 90.00th=[34866], 95.00th=[41681], | 99.00th=[60031], 99.50th=[65799], 99.90th=[67634], 99.95th=[67634], | 99.99th=[67634] bw ( KiB/s): min= 223, max= 702, per=26.60%, avg=463.63, stdev=136.76, samples=27 iops : min= 13, max= 43, avg=28.52, stdev= 8.70, samples=27 lat (usec) : 100=1.30%, 250=2.86% lat (msec) : 2=0.78%, 4=2.86%, 10=18.88%, 20=39.06%, 50=31.90% lat (msec) : 100=2.34% cpu : usr=0.13%, sys=29.13%, ctx=2811, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=186438: Tue Sep 8 19:57:46 2026 read: IOPS=24, BW=397KiB/s (407kB/s)(5744KiB/14455msec) clat (usec): min=75, max=62140, avg=19788.28, stdev=10615.76 lat (usec): min=76, max=62140, avg=19788.85, stdev=10615.81 clat percentiles (usec): | 1.00th=[ 79], 5.00th=[ 212], 10.00th=[ 8979], 20.00th=[11338], | 30.00th=[13960], 40.00th=[15926], 50.00th=[18482], 60.00th=[21103], | 70.00th=[23987], 80.00th=[27132], 90.00th=[32637], 95.00th=[39584], | 99.00th=[53740], 99.50th=[60556], 99.90th=[62129], 99.95th=[62129], | 99.99th=[62129] bw ( KiB/s): min= 127, max= 608, per=23.70%, avg=392.71, stdev=131.65, samples=28 iops : min= 7, max= 38, avg=24.11, stdev= 8.45, samples=28 write: IOPS=28, BW=453KiB/s (464kB/s)(6544KiB/14455msec); 0 zone resets clat (usec): min=1531, max=82525, avg=17849.00, stdev=13250.25 lat (usec): min=1532, max=82526, avg=17852.73, stdev=13252.10 clat percentiles (usec): | 1.00th=[ 2966], 5.00th=[ 3851], 10.00th=[ 4359], 20.00th=[ 6194], | 30.00th=[ 8717], 40.00th=[11994], 50.00th=[15008], 60.00th=[17695], | 70.00th=[21103], 80.00th=[27395], 90.00th=[36439], 95.00th=[44827], | 99.00th=[58983], 99.50th=[69731], 99.90th=[82314], 99.95th=[82314], | 99.99th=[82314] bw ( KiB/s): min= 192, max= 704, per=25.23%, avg=439.79, stdev=136.86, samples=28 iops : min= 12, max= 44, avg=27.04, stdev= 8.66, samples=28 lat (usec) : 100=0.78%, 250=1.56%, 500=0.13% lat (msec) : 2=0.13%, 4=3.52%, 10=17.58%, 20=37.89%, 50=35.94% lat (msec) : 100=2.47% cpu : usr=0.12%, sys=28.81%, ctx=2820, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=186439: Tue Sep 8 19:57:46 2026 read: IOPS=27, BW=440KiB/s (450kB/s)(6256KiB/14232msec) clat (usec): min=67, max=81466, avg=19498.71, stdev=11277.25 lat (usec): min=68, max=81467, avg=19499.37, stdev=11277.30 clat percentiles (usec): | 1.00th=[ 81], 5.00th=[ 210], 10.00th=[ 8225], 20.00th=[10945], | 30.00th=[13042], 40.00th=[15270], 50.00th=[17433], 60.00th=[20579], | 70.00th=[23462], 80.00th=[27657], 90.00th=[34341], 95.00th=[40109], | 99.00th=[51119], 99.50th=[68682], 99.90th=[81265], 99.95th=[81265], | 99.99th=[81265] bw ( KiB/s): min= 190, max= 736, per=26.52%, avg=439.46, stdev=134.95, samples=28 iops : min= 11, max= 46, avg=27.04, stdev= 8.62, samples=28 write: IOPS=26, BW=424KiB/s (434kB/s)(6032KiB/14232msec); 0 zone resets clat (usec): min=2291, max=69904, avg=17467.44, stdev=11807.05 lat (usec): min=2292, max=69905, avg=17476.91, stdev=11815.58 clat percentiles (usec): | 1.00th=[ 3097], 5.00th=[ 3916], 10.00th=[ 4817], 20.00th=[ 7242], | 30.00th=[ 9503], 40.00th=[12387], 50.00th=[15533], 60.00th=[17695], | 70.00th=[21627], 80.00th=[25822], 90.00th=[33817], 95.00th=[41681], | 99.00th=[55313], 99.50th=[63701], 99.90th=[69731], 99.95th=[69731], | 99.99th=[69731] bw ( KiB/s): min= 191, max= 766, per=23.93%, avg=417.11, stdev=136.09, samples=28 iops : min= 11, max= 47, avg=25.61, stdev= 8.62, samples=28 lat (usec) : 100=1.04%, 250=1.69%, 500=0.13%, 750=0.13% lat (msec) : 4=2.73%, 10=18.49%, 20=37.50%, 50=36.59%, 100=1.69% cpu : usr=0.08%, sys=29.03%, ctx=2786, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=186440: Tue Sep 8 19:57:46 2026 read: IOPS=26, BW=431KiB/s (442kB/s)(6032KiB/13985msec) clat (usec): min=38, max=75259, avg=18846.35, stdev=11738.57 lat (usec): min=39, max=75260, avg=18847.25, stdev=11738.44 clat percentiles (usec): | 1.00th=[ 72], 5.00th=[ 116], 10.00th=[ 6259], 20.00th=[10552], | 30.00th=[12649], 40.00th=[14877], 50.00th=[17433], 60.00th=[20055], | 70.00th=[22414], 80.00th=[27132], 90.00th=[34341], 95.00th=[39584], | 99.00th=[59507], 99.50th=[69731], 99.90th=[74974], 99.95th=[74974], | 99.99th=[74974] bw ( KiB/s): min= 222, max= 672, per=25.95%, avg=429.93, stdev=128.89, samples=27 iops : min= 13, max= 42, avg=26.41, stdev= 8.27, samples=27 write: IOPS=27, BW=447KiB/s (458kB/s)(6256KiB/13985msec); 0 zone resets clat (usec): min=800, max=75129, avg=17491.03, stdev=12656.86 lat (usec): min=800, max=75130, avg=17492.21, stdev=12656.86 clat percentiles (usec): | 1.00th=[ 1532], 5.00th=[ 3851], 10.00th=[ 4424], 20.00th=[ 5866], | 30.00th=[ 8291], 40.00th=[11338], 50.00th=[14615], 60.00th=[18220], | 70.00th=[22152], 80.00th=[27132], 90.00th=[35390], 95.00th=[42730], | 99.00th=[55837], 99.50th=[61080], 99.90th=[74974], 99.95th=[74974], | 99.99th=[74974] bw ( KiB/s): min= 159, max= 768, per=25.60%, avg=446.19, stdev=177.02, samples=27 iops : min= 9, max= 48, avg=27.44, stdev=11.23, samples=27 lat (usec) : 50=0.26%, 100=1.17%, 250=2.99%, 1000=0.13% lat (msec) : 2=0.52%, 4=2.47%, 10=19.53%, 20=35.55%, 50=35.42% lat (msec) : 100=1.95% cpu : usr=0.13%, sys=28.41%, ctx=2664, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1657KiB/s (1697kB/s), 397KiB/s-440KiB/s (407kB/s-450kB/s), io=23.4MiB (24.5MB), run=13697-14455msec WRITE: bw=1743KiB/s (1785kB/s), 424KiB/s-465KiB/s (434kB/s-476kB/s), io=24.6MiB (25.8MB), run=13697-14455msec rand-rw: (groupid=0, jobs=1): err= 0: pid=186442: Tue Sep 8 19:57:47 2026 read: IOPS=23, BW=376KiB/s (386kB/s)(5920KiB/15725msec) clat (usec): min=2741, max=87745, avg=18443.84, stdev=15056.32 lat (usec): min=2741, max=87746, avg=18444.33, stdev=15056.35 clat percentiles (usec): | 1.00th=[ 3523], 5.00th=[ 4490], 10.00th=[ 4883], 20.00th=[ 6194], | 30.00th=[ 8717], 40.00th=[10945], 50.00th=[13960], 60.00th=[16712], | 70.00th=[21365], 80.00th=[27657], 90.00th=[38011], 95.00th=[50594], | 99.00th=[71828], 99.50th=[82314], 99.90th=[87557], 99.95th=[87557], | 99.99th=[87557] bw ( KiB/s): min= 127, max= 1216, per=24.50%, avg=371.87, stdev=259.27, samples=31 iops : min= 7, max= 76, avg=22.61, stdev=16.34, samples=31 write: IOPS=25, BW=405KiB/s (415kB/s)(6368KiB/15725msec); 0 zone resets clat (usec): min=4924, max=99805, avg=22214.01, stdev=16236.54 lat (usec): min=4925, max=99836, avg=22215.34, stdev=16237.14 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 7], 10.00th=[ 7], 20.00th=[ 9], | 30.00th=[ 11], 40.00th=[ 14], 50.00th=[ 17], 60.00th=[ 22], | 70.00th=[ 28], 80.00th=[ 35], 90.00th=[ 47], 95.00th=[ 54], | 99.00th=[ 78], 99.50th=[ 84], 99.90th=[ 101], 99.95th=[ 101], | 99.99th=[ 101] bw ( KiB/s): min= 127, max= 1280, per=25.16%, avg=401.87, stdev=273.15, samples=31 iops : min= 7, max= 80, avg=24.48, stdev=17.21, samples=31 lat (msec) : 4=1.17%, 10=29.82%, 20=29.95%, 50=33.20%, 100=5.86% cpu : usr=0.09%, sys=12.27%, ctx=1512, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=186443: Tue Sep 8 19:57:47 2026 read: IOPS=22, BW=367KiB/s (376kB/s)(5744KiB/15647msec) clat (msec): min=3, max=100, avg=17.73, stdev=14.04 lat (msec): min=3, max=100, avg=17.73, stdev=14.04 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 5], 10.00th=[ 6], 20.00th=[ 7], | 30.00th=[ 10], 40.00th=[ 11], 50.00th=[ 14], 60.00th=[ 17], | 70.00th=[ 20], 80.00th=[ 27], 90.00th=[ 37], 95.00th=[ 47], | 99.00th=[ 69], 99.50th=[ 83], 99.90th=[ 101], 99.95th=[ 101], | 99.99th=[ 101] bw ( KiB/s): min= 95, max= 992, per=22.79%, avg=345.97, stdev=182.52, samples=30 iops : min= 5, max= 62, avg=21.00, stdev=11.58, samples=30 write: IOPS=26, BW=418KiB/s (428kB/s)(6544KiB/15647msec); 0 zone resets clat (usec): min=4467, max=93257, avg=22484.33, stdev=15977.48 lat (usec): min=4468, max=93258, avg=22485.58, stdev=15977.62 clat percentiles (usec): | 1.00th=[ 5407], 5.00th=[ 6194], 10.00th=[ 6849], 20.00th=[ 8455], | 30.00th=[10814], 40.00th=[14091], 50.00th=[17695], 60.00th=[23462], | 70.00th=[28967], 80.00th=[33817], 90.00th=[43779], 95.00th=[54789], | 99.00th=[78119], 99.50th=[78119], 99.90th=[92799], 99.95th=[92799], | 99.99th=[92799] bw ( KiB/s): min= 127, max= 1376, per=24.25%, avg=387.20, stdev=226.73, samples=30 iops : min= 7, max= 86, avg=23.57, stdev=14.36, samples=30 lat (msec) : 4=0.91%, 10=30.08%, 20=30.99%, 50=32.68%, 100=5.21% lat (msec) : 250=0.13% cpu : usr=0.08%, sys=12.78%, ctx=1518, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=186444: Tue Sep 8 19:57:47 2026 read: IOPS=24, BW=398KiB/s (408kB/s)(6256KiB/15709msec) clat (msec): min=3, max=101, avg=17.90, stdev=14.35 lat (msec): min=3, max=101, avg=17.90, stdev=14.35 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 5], 10.00th=[ 6], 20.00th=[ 7], | 30.00th=[ 9], 40.00th=[ 12], 50.00th=[ 14], 60.00th=[ 18], | 70.00th=[ 21], 80.00th=[ 26], 90.00th=[ 39], 95.00th=[ 46], | 99.00th=[ 72], 99.50th=[ 83], 99.90th=[ 103], 99.95th=[ 103], | 99.99th=[ 103] bw ( KiB/s): min= 159, max= 1472, per=26.27%, avg=398.77, stdev=291.98, samples=31 iops : min= 9, max= 92, avg=24.29, stdev=18.37, samples=31 write: IOPS=23, BW=384KiB/s (393kB/s)(6032KiB/15709msec); 0 zone resets clat (usec): min=4780, max=83133, avg=22874.15, stdev=16169.88 lat (usec): min=4781, max=83134, avg=22875.57, stdev=16169.86 clat percentiles (usec): | 1.00th=[ 5211], 5.00th=[ 6194], 10.00th=[ 6849], 20.00th=[ 8291], | 30.00th=[10945], 40.00th=[14877], 50.00th=[19006], 60.00th=[22676], | 70.00th=[28443], 80.00th=[35390], 90.00th=[47449], 95.00th=[53216], | 99.00th=[77071], 99.50th=[80217], 99.90th=[83362], 99.95th=[83362], | 99.99th=[83362] bw ( KiB/s): min= 127, max= 1181, per=23.77%, avg=379.58, stdev=251.17, samples=31 iops : min= 7, max= 73, avg=23.10, stdev=15.82, samples=31 lat (msec) : 4=0.65%, 10=30.99%, 20=28.78%, 50=33.85%, 100=5.60% lat (msec) : 250=0.13% cpu : usr=0.08%, sys=12.52%, ctx=1492, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=186445: Tue Sep 8 19:57:47 2026 read: IOPS=23, BW=382KiB/s (392kB/s)(6032KiB/15773msec) clat (usec): min=2376, max=85867, avg=18454.10, stdev=15372.46 lat (usec): min=2376, max=85868, avg=18454.62, stdev=15372.51 clat percentiles (usec): | 1.00th=[ 2606], 5.00th=[ 4146], 10.00th=[ 4752], 20.00th=[ 5800], | 30.00th=[ 7504], 40.00th=[10290], 50.00th=[13304], 60.00th=[17433], | 70.00th=[22676], 80.00th=[28181], 90.00th=[40109], 95.00th=[51643], | 99.00th=[68682], 99.50th=[80217], 99.90th=[85459], 99.95th=[85459], | 99.99th=[85459] bw ( KiB/s): min= 127, max= 1440, per=24.48%, avg=371.68, stdev=267.75, samples=31 iops : min= 7, max= 90, avg=22.61, stdev=16.85, samples=31 write: IOPS=24, BW=397KiB/s (406kB/s)(6256KiB/15773msec); 0 zone resets clat (msec): min=4, max=120, avg=22.34, stdev=16.09 lat (msec): min=4, max=120, avg=22.34, stdev=16.09 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 6], 10.00th=[ 7], 20.00th=[ 9], | 30.00th=[ 11], 40.00th=[ 14], 50.00th=[ 19], 60.00th=[ 23], | 70.00th=[ 30], 80.00th=[ 35], 90.00th=[ 45], 95.00th=[ 52], | 99.00th=[ 70], 99.50th=[ 78], 99.90th=[ 121], 99.95th=[ 121], | 99.99th=[ 121] bw ( KiB/s): min= 159, max= 1309, per=24.43%, avg=390.10, stdev=267.56, samples=31 iops : min= 9, max= 81, avg=23.74, stdev=16.85, samples=31 lat (msec) : 4=2.08%, 10=31.64%, 20=25.91%, 50=34.38%, 100=5.86% lat (msec) : 250=0.13% cpu : usr=0.11%, sys=12.25%, ctx=1542, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1519KiB/s (1555kB/s), 367KiB/s-398KiB/s (376kB/s-408kB/s), io=23.4MiB (24.5MB), run=15647-15773msec WRITE: bw=1598KiB/s (1636kB/s), 384KiB/s-418KiB/s (393kB/s-428kB/s), io=24.6MiB (25.8MB), run=15647-15773msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=186458: Tue Sep 8 19:57:55 2026 read: IOPS=3, BW=3314KiB/s (3393kB/s)(7168KiB/2163msec) clat (usec): min=446, max=210035, avg=122184.81, stdev=66456.40 lat (usec): min=447, max=210036, avg=122185.69, stdev=66456.42 clat percentiles (usec): | 1.00th=[ 449], 5.00th=[ 449], 10.00th=[ 449], 20.00th=[ 82314], | 30.00th=[122160], 40.00th=[122160], 50.00th=[135267], 60.00th=[139461], | 70.00th=[139461], 80.00th=[164627], 90.00th=[210764], 95.00th=[210764], | 99.00th=[210764], 99.50th=[210764], 99.90th=[210764], 99.95th=[210764], | 99.99th=[210764] bw ( KiB/s): min= 1980, max= 3992, per=39.64%, avg=2911.00, stdev=1046.97, samples=4 iops : min= 1, max= 3, avg= 2.25, stdev= 0.96, samples=4 write: IOPS=2, BW=2367KiB/s (2424kB/s)(5120KiB/2163msec); 0 zone resets clat (msec): min=163, max=381, avg=234.10, stdev=86.41 lat (msec): min=163, max=381, avg=234.15, stdev=86.41 clat percentiles (msec): | 1.00th=[ 163], 5.00th=[ 163], 10.00th=[ 163], 20.00th=[ 163], | 30.00th=[ 182], 40.00th=[ 182], 50.00th=[ 222], 60.00th=[ 222], | 70.00th=[ 224], 80.00th=[ 224], 90.00th=[ 384], 95.00th=[ 384], | 99.00th=[ 384], 99.50th=[ 384], 99.90th=[ 384], 99.95th=[ 384], | 99.99th=[ 384] bw ( KiB/s): min= 1996, max= 3961, per=25.96%, avg=2668.33, stdev=1119.78, samples=3 iops : min= 1, max= 3, avg= 2.00, stdev= 1.00, samples=3 lat (usec) : 500=8.33% lat (msec) : 100=8.33%, 250=75.00%, 500=8.33% cpu : usr=0.00%, sys=40.15%, ctx=514, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=186459: Tue Sep 8 19:57:55 2026 read: IOPS=0, BW=734KiB/s (752kB/s)(2048KiB/2789msec) clat (msec): min=130, max=135, avg=133.36, stdev= 3.46 lat (msec): min=130, max=135, avg=133.36, stdev= 3.46 clat percentiles (msec): | 1.00th=[ 131], 5.00th=[ 131], 10.00th=[ 131], 20.00th=[ 131], | 30.00th=[ 131], 40.00th=[ 131], 50.00th=[ 131], 60.00th=[ 136], | 70.00th=[ 136], 80.00th=[ 136], 90.00th=[ 136], 95.00th=[ 136], | 99.00th=[ 136], 99.50th=[ 136], 99.90th=[ 136], 99.95th=[ 136], | 99.99th=[ 136] bw ( KiB/s): min= 1805, max= 2048, per=26.24%, avg=1926.50, stdev=171.83, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 write: IOPS=3, BW=3672KiB/s (3760kB/s)(10.0MiB/2789msec); 0 zone resets clat (msec): min=91, max=511, avg=242.20, stdev=160.97 lat (msec): min=91, max=511, avg=242.25, stdev=160.97 clat percentiles (msec): | 1.00th=[ 92], 5.00th=[ 92], 10.00th=[ 92], 20.00th=[ 111], | 30.00th=[ 132], 40.00th=[ 138], 50.00th=[ 146], 60.00th=[ 176], | 70.00th=[ 226], 80.00th=[ 435], 90.00th=[ 460], 95.00th=[ 510], | 99.00th=[ 510], 99.50th=[ 510], 99.90th=[ 510], 99.95th=[ 510], | 99.99th=[ 510] bw ( KiB/s): min= 1805, max= 6144, per=31.07%, avg=3193.80, stdev=1874.55, samples=5 iops : min= 1, max= 6, avg= 2.60, stdev= 2.07, samples=5 lat (msec) : 100=8.33%, 250=66.67%, 500=16.67%, 750=8.33% cpu : usr=0.00%, sys=46.52%, ctx=278, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=186460: Tue Sep 8 19:57:55 2026 read: IOPS=2, BW=2797KiB/s (2864kB/s)(6144KiB/2197msec) clat (usec): min=320, max=167626, avg=72904.03, stdev=80955.63 lat (usec): min=320, max=167627, avg=72904.83, stdev=80955.77 clat percentiles (usec): | 1.00th=[ 322], 5.00th=[ 322], 10.00th=[ 322], 20.00th=[ 437], | 30.00th=[ 437], 40.00th=[ 799], 50.00th=[ 799], 60.00th=[116917], | 70.00th=[152044], 80.00th=[152044], 90.00th=[166724], 95.00th=[166724], | 99.00th=[166724], 99.50th=[166724], 99.90th=[166724], 99.95th=[166724], | 99.99th=[166724] bw ( KiB/s): min= 3961, max= 6144, per=68.81%, avg=5052.50, stdev=1543.61, samples=2 iops : min= 3, max= 6, avg= 4.50, stdev= 2.12, samples=2 write: IOPS=2, BW=2797KiB/s (2864kB/s)(6144KiB/2197msec); 0 zone resets clat (msec): min=105, max=477, avg=259.09, stdev=142.16 lat (msec): min=105, max=477, avg=259.14, stdev=142.15 clat percentiles (msec): | 1.00th=[ 106], 5.00th=[ 106], 10.00th=[ 106], 20.00th=[ 159], | 30.00th=[ 159], 40.00th=[ 211], 50.00th=[ 211], 60.00th=[ 220], | 70.00th=[ 384], 80.00th=[ 384], 90.00th=[ 477], 95.00th=[ 477], | 99.00th=[ 477], 99.50th=[ 477], 99.90th=[ 477], 99.95th=[ 477], | 99.99th=[ 477] bw ( KiB/s): min= 1799, max= 6144, per=38.70%, avg=3978.33, stdev=2172.53, samples=3 iops : min= 1, max= 6, avg= 3.33, stdev= 2.52, samples=3 lat (usec) : 500=16.67%, 1000=8.33% lat (msec) : 250=58.33%, 500=16.67% cpu : usr=0.00%, sys=46.27%, ctx=596, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=186461: Tue Sep 8 19:57:55 2026 read: IOPS=3, BW=3362KiB/s (3442kB/s)(5120KiB/1523msec) clat (usec): min=323, max=195936, avg=39508.77, stdev=87445.96 lat (usec): min=324, max=195937, avg=39509.34, stdev=87445.79 clat percentiles (usec): | 1.00th=[ 326], 5.00th=[ 326], 10.00th=[ 326], 20.00th=[ 326], | 30.00th=[ 388], 40.00th=[ 388], 50.00th=[ 441], 60.00th=[ 441], | 70.00th=[ 457], 80.00th=[ 457], 90.00th=[196084], 95.00th=[196084], | 99.00th=[196084], 99.50th=[196084], 99.90th=[196084], 99.95th=[196084], | 99.99th=[196084] bw ( KiB/s): min= 1996, max= 1996, per=27.18%, avg=1996.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=4, BW=4707KiB/s (4819kB/s)(7168KiB/1523msec); 0 zone resets clat (msec): min=98, max=314, avg=186.81, stdev=76.40 lat (msec): min=98, max=314, avg=186.86, stdev=76.41 clat percentiles (msec): | 1.00th=[ 99], 5.00th=[ 99], 10.00th=[ 99], 20.00th=[ 117], | 30.00th=[ 136], 40.00th=[ 136], 50.00th=[ 188], 60.00th=[ 226], | 70.00th=[ 226], 80.00th=[ 228], 90.00th=[ 317], 95.00th=[ 317], | 99.00th=[ 317], 99.50th=[ 317], 99.90th=[ 317], 99.95th=[ 317], | 99.99th=[ 317] bw ( KiB/s): min= 3567, max= 3992, per=36.77%, avg=3779.50, stdev=300.52, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 lat (usec) : 500=33.33% lat (msec) : 100=8.33%, 250=50.00%, 500=8.33% cpu : usr=0.07%, sys=62.81%, ctx=231, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=7343KiB/s (7519kB/s), 734KiB/s-3362KiB/s (752kB/s-3442kB/s), io=20.0MiB (20.0MB), run=1523-2789msec WRITE: bw=10.0MiB/s (10.5MB/s), 2367KiB/s-4707KiB/s (2424kB/s-4819kB/s), io=28.0MiB (29.4MB), run=1523-2789msec rand-rw: (groupid=0, jobs=1): err= 0: pid=186454: Tue Sep 8 19:57:55 2026 read: IOPS=3, BW=3440KiB/s (3522kB/s)(7168KiB/2084msec) clat (msec): min=53, max=360, avg=130.12, stdev=108.44 lat (msec): min=53, max=360, avg=130.12, stdev=108.44 clat percentiles (msec): | 1.00th=[ 54], 5.00th=[ 54], 10.00th=[ 54], 20.00th=[ 59], | 30.00th=[ 65], 40.00th=[ 65], 50.00th=[ 95], 60.00th=[ 118], | 70.00th=[ 118], 80.00th=[ 161], 90.00th=[ 359], 95.00th=[ 359], | 99.00th=[ 359], 99.50th=[ 359], 99.90th=[ 359], 99.95th=[ 359], | 99.99th=[ 359] bw ( KiB/s): min= 3992, max= 5180, per=64.40%, avg=4586.00, stdev=840.04, samples=2 iops : min= 3, max= 5, avg= 4.00, stdev= 1.41, samples=2 write: IOPS=2, BW=2457KiB/s (2516kB/s)(5120KiB/2084msec); 0 zone resets clat (msec): min=102, max=419, avg=220.38, stdev=146.81 lat (msec): min=102, max=419, avg=220.43, stdev=146.82 clat percentiles (msec): | 1.00th=[ 103], 5.00th=[ 103], 10.00th=[ 103], 20.00th=[ 103], | 30.00th=[ 104], 40.00th=[ 104], 50.00th=[ 142], 60.00th=[ 142], | 70.00th=[ 334], 80.00th=[ 334], 90.00th=[ 422], 95.00th=[ 422], | 99.00th=[ 422], 99.50th=[ 422], 99.90th=[ 422], 99.95th=[ 422], | 99.99th=[ 422] bw ( KiB/s): min= 1726, max= 3961, per=28.52%, avg=2843.50, stdev=1580.38, samples=2 iops : min= 1, max= 3, avg= 2.00, stdev= 1.41, samples=2 lat (msec) : 100=33.33%, 250=41.67%, 500=25.00% cpu : usr=0.00%, sys=24.39%, ctx=150, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=186455: Tue Sep 8 19:57:55 2026 read: IOPS=0, BW=748KiB/s (766kB/s)(2048KiB/2737msec) clat (msec): min=56, max=339, avg=198.21, stdev=200.07 lat (msec): min=56, max=339, avg=198.21, stdev=200.07 clat percentiles (msec): | 1.00th=[ 57], 5.00th=[ 57], 10.00th=[ 57], 20.00th=[ 57], | 30.00th=[ 57], 40.00th=[ 57], 50.00th=[ 57], 60.00th=[ 338], | 70.00th=[ 338], 80.00th=[ 338], 90.00th=[ 338], 95.00th=[ 338], | 99.00th=[ 338], 99.50th=[ 338], 99.90th=[ 338], 99.95th=[ 338], | 99.99th=[ 338] bw ( KiB/s): min= 1726, max= 2048, per=26.50%, avg=1887.00, stdev=227.69, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 write: IOPS=3, BW=3741KiB/s (3831kB/s)(10.0MiB/2737msec); 0 zone resets clat (msec): min=70, max=840, avg=228.86, stdev=229.96 lat (msec): min=70, max=840, avg=228.92, stdev=229.96 clat percentiles (msec): | 1.00th=[ 71], 5.00th=[ 71], 10.00th=[ 71], 20.00th=[ 78], | 30.00th=[ 97], 40.00th=[ 124], 50.00th=[ 146], 60.00th=[ 163], | 70.00th=[ 176], 80.00th=[ 266], 90.00th=[ 330], 95.00th=[ 844], | 99.00th=[ 844], 99.50th=[ 844], 99.90th=[ 844], 99.95th=[ 844], | 99.99th=[ 844] bw ( KiB/s): min= 1980, max= 6144, per=38.37%, avg=3825.00, stdev=2157.39, samples=4 iops : min= 1, max= 6, avg= 3.25, stdev= 2.63, samples=4 lat (msec) : 100=33.33%, 250=33.33%, 500=25.00%, 1000=8.33% cpu : usr=0.00%, sys=14.62%, ctx=90, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=186456: Tue Sep 8 19:57:55 2026 read: IOPS=2, BW=2136KiB/s (2188kB/s)(6144KiB/2876msec) clat (msec): min=18, max=266, avg=90.30, stdev=92.52 lat (msec): min=18, max=266, avg=90.31, stdev=92.52 clat percentiles (msec): | 1.00th=[ 19], 5.00th=[ 19], 10.00th=[ 19], 20.00th=[ 19], | 30.00th=[ 19], 40.00th=[ 55], 50.00th=[ 55], 60.00th=[ 90], | 70.00th=[ 94], 80.00th=[ 94], 90.00th=[ 268], 95.00th=[ 268], | 99.00th=[ 268], 99.50th=[ 268], 99.90th=[ 268], 99.95th=[ 268], | 99.99th=[ 268] bw ( KiB/s): min= 4096, max= 4096, per=57.52%, avg=4096.00, stdev= 0.00, samples=2 iops : min= 4, max= 4, avg= 4.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2136KiB/s (2188kB/s)(6144KiB/2876msec); 0 zone resets clat (msec): min=17, max=1144, avg=382.05, stdev=419.74 lat (msec): min=17, max=1144, avg=382.11, stdev=419.76 clat percentiles (msec): | 1.00th=[ 18], 5.00th=[ 18], 10.00th=[ 18], 20.00th=[ 66], | 30.00th=[ 66], 40.00th=[ 197], 50.00th=[ 197], 60.00th=[ 321], | 70.00th=[ 550], 80.00th=[ 550], 90.00th=[ 1150], 95.00th=[ 1150], | 99.00th=[ 1150], 99.50th=[ 1150], 99.90th=[ 1150], 99.95th=[ 1150], | 99.99th=[ 1150] bw ( KiB/s): min= 1980, max= 3453, per=25.01%, avg=2493.67, stdev=831.50, samples=3 iops : min= 1, max= 3, avg= 2.00, stdev= 1.00, samples=3 lat (msec) : 20=25.00%, 100=33.33%, 250=8.33%, 500=16.67%, 750=8.33% lat (msec) : 2000=8.33% cpu : usr=0.03%, sys=12.70%, ctx=89, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=186457: Tue Sep 8 19:57:55 2026 read: IOPS=1, BW=2011KiB/s (2059kB/s)(5120KiB/2546msec) clat (msec): min=49, max=615, avg=238.44, stdev=263.16 lat (msec): min=49, max=615, avg=238.44, stdev=263.16 clat percentiles (msec): | 1.00th=[ 50], 5.00th=[ 50], 10.00th=[ 50], 20.00th=[ 50], | 30.00th=[ 52], 40.00th=[ 52], 50.00th=[ 60], 60.00th=[ 60], | 70.00th=[ 418], 80.00th=[ 418], 90.00th=[ 617], 95.00th=[ 617], | 99.00th=[ 617], 99.50th=[ 617], 99.90th=[ 617], 99.95th=[ 617], | 99.99th=[ 617] bw ( KiB/s): min= 3961, max= 4096, per=56.57%, avg=4028.50, stdev=95.46, samples=2 iops : min= 3, max= 4, avg= 3.50, stdev= 0.71, samples=2 write: IOPS=2, BW=2815KiB/s (2883kB/s)(7168KiB/2546msec); 0 zone resets clat (msec): min=51, max=403, avg=191.07, stdev=140.73 lat (msec): min=51, max=404, avg=191.15, stdev=140.72 clat percentiles (msec): | 1.00th=[ 52], 5.00th=[ 52], 10.00th=[ 52], 20.00th=[ 52], | 30.00th=[ 92], 40.00th=[ 92], 50.00th=[ 155], 60.00th=[ 259], | 70.00th=[ 259], 80.00th=[ 330], 90.00th=[ 405], 95.00th=[ 405], | 99.00th=[ 405], 99.50th=[ 405], 99.90th=[ 405], 99.95th=[ 405], | 99.99th=[ 405] bw ( KiB/s): min= 1996, max= 5171, per=35.95%, avg=3583.50, stdev=2245.06, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 lat (msec) : 50=8.33%, 100=41.67%, 250=8.33%, 500=33.33%, 750=8.33% cpu : usr=0.00%, sys=20.75%, ctx=200, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=7121KiB/s (7292kB/s), 748KiB/s-3440KiB/s (766kB/s-3522kB/s), io=20.0MiB (20.0MB), run=2084-2876msec WRITE: bw=9969KiB/s (10.2MB/s), 2136KiB/s-3741KiB/s (2188kB/s-3831kB/s), io=28.0MiB (29.4MB), run=2084-2876msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=186466: Tue Sep 8 19:58:03 2026 read: IOPS=1, BW=6865KiB/s (7030kB/s)(12.0MiB/1790msec) clat (msec): min=383, max=880, avg=583.94, stdev=262.13 lat (msec): min=383, max=880, avg=583.94, stdev=262.13 clat percentiles (msec): | 1.00th=[ 384], 5.00th=[ 384], 10.00th=[ 384], 20.00th=[ 384], | 30.00th=[ 384], 40.00th=[ 489], 50.00th=[ 489], 60.00th=[ 489], | 70.00th=[ 877], 80.00th=[ 877], 90.00th=[ 877], 95.00th=[ 877], | 99.00th=[ 877], 99.50th=[ 877], 99.90th=[ 877], 99.95th=[ 877], | 99.99th=[ 877] bw ( KiB/s): min= 8110, max= 8192, per=100.00%, avg=8151.00, stdev=57.98, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 500=66.67%, 1000=33.33% cpu : usr=0.00%, sys=44.83%, ctx=2976, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=186467: Tue Sep 8 19:58:03 2026 read: IOPS=0, BW=1698KiB/s (1739kB/s)(4096KiB/2412msec) clat (nsec): min=881580k, max=881580k, avg=881579910.00, stdev= 0.00 lat (nsec): min=881581k, max=881581k, avg=881581210.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 885], 5.00th=[ 885], 10.00th=[ 885], 20.00th=[ 885], | 30.00th=[ 885], 40.00th=[ 885], 50.00th=[ 885], 60.00th=[ 885], | 70.00th=[ 885], 80.00th=[ 885], 90.00th=[ 885], 95.00th=[ 885], | 99.00th=[ 885], 99.50th=[ 885], 99.90th=[ 885], 99.95th=[ 885], | 99.99th=[ 885] bw ( KiB/s): min= 8192, max= 8192, per=100.00%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 write: IOPS=0, BW=3396KiB/s (3478kB/s)(8192KiB/2412msec); 0 zone resets clat (msec): min=684, max=813, avg=749.06, stdev=91.12 lat (msec): min=684, max=813, avg=749.30, stdev=91.13 clat percentiles (msec): | 1.00th=[ 684], 5.00th=[ 684], 10.00th=[ 684], 20.00th=[ 684], | 30.00th=[ 684], 40.00th=[ 684], 50.00th=[ 684], 60.00th=[ 810], | 70.00th=[ 810], 80.00th=[ 810], 90.00th=[ 810], 95.00th=[ 810], | 99.00th=[ 810], 99.50th=[ 810], 99.90th=[ 810], 99.95th=[ 810], | 99.99th=[ 810] bw ( KiB/s): min= 8192, max= 8192, per=60.30%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, 1000=66.67% cpu : usr=0.00%, sys=13.77%, ctx=1145, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=186468: Tue Sep 8 19:58:03 2026 write: IOPS=1, BW=5879KiB/s (6021kB/s)(12.0MiB/2090msec); 0 zone resets clat (msec): min=506, max=785, avg=684.91, stdev=155.27 lat (msec): min=511, max=785, avg=686.82, stdev=152.49 clat percentiles (msec): | 1.00th=[ 506], 5.00th=[ 506], 10.00th=[ 506], 20.00th=[ 506], | 30.00th=[ 506], 40.00th=[ 768], 50.00th=[ 768], 60.00th=[ 768], | 70.00th=[ 785], 80.00th=[ 785], 90.00th=[ 785], 95.00th=[ 785], | 99.00th=[ 785], 99.50th=[ 785], 99.90th=[ 785], 99.95th=[ 785], | 99.99th=[ 785] bw ( KiB/s): min= 8110, max= 8192, per=60.00%, avg=8151.00, stdev=57.98, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 750=33.33%, 1000=66.67% cpu : usr=0.05%, sys=15.94%, ctx=88, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=186469: Tue Sep 8 19:58:03 2026 write: IOPS=1, BW=5928KiB/s (6070kB/s)(12.0MiB/2073msec); 0 zone resets clat (msec): min=161, max=1032, avg=672.91, stdev=455.31 lat (msec): min=161, max=1032, avg=673.18, stdev=455.30 clat percentiles (msec): | 1.00th=[ 161], 5.00th=[ 161], 10.00th=[ 161], 20.00th=[ 161], | 30.00th=[ 161], 40.00th=[ 827], 50.00th=[ 827], 60.00th=[ 827], | 70.00th=[ 1036], 80.00th=[ 1036], 90.00th=[ 1036], 95.00th=[ 1036], | 99.00th=[ 1036], 99.50th=[ 1036], 99.90th=[ 1036], 99.95th=[ 1036], | 99.99th=[ 1036] bw ( KiB/s): min= 8110, max= 8192, per=60.00%, avg=8151.00, stdev=57.98, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 250=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=13.51%, ctx=71, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=6793KiB/s (6956kB/s), 1698KiB/s-6865KiB/s (1739kB/s-7030kB/s), io=16.0MiB (16.8MB), run=1790-2412msec WRITE: bw=13.3MiB/s (13.9MB/s), 3396KiB/s-5928KiB/s (3478kB/s-6070kB/s), io=32.0MiB (33.6MB), run=2073-2412msec rand-rw: (groupid=0, jobs=1): err= 0: pid=186471: Tue Sep 8 19:58:03 2026 read: IOPS=1, BW=5824KiB/s (5963kB/s)(12.0MiB/2110msec) clat (msec): min=599, max=856, avg=687.58, stdev=146.24 lat (msec): min=599, max=856, avg=687.58, stdev=146.24 clat percentiles (msec): | 1.00th=[ 600], 5.00th=[ 600], 10.00th=[ 600], 20.00th=[ 600], | 30.00th=[ 600], 40.00th=[ 609], 50.00th=[ 609], 60.00th=[ 609], | 70.00th=[ 860], 80.00th=[ 860], 90.00th=[ 860], 95.00th=[ 860], | 99.00th=[ 860], 99.50th=[ 860], 99.90th=[ 860], 99.95th=[ 860], | 99.99th=[ 860] bw ( KiB/s): min= 8126, max= 8192, per=100.00%, avg=8159.00, stdev=46.67, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 750=66.67%, 1000=33.33% cpu : usr=0.00%, sys=14.22%, ctx=106, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=186472: Tue Sep 8 19:58:03 2026 read: IOPS=0, BW=1777KiB/s (1820kB/s)(4096KiB/2305msec) clat (nsec): min=1043.1M, max=1043.1M, avg=1043146694.00, stdev= 0.00 lat (nsec): min=1043.1M, max=1043.1M, avg=1043147799.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1045], 5.00th=[ 1045], 10.00th=[ 1045], 20.00th=[ 1045], | 30.00th=[ 1045], 40.00th=[ 1045], 50.00th=[ 1045], 60.00th=[ 1045], | 70.00th=[ 1045], 80.00th=[ 1045], 90.00th=[ 1045], 95.00th=[ 1045], | 99.00th=[ 1045], 99.50th=[ 1045], 99.90th=[ 1045], 99.95th=[ 1045], | 99.99th=[ 1045] bw ( KiB/s): min= 8126, max= 8126, per=100.00%, avg=8126.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=3554KiB/s (3639kB/s)(8192KiB/2305msec); 0 zone resets clat (msec): min=179, max=1061, avg=620.66, stdev=623.68 lat (msec): min=179, max=1061, avg=620.86, stdev=623.58 clat percentiles (msec): | 1.00th=[ 180], 5.00th=[ 180], 10.00th=[ 180], 20.00th=[ 180], | 30.00th=[ 180], 40.00th=[ 180], 50.00th=[ 180], 60.00th=[ 1062], | 70.00th=[ 1062], 80.00th=[ 1062], 90.00th=[ 1062], 95.00th=[ 1062], | 99.00th=[ 1062], 99.50th=[ 1062], 99.90th=[ 1062], 99.95th=[ 1062], | 99.99th=[ 1062] bw ( KiB/s): min= 8159, max= 8159, per=57.39%, avg=8159.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 2000=66.67% cpu : usr=0.00%, sys=10.37%, ctx=88, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=186473: Tue Sep 8 19:58:03 2026 write: IOPS=1, BW=5456KiB/s (5587kB/s)(12.0MiB/2252msec); 0 zone resets clat (msec): min=174, max=1498, avg=741.73, stdev=682.19 lat (msec): min=175, max=1499, avg=741.99, stdev=682.20 clat percentiles (msec): | 1.00th=[ 176], 5.00th=[ 176], 10.00th=[ 176], 20.00th=[ 176], | 30.00th=[ 176], 40.00th=[ 550], 50.00th=[ 550], 60.00th=[ 550], | 70.00th=[ 1502], 80.00th=[ 1502], 90.00th=[ 1502], 95.00th=[ 1502], | 99.00th=[ 1502], 99.50th=[ 1502], 99.90th=[ 1502], 99.95th=[ 1502], | 99.99th=[ 1502] bw ( KiB/s): min= 8159, max= 8192, per=57.51%, avg=8175.50, stdev=23.33, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 250=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.00%, sys=11.64%, ctx=57, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=186474: Tue Sep 8 19:58:03 2026 write: IOPS=1, BW=5777KiB/s (5916kB/s)(12.0MiB/2127msec); 0 zone resets clat (msec): min=189, max=1182, avg=693.19, stdev=496.34 lat (msec): min=189, max=1182, avg=693.41, stdev=496.42 clat percentiles (msec): | 1.00th=[ 190], 5.00th=[ 190], 10.00th=[ 190], 20.00th=[ 190], | 30.00th=[ 190], 40.00th=[ 709], 50.00th=[ 709], 60.00th=[ 709], | 70.00th=[ 1183], 80.00th=[ 1183], 90.00th=[ 1183], 95.00th=[ 1183], | 99.00th=[ 1183], 99.50th=[ 1183], 99.90th=[ 1183], 99.95th=[ 1183], | 99.99th=[ 1183] bw ( KiB/s): min= 8126, max= 8126, per=57.16%, avg=8126.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.00%, sys=14.11%, ctx=57, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=7108KiB/s (7279kB/s), 1777KiB/s-5824KiB/s (1820kB/s-5963kB/s), io=16.0MiB (16.8MB), run=2110-2305msec WRITE: bw=13.9MiB/s (14.6MB/s), 3554KiB/s-5777KiB/s (3639kB/s-5916kB/s), io=32.0MiB (33.6MB), run=2127-2305msec