== sanity test 398b: DIO and buffer IO race ============== 14:42:52 (1788201772) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 5.30937 s, 9.5 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144988: Mon Aug 31 14:45:07 2026 read: IOPS=13, BW=52.2KiB/s (53.4kB/s)(5992KiB/114864msec) clat (usec): min=35, max=279826, avg=37502.71, stdev=27788.20 lat (usec): min=36, max=279827, avg=37510.59, stdev=27784.32 clat percentiles (usec): | 1.00th=[ 54], 5.00th=[ 70], 10.00th=[ 11207], 20.00th=[ 19006], | 30.00th=[ 22938], 40.00th=[ 27132], 50.00th=[ 31327], 60.00th=[ 36963], | 70.00th=[ 44303], 80.00th=[ 54264], 90.00th=[ 69731], 95.00th=[ 86508], | 99.00th=[135267], 99.50th=[166724], 99.90th=[246416], 99.95th=[278922], | 99.99th=[278922] bw ( KiB/s): min= 7, max= 127, per=25.40%, avg=51.82, stdev=21.12, samples=226 iops : min= 1, max= 31, avg=12.31, stdev= 5.32, samples=226 write: IOPS=13, BW=54.8KiB/s (56.1kB/s)(6296KiB/114864msec); 0 zone resets clat (usec): min=940, max=460772, avg=37170.11, stdev=39226.97 lat (usec): min=942, max=460774, avg=37178.78, stdev=39228.94 clat percentiles (usec): | 1.00th=[ 1188], 5.00th=[ 1385], 10.00th=[ 1909], 20.00th=[ 4146], | 30.00th=[ 8455], 40.00th=[ 17695], 50.00th=[ 27657], 60.00th=[ 37487], | 70.00th=[ 49546], 80.00th=[ 63177], 90.00th=[ 84411], 95.00th=[111674], | 99.00th=[173016], 99.50th=[185598], 99.90th=[354419], 99.95th=[459277], | 99.99th=[459277] bw ( KiB/s): min= 7, max= 127, per=25.36%, avg=54.26, stdev=22.27, samples=227 iops : min= 1, max= 31, avg=12.92, stdev= 5.60, samples=227 lat (usec) : 50=0.26%, 100=3.42%, 250=0.33%, 500=0.13%, 750=0.03% lat (usec) : 1000=0.13% lat (msec) : 2=5.40%, 4=4.62%, 10=7.13%, 20=11.23%, 50=40.76% lat (msec) : 100=21.58%, 250=4.85%, 500=0.13% cpu : usr=0.09%, sys=5.67%, ctx=6748, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144989: Mon Aug 31 14:45:07 2026 read: IOPS=12, BW=50.6KiB/s (51.8kB/s)(5940KiB/117361msec) clat (usec): min=35, max=328486, avg=38292.82, stdev=28058.48 lat (usec): min=35, max=328488, avg=38299.16, stdev=28054.74 clat percentiles (usec): | 1.00th=[ 58], 5.00th=[ 74], 10.00th=[ 12125], 20.00th=[ 19530], | 30.00th=[ 23462], 40.00th=[ 27919], 50.00th=[ 33162], 60.00th=[ 38536], | 70.00th=[ 46400], 80.00th=[ 55837], 90.00th=[ 71828], 95.00th=[ 83362], | 99.00th=[111674], 99.50th=[147850], 99.90th=[308282], 99.95th=[329253], | 99.99th=[329253] bw ( KiB/s): min= 6, max= 103, per=24.64%, avg=50.26, stdev=20.61, samples=231 iops : min= 1, max= 25, avg=11.91, stdev= 5.17, samples=231 write: IOPS=13, BW=54.1KiB/s (55.4kB/s)(6348KiB/117361msec); 0 zone resets clat (usec): min=975, max=415889, avg=37997.67, stdev=39734.02 lat (usec): min=977, max=415891, avg=38005.47, stdev=39733.98 clat percentiles (usec): | 1.00th=[ 1221], 5.00th=[ 1401], 10.00th=[ 2008], 20.00th=[ 4228], | 30.00th=[ 8455], 40.00th=[ 18482], 50.00th=[ 28705], 60.00th=[ 38536], | 70.00th=[ 49546], 80.00th=[ 64226], 90.00th=[ 87557], 95.00th=[112722], | 99.00th=[166724], 99.50th=[208667], 99.90th=[333448], 99.95th=[417334], | 99.99th=[417334] bw ( KiB/s): min= 7, max= 149, per=24.93%, avg=53.35, stdev=22.62, samples=232 iops : min= 1, max= 37, avg=12.69, stdev= 5.68, samples=232 lat (usec) : 50=0.29%, 100=2.96%, 250=0.55%, 500=0.10%, 750=0.03% lat (usec) : 1000=0.07% lat (msec) : 2=5.18%, 4=4.75%, 10=6.87%, 20=10.87%, 50=40.17% lat (msec) : 100=23.63%, 250=4.30%, 500=0.23% cpu : usr=0.09%, sys=5.50%, ctx=6822, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144990: Mon Aug 31 14:45:07 2026 read: IOPS=12, BW=51.5KiB/s (52.7kB/s)(6028KiB/117112msec) clat (usec): min=30, max=307905, avg=38349.47, stdev=28640.82 lat (usec): min=31, max=307906, avg=38353.46, stdev=28640.46 clat percentiles (usec): | 1.00th=[ 51], 5.00th=[ 67], 10.00th=[ 2835], 20.00th=[ 18744], | 30.00th=[ 22938], 40.00th=[ 28181], 50.00th=[ 33424], 60.00th=[ 39060], | 70.00th=[ 46400], 80.00th=[ 56361], 90.00th=[ 72877], 95.00th=[ 86508], | 99.00th=[130548], 99.50th=[168821], 99.90th=[274727], 99.95th=[308282], | 99.99th=[308282] bw ( KiB/s): min= 7, max= 112, per=25.21%, avg=51.43, stdev=21.18, samples=229 iops : min= 1, max= 28, avg=12.21, stdev= 5.34, samples=229 write: IOPS=13, BW=53.5KiB/s (54.7kB/s)(6260KiB/117112msec); 0 zone resets clat (usec): min=1015, max=423213, avg=37770.96, stdev=39350.13 lat (usec): min=1016, max=423215, avg=37773.21, stdev=39350.02 clat percentiles (usec): | 1.00th=[ 1205], 5.00th=[ 1418], 10.00th=[ 2278], 20.00th=[ 4883], | 30.00th=[ 8455], 40.00th=[ 19530], 50.00th=[ 27919], 60.00th=[ 38011], | 70.00th=[ 49546], 80.00th=[ 63177], 90.00th=[ 85459], 95.00th=[106431], | 99.00th=[170918], 99.50th=[202376], 99.90th=[337642], 99.95th=[421528], | 99.99th=[421528] bw ( KiB/s): min= 7, max= 119, per=24.76%, avg=52.99, stdev=21.27, samples=231 iops : min= 1, max= 29, avg=12.60, stdev= 5.34, samples=231 lat (usec) : 50=0.46%, 100=3.78%, 250=0.39%, 500=0.07%, 750=0.03% lat (msec) : 2=4.59%, 4=4.13%, 10=8.07%, 20=10.35%, 50=39.81% lat (msec) : 100=23.93%, 250=4.13%, 500=0.26% cpu : usr=0.09%, sys=5.58%, ctx=6831, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144991: Mon Aug 31 14:45:07 2026 read: IOPS=13, BW=52.1KiB/s (53.3kB/s)(6052KiB/116256msec) clat (usec): min=34, max=215025, avg=38148.32, stdev=27002.99 lat (usec): min=35, max=215027, avg=38161.48, stdev=27001.16 clat percentiles (usec): | 1.00th=[ 55], 5.00th=[ 68], 10.00th=[ 119], 20.00th=[ 19006], | 30.00th=[ 24511], 40.00th=[ 28967], 50.00th=[ 33817], 60.00th=[ 39060], | 70.00th=[ 46400], 80.00th=[ 55313], 90.00th=[ 71828], 95.00th=[ 88605], | 99.00th=[128451], 99.50th=[149947], 99.90th=[193987], 99.95th=[214959], | 99.99th=[214959] bw ( KiB/s): min= 7, max= 111, per=25.33%, avg=51.68, stdev=19.94, samples=229 iops : min= 1, max= 27, avg=12.27, stdev= 4.99, samples=229 write: IOPS=13, BW=53.6KiB/s (54.9kB/s)(6236KiB/116256msec); 0 zone resets clat (usec): min=903, max=502195, avg=37413.35, stdev=40005.40 lat (usec): min=904, max=502196, avg=37422.82, stdev=40000.76 clat percentiles (usec): | 1.00th=[ 1188], 5.00th=[ 1418], 10.00th=[ 2024], 20.00th=[ 4359], | 30.00th=[ 8291], 40.00th=[ 17171], 50.00th=[ 27919], 60.00th=[ 37487], | 70.00th=[ 49021], 80.00th=[ 64226], 90.00th=[ 83362], 95.00th=[108528], | 99.00th=[164627], 99.50th=[204473], 99.90th=[413139], 99.95th=[501220], | 99.99th=[501220] bw ( KiB/s): min= 7, max= 125, per=24.75%, avg=52.97, stdev=22.28, samples=230 iops : min= 1, max= 31, avg=12.60, stdev= 5.61, samples=230 lat (usec) : 50=0.39%, 100=4.33%, 250=0.39%, 500=0.16%, 750=0.03% lat (usec) : 1000=0.07% lat (msec) : 2=4.95%, 4=4.39%, 10=7.65%, 20=9.77%, 50=40.01% lat (msec) : 100=23.14%, 250=4.62%, 500=0.07%, 750=0.03% cpu : usr=0.08%, sys=5.60%, ctx=6685, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=205KiB/s (210kB/s), 50.6KiB/s-52.2KiB/s (51.8kB/s-53.4kB/s), io=23.4MiB (24.6MB), run=114864-117361msec WRITE: bw=214KiB/s (219kB/s), 53.5KiB/s-54.8KiB/s (54.7kB/s-56.1kB/s), io=24.6MiB (25.7MB), run=114864-117361msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144983: Mon Aug 31 14:47:12 2026 read: IOPS=6, BW=24.6KiB/s (25.2kB/s)(5992KiB/243353msec) clat (msec): min=5, max=807, avg=32.40, stdev=37.61 lat (msec): min=5, max=807, avg=32.41, stdev=37.61 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 13], | 30.00th=[ 16], 40.00th=[ 18], 50.00th=[ 22], 60.00th=[ 26], | 70.00th=[ 32], 80.00th=[ 43], 90.00th=[ 67], 95.00th=[ 93], | 99.00th=[ 165], 99.50th=[ 228], 99.90th=[ 351], 99.95th=[ 810], | 99.99th=[ 810] bw ( KiB/s): min= 7, max= 94, per=27.69%, avg=27.14, stdev=17.80, samples=427 iops : min= 1, max= 23, avg= 6.16, stdev= 4.48, samples=427 write: IOPS=6, BW=25.9KiB/s (26.5kB/s)(6296KiB/243353msec); 0 zone resets clat (msec): min=33, max=684, avg=123.49, stdev=55.90 lat (msec): min=33, max=684, avg=123.49, stdev=55.90 clat percentiles (msec): | 1.00th=[ 48], 5.00th=[ 59], 10.00th=[ 68], 20.00th=[ 80], | 30.00th=[ 91], 40.00th=[ 102], 50.00th=[ 112], 60.00th=[ 124], | 70.00th=[ 142], 80.00th=[ 159], 90.00th=[ 190], 95.00th=[ 224], | 99.00th=[ 313], 99.50th=[ 372], 99.90th=[ 550], 99.95th=[ 684], | 99.99th=[ 684] bw ( KiB/s): min= 7, max= 55, per=24.60%, avg=25.33, stdev=10.58, samples=479 iops : min= 1, max= 13, avg= 5.70, stdev= 2.71, samples=479 lat (msec) : 10=3.97%, 20=19.17%, 50=18.46%, 100=24.64%, 250=32.29% lat (msec) : 500=1.33%, 750=0.10%, 1000=0.03% cpu : usr=0.05%, sys=1.26%, ctx=5105, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144984: Mon Aug 31 14:47:12 2026 read: IOPS=6, BW=24.4KiB/s (24.9kB/s)(5940KiB/243926msec) clat (msec): min=5, max=748, avg=32.04, stdev=37.39 lat (msec): min=5, max=748, avg=32.04, stdev=37.39 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 13], | 30.00th=[ 16], 40.00th=[ 18], 50.00th=[ 21], 60.00th=[ 25], | 70.00th=[ 31], 80.00th=[ 43], 90.00th=[ 67], 95.00th=[ 94], | 99.00th=[ 174], 99.50th=[ 218], 99.90th=[ 351], 99.95th=[ 751], | 99.99th=[ 751] bw ( KiB/s): min= 7, max= 111, per=27.36%, avg=26.82, stdev=17.78, samples=428 iops : min= 1, max= 27, avg= 6.07, stdev= 4.50, samples=428 write: IOPS=6, BW=26.0KiB/s (26.6kB/s)(6348KiB/243926msec); 0 zone resets clat (msec): min=36, max=538, avg=123.44, stdev=55.19 lat (msec): min=36, max=538, avg=123.44, stdev=55.19 clat percentiles (msec): | 1.00th=[ 45], 5.00th=[ 57], 10.00th=[ 66], 20.00th=[ 79], | 30.00th=[ 89], 40.00th=[ 100], 50.00th=[ 112], 60.00th=[ 126], | 70.00th=[ 140], 80.00th=[ 165], 90.00th=[ 199], 95.00th=[ 226], | 99.00th=[ 296], 99.50th=[ 342], 99.90th=[ 418], 99.95th=[ 542], | 99.99th=[ 542] bw ( KiB/s): min= 7, max= 63, per=24.80%, avg=25.54, stdev=11.16, samples=479 iops : min= 1, max= 15, avg= 5.75, stdev= 2.83, samples=479 lat (msec) : 10=4.30%, 20=18.95%, 50=18.13%, 100=26.07%, 250=30.73% lat (msec) : 500=1.76%, 750=0.07% cpu : usr=0.05%, sys=1.25%, ctx=5151, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144985: Mon Aug 31 14:47:12 2026 read: IOPS=6, BW=24.9KiB/s (25.5kB/s)(6028KiB/241740msec) clat (msec): min=4, max=395, avg=32.68, stdev=31.90 lat (msec): min=4, max=395, avg=32.69, stdev=31.90 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 11], 20.00th=[ 14], | 30.00th=[ 16], 40.00th=[ 19], 50.00th=[ 22], 60.00th=[ 26], | 70.00th=[ 34], 80.00th=[ 47], 90.00th=[ 68], 95.00th=[ 93], | 99.00th=[ 153], 99.50th=[ 180], 99.90th=[ 355], 99.95th=[ 397], | 99.99th=[ 397] bw ( KiB/s): min= 7, max= 112, per=26.51%, avg=25.98, stdev=17.26, samples=448 iops : min= 1, max= 28, avg= 5.86, stdev= 4.37, samples=448 write: IOPS=6, BW=25.9KiB/s (26.5kB/s)(6260KiB/241740msec); 0 zone resets clat (msec): min=37, max=826, avg=122.73, stdev=55.62 lat (msec): min=37, max=826, avg=122.73, stdev=55.62 clat percentiles (msec): | 1.00th=[ 47], 5.00th=[ 60], 10.00th=[ 69], 20.00th=[ 80], | 30.00th=[ 90], 40.00th=[ 102], 50.00th=[ 113], 60.00th=[ 125], | 70.00th=[ 140], 80.00th=[ 159], 90.00th=[ 190], 95.00th=[ 220], | 99.00th=[ 292], 99.50th=[ 359], 99.90th=[ 600], 99.95th=[ 827], | 99.99th=[ 827] bw ( KiB/s): min= 7, max= 55, per=24.70%, avg=25.44, stdev=10.76, samples=475 iops : min= 1, max= 13, avg= 5.72, stdev= 2.76, samples=475 lat (msec) : 10=3.39%, 20=19.34%, 50=18.16%, 100=26.01%, 250=31.74% lat (msec) : 500=1.30%, 750=0.03%, 1000=0.03% cpu : usr=0.04%, sys=1.25%, ctx=4988, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144986: Mon Aug 31 14:47:12 2026 read: IOPS=6, BW=24.0KiB/s (25.6kB/s)(6052KiB/242444msec) clat (msec): min=5, max=401, avg=32.01, stdev=33.86 lat (msec): min=5, max=401, avg=32.01, stdev=33.86 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 13], | 30.00th=[ 16], 40.00th=[ 18], 50.00th=[ 21], 60.00th=[ 24], | 70.00th=[ 31], 80.00th=[ 43], 90.00th=[ 68], 95.00th=[ 100], | 99.00th=[ 163], 99.50th=[ 211], 99.90th=[ 342], 99.95th=[ 401], | 99.99th=[ 401] bw ( KiB/s): min= 7, max= 120, per=27.24%, avg=26.69, stdev=18.51, samples=438 iops : min= 1, max= 30, avg= 6.03, stdev= 4.68, samples=438 write: IOPS=6, BW=25.7KiB/s (26.3kB/s)(6236KiB/242444msec); 0 zone resets clat (msec): min=36, max=837, avg=124.17, stdev=57.28 lat (msec): min=36, max=837, avg=124.18, stdev=57.28 clat percentiles (msec): | 1.00th=[ 47], 5.00th=[ 61], 10.00th=[ 68], 20.00th=[ 80], | 30.00th=[ 90], 40.00th=[ 101], 50.00th=[ 113], 60.00th=[ 126], | 70.00th=[ 142], 80.00th=[ 161], 90.00th=[ 194], 95.00th=[ 220], | 99.00th=[ 305], 99.50th=[ 355], 99.90th=[ 550], 99.95th=[ 835], | 99.99th=[ 835] bw ( KiB/s): min= 7, max= 55, per=24.54%, avg=25.28, stdev=10.68, samples=475 iops : min= 1, max= 13, avg= 5.68, stdev= 2.74, samples=475 lat (msec) : 10=4.59%, 20=19.17%, 50=18.00%, 100=25.29%, 250=31.41% lat (msec) : 500=1.43%, 750=0.07%, 1000=0.03% cpu : usr=0.05%, sys=1.29%, ctx=5139, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=98.4KiB/s (101kB/s), 24.4KiB/s-24.0KiB/s (24.9kB/s-25.6kB/s), io=23.4MiB (24.6MB), run=241740-243926msec WRITE: bw=103KiB/s (106kB/s), 25.7KiB/s-26.0KiB/s (26.3kB/s-26.6kB/s), io=24.6MiB (25.7MB), run=241740-243926msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=145045: Mon Aug 31 14:47:46 2026 read: IOPS=15, BW=240KiB/s (246kB/s)(5920KiB/24659msec) clat (usec): min=36, max=180059, avg=34300.49, stdev=28706.70 lat (usec): min=37, max=180061, avg=34301.66, stdev=28706.84 clat percentiles (usec): | 1.00th=[ 47], 5.00th=[ 58], 10.00th=[ 70], 20.00th=[ 717], | 30.00th=[ 18220], 40.00th=[ 25035], 50.00th=[ 29754], 60.00th=[ 36963], | 70.00th=[ 44303], 80.00th=[ 55313], 90.00th=[ 69731], 95.00th=[ 89654], | 99.00th=[116917], 99.50th=[152044], 99.90th=[179307], 99.95th=[179307], | 99.99th=[179307] bw ( KiB/s): min= 63, max= 561, per=23.94%, avg=232.42, stdev=82.72, samples=48 iops : min= 3, max= 35, avg=13.71, stdev= 5.26, samples=48 write: IOPS=16, BW=258KiB/s (264kB/s)(6368KiB/24659msec); 0 zone resets clat (usec): min=1417, max=178154, avg=29634.99, stdev=32025.08 lat (usec): min=1417, max=178156, avg=29638.01, stdev=32026.27 clat percentiles (usec): | 1.00th=[ 1500], 5.00th=[ 1860], 10.00th=[ 2638], 20.00th=[ 3949], | 30.00th=[ 5997], 40.00th=[ 9896], 50.00th=[ 18220], 60.00th=[ 25560], | 70.00th=[ 38536], 80.00th=[ 54264], 90.00th=[ 77071], 95.00th=[ 99091], | 99.00th=[130548], 99.50th=[175113], 99.90th=[177210], 99.95th=[177210], | 99.99th=[177210] bw ( KiB/s): min= 63, max= 623, per=24.89%, avg=254.12, stdev=104.22, samples=48 iops : min= 3, max= 38, avg=15.08, stdev= 6.57, samples=48 lat (usec) : 50=0.65%, 100=7.03%, 250=1.43%, 500=0.26%, 750=0.26% lat (usec) : 1000=0.13% lat (msec) : 2=3.78%, 4=7.42%, 10=10.16%, 20=11.98%, 50=33.72% lat (msec) : 100=19.79%, 250=3.39% cpu : usr=0.10%, sys=7.12%, ctx=1586, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145046: Mon Aug 31 14:47:46 2026 read: IOPS=15, BW=243KiB/s (249kB/s)(5744KiB/23644msec) clat (usec): min=36, max=151058, avg=32976.65, stdev=25188.23 lat (usec): min=36, max=151059, avg=32978.60, stdev=25188.97 clat percentiles (usec): | 1.00th=[ 42], 5.00th=[ 59], 10.00th=[ 67], 20.00th=[ 2376], | 30.00th=[ 21890], 40.00th=[ 27395], 50.00th=[ 31327], 60.00th=[ 36439], | 70.00th=[ 41681], 80.00th=[ 50070], 90.00th=[ 62129], 95.00th=[ 80217], | 99.00th=[109577], 99.50th=[139461], 99.90th=[152044], 99.95th=[152044], | 99.99th=[152044] bw ( KiB/s): min= 58, max= 509, per=24.95%, avg=242.26, stdev=86.59, samples=46 iops : min= 3, max= 31, avg=14.33, stdev= 5.47, samples=46 write: IOPS=17, BW=277KiB/s (283kB/s)(6544KiB/23644msec); 0 zone resets clat (usec): min=1394, max=238488, avg=28412.36, stdev=32314.89 lat (usec): min=1396, max=238489, avg=28415.48, stdev=32315.49 clat percentiles (usec): | 1.00th=[ 1598], 5.00th=[ 1942], 10.00th=[ 2573], 20.00th=[ 4293], | 30.00th=[ 6390], 40.00th=[ 8979], 50.00th=[ 14091], 60.00th=[ 25035], | 70.00th=[ 38536], 80.00th=[ 52167], 90.00th=[ 69731], 95.00th=[ 80217], | 99.00th=[162530], 99.50th=[185598], 99.90th=[238027], 99.95th=[238027], | 99.99th=[238027] bw ( KiB/s): min= 94, max= 535, per=26.80%, avg=273.59, stdev=100.98, samples=46 iops : min= 5, max= 33, avg=16.30, stdev= 6.38, samples=46 lat (usec) : 50=1.04%, 100=6.51%, 250=1.04%, 500=0.39%, 750=0.13% lat (usec) : 1000=0.13% lat (msec) : 2=3.26%, 4=6.77%, 10=13.80%, 20=9.38%, 50=36.98% lat (msec) : 100=18.36%, 250=2.21% cpu : usr=0.09%, sys=7.38%, ctx=1536, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145047: Mon Aug 31 14:47:46 2026 read: IOPS=16, BW=261KiB/s (267kB/s)(6256KiB/23969msec) clat (usec): min=35, max=238709, avg=33884.73, stdev=29907.52 lat (usec): min=35, max=238709, avg=33886.88, stdev=29907.01 clat percentiles (usec): | 1.00th=[ 44], 5.00th=[ 57], 10.00th=[ 63], 20.00th=[ 110], | 30.00th=[ 19006], 40.00th=[ 25035], 50.00th=[ 29754], 60.00th=[ 37487], | 70.00th=[ 43779], 80.00th=[ 54264], 90.00th=[ 69731], 95.00th=[ 89654], | 99.00th=[127402], 99.50th=[147850], 99.90th=[238027], 99.95th=[238027], | 99.99th=[238027] bw ( KiB/s): min= 126, max= 479, per=27.05%, avg=262.64, stdev=75.86, samples=47 iops : min= 7, max= 29, avg=15.60, stdev= 4.79, samples=47 write: IOPS=15, BW=252KiB/s (258kB/s)(6032KiB/23969msec); 0 zone resets clat (usec): min=1393, max=127494, avg=27978.47, stdev=27438.84 lat (usec): min=1395, max=127495, avg=27984.06, stdev=27437.89 clat percentiles (usec): | 1.00th=[ 1516], 5.00th=[ 2180], 10.00th=[ 3195], 20.00th=[ 4686], | 30.00th=[ 6652], 40.00th=[ 9765], 50.00th=[ 19268], 60.00th=[ 27132], | 70.00th=[ 35914], 80.00th=[ 52167], 90.00th=[ 70779], 95.00th=[ 82314], | 99.00th=[107480], 99.50th=[119014], 99.90th=[127402], 99.95th=[127402], | 99.99th=[127402] bw ( KiB/s): min= 63, max= 447, per=24.46%, avg=249.79, stdev=91.38, samples=47 iops : min= 3, max= 27, avg=14.79, stdev= 5.75, samples=47 lat (usec) : 50=0.78%, 100=8.85%, 250=1.95%, 500=0.13%, 1000=0.13% lat (msec) : 2=2.21%, 4=5.99%, 10=12.24%, 20=8.85%, 50=35.55% lat (msec) : 100=20.96%, 250=2.34% cpu : usr=0.08%, sys=7.19%, ctx=1540, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145048: Mon Aug 31 14:47:46 2026 read: IOPS=15, BW=254KiB/s (260kB/s)(6032KiB/23761msec) clat (usec): min=37, max=135854, avg=33540.39, stdev=27916.41 lat (usec): min=37, max=135855, avg=33541.42, stdev=27916.45 clat percentiles (usec): | 1.00th=[ 40], 5.00th=[ 59], 10.00th=[ 63], 20.00th=[ 113], | 30.00th=[ 17695], 40.00th=[ 24773], 50.00th=[ 30802], 60.00th=[ 38536], | 70.00th=[ 45351], 80.00th=[ 56361], 90.00th=[ 71828], 95.00th=[ 82314], | 99.00th=[108528], 99.50th=[128451], 99.90th=[135267], 99.95th=[135267], | 99.99th=[135267] bw ( KiB/s): min= 95, max= 471, per=26.06%, avg=253.02, stdev=82.15, samples=47 iops : min= 5, max= 29, avg=15.00, stdev= 5.17, samples=47 write: IOPS=16, BW=263KiB/s (270kB/s)(6256KiB/23761msec); 0 zone resets clat (usec): min=1286, max=262530, avg=28259.79, stdev=31090.01 lat (usec): min=1288, max=262532, avg=28262.26, stdev=31090.29 clat percentiles (usec): | 1.00th=[ 1516], 5.00th=[ 2376], 10.00th=[ 3032], 20.00th=[ 4490], | 30.00th=[ 6718], 40.00th=[ 10945], 50.00th=[ 17433], 60.00th=[ 24773], | 70.00th=[ 37487], 80.00th=[ 49546], 90.00th=[ 66847], 95.00th=[ 83362], | 99.00th=[122160], 99.50th=[196084], 99.90th=[263193], 99.95th=[263193], | 99.99th=[263193] bw ( KiB/s): min= 63, max= 573, per=25.77%, avg=263.15, stdev=90.98, samples=47 iops : min= 3, max= 35, avg=15.64, stdev= 5.72, samples=47 lat (usec) : 50=1.04%, 100=8.20%, 250=2.47%, 500=0.52%, 750=0.13% lat (msec) : 2=1.95%, 4=6.77%, 10=10.94%, 20=10.94%, 50=33.59% lat (msec) : 100=21.35%, 250=1.95%, 500=0.13% cpu : usr=0.06%, sys=6.96%, ctx=1470, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=971KiB/s (995kB/s), 240KiB/s-261KiB/s (246kB/s-267kB/s), io=23.4MiB (24.5MB), run=23644-24659msec WRITE: bw=1022KiB/s (1046kB/s), 252KiB/s-277KiB/s (258kB/s-283kB/s), io=24.6MiB (25.8MB), run=23644-24659msec rand-rw: (groupid=0, jobs=1): err= 0: pid=145050: Mon Aug 31 14:48:26 2026 read: IOPS=5, BW=92.7KiB/s (94.9kB/s)(5920KiB/63883msec) clat (msec): min=7, max=239, avg=37.13, stdev=33.81 lat (msec): min=7, max=239, avg=37.13, stdev=33.81 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 17], | 30.00th=[ 19], 40.00th=[ 22], 50.00th=[ 26], 60.00th=[ 32], | 70.00th=[ 39], 80.00th=[ 47], 90.00th=[ 80], 95.00th=[ 106], | 99.00th=[ 182], 99.50th=[ 230], 99.90th=[ 241], 99.95th=[ 241], | 99.99th=[ 241] bw ( KiB/s): min= 30, max= 416, per=27.33%, avg=101.66, stdev=65.47, samples=114 iops : min= 1, max= 26, avg= 5.54, stdev= 4.14, samples=114 write: IOPS=6, BW=99.7KiB/s (102kB/s)(6368KiB/63883msec); 0 zone resets clat (msec): min=45, max=374, avg=125.77, stdev=50.37 lat (msec): min=45, max=374, avg=125.77, stdev=50.36 clat percentiles (msec): | 1.00th=[ 52], 5.00th=[ 66], 10.00th=[ 73], 20.00th=[ 83], | 30.00th=[ 93], 40.00th=[ 103], 50.00th=[ 114], 60.00th=[ 127], | 70.00th=[ 148], 80.00th=[ 167], 90.00th=[ 190], 95.00th=[ 215], | 99.00th=[ 288], 99.50th=[ 309], 99.90th=[ 376], 99.95th=[ 376], | 99.99th=[ 376] bw ( KiB/s): min= 24, max= 190, per=25.58%, avg=100.00, stdev=37.11, samples=125 iops : min= 1, max= 11, avg= 5.43, stdev= 2.34, samples=125 lat (msec) : 10=0.52%, 20=16.28%, 50=22.79%, 100=25.13%, 250=33.72% lat (msec) : 500=1.56% cpu : usr=0.05%, sys=1.47%, ctx=1347, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145051: Mon Aug 31 14:48:26 2026 read: IOPS=5, BW=89.2KiB/s (91.4kB/s)(5744KiB/64363msec) clat (msec): min=7, max=188, avg=36.84, stdev=31.51 lat (msec): min=7, max=188, avg=36.84, stdev=31.51 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 17], | 30.00th=[ 20], 40.00th=[ 23], 50.00th=[ 27], 60.00th=[ 32], | 70.00th=[ 39], 80.00th=[ 47], 90.00th=[ 72], 95.00th=[ 107], | 99.00th=[ 176], 99.50th=[ 186], 99.90th=[ 188], 99.95th=[ 188], | 99.99th=[ 188] bw ( KiB/s): min= 24, max= 416, per=26.24%, avg=97.63, stdev=61.36, samples=116 iops : min= 1, max= 26, avg= 5.28, stdev= 3.86, samples=116 write: IOPS=6, BW=102KiB/s (104kB/s)(6544KiB/64363msec); 0 zone resets clat (msec): min=39, max=411, avg=124.80, stdev=51.42 lat (msec): min=39, max=411, avg=124.80, stdev=51.42 clat percentiles (msec): | 1.00th=[ 54], 5.00th=[ 65], 10.00th=[ 72], 20.00th=[ 84], | 30.00th=[ 92], 40.00th=[ 104], 50.00th=[ 115], 60.00th=[ 125], | 70.00th=[ 138], 80.00th=[ 161], 90.00th=[ 199], 95.00th=[ 230], | 99.00th=[ 279], 99.50th=[ 292], 99.90th=[ 414], 99.95th=[ 414], | 99.99th=[ 414] bw ( KiB/s): min= 30, max= 191, per=26.12%, avg=102.14, stdev=38.02, samples=126 iops : min= 1, max= 11, avg= 5.56, stdev= 2.43, samples=126 lat (msec) : 10=1.17%, 20=13.28%, 50=23.96%, 100=25.78%, 250=34.38% lat (msec) : 500=1.43% cpu : usr=0.05%, sys=1.52%, ctx=1267, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145052: Mon Aug 31 14:48:26 2026 read: IOPS=6, BW=102KiB/s (104kB/s)(6256KiB/61498msec) clat (msec): min=6, max=221, avg=35.48, stdev=30.82 lat (msec): min=6, max=221, avg=35.49, stdev=30.82 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 17], | 30.00th=[ 20], 40.00th=[ 22], 50.00th=[ 26], 60.00th=[ 31], | 70.00th=[ 37], 80.00th=[ 46], 90.00th=[ 73], 95.00th=[ 94], | 99.00th=[ 184], 99.50th=[ 188], 99.90th=[ 222], 99.95th=[ 222], | 99.99th=[ 222] bw ( KiB/s): min= 30, max= 344, per=29.13%, avg=108.36, stdev=68.08, samples=114 iops : min= 1, max= 21, avg= 5.96, stdev= 4.28, samples=114 write: IOPS=6, BW=98.1KiB/s (100kB/s)(6032KiB/61498msec); 0 zone resets clat (msec): min=45, max=358, avg=126.13, stdev=52.34 lat (msec): min=45, max=358, avg=126.13, stdev=52.34 clat percentiles (msec): | 1.00th=[ 50], 5.00th=[ 64], 10.00th=[ 71], 20.00th=[ 85], | 30.00th=[ 94], 40.00th=[ 106], 50.00th=[ 114], 60.00th=[ 126], | 70.00th=[ 144], 80.00th=[ 165], 90.00th=[ 188], 95.00th=[ 220], | 99.00th=[ 305], 99.50th=[ 342], 99.90th=[ 359], 99.95th=[ 359], | 99.99th=[ 359] bw ( KiB/s): min= 31, max= 223, per=25.20%, avg=98.53, stdev=38.05, samples=120 iops : min= 1, max= 13, avg= 5.35, stdev= 2.40, samples=120 lat (msec) : 10=1.43%, 20=15.76%, 50=25.91%, 100=22.79%, 250=32.42% lat (msec) : 500=1.69% cpu : usr=0.05%, sys=1.53%, ctx=1367, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145053: Mon Aug 31 14:48:26 2026 read: IOPS=5, BW=94.1KiB/s (96.4kB/s)(6032KiB/64088msec) clat (msec): min=7, max=223, avg=37.07, stdev=31.22 lat (msec): min=7, max=223, avg=37.08, stdev=31.22 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 13], 20.00th=[ 18], | 30.00th=[ 21], 40.00th=[ 24], 50.00th=[ 28], 60.00th=[ 32], | 70.00th=[ 37], 80.00th=[ 48], 90.00th=[ 75], 95.00th=[ 100], | 99.00th=[ 180], 99.50th=[ 192], 99.90th=[ 224], 99.95th=[ 224], | 99.99th=[ 224] bw ( KiB/s): min= 30, max= 415, per=27.35%, avg=101.74, stdev=69.56, samples=115 iops : min= 1, max= 25, avg= 5.53, stdev= 4.37, samples=115 write: IOPS=6, BW=97.6KiB/s (99.0kB/s)(6256KiB/64088msec); 0 zone resets clat (msec): min=47, max=377, avg=127.92, stdev=50.22 lat (msec): min=47, max=377, avg=127.92, stdev=50.22 clat percentiles (msec): | 1.00th=[ 51], 5.00th=[ 64], 10.00th=[ 77], 20.00th=[ 90], | 30.00th=[ 97], 40.00th=[ 107], 50.00th=[ 117], 60.00th=[ 130], | 70.00th=[ 148], 80.00th=[ 163], 90.00th=[ 194], 95.00th=[ 224], | 99.00th=[ 300], 99.50th=[ 330], 99.90th=[ 376], 99.95th=[ 376], | 99.99th=[ 376] bw ( KiB/s): min= 31, max= 189, per=25.03%, avg=97.86, stdev=34.65, samples=125 iops : min= 1, max= 11, avg= 5.30, stdev= 2.23, samples=125 lat (msec) : 10=1.04%, 20=13.15%, 50=25.78%, 100=22.79%, 250=35.94% lat (msec) : 500=1.30% cpu : usr=0.05%, sys=1.42%, ctx=1350, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=372KiB/s (381kB/s), 89.2KiB/s-102KiB/s (91.4kB/s-104kB/s), io=23.4MiB (24.5MB), run=61498-64363msec WRITE: bw=392KiB/s (401kB/s), 97.6KiB/s-102KiB/s (99.0kB/s-104kB/s), io=24.6MiB (25.8MB), run=61498-64363msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=145068: Mon Aug 31 14:48:40 2026 read: IOPS=1, BW=1989KiB/s (2037kB/s)(7168KiB/3603msec) clat (usec): min=536, max=796879, avg=293032.53, stdev=248896.65 lat (usec): min=537, max=796880, avg=293033.75, stdev=248896.54 clat percentiles (usec): | 1.00th=[ 537], 5.00th=[ 537], 10.00th=[ 537], 20.00th=[168821], | 30.00th=[177210], 40.00th=[177210], 50.00th=[261096], 60.00th=[308282], | 70.00th=[308282], 80.00th=[337642], 90.00th=[792724], 95.00th=[792724], | 99.00th=[792724], 99.50th=[792724], 99.90th=[792724], 99.95th=[792724], | 99.99th=[792724] bw ( KiB/s): min= 1878, max= 3052, per=50.14%, avg=2192.00, stdev=484.23, samples=5 iops : min= 1, max= 2, avg= 1.20, stdev= 0.45, samples=5 write: IOPS=1, BW=1421KiB/s (1455kB/s)(5120KiB/3603msec); 0 zone resets clat (msec): min=139, max=367, avg=280.98, stdev=91.36 lat (msec): min=139, max=367, avg=281.37, stdev=91.38 clat percentiles (msec): | 1.00th=[ 140], 5.00th=[ 140], 10.00th=[ 140], 20.00th=[ 140], | 30.00th=[ 264], 40.00th=[ 264], 50.00th=[ 279], 60.00th=[ 279], | 70.00th=[ 355], 80.00th=[ 355], 90.00th=[ 368], 95.00th=[ 368], | 99.00th=[ 368], 99.50th=[ 368], 99.90th=[ 368], 99.95th=[ 368], | 99.99th=[ 368] bw ( KiB/s): min= 2011, max= 3828, per=42.81%, avg=2620.67, stdev=1045.60, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (usec) : 750=8.33% lat (msec) : 250=25.00%, 500=58.33%, 1000=8.33% cpu : usr=0.00%, sys=14.63%, ctx=206, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145069: Mon Aug 31 14:48:40 2026 read: IOPS=0, BW=481KiB/s (493kB/s)(2048KiB/4254msec) clat (usec): min=483, max=185735, avg=93109.62, stdev=130993.44 lat (usec): min=484, max=185738, avg=93111.42, stdev=130994.40 clat percentiles (usec): | 1.00th=[ 482], 5.00th=[ 482], 10.00th=[ 482], 20.00th=[ 482], | 30.00th=[ 482], 40.00th=[ 482], 50.00th=[ 482], 60.00th=[185598], | 70.00th=[185598], 80.00th=[185598], 90.00th=[185598], 95.00th=[185598], | 99.00th=[185598], 99.50th=[185598], 99.90th=[185598], 99.95th=[185598], | 99.99th=[185598] bw ( KiB/s): min= 1505, max= 1914, per=39.10%, avg=1709.50, stdev=289.21, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2407KiB/s (2465kB/s)(10.0MiB/4254msec); 0 zone resets clat (msec): min=136, max=793, avg=402.70, stdev=233.70 lat (msec): min=136, max=793, avg=402.94, stdev=233.82 clat percentiles (msec): | 1.00th=[ 136], 5.00th=[ 136], 10.00th=[ 136], 20.00th=[ 192], | 30.00th=[ 197], 40.00th=[ 205], 50.00th=[ 313], 60.00th=[ 363], | 70.00th=[ 584], 80.00th=[ 600], 90.00th=[ 651], 95.00th=[ 793], | 99.00th=[ 793], 99.50th=[ 793], 99.90th=[ 793], 99.95th=[ 793], | 99.99th=[ 793] bw ( KiB/s): min= 1914, max= 6035, per=51.38%, avg=3145.00, stdev=1790.33, samples=5 iops : min= 1, max= 5, avg= 2.20, stdev= 1.79, samples=5 lat (usec) : 500=8.33% lat (msec) : 250=41.67%, 500=16.67%, 750=25.00%, 1000=8.33% cpu : usr=0.05%, sys=13.31%, ctx=145, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145070: Mon Aug 31 14:48:40 2026 read: IOPS=1, BW=1312KiB/s (1343kB/s)(6144KiB/4684msec) clat (msec): min=5, max=743, avg=273.02, stdev=281.39 lat (msec): min=5, max=743, avg=273.02, stdev=281.39 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 6], 10.00th=[ 6], 20.00th=[ 7], | 30.00th=[ 7], 40.00th=[ 155], 50.00th=[ 155], 60.00th=[ 338], | 70.00th=[ 393], 80.00th=[ 393], 90.00th=[ 743], 95.00th=[ 743], | 99.00th=[ 743], 99.50th=[ 743], 99.90th=[ 743], 99.95th=[ 743], | 99.99th=[ 743] bw ( KiB/s): min= 2048, max= 4023, per=74.93%, avg=3276.00, stdev=1071.76, samples=3 iops : min= 2, max= 3, avg= 2.67, stdev= 0.58, samples=3 write: IOPS=1, BW=1312KiB/s (1343kB/s)(6144KiB/4684msec); 0 zone resets clat (msec): min=175, max=730, avg=490.03, stdev=222.82 lat (msec): min=177, max=730, avg=490.35, stdev=222.40 clat percentiles (msec): | 1.00th=[ 176], 5.00th=[ 176], 10.00th=[ 176], 20.00th=[ 279], | 30.00th=[ 279], 40.00th=[ 468], 50.00th=[ 468], 60.00th=[ 625], | 70.00th=[ 659], 80.00th=[ 659], 90.00th=[ 735], 95.00th=[ 735], | 99.00th=[ 735], 99.50th=[ 735], 99.90th=[ 735], 99.95th=[ 735], | 99.99th=[ 735] bw ( KiB/s): min= 1537, max= 2048, per=31.10%, avg=1903.60, stdev=211.04, samples=5 iops : min= 1, max= 2, avg= 1.20, stdev= 0.45, samples=5 lat (msec) : 10=16.67%, 250=16.67%, 500=33.33%, 750=33.33% cpu : usr=0.00%, sys=8.29%, ctx=118, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145071: Mon Aug 31 14:48:40 2026 read: IOPS=1, BW=1357KiB/s (1390kB/s)(5120KiB/3772msec) clat (usec): min=383, max=655272, avg=212574.91, stdev=303496.50 lat (usec): min=384, max=655273, avg=212575.87, stdev=303496.56 clat percentiles (usec): | 1.00th=[ 383], 5.00th=[ 383], 10.00th=[ 383], 20.00th=[ 383], | 30.00th=[ 441], 40.00th=[ 441], 50.00th=[ 578], 60.00th=[ 578], | 70.00th=[404751], 80.00th=[404751], 90.00th=[658506], 95.00th=[658506], | 99.00th=[658506], 99.50th=[658506], 99.90th=[658506], 99.95th=[658506], | 99.99th=[658506] bw ( KiB/s): min= 1914, max= 6035, per=90.91%, avg=3974.50, stdev=2913.99, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 write: IOPS=1, BW=1900KiB/s (1946kB/s)(7168KiB/3772msec); 0 zone resets clat (msec): min=181, max=528, avg=370.99, stdev=122.21 lat (msec): min=182, max=528, avg=371.25, stdev=121.93 clat percentiles (msec): | 1.00th=[ 182], 5.00th=[ 182], 10.00th=[ 182], 20.00th=[ 292], | 30.00th=[ 317], 40.00th=[ 317], 50.00th=[ 368], 60.00th=[ 401], | 70.00th=[ 401], 80.00th=[ 510], 90.00th=[ 527], 95.00th=[ 527], | 99.00th=[ 527], 99.50th=[ 527], 99.90th=[ 527], 99.95th=[ 527], | 99.99th=[ 527] bw ( KiB/s): min= 1535, max= 2023, per=30.85%, avg=1888.60, stdev=205.99, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 lat (usec) : 500=16.67%, 750=8.33% lat (msec) : 250=8.33%, 500=41.67%, 750=25.00% cpu : usr=0.03%, sys=13.52%, ctx=153, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4372KiB/s (4477kB/s), 481KiB/s-1989KiB/s (493kB/s-2037kB/s), io=20.0MiB (20.0MB), run=3603-4684msec WRITE: bw=6121KiB/s (6268kB/s), 1312KiB/s-2407KiB/s (1343kB/s-2465kB/s), io=28.0MiB (29.4MB), run=3603-4684msec rand-rw: (groupid=0, jobs=1): err= 0: pid=145073: Mon Aug 31 14:48:41 2026 read: IOPS=1, BW=1559KiB/s (1596kB/s)(7168KiB/4598msec) clat (msec): min=94, max=805, avg=269.56, stdev=245.35 lat (msec): min=94, max=805, avg=269.56, stdev=245.35 clat percentiles (msec): | 1.00th=[ 95], 5.00th=[ 95], 10.00th=[ 95], 20.00th=[ 105], | 30.00th=[ 184], 40.00th=[ 184], 50.00th=[ 186], 60.00th=[ 239], | 70.00th=[ 239], 80.00th=[ 275], 90.00th=[ 810], 95.00th=[ 810], | 99.00th=[ 810], 99.50th=[ 810], 99.90th=[ 810], 99.95th=[ 810], | 99.99th=[ 810] bw ( KiB/s): min= 1381, max= 2023, per=44.72%, avg=1861.60, stdev=271.57, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 write: IOPS=1, BW=1114KiB/s (1140kB/s)(5120KiB/4598msec); 0 zone resets clat (msec): min=126, max=1144, avg=513.06, stdev=382.00 lat (msec): min=126, max=1144, avg=513.33, stdev=381.99 clat percentiles (msec): | 1.00th=[ 128], 5.00th=[ 128], 10.00th=[ 128], 20.00th=[ 128], | 30.00th=[ 334], 40.00th=[ 334], 50.00th=[ 460], 60.00th=[ 460], | 70.00th=[ 502], 80.00th=[ 502], 90.00th=[ 1150], 95.00th=[ 1150], | 99.00th=[ 1150], 99.50th=[ 1150], 99.90th=[ 1150], 99.95th=[ 1150], | 99.99th=[ 1150] bw ( KiB/s): min= 1935, max= 4087, per=45.99%, avg=2680.33, stdev=1218.93, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (msec) : 100=8.33%, 250=41.67%, 500=25.00%, 750=8.33%, 1000=8.33% lat (msec) : 2000=8.33% cpu : usr=0.00%, sys=3.92%, ctx=78, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145074: Mon Aug 31 14:48:41 2026 read: IOPS=0, BW=423KiB/s (433kB/s)(2048KiB/4844msec) clat (msec): min=173, max=395, avg=284.53, stdev=157.38 lat (msec): min=173, max=395, avg=284.53, stdev=157.38 clat percentiles (msec): | 1.00th=[ 174], 5.00th=[ 174], 10.00th=[ 174], 20.00th=[ 174], | 30.00th=[ 174], 40.00th=[ 174], 50.00th=[ 174], 60.00th=[ 397], | 70.00th=[ 397], 80.00th=[ 397], 90.00th=[ 397], 95.00th=[ 397], | 99.00th=[ 397], 99.50th=[ 397], 99.90th=[ 397], 99.95th=[ 397], | 99.99th=[ 397] bw ( KiB/s): min= 1490, max= 2043, per=42.43%, avg=1766.50, stdev=391.03, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2114KiB/s (2165kB/s)(10.0MiB/4844msec); 0 zone resets clat (msec): min=180, max=1405, avg=411.03, stdev=369.88 lat (msec): min=180, max=1405, avg=411.18, stdev=369.83 clat percentiles (msec): | 1.00th=[ 182], 5.00th=[ 182], 10.00th=[ 182], 20.00th=[ 186], | 30.00th=[ 218], 40.00th=[ 257], 50.00th=[ 262], 60.00th=[ 266], | 70.00th=[ 351], 80.00th=[ 405], 90.00th=[ 584], 95.00th=[ 1401], | 99.00th=[ 1401], 99.50th=[ 1401], 99.90th=[ 1401], 99.95th=[ 1401], | 99.99th=[ 1401] bw ( KiB/s): min= 1950, max= 4087, per=51.86%, avg=3022.17, stdev=1126.04, samples=6 iops : min= 1, max= 3, avg= 2.00, stdev= 1.10, samples=6 lat (msec) : 250=33.33%, 500=50.00%, 750=8.33%, 2000=8.33% cpu : usr=0.02%, sys=4.15%, ctx=80, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145075: Mon Aug 31 14:48:41 2026 read: IOPS=1, BW=1361KiB/s (1394kB/s)(6144KiB/4514msec) clat (msec): min=95, max=250, avg=186.66, stdev=61.62 lat (msec): min=95, max=250, avg=186.66, stdev=61.62 clat percentiles (msec): | 1.00th=[ 96], 5.00th=[ 96], 10.00th=[ 96], 20.00th=[ 130], | 30.00th=[ 130], 40.00th=[ 188], 50.00th=[ 188], 60.00th=[ 228], | 70.00th=[ 228], 80.00th=[ 228], 90.00th=[ 251], 95.00th=[ 251], | 99.00th=[ 251], 99.50th=[ 251], 99.90th=[ 251], 99.95th=[ 251], | 99.99th=[ 251] bw ( KiB/s): min= 1935, max= 4087, per=60.41%, avg=2515.00, stdev=1048.75, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 write: IOPS=1, BW=1361KiB/s (1394kB/s)(6144KiB/4514msec); 0 zone resets clat (msec): min=207, max=1053, avg=542.09, stdev=324.72 lat (msec): min=207, max=1053, avg=542.20, stdev=324.73 clat percentiles (msec): | 1.00th=[ 209], 5.00th=[ 209], 10.00th=[ 209], 20.00th=[ 271], | 30.00th=[ 271], 40.00th=[ 368], 50.00th=[ 368], 60.00th=[ 584], | 70.00th=[ 760], 80.00th=[ 760], 90.00th=[ 1053], 95.00th=[ 1053], | 99.00th=[ 1053], 99.50th=[ 1053], 99.90th=[ 1053], 99.95th=[ 1053], | 99.99th=[ 1053] bw ( KiB/s): min= 1398, max= 2023, per=32.24%, avg=1878.80, stdev=271.31, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 lat (msec) : 100=8.33%, 250=41.67%, 500=25.00%, 750=8.33%, 1000=8.33% lat (msec) : 2000=8.33% cpu : usr=0.04%, sys=4.61%, ctx=85, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145076: Mon Aug 31 14:48:41 2026 read: IOPS=1, BW=1041KiB/s (1066kB/s)(5120KiB/4919msec) clat (msec): min=76, max=448, avg=173.99, stdev=154.15 lat (msec): min=76, max=448, avg=174.00, stdev=154.15 clat percentiles (msec): | 1.00th=[ 78], 5.00th=[ 78], 10.00th=[ 78], 20.00th=[ 78], | 30.00th=[ 109], 40.00th=[ 109], 50.00th=[ 117], 60.00th=[ 117], | 70.00th=[ 121], 80.00th=[ 121], 90.00th=[ 447], 95.00th=[ 447], | 99.00th=[ 447], 99.50th=[ 447], 99.90th=[ 447], 99.95th=[ 447], | 99.99th=[ 447] bw ( KiB/s): min= 2019, max= 4087, per=65.06%, avg=2708.33, stdev=1193.96, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 write: IOPS=1, BW=1457KiB/s (1492kB/s)(7168KiB/4919msec); 0 zone resets clat (msec): min=202, max=1246, avg=563.71, stdev=362.45 lat (msec): min=202, max=1246, avg=563.80, stdev=362.44 clat percentiles (msec): | 1.00th=[ 203], 5.00th=[ 203], 10.00th=[ 203], 20.00th=[ 296], | 30.00th=[ 422], 40.00th=[ 422], 50.00th=[ 439], 60.00th=[ 502], | 70.00th=[ 502], 80.00th=[ 844], 90.00th=[ 1250], 95.00th=[ 1250], | 99.00th=[ 1250], 99.50th=[ 1250], 99.90th=[ 1250], 99.95th=[ 1250], | 99.99th=[ 1250] bw ( KiB/s): min= 1486, max= 2023, per=32.87%, avg=1915.50, stdev=213.05, samples=6 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=6 lat (msec) : 100=8.33%, 250=33.33%, 500=33.33%, 750=8.33%, 1000=8.33% lat (msec) : 2000=8.33% cpu : usr=0.00%, sys=2.38%, ctx=65, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4163KiB/s (4263kB/s), 423KiB/s-1559KiB/s (433kB/s-1596kB/s), io=20.0MiB (20.0MB), run=4514-4919msec WRITE: bw=5829KiB/s (5969kB/s), 1114KiB/s-2114KiB/s (1140kB/s-2165kB/s), io=28.0MiB (29.4MB), run=4514-4919msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=145083: Mon Aug 31 14:48:56 2026 read: IOPS=1, BW=4181KiB/s (4281kB/s)(12.0MiB/2939msec) clat (msec): min=858, max=1080, avg=945.18, stdev=119.13 lat (msec): min=858, max=1080, avg=945.18, stdev=119.13 clat percentiles (msec): | 1.00th=[ 860], 5.00th=[ 860], 10.00th=[ 860], 20.00th=[ 860], | 30.00th=[ 860], 40.00th=[ 894], 50.00th=[ 894], 60.00th=[ 894], | 70.00th=[ 1083], 80.00th=[ 1083], 90.00th=[ 1083], 95.00th=[ 1083], | 99.00th=[ 1083], 99.50th=[ 1083], 99.90th=[ 1083], 99.95th=[ 1083], | 99.99th=[ 1083] bw ( KiB/s): min= 8175, max= 8192, per=100.00%, avg=8183.50, stdev=12.02, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 1000=66.67%, 2000=33.33% cpu : usr=0.00%, sys=3.71%, ctx=50, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145084: Mon Aug 31 14:48:56 2026 read: IOPS=0, BW=2343KiB/s (2399kB/s)(4096KiB/1748msec) clat (nsec): min=234024k, max=234024k, avg=234024384.00, stdev= 0.00 lat (nsec): min=234045k, max=234045k, avg=234044512.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 234], 5.00th=[ 234], 10.00th=[ 234], 20.00th=[ 234], | 30.00th=[ 234], 40.00th=[ 234], 50.00th=[ 234], 60.00th=[ 234], | 70.00th=[ 234], 80.00th=[ 234], 90.00th=[ 234], 95.00th=[ 234], | 99.00th=[ 234], 99.50th=[ 234], 99.90th=[ 234], 99.95th=[ 234], | 99.99th=[ 234] bw ( KiB/s): min= 6627, max= 6627, per=100.00%, avg=6627.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=1, BW=4686KiB/s (4799kB/s)(8192KiB/1748msec); 0 zone resets clat (msec): min=658, max=696, avg=677.51, stdev=27.26 lat (msec): min=658, max=697, avg=677.88, stdev=27.22 clat percentiles (msec): | 1.00th=[ 659], 5.00th=[ 659], 10.00th=[ 659], 20.00th=[ 659], | 30.00th=[ 659], 40.00th=[ 659], 50.00th=[ 659], 60.00th=[ 701], | 70.00th=[ 701], 80.00th=[ 701], 90.00th=[ 701], 95.00th=[ 701], | 99.00th=[ 701], 99.50th=[ 701], 99.90th=[ 701], 99.95th=[ 701], | 99.99th=[ 701] bw ( KiB/s): min= 8192, max= 8192, per=96.29%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 750=66.67% cpu : usr=0.00%, sys=7.56%, ctx=76, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145086: Mon Aug 31 14:48:56 2026 write: IOPS=0, BW=3191KiB/s (3267kB/s)(12.0MiB/3851msec); 0 zone resets clat (msec): min=336, max=1747, avg=1253.21, stdev=794.86 lat (msec): min=337, max=1747, avg=1253.71, stdev=794.61 clat percentiles (msec): | 1.00th=[ 338], 5.00th=[ 338], 10.00th=[ 338], 20.00th=[ 338], | 30.00th=[ 338], 40.00th=[ 1670], 50.00th=[ 1670], 60.00th=[ 1670], | 70.00th=[ 1754], 80.00th=[ 1754], 90.00th=[ 1754], 95.00th=[ 1754], | 99.00th=[ 1754], 99.50th=[ 1754], 99.90th=[ 1754], 99.95th=[ 1754], | 99.99th=[ 1754] bw ( KiB/s): min= 8000, max= 8192, per=95.16%, avg=8096.00, stdev=135.76, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.00%, sys=4.34%, ctx=72, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145087: Mon Aug 31 14:48:56 2026 write: IOPS=1, BW=5111KiB/s (5234kB/s)(12.0MiB/2404msec); 0 zone resets clat (msec): min=361, max=1449, avg=758.08, stdev=601.13 lat (msec): min=361, max=1450, avg=758.46, stdev=601.13 clat percentiles (msec): | 1.00th=[ 363], 5.00th=[ 363], 10.00th=[ 363], 20.00th=[ 363], | 30.00th=[ 363], 40.00th=[ 464], 50.00th=[ 464], 60.00th=[ 464], | 70.00th=[ 1452], 80.00th=[ 1452], 90.00th=[ 1452], 95.00th=[ 1452], | 99.00th=[ 1452], 99.50th=[ 1452], 99.90th=[ 1452], 99.95th=[ 1452], | 99.99th=[ 1452] bw ( KiB/s): min=16384, max=16384, per=100.00%, avg=16384.00, stdev= 0.00, samples=1 iops : min= 4, max= 4, avg= 4.00, stdev= 0.00, samples=1 lat (msec) : 500=66.67%, 2000=33.33% cpu : usr=0.00%, sys=5.87%, ctx=53, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5575KiB/s (5708kB/s), 2343KiB/s-4181KiB/s (2399kB/s-4281kB/s), io=16.0MiB (16.8MB), run=1748-2939msec WRITE: bw=8509KiB/s (8713kB/s), 3191KiB/s-5111KiB/s (3267kB/s-5234kB/s), io=32.0MiB (33.6MB), run=1748-3851msec rand-rw: (groupid=0, jobs=1): err= 0: pid=145088: Mon Aug 31 14:48:56 2026 read: IOPS=1, BW=4632KiB/s (4743kB/s)(12.0MiB/2653msec) clat (msec): min=712, max=890, avg=818.45, stdev=93.57 lat (msec): min=712, max=890, avg=818.45, stdev=93.57 clat percentiles (msec): | 1.00th=[ 709], 5.00th=[ 709], 10.00th=[ 709], 20.00th=[ 709], | 30.00th=[ 709], 40.00th=[ 852], 50.00th=[ 852], 60.00th=[ 852], | 70.00th=[ 894], 80.00th=[ 894], 90.00th=[ 894], 95.00th=[ 894], | 99.00th=[ 894], 99.50th=[ 894], 99.90th=[ 894], 99.95th=[ 894], | 99.99th=[ 894] bw ( KiB/s): min= 8143, max= 8175, per=100.00%, avg=8159.00, stdev=22.63, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 1000=66.67% cpu : usr=0.00%, sys=15.31%, ctx=308, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145089: Mon Aug 31 14:48:56 2026 read: IOPS=0, BW=1359KiB/s (1391kB/s)(4096KiB/3015msec) clat (nsec): min=729144k, max=729144k, avg=729143611.00, stdev= 0.00 lat (nsec): min=729146k, max=729146k, avg=729145976.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 726], 5.00th=[ 726], 10.00th=[ 726], 20.00th=[ 726], | 30.00th=[ 726], 40.00th=[ 726], 50.00th=[ 726], 60.00th=[ 726], | 70.00th=[ 726], 80.00th=[ 726], 90.00th=[ 726], 95.00th=[ 726], | 99.00th=[ 726], 99.50th=[ 726], 99.90th=[ 726], 99.95th=[ 726], | 99.99th=[ 726] bw ( KiB/s): min= 8175, max= 8175, per=100.00%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2717KiB/s (2782kB/s)(8192KiB/3015msec); 0 zone resets clat (msec): min=766, max=1386, avg=1076.20, stdev=438.41 lat (msec): min=766, max=1386, avg=1076.49, stdev=438.33 clat percentiles (msec): | 1.00th=[ 768], 5.00th=[ 768], 10.00th=[ 768], 20.00th=[ 768], | 30.00th=[ 768], 40.00th=[ 768], 50.00th=[ 768], 60.00th=[ 1385], | 70.00th=[ 1385], 80.00th=[ 1385], 90.00th=[ 1385], 95.00th=[ 1385], | 99.00th=[ 1385], 99.50th=[ 1385], 99.90th=[ 1385], 99.95th=[ 1385], | 99.99th=[ 1385] bw ( KiB/s): min= 7968, max= 7968, per=98.83%, avg=7968.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=4.91%, ctx=130, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145090: Mon Aug 31 14:48:56 2026 write: IOPS=0, BW=3024KiB/s (3096kB/s)(12.0MiB/4064msec); 0 zone resets clat (msec): min=286, max=1924, avg=1335.17, stdev=910.56 lat (msec): min=286, max=1925, avg=1336.08, stdev=910.91 clat percentiles (msec): | 1.00th=[ 288], 5.00th=[ 288], 10.00th=[ 288], 20.00th=[ 288], | 30.00th=[ 288], 40.00th=[ 1787], 50.00th=[ 1787], 60.00th=[ 1787], | 70.00th=[ 1921], 80.00th=[ 1921], 90.00th=[ 1921], 95.00th=[ 1921], | 99.00th=[ 1921], 99.50th=[ 1921], 99.90th=[ 1921], 99.95th=[ 1921], | 99.99th=[ 1921] bw ( KiB/s): min= 8175, max= 8175, per=100.00%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.00%, sys=2.71%, ctx=45, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145091: Mon Aug 31 14:48:56 2026 write: IOPS=1, BW=4125KiB/s (4224kB/s)(12.0MiB/2979msec); 0 zone resets clat (msec): min=466, max=1304, avg=921.82, stdev=423.61 lat (msec): min=467, max=1307, avg=923.35, stdev=424.56 clat percentiles (msec): | 1.00th=[ 468], 5.00th=[ 468], 10.00th=[ 468], 20.00th=[ 468], | 30.00th=[ 468], 40.00th=[ 995], 50.00th=[ 995], 60.00th=[ 995], | 70.00th=[ 1301], 80.00th=[ 1301], 90.00th=[ 1301], 95.00th=[ 1301], | 99.00th=[ 1301], 99.50th=[ 1301], 99.90th=[ 1301], 99.95th=[ 1301], | 99.99th=[ 1301] bw ( KiB/s): min= 7968, max= 8175, per=100.00%, avg=8071.50, stdev=146.37, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=5.81%, ctx=65, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5434KiB/s (5565kB/s), 1359KiB/s-4632KiB/s (1391kB/s-4743kB/s), io=16.0MiB (16.8MB), run=2653-3015msec WRITE: bw=8063KiB/s (8257kB/s), 2717KiB/s-4125KiB/s (2782kB/s-4224kB/s), io=32.0MiB (33.6MB), run=2979-4064msec