== sanity test 398b: DIO and buffer IO race ============== 22:45:10 (1788749110) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 4.65311 s, 10.8 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144925: Sun Sep 6 22:47:01 2026 read: IOPS=15, BW=61.0KiB/s (63.5kB/s)(5992KiB/96683msec) clat (usec): min=33, max=338419, avg=31119.30, stdev=24635.99 lat (usec): min=33, max=338420, avg=31121.03, stdev=24635.88 clat percentiles (usec): | 1.00th=[ 50], 5.00th=[ 63], 10.00th=[ 113], 20.00th=[ 14222], | 30.00th=[ 18482], 40.00th=[ 22414], 50.00th=[ 26084], 60.00th=[ 31851], | 70.00th=[ 38536], 80.00th=[ 46924], 90.00th=[ 59507], 95.00th=[ 71828], | 99.00th=[102237], 99.50th=[135267], 99.90th=[208667], 99.95th=[337642], | 99.99th=[337642] bw ( KiB/s): min= 7, max= 152, per=25.24%, avg=61.84, stdev=22.74, samples=190 iops : min= 1, max= 38, avg=14.84, stdev= 5.75, samples=190 write: IOPS=16, BW=65.1KiB/s (66.7kB/s)(6296KiB/96683msec); 0 zone resets clat (usec): min=791, max=509353, avg=31616.09, stdev=33003.60 lat (usec): min=792, max=509354, avg=31618.16, stdev=33003.51 clat percentiles (usec): | 1.00th=[ 1074], 5.00th=[ 1319], 10.00th=[ 1942], 20.00th=[ 3752], | 30.00th=[ 7111], 40.00th=[ 16319], 50.00th=[ 23200], 60.00th=[ 31851], | 70.00th=[ 41681], 80.00th=[ 54264], 90.00th=[ 74974], 95.00th=[ 87557], | 99.00th=[130548], 99.50th=[143655], 99.90th=[291505], 99.95th=[509608], | 99.99th=[509608] bw ( KiB/s): min= 15, max= 135, per=25.29%, avg=64.99, stdev=23.10, samples=190 iops : min= 3, max= 33, avg=15.64, stdev= 5.83, samples=190 lat (usec) : 50=0.49%, 100=4.17%, 250=0.72%, 500=0.13%, 750=0.03% lat (usec) : 1000=0.26% lat (msec) : 2=5.24%, 4=5.60%, 10=7.29%, 20=16.21%, 50=39.58% lat (msec) : 100=18.39%, 250=1.79%, 500=0.07%, 750=0.03% cpu : usr=0.10%, sys=7.42%, ctx=6827, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144926: Sun Sep 6 22:47:01 2026 read: IOPS=15, BW=61.5KiB/s (62.9kB/s)(5940KiB/96633msec) clat (usec): min=26, max=342173, avg=31390.71, stdev=25383.11 lat (usec): min=27, max=342174, avg=31394.05, stdev=25383.33 clat percentiles (usec): | 1.00th=[ 49], 5.00th=[ 69], 10.00th=[ 143], 20.00th=[ 14091], | 30.00th=[ 17957], 40.00th=[ 21890], 50.00th=[ 26346], 60.00th=[ 31327], | 70.00th=[ 38011], 80.00th=[ 46924], 90.00th=[ 61080], 95.00th=[ 74974], | 99.00th=[114820], 99.50th=[135267], 99.90th=[179307], 99.95th=[341836], | 99.99th=[341836] bw ( KiB/s): min= 6, max= 127, per=24.90%, avg=61.02, stdev=22.10, samples=191 iops : min= 1, max= 31, avg=14.63, stdev= 5.55, samples=191 write: IOPS=16, BW=65.7KiB/s (67.3kB/s)(6348KiB/96633msec); 0 zone resets clat (usec): min=804, max=561885, avg=31310.63, stdev=33208.45 lat (usec): min=806, max=561887, avg=31313.69, stdev=33208.78 clat percentiles (usec): | 1.00th=[ 1057], 5.00th=[ 1270], 10.00th=[ 1729], 20.00th=[ 3818], | 30.00th=[ 7242], 40.00th=[ 15664], 50.00th=[ 23200], 60.00th=[ 31327], | 70.00th=[ 41681], 80.00th=[ 54264], 90.00th=[ 71828], 95.00th=[ 91751], | 99.00th=[130548], 99.50th=[160433], 99.90th=[261096], 99.95th=[557843], | 99.99th=[557843] bw ( KiB/s): min= 6, max= 143, per=25.31%, avg=65.05, stdev=24.83, samples=191 iops : min= 1, max= 35, avg=15.65, stdev= 6.23, samples=191 lat (usec) : 50=0.59%, 100=3.58%, 250=0.91%, 500=0.13%, 750=0.07% lat (usec) : 1000=0.33% lat (msec) : 2=6.09%, 4=4.52%, 10=8.33%, 20=16.18%, 50=39.19% lat (msec) : 100=17.42%, 250=2.57%, 500=0.07%, 750=0.03% cpu : usr=0.09%, sys=7.47%, ctx=6913, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144927: Sun Sep 6 22:47:01 2026 read: IOPS=15, BW=62.0KiB/s (63.5kB/s)(6028KiB/97173msec) clat (usec): min=35, max=185407, avg=30100.20, stdev=21849.60 lat (usec): min=35, max=185408, avg=30102.09, stdev=21849.67 clat percentiles (usec): | 1.00th=[ 49], 5.00th=[ 66], 10.00th=[ 141], 20.00th=[ 13960], | 30.00th=[ 17695], 40.00th=[ 21890], 50.00th=[ 25560], 60.00th=[ 31589], | 70.00th=[ 38011], 80.00th=[ 45351], 90.00th=[ 57934], 95.00th=[ 67634], | 99.00th=[ 95945], 99.50th=[120062], 99.90th=[170918], 99.95th=[185598], | 99.99th=[185598] bw ( KiB/s): min= 15, max= 126, per=25.57%, avg=62.64, stdev=23.68, samples=189 iops : min= 3, max= 31, avg=15.04, stdev= 5.99, samples=189 write: IOPS=16, BW=64.4KiB/s (65.0kB/s)(6260KiB/97173msec); 0 zone resets clat (usec): min=776, max=647787, avg=32824.21, stdev=35967.21 lat (usec): min=777, max=647790, avg=32826.20, stdev=35967.23 clat percentiles (usec): | 1.00th=[ 1057], 5.00th=[ 1352], 10.00th=[ 1795], 20.00th=[ 3720], | 30.00th=[ 7177], 40.00th=[ 17171], 50.00th=[ 25297], 60.00th=[ 33817], | 70.00th=[ 43254], 80.00th=[ 54264], 90.00th=[ 73925], 95.00th=[ 90702], | 99.00th=[158335], 99.50th=[183501], 99.90th=[256902], 99.95th=[650118], | 99.99th=[650118] bw ( KiB/s): min= 15, max= 142, per=25.02%, avg=64.31, stdev=23.64, samples=191 iops : min= 3, max= 35, avg=15.46, stdev= 5.93, samples=191 lat (usec) : 50=0.72%, 100=3.42%, 250=1.11%, 500=0.16%, 750=0.03% lat (usec) : 1000=0.23% lat (msec) : 2=5.76%, 4=4.69%, 10=7.75%, 20=15.85%, 50=40.59% lat (msec) : 100=17.48%, 250=2.12%, 500=0.07%, 750=0.03% cpu : usr=0.10%, sys=7.27%, ctx=6835, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144928: Sun Sep 6 22:47:01 2026 read: IOPS=15, BW=61.9KiB/s (63.4kB/s)(6052KiB/97810msec) clat (usec): min=33, max=227044, avg=30127.49, stdev=23107.31 lat (usec): min=34, max=227045, avg=30129.34, stdev=23107.34 clat percentiles (usec): | 1.00th=[ 45], 5.00th=[ 63], 10.00th=[ 86], 20.00th=[ 13698], | 30.00th=[ 17957], 40.00th=[ 21627], 50.00th=[ 25560], 60.00th=[ 31065], | 70.00th=[ 36963], 80.00th=[ 46400], 90.00th=[ 59507], 95.00th=[ 70779], | 99.00th=[107480], 99.50th=[119014], 99.90th=[170918], 99.95th=[227541], | 99.99th=[227541] bw ( KiB/s): min= 15, max= 135, per=25.30%, avg=61.99, stdev=23.77, samples=190 iops : min= 3, max= 33, avg=14.88, stdev= 6.00, samples=190 write: IOPS=15, BW=63.8KiB/s (65.3kB/s)(6236KiB/97810msec); 0 zone resets clat (usec): min=677, max=696967, avg=33261.93, stdev=37071.44 lat (usec): min=678, max=696971, avg=33264.64, stdev=37071.05 clat percentiles (usec): | 1.00th=[ 1029], 5.00th=[ 1270], 10.00th=[ 1614], 20.00th=[ 3720], | 30.00th=[ 7373], 40.00th=[ 17695], 50.00th=[ 25297], 60.00th=[ 34341], | 70.00th=[ 43254], 80.00th=[ 56361], 90.00th=[ 73925], 95.00th=[ 91751], | 99.00th=[154141], 99.50th=[177210], 99.90th=[316670], 99.95th=[700449], | 99.99th=[700449] bw ( KiB/s): min= 15, max= 143, per=24.65%, avg=63.35, stdev=22.97, samples=192 iops : min= 3, max= 35, avg=15.22, stdev= 5.79, samples=192 lat (usec) : 50=0.78%, 100=4.88%, 250=0.52%, 500=0.03%, 750=0.13% lat (usec) : 1000=0.29% lat (msec) : 2=6.51%, 4=3.74%, 10=7.36%, 20=15.20%, 50=40.01% lat (msec) : 100=18.00%, 250=2.47%, 500=0.03%, 750=0.03% cpu : usr=0.11%, sys=7.43%, ctx=6810, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=245KiB/s (251kB/s), 61.5KiB/s-62.0KiB/s (62.9kB/s-63.5kB/s), io=23.4MiB (24.6MB), run=96633-97810msec WRITE: bw=257KiB/s (263kB/s), 63.8KiB/s-65.7KiB/s (65.3kB/s-67.3kB/s), io=24.6MiB (25.7MB), run=96633-97810msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144920: Sun Sep 6 22:48:29 2026 read: IOPS=8, BW=32.7KiB/s (33.4kB/s)(5992KiB/183510msec) clat (msec): min=4, max=568, avg=25.63, stdev=30.33 lat (msec): min=4, max=568, avg=25.63, stdev=30.33 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 8], 10.00th=[ 8], 20.00th=[ 10], | 30.00th=[ 12], 40.00th=[ 13], 50.00th=[ 15], 60.00th=[ 18], | 70.00th=[ 23], 80.00th=[ 35], 90.00th=[ 60], 95.00th=[ 79], | 99.00th=[ 134], 99.50th=[ 165], 99.90th=[ 326], 99.95th=[ 567], | 99.99th=[ 567] bw ( KiB/s): min= 7, max= 120, per=26.41%, avg=34.06, stdev=23.40, samples=344 iops : min= 1, max= 30, avg= 7.94, stdev= 5.93, samples=344 write: IOPS=8, BW=34.3KiB/s (35.1kB/s)(6296KiB/183510msec); 0 zone resets clat (msec): min=25, max=447, avg=91.96, stdev=49.21 lat (msec): min=25, max=447, avg=91.96, stdev=49.21 clat percentiles (msec): | 1.00th=[ 33], 5.00th=[ 40], 10.00th=[ 46], 20.00th=[ 54], | 30.00th=[ 62], 40.00th=[ 68], 50.00th=[ 77], 60.00th=[ 87], | 70.00th=[ 106], 80.00th=[ 129], 90.00th=[ 163], 95.00th=[ 190], | 99.00th=[ 255], 99.50th=[ 279], 99.90th=[ 351], 99.95th=[ 447], | 99.99th=[ 447] bw ( KiB/s): min= 7, max= 88, per=25.28%, avg=34.13, stdev=17.00, samples=360 iops : min= 1, max= 22, avg= 7.96, stdev= 4.34, samples=360 lat (msec) : 10=11.39%, 20=20.44%, 50=17.97%, 100=32.39%, 250=17.12% lat (msec) : 500=0.65%, 750=0.03% cpu : usr=0.06%, sys=1.68%, ctx=5385, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144922: Sun Sep 6 22:48:29 2026 read: IOPS=7, BW=31.0KiB/s (32.8kB/s)(5940KiB/185695msec) clat (msec): min=3, max=523, avg=24.95, stdev=29.52 lat (msec): min=3, max=523, avg=24.96, stdev=29.52 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 8], 10.00th=[ 8], 20.00th=[ 10], | 30.00th=[ 11], 40.00th=[ 13], 50.00th=[ 15], 60.00th=[ 18], | 70.00th=[ 22], 80.00th=[ 34], 90.00th=[ 59], 95.00th=[ 79], | 99.00th=[ 140], 99.50th=[ 169], 99.90th=[ 321], 99.95th=[ 523], | 99.99th=[ 523] bw ( KiB/s): min= 7, max= 128, per=26.51%, avg=34.20, stdev=23.82, samples=339 iops : min= 1, max= 32, avg= 7.99, stdev= 6.03, samples=339 write: IOPS=8, BW=34.2KiB/s (35.0kB/s)(6348KiB/185695msec); 0 zone resets clat (msec): min=17, max=450, avg=93.41, stdev=50.97 lat (msec): min=17, max=450, avg=93.41, stdev=50.97 clat percentiles (msec): | 1.00th=[ 32], 5.00th=[ 40], 10.00th=[ 45], 20.00th=[ 55], | 30.00th=[ 61], 40.00th=[ 69], 50.00th=[ 78], 60.00th=[ 90], | 70.00th=[ 107], 80.00th=[ 130], 90.00th=[ 167], 95.00th=[ 197], | 99.00th=[ 262], 99.50th=[ 288], 99.90th=[ 368], 99.95th=[ 451], | 99.99th=[ 451] bw ( KiB/s): min= 7, max= 88, per=24.96%, avg=33.69, stdev=17.39, samples=367 iops : min= 1, max= 22, avg= 7.86, stdev= 4.43, samples=367 lat (msec) : 4=0.07%, 10=11.10%, 20=21.13%, 50=17.90%, 100=31.32% lat (msec) : 250=17.77%, 500=0.68%, 750=0.03% cpu : usr=0.07%, sys=1.74%, ctx=5397, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144923: Sun Sep 6 22:48:29 2026 read: IOPS=8, BW=32.7KiB/s (33.5kB/s)(6028KiB/184128msec) clat (msec): min=4, max=283, avg=25.43, stdev=26.55 lat (msec): min=4, max=283, avg=25.43, stdev=26.55 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 7], 10.00th=[ 8], 20.00th=[ 10], | 30.00th=[ 12], 40.00th=[ 14], 50.00th=[ 16], 60.00th=[ 19], | 70.00th=[ 24], 80.00th=[ 37], 90.00th=[ 59], 95.00th=[ 78], | 99.00th=[ 117], 99.50th=[ 167], 99.90th=[ 257], 99.95th=[ 284], | 99.99th=[ 284] bw ( KiB/s): min= 7, max= 134, per=26.40%, avg=34.05, stdev=23.42, samples=345 iops : min= 1, max= 33, avg= 7.94, stdev= 5.91, samples=345 write: IOPS=8, BW=33.0KiB/s (34.8kB/s)(6260KiB/184128msec); 0 zone resets clat (msec): min=22, max=693, avg=92.95, stdev=52.12 lat (msec): min=22, max=693, avg=92.96, stdev=52.12 clat percentiles (msec): | 1.00th=[ 33], 5.00th=[ 41], 10.00th=[ 45], 20.00th=[ 54], | 30.00th=[ 62], 40.00th=[ 69], 50.00th=[ 78], 60.00th=[ 89], | 70.00th=[ 106], 80.00th=[ 130], 90.00th=[ 161], 95.00th=[ 188], | 99.00th=[ 266], 99.50th=[ 296], 99.90th=[ 447], 99.95th=[ 693], | 99.99th=[ 693] bw ( KiB/s): min= 7, max= 88, per=24.95%, avg=33.68, stdev=17.00, samples=362 iops : min= 1, max= 22, avg= 7.85, stdev= 4.34, samples=362 lat (msec) : 10=11.46%, 20=19.76%, 50=19.17%, 100=31.67%, 250=17.12% lat (msec) : 500=0.78%, 750=0.03% cpu : usr=0.07%, sys=1.73%, ctx=5379, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144924: Sun Sep 6 22:48:29 2026 read: IOPS=8, BW=33.2KiB/s (34.0kB/s)(6052KiB/182251msec) clat (msec): min=4, max=282, avg=24.23, stdev=24.64 lat (msec): min=4, max=282, avg=24.23, stdev=24.65 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 8], 10.00th=[ 8], 20.00th=[ 10], | 30.00th=[ 12], 40.00th=[ 13], 50.00th=[ 16], 60.00th=[ 19], | 70.00th=[ 23], 80.00th=[ 34], 90.00th=[ 55], 95.00th=[ 70], | 99.00th=[ 124], 99.50th=[ 136], 99.90th=[ 247], 99.95th=[ 284], | 99.99th=[ 284] bw ( KiB/s): min= 7, max= 127, per=26.87%, avg=34.66, stdev=23.86, samples=341 iops : min= 1, max= 31, avg= 8.10, stdev= 6.01, samples=341 write: IOPS=8, BW=34.2KiB/s (35.0kB/s)(6236KiB/182251msec); 0 zone resets clat (msec): min=24, max=690, avg=93.18, stdev=51.94 lat (msec): min=24, max=690, avg=93.19, stdev=51.94 clat percentiles (msec): | 1.00th=[ 33], 5.00th=[ 41], 10.00th=[ 46], 20.00th=[ 54], | 30.00th=[ 62], 40.00th=[ 68], 50.00th=[ 78], 60.00th=[ 89], | 70.00th=[ 106], 80.00th=[ 130], 90.00th=[ 167], 95.00th=[ 192], | 99.00th=[ 262], 99.50th=[ 300], 99.90th=[ 443], 99.95th=[ 693], | 99.99th=[ 693] bw ( KiB/s): min= 7, max= 88, per=25.02%, avg=33.78, stdev=17.10, samples=360 iops : min= 1, max= 22, avg= 7.88, stdev= 4.37, samples=360 lat (msec) : 10=10.64%, 20=21.09%, 50=19.04%, 100=31.74%, 250=16.86% lat (msec) : 500=0.59%, 750=0.03% cpu : usr=0.06%, sys=1.74%, ctx=5290, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=129KiB/s (132kB/s), 31.0KiB/s-33.2KiB/s (32.8kB/s-34.0kB/s), io=23.4MiB (24.6MB), run=182251-185695msec WRITE: bw=135KiB/s (139kB/s), 33.0KiB/s-34.3KiB/s (34.8kB/s-35.1kB/s), io=24.6MiB (25.7MB), run=182251-185695msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144981: Sun Sep 6 22:48:55 2026 read: IOPS=20, BW=321KiB/s (328kB/s)(5920KiB/18469msec) clat (usec): min=38, max=159394, avg=25716.60, stdev=20716.72 lat (usec): min=39, max=159395, avg=25718.07, stdev=20716.72 clat percentiles (usec): | 1.00th=[ 45], 5.00th=[ 63], 10.00th=[ 79], 20.00th=[ 1369], | 30.00th=[ 16909], 40.00th=[ 20841], 50.00th=[ 23725], 60.00th=[ 28443], | 70.00th=[ 32113], 80.00th=[ 39060], 90.00th=[ 47449], 95.00th=[ 57934], | 99.00th=[100140], 99.50th=[130548], 99.90th=[160433], 99.95th=[160433], | 99.99th=[160433] bw ( KiB/s): min= 159, max= 692, per=26.26%, avg=320.36, stdev=122.21, samples=36 iops : min= 9, max= 43, avg=19.39, stdev= 7.71, samples=36 write: IOPS=21, BW=345KiB/s (353kB/s)(6368KiB/18469msec); 0 zone resets clat (usec): min=1297, max=130475, avg=22053.05, stdev=22095.22 lat (usec): min=1299, max=130476, avg=22066.56, stdev=22129.17 clat percentiles (usec): | 1.00th=[ 1483], 5.00th=[ 2008], 10.00th=[ 2999], 20.00th=[ 4752], | 30.00th=[ 6194], 40.00th=[ 8586], 50.00th=[ 13829], 60.00th=[ 19530], | 70.00th=[ 27657], 80.00th=[ 40633], 90.00th=[ 54264], 95.00th=[ 63177], | 99.00th=[ 93848], 99.50th=[121111], 99.90th=[130548], 99.95th=[130548], | 99.99th=[130548] bw ( KiB/s): min= 157, max= 572, per=27.01%, avg=346.53, stdev=96.67, samples=36 iops : min= 9, max= 35, avg=21.03, stdev= 6.04, samples=36 lat (usec) : 50=1.30%, 100=5.08%, 250=2.86%, 500=0.26% lat (msec) : 2=2.73%, 4=5.99%, 10=14.84%, 20=16.15%, 50=40.23% lat (msec) : 100=9.77%, 250=0.78% cpu : usr=0.18%, sys=11.33%, ctx=1656, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144982: Sun Sep 6 22:48:55 2026 read: IOPS=18, BW=299KiB/s (306kB/s)(5744KiB/19196msec) clat (usec): min=41, max=137645, avg=26952.37, stdev=19317.63 lat (usec): min=41, max=137646, avg=26953.80, stdev=19317.64 clat percentiles (usec): | 1.00th=[ 52], 5.00th=[ 76], 10.00th=[ 120], 20.00th=[ 12911], | 30.00th=[ 17957], 40.00th=[ 21365], 50.00th=[ 25297], 60.00th=[ 29492], | 70.00th=[ 33162], 80.00th=[ 40633], 90.00th=[ 51119], 95.00th=[ 59507], | 99.00th=[ 81265], 99.50th=[121111], 99.90th=[137364], 99.95th=[137364], | 99.99th=[137364] bw ( KiB/s): min= 26, max= 574, per=24.40%, avg=297.65, stdev=102.25, samples=37 iops : min= 1, max= 35, avg=17.95, stdev= 6.42, samples=37 write: IOPS=21, BW=341KiB/s (349kB/s)(6544KiB/19196msec); 0 zone resets clat (usec): min=1217, max=155027, avg=23026.87, stdev=24646.33 lat (usec): min=1220, max=155029, avg=23029.88, stdev=24646.30 clat percentiles (usec): | 1.00th=[ 1450], 5.00th=[ 1958], 10.00th=[ 2540], 20.00th=[ 4080], | 30.00th=[ 6128], 40.00th=[ 8586], 50.00th=[ 13698], 60.00th=[ 19530], | 70.00th=[ 29230], 80.00th=[ 41157], 90.00th=[ 55837], 95.00th=[ 67634], | 99.00th=[114820], 99.50th=[125305], 99.90th=[154141], 99.95th=[154141], | 99.99th=[154141] bw ( KiB/s): min= 134, max= 750, per=26.09%, avg=334.78, stdev=118.48, samples=37 iops : min= 8, max= 46, avg=20.27, stdev= 7.41, samples=37 lat (usec) : 50=0.26%, 100=3.52%, 250=2.86%, 500=0.52%, 750=0.13% lat (msec) : 2=3.12%, 4=7.42%, 10=13.41%, 20=17.71%, 50=38.28% lat (msec) : 100=11.59%, 250=1.17% cpu : usr=0.13%, sys=11.31%, ctx=1712, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144983: Sun Sep 6 22:48:55 2026 read: IOPS=19, BW=319KiB/s (326kB/s)(6256KiB/19629msec) clat (usec): min=38, max=167946, avg=26256.88, stdev=23138.11 lat (usec): min=38, max=167948, avg=26258.50, stdev=23138.26 clat percentiles (usec): | 1.00th=[ 50], 5.00th=[ 64], 10.00th=[ 79], 20.00th=[ 176], | 30.00th=[ 14091], 40.00th=[ 19006], 50.00th=[ 22938], 60.00th=[ 28443], | 70.00th=[ 35390], 80.00th=[ 41681], 90.00th=[ 53740], 95.00th=[ 63177], | 99.00th=[117965], 99.50th=[135267], 99.90th=[168821], 99.95th=[168821], | 99.99th=[168821] bw ( KiB/s): min= 54, max= 571, per=26.14%, avg=318.95, stdev=124.78, samples=38 iops : min= 3, max= 35, avg=19.32, stdev= 7.80, samples=38 write: IOPS=19, BW=307KiB/s (315kB/s)(6032KiB/19629msec); 0 zone resets clat (usec): min=1306, max=201214, avg=24439.87, stdev=25005.71 lat (usec): min=1310, max=201218, avg=24443.88, stdev=25006.14 clat percentiles (usec): | 1.00th=[ 1745], 5.00th=[ 2442], 10.00th=[ 3359], 20.00th=[ 4948], | 30.00th=[ 6718], 40.00th=[ 10683], 50.00th=[ 17171], 60.00th=[ 22414], | 70.00th=[ 30540], 80.00th=[ 40109], 90.00th=[ 55837], 95.00th=[ 73925], | 99.00th=[101188], 99.50th=[154141], 99.90th=[200279], 99.95th=[200279], | 99.99th=[200279] bw ( KiB/s): min= 108, max= 503, per=23.61%, avg=302.89, stdev=97.51, samples=38 iops : min= 6, max= 31, avg=18.29, stdev= 6.11, samples=38 lat (usec) : 50=0.52%, 100=6.64%, 250=3.52%, 500=0.52%, 750=0.26% lat (msec) : 2=1.69%, 4=5.34%, 10=12.89%, 20=16.80%, 50=38.93% lat (msec) : 100=11.72%, 250=1.17% cpu : usr=0.14%, sys=10.72%, ctx=1635, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144984: Sun Sep 6 22:48:55 2026 read: IOPS=20, BW=322KiB/s (330kB/s)(6032KiB/18712msec) clat (usec): min=38, max=192405, avg=26292.03, stdev=21548.92 lat (usec): min=38, max=192408, avg=26297.05, stdev=21547.35 clat percentiles (usec): | 1.00th=[ 41], 5.00th=[ 65], 10.00th=[ 78], 20.00th=[ 225], | 30.00th=[ 16909], 40.00th=[ 21103], 50.00th=[ 25035], 60.00th=[ 29754], | 70.00th=[ 34341], 80.00th=[ 39584], 90.00th=[ 49546], 95.00th=[ 63177], | 99.00th=[ 90702], 99.50th=[130548], 99.90th=[191890], 99.95th=[191890], | 99.99th=[191890] bw ( KiB/s): min= 27, max= 572, per=26.15%, avg=318.97, stdev=98.18, samples=36 iops : min= 1, max= 35, avg=19.31, stdev= 6.07, samples=36 write: IOPS=20, BW=334KiB/s (342kB/s)(6256KiB/18712msec); 0 zone resets clat (usec): min=1578, max=126297, avg=21952.95, stdev=20985.56 lat (usec): min=1579, max=126299, avg=21955.60, stdev=20985.65 clat percentiles (usec): | 1.00th=[ 1631], 5.00th=[ 2147], 10.00th=[ 3064], 20.00th=[ 4686], | 30.00th=[ 6718], 40.00th=[ 10421], 50.00th=[ 15533], 60.00th=[ 20317], | 70.00th=[ 28443], 80.00th=[ 38011], 90.00th=[ 48497], 95.00th=[ 64226], | 99.00th=[ 94897], 99.50th=[108528], 99.90th=[126354], 99.95th=[126354], | 99.99th=[126354] bw ( KiB/s): min= 108, max= 480, per=26.15%, avg=335.50, stdev=93.17, samples=36 iops : min= 6, max= 30, avg=20.33, stdev= 5.85, samples=36 lat (usec) : 50=0.91%, 100=6.51%, 250=2.60%, 500=0.13%, 750=0.13% lat (msec) : 2=2.34%, 4=5.86%, 10=11.85%, 20=17.97%, 50=42.06% lat (msec) : 100=8.85%, 250=0.78% cpu : usr=0.14%, sys=11.41%, ctx=1691, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1220KiB/s (1250kB/s), 299KiB/s-322KiB/s (306kB/s-330kB/s), io=23.4MiB (24.5MB), run=18469-19629msec WRITE: bw=1284KiB/s (1315kB/s), 307KiB/s-345KiB/s (315kB/s-353kB/s), io=24.6MiB (25.8MB), run=18469-19629msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144976: Sun Sep 6 22:49:20 2026 read: IOPS=8, BW=134KiB/s (137kB/s)(5920KiB/44327msec) clat (msec): min=6, max=261, avg=24.84, stdev=25.62 lat (msec): min=6, max=261, avg=24.84, stdev=25.62 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 10], 20.00th=[ 12], | 30.00th=[ 13], 40.00th=[ 15], 50.00th=[ 17], 60.00th=[ 20], | 70.00th=[ 24], 80.00th=[ 30], 90.00th=[ 47], 95.00th=[ 74], | 99.00th=[ 153], 99.50th=[ 180], 99.90th=[ 262], 99.95th=[ 262], | 99.99th=[ 262] bw ( KiB/s): min= 31, max= 447, per=25.59%, avg=138.16, stdev=90.99, samples=85 iops : min= 1, max= 27, avg= 7.99, stdev= 5.78, samples=85 write: IOPS=8, BW=144KiB/s (147kB/s)(6368KiB/44327msec); 0 zone resets clat (msec): min=30, max=239, avg=87.74, stdev=37.71 lat (msec): min=30, max=239, avg=87.74, stdev=37.71 clat percentiles (msec): | 1.00th=[ 34], 5.00th=[ 44], 10.00th=[ 49], 20.00th=[ 60], | 30.00th=[ 65], 40.00th=[ 70], 50.00th=[ 78], 60.00th=[ 86], | 70.00th=[ 97], 80.00th=[ 117], 90.00th=[ 146], 95.00th=[ 165], | 99.00th=[ 205], 99.50th=[ 209], 99.90th=[ 241], 99.95th=[ 241], | 99.99th=[ 241] bw ( KiB/s): min= 28, max= 287, per=25.24%, avg=143.36, stdev=56.50, samples=88 iops : min= 1, max= 17, avg= 8.31, stdev= 3.60, samples=88 lat (msec) : 10=5.60%, 20=24.09%, 50=19.92%, 100=35.03%, 250=15.23% lat (msec) : 500=0.13% cpu : usr=0.09%, sys=2.17%, ctx=1340, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144977: Sun Sep 6 22:49:20 2026 read: IOPS=8, BW=130KiB/s (133kB/s)(5744KiB/44300msec) clat (msec): min=6, max=258, avg=25.90, stdev=28.18 lat (msec): min=6, max=258, avg=25.90, stdev=28.18 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 10], 20.00th=[ 12], | 30.00th=[ 13], 40.00th=[ 15], 50.00th=[ 17], 60.00th=[ 19], | 70.00th=[ 23], 80.00th=[ 31], 90.00th=[ 52], 95.00th=[ 90], | 99.00th=[ 146], 99.50th=[ 159], 99.90th=[ 259], 99.95th=[ 259], | 99.99th=[ 259] bw ( KiB/s): min= 28, max= 415, per=24.57%, avg=132.69, stdev=83.20, samples=86 iops : min= 1, max= 25, avg= 7.64, stdev= 5.31, samples=86 write: IOPS=9, BW=148KiB/s (151kB/s)(6544KiB/44300msec); 0 zone resets clat (msec): min=32, max=290, avg=85.43, stdev=34.89 lat (msec): min=32, max=290, avg=85.44, stdev=34.89 clat percentiles (msec): | 1.00th=[ 39], 5.00th=[ 45], 10.00th=[ 50], 20.00th=[ 58], | 30.00th=[ 66], 40.00th=[ 72], 50.00th=[ 79], 60.00th=[ 85], | 70.00th=[ 92], 80.00th=[ 107], 90.00th=[ 132], 95.00th=[ 153], | 99.00th=[ 205], 99.50th=[ 218], 99.90th=[ 292], 99.95th=[ 292], | 99.99th=[ 292] bw ( KiB/s): min= 31, max= 255, per=25.92%, avg=147.22, stdev=56.67, samples=88 iops : min= 1, max= 15, avg= 8.56, stdev= 3.57, samples=88 lat (msec) : 10=5.99%, 20=23.70%, 50=17.71%, 100=37.76%, 250=14.58% lat (msec) : 500=0.26% cpu : usr=0.07%, sys=2.21%, ctx=1415, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144978: Sun Sep 6 22:49:20 2026 read: IOPS=9, BW=147KiB/s (150kB/s)(6256KiB/42613msec) clat (msec): min=5, max=148, avg=24.35, stdev=22.26 lat (msec): min=5, max=148, avg=24.36, stdev=22.26 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 9], 20.00th=[ 11], | 30.00th=[ 13], 40.00th=[ 15], 50.00th=[ 17], 60.00th=[ 20], | 70.00th=[ 24], 80.00th=[ 33], 90.00th=[ 48], 95.00th=[ 70], | 99.00th=[ 129], 99.50th=[ 138], 99.90th=[ 148], 99.95th=[ 148], | 99.99th=[ 148] bw ( KiB/s): min= 31, max= 478, per=27.64%, avg=149.27, stdev=95.15, samples=83 iops : min= 1, max= 29, avg= 8.66, stdev= 6.03, samples=83 write: IOPS=8, BW=142KiB/s (145kB/s)(6032KiB/42613msec); 0 zone resets clat (msec): min=34, max=242, avg=87.38, stdev=36.33 lat (msec): min=34, max=242, avg=87.38, stdev=36.33 clat percentiles (msec): | 1.00th=[ 39], 5.00th=[ 44], 10.00th=[ 51], 20.00th=[ 59], | 30.00th=[ 65], 40.00th=[ 71], 50.00th=[ 79], 60.00th=[ 88], | 70.00th=[ 97], 80.00th=[ 112], 90.00th=[ 140], 95.00th=[ 159], | 99.00th=[ 207], 99.50th=[ 213], 99.90th=[ 243], 99.95th=[ 243], | 99.99th=[ 243] bw ( KiB/s): min= 32, max= 256, per=24.68%, avg=140.20, stdev=51.79, samples=84 iops : min= 2, max= 16, avg= 8.11, stdev= 3.29, samples=84 lat (msec) : 10=7.81%, 20=23.83%, 50=19.40%, 100=33.98%, 250=14.97% cpu : usr=0.06%, sys=2.28%, ctx=1368, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144980: Sun Sep 6 22:49:20 2026 read: IOPS=8, BW=141KiB/s (144kB/s)(6032KiB/42886msec) clat (msec): min=6, max=204, avg=25.33, stdev=24.79 lat (msec): min=6, max=204, avg=25.33, stdev=24.79 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 11], | 30.00th=[ 12], 40.00th=[ 14], 50.00th=[ 17], 60.00th=[ 21], | 70.00th=[ 26], 80.00th=[ 33], 90.00th=[ 52], 95.00th=[ 83], | 99.00th=[ 140], 99.50th=[ 146], 99.90th=[ 205], 99.95th=[ 205], | 99.99th=[ 205] bw ( KiB/s): min= 31, max= 352, per=25.81%, avg=139.36, stdev=79.90, samples=85 iops : min= 1, max= 22, avg= 8.05, stdev= 5.01, samples=85 write: IOPS=9, BW=146KiB/s (149kB/s)(6256KiB/42886msec); 0 zone resets clat (msec): min=24, max=281, avg=84.99, stdev=36.31 lat (msec): min=24, max=281, avg=84.99, stdev=36.31 clat percentiles (msec): | 1.00th=[ 34], 5.00th=[ 43], 10.00th=[ 48], 20.00th=[ 57], | 30.00th=[ 65], 40.00th=[ 71], 50.00th=[ 78], 60.00th=[ 85], | 70.00th=[ 95], 80.00th=[ 108], 90.00th=[ 130], 95.00th=[ 155], | 99.00th=[ 228], 99.50th=[ 241], 99.90th=[ 279], 99.95th=[ 279], | 99.99th=[ 279] bw ( KiB/s): min= 32, max= 255, per=25.59%, avg=145.34, stdev=55.43, samples=85 iops : min= 2, max= 15, avg= 8.42, stdev= 3.53, samples=85 lat (msec) : 10=8.33%, 20=20.70%, 50=20.96%, 100=36.72%, 250=13.15% lat (msec) : 500=0.13% cpu : usr=0.07%, sys=2.23%, ctx=1341, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=540KiB/s (553kB/s), 130KiB/s-147KiB/s (133kB/s-150kB/s), io=23.4MiB (24.5MB), run=42613-44327msec WRITE: bw=569KiB/s (582kB/s), 142KiB/s-148KiB/s (145kB/s-151kB/s), io=24.6MiB (25.8MB), run=42613-44327msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144996: Sun Sep 6 22:49:30 2026 read: IOPS=2, BW=2150KiB/s (2202kB/s)(7168KiB/3334msec) clat (usec): min=617, max=679704, avg=263340.87, stdev=232878.72 lat (usec): min=618, max=679707, avg=263342.29, stdev=232879.25 clat percentiles (usec): | 1.00th=[ 619], 5.00th=[ 619], 10.00th=[ 619], 20.00th=[ 775], | 30.00th=[227541], 40.00th=[227541], 50.00th=[248513], 60.00th=[333448], | 70.00th=[333448], 80.00th=[350225], 90.00th=[683672], 95.00th=[683672], | 99.00th=[683672], 99.50th=[683672], 99.90th=[683672], 99.95th=[683672], | 99.99th=[683672] bw ( KiB/s): min= 2031, max= 6119, per=74.71%, avg=4076.33, stdev=2044.00, samples=3 iops : min= 1, max= 5, avg= 3.00, stdev= 2.00, samples=3 write: IOPS=1, BW=1536KiB/s (1573kB/s)(5120KiB/3334msec); 0 zone resets clat (msec): min=107, max=458, avg=268.57, stdev=154.40 lat (msec): min=107, max=458, avg=268.69, stdev=154.37 clat percentiles (msec): | 1.00th=[ 108], 5.00th=[ 108], 10.00th=[ 108], 20.00th=[ 108], | 30.00th=[ 124], 40.00th=[ 124], 50.00th=[ 275], 60.00th=[ 275], | 70.00th=[ 380], 80.00th=[ 380], 90.00th=[ 460], 95.00th=[ 460], | 99.00th=[ 460], 99.50th=[ 460], 99.90th=[ 460], 99.95th=[ 460], | 99.99th=[ 460] bw ( KiB/s): min= 2031, max= 4087, per=35.59%, avg=2719.00, stdev=1184.73, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (usec) : 750=8.33%, 1000=8.33% lat (msec) : 250=33.33%, 500=41.67%, 750=8.33% cpu : usr=0.03%, sys=17.40%, ctx=278, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144997: Sun Sep 6 22:49:30 2026 read: IOPS=0, BW=546KiB/s (559kB/s)(2048KiB/3753msec) clat (msec): min=166, max=266, avg=216.35, stdev=70.76 lat (msec): min=166, max=266, avg=216.35, stdev=70.75 clat percentiles (msec): | 1.00th=[ 167], 5.00th=[ 167], 10.00th=[ 167], 20.00th=[ 167], | 30.00th=[ 167], 40.00th=[ 167], 50.00th=[ 167], 60.00th=[ 268], | 70.00th=[ 268], 80.00th=[ 268], 90.00th=[ 268], 95.00th=[ 268], | 99.00th=[ 268], 99.50th=[ 268], 99.90th=[ 268], 99.95th=[ 268], | 99.99th=[ 268] bw ( KiB/s): min= 1980, max= 2043, per=36.87%, avg=2011.50, stdev=44.55, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2728KiB/s (2794kB/s)(10.0MiB/3753msec); 0 zone resets clat (msec): min=122, max=546, avg=323.82, stdev=133.73 lat (msec): min=122, max=547, avg=323.93, stdev=133.71 clat percentiles (msec): | 1.00th=[ 123], 5.00th=[ 123], 10.00th=[ 123], 20.00th=[ 140], | 30.00th=[ 199], 40.00th=[ 321], 50.00th=[ 351], 60.00th=[ 359], | 70.00th=[ 368], 80.00th=[ 414], 90.00th=[ 418], 95.00th=[ 550], | 99.00th=[ 550], 99.50th=[ 550], 99.90th=[ 550], 99.95th=[ 550], | 99.99th=[ 550] bw ( KiB/s): min= 2031, max= 4079, per=35.55%, avg=2715.67, stdev=1052.95, samples=6 iops : min= 1, max= 3, avg= 1.67, stdev= 1.03, samples=6 lat (msec) : 250=33.33%, 500=58.33%, 750=8.33% cpu : usr=0.00%, sys=27.08%, ctx=190, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144998: Sun Sep 6 22:49:30 2026 read: IOPS=2, BW=2212KiB/s (2265kB/s)(6144KiB/2778msec) clat (usec): min=410, max=272103, avg=128795.82, stdev=108763.96 lat (usec): min=412, max=272104, avg=128796.89, stdev=108763.98 clat percentiles (usec): | 1.00th=[ 412], 5.00th=[ 412], 10.00th=[ 412], 20.00th=[ 486], | 30.00th=[ 486], 40.00th=[139461], 50.00th=[139461], 60.00th=[166724], | 70.00th=[191890], 80.00th=[191890], 90.00th=[270533], 95.00th=[270533], | 99.00th=[270533], 99.50th=[270533], 99.90th=[270533], 99.95th=[270533], | 99.99th=[270533] bw ( KiB/s): min= 2031, max= 4079, per=62.25%, avg=3396.33, stdev=1182.41, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 write: IOPS=2, BW=2212KiB/s (2265kB/s)(6144KiB/2778msec); 0 zone resets clat (msec): min=135, max=1001, avg=307.98, stdev=341.66 lat (msec): min=135, max=1001, avg=308.07, stdev=341.67 clat percentiles (msec): | 1.00th=[ 136], 5.00th=[ 136], 10.00th=[ 136], 20.00th=[ 142], | 30.00th=[ 142], 40.00th=[ 146], 50.00th=[ 146], 60.00th=[ 207], | 70.00th=[ 218], 80.00th=[ 218], 90.00th=[ 1003], 95.00th=[ 1003], | 99.00th=[ 1003], 99.50th=[ 1003], 99.90th=[ 1003], 99.95th=[ 1003], | 99.99th=[ 1003] bw ( KiB/s): min= 2039, max= 4079, per=44.25%, avg=3380.33, stdev=1161.97, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 lat (usec) : 500=16.67% lat (msec) : 250=66.67%, 500=8.33%, 2000=8.33% cpu : usr=0.04%, sys=21.21%, ctx=244, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144999: Sun Sep 6 22:49:30 2026 read: IOPS=1, BW=1869KiB/s (1913kB/s)(5120KiB/2740msec) clat (usec): min=581, max=419896, avg=245998.44, stdev=159250.15 lat (usec): min=581, max=419897, avg=245999.51, stdev=159250.30 clat percentiles (usec): | 1.00th=[ 578], 5.00th=[ 578], 10.00th=[ 578], 20.00th=[ 578], | 30.00th=[191890], 40.00th=[191890], 50.00th=[304088], 60.00th=[304088], | 70.00th=[316670], 80.00th=[316670], 90.00th=[421528], 95.00th=[421528], | 99.00th=[421528], 99.50th=[421528], 99.90th=[421528], 99.95th=[421528], | 99.99th=[421528] bw ( KiB/s): min= 2039, max= 6119, per=74.76%, avg=4079.00, stdev=2885.00, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 write: IOPS=2, BW=2616KiB/s (2679kB/s)(7168KiB/2740msec); 0 zone resets clat (msec): min=124, max=300, avg=211.21, stdev=75.59 lat (msec): min=124, max=300, avg=211.31, stdev=75.56 clat percentiles (msec): | 1.00th=[ 125], 5.00th=[ 125], 10.00th=[ 125], 20.00th=[ 138], | 30.00th=[ 142], 40.00th=[ 142], 50.00th=[ 232], 60.00th=[ 253], | 70.00th=[ 253], 80.00th=[ 292], 90.00th=[ 300], 95.00th=[ 300], | 99.00th=[ 300], 99.50th=[ 300], 99.90th=[ 300], 99.95th=[ 300], | 99.99th=[ 300] bw ( KiB/s): min= 2031, max= 4087, per=45.87%, avg=3504.25, stdev=989.97, samples=4 iops : min= 1, max= 3, avg= 2.50, stdev= 1.00, samples=4 lat (usec) : 750=8.33% lat (msec) : 250=41.67%, 500=50.00% cpu : usr=0.00%, sys=24.13%, ctx=280, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5457KiB/s (5588kB/s), 546KiB/s-2212KiB/s (559kB/s-2265kB/s), io=20.0MiB (20.0MB), run=2740-3753msec WRITE: bw=7640KiB/s (7823kB/s), 1536KiB/s-2728KiB/s (1573kB/s-2794kB/s), io=28.0MiB (29.4MB), run=2740-3753msec rand-rw: (groupid=0, jobs=1): err= 0: pid=145000: Sun Sep 6 22:49:31 2026 read: IOPS=1, BW=1817KiB/s (1861kB/s)(7168KiB/3945msec) clat (msec): min=52, max=744, avg=331.26, stdev=275.78 lat (msec): min=52, max=744, avg=331.27, stdev=275.78 clat percentiles (msec): | 1.00th=[ 53], 5.00th=[ 53], 10.00th=[ 53], 20.00th=[ 64], | 30.00th=[ 174], 40.00th=[ 174], 50.00th=[ 194], 60.00th=[ 531], | 70.00th=[ 531], 80.00th=[ 558], 90.00th=[ 743], 95.00th=[ 743], | 99.00th=[ 743], 99.50th=[ 743], 99.90th=[ 743], 99.95th=[ 743], | 99.99th=[ 743] bw ( KiB/s): min= 1984, max= 4087, per=49.30%, avg=2432.00, stdev=925.46, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 write: IOPS=1, BW=1298KiB/s (1329kB/s)(5120KiB/3945msec); 0 zone resets clat (msec): min=143, max=495, avg=294.56, stdev=180.14 lat (msec): min=143, max=495, avg=294.71, stdev=180.12 clat percentiles (msec): | 1.00th=[ 144], 5.00th=[ 144], 10.00th=[ 144], 20.00th=[ 144], | 30.00th=[ 167], 40.00th=[ 167], 50.00th=[ 180], 60.00th=[ 180], | 70.00th=[ 489], 80.00th=[ 489], 90.00th=[ 498], 95.00th=[ 498], | 99.00th=[ 498], 99.50th=[ 498], 99.90th=[ 498], 99.95th=[ 498], | 99.99th=[ 498] bw ( KiB/s): min= 2031, max= 4087, per=39.35%, avg=2717.67, stdev=1185.88, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (msec) : 100=16.67%, 250=41.67%, 500=16.67%, 750=25.00% cpu : usr=0.03%, sys=7.81%, ctx=94, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145001: Sun Sep 6 22:49:31 2026 read: IOPS=0, BW=493KiB/s (505kB/s)(2048KiB/4151msec) clat (msec): min=201, max=317, avg=259.01, stdev=82.02 lat (msec): min=201, max=317, avg=259.01, stdev=82.02 clat percentiles (msec): | 1.00th=[ 201], 5.00th=[ 201], 10.00th=[ 201], 20.00th=[ 201], | 30.00th=[ 201], 40.00th=[ 201], 50.00th=[ 201], 60.00th=[ 317], | 70.00th=[ 317], 80.00th=[ 317], 90.00th=[ 317], 95.00th=[ 317], | 99.00th=[ 317], 99.50th=[ 317], 99.90th=[ 317], 99.95th=[ 317], | 99.99th=[ 317] bw ( KiB/s): min= 1973, max= 2031, per=40.58%, avg=2002.00, stdev=41.01, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2467KiB/s (2526kB/s)(10.0MiB/4151msec); 0 zone resets clat (msec): min=70, max=1072, avg=348.25, stdev=307.32 lat (msec): min=71, max=1072, avg=348.46, stdev=307.36 clat percentiles (msec): | 1.00th=[ 71], 5.00th=[ 71], 10.00th=[ 71], 20.00th=[ 85], | 30.00th=[ 85], 40.00th=[ 209], 50.00th=[ 224], 60.00th=[ 326], | 70.00th=[ 372], 80.00th=[ 443], 90.00th=[ 600], 95.00th=[ 1070], | 99.00th=[ 1070], 99.50th=[ 1070], 99.90th=[ 1070], 99.95th=[ 1070], | 99.99th=[ 1070] bw ( KiB/s): min= 2027, max= 4087, per=47.05%, avg=3249.60, stdev=1106.69, samples=5 iops : min= 1, max= 3, avg= 2.40, stdev= 0.89, samples=5 lat (msec) : 100=25.00%, 250=25.00%, 500=33.33%, 750=8.33%, 2000=8.33% cpu : usr=0.00%, sys=7.16%, ctx=129, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145002: Sun Sep 6 22:49:31 2026 read: IOPS=1, BW=1590KiB/s (1628kB/s)(6144KiB/3864msec) clat (msec): min=72, max=177, avg=110.14, stdev=39.96 lat (msec): min=72, max=177, avg=110.14, stdev=39.96 clat percentiles (msec): | 1.00th=[ 73], 5.00th=[ 73], 10.00th=[ 73], 20.00th=[ 85], | 30.00th=[ 85], 40.00th=[ 87], 50.00th=[ 87], 60.00th=[ 102], | 70.00th=[ 140], 80.00th=[ 140], 90.00th=[ 178], 95.00th=[ 178], | 99.00th=[ 178], 99.50th=[ 178], 99.90th=[ 178], 99.95th=[ 178], | 99.99th=[ 178] bw ( KiB/s): min= 2015, max= 6095, per=68.50%, avg=3379.00, stdev=2352.13, samples=3 iops : min= 1, max= 5, avg= 2.33, stdev= 2.31, samples=3 write: IOPS=1, BW=1590KiB/s (1628kB/s)(6144KiB/3864msec); 0 zone resets clat (msec): min=192, max=813, avg=501.50, stdev=243.70 lat (msec): min=192, max=813, avg=501.62, stdev=243.68 clat percentiles (msec): | 1.00th=[ 192], 5.00th=[ 192], 10.00th=[ 192], 20.00th=[ 271], | 30.00th=[ 271], 40.00th=[ 456], 50.00th=[ 456], 60.00th=[ 558], | 70.00th=[ 718], 80.00th=[ 718], 90.00th=[ 810], 95.00th=[ 810], | 99.00th=[ 810], 99.50th=[ 810], 99.90th=[ 810], 99.95th=[ 810], | 99.99th=[ 810] bw ( KiB/s): min= 2003, max= 4063, per=36.63%, avg=2530.00, stdev=1022.06, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (msec) : 100=25.00%, 250=33.33%, 500=16.67%, 750=16.67%, 1000=8.33% cpu : usr=0.08%, sys=7.84%, ctx=111, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145003: Sun Sep 6 22:49:31 2026 read: IOPS=1, BW=1266KiB/s (1296kB/s)(5120KiB/4044msec) clat (msec): min=53, max=440, avg=227.36, stdev=149.60 lat (msec): min=53, max=440, avg=227.36, stdev=149.60 clat percentiles (msec): | 1.00th=[ 54], 5.00th=[ 54], 10.00th=[ 54], 20.00th=[ 54], | 30.00th=[ 123], 40.00th=[ 123], 50.00th=[ 243], 60.00th=[ 243], | 70.00th=[ 279], 80.00th=[ 279], 90.00th=[ 443], 95.00th=[ 443], | 99.00th=[ 443], 99.50th=[ 443], 99.90th=[ 443], 99.95th=[ 443], | 99.99th=[ 443] bw ( KiB/s): min= 4063, max= 4096, per=82.70%, avg=4079.50, stdev=23.33, samples=2 iops : min= 3, max= 4, avg= 3.50, stdev= 0.71, samples=2 write: IOPS=1, BW=1773KiB/s (1815kB/s)(7168KiB/4044msec); 0 zone resets clat (msec): min=89, max=863, avg=409.68, stdev=333.82 lat (msec): min=89, max=863, avg=409.85, stdev=333.90 clat percentiles (msec): | 1.00th=[ 89], 5.00th=[ 89], 10.00th=[ 89], 20.00th=[ 93], | 30.00th=[ 169], 40.00th=[ 169], 50.00th=[ 351], 60.00th=[ 451], | 70.00th=[ 451], 80.00th=[ 852], 90.00th=[ 860], 95.00th=[ 860], | 99.00th=[ 860], 99.50th=[ 860], 99.90th=[ 860], 99.95th=[ 860], | 99.99th=[ 860] bw ( KiB/s): min= 2003, max= 6131, per=51.41%, avg=3551.00, stdev=1971.97, samples=4 iops : min= 1, max= 5, avg= 2.50, stdev= 1.91, samples=4 lat (msec) : 100=25.00%, 250=25.00%, 500=33.33%, 1000=16.67% cpu : usr=0.05%, sys=5.61%, ctx=100, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4934KiB/s (5052kB/s), 493KiB/s-1817KiB/s (505kB/s-1861kB/s), io=20.0MiB (20.0MB), run=3864-4151msec WRITE: bw=6907KiB/s (7073kB/s), 1298KiB/s-2467KiB/s (1329kB/s-2526kB/s), io=28.0MiB (29.4MB), run=3864-4151msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=145014: Sun Sep 6 22:49:42 2026 read: IOPS=0, BW=2595KiB/s (2657kB/s)(12.0MiB/4735msec) clat (msec): min=196, max=4294, avg=1577.90, stdev=2352.83 lat (msec): min=196, max=4294, avg=1577.90, stdev=2352.83 clat percentiles (msec): | 1.00th=[ 197], 5.00th=[ 197], 10.00th=[ 197], 20.00th=[ 197], | 30.00th=[ 197], 40.00th=[ 243], 50.00th=[ 243], 60.00th=[ 243], | 70.00th=[ 4279], 80.00th=[ 4279], 90.00th=[ 4279], 95.00th=[ 4279], | 99.00th=[ 4279], 99.50th=[ 4279], 99.90th=[ 4279], 99.95th=[ 4279], | 99.99th=[ 4279] bw ( KiB/s): min=16318, max=16318, per=100.00%, avg=16318.00, stdev= 0.00, samples=1 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=1 lat (msec) : 250=66.67%, >=2000=33.33% cpu : usr=0.00%, sys=2.20%, ctx=39, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145015: Sun Sep 6 22:49:42 2026 read: IOPS=0, BW=933KiB/s (955kB/s)(4096KiB/4390msec) clat (nsec): min=3795.9M, max=3795.9M, avg=3795908856.00, stdev= 0.00 lat (nsec): min=3795.9M, max=3795.9M, avg=3795910371.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 3809], 5.00th=[ 3809], 10.00th=[ 3809], 20.00th=[ 3809], | 30.00th=[ 3809], 40.00th=[ 3809], 50.00th=[ 3809], 60.00th=[ 3809], | 70.00th=[ 3809], 80.00th=[ 3809], 90.00th=[ 3809], 95.00th=[ 3809], | 99.00th=[ 3809], 99.50th=[ 3809], 99.90th=[ 3809], 99.95th=[ 3809], | 99.99th=[ 3809] bw ( KiB/s): min= 8192, max= 8192, per=100.00%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 write: IOPS=0, BW=1866KiB/s (1911kB/s)(8192KiB/4390msec); 0 zone resets clat (msec): min=216, max=375, avg=296.05, stdev=112.65 lat (msec): min=216, max=376, avg=296.50, stdev=112.60 clat percentiles (msec): | 1.00th=[ 218], 5.00th=[ 218], 10.00th=[ 218], 20.00th=[ 218], | 30.00th=[ 218], 40.00th=[ 218], 50.00th=[ 218], 60.00th=[ 376], | 70.00th=[ 376], 80.00th=[ 376], 90.00th=[ 376], 95.00th=[ 376], | 99.00th=[ 376], 99.50th=[ 376], 99.90th=[ 376], 99.95th=[ 376], | 99.99th=[ 376] lat (msec) : 250=33.33%, 500=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=2.60%, ctx=28, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145016: Sun Sep 6 22:49:42 2026 write: IOPS=0, BW=2318KiB/s (2374kB/s)(12.0MiB/5301msec); 0 zone resets clat (msec): min=117, max=5006, avg=1765.90, stdev=2806.37 lat (msec): min=118, max=5006, avg=1766.38, stdev=2806.39 clat percentiles (msec): | 1.00th=[ 118], 5.00th=[ 118], 10.00th=[ 118], 20.00th=[ 118], | 30.00th=[ 118], 40.00th=[ 174], 50.00th=[ 174], 60.00th=[ 174], | 70.00th=[ 5000], 80.00th=[ 5000], 90.00th=[ 5000], 95.00th=[ 5000], | 99.00th=[ 5000], 99.50th=[ 5000], 99.90th=[ 5000], 99.95th=[ 5000], | 99.99th=[ 5000] bw ( KiB/s): min= 8110, max= 8110, per=100.00%, avg=8110.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=66.67%, >=2000=33.33% cpu : usr=0.00%, sys=2.17%, ctx=26, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145017: Sun Sep 6 22:49:42 2026 write: IOPS=0, BW=2471KiB/s (2530kB/s)(12.0MiB/4973msec); 0 zone resets clat (msec): min=228, max=2620, avg=1655.61, stdev=1261.40 lat (msec): min=228, max=2623, avg=1657.08, stdev=1262.55 clat percentiles (msec): | 1.00th=[ 228], 5.00th=[ 228], 10.00th=[ 228], 20.00th=[ 228], | 30.00th=[ 228], 40.00th=[ 2123], 50.00th=[ 2123], 60.00th=[ 2123], | 70.00th=[ 2635], 80.00th=[ 2635], 90.00th=[ 2635], 95.00th=[ 2635], | 99.00th=[ 2635], 99.50th=[ 2635], 99.90th=[ 2635], 99.95th=[ 2635], | 99.99th=[ 2635] bw ( KiB/s): min= 8159, max= 8175, per=100.00%, avg=8167.00, stdev=11.31, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 250=33.33%, >=2000=66.67% cpu : usr=0.00%, sys=3.46%, ctx=55, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3460KiB/s (3543kB/s), 933KiB/s-2595KiB/s (955kB/s-2657kB/s), io=16.0MiB (16.8MB), run=4390-4735msec WRITE: bw=6181KiB/s (6330kB/s), 1866KiB/s-2471KiB/s (1911kB/s-2530kB/s), io=32.0MiB (33.6MB), run=4390-5301msec rand-rw: (groupid=0, jobs=1): err= 0: pid=145009: Sun Sep 6 22:49:42 2026 read: IOPS=0, BW=2477KiB/s (2537kB/s)(12.0MiB/4960msec) clat (msec): min=438, max=4027, avg=1637.37, stdev=2070.27 lat (msec): min=438, max=4027, avg=1637.37, stdev=2070.27 clat percentiles (msec): | 1.00th=[ 439], 5.00th=[ 439], 10.00th=[ 439], 20.00th=[ 439], | 30.00th=[ 439], 40.00th=[ 447], 50.00th=[ 447], 60.00th=[ 447], | 70.00th=[ 4044], 80.00th=[ 4044], 90.00th=[ 4044], 95.00th=[ 4044], | 99.00th=[ 4044], 99.50th=[ 4044], 99.90th=[ 4044], 99.95th=[ 4044], | 99.99th=[ 4044] bw ( KiB/s): min= 8094, max= 8159, per=100.00%, avg=8126.50, stdev=45.96, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=66.67%, >=2000=33.33% cpu : usr=0.00%, sys=10.97%, ctx=1263, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145010: Sun Sep 6 22:49:42 2026 read: IOPS=0, BW=1440KiB/s (1475kB/s)(4096KiB/2844msec) clat (nsec): min=505382k, max=505382k, avg=505382430.00, stdev= 0.00 lat (nsec): min=505385k, max=505385k, avg=505385461.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 506], 5.00th=[ 506], 10.00th=[ 506], 20.00th=[ 506], | 30.00th=[ 506], 40.00th=[ 506], 50.00th=[ 506], 60.00th=[ 506], | 70.00th=[ 506], 80.00th=[ 506], 90.00th=[ 506], 95.00th=[ 506], | 99.00th=[ 506], 99.50th=[ 506], 99.90th=[ 506], 99.95th=[ 506], | 99.99th=[ 506] bw ( KiB/s): min= 8192, max= 8192, per=100.00%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2880KiB/s (2950kB/s)(8192KiB/2844msec); 0 zone resets clat (msec): min=150, max=2133, avg=1142.30, stdev=1402.21 lat (msec): min=151, max=2134, avg=1142.85, stdev=1402.14 clat percentiles (msec): | 1.00th=[ 150], 5.00th=[ 150], 10.00th=[ 150], 20.00th=[ 150], | 30.00th=[ 150], 40.00th=[ 150], 50.00th=[ 150], 60.00th=[ 2140], | 70.00th=[ 2140], 80.00th=[ 2140], 90.00th=[ 2140], 95.00th=[ 2140], | 99.00th=[ 2140], 99.50th=[ 2140], 99.90th=[ 2140], 99.95th=[ 2140], | 99.99th=[ 2140] lat (msec) : 250=33.33%, 750=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=8.20%, ctx=102, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145011: Sun Sep 6 22:49:42 2026 write: IOPS=0, BW=2223KiB/s (2276kB/s)(12.0MiB/5528msec); 0 zone resets clat (msec): min=261, max=4754, avg=1827.79, stdev=2536.48 lat (msec): min=262, max=4754, avg=1828.29, stdev=2536.41 clat percentiles (msec): | 1.00th=[ 262], 5.00th=[ 262], 10.00th=[ 262], 20.00th=[ 262], | 30.00th=[ 262], 40.00th=[ 468], 50.00th=[ 468], 60.00th=[ 468], | 70.00th=[ 4732], 80.00th=[ 4732], 90.00th=[ 4732], 95.00th=[ 4732], | 99.00th=[ 4732], 99.50th=[ 4732], 99.90th=[ 4732], 99.95th=[ 4732], | 99.99th=[ 4732] bw ( KiB/s): min= 8192, max= 8192, per=100.00%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 500=66.67%, >=2000=33.33% cpu : usr=0.00%, sys=4.29%, ctx=72, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145012: Sun Sep 6 22:49:42 2026 write: IOPS=0, BW=2470KiB/s (2529kB/s)(12.0MiB/4975msec); 0 zone resets clat (msec): min=211, max=2606, avg=1653.90, stdev=1270.09 lat (msec): min=212, max=2606, avg=1654.73, stdev=1270.05 clat percentiles (msec): | 1.00th=[ 213], 5.00th=[ 213], 10.00th=[ 213], 20.00th=[ 213], | 30.00th=[ 213], 40.00th=[ 2140], 50.00th=[ 2140], 60.00th=[ 2140], | 70.00th=[ 2601], 80.00th=[ 2601], 90.00th=[ 2601], 95.00th=[ 2601], | 99.00th=[ 2601], 99.50th=[ 2601], 99.90th=[ 2601], 99.95th=[ 2601], | 99.99th=[ 2601] bw ( KiB/s): min= 8126, max= 8192, per=100.00%, avg=8159.00, stdev=46.67, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 250=33.33%, >=2000=66.67% cpu : usr=0.00%, sys=2.69%, ctx=45, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3303KiB/s (3383kB/s), 1440KiB/s-2477KiB/s (1475kB/s-2537kB/s), io=16.0MiB (16.8MB), run=2844-4960msec WRITE: bw=5928KiB/s (6070kB/s), 2223KiB/s-2880KiB/s (2276kB/s-2950kB/s), io=32.0MiB (33.6MB), run=2844-5528msec