== sanity test 398b: DIO and buffer IO race ============== 09:50:08 (1788616208) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 5.30069 s, 9.5 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=145704: Sat Sep 5 09:52:20 2026 read: IOPS=12, BW=51.0KiB/s (53.2kB/s)(5992KiB/115234msec) clat (usec): min=32, max=912282, avg=36995.92, stdev=36361.37 lat (usec): min=32, max=912283, avg=36997.52, stdev=36361.48 clat percentiles (usec): | 1.00th=[ 46], 5.00th=[ 55], 10.00th=[ 87], 20.00th=[ 16188], | 30.00th=[ 21103], 40.00th=[ 25560], 50.00th=[ 30016], 60.00th=[ 35914], | 70.00th=[ 44303], 80.00th=[ 55313], 90.00th=[ 72877], 95.00th=[ 92799], | 99.00th=[137364], 99.50th=[164627], 99.90th=[221250], 99.95th=[910164], | 99.99th=[910164] bw ( KiB/s): min= 7, max= 127, per=25.04%, avg=52.08, stdev=21.92, samples=225 iops : min= 1, max= 31, avg=12.38, stdev= 5.51, samples=225 write: IOPS=13, BW=54.6KiB/s (55.9kB/s)(6296KiB/115234msec); 0 zone resets clat (usec): min=942, max=625006, avg=37784.42, stdev=40891.31 lat (usec): min=943, max=625007, avg=37787.08, stdev=40892.17 clat percentiles (usec): | 1.00th=[ 1037], 5.00th=[ 1139], 10.00th=[ 1450], 20.00th=[ 3589], | 30.00th=[ 7439], 40.00th=[ 17433], 50.00th=[ 28181], 60.00th=[ 38536], | 70.00th=[ 49021], 80.00th=[ 65274], 90.00th=[ 90702], 95.00th=[111674], | 99.00th=[158335], 99.50th=[187696], 99.90th=[304088], 99.95th=[624952], | 99.99th=[624952] bw ( KiB/s): min= 7, max= 111, per=25.23%, avg=54.99, stdev=21.93, samples=224 iops : min= 1, max= 27, avg=13.09, stdev= 5.52, samples=224 lat (usec) : 50=1.11%, 100=3.94%, 250=0.23%, 500=0.10%, 750=0.07% lat (usec) : 1000=0.16% lat (msec) : 2=7.23%, 4=3.97%, 10=6.22%, 20=12.40%, 50=37.89% lat (msec) : 100=21.26%, 250=5.31%, 500=0.07%, 750=0.03%, 1000=0.03% cpu : usr=0.06%, sys=4.98%, ctx=6329, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145705: Sat Sep 5 09:52:20 2026 read: IOPS=12, BW=51.6KiB/s (52.8kB/s)(5940KiB/115169msec) clat (usec): min=28, max=362620, avg=35931.98, stdev=29051.98 lat (usec): min=28, max=362621, avg=35935.35, stdev=29054.51 clat percentiles (usec): | 1.00th=[ 45], 5.00th=[ 55], 10.00th=[ 71], 20.00th=[ 14615], | 30.00th=[ 20055], 40.00th=[ 24511], 50.00th=[ 29754], 60.00th=[ 36963], | 70.00th=[ 44827], 80.00th=[ 55837], 90.00th=[ 73925], 95.00th=[ 88605], | 99.00th=[123208], 99.50th=[132645], 99.90th=[231736], 99.95th=[362808], | 99.99th=[362808] bw ( KiB/s): min= 7, max= 140, per=24.86%, avg=51.71, stdev=23.32, samples=225 iops : min= 1, max= 35, avg=12.28, stdev= 5.87, samples=225 write: IOPS=13, BW=55.1KiB/s (56.4kB/s)(6348KiB/115169msec); 0 zone resets clat (usec): min=905, max=868990, avg=38729.39, stdev=46796.81 lat (usec): min=906, max=868992, avg=38735.45, stdev=46797.06 clat percentiles (usec): | 1.00th=[ 1029], 5.00th=[ 1139], 10.00th=[ 1352], 20.00th=[ 3130], | 30.00th=[ 7111], 40.00th=[ 16188], 50.00th=[ 27395], 60.00th=[ 37487], | 70.00th=[ 49546], 80.00th=[ 66847], 90.00th=[ 89654], 95.00th=[116917], | 99.00th=[183501], 99.50th=[227541], 99.90th=[434111], 99.95th=[868221], | 99.99th=[868221] bw ( KiB/s): min= 7, max= 156, per=25.26%, avg=55.06, stdev=24.80, samples=226 iops : min= 1, max= 39, avg=13.12, stdev= 6.24, samples=226 lat (usec) : 50=1.07%, 100=4.62%, 250=0.49%, 500=0.03%, 750=0.07% lat (usec) : 1000=0.36% lat (msec) : 2=7.55%, 4=4.07%, 10=6.54%, 20=11.85%, 50=35.51% lat (msec) : 100=22.62%, 250=5.01%, 500=0.16%, 1000=0.03% cpu : usr=0.08%, sys=5.15%, ctx=6338, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145706: Sat Sep 5 09:52:20 2026 read: IOPS=13, BW=52.4KiB/s (53.6kB/s)(6028KiB/115130msec) clat (usec): min=34, max=924564, avg=36825.08, stdev=37162.15 lat (usec): min=34, max=924565, avg=36828.91, stdev=37160.82 clat percentiles (usec): | 1.00th=[ 41], 5.00th=[ 55], 10.00th=[ 65], 20.00th=[ 15795], | 30.00th=[ 19792], 40.00th=[ 23987], 50.00th=[ 29754], 60.00th=[ 35914], | 70.00th=[ 44827], 80.00th=[ 54264], 90.00th=[ 73925], 95.00th=[ 92799], | 99.00th=[132645], 99.50th=[166724], 99.90th=[223347], 99.95th=[926942], | 99.99th=[926942] bw ( KiB/s): min= 7, max= 111, per=25.25%, avg=52.52, stdev=21.75, samples=225 iops : min= 1, max= 27, avg=12.48, stdev= 5.46, samples=225 write: IOPS=13, BW=54.4KiB/s (55.7kB/s)(6260KiB/115130msec); 0 zone resets clat (usec): min=880, max=348812, avg=37884.02, stdev=39444.15 lat (usec): min=881, max=348813, avg=37885.66, stdev=39443.89 clat percentiles (usec): | 1.00th=[ 1045], 5.00th=[ 1156], 10.00th=[ 1401], 20.00th=[ 3326], | 30.00th=[ 6849], 40.00th=[ 17171], 50.00th=[ 27919], 60.00th=[ 37487], | 70.00th=[ 50070], 80.00th=[ 66323], 90.00th=[ 92799], 95.00th=[111674], | 99.00th=[173016], 99.50th=[187696], 99.90th=[267387], 99.95th=[350225], | 99.99th=[350225] bw ( KiB/s): min= 7, max= 135, per=24.78%, avg=54.01, stdev=22.81, samples=227 iops : min= 1, max= 33, avg=12.86, stdev= 5.73, samples=227 lat (usec) : 50=1.27%, 100=4.07%, 250=0.36%, 500=0.07%, 750=0.03% lat (usec) : 1000=0.26% lat (msec) : 2=7.13%, 4=3.87%, 10=6.77%, 20=12.66%, 50=36.10% lat (msec) : 100=21.68%, 250=5.60%, 500=0.10%, 1000=0.03% cpu : usr=0.07%, sys=5.21%, ctx=6396, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145707: Sat Sep 5 09:52:20 2026 read: IOPS=13, BW=53.5KiB/s (54.7kB/s)(6052KiB/113204msec) clat (usec): min=27, max=825677, avg=35812.20, stdev=34630.07 lat (usec): min=27, max=825678, avg=35816.81, stdev=34630.42 clat percentiles (usec): | 1.00th=[ 45], 5.00th=[ 55], 10.00th=[ 64], 20.00th=[ 15401], | 30.00th=[ 19792], 40.00th=[ 24773], 50.00th=[ 29230], 60.00th=[ 34866], | 70.00th=[ 43779], 80.00th=[ 54264], 90.00th=[ 70779], 95.00th=[ 86508], | 99.00th=[130548], 99.50th=[162530], 99.90th=[250610], 99.95th=[826278], | 99.99th=[826278] bw ( KiB/s): min= 7, max= 135, per=25.59%, avg=53.22, stdev=23.44, samples=223 iops : min= 1, max= 33, avg=12.66, stdev= 5.90, samples=223 write: IOPS=13, BW=55.1KiB/s (56.4kB/s)(6236KiB/113204msec); 0 zone resets clat (usec): min=848, max=476340, avg=37637.85, stdev=39698.22 lat (usec): min=849, max=476340, avg=37640.98, stdev=39698.79 clat percentiles (usec): | 1.00th=[ 1020], 5.00th=[ 1106], 10.00th=[ 1401], 20.00th=[ 3556], | 30.00th=[ 7504], 40.00th=[ 16188], 50.00th=[ 27395], 60.00th=[ 39060], | 70.00th=[ 50594], 80.00th=[ 64750], 90.00th=[ 87557], 95.00th=[113771], | 99.00th=[162530], 99.50th=[185598], 99.90th=[312476], 99.95th=[476054], | 99.99th=[476054] bw ( KiB/s): min= 15, max= 135, per=25.23%, avg=55.00, stdev=22.64, samples=222 iops : min= 3, max= 33, avg=13.11, stdev= 5.69, samples=222 lat (usec) : 50=1.40%, 100=4.75%, 250=0.16%, 500=0.07%, 1000=0.26% lat (msec) : 2=6.87%, 4=4.30%, 10=5.79%, 20=13.12%, 50=36.07% lat (msec) : 100=21.94%, 250=5.18%, 500=0.07%, 1000=0.03% cpu : usr=0.07%, sys=5.09%, ctx=6334, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=208KiB/s (213kB/s), 51.6KiB/s-53.5KiB/s (52.8kB/s-54.7kB/s), io=23.4MiB (24.6MB), run=113204-115234msec WRITE: bw=218KiB/s (223kB/s), 54.4KiB/s-55.1KiB/s (55.7kB/s-56.4kB/s), io=24.6MiB (25.7MB), run=113204-115234msec rand-rw: (groupid=0, jobs=1): err= 0: pid=145700: Sat Sep 5 09:54:09 2026 read: IOPS=6, BW=26.7KiB/s (27.3kB/s)(5992KiB/224371msec) clat (msec): min=4, max=924, avg=30.06, stdev=38.91 lat (msec): min=4, max=924, avg=30.06, stdev=38.91 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 11], | 30.00th=[ 14], 40.00th=[ 15], 50.00th=[ 18], 60.00th=[ 21], | 70.00th=[ 27], 80.00th=[ 41], 90.00th=[ 68], 95.00th=[ 100], | 99.00th=[ 163], 99.50th=[ 207], 99.90th=[ 271], 99.95th=[ 927], | 99.99th=[ 927] bw ( KiB/s): min= 7, max= 111, per=27.64%, avg=29.58, stdev=19.83, samples=394 iops : min= 1, max= 27, avg= 6.79, stdev= 5.02, samples=394 write: IOPS=7, BW=28.1KiB/s (28.7kB/s)(6296KiB/224371msec); 0 zone resets clat (msec): min=34, max=513, avg=113.74, stdev=58.22 lat (msec): min=34, max=513, avg=113.74, stdev=58.22 clat percentiles (msec): | 1.00th=[ 43], 5.00th=[ 53], 10.00th=[ 61], 20.00th=[ 70], | 30.00th=[ 79], 40.00th=[ 87], 50.00th=[ 96], 60.00th=[ 109], | 70.00th=[ 125], 80.00th=[ 153], 90.00th=[ 194], 95.00th=[ 236], | 99.00th=[ 313], 99.50th=[ 347], 99.90th=[ 368], 99.95th=[ 514], | 99.99th=[ 514] bw ( KiB/s): min= 7, max= 56, per=24.77%, avg=27.75, stdev=13.46, samples=440 iops : min= 1, max= 14, avg= 6.33, stdev= 3.45, samples=440 lat (msec) : 10=7.26%, 20=20.74%, 50=14.52%, 100=31.22%, 250=24.45% lat (msec) : 500=1.76%, 750=0.03%, 1000=0.03% cpu : usr=0.03%, sys=1.15%, ctx=5111, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145701: Sat Sep 5 09:54:09 2026 read: IOPS=6, BW=26.5KiB/s (27.1kB/s)(5940KiB/224328msec) clat (msec): min=4, max=853, avg=29.46, stdev=38.41 lat (msec): min=4, max=853, avg=29.46, stdev=38.41 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 11], | 30.00th=[ 13], 40.00th=[ 15], 50.00th=[ 17], 60.00th=[ 21], | 70.00th=[ 27], 80.00th=[ 40], 90.00th=[ 71], 95.00th=[ 96], | 99.00th=[ 136], 99.50th=[ 174], 99.90th=[ 447], 99.95th=[ 852], | 99.99th=[ 852] bw ( KiB/s): min= 7, max= 112, per=27.43%, avg=29.35, stdev=20.17, samples=393 iops : min= 1, max= 28, avg= 6.74, stdev= 5.11, samples=393 write: IOPS=7, BW=28.3KiB/s (28.0kB/s)(6348KiB/224328msec); 0 zone resets clat (msec): min=30, max=631, avg=113.57, stdev=58.98 lat (msec): min=30, max=631, avg=113.57, stdev=58.98 clat percentiles (msec): | 1.00th=[ 43], 5.00th=[ 52], 10.00th=[ 59], 20.00th=[ 69], | 30.00th=[ 78], 40.00th=[ 87], 50.00th=[ 96], 60.00th=[ 109], | 70.00th=[ 128], 80.00th=[ 155], 90.00th=[ 194], 95.00th=[ 226], | 99.00th=[ 326], 99.50th=[ 355], 99.90th=[ 414], 99.95th=[ 634], | 99.99th=[ 634] bw ( KiB/s): min= 7, max= 56, per=24.99%, avg=27.98, stdev=13.25, samples=440 iops : min= 1, max= 14, avg= 6.39, stdev= 3.41, samples=440 lat (msec) : 10=7.68%, 20=21.22%, 50=13.93%, 100=30.83%, 250=24.54% lat (msec) : 500=1.73%, 750=0.03%, 1000=0.03% cpu : usr=0.04%, sys=1.16%, ctx=5275, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145702: Sat Sep 5 09:54:09 2026 read: IOPS=6, BW=26.9KiB/s (27.5kB/s)(6028KiB/224082msec) clat (msec): min=5, max=337, avg=31.03, stdev=33.24 lat (msec): min=5, max=337, avg=31.03, stdev=33.24 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 12], | 30.00th=[ 14], 40.00th=[ 16], 50.00th=[ 19], 60.00th=[ 23], | 70.00th=[ 31], 80.00th=[ 44], 90.00th=[ 71], 95.00th=[ 96], | 99.00th=[ 169], 99.50th=[ 201], 99.90th=[ 271], 99.95th=[ 338], | 99.99th=[ 338] bw ( KiB/s): min= 7, max= 120, per=26.28%, avg=28.12, stdev=20.42, samples=416 iops : min= 1, max= 30, avg= 6.42, stdev= 5.16, samples=416 write: IOPS=6, BW=27.9KiB/s (28.6kB/s)(6260KiB/224082msec); 0 zone resets clat (msec): min=35, max=956, avg=113.10, stdev=61.64 lat (msec): min=35, max=956, avg=113.11, stdev=61.64 clat percentiles (msec): | 1.00th=[ 43], 5.00th=[ 52], 10.00th=[ 58], 20.00th=[ 68], | 30.00th=[ 79], 40.00th=[ 88], 50.00th=[ 96], 60.00th=[ 107], | 70.00th=[ 126], 80.00th=[ 153], 90.00th=[ 188], 95.00th=[ 230], | 99.00th=[ 321], 99.50th=[ 376], 99.90th=[ 493], 99.95th=[ 953], | 99.99th=[ 953] bw ( KiB/s): min= 7, max= 56, per=24.65%, avg=27.61, stdev=13.63, samples=439 iops : min= 1, max= 14, avg= 6.30, stdev= 3.48, samples=439 lat (msec) : 10=6.84%, 20=20.02%, 50=16.02%, 100=31.64%, 250=23.67% lat (msec) : 500=1.79%, 1000=0.03% cpu : usr=0.04%, sys=1.15%, ctx=5154, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145703: Sat Sep 5 09:54:09 2026 read: IOPS=6, BW=27.2KiB/s (27.8kB/s)(6052KiB/222800msec) clat (msec): min=4, max=257, avg=28.95, stdev=30.26 lat (msec): min=4, max=257, avg=28.96, stdev=30.26 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 11], | 30.00th=[ 13], 40.00th=[ 15], 50.00th=[ 18], 60.00th=[ 21], | 70.00th=[ 28], 80.00th=[ 42], 90.00th=[ 71], 95.00th=[ 94], | 99.00th=[ 144], 99.50th=[ 171], 99.90th=[ 247], 99.95th=[ 257], | 99.99th=[ 257] bw ( KiB/s): min= 7, max= 118, per=28.00%, avg=29.96, stdev=20.55, samples=393 iops : min= 1, max= 29, avg= 6.89, stdev= 5.18, samples=393 write: IOPS=6, BW=27.0KiB/s (28.7kB/s)(6236KiB/222800msec); 0 zone resets clat (msec): min=27, max=1003, avg=114.61, stdev=65.78 lat (msec): min=27, max=1003, avg=114.61, stdev=65.78 clat percentiles (msec): | 1.00th=[ 42], 5.00th=[ 52], 10.00th=[ 58], 20.00th=[ 68], | 30.00th=[ 77], 40.00th=[ 86], 50.00th=[ 96], 60.00th=[ 109], | 70.00th=[ 126], 80.00th=[ 155], 90.00th=[ 201], 95.00th=[ 241], | 99.00th=[ 338], 99.50th=[ 368], 99.90th=[ 634], 99.95th=[ 1003], | 99.99th=[ 1003] bw ( KiB/s): min= 7, max= 63, per=24.78%, avg=27.76, stdev=13.46, samples=436 iops : min= 1, max= 15, avg= 6.33, stdev= 3.45, samples=436 lat (msec) : 10=8.69%, 20=20.35%, 50=14.49%, 100=30.73%, 250=23.63% lat (msec) : 500=2.05%, 750=0.03%, 2000=0.03% cpu : usr=0.03%, sys=1.18%, ctx=5275, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=107KiB/s (110kB/s), 26.5KiB/s-27.2KiB/s (27.1kB/s-27.8kB/s), io=23.4MiB (24.6MB), run=222800-224371msec WRITE: bw=112KiB/s (115kB/s), 27.9KiB/s-28.3KiB/s (28.6kB/s-28.0kB/s), io=24.6MiB (25.7MB), run=222800-224371msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=145757: Sat Sep 5 09:54:40 2026 read: IOPS=15, BW=255KiB/s (261kB/s)(5920KiB/23182msec) clat (usec): min=31, max=168113, avg=32177.90, stdev=27987.89 lat (usec): min=32, max=168114, avg=32178.95, stdev=27987.92 clat percentiles (usec): | 1.00th=[ 38], 5.00th=[ 51], 10.00th=[ 56], 20.00th=[ 97], | 30.00th=[ 18220], 40.00th=[ 23200], 50.00th=[ 29492], 60.00th=[ 33817], | 70.00th=[ 40633], 80.00th=[ 51643], 90.00th=[ 69731], 95.00th=[ 82314], | 99.00th=[128451], 99.50th=[160433], 99.90th=[168821], 99.95th=[168821], | 99.99th=[168821] bw ( KiB/s): min= 62, max= 476, per=24.52%, avg=249.38, stdev=82.73, samples=45 iops : min= 3, max= 29, avg=14.78, stdev= 5.19, samples=45 write: IOPS=17, BW=275KiB/s (281kB/s)(6368KiB/23182msec); 0 zone resets clat (usec): min=1250, max=155150, avg=27927.14, stdev=28166.96 lat (usec): min=1250, max=155153, avg=27941.20, stdev=28160.51 clat percentiles (usec): | 1.00th=[ 1369], 5.00th=[ 1631], 10.00th=[ 2147], 20.00th=[ 4883], | 30.00th=[ 7439], 40.00th=[ 11076], 50.00th=[ 19006], 60.00th=[ 26084], | 70.00th=[ 36963], 80.00th=[ 46924], 90.00th=[ 69731], 95.00th=[ 85459], | 99.00th=[114820], 99.50th=[141558], 99.90th=[154141], 99.95th=[154141], | 99.99th=[154141] bw ( KiB/s): min= 31, max= 506, per=25.41%, avg=271.93, stdev=108.31, samples=45 iops : min= 1, max= 31, avg=16.22, stdev= 6.81, samples=45 lat (usec) : 50=2.21%, 100=7.42%, 250=0.65%, 500=0.52% lat (msec) : 2=4.82%, 4=4.82%, 10=10.16%, 20=11.98%, 50=37.50% lat (msec) : 100=17.71%, 250=2.21% cpu : usr=0.06%, sys=6.52%, ctx=1441, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145758: Sat Sep 5 09:54:40 2026 read: IOPS=15, BW=244KiB/s (250kB/s)(5744KiB/23543msec) clat (usec): min=40, max=129350, avg=32497.69, stdev=25042.13 lat (usec): min=41, max=129351, avg=32498.79, stdev=25042.10 clat percentiles (usec): | 1.00th=[ 49], 5.00th=[ 57], 10.00th=[ 62], 20.00th=[ 3195], | 30.00th=[ 20317], 40.00th=[ 25560], 50.00th=[ 31589], 60.00th=[ 36439], | 70.00th=[ 42206], 80.00th=[ 49546], 90.00th=[ 65799], 95.00th=[ 79168], | 99.00th=[107480], 99.50th=[122160], 99.90th=[129500], 99.95th=[129500], | 99.99th=[129500] bw ( KiB/s): min= 28, max= 445, per=23.80%, avg=242.09, stdev=96.51, samples=46 iops : min= 1, max= 27, avg=14.35, stdev= 6.07, samples=46 write: IOPS=17, BW=278KiB/s (285kB/s)(6544KiB/23543msec); 0 zone resets clat (usec): min=1340, max=252860, avg=28661.17, stdev=33822.01 lat (usec): min=1342, max=252862, avg=28666.25, stdev=33824.44 clat percentiles (usec): | 1.00th=[ 1434], 5.00th=[ 1614], 10.00th=[ 1942], 20.00th=[ 3261], | 30.00th=[ 5145], 40.00th=[ 7701], 50.00th=[ 16450], 60.00th=[ 25035], | 70.00th=[ 36963], 80.00th=[ 50070], 90.00th=[ 73925], 95.00th=[ 92799], | 99.00th=[132645], 99.50th=[187696], 99.90th=[252707], 99.95th=[252707], | 99.99th=[252707] bw ( KiB/s): min= 94, max= 792, per=25.64%, avg=274.35, stdev=124.50, samples=46 iops : min= 5, max= 49, avg=16.37, stdev= 7.84, samples=46 lat (usec) : 50=0.65%, 100=7.81%, 250=0.65%, 750=0.13% lat (msec) : 2=5.73%, 4=7.42%, 10=10.68%, 20=9.64%, 50=37.63% lat (msec) : 100=16.93%, 250=2.60%, 500=0.13% cpu : usr=0.04%, sys=6.15%, ctx=1419, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145760: Sat Sep 5 09:54:40 2026 read: IOPS=16, BW=271KiB/s (278kB/s)(6256KiB/23079msec) clat (usec): min=34, max=158141, avg=31645.49, stdev=26905.62 lat (usec): min=34, max=158142, avg=31647.40, stdev=26905.07 clat percentiles (usec): | 1.00th=[ 42], 5.00th=[ 55], 10.00th=[ 59], 20.00th=[ 115], | 30.00th=[ 17171], 40.00th=[ 22414], 50.00th=[ 28705], 60.00th=[ 34866], | 70.00th=[ 41681], 80.00th=[ 50070], 90.00th=[ 69731], 95.00th=[ 79168], | 99.00th=[123208], 99.50th=[126354], 99.90th=[158335], 99.95th=[158335], | 99.99th=[158335] bw ( KiB/s): min= 95, max= 504, per=26.86%, avg=273.16, stdev=101.44, samples=45 iops : min= 5, max= 31, avg=16.31, stdev= 6.39, samples=45 write: IOPS=16, BW=261KiB/s (268kB/s)(6032KiB/23079msec); 0 zone resets clat (usec): min=1244, max=177614, avg=27866.05, stdev=30577.89 lat (usec): min=1245, max=177616, avg=27867.84, stdev=30577.94 clat percentiles (usec): | 1.00th=[ 1500], 5.00th=[ 1713], 10.00th=[ 2671], 20.00th=[ 4293], | 30.00th=[ 6390], 40.00th=[ 10028], 50.00th=[ 17171], 60.00th=[ 24511], | 70.00th=[ 35390], 80.00th=[ 50070], 90.00th=[ 67634], 95.00th=[ 86508], | 99.00th=[156238], 99.50th=[168821], 99.90th=[177210], 99.95th=[177210], | 99.99th=[177210] bw ( KiB/s): min= 63, max= 475, per=24.16%, avg=258.53, stdev=95.99, samples=45 iops : min= 3, max= 29, avg=15.38, stdev= 6.01, samples=45 lat (usec) : 50=1.82%, 100=8.20%, 250=1.17%, 500=0.26%, 750=0.13% lat (msec) : 2=3.91%, 4=5.21%, 10=11.33%, 20=13.02%, 50=34.64% lat (msec) : 100=17.58%, 250=2.73% cpu : usr=0.07%, sys=6.68%, ctx=1470, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145761: Sat Sep 5 09:54:40 2026 read: IOPS=16, BW=263KiB/s (269kB/s)(6032KiB/22960msec) clat (usec): min=34, max=289625, avg=31169.54, stdev=30252.53 lat (usec): min=34, max=289626, avg=31170.58, stdev=30252.54 clat percentiles (usec): | 1.00th=[ 38], 5.00th=[ 53], 10.00th=[ 58], 20.00th=[ 84], | 30.00th=[ 16319], 40.00th=[ 22152], 50.00th=[ 28443], 60.00th=[ 33424], | 70.00th=[ 39060], 80.00th=[ 47973], 90.00th=[ 62653], 95.00th=[ 76022], | 99.00th=[154141], 99.50th=[158335], 99.90th=[291505], 99.95th=[291505], | 99.99th=[291505] bw ( KiB/s): min= 114, max= 538, per=25.62%, avg=260.53, stdev=95.13, samples=45 iops : min= 7, max= 33, avg=15.51, stdev= 5.94, samples=45 write: IOPS=17, BW=272KiB/s (279kB/s)(6256KiB/22960msec); 0 zone resets clat (usec): min=1134, max=215770, avg=28537.22, stdev=32180.44 lat (usec): min=1136, max=215773, avg=28539.30, stdev=32180.56 clat percentiles (usec): | 1.00th=[ 1467], 5.00th=[ 1663], 10.00th=[ 2147], 20.00th=[ 3687], | 30.00th=[ 6063], 40.00th=[ 10945], 50.00th=[ 16909], 60.00th=[ 27919], | 70.00th=[ 35914], 80.00th=[ 49546], 90.00th=[ 66323], 95.00th=[ 83362], | 99.00th=[154141], 99.50th=[204473], 99.90th=[214959], 99.95th=[214959], | 99.99th=[214959] bw ( KiB/s): min= 62, max= 510, per=25.46%, avg=272.47, stdev=99.69, samples=45 iops : min= 3, max= 31, avg=16.24, stdev= 6.23, samples=45 lat (usec) : 50=1.95%, 100=8.72%, 250=0.78%, 500=0.13% lat (msec) : 2=4.17%, 4=6.90%, 10=9.38%, 20=12.63%, 50=36.20% lat (msec) : 100=16.54%, 250=2.47%, 500=0.13% cpu : usr=0.08%, sys=6.39%, ctx=1348, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1017KiB/s (1042kB/s), 244KiB/s-271KiB/s (250kB/s-278kB/s), io=23.4MiB (24.5MB), run=22960-23543msec WRITE: bw=1070KiB/s (1096kB/s), 261KiB/s-278KiB/s (268kB/s-285kB/s), io=24.6MiB (25.8MB), run=22960-23543msec rand-rw: (groupid=0, jobs=1): err= 0: pid=145762: Sat Sep 5 09:55:30 2026 read: IOPS=5, BW=81.0KiB/s (82.0kB/s)(5920KiB/73043msec) clat (msec): min=6, max=185, avg=41.13, stdev=27.32 lat (msec): min=6, max=185, avg=41.13, stdev=27.32 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 14], 10.00th=[ 16], 20.00th=[ 19], | 30.00th=[ 24], 40.00th=[ 30], 50.00th=[ 35], 60.00th=[ 40], | 70.00th=[ 47], 80.00th=[ 61], 90.00th=[ 77], 95.00th=[ 94], | 99.00th=[ 142], 99.50th=[ 174], 99.90th=[ 186], 99.95th=[ 186], | 99.99th=[ 186] bw ( KiB/s): min= 30, max= 256, per=27.05%, avg=87.90, stdev=51.63, samples=132 iops : min= 1, max= 16, avg= 4.74, stdev= 3.27, samples=132 write: IOPS=5, BW=87.2KiB/s (89.3kB/s)(6368KiB/73043msec); 0 zone resets clat (msec): min=42, max=340, avg=144.39, stdev=58.23 lat (msec): min=42, max=340, avg=144.40, stdev=58.23 clat percentiles (msec): | 1.00th=[ 50], 5.00th=[ 66], 10.00th=[ 78], 20.00th=[ 95], | 30.00th=[ 112], 40.00th=[ 124], 50.00th=[ 136], 60.00th=[ 146], | 70.00th=[ 163], 80.00th=[ 186], 90.00th=[ 215], 95.00th=[ 268], | 99.00th=[ 330], 99.50th=[ 342], 99.90th=[ 342], 99.95th=[ 342], | 99.99th=[ 342] bw ( KiB/s): min= 30, max= 159, per=25.51%, avg=87.25, stdev=30.86, samples=143 iops : min= 1, max= 9, avg= 4.69, stdev= 1.99, samples=143 lat (msec) : 10=0.78%, 20=10.42%, 50=23.83%, 100=23.05%, 250=38.41% lat (msec) : 500=3.52% cpu : usr=0.04%, sys=1.35%, ctx=1300, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145763: Sat Sep 5 09:55:30 2026 read: IOPS=4, BW=78.1KiB/s (80.0kB/s)(5744KiB/73515msec) clat (msec): min=6, max=197, avg=42.78, stdev=31.54 lat (msec): min=6, max=197, avg=42.78, stdev=31.54 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 13], 10.00th=[ 17], 20.00th=[ 22], | 30.00th=[ 25], 40.00th=[ 29], 50.00th=[ 34], 60.00th=[ 40], | 70.00th=[ 50], 80.00th=[ 57], 90.00th=[ 78], 95.00th=[ 104], | 99.00th=[ 182], 99.50th=[ 194], 99.90th=[ 197], 99.95th=[ 197], | 99.99th=[ 197] bw ( KiB/s): min= 30, max= 320, per=28.31%, avg=92.02, stdev=54.72, samples=122 iops : min= 1, max= 20, avg= 5.00, stdev= 3.52, samples=122 write: IOPS=5, BW=89.0KiB/s (91.2kB/s)(6544KiB/73515msec); 0 zone resets clat (msec): min=43, max=384, avg=141.61, stdev=56.88 lat (msec): min=43, max=384, avg=141.61, stdev=56.88 clat percentiles (msec): | 1.00th=[ 52], 5.00th=[ 67], 10.00th=[ 77], 20.00th=[ 94], | 30.00th=[ 106], 40.00th=[ 118], 50.00th=[ 133], 60.00th=[ 146], | 70.00th=[ 165], 80.00th=[ 190], 90.00th=[ 215], 95.00th=[ 245], | 99.00th=[ 321], 99.50th=[ 347], 99.90th=[ 384], 99.95th=[ 384], | 99.99th=[ 384] bw ( KiB/s): min= 30, max= 159, per=26.09%, avg=89.24, stdev=33.57, samples=144 iops : min= 1, max= 9, avg= 4.82, stdev= 2.16, samples=144 lat (msec) : 10=0.52%, 20=7.68%, 50=25.78%, 100=23.57%, 250=39.97% lat (msec) : 500=2.47% cpu : usr=0.02%, sys=1.16%, ctx=1287, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145764: Sat Sep 5 09:55:30 2026 read: IOPS=5, BW=89.3KiB/s (91.5kB/s)(6256KiB/70020msec) clat (msec): min=6, max=217, avg=38.84, stdev=30.67 lat (msec): min=7, max=217, avg=38.85, stdev=30.67 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 15], 20.00th=[ 19], | 30.00th=[ 22], 40.00th=[ 26], 50.00th=[ 30], 60.00th=[ 36], | 70.00th=[ 43], 80.00th=[ 52], 90.00th=[ 72], 95.00th=[ 104], | 99.00th=[ 194], 99.50th=[ 209], 99.90th=[ 218], 99.95th=[ 218], | 99.99th=[ 218] bw ( KiB/s): min= 30, max= 320, per=29.89%, avg=97.13, stdev=62.57, samples=127 iops : min= 1, max= 20, avg= 5.30, stdev= 3.97, samples=127 write: IOPS=5, BW=86.1KiB/s (88.2kB/s)(6032KiB/70020msec); 0 zone resets clat (msec): min=44, max=339, avg=144.65, stdev=56.90 lat (msec): min=44, max=339, avg=144.65, stdev=56.90 clat percentiles (msec): | 1.00th=[ 52], 5.00th=[ 65], 10.00th=[ 79], 20.00th=[ 99], | 30.00th=[ 110], 40.00th=[ 122], 50.00th=[ 133], 60.00th=[ 155], | 70.00th=[ 171], 80.00th=[ 190], 90.00th=[ 215], 95.00th=[ 257], | 99.00th=[ 309], 99.50th=[ 338], 99.90th=[ 338], 99.95th=[ 338], | 99.99th=[ 338] bw ( KiB/s): min= 29, max= 189, per=25.13%, avg=85.96, stdev=32.58, samples=137 iops : min= 1, max= 11, avg= 4.61, stdev= 2.09, samples=137 lat (msec) : 10=1.30%, 20=11.46%, 50=27.08%, 100=18.88%, 250=38.54% lat (msec) : 500=2.73% cpu : usr=0.03%, sys=1.21%, ctx=1401, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145765: Sat Sep 5 09:55:30 2026 read: IOPS=5, BW=83.9KiB/s (85.9kB/s)(6032KiB/71913msec) clat (msec): min=5, max=223, avg=41.69, stdev=34.22 lat (msec): min=5, max=223, avg=41.69, stdev=34.22 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 15], 20.00th=[ 18], | 30.00th=[ 22], 40.00th=[ 28], 50.00th=[ 32], 60.00th=[ 37], | 70.00th=[ 46], 80.00th=[ 58], 90.00th=[ 82], 95.00th=[ 111], | 99.00th=[ 201], 99.50th=[ 220], 99.90th=[ 224], 99.95th=[ 224], | 99.99th=[ 224] bw ( KiB/s): min= 30, max= 320, per=28.56%, avg=92.81, stdev=58.92, samples=127 iops : min= 1, max= 20, avg= 5.04, stdev= 3.72, samples=127 write: IOPS=5, BW=86.0KiB/s (89.1kB/s)(6256KiB/71913msec); 0 zone resets clat (msec): min=35, max=372, avg=143.51, stdev=56.07 lat (msec): min=35, max=372, avg=143.51, stdev=56.07 clat percentiles (msec): | 1.00th=[ 50], 5.00th=[ 73], 10.00th=[ 83], 20.00th=[ 94], | 30.00th=[ 109], 40.00th=[ 123], 50.00th=[ 136], 60.00th=[ 148], | 70.00th=[ 167], 80.00th=[ 184], 90.00th=[ 213], 95.00th=[ 262], | 99.00th=[ 313], 99.50th=[ 334], 99.90th=[ 372], 99.95th=[ 372], | 99.99th=[ 372] bw ( KiB/s): min= 30, max= 160, per=25.36%, avg=86.72, stdev=32.33, samples=142 iops : min= 1, max= 10, avg= 4.66, stdev= 2.11, samples=142 lat (msec) : 10=1.30%, 20=10.81%, 50=24.35%, 100=21.48%, 250=39.32% lat (msec) : 500=2.73% cpu : usr=0.03%, sys=1.22%, ctx=1344, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=326KiB/s (334kB/s), 78.1KiB/s-89.3KiB/s (80.0kB/s-91.5kB/s), io=23.4MiB (24.5MB), run=70020-73515msec WRITE: bw=343KiB/s (351kB/s), 86.1KiB/s-89.0KiB/s (88.2kB/s-91.2kB/s), io=24.6MiB (25.8MB), run=70020-73515msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=145782: Sat Sep 5 09:55:43 2026 read: IOPS=2, BW=2535KiB/s (2595kB/s)(7168KiB/2828msec) clat (msec): min=3, max=265, avg=167.14, stdev=89.34 lat (msec): min=3, max=265, avg=167.14, stdev=89.34 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 4], 10.00th=[ 4], 20.00th=[ 138], | 30.00th=[ 144], 40.00th=[ 144], 50.00th=[ 165], 60.00th=[ 190], | 70.00th=[ 190], 80.00th=[ 266], 90.00th=[ 266], 95.00th=[ 266], | 99.00th=[ 266], 99.50th=[ 266], 99.90th=[ 266], 99.95th=[ 266], | 99.99th=[ 266] bw ( KiB/s): min= 2023, max= 3871, per=49.15%, avg=2400.60, stdev=822.01, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 write: IOPS=1, BW=1810KiB/s (1854kB/s)(5120KiB/2828msec); 0 zone resets clat (msec): min=151, max=556, avg=326.56, stdev=179.18 lat (msec): min=151, max=556, avg=326.63, stdev=179.20 clat percentiles (msec): | 1.00th=[ 153], 5.00th=[ 153], 10.00th=[ 153], 20.00th=[ 153], | 30.00th=[ 159], 40.00th=[ 159], 50.00th=[ 309], 60.00th=[ 309], | 70.00th=[ 456], 80.00th=[ 456], 90.00th=[ 558], 95.00th=[ 558], | 99.00th=[ 558], 99.50th=[ 558], 99.90th=[ 558], 99.95th=[ 558], | 99.99th=[ 558] bw ( KiB/s): min= 2023, max= 4087, per=39.69%, avg=2713.67, stdev=1189.35, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (msec) : 4=8.33%, 250=50.00%, 500=33.33%, 750=8.33% cpu : usr=0.07%, sys=21.50%, ctx=235, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145783: Sat Sep 5 09:55:43 2026 read: IOPS=0, BW=488KiB/s (500kB/s)(2048KiB/4193msec) clat (usec): min=469, max=94898, avg=47683.80, stdev=66771.45 lat (usec): min=470, max=94901, avg=47686.04, stdev=66772.71 clat percentiles (usec): | 1.00th=[ 469], 5.00th=[ 469], 10.00th=[ 469], 20.00th=[ 469], | 30.00th=[ 469], 40.00th=[ 469], 50.00th=[ 469], 60.00th=[94897], | 70.00th=[94897], 80.00th=[94897], 90.00th=[94897], 95.00th=[94897], | 99.00th=[94897], 99.50th=[94897], 99.90th=[94897], 99.95th=[94897], | 99.99th=[94897] bw ( KiB/s): min= 1928, max= 2043, per=40.65%, avg=1985.50, stdev=81.32, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2442KiB/s (2501kB/s)(10.0MiB/4193msec); 0 zone resets clat (msec): min=105, max=773, avg=400.10, stdev=244.69 lat (msec): min=105, max=773, avg=400.20, stdev=244.68 clat percentiles (msec): | 1.00th=[ 106], 5.00th=[ 106], 10.00th=[ 106], 20.00th=[ 153], | 30.00th=[ 155], 40.00th=[ 271], 50.00th=[ 347], 60.00th=[ 372], | 70.00th=[ 456], 80.00th=[ 642], 90.00th=[ 726], 95.00th=[ 776], | 99.00th=[ 776], 99.50th=[ 776], 99.90th=[ 776], 99.95th=[ 776], | 99.99th=[ 776] bw ( KiB/s): min= 2023, max= 6107, per=44.67%, avg=3054.33, stdev=1706.33, samples=6 iops : min= 1, max= 5, avg= 2.00, stdev= 1.67, samples=6 lat (usec) : 500=8.33% lat (msec) : 100=8.33%, 250=25.00%, 500=33.33%, 750=16.67%, 1000=8.33% cpu : usr=0.10%, sys=17.72%, ctx=202, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145784: Sat Sep 5 09:55:43 2026 read: IOPS=1, BW=1905KiB/s (1950kB/s)(6144KiB/3226msec) clat (usec): min=417, max=207488, avg=100201.81, stdev=84484.31 lat (usec): min=418, max=207489, avg=100203.06, stdev=84484.25 clat percentiles (usec): | 1.00th=[ 416], 5.00th=[ 416], 10.00th=[ 416], 20.00th=[ 832], | 30.00th=[ 832], 40.00th=[103285], 50.00th=[103285], 60.00th=[131597], | 70.00th=[158335], 80.00th=[158335], 90.00th=[206570], 95.00th=[206570], | 99.00th=[206570], 99.50th=[206570], 99.90th=[206570], 99.95th=[206570], | 99.99th=[206570] bw ( KiB/s): min= 2043, max= 4087, per=69.46%, avg=3392.33, stdev=1168.73, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 write: IOPS=1, BW=1905KiB/s (1950kB/s)(6144KiB/3226msec); 0 zone resets clat (msec): min=153, max=561, avg=419.12, stdev=155.00 lat (msec): min=153, max=561, avg=419.17, stdev=154.99 clat percentiles (msec): | 1.00th=[ 155], 5.00th=[ 155], 10.00th=[ 155], 20.00th=[ 317], | 30.00th=[ 317], 40.00th=[ 460], 50.00th=[ 460], 60.00th=[ 502], | 70.00th=[ 523], 80.00th=[ 523], 90.00th=[ 558], 95.00th=[ 558], | 99.00th=[ 558], 99.50th=[ 558], 99.90th=[ 558], 99.95th=[ 558], | 99.99th=[ 558] bw ( KiB/s): min= 2023, max= 4071, per=37.17%, avg=2542.00, stdev=1019.37, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (usec) : 500=8.33%, 1000=8.33% lat (msec) : 250=41.67%, 500=16.67%, 750=25.00% cpu : usr=0.00%, sys=14.51%, ctx=138, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145785: Sat Sep 5 09:55:43 2026 read: IOPS=1, BW=1740KiB/s (1782kB/s)(5120KiB/2942msec) clat (usec): min=484, max=366180, avg=104197.68, stdev=159382.14 lat (usec): min=485, max=366181, avg=104198.70, stdev=159382.17 clat percentiles (usec): | 1.00th=[ 486], 5.00th=[ 486], 10.00th=[ 486], 20.00th=[ 486], | 30.00th=[ 2089], 40.00th=[ 2089], 50.00th=[ 4686], 60.00th=[ 4686], | 70.00th=[147850], 80.00th=[147850], 90.00th=[367002], 95.00th=[367002], | 99.00th=[367002], 99.50th=[367002], 99.90th=[367002], 99.95th=[367002], | 99.99th=[367002] bw ( KiB/s): min= 8094, max= 8094, per=100.00%, avg=8094.00, stdev= 0.00, samples=1 iops : min= 7, max= 7, avg= 7.00, stdev= 0.00, samples=1 write: IOPS=2, BW=2436KiB/s (2495kB/s)(7168KiB/2942msec); 0 zone resets clat (msec): min=186, max=492, avg=329.09, stdev=102.54 lat (msec): min=186, max=492, avg=329.17, stdev=102.55 clat percentiles (msec): | 1.00th=[ 186], 5.00th=[ 186], 10.00th=[ 186], 20.00th=[ 220], | 30.00th=[ 326], 40.00th=[ 326], 50.00th=[ 338], 60.00th=[ 355], | 70.00th=[ 355], 80.00th=[ 384], 90.00th=[ 493], 95.00th=[ 493], | 99.00th=[ 493], 99.50th=[ 493], 99.90th=[ 493], 99.95th=[ 493], | 99.99th=[ 493] bw ( KiB/s): min= 2043, max= 4071, per=49.61%, avg=3392.33, stdev=1168.56, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 lat (usec) : 500=8.33% lat (msec) : 4=8.33%, 10=8.33%, 250=25.00%, 500=50.00% cpu : usr=0.00%, sys=18.80%, ctx=136, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4884KiB/s (5002kB/s), 488KiB/s-2535KiB/s (500kB/s-2595kB/s), io=20.0MiB (20.0MB), run=2828-4193msec WRITE: bw=6838KiB/s (7002kB/s), 1810KiB/s-2442KiB/s (1854kB/s-2501kB/s), io=28.0MiB (29.4MB), run=2828-4193msec rand-rw: (groupid=0, jobs=1): err= 0: pid=145787: Sat Sep 5 09:55:44 2026 read: IOPS=1, BW=1905KiB/s (1951kB/s)(7168KiB/3763msec) clat (msec): min=97, max=587, avg=275.52, stdev=188.27 lat (msec): min=97, max=587, avg=275.52, stdev=188.27 clat percentiles (msec): | 1.00th=[ 99], 5.00th=[ 99], 10.00th=[ 99], 20.00th=[ 117], | 30.00th=[ 130], 40.00th=[ 130], 50.00th=[ 209], 60.00th=[ 347], | 70.00th=[ 347], 80.00th=[ 443], 90.00th=[ 584], 95.00th=[ 584], | 99.00th=[ 584], 99.50th=[ 584], 99.90th=[ 584], 99.95th=[ 584], | 99.99th=[ 584] bw ( KiB/s): min= 1825, max= 3946, per=52.20%, avg=2364.20, stdev=888.32, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 write: IOPS=1, BW=1361KiB/s (1393kB/s)(5120KiB/3763msec); 0 zone resets clat (msec): min=132, max=505, avg=355.94, stdev=140.52 lat (msec): min=132, max=505, avg=356.01, stdev=140.52 clat percentiles (msec): | 1.00th=[ 133], 5.00th=[ 133], 10.00th=[ 133], 20.00th=[ 133], | 30.00th=[ 330], 40.00th=[ 330], 50.00th=[ 384], 60.00th=[ 384], | 70.00th=[ 426], 80.00th=[ 426], 90.00th=[ 506], 95.00th=[ 506], | 99.00th=[ 506], 99.50th=[ 506], 99.90th=[ 506], 99.95th=[ 506], | 99.99th=[ 506] bw ( KiB/s): min= 2027, max= 6071, per=63.85%, avg=4049.00, stdev=2859.54, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 lat (msec) : 100=8.33%, 250=33.33%, 500=41.67%, 750=16.67% cpu : usr=0.03%, sys=6.43%, ctx=116, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145788: Sat Sep 5 09:55:44 2026 read: IOPS=0, BW=496KiB/s (508kB/s)(2048KiB/4129msec) clat (msec): min=99, max=558, avg=329.23, stdev=324.93 lat (msec): min=99, max=558, avg=329.23, stdev=324.93 clat percentiles (msec): | 1.00th=[ 100], 5.00th=[ 100], 10.00th=[ 100], 20.00th=[ 100], | 30.00th=[ 100], 40.00th=[ 100], 50.00th=[ 100], 60.00th=[ 558], | 70.00th=[ 558], 80.00th=[ 558], 90.00th=[ 558], 95.00th=[ 558], | 99.00th=[ 558], 99.50th=[ 558], 99.90th=[ 558], 99.95th=[ 558], | 99.99th=[ 558] bw ( KiB/s): min= 1363, max= 2019, per=37.34%, avg=1691.00, stdev=463.86, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2480KiB/s (2540kB/s)(10.0MiB/4129msec); 0 zone resets clat (msec): min=199, max=630, avg=346.68, stdev=180.47 lat (msec): min=199, max=631, avg=346.82, stdev=180.58 clat percentiles (msec): | 1.00th=[ 201], 5.00th=[ 201], 10.00th=[ 201], 20.00th=[ 209], | 30.00th=[ 222], 40.00th=[ 230], 50.00th=[ 255], 60.00th=[ 264], | 70.00th=[ 275], 80.00th=[ 584], 90.00th=[ 600], 95.00th=[ 634], | 99.00th=[ 634], 99.50th=[ 634], 99.90th=[ 634], 99.95th=[ 634], | 99.99th=[ 634] bw ( KiB/s): min= 1973, max= 4039, per=42.25%, avg=2679.00, stdev=1023.82, samples=6 iops : min= 1, max= 3, avg= 1.67, stdev= 1.03, samples=6 lat (msec) : 100=8.33%, 250=33.33%, 500=25.00%, 750=33.33% cpu : usr=0.00%, sys=6.15%, ctx=111, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145789: Sat Sep 5 09:55:44 2026 read: IOPS=1, BW=1613KiB/s (1652kB/s)(6144KiB/3809msec) clat (msec): min=98, max=367, avg=193.37, stdev=119.01 lat (msec): min=98, max=367, avg=193.37, stdev=119.01 clat percentiles (msec): | 1.00th=[ 99], 5.00th=[ 99], 10.00th=[ 99], 20.00th=[ 100], | 30.00th=[ 100], 40.00th=[ 126], 50.00th=[ 126], 60.00th=[ 150], | 70.00th=[ 321], 80.00th=[ 321], 90.00th=[ 368], 95.00th=[ 368], | 99.00th=[ 368], 99.50th=[ 368], 99.90th=[ 368], 99.95th=[ 368], | 99.99th=[ 368] bw ( KiB/s): min= 1973, max= 4047, per=55.39%, avg=2508.75, stdev=1025.75, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 write: IOPS=1, BW=1613KiB/s (1652kB/s)(6144KiB/3809msec); 0 zone resets clat (msec): min=213, max=748, avg=431.90, stdev=237.41 lat (msec): min=213, max=748, avg=437.66, stdev=244.96 clat percentiles (msec): | 1.00th=[ 213], 5.00th=[ 213], 10.00th=[ 213], 20.00th=[ 228], | 30.00th=[ 228], 40.00th=[ 266], 50.00th=[ 266], 60.00th=[ 451], | 70.00th=[ 684], 80.00th=[ 684], 90.00th=[ 751], 95.00th=[ 751], | 99.00th=[ 751], 99.50th=[ 751], 99.90th=[ 751], 99.95th=[ 751], | 99.99th=[ 751] bw ( KiB/s): min= 1973, max= 4055, per=39.60%, avg=2510.75, stdev=1029.75, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (msec) : 100=16.67%, 250=33.33%, 500=33.33%, 750=16.67% cpu : usr=0.00%, sys=5.46%, ctx=60, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145790: Sat Sep 5 09:55:44 2026 read: IOPS=1, BW=1132KiB/s (1160kB/s)(5120KiB/4521msec) clat (msec): min=35, max=503, avg=191.67, stdev=180.59 lat (msec): min=35, max=503, avg=191.68, stdev=180.59 clat percentiles (msec): | 1.00th=[ 35], 5.00th=[ 35], 10.00th=[ 35], 20.00th=[ 35], | 30.00th=[ 128], 40.00th=[ 128], 50.00th=[ 132], 60.00th=[ 132], | 70.00th=[ 161], 80.00th=[ 161], 90.00th=[ 506], 95.00th=[ 506], | 99.00th=[ 506], 99.50th=[ 506], 99.90th=[ 506], 99.95th=[ 506], | 99.99th=[ 506] bw ( KiB/s): min= 1988, max= 6095, per=89.24%, avg=4041.50, stdev=2904.09, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 write: IOPS=1, BW=1585KiB/s (1624kB/s)(7168KiB/4521msec); 0 zone resets clat (msec): min=123, max=1056, avg=501.05, stdev=368.66 lat (msec): min=123, max=1056, avg=501.14, stdev=368.65 clat percentiles (msec): | 1.00th=[ 124], 5.00th=[ 124], 10.00th=[ 124], 20.00th=[ 144], | 30.00th=[ 169], 40.00th=[ 169], 50.00th=[ 542], 60.00th=[ 651], | 70.00th=[ 651], 80.00th=[ 818], 90.00th=[ 1053], 95.00th=[ 1053], | 99.00th=[ 1053], 99.50th=[ 1053], 99.90th=[ 1053], 99.95th=[ 1053], | 99.99th=[ 1053] bw ( KiB/s): min= 1973, max= 2035, per=31.63%, avg=2005.75, stdev=29.97, samples=4 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=4 lat (msec) : 50=8.33%, 250=50.00%, 750=25.00%, 1000=8.33%, 2000=8.33% cpu : usr=0.02%, sys=4.29%, ctx=102, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4530KiB/s (4639kB/s), 496KiB/s-1905KiB/s (508kB/s-1951kB/s), io=20.0MiB (20.0MB), run=3763-4521msec WRITE: bw=6342KiB/s (6494kB/s), 1361KiB/s-2480KiB/s (1393kB/s-2540kB/s), io=28.0MiB (29.4MB), run=3763-4521msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=145796: Sat Sep 5 09:55:56 2026 read: IOPS=0, BW=3779KiB/s (3869kB/s)(12.0MiB/3252msec) clat (msec): min=866, max=1386, avg=1055.00, stdev=287.93 lat (msec): min=866, max=1386, avg=1055.00, stdev=287.93 clat percentiles (msec): | 1.00th=[ 869], 5.00th=[ 869], 10.00th=[ 869], 20.00th=[ 869], | 30.00th=[ 869], 40.00th=[ 911], 50.00th=[ 911], 60.00th=[ 911], | 70.00th=[ 1385], 80.00th=[ 1385], 90.00th=[ 1385], 95.00th=[ 1385], | 99.00th=[ 1385], 99.50th=[ 1385], 99.90th=[ 1385], 99.95th=[ 1385], | 99.99th=[ 1385] bw ( KiB/s): min= 8094, max= 8110, per=100.00%, avg=8102.00, stdev=11.31, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=66.67%, 2000=33.33% cpu : usr=0.00%, sys=2.92%, ctx=71, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145797: Sat Sep 5 09:55:56 2026 read: IOPS=0, BW=2794KiB/s (2861kB/s)(4096KiB/1466msec) clat (nsec): min=487196k, max=487196k, avg=487196085.00, stdev= 0.00 lat (nsec): min=487198k, max=487198k, avg=487198079.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 489], 5.00th=[ 489], 10.00th=[ 489], 20.00th=[ 489], | 30.00th=[ 489], 40.00th=[ 489], 50.00th=[ 489], 60.00th=[ 489], | 70.00th=[ 489], 80.00th=[ 489], 90.00th=[ 489], 95.00th=[ 489], | 99.00th=[ 489], 99.50th=[ 489], 99.90th=[ 489], 99.95th=[ 489], | 99.99th=[ 489] bw ( KiB/s): min= 6965, max= 6965, per=100.00%, avg=6965.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=1, BW=5588KiB/s (5722kB/s)(8192KiB/1466msec); 0 zone resets clat (msec): min=384, max=523, avg=454.17, stdev=98.00 lat (msec): min=385, max=523, avg=454.39, stdev=98.06 clat percentiles (msec): | 1.00th=[ 384], 5.00th=[ 384], 10.00th=[ 384], 20.00th=[ 384], | 30.00th=[ 384], 40.00th=[ 384], 50.00th=[ 384], 60.00th=[ 523], | 70.00th=[ 523], 80.00th=[ 523], 90.00th=[ 523], 95.00th=[ 523], | 99.00th=[ 523], 99.50th=[ 523], 99.90th=[ 523], 99.95th=[ 523], | 99.99th=[ 523] bw ( KiB/s): min= 8094, max= 8094, per=47.92%, avg=8094.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=66.67%, 750=33.33% cpu : usr=0.00%, sys=6.14%, ctx=56, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145798: Sat Sep 5 09:55:56 2026 write: IOPS=2, BW=8371KiB/s (8571kB/s)(12.0MiB/1468msec); 0 zone resets clat (msec): min=263, max=852, avg=467.78, stdev=333.72 lat (msec): min=263, max=853, avg=468.08, stdev=333.78 clat percentiles (msec): | 1.00th=[ 264], 5.00th=[ 264], 10.00th=[ 264], 20.00th=[ 264], | 30.00th=[ 264], 40.00th=[ 288], 50.00th=[ 288], 60.00th=[ 288], | 70.00th=[ 852], 80.00th=[ 852], 90.00th=[ 852], 95.00th=[ 852], | 99.00th=[ 852], 99.50th=[ 852], 99.90th=[ 852], 99.95th=[ 852], | 99.99th=[ 852] bw ( KiB/s): min= 6736, max= 8094, per=43.90%, avg=7415.00, stdev=960.25, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=66.67%, 1000=33.33% cpu : usr=0.00%, sys=7.02%, ctx=96, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145799: Sat Sep 5 09:55:56 2026 write: IOPS=1, BW=6334KiB/s (6486kB/s)(12.0MiB/1940msec); 0 zone resets clat (msec): min=242, max=1017, avg=619.85, stdev=387.88 lat (msec): min=242, max=1017, avg=621.17, stdev=387.88 clat percentiles (msec): | 1.00th=[ 243], 5.00th=[ 243], 10.00th=[ 243], 20.00th=[ 243], | 30.00th=[ 243], 40.00th=[ 600], 50.00th=[ 600], 60.00th=[ 600], | 70.00th=[ 1020], 80.00th=[ 1020], 90.00th=[ 1020], 95.00th=[ 1020], | 99.00th=[ 1020], 99.50th=[ 1020], 99.90th=[ 1020], 99.95th=[ 1020], | 99.99th=[ 1020] bw ( KiB/s): min= 7049, max= 8094, per=44.83%, avg=7571.50, stdev=738.93, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 250=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.00%, sys=5.11%, ctx=53, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5038KiB/s (5159kB/s), 2794KiB/s-3779KiB/s (2861kB/s-3869kB/s), io=16.0MiB (16.8MB), run=1466-3252msec WRITE: bw=16.5MiB/s (17.3MB/s), 5588KiB/s-8371KiB/s (5722kB/s-8571kB/s), io=32.0MiB (33.6MB), run=1466-1940msec rand-rw: (groupid=0, jobs=1): err= 0: pid=145801: Sat Sep 5 09:55:57 2026 read: IOPS=1, BW=5111KiB/s (5234kB/s)(12.0MiB/2404msec) clat (msec): min=729, max=853, avg=800.99, stdev=64.21 lat (msec): min=729, max=853, avg=800.99, stdev=64.21 clat percentiles (msec): | 1.00th=[ 726], 5.00th=[ 726], 10.00th=[ 726], 20.00th=[ 726], | 30.00th=[ 726], 40.00th=[ 818], 50.00th=[ 818], 60.00th=[ 818], | 70.00th=[ 852], 80.00th=[ 852], 90.00th=[ 852], 95.00th=[ 852], | 99.00th=[ 852], 99.50th=[ 852], 99.90th=[ 852], 99.95th=[ 852], | 99.99th=[ 852] bw ( KiB/s): min= 8047, max= 8192, per=100.00%, avg=8119.50, stdev=102.53, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 750=33.33%, 1000=66.67% cpu : usr=0.00%, sys=14.19%, ctx=312, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145802: Sat Sep 5 09:55:57 2026 read: IOPS=0, BW=1525KiB/s (1562kB/s)(4096KiB/2686msec) clat (nsec): min=762863k, max=762863k, avg=762863315.00, stdev= 0.00 lat (nsec): min=762865k, max=762865k, avg=762865194.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 760], 5.00th=[ 760], 10.00th=[ 760], 20.00th=[ 760], | 30.00th=[ 760], 40.00th=[ 760], 50.00th=[ 760], 60.00th=[ 760], | 70.00th=[ 760], 80.00th=[ 760], 90.00th=[ 760], 95.00th=[ 760], | 99.00th=[ 760], 99.50th=[ 760], 99.90th=[ 760], 99.95th=[ 760], | 99.99th=[ 760] bw ( KiB/s): min= 8143, max= 8143, per=100.00%, avg=8143.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=3050KiB/s (3123kB/s)(8192KiB/2686msec); 0 zone resets clat (msec): min=890, max=1027, avg=958.86, stdev=97.33 lat (msec): min=890, max=1028, avg=959.21, stdev=97.34 clat percentiles (msec): | 1.00th=[ 894], 5.00th=[ 894], 10.00th=[ 894], 20.00th=[ 894], | 30.00th=[ 894], 40.00th=[ 894], 50.00th=[ 894], 60.00th=[ 1028], | 70.00th=[ 1028], 80.00th=[ 1028], 90.00th=[ 1028], 95.00th=[ 1028], | 99.00th=[ 1028], 99.50th=[ 1028], 99.90th=[ 1028], 99.95th=[ 1028], | 99.99th=[ 1028] bw ( KiB/s): min= 8159, max= 8159, per=82.55%, avg=8159.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 1000=66.67%, 2000=33.33% cpu : usr=0.00%, sys=4.66%, ctx=82, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145803: Sat Sep 5 09:55:57 2026 write: IOPS=0, BW=3707KiB/s (3796kB/s)(12.0MiB/3315msec); 0 zone resets clat (msec): min=255, max=1750, avg=1104.18, stdev=767.49 lat (msec): min=256, max=1750, avg=1104.57, stdev=767.50 clat percentiles (msec): | 1.00th=[ 257], 5.00th=[ 257], 10.00th=[ 257], 20.00th=[ 257], | 30.00th=[ 257], 40.00th=[ 1301], 50.00th=[ 1301], 60.00th=[ 1301], | 70.00th=[ 1754], 80.00th=[ 1754], 90.00th=[ 1754], 95.00th=[ 1754], | 99.00th=[ 1754], 99.50th=[ 1754], 99.90th=[ 1754], 99.95th=[ 1754], | 99.99th=[ 1754] bw ( KiB/s): min= 8159, max= 8192, per=82.71%, avg=8175.50, stdev=23.33, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.00%, sys=2.78%, ctx=48, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145804: Sat Sep 5 09:55:57 2026 write: IOPS=1, BW=4491KiB/s (4599kB/s)(12.0MiB/2736msec); 0 zone resets clat (msec): min=389, max=1208, avg=911.34, stdev=452.99 lat (msec): min=390, max=1208, avg=911.74, stdev=453.06 clat percentiles (msec): | 1.00th=[ 388], 5.00th=[ 388], 10.00th=[ 388], 20.00th=[ 388], | 30.00th=[ 388], 40.00th=[ 1133], 50.00th=[ 1133], 60.00th=[ 1133], | 70.00th=[ 1217], 80.00th=[ 1217], 90.00th=[ 1217], 95.00th=[ 1217], | 99.00th=[ 1217], 99.50th=[ 1217], 99.90th=[ 1217], 99.95th=[ 1217], | 99.99th=[ 1217] bw ( KiB/s): min= 8047, max= 8143, per=81.90%, avg=8095.00, stdev=67.88, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.00%, sys=6.33%, ctx=63, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=6100KiB/s (6246kB/s), 1525KiB/s-5111KiB/s (1562kB/s-5234kB/s), io=16.0MiB (16.8MB), run=2404-2686msec WRITE: bw=9885KiB/s (10.1MB/s), 3050KiB/s-4491KiB/s (3123kB/s-4599kB/s), io=32.0MiB (33.6MB), run=2686-3315msec