== sanity test 398b: DIO and buffer IO race ============== 21:14:49 (1788570889) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 6.76212 s, 7.4 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=178486: Fri Sep 4 21:17:10 2026 read: IOPS=12, BW=49.6KiB/s (50.8kB/s)(5992KiB/120815msec) clat (usec): min=39, max=242693, avg=43544.44, stdev=27922.36 lat (usec): min=39, max=242695, avg=43549.86, stdev=27921.71 clat percentiles (usec): | 1.00th=[ 59], 5.00th=[ 12256], 10.00th=[ 16909], 20.00th=[ 22938], | 30.00th=[ 27395], 40.00th=[ 31851], 50.00th=[ 37487], 60.00th=[ 43779], | 70.00th=[ 51119], 80.00th=[ 61080], 90.00th=[ 79168], 95.00th=[ 91751], | 99.00th=[147850], 99.50th=[166724], 99.90th=[196084], 99.95th=[242222], | 99.99th=[242222] bw ( KiB/s): min= 7, max= 112, per=24.94%, avg=49.38, stdev=18.77, samples=236 iops : min= 1, max= 28, avg=11.68, stdev= 4.71, samples=236 write: IOPS=13, BW=52.1KiB/s (53.4kB/s)(6296KiB/120815msec); 0 zone resets clat (usec): min=965, max=944221, avg=34991.23, stdev=40449.87 lat (usec): min=966, max=944222, avg=34997.54, stdev=40447.66 clat percentiles (usec): | 1.00th=[ 1123], 5.00th=[ 1369], 10.00th=[ 2114], 20.00th=[ 4293], | 30.00th=[ 8979], 40.00th=[ 19268], 50.00th=[ 26346], 60.00th=[ 33817], | 70.00th=[ 44303], 80.00th=[ 58459], 90.00th=[ 78119], 95.00th=[102237], | 99.00th=[145753], 99.50th=[164627], 99.90th=[240124], 99.95th=[943719], | 99.99th=[943719] bw ( KiB/s): min= 7, max= 149, per=25.13%, avg=52.27, stdev=21.08, samples=235 iops : min= 1, max= 37, avg=12.40, stdev= 5.32, samples=235 lat (usec) : 50=0.10%, 100=1.27%, 250=0.16%, 500=0.03%, 750=0.07% lat (usec) : 1000=0.07% lat (msec) : 2=4.82%, 4=4.59%, 10=6.71%, 20=10.51%, 50=42.97% lat (msec) : 100=24.09%, 250=4.59%, 1000=0.03% cpu : usr=0.09%, sys=5.69%, ctx=6917, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178488: Fri Sep 4 21:17:10 2026 read: IOPS=12, BW=51.1KiB/s (52.3kB/s)(5940KiB/116303msec) clat (usec): min=46, max=1044.0k, avg=43125.10, stdev=37068.50 lat (usec): min=46, max=1044.1k, avg=43131.16, stdev=37067.69 clat percentiles (usec): | 1.00th=[ 59], 5.00th=[ 11076], 10.00th=[ 16450], | 20.00th=[ 22414], 30.00th=[ 26870], 40.00th=[ 31327], | 50.00th=[ 37487], 60.00th=[ 43254], 70.00th=[ 51119], | 80.00th=[ 60556], 90.00th=[ 74974], 95.00th=[ 91751], | 99.00th=[ 127402], 99.50th=[ 166724], 99.90th=[ 219153], | 99.95th=[1044382], 99.99th=[1044382] bw ( KiB/s): min= 7, max= 119, per=25.75%, avg=50.98, stdev=19.63, samples=227 iops : min= 1, max= 29, avg=12.07, stdev= 4.93, samples=227 write: IOPS=13, BW=54.6KiB/s (55.9kB/s)(6348KiB/116303msec); 0 zone resets clat (usec): min=999, max=211067, avg=32609.43, stdev=32734.16 lat (usec): min=1000, max=211069, avg=32614.62, stdev=32733.83 clat percentiles (usec): | 1.00th=[ 1139], 5.00th=[ 1385], 10.00th=[ 1991], 20.00th=[ 3818], | 30.00th=[ 6783], 40.00th=[ 13829], 50.00th=[ 24511], 60.00th=[ 32900], | 70.00th=[ 42206], 80.00th=[ 57934], 90.00th=[ 77071], 95.00th=[ 95945], | 99.00th=[143655], 99.50th=[154141], 99.90th=[196084], 99.95th=[210764], | 99.99th=[210764] bw ( KiB/s): min= 15, max= 127, per=26.17%, avg=54.44, stdev=20.88, samples=227 iops : min= 3, max= 31, avg=12.95, stdev= 5.26, samples=227 lat (usec) : 50=0.10%, 100=1.33%, 250=0.33%, 500=0.10%, 1000=0.03% lat (msec) : 2=5.24%, 4=5.31%, 10=8.20%, 20=10.29%, 50=41.31% lat (msec) : 100=23.83%, 250=3.91%, 2000=0.03% cpu : usr=0.10%, sys=5.79%, ctx=6900, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178490: Fri Sep 4 21:17:10 2026 read: IOPS=12, BW=50.5KiB/s (51.7kB/s)(6028KiB/119328msec) clat (usec): min=32, max=1001.7k, avg=43964.36, stdev=37772.08 lat (usec): min=32, max=1001.7k, avg=43966.40, stdev=37772.11 clat percentiles (usec): | 1.00th=[ 57], 5.00th=[ 11600], 10.00th=[ 16712], | 20.00th=[ 21890], 30.00th=[ 27395], 40.00th=[ 31851], | 50.00th=[ 37487], 60.00th=[ 44303], 70.00th=[ 51643], | 80.00th=[ 61604], 90.00th=[ 76022], 95.00th=[ 96994], | 99.00th=[ 141558], 99.50th=[ 185598], 99.90th=[ 270533], | 99.95th=[1002439], 99.99th=[1002439] bw ( KiB/s): min= 7, max= 104, per=25.28%, avg=50.05, stdev=18.00, samples=234 iops : min= 1, max= 26, avg=11.85, stdev= 4.53, samples=234 write: IOPS=13, BW=52.5KiB/s (53.7kB/s)(6260KiB/119328msec); 0 zone resets clat (usec): min=902, max=210192, avg=33616.90, stdev=32755.85 lat (usec): min=904, max=210193, avg=33623.45, stdev=32756.86 clat percentiles (usec): | 1.00th=[ 1156], 5.00th=[ 1418], 10.00th=[ 2212], 20.00th=[ 4359], | 30.00th=[ 7832], 40.00th=[ 16712], 50.00th=[ 25297], 60.00th=[ 33424], | 70.00th=[ 43254], 80.00th=[ 60031], 90.00th=[ 81265], 95.00th=[100140], | 99.00th=[133694], 99.50th=[147850], 99.90th=[196084], 99.95th=[210764], | 99.99th=[210764] bw ( KiB/s): min= 7, max= 120, per=24.99%, avg=51.97, stdev=21.53, samples=234 iops : min= 1, max= 30, avg=12.33, stdev= 5.41, samples=234 lat (usec) : 50=0.16%, 100=1.73%, 250=0.20%, 500=0.03%, 1000=0.03% lat (msec) : 2=4.56%, 4=4.92%, 10=7.75%, 20=10.97%, 50=40.98% lat (msec) : 100=23.99%, 250=4.62%, 500=0.03%, 2000=0.03% cpu : usr=0.11%, sys=5.72%, ctx=6747, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178492: Fri Sep 4 21:17:10 2026 read: IOPS=12, BW=51.2KiB/s (52.4kB/s)(6052KiB/118230msec) clat (usec): min=35, max=239925, avg=42808.06, stdev=29129.84 lat (usec): min=35, max=239925, avg=42817.99, stdev=29126.25 clat percentiles (usec): | 1.00th=[ 58], 5.00th=[ 9634], 10.00th=[ 16057], 20.00th=[ 21365], | 30.00th=[ 26608], 40.00th=[ 31589], 50.00th=[ 36963], 60.00th=[ 43254], | 70.00th=[ 51119], 80.00th=[ 60031], 90.00th=[ 76022], 95.00th=[ 93848], | 99.00th=[164627], 99.50th=[189793], 99.90th=[231736], 99.95th=[240124], | 99.99th=[240124] bw ( KiB/s): min= 7, max= 95, per=25.85%, avg=51.17, stdev=18.46, samples=230 iops : min= 1, max= 23, avg=12.12, stdev= 4.63, samples=230 write: IOPS=13, BW=52.7KiB/s (54.0kB/s)(6236KiB/118230msec); 0 zone resets clat (usec): min=1006, max=1056.4k, avg=33960.63, stdev=42037.47 lat (usec): min=1007, max=1056.4k, avg=33970.60, stdev=42036.27 clat percentiles (usec): | 1.00th=[ 1106], 5.00th=[ 1401], 10.00th=[ 2114], | 20.00th=[ 4359], 30.00th=[ 7898], 40.00th=[ 15139], | 50.00th=[ 24511], 60.00th=[ 33162], 70.00th=[ 43254], | 80.00th=[ 56886], 90.00th=[ 80217], 95.00th=[ 100140], | 99.00th=[ 143655], 99.50th=[ 158335], 99.90th=[ 208667], | 99.95th=[1052771], 99.99th=[1052771] bw ( KiB/s): min= 7, max= 151, per=25.25%, avg=52.52, stdev=23.08, samples=231 iops : min= 1, max= 37, avg=12.46, stdev= 5.80, samples=231 lat (usec) : 50=0.16%, 100=1.50%, 250=0.33%, 500=0.07%, 750=0.03% lat (usec) : 1000=0.13% lat (msec) : 2=4.72%, 4=4.82%, 10=7.85%, 20=11.23%, 50=41.08% lat (msec) : 100=23.70%, 250=4.36%, 2000=0.03% cpu : usr=0.09%, sys=5.72%, ctx=6894, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=199KiB/s (204kB/s), 49.6KiB/s-51.2KiB/s (50.8kB/s-52.4kB/s), io=23.4MiB (24.6MB), run=116303-120815msec WRITE: bw=208KiB/s (213kB/s), 52.1KiB/s-54.6KiB/s (53.4kB/s-55.9kB/s), io=24.6MiB (25.7MB), run=116303-120815msec rand-rw: (groupid=0, jobs=1): err= 0: pid=178487: Fri Sep 4 21:17:45 2026 read: IOPS=9, BW=38.7KiB/s (39.7kB/s)(5992KiB/154647msec) clat (msec): min=7, max=958, avg=41.37, stdev=43.56 lat (msec): min=7, max=958, avg=41.37, stdev=43.56 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 12], 20.00th=[ 16], | 30.00th=[ 19], 40.00th=[ 22], 50.00th=[ 28], 60.00th=[ 34], | 70.00th=[ 44], 80.00th=[ 59], 90.00th=[ 93], 95.00th=[ 122], | 99.00th=[ 176], 99.50th=[ 194], 99.90th=[ 268], 99.95th=[ 961], | 99.99th=[ 961] bw ( KiB/s): min= 7, max= 159, per=25.24%, avg=38.87, stdev=26.56, samples=301 iops : min= 1, max= 39, avg= 9.08, stdev= 6.68, samples=301 write: IOPS=10, BW=40.7KiB/s (41.7kB/s)(6296KiB/154647msec); 0 zone resets clat (msec): min=9, max=262, avg=58.59, stdev=40.51 lat (msec): min=9, max=262, avg=58.59, stdev=40.50 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 21], 10.00th=[ 23], 20.00th=[ 28], | 30.00th=[ 33], 40.00th=[ 38], 50.00th=[ 44], 60.00th=[ 54], | 70.00th=[ 67], 80.00th=[ 86], 90.00th=[ 115], 95.00th=[ 140], | 99.00th=[ 201], 99.50th=[ 236], 99.90th=[ 251], 99.95th=[ 264], | 99.99th=[ 264] bw ( KiB/s): min= 7, max= 135, per=25.26%, avg=40.67, stdev=25.19, samples=302 iops : min= 1, max= 33, avg= 9.53, stdev= 6.33, samples=302 lat (msec) : 10=1.86%, 20=17.45%, 50=46.29%, 100=23.21%, 250=11.04% lat (msec) : 500=0.13%, 1000=0.03% cpu : usr=0.07%, sys=2.01%, ctx=4909, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178489: Fri Sep 4 21:17:45 2026 read: IOPS=9, BW=38.4KiB/s (39.3kB/s)(5940KiB/154814msec) clat (msec): min=5, max=1023, avg=40.40, stdev=46.54 lat (msec): min=5, max=1023, avg=40.40, stdev=46.54 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 12], 20.00th=[ 15], | 30.00th=[ 18], 40.00th=[ 22], 50.00th=[ 26], 60.00th=[ 31], | 70.00th=[ 40], 80.00th=[ 57], 90.00th=[ 92], 95.00th=[ 123], | 99.00th=[ 192], 99.50th=[ 226], 99.90th=[ 380], 99.95th=[ 1020], | 99.99th=[ 1020] bw ( KiB/s): min= 7, max= 143, per=25.33%, avg=39.01, stdev=28.31, samples=297 iops : min= 1, max= 35, avg= 9.12, stdev= 7.11, samples=297 write: IOPS=10, BW=41.0KiB/s (41.0kB/s)(6348KiB/154814msec); 0 zone resets clat (msec): min=10, max=332, avg=59.43, stdev=42.52 lat (msec): min=10, max=332, avg=59.44, stdev=42.52 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 20], 10.00th=[ 23], 20.00th=[ 28], | 30.00th=[ 33], 40.00th=[ 37], 50.00th=[ 43], 60.00th=[ 54], | 70.00th=[ 69], 80.00th=[ 88], 90.00th=[ 118], 95.00th=[ 144], | 99.00th=[ 205], 99.50th=[ 243], 99.90th=[ 326], 99.95th=[ 334], | 99.99th=[ 334] bw ( KiB/s): min= 7, max= 119, per=25.39%, avg=40.88, stdev=25.47, samples=302 iops : min= 1, max= 29, avg= 9.59, stdev= 6.40, samples=302 lat (msec) : 10=2.44%, 20=18.29%, 50=45.87%, 100=21.42%, 250=11.65% lat (msec) : 500=0.29%, 2000=0.03% cpu : usr=0.06%, sys=1.99%, ctx=4833, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178491: Fri Sep 4 21:17:45 2026 read: IOPS=9, BW=38.0KiB/s (39.9kB/s)(6028KiB/154697msec) clat (msec): min=6, max=386, avg=39.76, stdev=36.12 lat (msec): min=6, max=386, avg=39.76, stdev=36.11 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 16], | 30.00th=[ 19], 40.00th=[ 23], 50.00th=[ 27], 60.00th=[ 33], | 70.00th=[ 42], 80.00th=[ 60], 90.00th=[ 91], 95.00th=[ 114], | 99.00th=[ 165], 99.50th=[ 205], 99.90th=[ 284], 99.95th=[ 388], | 99.99th=[ 388] bw ( KiB/s): min= 7, max= 135, per=25.56%, avg=39.37, stdev=25.63, samples=299 iops : min= 1, max= 33, avg= 9.20, stdev= 6.42, samples=299 write: IOPS=10, BW=40.5KiB/s (41.4kB/s)(6260KiB/154697msec); 0 zone resets clat (msec): min=12, max=1041, avg=60.30, stdev=48.45 lat (msec): min=12, max=1041, avg=60.31, stdev=48.45 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 21], 10.00th=[ 24], 20.00th=[ 29], | 30.00th=[ 33], 40.00th=[ 39], 50.00th=[ 45], 60.00th=[ 54], | 70.00th=[ 69], 80.00th=[ 88], 90.00th=[ 116], 95.00th=[ 144], | 99.00th=[ 218], 99.50th=[ 239], 99.90th=[ 275], 99.95th=[ 1045], | 99.99th=[ 1045] bw ( KiB/s): min= 7, max= 125, per=24.92%, avg=40.12, stdev=25.43, samples=304 iops : min= 1, max= 31, avg= 9.40, stdev= 6.40, samples=304 lat (msec) : 10=2.25%, 20=16.50%, 50=47.49%, 100=22.49%, 250=11.04% lat (msec) : 500=0.20%, 2000=0.03% cpu : usr=0.07%, sys=2.06%, ctx=4812, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178493: Fri Sep 4 21:17:45 2026 read: IOPS=9, BW=38.9KiB/s (39.9kB/s)(6052KiB/155476msec) clat (msec): min=5, max=288, avg=40.65, stdev=37.44 lat (msec): min=5, max=288, avg=40.66, stdev=37.44 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 13], 20.00th=[ 16], | 30.00th=[ 19], 40.00th=[ 23], 50.00th=[ 27], 60.00th=[ 33], | 70.00th=[ 42], 80.00th=[ 59], 90.00th=[ 95], 95.00th=[ 123], | 99.00th=[ 176], 99.50th=[ 205], 99.90th=[ 257], 99.95th=[ 288], | 99.99th=[ 288] bw ( KiB/s): min= 7, max= 127, per=25.81%, avg=39.75, stdev=26.24, samples=295 iops : min= 1, max= 31, avg= 9.30, stdev= 6.59, samples=295 write: IOPS=10, BW=40.1KiB/s (41.1kB/s)(6236KiB/155476msec); 0 zone resets clat (msec): min=12, max=1038, avg=60.03, stdev=48.33 lat (msec): min=12, max=1038, avg=60.03, stdev=48.34 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 20], 10.00th=[ 23], 20.00th=[ 28], | 30.00th=[ 33], 40.00th=[ 38], 50.00th=[ 44], 60.00th=[ 57], | 70.00th=[ 71], 80.00th=[ 89], 90.00th=[ 115], 95.00th=[ 142], | 99.00th=[ 205], 99.50th=[ 236], 99.90th=[ 342], 99.95th=[ 1036], | 99.99th=[ 1036] bw ( KiB/s): min= 7, max= 119, per=24.80%, avg=39.92, stdev=25.21, samples=303 iops : min= 1, max= 29, avg= 9.34, stdev= 6.34, samples=303 lat (msec) : 10=2.57%, 20=17.48%, 50=45.77%, 100=21.84%, 250=12.11% lat (msec) : 500=0.20%, 2000=0.03% cpu : usr=0.06%, sys=2.07%, ctx=4852, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=154KiB/s (158kB/s), 38.4KiB/s-38.0KiB/s (39.3kB/s-39.9kB/s), io=23.4MiB (24.6MB), run=154647-155476msec WRITE: bw=162KiB/s (166kB/s), 40.1KiB/s-41.0KiB/s (41.1kB/s-41.0kB/s), io=24.6MiB (25.7MB), run=154647-155476msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=178531: Fri Sep 4 21:18:28 2026 read: IOPS=10, BW=173KiB/s (177kB/s)(5920KiB/34311msec) clat (usec): min=34, max=180609, avg=47124.96, stdev=28412.25 lat (usec): min=34, max=180611, avg=47128.23, stdev=28412.50 clat percentiles (usec): | 1.00th=[ 51], 5.00th=[ 76], 10.00th=[ 155], 20.00th=[ 25560], | 30.00th=[ 35390], 40.00th=[ 40633], 50.00th=[ 46400], 60.00th=[ 51643], | 70.00th=[ 56886], 80.00th=[ 67634], 90.00th=[ 81265], 95.00th=[ 98042], | 99.00th=[126354], 99.50th=[145753], 99.90th=[181404], 99.95th=[181404], | 99.99th=[181404] bw ( KiB/s): min= 31, max= 318, per=24.74%, avg=172.68, stdev=57.42, samples=66 iops : min= 1, max= 19, avg=10.06, stdev= 3.61, samples=66 write: IOPS=11, BW=186KiB/s (190kB/s)(6368KiB/34311msec); 0 zone resets clat (usec): min=1857, max=238528, avg=42193.23, stdev=40029.92 lat (usec): min=1859, max=238532, avg=42216.81, stdev=40067.28 clat percentiles (msec): | 1.00th=[ 3], 5.00th=[ 4], 10.00th=[ 6], 20.00th=[ 8], | 30.00th=[ 12], 40.00th=[ 23], 50.00th=[ 32], 60.00th=[ 42], | 70.00th=[ 54], 80.00th=[ 70], 90.00th=[ 96], 95.00th=[ 116], | 99.00th=[ 188], 99.50th=[ 226], 99.90th=[ 239], 99.95th=[ 239], | 99.99th=[ 239] bw ( KiB/s): min= 32, max= 319, per=25.18%, avg=184.79, stdev=64.45, samples=67 iops : min= 2, max= 19, avg=10.82, stdev= 4.00, samples=67 lat (usec) : 50=0.39%, 100=3.91%, 250=0.52%, 500=0.13% lat (msec) : 2=0.65%, 4=2.99%, 10=10.81%, 20=7.81%, 50=34.90% lat (msec) : 100=31.38%, 250=6.51% cpu : usr=0.07%, sys=6.10%, ctx=1805, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178532: Fri Sep 4 21:18:28 2026 read: IOPS=10, BW=171KiB/s (175kB/s)(5744KiB/33539msec) clat (usec): min=52, max=223884, avg=50242.73, stdev=32496.24 lat (usec): min=53, max=223885, avg=50309.65, stdev=32426.65 clat percentiles (usec): | 1.00th=[ 57], 5.00th=[ 75], 10.00th=[ 5604], 20.00th=[ 25822], | 30.00th=[ 33817], 40.00th=[ 39584], 50.00th=[ 45876], 60.00th=[ 53216], | 70.00th=[ 63701], 80.00th=[ 72877], 90.00th=[ 88605], 95.00th=[106431], | 99.00th=[158335], 99.50th=[175113], 99.90th=[223347], 99.95th=[223347], | 99.99th=[223347] bw ( KiB/s): min= 31, max= 415, per=24.47%, avg=170.80, stdev=67.15, samples=66 iops : min= 1, max= 25, avg= 9.94, stdev= 4.21, samples=66 write: IOPS=12, BW=195KiB/s (200kB/s)(6544KiB/33539msec); 0 zone resets clat (usec): min=1686, max=184879, avg=37271.63, stdev=34974.45 lat (usec): min=1688, max=184881, avg=37277.17, stdev=34973.71 clat percentiles (usec): | 1.00th=[ 1795], 5.00th=[ 2540], 10.00th=[ 3589], 20.00th=[ 6980], | 30.00th=[ 10290], 40.00th=[ 19006], 50.00th=[ 27657], 60.00th=[ 35914], | 70.00th=[ 49546], 80.00th=[ 64750], 90.00th=[ 82314], 95.00th=[108528], | 99.00th=[152044], 99.50th=[166724], 99.90th=[185598], 99.95th=[185598], | 99.99th=[185598] bw ( KiB/s): min= 31, max= 384, per=26.56%, avg=194.92, stdev=81.14, samples=66 iops : min= 1, max= 24, avg=11.45, stdev= 5.19, samples=66 lat (usec) : 100=3.39%, 250=0.65%, 500=0.26% lat (msec) : 2=1.69%, 4=4.43%, 10=9.90%, 20=7.68%, 50=35.81% lat (msec) : 100=29.69%, 250=6.51% cpu : usr=0.07%, sys=5.92%, ctx=1790, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178533: Fri Sep 4 21:18:28 2026 read: IOPS=11, BW=184KiB/s (189kB/s)(6256KiB/33961msec) clat (usec): min=47, max=169969, avg=45860.51, stdev=29243.45 lat (usec): min=48, max=169970, avg=45872.41, stdev=29253.47 clat percentiles (usec): | 1.00th=[ 62], 5.00th=[ 81], 10.00th=[ 135], 20.00th=[ 26084], | 30.00th=[ 31589], 40.00th=[ 36439], 50.00th=[ 42206], 60.00th=[ 50070], | 70.00th=[ 58459], 80.00th=[ 67634], 90.00th=[ 80217], 95.00th=[ 99091], | 99.00th=[127402], 99.50th=[156238], 99.90th=[170918], 99.95th=[170918], | 99.99th=[170918] bw ( KiB/s): min= 31, max= 411, per=26.40%, avg=184.27, stdev=73.54, samples=67 iops : min= 1, max= 25, avg=10.79, stdev= 4.63, samples=67 write: IOPS=11, BW=178KiB/s (182kB/s)(6032KiB/33961msec); 0 zone resets clat (usec): min=1527, max=262476, avg=41896.84, stdev=39163.34 lat (usec): min=1529, max=262479, avg=41899.96, stdev=39162.98 clat percentiles (usec): | 1.00th=[ 1893], 5.00th=[ 2606], 10.00th=[ 4621], 20.00th=[ 7111], | 30.00th=[ 13304], 40.00th=[ 23725], 50.00th=[ 33162], 60.00th=[ 43254], | 70.00th=[ 52167], 80.00th=[ 69731], 90.00th=[ 92799], 95.00th=[122160], | 99.00th=[173016], 99.50th=[183501], 99.90th=[263193], 99.95th=[263193], | 99.99th=[263193] bw ( KiB/s): min= 62, max= 414, per=23.95%, avg=175.78, stdev=75.85, samples=67 iops : min= 3, max= 25, avg=10.25, stdev= 4.78, samples=67 lat (usec) : 50=0.13%, 100=3.91%, 250=2.08%, 500=0.26% lat (msec) : 2=1.04%, 4=3.12%, 10=9.11%, 20=6.38%, 50=37.89% lat (msec) : 100=29.56%, 250=6.38%, 500=0.13% cpu : usr=0.08%, sys=6.11%, ctx=1806, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178534: Fri Sep 4 21:18:28 2026 read: IOPS=11, BW=183KiB/s (188kB/s)(6032KiB/32881msec) clat (usec): min=46, max=213927, avg=47197.35, stdev=33106.76 lat (usec): min=46, max=213929, avg=47200.81, stdev=33106.19 clat percentiles (usec): | 1.00th=[ 56], 5.00th=[ 71], 10.00th=[ 104], 20.00th=[ 22676], | 30.00th=[ 32113], 40.00th=[ 36963], 50.00th=[ 43779], 60.00th=[ 51119], | 70.00th=[ 60556], 80.00th=[ 68682], 90.00th=[ 86508], 95.00th=[103285], | 99.00th=[187696], 99.50th=[196084], 99.90th=[214959], 99.95th=[214959], | 99.99th=[214959] bw ( KiB/s): min= 31, max= 341, per=26.17%, avg=182.69, stdev=66.64, samples=65 iops : min= 1, max= 21, avg=10.69, stdev= 4.28, samples=65 write: IOPS=11, BW=190KiB/s (195kB/s)(6256KiB/32881msec); 0 zone resets clat (usec): min=1779, max=194512, avg=37992.90, stdev=37334.61 lat (usec): min=1781, max=194514, avg=38021.99, stdev=37322.65 clat percentiles (usec): | 1.00th=[ 1958], 5.00th=[ 2737], 10.00th=[ 4047], 20.00th=[ 7111], | 30.00th=[ 10159], 40.00th=[ 16712], 50.00th=[ 26346], 60.00th=[ 35390], | 70.00th=[ 47449], 80.00th=[ 68682], 90.00th=[ 91751], 95.00th=[117965], | 99.00th=[154141], 99.50th=[185598], 99.90th=[193987], 99.95th=[193987], | 99.99th=[193987] bw ( KiB/s): min= 31, max= 448, per=25.93%, avg=190.29, stdev=78.64, samples=65 iops : min= 1, max= 28, avg=11.15, stdev= 4.93, samples=65 lat (usec) : 50=0.26%, 100=4.43%, 250=1.95%, 500=0.13%, 750=0.13% lat (usec) : 1000=0.13% lat (msec) : 2=0.78%, 4=4.17%, 10=10.29%, 20=8.07%, 50=35.03% lat (msec) : 100=27.86%, 250=6.77% cpu : usr=0.10%, sys=6.03%, ctx=1713, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=698KiB/s (715kB/s), 171KiB/s-184KiB/s (175kB/s-189kB/s), io=23.4MiB (24.5MB), run=32881-34311msec WRITE: bw=734KiB/s (752kB/s), 178KiB/s-195KiB/s (182kB/s-200kB/s), io=24.6MiB (25.8MB), run=32881-34311msec rand-rw: (groupid=0, jobs=1): err= 0: pid=178535: Fri Sep 4 21:18:39 2026 read: IOPS=8, BW=132KiB/s (135kB/s)(5920KiB/44977msec) clat (msec): min=7, max=239, avg=46.95, stdev=42.24 lat (msec): min=7, max=239, avg=46.95, stdev=42.24 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 13], 20.00th=[ 17], | 30.00th=[ 21], 40.00th=[ 25], 50.00th=[ 33], 60.00th=[ 40], | 70.00th=[ 51], 80.00th=[ 68], 90.00th=[ 115], 95.00th=[ 144], | 99.00th=[ 197], 99.50th=[ 209], 99.90th=[ 241], 99.95th=[ 241], | 99.99th=[ 241] bw ( KiB/s): min= 31, max= 509, per=24.67%, avg=131.00, stdev=99.53, samples=89 iops : min= 1, max= 31, avg= 7.42, stdev= 6.25, samples=89 write: IOPS=8, BW=142KiB/s (145kB/s)(6368KiB/44977msec); 0 zone resets clat (msec): min=15, max=268, avg=69.01, stdev=45.49 lat (msec): min=15, max=268, avg=69.02, stdev=45.49 clat percentiles (msec): | 1.00th=[ 19], 5.00th=[ 23], 10.00th=[ 26], 20.00th=[ 32], | 30.00th=[ 39], 40.00th=[ 44], 50.00th=[ 54], 60.00th=[ 67], | 70.00th=[ 87], 80.00th=[ 109], 90.00th=[ 134], 95.00th=[ 155], | 99.00th=[ 234], 99.50th=[ 249], 99.90th=[ 268], 99.95th=[ 268], | 99.99th=[ 268] bw ( KiB/s): min= 29, max= 414, per=25.79%, avg=143.92, stdev=89.59, samples=87 iops : min= 1, max= 25, avg= 8.23, stdev= 5.65, samples=87 lat (msec) : 10=1.04%, 20=13.41%, 50=43.62%, 100=24.48%, 250=17.32% lat (msec) : 500=0.13% cpu : usr=0.07%, sys=1.91%, ctx=1227, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178536: Fri Sep 4 21:18:39 2026 read: IOPS=7, BW=127KiB/s (130kB/s)(5744KiB/45085msec) clat (msec): min=7, max=275, avg=48.55, stdev=45.50 lat (msec): min=7, max=275, avg=48.56, stdev=45.50 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 13], 10.00th=[ 15], 20.00th=[ 18], | 30.00th=[ 22], 40.00th=[ 26], 50.00th=[ 32], 60.00th=[ 40], | 70.00th=[ 49], 80.00th=[ 72], 90.00th=[ 112], 95.00th=[ 150], | 99.00th=[ 213], 99.50th=[ 268], 99.90th=[ 275], 99.95th=[ 275], | 99.99th=[ 275] bw ( KiB/s): min= 30, max= 541, per=25.16%, avg=133.60, stdev=94.36, samples=84 iops : min= 1, max= 33, avg= 7.56, stdev= 5.94, samples=84 write: IOPS=9, BW=145KiB/s (149kB/s)(6544KiB/45085msec); 0 zone resets clat (msec): min=17, max=237, avg=67.02, stdev=45.01 lat (msec): min=17, max=237, avg=67.02, stdev=45.01 clat percentiles (msec): | 1.00th=[ 20], 5.00th=[ 23], 10.00th=[ 26], 20.00th=[ 32], | 30.00th=[ 37], 40.00th=[ 43], 50.00th=[ 53], 60.00th=[ 64], | 70.00th=[ 79], 80.00th=[ 100], 90.00th=[ 129], 95.00th=[ 167], | 99.00th=[ 218], 99.50th=[ 234], 99.90th=[ 239], 99.95th=[ 239], | 99.99th=[ 239] bw ( KiB/s): min= 31, max= 415, per=26.09%, avg=145.56, stdev=91.59, samples=88 iops : min= 1, max= 25, avg= 8.33, stdev= 5.77, samples=88 lat (msec) : 10=0.91%, 20=11.85%, 50=45.96%, 100=25.39%, 250=15.49% lat (msec) : 500=0.39% cpu : usr=0.08%, sys=1.98%, ctx=1290, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178537: Fri Sep 4 21:18:39 2026 read: IOPS=8, BW=140KiB/s (144kB/s)(6256KiB/44541msec) clat (msec): min=7, max=244, avg=45.70, stdev=42.48 lat (msec): min=7, max=244, avg=45.70, stdev=42.48 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 13], 10.00th=[ 14], 20.00th=[ 18], | 30.00th=[ 22], 40.00th=[ 26], 50.00th=[ 30], 60.00th=[ 36], | 70.00th=[ 47], 80.00th=[ 63], 90.00th=[ 101], 95.00th=[ 146], | 99.00th=[ 226], 99.50th=[ 228], 99.90th=[ 245], 99.95th=[ 245], | 99.99th=[ 245] bw ( KiB/s): min= 31, max= 667, per=27.07%, avg=143.76, stdev=114.04, samples=86 iops : min= 1, max= 41, avg= 8.22, stdev= 7.18, samples=86 write: IOPS=8, BW=135KiB/s (139kB/s)(6032KiB/44541msec); 0 zone resets clat (msec): min=10, max=223, avg=69.88, stdev=45.42 lat (msec): min=10, max=223, avg=69.88, stdev=45.42 clat percentiles (msec): | 1.00th=[ 19], 5.00th=[ 24], 10.00th=[ 26], 20.00th=[ 32], | 30.00th=[ 39], 40.00th=[ 45], 50.00th=[ 52], 60.00th=[ 67], | 70.00th=[ 88], 80.00th=[ 111], 90.00th=[ 142], 95.00th=[ 165], | 99.00th=[ 203], 99.50th=[ 215], 99.90th=[ 224], 99.95th=[ 224], | 99.99th=[ 224] bw ( KiB/s): min= 31, max= 416, per=24.63%, avg=137.45, stdev=83.30, samples=86 iops : min= 1, max= 26, avg= 7.83, stdev= 5.25, samples=86 lat (msec) : 10=1.30%, 20=11.98%, 50=47.40%, 100=22.53%, 250=16.80% cpu : usr=0.06%, sys=1.79%, ctx=1255, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178538: Fri Sep 4 21:18:39 2026 read: IOPS=8, BW=135KiB/s (138kB/s)(6032KiB/44613msec) clat (msec): min=7, max=276, avg=46.07, stdev=40.22 lat (msec): min=7, max=276, avg=46.07, stdev=40.22 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 13], 10.00th=[ 15], 20.00th=[ 18], | 30.00th=[ 22], 40.00th=[ 25], 50.00th=[ 32], 60.00th=[ 40], | 70.00th=[ 48], 80.00th=[ 70], 90.00th=[ 104], 95.00th=[ 129], | 99.00th=[ 199], 99.50th=[ 243], 99.90th=[ 275], 99.95th=[ 275], | 99.99th=[ 275] bw ( KiB/s): min= 31, max= 446, per=26.05%, avg=138.32, stdev=89.59, samples=85 iops : min= 1, max= 27, avg= 7.87, stdev= 5.64, samples=85 write: IOPS=8, BW=140KiB/s (144kB/s)(6256KiB/44613msec); 0 zone resets clat (msec): min=16, max=261, avg=68.74, stdev=43.93 lat (msec): min=16, max=261, avg=68.77, stdev=43.91 clat percentiles (msec): | 1.00th=[ 20], 5.00th=[ 25], 10.00th=[ 27], 20.00th=[ 32], | 30.00th=[ 38], 40.00th=[ 45], 50.00th=[ 56], 60.00th=[ 70], | 70.00th=[ 85], 80.00th=[ 100], 90.00th=[ 133], 95.00th=[ 150], | 99.00th=[ 232], 99.50th=[ 249], 99.90th=[ 262], 99.95th=[ 262], | 99.99th=[ 262] bw ( KiB/s): min= 29, max= 414, per=25.04%, avg=139.72, stdev=89.34, samples=88 iops : min= 1, max= 25, avg= 7.97, stdev= 5.66, samples=88 lat (msec) : 10=0.78%, 20=13.28%, 50=44.14%, 100=26.56%, 250=14.97% lat (msec) : 500=0.26% cpu : usr=0.06%, sys=1.95%, ctx=1176, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=531KiB/s (544kB/s), 127KiB/s-140KiB/s (130kB/s-144kB/s), io=23.4MiB (24.5MB), run=44541-45085msec WRITE: bw=559KiB/s (572kB/s), 135KiB/s-145KiB/s (139kB/s-149kB/s), io=24.6MiB (25.8MB), run=44541-45085msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=178550: Fri Sep 4 21:18:53 2026 read: IOPS=1, BW=1916KiB/s (1962kB/s)(7168KiB/3741msec) clat (msec): min=76, max=703, avg=197.05, stdev=226.60 lat (msec): min=76, max=703, avg=197.06, stdev=226.60 clat percentiles (msec): | 1.00th=[ 77], 5.00th=[ 77], 10.00th=[ 77], 20.00th=[ 78], | 30.00th=[ 92], 40.00th=[ 92], 50.00th=[ 97], 60.00th=[ 159], | 70.00th=[ 159], 80.00th=[ 178], 90.00th=[ 701], 95.00th=[ 701], | 99.00th=[ 701], 99.50th=[ 701], 99.90th=[ 701], 99.95th=[ 701], | 99.99th=[ 701] bw ( KiB/s): min= 1475, max= 4031, per=49.91%, avg=2262.20, stdev=1009.35, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 write: IOPS=1, BW=1369KiB/s (1401kB/s)(5120KiB/3741msec); 0 zone resets clat (msec): min=220, max=610, avg=435.32, stdev=145.66 lat (msec): min=220, max=610, avg=435.43, stdev=145.65 clat percentiles (msec): | 1.00th=[ 222], 5.00th=[ 222], 10.00th=[ 222], 20.00th=[ 222], | 30.00th=[ 409], 40.00th=[ 409], 50.00th=[ 418], 60.00th=[ 418], | 70.00th=[ 518], 80.00th=[ 518], 90.00th=[ 609], 95.00th=[ 609], | 99.00th=[ 609], 99.50th=[ 609], 99.90th=[ 609], 99.95th=[ 609], | 99.99th=[ 609] bw ( KiB/s): min= 1899, max= 4039, per=41.22%, avg=2616.00, stdev=1232.37, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (msec) : 100=33.33%, 250=25.00%, 500=16.67%, 750=25.00% cpu : usr=0.00%, sys=6.60%, ctx=117, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178551: Fri Sep 4 21:18:53 2026 read: IOPS=0, BW=453KiB/s (464kB/s)(2048KiB/4517msec) clat (msec): min=118, max=127, avg=123.28, stdev= 6.41 lat (msec): min=118, max=127, avg=123.28, stdev= 6.41 clat percentiles (msec): | 1.00th=[ 120], 5.00th=[ 120], 10.00th=[ 120], 20.00th=[ 120], | 30.00th=[ 120], 40.00th=[ 120], 50.00th=[ 120], 60.00th=[ 128], | 70.00th=[ 128], 80.00th=[ 128], 90.00th=[ 128], 95.00th=[ 128], | 99.00th=[ 128], 99.50th=[ 128], 99.90th=[ 128], 99.95th=[ 128], | 99.99th=[ 128] bw ( KiB/s): min= 2035, max= 2043, per=44.98%, avg=2039.00, stdev= 5.66, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2267KiB/s (2321kB/s)(10.0MiB/4517msec); 0 zone resets clat (msec): min=196, max=692, avg=414.88, stdev=176.05 lat (msec): min=196, max=692, avg=415.03, stdev=176.10 clat percentiles (msec): | 1.00th=[ 197], 5.00th=[ 197], 10.00th=[ 197], 20.00th=[ 239], | 30.00th=[ 253], 40.00th=[ 257], 50.00th=[ 414], 60.00th=[ 422], | 70.00th=[ 481], 80.00th=[ 592], 90.00th=[ 600], 95.00th=[ 693], | 99.00th=[ 693], 99.50th=[ 693], 99.90th=[ 693], 99.95th=[ 693], | 99.99th=[ 693] bw ( KiB/s): min= 1882, max= 3806, per=35.56%, avg=2257.29, stdev=685.18, samples=7 iops : min= 1, max= 3, avg= 1.43, stdev= 0.79, samples=7 lat (msec) : 250=33.33%, 500=41.67%, 750=25.00% cpu : usr=0.02%, sys=6.42%, ctx=87, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178552: Fri Sep 4 21:18:53 2026 read: IOPS=1, BW=1442KiB/s (1476kB/s)(6144KiB/4262msec) clat (msec): min=65, max=867, avg=356.41, stdev=389.78 lat (msec): min=65, max=867, avg=356.41, stdev=389.78 clat percentiles (msec): | 1.00th=[ 66], 5.00th=[ 66], 10.00th=[ 66], 20.00th=[ 71], | 30.00th=[ 71], 40.00th=[ 114], 50.00th=[ 114], 60.00th=[ 176], | 70.00th=[ 844], 80.00th=[ 844], 90.00th=[ 869], 95.00th=[ 869], | 99.00th=[ 869], 99.50th=[ 869], 99.90th=[ 869], 99.95th=[ 869], | 99.99th=[ 869] bw ( KiB/s): min= 2019, max= 4071, per=74.42%, avg=3373.67, stdev=1173.35, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 write: IOPS=1, BW=1442KiB/s (1476kB/s)(6144KiB/4262msec); 0 zone resets clat (msec): min=77, max=670, avg=348.82, stdev=268.73 lat (msec): min=81, max=670, avg=349.62, stdev=267.92 clat percentiles (msec): | 1.00th=[ 79], 5.00th=[ 79], 10.00th=[ 79], 20.00th=[ 115], | 30.00th=[ 115], 40.00th=[ 142], 50.00th=[ 142], 60.00th=[ 472], | 70.00th=[ 617], 80.00th=[ 617], 90.00th=[ 667], 95.00th=[ 667], | 99.00th=[ 667], 99.50th=[ 667], 99.90th=[ 667], 99.95th=[ 667], | 99.99th=[ 667] bw ( KiB/s): min= 1910, max= 2741, per=34.27%, avg=2175.25, stdev=381.13, samples=4 iops : min= 1, max= 2, avg= 1.25, stdev= 0.50, samples=4 lat (msec) : 100=25.00%, 250=33.33%, 500=8.33%, 750=16.67%, 1000=16.67% cpu : usr=0.09%, sys=5.68%, ctx=83, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178554: Fri Sep 4 21:18:53 2026 read: IOPS=1, BW=1266KiB/s (1296kB/s)(5120KiB/4044msec) clat (msec): min=142, max=596, avg=270.75, stdev=193.21 lat (msec): min=142, max=596, avg=270.75, stdev=193.21 clat percentiles (msec): | 1.00th=[ 142], 5.00th=[ 142], 10.00th=[ 142], 20.00th=[ 142], | 30.00th=[ 146], 40.00th=[ 146], 50.00th=[ 169], 60.00th=[ 169], | 70.00th=[ 300], 80.00th=[ 300], 90.00th=[ 600], 95.00th=[ 600], | 99.00th=[ 600], 99.50th=[ 600], 99.90th=[ 600], 99.95th=[ 600], | 99.99th=[ 600] bw ( KiB/s): min= 1899, max= 3992, per=58.17%, avg=2636.67, stdev=1175.29, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 write: IOPS=1, BW=1773KiB/s (1815kB/s)(7168KiB/4044msec); 0 zone resets clat (msec): min=191, max=615, avg=356.62, stdev=147.49 lat (msec): min=192, max=615, avg=356.76, stdev=147.55 clat percentiles (msec): | 1.00th=[ 192], 5.00th=[ 192], 10.00th=[ 192], 20.00th=[ 209], | 30.00th=[ 288], 40.00th=[ 288], 50.00th=[ 363], 60.00th=[ 380], | 70.00th=[ 380], 80.00th=[ 456], 90.00th=[ 617], 95.00th=[ 617], | 99.00th=[ 617], 99.50th=[ 617], 99.90th=[ 617], 99.95th=[ 617], | 99.99th=[ 617] bw ( KiB/s): min= 1361, max= 3820, per=35.07%, avg=2226.00, stdev=932.33, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 lat (msec) : 250=41.67%, 500=41.67%, 750=16.67% cpu : usr=0.07%, sys=5.89%, ctx=117, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4534KiB/s (4643kB/s), 453KiB/s-1916KiB/s (464kB/s-1962kB/s), io=20.0MiB (20.0MB), run=3741-4517msec WRITE: bw=6348KiB/s (6500kB/s), 1369KiB/s-2267KiB/s (1401kB/s-2321kB/s), io=28.0MiB (29.4MB), run=3741-4517msec rand-rw: (groupid=0, jobs=1): err= 0: pid=178553: Fri Sep 4 21:18:54 2026 read: IOPS=2, BW=2272KiB/s (2326kB/s)(7168KiB/3155msec) clat (msec): min=145, max=415, avg=254.65, stdev=82.11 lat (msec): min=145, max=415, avg=254.65, stdev=82.11 clat percentiles (msec): | 1.00th=[ 146], 5.00th=[ 146], 10.00th=[ 146], 20.00th=[ 209], | 30.00th=[ 239], 40.00th=[ 239], 50.00th=[ 251], 60.00th=[ 259], | 70.00th=[ 259], 80.00th=[ 264], 90.00th=[ 418], 95.00th=[ 418], | 99.00th=[ 418], 99.50th=[ 418], 99.90th=[ 418], 99.95th=[ 418], | 99.99th=[ 418] bw ( KiB/s): min= 1458, max= 4007, per=64.18%, avg=2829.00, stdev=1279.97, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 1.15, samples=4 write: IOPS=1, BW=1623KiB/s (1662kB/s)(5120KiB/3155msec); 0 zone resets clat (msec): min=124, max=401, avg=230.32, stdev=107.77 lat (msec): min=124, max=401, avg=230.43, stdev=107.76 clat percentiles (msec): | 1.00th=[ 125], 5.00th=[ 125], 10.00th=[ 125], 20.00th=[ 125], | 30.00th=[ 157], 40.00th=[ 157], 50.00th=[ 224], 60.00th=[ 224], | 70.00th=[ 247], 80.00th=[ 247], 90.00th=[ 401], 95.00th=[ 401], | 99.00th=[ 401], 99.50th=[ 401], 99.90th=[ 401], 99.95th=[ 401], | 99.99th=[ 401] bw ( KiB/s): min= 2003, max= 5988, per=54.09%, avg=3338.00, stdev=2294.99, samples=3 iops : min= 1, max= 5, avg= 2.33, stdev= 2.31, samples=3 lat (msec) : 250=58.33%, 500=41.67% cpu : usr=0.06%, sys=21.15%, ctx=227, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178555: Fri Sep 4 21:18:54 2026 read: IOPS=0, BW=441KiB/s (451kB/s)(2048KiB/4646msec) clat (msec): min=33, max=185, avg=109.86, stdev=107.33 lat (msec): min=33, max=185, avg=109.87, stdev=107.33 clat percentiles (msec): | 1.00th=[ 34], 5.00th=[ 34], 10.00th=[ 34], 20.00th=[ 34], | 30.00th=[ 34], 40.00th=[ 34], 50.00th=[ 34], 60.00th=[ 186], | 70.00th=[ 186], 80.00th=[ 186], 90.00th=[ 186], 95.00th=[ 186], | 99.00th=[ 186], 99.50th=[ 186], 99.90th=[ 186], 99.95th=[ 186], | 99.99th=[ 186] bw ( KiB/s): min= 1416, max= 1899, per=37.60%, avg=1657.50, stdev=341.53, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2204KiB/s (2257kB/s)(10.0MiB/4646msec); 0 zone resets clat (msec): min=120, max=1151, avg=424.92, stdev=300.60 lat (msec): min=120, max=1151, avg=425.04, stdev=300.56 clat percentiles (msec): | 1.00th=[ 121], 5.00th=[ 121], 10.00th=[ 121], 20.00th=[ 232], | 30.00th=[ 257], 40.00th=[ 262], 50.00th=[ 309], 60.00th=[ 342], | 70.00th=[ 397], 80.00th=[ 489], 90.00th=[ 701], 95.00th=[ 1150], | 99.00th=[ 1150], 99.50th=[ 1150], 99.90th=[ 1150], 99.95th=[ 1150], | 99.99th=[ 1150] bw ( KiB/s): min= 2003, max= 4063, per=50.92%, avg=3142.40, stdev=1037.90, samples=5 iops : min= 1, max= 3, avg= 2.20, stdev= 1.10, samples=5 lat (msec) : 50=8.33%, 250=25.00%, 500=50.00%, 750=8.33%, 2000=8.33% cpu : usr=0.04%, sys=15.89%, ctx=150, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178556: Fri Sep 4 21:18:54 2026 read: IOPS=1, BW=1949KiB/s (1996kB/s)(6144KiB/3152msec) clat (usec): min=942, max=292706, avg=142913.05, stdev=134128.32 lat (usec): min=944, max=292707, avg=142914.30, stdev=134128.06 clat percentiles (usec): | 1.00th=[ 947], 5.00th=[ 947], 10.00th=[ 947], 20.00th=[ 2999], | 30.00th=[ 2999], 40.00th=[ 66323], 50.00th=[ 66323], 60.00th=[240124], | 70.00th=[254804], 80.00th=[254804], 90.00th=[291505], 95.00th=[291505], | 99.00th=[291505], 99.50th=[291505], 99.90th=[291505], 99.95th=[291505], | 99.99th=[291505] bw ( KiB/s): min= 2023, max= 3992, per=74.43%, avg=3281.00, stdev=1092.54, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 write: IOPS=1, BW=1949KiB/s (1996kB/s)(6144KiB/3152msec); 0 zone resets clat (msec): min=192, max=651, avg=373.15, stdev=164.15 lat (msec): min=192, max=652, avg=373.22, stdev=164.17 clat percentiles (msec): | 1.00th=[ 192], 5.00th=[ 192], 10.00th=[ 192], 20.00th=[ 257], | 30.00th=[ 257], 40.00th=[ 305], 50.00th=[ 305], 60.00th=[ 388], | 70.00th=[ 447], 80.00th=[ 447], 90.00th=[ 651], 95.00th=[ 651], | 99.00th=[ 651], 99.50th=[ 651], 99.90th=[ 651], 99.95th=[ 651], | 99.99th=[ 651] bw ( KiB/s): min= 1914, max= 2820, per=35.46%, avg=2188.25, stdev=423.71, samples=4 iops : min= 1, max= 2, avg= 1.25, stdev= 0.50, samples=4 lat (usec) : 1000=8.33% lat (msec) : 4=8.33%, 100=8.33%, 250=16.67%, 500=50.00%, 750=8.33% cpu : usr=0.00%, sys=20.18%, ctx=230, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178557: Fri Sep 4 21:18:54 2026 read: IOPS=1, BW=1232KiB/s (1261kB/s)(5120KiB/4157msec) clat (usec): min=347, max=479637, avg=165741.34, stdev=231039.90 lat (usec): min=347, max=479638, avg=165742.52, stdev=231040.09 clat percentiles (usec): | 1.00th=[ 347], 5.00th=[ 347], 10.00th=[ 347], 20.00th=[ 347], | 30.00th=[ 506], 40.00th=[ 506], 50.00th=[ 627], 60.00th=[ 627], | 70.00th=[346031], 80.00th=[346031], 90.00th=[480248], 95.00th=[480248], | 99.00th=[480248], 99.50th=[480248], 99.90th=[480248], 99.95th=[480248], | 99.99th=[480248] bw ( KiB/s): min= 1899, max= 6095, per=90.68%, avg=3997.00, stdev=2967.02, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 write: IOPS=1, BW=1724KiB/s (1766kB/s)(7168KiB/4157msec); 0 zone resets clat (msec): min=170, max=824, avg=443.01, stdev=240.53 lat (msec): min=170, max=824, avg=443.11, stdev=240.56 clat percentiles (msec): | 1.00th=[ 171], 5.00th=[ 171], 10.00th=[ 171], 20.00th=[ 232], | 30.00th=[ 271], 40.00th=[ 271], 50.00th=[ 451], 60.00th=[ 481], | 70.00th=[ 481], 80.00th=[ 667], 90.00th=[ 827], 95.00th=[ 827], | 99.00th=[ 827], 99.50th=[ 827], 99.90th=[ 827], 99.95th=[ 827], | 99.99th=[ 827] bw ( KiB/s): min= 1481, max= 2031, per=30.61%, avg=1889.00, stdev=232.73, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 lat (usec) : 500=8.33%, 750=16.67% lat (msec) : 250=16.67%, 500=41.67%, 750=8.33%, 1000=8.33% cpu : usr=0.00%, sys=13.91%, ctx=218, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4408KiB/s (4514kB/s), 441KiB/s-2272KiB/s (451kB/s-2326kB/s), io=20.0MiB (20.0MB), run=3152-4646msec WRITE: bw=6171KiB/s (6319kB/s), 1623KiB/s-2204KiB/s (1662kB/s-2257kB/s), io=28.0MiB (29.4MB), run=3152-4646msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=178566: Fri Sep 4 21:19:09 2026 read: IOPS=1, BW=4393KiB/s (4499kB/s)(12.0MiB/2797msec) clat (msec): min=770, max=1174, avg=908.99, stdev=229.91 lat (msec): min=770, max=1174, avg=909.00, stdev=229.91 clat percentiles (msec): | 1.00th=[ 768], 5.00th=[ 768], 10.00th=[ 768], 20.00th=[ 768], | 30.00th=[ 768], 40.00th=[ 785], 50.00th=[ 785], 60.00th=[ 785], | 70.00th=[ 1167], 80.00th=[ 1167], 90.00th=[ 1167], 95.00th=[ 1167], | 99.00th=[ 1167], 99.50th=[ 1167], 99.90th=[ 1167], 99.95th=[ 1167], | 99.99th=[ 1167] bw ( KiB/s): min= 8078, max= 8159, per=100.00%, avg=8118.50, stdev=57.28, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=66.67%, 2000=33.33% cpu : usr=0.00%, sys=15.88%, ctx=281, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178568: Fri Sep 4 21:19:09 2026 read: IOPS=0, BW=1374KiB/s (1407kB/s)(4096KiB/2981msec) clat (nsec): min=892873k, max=892873k, avg=892873202.00, stdev= 0.00 lat (nsec): min=892875k, max=892875k, avg=892875347.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 894], 5.00th=[ 894], 10.00th=[ 894], 20.00th=[ 894], | 30.00th=[ 894], 40.00th=[ 894], 50.00th=[ 894], 60.00th=[ 894], | 70.00th=[ 894], 80.00th=[ 894], 90.00th=[ 894], 95.00th=[ 894], | 99.00th=[ 894], 99.50th=[ 894], 99.90th=[ 894], 99.95th=[ 894], | 99.99th=[ 894] bw ( KiB/s): min= 8143, max= 8143, per=100.00%, avg=8143.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2748KiB/s (2814kB/s)(8192KiB/2981msec); 0 zone resets clat (msec): min=301, max=1607, avg=954.12, stdev=923.40 lat (msec): min=301, max=1607, avg=954.67, stdev=923.58 clat percentiles (msec): | 1.00th=[ 300], 5.00th=[ 300], 10.00th=[ 300], 20.00th=[ 300], | 30.00th=[ 300], 40.00th=[ 300], 50.00th=[ 300], 60.00th=[ 1603], | 70.00th=[ 1603], 80.00th=[ 1603], 90.00th=[ 1603], 95.00th=[ 1603], | 99.00th=[ 1603], 99.50th=[ 1603], 99.90th=[ 1603], 99.95th=[ 1603], | 99.99th=[ 1603] bw ( KiB/s): min= 8078, max= 8078, per=96.10%, avg=8078.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=7.79%, ctx=164, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178569: Fri Sep 4 21:19:09 2026 write: IOPS=0, BW=3152KiB/s (3228kB/s)(12.0MiB/3898msec); 0 zone resets clat (msec): min=261, max=1683, avg=1188.22, stdev=803.56 lat (msec): min=261, max=1684, avg=1189.32, stdev=803.92 clat percentiles (msec): | 1.00th=[ 262], 5.00th=[ 262], 10.00th=[ 262], 20.00th=[ 262], | 30.00th=[ 262], 40.00th=[ 1620], 50.00th=[ 1620], 60.00th=[ 1620], | 70.00th=[ 1687], 80.00th=[ 1687], 90.00th=[ 1687], 95.00th=[ 1687], | 99.00th=[ 1687], 99.50th=[ 1687], 99.90th=[ 1687], 99.95th=[ 1687], | 99.99th=[ 1687] bw ( KiB/s): min= 8078, max= 8078, per=96.10%, avg=8078.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.03%, sys=3.49%, ctx=63, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178572: Fri Sep 4 21:19:09 2026 write: IOPS=0, BW=4041KiB/s (4138kB/s)(12.0MiB/3041msec); 0 zone resets clat (msec): min=870, max=1029, avg=956.18, stdev=80.03 lat (msec): min=874, max=1030, avg=957.61, stdev=78.43 clat percentiles (msec): | 1.00th=[ 869], 5.00th=[ 869], 10.00th=[ 869], 20.00th=[ 869], | 30.00th=[ 869], 40.00th=[ 969], 50.00th=[ 969], 60.00th=[ 969], | 70.00th=[ 1028], 80.00th=[ 1028], 90.00th=[ 1028], 95.00th=[ 1028], | 99.00th=[ 1028], 99.50th=[ 1028], 99.90th=[ 1028], 99.95th=[ 1028], | 99.99th=[ 1028] bw ( KiB/s): min= 8110, max= 8192, per=96.97%, avg=8151.00, stdev=57.98, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 1000=66.67%, 2000=33.33% cpu : usr=0.00%, sys=5.86%, ctx=54, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5496KiB/s (5628kB/s), 1374KiB/s-4393KiB/s (1407kB/s-4499kB/s), io=16.0MiB (16.8MB), run=2797-2981msec WRITE: bw=8406KiB/s (8608kB/s), 2748KiB/s-4041KiB/s (2814kB/s-4138kB/s), io=32.0MiB (33.6MB), run=2981-3898msec rand-rw: (groupid=0, jobs=1): err= 0: pid=178565: Fri Sep 4 21:19:09 2026 read: IOPS=0, BW=3566KiB/s (3651kB/s)(12.0MiB/3446msec) clat (msec): min=245, max=1573, avg=1114.31, stdev=752.76 lat (msec): min=245, max=1573, avg=1114.31, stdev=752.76 clat percentiles (msec): | 1.00th=[ 247], 5.00th=[ 247], 10.00th=[ 247], 20.00th=[ 247], | 30.00th=[ 247], 40.00th=[ 1519], 50.00th=[ 1519], 60.00th=[ 1519], | 70.00th=[ 1569], 80.00th=[ 1569], 90.00th=[ 1569], 95.00th=[ 1569], | 99.00th=[ 1569], 99.50th=[ 1569], 99.90th=[ 1569], 99.95th=[ 1569], | 99.99th=[ 1569] bw ( KiB/s): min= 8143, max= 8192, per=100.00%, avg=8167.50, stdev=34.65, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 250=33.33%, 2000=66.67% cpu : usr=0.00%, sys=3.40%, ctx=49, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178567: Fri Sep 4 21:19:09 2026 read: IOPS=0, BW=1178KiB/s (1206kB/s)(4096KiB/3477msec) clat (nsec): min=1300.4M, max=1300.4M, avg=1300380388.00, stdev= 0.00 lat (nsec): min=1300.4M, max=1300.4M, avg=1300382700.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1301], 5.00th=[ 1301], 10.00th=[ 1301], 20.00th=[ 1301], | 30.00th=[ 1301], 40.00th=[ 1301], 50.00th=[ 1301], 60.00th=[ 1301], | 70.00th=[ 1301], 80.00th=[ 1301], 90.00th=[ 1301], 95.00th=[ 1301], | 99.00th=[ 1301], 99.50th=[ 1301], 99.90th=[ 1301], 99.95th=[ 1301], | 99.99th=[ 1301] bw ( KiB/s): min= 8143, max= 8143, per=100.00%, avg=8143.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2356KiB/s (2413kB/s)(8192KiB/3477msec); 0 zone resets clat (msec): min=381, max=1719, avg=1050.52, stdev=946.06 lat (msec): min=383, max=1719, avg=1051.48, stdev=945.32 clat percentiles (msec): | 1.00th=[ 380], 5.00th=[ 380], 10.00th=[ 380], 20.00th=[ 380], | 30.00th=[ 380], 40.00th=[ 380], 50.00th=[ 380], 60.00th=[ 1720], | 70.00th=[ 1720], 80.00th=[ 1720], 90.00th=[ 1720], 95.00th=[ 1720], | 99.00th=[ 1720], 99.50th=[ 1720], 99.90th=[ 1720], 99.95th=[ 1720], | 99.99th=[ 1720] bw ( KiB/s): min= 8159, max= 8159, per=100.00%, avg=8159.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.00%, sys=3.42%, ctx=49, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178570: Fri Sep 4 21:19:09 2026 write: IOPS=0, BW=2957KiB/s (3028kB/s)(12.0MiB/4156msec); 0 zone resets clat (msec): min=311, max=1975, avg=1359.37, stdev=912.22 lat (msec): min=311, max=1976, avg=1360.33, stdev=912.65 clat percentiles (msec): | 1.00th=[ 313], 5.00th=[ 313], 10.00th=[ 313], 20.00th=[ 313], | 30.00th=[ 313], 40.00th=[ 1787], 50.00th=[ 1787], 60.00th=[ 1787], | 70.00th=[ 1972], 80.00th=[ 1972], 90.00th=[ 1972], 95.00th=[ 1972], | 99.00th=[ 1972], 99.50th=[ 1972], 99.90th=[ 1972], 99.95th=[ 1972], | 99.99th=[ 1972] bw ( KiB/s): min= 8159, max= 8159, per=100.00%, avg=8159.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.00%, sys=3.66%, ctx=70, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178571: Fri Sep 4 21:19:09 2026 write: IOPS=1, BW=4830KiB/s (4946kB/s)(12.0MiB/2544msec); 0 zone resets clat (msec): min=402, max=1237, avg=787.18, stdev=421.31 lat (msec): min=403, max=1245, avg=790.31, stdev=425.53 clat percentiles (msec): | 1.00th=[ 405], 5.00th=[ 405], 10.00th=[ 405], 20.00th=[ 405], | 30.00th=[ 405], 40.00th=[ 718], 50.00th=[ 718], 60.00th=[ 718], | 70.00th=[ 1234], 80.00th=[ 1234], 90.00th=[ 1234], 95.00th=[ 1234], | 99.00th=[ 1234], 99.50th=[ 1234], 99.90th=[ 1234], 99.95th=[ 1234], | 99.99th=[ 1234] bw ( KiB/s): min= 7049, max= 8126, per=96.24%, avg=7587.50, stdev=761.55, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.04%, sys=7.16%, ctx=65, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4712KiB/s (4825kB/s), 1178KiB/s-3566KiB/s (1206kB/s-3651kB/s), io=16.0MiB (16.8MB), run=3446-3477msec WRITE: bw=7885KiB/s (8074kB/s), 2356KiB/s-4830KiB/s (2413kB/s-4946kB/s), io=32.0MiB (33.6MB), run=2544-4156msec