== sanity test 398b: DIO and buffer IO race ============== 03:23:55 (1788333835) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 7.94883 s, 6.3 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144846: Wed Sep 2 03:26:18 2026 read: IOPS=12, BW=50.5KiB/s (51.7kB/s)(5992KiB/118598msec) clat (usec): min=30, max=1031.8k, avg=38527.06, stdev=39071.74 lat (usec): min=30, max=1031.8k, avg=38529.41, stdev=39071.20 clat percentiles (usec): | 1.00th=[ 47], 5.00th=[ 64], 10.00th=[ 159], | 20.00th=[ 17695], 30.00th=[ 22938], 40.00th=[ 27919], | 50.00th=[ 32637], 60.00th=[ 38536], 70.00th=[ 46924], | 80.00th=[ 56886], 90.00th=[ 72877], 95.00th=[ 86508], | 99.00th=[ 122160], 99.50th=[ 160433], 99.90th=[ 497026], | 99.95th=[1035994], 99.99th=[1035994] bw ( KiB/s): min= 7, max= 126, per=24.97%, avg=50.18, stdev=19.72, samples=233 iops : min= 1, max= 31, avg=11.92, stdev= 4.97, samples=233 write: IOPS=13, BW=53.1KiB/s (54.4kB/s)(6296KiB/118598msec); 0 zone resets clat (usec): min=969, max=322513, avg=38341.54, stdev=39401.07 lat (usec): min=969, max=322515, avg=38344.86, stdev=39400.20 clat percentiles (usec): | 1.00th=[ 1074], 5.00th=[ 1319], 10.00th=[ 1876], 20.00th=[ 4228], | 30.00th=[ 8586], 40.00th=[ 18220], 50.00th=[ 28181], 60.00th=[ 38011], | 70.00th=[ 51119], 80.00th=[ 66847], 90.00th=[ 88605], 95.00th=[113771], | 99.00th=[185598], 99.50th=[206570], 99.90th=[250610], 99.95th=[320865], | 99.99th=[320865] bw ( KiB/s): min= 7, max= 117, per=25.21%, avg=52.94, stdev=22.16, samples=232 iops : min= 1, max= 29, avg=12.61, stdev= 5.56, samples=232 lat (usec) : 50=0.72%, 100=3.81%, 250=0.62%, 500=0.10%, 750=0.03% lat (usec) : 1000=0.16% lat (msec) : 2=5.53%, 4=4.33%, 10=7.06%, 20=10.77%, 50=38.48% lat (msec) : 100=23.67%, 250=4.59%, 500=0.10%, 2000=0.03% cpu : usr=0.08%, sys=6.02%, ctx=6742, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144847: Wed Sep 2 03:26:18 2026 read: IOPS=12, BW=50.2KiB/s (51.4kB/s)(5940KiB/118427msec) clat (usec): min=30, max=1073.2k, avg=38283.00, stdev=40931.13 lat (usec): min=30, max=1073.2k, avg=38286.92, stdev=40931.21 clat percentiles (usec): | 1.00th=[ 48], 5.00th=[ 62], 10.00th=[ 103], | 20.00th=[ 16909], 30.00th=[ 22152], 40.00th=[ 27132], | 50.00th=[ 32375], 60.00th=[ 38011], 70.00th=[ 45876], | 80.00th=[ 57934], 90.00th=[ 70779], 95.00th=[ 86508], | 99.00th=[ 127402], 99.50th=[ 160433], 99.90th=[ 557843], | 99.95th=[1069548], 99.99th=[1069548] bw ( KiB/s): min= 7, max= 111, per=24.89%, avg=50.03, stdev=20.31, samples=232 iops : min= 1, max= 27, avg=11.88, stdev= 5.12, samples=232 write: IOPS=13, BW=53.6KiB/s (54.9kB/s)(6348KiB/118427msec); 0 zone resets clat (usec): min=962, max=213250, avg=38479.12, stdev=37956.14 lat (usec): min=963, max=213252, avg=38483.22, stdev=37955.09 clat percentiles (usec): | 1.00th=[ 1074], 5.00th=[ 1254], 10.00th=[ 1844], 20.00th=[ 3916], | 30.00th=[ 8356], 40.00th=[ 18220], 50.00th=[ 28967], 60.00th=[ 39584], | 70.00th=[ 52167], 80.00th=[ 66847], 90.00th=[ 91751], 95.00th=[113771], | 99.00th=[156238], 99.50th=[179307], 99.90th=[210764], 99.95th=[212861], | 99.99th=[212861] bw ( KiB/s): min= 15, max= 119, per=25.35%, avg=53.24, stdev=22.36, samples=233 iops : min= 3, max= 29, avg=12.69, stdev= 5.64, samples=233 lat (usec) : 50=0.65%, 100=4.10%, 250=0.49%, 500=0.20%, 750=0.10% lat (usec) : 1000=0.16% lat (msec) : 2=5.70%, 4=4.85%, 10=6.54%, 20=10.77%, 50=37.73% lat (msec) : 100=23.24%, 250=5.37%, 500=0.03%, 750=0.03%, 2000=0.03% cpu : usr=0.08%, sys=5.86%, ctx=6565, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144848: Wed Sep 2 03:26:18 2026 read: IOPS=12, BW=50.5KiB/s (51.7kB/s)(6028KiB/119455msec) clat (usec): min=29, max=200239, avg=36748.76, stdev=27953.86 lat (usec): min=29, max=200240, avg=36750.54, stdev=27953.94 clat percentiles (usec): | 1.00th=[ 46], 5.00th=[ 57], 10.00th=[ 96], 20.00th=[ 16450], | 30.00th=[ 21890], 40.00th=[ 26084], 50.00th=[ 31065], 60.00th=[ 37487], | 70.00th=[ 45351], 80.00th=[ 56361], 90.00th=[ 71828], 95.00th=[ 88605], | 99.00th=[129500], 99.50th=[154141], 99.90th=[196084], 99.95th=[200279], | 99.99th=[200279] bw ( KiB/s): min= 7, max= 135, per=25.01%, avg=50.27, stdev=21.39, samples=234 iops : min= 1, max= 33, avg=11.94, stdev= 5.36, samples=234 write: IOPS=13, BW=52.4KiB/s (53.7kB/s)(6260KiB/119455msec); 0 zone resets clat (usec): min=906, max=1010.6k, avg=40574.41, stdev=47413.40 lat (usec): min=907, max=1010.6k, avg=40592.85, stdev=47414.34 clat percentiles (usec): | 1.00th=[ 1074], 5.00th=[ 1303], 10.00th=[ 1745], | 20.00th=[ 4293], 30.00th=[ 8586], 40.00th=[ 20055], | 50.00th=[ 30278], 60.00th=[ 41681], 70.00th=[ 53740], | 80.00th=[ 69731], 90.00th=[ 92799], 95.00th=[ 114820], | 99.00th=[ 158335], 99.50th=[ 191890], 99.90th=[ 522191], | 99.95th=[1010828], 99.99th=[1010828] bw ( KiB/s): min= 7, max= 152, per=24.75%, avg=51.97, stdev=21.91, samples=235 iops : min= 1, max= 38, avg=12.37, stdev= 5.50, samples=235 lat (usec) : 50=0.98%, 100=4.00%, 250=0.88%, 500=0.16%, 750=0.10% lat (usec) : 1000=0.23% lat (msec) : 2=5.47%, 4=4.30%, 10=6.54%, 20=10.68%, 50=37.79% lat (msec) : 100=23.21%, 250=5.57%, 500=0.03%, 750=0.03%, 2000=0.03% cpu : usr=0.08%, sys=5.89%, ctx=6574, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144849: Wed Sep 2 03:26:18 2026 read: IOPS=12, BW=51.4KiB/s (52.6kB/s)(6052KiB/117745msec) clat (usec): min=34, max=591099, avg=37584.62, stdev=32348.21 lat (usec): min=34, max=591100, avg=37587.39, stdev=32349.05 clat percentiles (usec): | 1.00th=[ 47], 5.00th=[ 59], 10.00th=[ 101], 20.00th=[ 16909], | 30.00th=[ 22152], 40.00th=[ 27395], 50.00th=[ 32375], 60.00th=[ 38011], | 70.00th=[ 45351], 80.00th=[ 55313], 90.00th=[ 70779], 95.00th=[ 87557], | 99.00th=[120062], 99.50th=[170918], 99.90th=[396362], 99.95th=[591397], | 99.99th=[591397] bw ( KiB/s): min= 7, max= 111, per=25.45%, avg=51.16, stdev=20.65, samples=231 iops : min= 1, max= 27, avg=12.16, stdev= 5.18, samples=231 write: IOPS=13, BW=52.0KiB/s (54.2kB/s)(6236KiB/117745msec); 0 zone resets clat (usec): min=873, max=859177, avg=38694.86, stdev=42421.95 lat (usec): min=874, max=859179, avg=38700.74, stdev=42429.82 clat percentiles (usec): | 1.00th=[ 1057], 5.00th=[ 1254], 10.00th=[ 1958], 20.00th=[ 4621], | 30.00th=[ 9372], 40.00th=[ 19268], 50.00th=[ 29492], 60.00th=[ 39584], | 70.00th=[ 50594], 80.00th=[ 66847], 90.00th=[ 88605], 95.00th=[111674], | 99.00th=[156238], 99.50th=[177210], 99.90th=[265290], 99.95th=[859833], | 99.99th=[859833] bw ( KiB/s): min= 7, max= 119, per=25.17%, avg=52.87, stdev=21.12, samples=230 iops : min= 1, max= 29, avg=12.60, stdev= 5.29, samples=230 lat (usec) : 50=0.94%, 100=3.97%, 250=0.59%, 500=0.07%, 750=0.07% lat (usec) : 1000=0.23% lat (msec) : 2=5.18%, 4=3.97%, 10=7.52%, 20=10.64%, 50=38.93% lat (msec) : 100=22.88%, 250=4.88%, 500=0.07%, 750=0.03%, 1000=0.03% cpu : usr=0.09%, sys=5.82%, ctx=6591, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=201KiB/s (206kB/s), 50.2KiB/s-51.4KiB/s (51.4kB/s-52.6kB/s), io=23.4MiB (24.6MB), run=117745-119455msec WRITE: bw=210KiB/s (216kB/s), 52.4KiB/s-53.6KiB/s (53.7kB/s-54.9kB/s), io=24.6MiB (25.7MB), run=117745-119455msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144851: Wed Sep 2 03:28:29 2026 read: IOPS=5, BW=23.0KiB/s (24.5kB/s)(5992KiB/250052msec) clat (msec): min=5, max=992, avg=33.19, stdev=43.30 lat (msec): min=5, max=992, avg=33.19, stdev=43.30 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 10], 10.00th=[ 11], 20.00th=[ 13], | 30.00th=[ 16], 40.00th=[ 18], 50.00th=[ 21], 60.00th=[ 25], | 70.00th=[ 31], 80.00th=[ 44], 90.00th=[ 70], 95.00th=[ 96], | 99.00th=[ 178], 99.50th=[ 257], 99.90th=[ 456], 99.95th=[ 995], | 99.99th=[ 995] bw ( KiB/s): min= 7, max= 88, per=28.08%, avg=26.67, stdev=17.35, samples=435 iops : min= 1, max= 22, avg= 6.06, stdev= 4.37, samples=435 write: IOPS=6, BW=25.2KiB/s (25.8kB/s)(6296KiB/250052msec); 0 zone resets clat (msec): min=34, max=470, avg=127.18, stdev=62.21 lat (msec): min=34, max=470, avg=127.18, stdev=62.21 clat percentiles (msec): | 1.00th=[ 45], 5.00th=[ 58], 10.00th=[ 66], 20.00th=[ 78], | 30.00th=[ 88], 40.00th=[ 101], 50.00th=[ 112], 60.00th=[ 127], | 70.00th=[ 144], 80.00th=[ 165], 90.00th=[ 211], 95.00th=[ 255], | 99.00th=[ 351], 99.50th=[ 388], 99.90th=[ 426], 99.95th=[ 472], | 99.99th=[ 472] bw ( KiB/s): min= 7, max= 63, per=24.75%, avg=24.75, stdev=11.35, samples=491 iops : min= 1, max= 15, avg= 5.57, stdev= 2.88, samples=491 lat (msec) : 10=3.78%, 20=20.18%, 50=17.97%, 100=25.29%, 250=29.75% lat (msec) : 500=2.99%, 1000=0.03% cpu : usr=0.04%, sys=1.24%, ctx=5312, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144852: Wed Sep 2 03:28:29 2026 read: IOPS=5, BW=23.7KiB/s (24.3kB/s)(5940KiB/250225msec) clat (msec): min=5, max=1159, avg=31.53, stdev=42.88 lat (msec): min=5, max=1159, avg=31.53, stdev=42.88 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 13], | 30.00th=[ 16], 40.00th=[ 18], 50.00th=[ 20], 60.00th=[ 24], | 70.00th=[ 29], 80.00th=[ 40], 90.00th=[ 65], 95.00th=[ 94], | 99.00th=[ 171], 99.50th=[ 218], 99.90th=[ 363], 99.95th=[ 1167], | 99.99th=[ 1167] bw ( KiB/s): min= 7, max= 95, per=27.97%, avg=26.57, stdev=17.77, samples=433 iops : min= 1, max= 23, avg= 6.03, stdev= 4.49, samples=433 write: IOPS=6, BW=25.4KiB/s (25.0kB/s)(6348KiB/250225msec); 0 zone resets clat (msec): min=34, max=521, avg=128.08, stdev=62.73 lat (msec): min=34, max=521, avg=128.08, stdev=62.73 clat percentiles (msec): | 1.00th=[ 47], 5.00th=[ 58], 10.00th=[ 66], 20.00th=[ 79], | 30.00th=[ 90], 40.00th=[ 101], 50.00th=[ 112], 60.00th=[ 127], | 70.00th=[ 146], 80.00th=[ 171], 90.00th=[ 213], 95.00th=[ 255], | 99.00th=[ 338], 99.50th=[ 384], 99.90th=[ 502], 99.95th=[ 523], | 99.99th=[ 523] bw ( KiB/s): min= 7, max= 63, per=24.94%, avg=24.94, stdev=11.43, samples=492 iops : min= 1, max= 15, avg= 5.62, stdev= 2.92, samples=492 lat (msec) : 10=4.17%, 20=20.21%, 50=17.61%, 100=24.58%, 250=30.70% lat (msec) : 500=2.64%, 750=0.07%, 2000=0.03% cpu : usr=0.05%, sys=1.22%, ctx=5291, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144853: Wed Sep 2 03:28:29 2026 read: IOPS=6, BW=24.1KiB/s (24.7kB/s)(6028KiB/249989msec) clat (msec): min=5, max=449, avg=33.16, stdev=36.09 lat (msec): min=5, max=449, avg=33.17, stdev=36.09 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 11], 20.00th=[ 14], | 30.00th=[ 16], 40.00th=[ 18], 50.00th=[ 21], 60.00th=[ 25], | 70.00th=[ 32], 80.00th=[ 43], 90.00th=[ 75], 95.00th=[ 101], | 99.00th=[ 171], 99.50th=[ 209], 99.90th=[ 368], 99.95th=[ 451], | 99.99th=[ 451] bw ( KiB/s): min= 7, max= 119, per=27.98%, avg=26.58, stdev=18.71, samples=439 iops : min= 1, max= 29, avg= 6.03, stdev= 4.69, samples=439 write: IOPS=6, BW=25.0KiB/s (25.6kB/s)(6260KiB/249989msec); 0 zone resets clat (msec): min=35, max=1493, avg=127.71, stdev=70.52 lat (msec): min=35, max=1493, avg=127.72, stdev=70.52 clat percentiles (msec): | 1.00th=[ 47], 5.00th=[ 58], 10.00th=[ 66], 20.00th=[ 79], | 30.00th=[ 90], 40.00th=[ 102], 50.00th=[ 113], 60.00th=[ 127], | 70.00th=[ 142], 80.00th=[ 167], 90.00th=[ 207], 95.00th=[ 245], | 99.00th=[ 338], 99.50th=[ 397], 99.90th=[ 592], 99.95th=[ 1502], | 99.99th=[ 1502] bw ( KiB/s): min= 7, max= 56, per=24.55%, avg=24.55, stdev=11.50, samples=492 iops : min= 1, max= 14, avg= 5.52, stdev= 2.93, samples=492 lat (msec) : 10=3.94%, 20=19.69%, 50=18.20%, 100=24.77%, 250=30.83% lat (msec) : 500=2.51%, 750=0.03%, 2000=0.03% cpu : usr=0.05%, sys=1.29%, ctx=5354, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144854: Wed Sep 2 03:28:29 2026 read: IOPS=6, BW=24.3KiB/s (24.9kB/s)(6052KiB/248918msec) clat (msec): min=5, max=301, avg=30.55, stdev=30.67 lat (msec): min=5, max=301, avg=30.56, stdev=30.68 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 13], | 30.00th=[ 16], 40.00th=[ 18], 50.00th=[ 21], 60.00th=[ 24], | 70.00th=[ 30], 80.00th=[ 41], 90.00th=[ 64], 95.00th=[ 85], | 99.00th=[ 163], 99.50th=[ 190], 99.90th=[ 296], 99.95th=[ 300], | 99.99th=[ 300] bw ( KiB/s): min= 7, max= 111, per=28.92%, avg=27.47, stdev=18.41, samples=427 iops : min= 1, max= 27, avg= 6.25, stdev= 4.67, samples=427 write: IOPS=6, BW=25.1KiB/s (25.7kB/s)(6236KiB/248918msec); 0 zone resets clat (msec): min=39, max=1494, avg=129.91, stdev=73.34 lat (msec): min=39, max=1494, avg=129.92, stdev=73.34 clat percentiles (msec): | 1.00th=[ 47], 5.00th=[ 57], 10.00th=[ 66], 20.00th=[ 80], | 30.00th=[ 91], 40.00th=[ 102], 50.00th=[ 112], 60.00th=[ 127], | 70.00th=[ 146], 80.00th=[ 167], 90.00th=[ 215], 95.00th=[ 262], | 99.00th=[ 342], 99.50th=[ 414], 99.90th=[ 684], 99.95th=[ 1502], | 99.99th=[ 1502] bw ( KiB/s): min= 7, max= 56, per=24.66%, avg=24.66, stdev=11.06, samples=488 iops : min= 1, max= 14, avg= 5.55, stdev= 2.80, samples=488 lat (msec) : 10=3.87%, 20=20.74%, 50=18.23%, 100=24.28%, 250=29.75% lat (msec) : 500=3.06%, 750=0.03%, 2000=0.03% cpu : usr=0.04%, sys=1.27%, ctx=5409, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=95.0KiB/s (98.3kB/s), 23.7KiB/s-24.3KiB/s (24.3kB/s-24.9kB/s), io=23.4MiB (24.6MB), run=248918-250225msec WRITE: bw=100KiB/s (103kB/s), 25.0KiB/s-25.4KiB/s (25.6kB/s-25.0kB/s), io=24.6MiB (25.7MB), run=248918-250225msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144902: Wed Sep 2 03:29:04 2026 read: IOPS=14, BW=229KiB/s (234kB/s)(5920KiB/25863msec) clat (usec): min=39, max=182710, avg=35888.91, stdev=27403.69 lat (usec): min=40, max=182711, avg=35890.50, stdev=27403.75 clat percentiles (usec): | 1.00th=[ 44], 5.00th=[ 64], 10.00th=[ 75], 20.00th=[ 14746], | 30.00th=[ 23200], 40.00th=[ 28443], 50.00th=[ 33162], 60.00th=[ 38011], | 70.00th=[ 45351], 80.00th=[ 53740], 90.00th=[ 66847], 95.00th=[ 84411], | 99.00th=[112722], 99.50th=[173016], 99.90th=[183501], 99.95th=[183501], | 99.99th=[183501] bw ( KiB/s): min= 91, max= 442, per=25.12%, avg=232.64, stdev=70.69, samples=50 iops : min= 5, max= 27, avg=13.76, stdev= 4.50, samples=50 write: IOPS=15, BW=246KiB/s (252kB/s)(6368KiB/25863msec); 0 zone resets clat (usec): min=1465, max=201345, avg=31075.85, stdev=33314.95 lat (usec): min=1468, max=201347, avg=31078.53, stdev=33314.93 clat percentiles (usec): | 1.00th=[ 1713], 5.00th=[ 2180], 10.00th=[ 3359], 20.00th=[ 5342], | 30.00th=[ 7373], 40.00th=[ 11207], 50.00th=[ 18482], 60.00th=[ 27919], | 70.00th=[ 40633], 80.00th=[ 55313], 90.00th=[ 76022], 95.00th=[ 91751], | 99.00th=[177210], 99.50th=[189793], 99.90th=[202376], 99.95th=[202376], | 99.99th=[202376] bw ( KiB/s): min= 63, max= 510, per=25.30%, avg=246.43, stdev=88.10, samples=51 iops : min= 3, max= 31, avg=14.65, stdev= 5.51, samples=51 lat (usec) : 50=0.65%, 100=5.99%, 250=1.17%, 500=0.52% lat (msec) : 2=2.47%, 4=5.21%, 10=12.37%, 20=10.42%, 50=37.37% lat (msec) : 100=20.44%, 250=3.39% cpu : usr=0.05%, sys=7.18%, ctx=1616, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144903: Wed Sep 2 03:29:04 2026 read: IOPS=13, BW=224KiB/s (229kB/s)(5744KiB/25686msec) clat (usec): min=38, max=399351, avg=38199.61, stdev=33712.33 lat (usec): min=38, max=399353, avg=38202.06, stdev=33712.14 clat percentiles (usec): | 1.00th=[ 49], 5.00th=[ 62], 10.00th=[ 76], 20.00th=[ 17957], | 30.00th=[ 25035], 40.00th=[ 28967], 50.00th=[ 33424], 60.00th=[ 39060], | 70.00th=[ 47449], 80.00th=[ 55313], 90.00th=[ 68682], 95.00th=[ 89654], | 99.00th=[168821], 99.50th=[193987], 99.90th=[400557], 99.95th=[400557], | 99.99th=[400557] bw ( KiB/s): min= 63, max= 380, per=23.90%, avg=221.32, stdev=69.82, samples=50 iops : min= 3, max= 23, avg=13.06, stdev= 4.38, samples=50 write: IOPS=15, BW=255KiB/s (261kB/s)(6544KiB/25686msec); 0 zone resets clat (usec): min=1485, max=147151, avg=28971.46, stdev=28221.04 lat (usec): min=1486, max=147153, avg=28983.49, stdev=28213.85 clat percentiles (usec): | 1.00th=[ 1778], 5.00th=[ 2540], 10.00th=[ 3523], 20.00th=[ 5604], | 30.00th=[ 8586], 40.00th=[ 12256], 50.00th=[ 20055], 60.00th=[ 27395], | 70.00th=[ 35390], 80.00th=[ 50594], 90.00th=[ 71828], 95.00th=[ 87557], | 99.00th=[114820], 99.50th=[129500], 99.90th=[147850], 99.95th=[147850], | 99.99th=[147850] bw ( KiB/s): min= 63, max= 414, per=25.61%, avg=249.42, stdev=83.03, samples=50 iops : min= 3, max= 25, avg=14.84, stdev= 5.23, samples=50 lat (usec) : 50=0.52%, 100=5.60%, 250=0.52%, 500=0.26%, 750=0.13% lat (msec) : 2=1.56%, 4=5.60%, 10=11.85%, 20=10.16%, 50=40.36% lat (msec) : 100=20.44%, 250=2.86%, 500=0.13% cpu : usr=0.09%, sys=7.18%, ctx=1598, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144904: Wed Sep 2 03:29:04 2026 read: IOPS=15, BW=249KiB/s (255kB/s)(6256KiB/25119msec) clat (usec): min=37, max=183137, avg=33107.25, stdev=27023.14 lat (usec): min=38, max=183140, avg=33108.79, stdev=27023.21 clat percentiles (usec): | 1.00th=[ 48], 5.00th=[ 61], 10.00th=[ 71], 20.00th=[ 186], | 30.00th=[ 20055], 40.00th=[ 26608], 50.00th=[ 31589], 60.00th=[ 36439], | 70.00th=[ 43254], 80.00th=[ 50594], 90.00th=[ 64750], 95.00th=[ 81265], | 99.00th=[125305], 99.50th=[130548], 99.90th=[183501], 99.95th=[183501], | 99.99th=[183501] bw ( KiB/s): min= 63, max= 413, per=27.03%, avg=250.27, stdev=91.92, samples=49 iops : min= 3, max= 25, avg=14.90, stdev= 5.80, samples=49 write: IOPS=15, BW=240KiB/s (246kB/s)(6032KiB/25119msec); 0 zone resets clat (usec): min=1448, max=213652, avg=31833.18, stdev=34851.97 lat (usec): min=1449, max=213655, avg=31839.29, stdev=34851.16 clat percentiles (usec): | 1.00th=[ 1680], 5.00th=[ 2278], 10.00th=[ 3261], 20.00th=[ 5473], | 30.00th=[ 8291], 40.00th=[ 13042], 50.00th=[ 19792], 60.00th=[ 28443], | 70.00th=[ 37487], 80.00th=[ 53216], 90.00th=[ 78119], 95.00th=[ 91751], | 99.00th=[189793], 99.50th=[210764], 99.90th=[212861], 99.95th=[212861], | 99.99th=[212861] bw ( KiB/s): min= 63, max= 408, per=24.28%, avg=236.51, stdev=82.58, samples=49 iops : min= 3, max= 25, avg=14.04, stdev= 5.16, samples=49 lat (usec) : 50=0.78%, 100=7.81%, 250=2.08%, 500=0.13%, 750=0.13% lat (usec) : 1000=0.13% lat (msec) : 2=2.21%, 4=4.95%, 10=10.55%, 20=11.07%, 50=38.15% lat (msec) : 100=19.14%, 250=2.86% cpu : usr=0.07%, sys=7.07%, ctx=1560, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144905: Wed Sep 2 03:29:04 2026 read: IOPS=15, BW=242KiB/s (248kB/s)(6032KiB/24884msec) clat (usec): min=38, max=191406, avg=35713.77, stdev=30274.49 lat (usec): min=38, max=191407, avg=35715.21, stdev=30274.50 clat percentiles (usec): | 1.00th=[ 41], 5.00th=[ 57], 10.00th=[ 66], 20.00th=[ 363], | 30.00th=[ 20579], 40.00th=[ 26870], 50.00th=[ 31589], 60.00th=[ 38011], | 70.00th=[ 47449], 80.00th=[ 56361], 90.00th=[ 72877], 95.00th=[ 82314], | 99.00th=[143655], 99.50th=[162530], 99.90th=[191890], 99.95th=[191890], | 99.99th=[191890] bw ( KiB/s): min= 63, max= 413, per=25.72%, avg=238.20, stdev=83.40, samples=49 iops : min= 3, max= 25, avg=14.12, stdev= 5.22, samples=49 write: IOPS=15, BW=251KiB/s (257kB/s)(6256KiB/24884msec); 0 zone resets clat (usec): min=1381, max=322828, avg=28709.26, stdev=31954.21 lat (usec): min=1383, max=322831, avg=28712.03, stdev=31954.04 clat percentiles (usec): | 1.00th=[ 1565], 5.00th=[ 1909], 10.00th=[ 2737], 20.00th=[ 4621], | 30.00th=[ 6718], 40.00th=[ 10683], 50.00th=[ 17695], 60.00th=[ 25297], | 70.00th=[ 38011], 80.00th=[ 52167], 90.00th=[ 69731], 95.00th=[ 83362], | 99.00th=[120062], 99.50th=[168821], 99.90th=[320865], 99.95th=[320865], | 99.99th=[320865] bw ( KiB/s): min= 32, max= 471, per=25.57%, avg=249.02, stdev=99.60, samples=49 iops : min= 2, max= 29, avg=14.82, stdev= 6.26, samples=49 lat (usec) : 50=1.04%, 100=6.90%, 250=1.69%, 500=0.78%, 750=0.26% lat (msec) : 2=2.73%, 4=6.12%, 10=11.72%, 20=10.29%, 50=34.38% lat (msec) : 100=21.09%, 250=2.86%, 500=0.13% cpu : usr=0.11%, sys=7.13%, ctx=1534, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=926KiB/s (948kB/s), 224KiB/s-249KiB/s (229kB/s-255kB/s), io=23.4MiB (24.5MB), run=24884-25863msec WRITE: bw=974KiB/s (998kB/s), 240KiB/s-255KiB/s (246kB/s-261kB/s), io=24.6MiB (25.8MB), run=24884-25863msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144907: Wed Sep 2 03:29:44 2026 read: IOPS=5, BW=91.7KiB/s (93.9kB/s)(5920KiB/64539msec) clat (msec): min=7, max=193, avg=34.20, stdev=32.61 lat (msec): min=7, max=193, avg=34.20, stdev=32.61 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 15], | 30.00th=[ 18], 40.00th=[ 21], 50.00th=[ 23], 60.00th=[ 26], | 70.00th=[ 32], 80.00th=[ 43], 90.00th=[ 70], 95.00th=[ 111], | 99.00th=[ 167], 99.50th=[ 188], 99.90th=[ 194], 99.95th=[ 194], | 99.99th=[ 194] bw ( KiB/s): min= 30, max= 375, per=27.05%, avg=99.80, stdev=64.08, samples=115 iops : min= 1, max= 23, avg= 5.49, stdev= 4.04, samples=115 write: IOPS=6, BW=98.7KiB/s (101kB/s)(6368KiB/64539msec); 0 zone resets clat (msec): min=40, max=391, avg=130.18, stdev=57.12 lat (msec): min=40, max=391, avg=130.19, stdev=57.12 clat percentiles (msec): | 1.00th=[ 54], 5.00th=[ 62], 10.00th=[ 71], 20.00th=[ 83], | 30.00th=[ 93], 40.00th=[ 107], 50.00th=[ 117], 60.00th=[ 133], | 70.00th=[ 148], 80.00th=[ 171], 90.00th=[ 207], 95.00th=[ 249], | 99.00th=[ 296], 99.50th=[ 384], 99.90th=[ 393], 99.95th=[ 393], | 99.99th=[ 393] bw ( KiB/s): min= 24, max= 224, per=25.25%, avg=97.95, stdev=40.75, samples=127 iops : min= 1, max= 14, avg= 5.39, stdev= 2.65, samples=127 lat (msec) : 10=2.47%, 20=16.15%, 50=21.74%, 100=22.79%, 250=34.51% lat (msec) : 500=2.34% cpu : usr=0.04%, sys=1.33%, ctx=1299, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144908: Wed Sep 2 03:29:44 2026 read: IOPS=5, BW=88.5KiB/s (90.7kB/s)(5744KiB/64879msec) clat (msec): min=5, max=301, avg=34.41, stdev=34.05 lat (msec): min=5, max=301, avg=34.41, stdev=34.05 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 15], | 30.00th=[ 17], 40.00th=[ 20], 50.00th=[ 23], 60.00th=[ 27], | 70.00th=[ 32], 80.00th=[ 44], 90.00th=[ 73], 95.00th=[ 106], | 99.00th=[ 161], 99.50th=[ 243], 99.90th=[ 300], 99.95th=[ 300], | 99.99th=[ 300] bw ( KiB/s): min= 24, max= 349, per=26.93%, avg=99.38, stdev=61.96, samples=113 iops : min= 1, max= 21, avg= 5.49, stdev= 3.87, samples=113 write: IOPS=6, BW=101KiB/s (103kB/s)(6544KiB/64879msec); 0 zone resets clat (msec): min=44, max=406, avg=128.29, stdev=53.19 lat (msec): min=44, max=406, avg=128.30, stdev=53.19 clat percentiles (msec): | 1.00th=[ 48], 5.00th=[ 67], 10.00th=[ 77], 20.00th=[ 88], | 30.00th=[ 96], 40.00th=[ 106], 50.00th=[ 118], 60.00th=[ 130], | 70.00th=[ 142], 80.00th=[ 159], 90.00th=[ 203], 95.00th=[ 234], | 99.00th=[ 313], 99.50th=[ 351], 99.90th=[ 405], 99.95th=[ 405], | 99.99th=[ 405] bw ( KiB/s): min= 30, max= 192, per=25.98%, avg=100.82, stdev=37.60, samples=127 iops : min= 1, max= 12, avg= 5.57, stdev= 2.42, samples=127 lat (msec) : 10=1.69%, 20=17.45%, 50=19.66%, 100=23.70%, 250=35.68% lat (msec) : 500=1.82% cpu : usr=0.03%, sys=1.38%, ctx=1390, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144909: Wed Sep 2 03:29:44 2026 read: IOPS=6, BW=99.2KiB/s (102kB/s)(6256KiB/63067msec) clat (msec): min=7, max=285, avg=32.26, stdev=29.26 lat (msec): min=7, max=285, avg=32.26, stdev=29.26 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 12], 20.00th=[ 15], | 30.00th=[ 18], 40.00th=[ 20], 50.00th=[ 23], 60.00th=[ 27], | 70.00th=[ 32], 80.00th=[ 41], 90.00th=[ 64], 95.00th=[ 95], | 99.00th=[ 148], 99.50th=[ 167], 99.90th=[ 288], 99.95th=[ 288], | 99.99th=[ 288] bw ( KiB/s): min= 30, max= 288, per=29.38%, avg=108.39, stdev=70.37, samples=114 iops : min= 1, max= 18, avg= 6.06, stdev= 4.46, samples=114 write: IOPS=5, BW=95.6KiB/s (97.9kB/s)(6032KiB/63067msec); 0 zone resets clat (msec): min=45, max=378, avg=133.71, stdev=59.05 lat (msec): min=45, max=378, avg=133.72, stdev=59.04 clat percentiles (msec): | 1.00th=[ 51], 5.00th=[ 65], 10.00th=[ 75], 20.00th=[ 88], | 30.00th=[ 97], 40.00th=[ 109], 50.00th=[ 121], 60.00th=[ 132], | 70.00th=[ 146], 80.00th=[ 169], 90.00th=[ 222], 95.00th=[ 262], | 99.00th=[ 330], 99.50th=[ 351], 99.90th=[ 380], 99.95th=[ 380], | 99.99th=[ 380] bw ( KiB/s): min= 30, max= 191, per=24.43%, avg=94.80, stdev=36.24, samples=124 iops : min= 1, max= 11, avg= 5.19, stdev= 2.33, samples=124 lat (msec) : 10=2.47%, 20=18.62%, 50=22.40%, 100=21.74%, 250=31.12% lat (msec) : 500=3.65% cpu : usr=0.04%, sys=1.37%, ctx=1323, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144910: Wed Sep 2 03:29:44 2026 read: IOPS=5, BW=95.0KiB/s (98.3kB/s)(6032KiB/62844msec) clat (msec): min=7, max=301, avg=33.94, stdev=33.11 lat (msec): min=7, max=301, avg=33.95, stdev=33.11 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 16], | 30.00th=[ 18], 40.00th=[ 21], 50.00th=[ 24], 60.00th=[ 28], | 70.00th=[ 33], 80.00th=[ 42], 90.00th=[ 67], 95.00th=[ 95], | 99.00th=[ 174], 99.50th=[ 259], 99.90th=[ 300], 99.95th=[ 300], | 99.99th=[ 300] bw ( KiB/s): min= 31, max= 286, per=28.07%, avg=103.60, stdev=62.50, samples=114 iops : min= 1, max= 17, avg= 5.75, stdev= 3.94, samples=114 write: IOPS=6, BW=99.5KiB/s (102kB/s)(6256KiB/62844msec); 0 zone resets clat (msec): min=44, max=452, avg=127.89, stdev=56.18 lat (msec): min=44, max=452, avg=127.90, stdev=56.18 clat percentiles (msec): | 1.00th=[ 52], 5.00th=[ 65], 10.00th=[ 73], 20.00th=[ 85], | 30.00th=[ 93], 40.00th=[ 106], 50.00th=[ 115], 60.00th=[ 129], | 70.00th=[ 148], 80.00th=[ 163], 90.00th=[ 192], 95.00th=[ 234], | 99.00th=[ 321], 99.50th=[ 405], 99.90th=[ 451], 99.95th=[ 451], | 99.99th=[ 451] bw ( KiB/s): min= 30, max= 191, per=25.57%, avg=99.19, stdev=38.81, samples=124 iops : min= 1, max= 11, avg= 5.47, stdev= 2.49, samples=124 lat (msec) : 10=1.43%, 20=17.32%, 50=22.53%, 100=24.22%, 250=32.29% lat (msec) : 500=2.21% cpu : usr=0.05%, sys=1.37%, ctx=1351, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=369KiB/s (378kB/s), 88.5KiB/s-99.2KiB/s (90.7kB/s-102kB/s), io=23.4MiB (24.5MB), run=62844-64879msec WRITE: bw=388KiB/s (398kB/s), 95.6KiB/s-101KiB/s (97.9kB/s-103kB/s), io=24.6MiB (25.8MB), run=62844-64879msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144928: Wed Sep 2 03:30:00 2026 read: IOPS=1, BW=1932KiB/s (1978kB/s)(7168KiB/3711msec) clat (msec): min=65, max=339, avg=140.73, stdev=91.75 lat (msec): min=65, max=339, avg=140.73, stdev=91.75 clat percentiles (msec): | 1.00th=[ 66], 5.00th=[ 66], 10.00th=[ 66], 20.00th=[ 94], | 30.00th=[ 109], 40.00th=[ 109], 50.00th=[ 110], 60.00th=[ 111], | 70.00th=[ 111], 80.00th=[ 159], 90.00th=[ 338], 95.00th=[ 338], | 99.00th=[ 338], 99.50th=[ 338], 99.90th=[ 338], 99.95th=[ 338], | 99.99th=[ 338] bw ( KiB/s): min= 4055, max= 4432, per=100.00%, avg=4243.50, stdev=266.58, samples=2 iops : min= 3, max= 4, avg= 3.50, stdev= 0.71, samples=2 write: IOPS=1, BW=1380KiB/s (1413kB/s)(5120KiB/3711msec); 0 zone resets clat (msec): min=262, max=1036, avg=531.70, stdev=319.38 lat (msec): min=262, max=1044, avg=533.43, stdev=322.63 clat percentiles (msec): | 1.00th=[ 264], 5.00th=[ 264], 10.00th=[ 264], 20.00th=[ 264], | 30.00th=[ 296], 40.00th=[ 296], 50.00th=[ 418], 60.00th=[ 418], | 70.00th=[ 642], 80.00th=[ 642], 90.00th=[ 1036], 95.00th=[ 1036], | 99.00th=[ 1036], 99.50th=[ 1036], 99.90th=[ 1036], 99.95th=[ 1036], | 99.99th=[ 1036] bw ( KiB/s): min= 1477, max= 2048, per=48.25%, avg=1858.50, stdev=264.83, samples=4 iops : min= 1, max= 2, avg= 1.25, stdev= 0.50, samples=4 lat (msec) : 100=16.67%, 250=33.33%, 500=33.33%, 750=8.33%, 2000=8.33% cpu : usr=0.00%, sys=4.53%, ctx=75, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144929: Wed Sep 2 03:30:00 2026 read: IOPS=0, BW=275KiB/s (282kB/s)(2048KiB/7442msec) clat (msec): min=100, max=512, avg=306.36, stdev=291.54 lat (msec): min=100, max=512, avg=306.37, stdev=291.54 clat percentiles (msec): | 1.00th=[ 101], 5.00th=[ 101], 10.00th=[ 101], 20.00th=[ 101], | 30.00th=[ 101], 40.00th=[ 101], 50.00th=[ 101], 60.00th=[ 514], | 70.00th=[ 514], 80.00th=[ 514], 90.00th=[ 514], 95.00th=[ 514], | 99.00th=[ 514], 99.50th=[ 514], 99.90th=[ 514], 99.95th=[ 514], | 99.99th=[ 514] bw ( KiB/s): min= 1434, max= 2027, per=62.90%, avg=1730.50, stdev=419.31, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1376KiB/s (1409kB/s)(10.0MiB/7442msec); 0 zone resets clat (msec): min=105, max=3415, avg=675.31, stdev=1022.66 lat (msec): min=105, max=3415, avg=675.38, stdev=1022.66 clat percentiles (msec): | 1.00th=[ 106], 5.00th=[ 106], 10.00th=[ 106], 20.00th=[ 157], | 30.00th=[ 165], 40.00th=[ 201], 50.00th=[ 213], 60.00th=[ 253], | 70.00th=[ 309], 80.00th=[ 718], 90.00th=[ 1217], 95.00th=[ 3406], | 99.00th=[ 3406], 99.50th=[ 3406], 99.90th=[ 3406], 99.95th=[ 3406], | 99.99th=[ 3406] bw ( KiB/s): min= 1882, max= 4096, per=87.92%, avg=3386.80, stdev=988.15, samples=5 iops : min= 1, max= 4, avg= 2.80, stdev= 1.30, samples=5 lat (msec) : 250=50.00%, 500=16.67%, 750=16.67%, 2000=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=3.53%, ctx=87, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144930: Wed Sep 2 03:30:00 2026 read: IOPS=1, BW=1741KiB/s (1783kB/s)(6144KiB/3528msec) clat (msec): min=134, max=408, avg=321.10, stdev=98.16 lat (msec): min=134, max=408, avg=321.10, stdev=98.16 clat percentiles (msec): | 1.00th=[ 134], 5.00th=[ 134], 10.00th=[ 134], 20.00th=[ 305], | 30.00th=[ 305], 40.00th=[ 334], 50.00th=[ 334], 60.00th=[ 372], | 70.00th=[ 372], 80.00th=[ 372], 90.00th=[ 409], 95.00th=[ 409], | 99.00th=[ 409], 99.50th=[ 409], 99.90th=[ 409], 99.95th=[ 409], | 99.99th=[ 409] bw ( KiB/s): min= 1882, max= 2048, per=72.56%, avg=1996.00, stdev=66.37, samples=5 iops : min= 1, max= 2, avg= 1.20, stdev= 0.45, samples=5 write: IOPS=1, BW=1741KiB/s (1783kB/s)(6144KiB/3528msec); 0 zone resets clat (msec): min=131, max=354, avg=262.22, stdev=85.10 lat (msec): min=132, max=354, avg=262.30, stdev=85.11 clat percentiles (msec): | 1.00th=[ 132], 5.00th=[ 132], 10.00th=[ 132], 20.00th=[ 215], | 30.00th=[ 215], 40.00th=[ 247], 50.00th=[ 247], 60.00th=[ 271], | 70.00th=[ 355], 80.00th=[ 355], 90.00th=[ 355], 95.00th=[ 355], | 99.00th=[ 355], 99.50th=[ 355], 99.90th=[ 355], 99.95th=[ 355], | 99.99th=[ 355] bw ( KiB/s): min= 1882, max= 4237, per=70.22%, avg=2705.00, stdev=1327.97, samples=3 iops : min= 1, max= 4, avg= 2.00, stdev= 1.73, samples=3 lat (msec) : 250=33.33%, 500=66.67% cpu : usr=0.03%, sys=4.08%, ctx=53, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144931: Wed Sep 2 03:30:00 2026 read: IOPS=0, BW=788KiB/s (806kB/s)(5120KiB/6501msec) clat (msec): min=58, max=288, avg=163.69, stdev=97.03 lat (msec): min=58, max=288, avg=163.69, stdev=97.03 clat percentiles (msec): | 1.00th=[ 59], 5.00th=[ 59], 10.00th=[ 59], 20.00th=[ 59], | 30.00th=[ 84], 40.00th=[ 84], 50.00th=[ 157], 60.00th=[ 157], | 70.00th=[ 230], 80.00th=[ 230], 90.00th=[ 288], 95.00th=[ 288], | 99.00th=[ 288], 99.50th=[ 288], 99.90th=[ 288], 99.95th=[ 288], | 99.99th=[ 288] bw ( KiB/s): min= 1882, max= 6144, per=100.00%, avg=4013.00, stdev=3013.69, samples=2 iops : min= 1, max= 6, avg= 3.50, stdev= 3.54, samples=2 write: IOPS=1, BW=1103KiB/s (1129kB/s)(7168KiB/6501msec); 0 zone resets clat (msec): min=116, max=2754, avg=800.19, stdev=898.17 lat (msec): min=116, max=2754, avg=800.47, stdev=898.13 clat percentiles (msec): | 1.00th=[ 117], 5.00th=[ 117], 10.00th=[ 117], 20.00th=[ 215], | 30.00th=[ 405], 40.00th=[ 405], 50.00th=[ 609], 60.00th=[ 667], | 70.00th=[ 667], 80.00th=[ 835], 90.00th=[ 2769], 95.00th=[ 2769], | 99.00th=[ 2769], 99.50th=[ 2769], 99.90th=[ 2769], 99.95th=[ 2769], | 99.99th=[ 2769] bw ( KiB/s): min= 1996, max= 2828, per=56.54%, avg=2177.80, stdev=363.70, samples=5 iops : min= 1, max= 2, avg= 1.20, stdev= 0.45, samples=5 lat (msec) : 100=16.67%, 250=33.33%, 500=16.67%, 750=16.67%, 1000=8.33% lat (msec) : >=2000=8.33% cpu : usr=0.02%, sys=2.49%, ctx=50, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2752KiB/s (2818kB/s), 275KiB/s-1932KiB/s (282kB/s-1978kB/s), io=20.0MiB (20.0MB), run=3528-7442msec WRITE: bw=3853KiB/s (3945kB/s), 1103KiB/s-1741KiB/s (1129kB/s-1783kB/s), io=28.0MiB (29.4MB), run=3528-7442msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144933: Wed Sep 2 03:30:00 2026 read: IOPS=2, BW=2122KiB/s (2173kB/s)(7168KiB/3378msec) clat (usec): min=655, max=472264, avg=234141.19, stdev=138529.95 lat (usec): min=657, max=472266, avg=234142.53, stdev=138529.85 clat percentiles (usec): | 1.00th=[ 660], 5.00th=[ 660], 10.00th=[ 660], 20.00th=[181404], | 30.00th=[238027], 40.00th=[238027], 50.00th=[238027], 60.00th=[244319], | 70.00th=[244319], 80.00th=[265290], 90.00th=[471860], 95.00th=[471860], | 99.00th=[471860], 99.50th=[471860], 99.90th=[471860], 99.95th=[471860], | 99.99th=[471860] bw ( KiB/s): min= 2000, max= 3631, per=81.39%, avg=2349.80, stdev=716.44, samples=5 iops : min= 1, max= 3, avg= 1.60, stdev= 0.89, samples=5 write: IOPS=1, BW=1516KiB/s (1552kB/s)(5120KiB/3378msec); 0 zone resets clat (msec): min=181, max=524, avg=347.27, stdev=124.31 lat (msec): min=181, max=525, avg=347.48, stdev=124.59 clat percentiles (msec): | 1.00th=[ 182], 5.00th=[ 182], 10.00th=[ 182], 20.00th=[ 182], | 30.00th=[ 300], 40.00th=[ 300], 50.00th=[ 359], 60.00th=[ 359], | 70.00th=[ 372], 80.00th=[ 372], 90.00th=[ 523], 95.00th=[ 523], | 99.00th=[ 523], 99.50th=[ 523], 99.90th=[ 523], 99.95th=[ 523], | 99.99th=[ 523] bw ( KiB/s): min= 2000, max= 2048, per=50.11%, avg=2025.50, stdev=19.94, samples=4 iops : min= 1, max= 2, avg= 1.25, stdev= 0.50, samples=4 lat (usec) : 750=8.33% lat (msec) : 250=41.67%, 500=41.67%, 750=8.33% cpu : usr=0.00%, sys=17.06%, ctx=300, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144934: Wed Sep 2 03:30:00 2026 read: IOPS=0, BW=289KiB/s (296kB/s)(2048KiB/7092msec) clat (msec): min=277, max=299, avg=288.52, stdev=14.92 lat (msec): min=277, max=299, avg=288.53, stdev=14.92 clat percentiles (msec): | 1.00th=[ 279], 5.00th=[ 279], 10.00th=[ 279], 20.00th=[ 279], | 30.00th=[ 279], 40.00th=[ 279], 50.00th=[ 279], 60.00th=[ 300], | 70.00th=[ 300], 80.00th=[ 300], 90.00th=[ 300], 95.00th=[ 300], | 99.00th=[ 300], 99.50th=[ 300], 99.90th=[ 300], 99.95th=[ 300], | 99.99th=[ 300] bw ( KiB/s): min= 1885, max= 2031, per=67.82%, avg=1958.00, stdev=103.24, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1444KiB/s (1479kB/s)(10.0MiB/7092msec); 0 zone resets clat (msec): min=133, max=3554, avg=650.95, stdev=1047.03 lat (msec): min=133, max=3554, avg=651.16, stdev=1046.97 clat percentiles (msec): | 1.00th=[ 134], 5.00th=[ 134], 10.00th=[ 134], 20.00th=[ 171], | 30.00th=[ 234], 40.00th=[ 266], 50.00th=[ 268], 60.00th=[ 288], | 70.00th=[ 300], 80.00th=[ 326], 90.00th=[ 969], 95.00th=[ 3540], | 99.00th=[ 3540], 99.50th=[ 3540], 99.90th=[ 3540], 99.95th=[ 3540], | 99.99th=[ 3540] bw ( KiB/s): min= 2023, max= 4096, per=87.92%, avg=3553.75, stdev=1021.50, samples=4 iops : min= 1, max= 4, avg= 3.00, stdev= 1.41, samples=4 lat (msec) : 250=25.00%, 500=58.33%, 1000=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=9.63%, ctx=183, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144935: Wed Sep 2 03:30:00 2026 read: IOPS=1, BW=1824KiB/s (1868kB/s)(6144KiB/3368msec) clat (usec): min=446, max=326970, avg=117897.80, stdev=120997.98 lat (usec): min=447, max=326971, avg=117899.03, stdev=120998.26 clat percentiles (usec): | 1.00th=[ 445], 5.00th=[ 445], 10.00th=[ 445], 20.00th=[ 1795], | 30.00th=[ 1795], 40.00th=[ 95945], 50.00th=[ 95945], 60.00th=[122160], | 70.00th=[160433], 80.00th=[160433], 90.00th=[325059], 95.00th=[325059], | 99.00th=[325059], 99.50th=[325059], 99.90th=[325059], 99.95th=[325059], | 99.99th=[325059] bw ( KiB/s): min= 2031, max= 8000, per=100.00%, avg=5015.50, stdev=4220.72, samples=2 iops : min= 1, max= 7, avg= 4.00, stdev= 4.24, samples=2 write: IOPS=1, BW=1824KiB/s (1868kB/s)(6144KiB/3368msec); 0 zone resets clat (msec): min=127, max=1063, avg=441.23, stdev=360.23 lat (msec): min=127, max=1063, avg=441.39, stdev=360.13 clat percentiles (msec): | 1.00th=[ 128], 5.00th=[ 128], 10.00th=[ 128], 20.00th=[ 190], | 30.00th=[ 190], 40.00th=[ 279], 50.00th=[ 279], 60.00th=[ 313], | 70.00th=[ 676], 80.00th=[ 676], 90.00th=[ 1062], 95.00th=[ 1062], | 99.00th=[ 1062], 99.50th=[ 1062], 99.90th=[ 1062], 99.95th=[ 1062], | 99.99th=[ 1062] bw ( KiB/s): min= 2000, max= 3792, per=61.05%, avg=2467.75, stdev=883.06, samples=4 iops : min= 1, max= 3, avg= 1.75, stdev= 0.96, samples=4 lat (usec) : 500=8.33% lat (msec) : 2=8.33%, 100=8.33%, 250=33.33%, 500=25.00%, 750=8.33% lat (msec) : 2000=8.33% cpu : usr=0.00%, sys=12.95%, ctx=159, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144936: Wed Sep 2 03:30:00 2026 read: IOPS=0, BW=832KiB/s (852kB/s)(5120KiB/6154msec) clat (usec): min=558, max=3087.3k, avg=677621.30, stdev=1353106.93 lat (usec): min=560, max=3087.3k, avg=677622.56, stdev=1353106.66 clat percentiles (usec): | 1.00th=[ 562], 5.00th=[ 562], 10.00th=[ 562], | 20.00th=[ 562], 30.00th=[ 1762], 40.00th=[ 1762], | 50.00th=[ 1991], 60.00th=[ 1991], 70.00th=[ 295699], | 80.00th=[ 295699], 90.00th=[3103785], 95.00th=[3103785], | 99.00th=[3103785], 99.50th=[3103785], 99.90th=[3103785], | 99.95th=[3103785], 99.99th=[3103785] bw ( KiB/s): min= 4031, max= 4063, per=100.00%, avg=4047.00, stdev=22.63, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1165KiB/s (1193kB/s)(7168KiB/6154msec); 0 zone resets clat (msec): min=110, max=921, avg=394.68, stdev=310.80 lat (msec): min=111, max=921, avg=394.91, stdev=310.65 clat percentiles (msec): | 1.00th=[ 111], 5.00th=[ 111], 10.00th=[ 111], 20.00th=[ 127], | 30.00th=[ 159], 40.00th=[ 159], 50.00th=[ 326], 60.00th=[ 430], | 70.00th=[ 430], 80.00th=[ 693], 90.00th=[ 919], 95.00th=[ 919], | 99.00th=[ 919], 99.50th=[ 919], 99.90th=[ 919], 99.95th=[ 919], | 99.99th=[ 919] bw ( KiB/s): min= 1885, max= 4031, per=59.31%, avg=2397.40, stdev=915.34, samples=5 iops : min= 1, max= 3, avg= 1.60, stdev= 0.89, samples=5 lat (usec) : 750=8.33% lat (msec) : 2=16.67%, 250=25.00%, 500=25.00%, 750=8.33%, 1000=8.33% lat (msec) : >=2000=8.33% cpu : usr=0.00%, sys=9.51%, ctx=595, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2888KiB/s (2957kB/s), 289KiB/s-2122KiB/s (296kB/s-2173kB/s), io=20.0MiB (20.0MB), run=3368-7092msec WRITE: bw=4043KiB/s (4140kB/s), 1165KiB/s-1824KiB/s (1193kB/s-1868kB/s), io=28.0MiB (29.4MB), run=3368-7092msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144946: Wed Sep 2 03:30:13 2026 read: IOPS=1, BW=4945KiB/s (5064kB/s)(12.0MiB/2485msec) clat (msec): min=665, max=822, avg=740.06, stdev=78.73 lat (msec): min=665, max=822, avg=740.07, stdev=78.73 clat percentiles (msec): | 1.00th=[ 667], 5.00th=[ 667], 10.00th=[ 667], 20.00th=[ 667], | 30.00th=[ 667], 40.00th=[ 735], 50.00th=[ 735], 60.00th=[ 735], | 70.00th=[ 827], 80.00th=[ 827], 90.00th=[ 827], 95.00th=[ 827], | 99.00th=[ 827], 99.50th=[ 827], 99.90th=[ 827], 99.95th=[ 827], | 99.99th=[ 827] bw ( KiB/s): min= 8126, max= 8175, per=100.00%, avg=8150.50, stdev=34.65, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=66.67%, 1000=33.33% cpu : usr=0.00%, sys=11.51%, ctx=347, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144947: Wed Sep 2 03:30:13 2026 read: IOPS=0, BW=1715KiB/s (1756kB/s)(4096KiB/2388msec) clat (nsec): min=752828k, max=752828k, avg=752828170.00, stdev= 0.00 lat (nsec): min=752831k, max=752831k, avg=752830898.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 751], 5.00th=[ 751], 10.00th=[ 751], 20.00th=[ 751], | 30.00th=[ 751], 40.00th=[ 751], 50.00th=[ 751], 60.00th=[ 751], | 70.00th=[ 751], 80.00th=[ 751], 90.00th=[ 751], 95.00th=[ 751], | 99.00th=[ 751], 99.50th=[ 751], 99.90th=[ 751], 99.95th=[ 751], | 99.99th=[ 751] bw ( KiB/s): min= 8126, max= 8126, per=100.00%, avg=8126.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=3430KiB/s (3513kB/s)(8192KiB/2388msec); 0 zone resets clat (msec): min=299, max=1155, avg=727.23, stdev=605.42 lat (msec): min=300, max=1155, avg=727.83, stdev=605.04 clat percentiles (msec): | 1.00th=[ 300], 5.00th=[ 300], 10.00th=[ 300], 20.00th=[ 300], | 30.00th=[ 300], 40.00th=[ 300], 50.00th=[ 300], 60.00th=[ 1150], | 70.00th=[ 1150], 80.00th=[ 1150], 90.00th=[ 1150], 95.00th=[ 1150], | 99.00th=[ 1150], 99.50th=[ 1150], 99.90th=[ 1150], 99.95th=[ 1150], | 99.99th=[ 1150] bw ( KiB/s): min= 8175, max= 8175, per=72.38%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=8.09%, ctx=140, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144948: Wed Sep 2 03:30:13 2026 write: IOPS=1, BW=4236KiB/s (4337kB/s)(12.0MiB/2901msec); 0 zone resets clat (msec): min=220, max=1425, avg=900.41, stdev=617.51 lat (msec): min=221, max=1426, avg=900.81, stdev=617.27 clat percentiles (msec): | 1.00th=[ 222], 5.00th=[ 222], 10.00th=[ 222], 20.00th=[ 222], | 30.00th=[ 222], 40.00th=[ 1053], 50.00th=[ 1053], 60.00th=[ 1053], | 70.00th=[ 1418], 80.00th=[ 1418], 90.00th=[ 1418], 95.00th=[ 1418], | 99.00th=[ 1418], 99.50th=[ 1418], 99.90th=[ 1418], 99.95th=[ 1418], | 99.99th=[ 1418] bw ( KiB/s): min= 8175, max= 8175, per=72.38%, avg=8175.00, stdev= 0.00, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 250=33.33%, 2000=66.67% cpu : usr=0.00%, sys=6.03%, ctx=79, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144949: Wed Sep 2 03:30:13 2026 write: IOPS=1, BW=5159KiB/s (5282kB/s)(12.0MiB/2382msec); 0 zone resets clat (msec): min=293, max=1454, avg=733.62, stdev=629.54 lat (msec): min=294, max=1455, avg=734.05, stdev=629.46 clat percentiles (msec): | 1.00th=[ 296], 5.00th=[ 296], 10.00th=[ 296], 20.00th=[ 296], | 30.00th=[ 296], 40.00th=[ 451], 50.00th=[ 451], 60.00th=[ 451], | 70.00th=[ 1452], 80.00th=[ 1452], 90.00th=[ 1452], 95.00th=[ 1452], | 99.00th=[ 1452], 99.50th=[ 1452], 99.90th=[ 1452], 99.95th=[ 1452], | 99.99th=[ 1452] bw ( KiB/s): min= 6068, max= 8126, per=62.83%, avg=7097.00, stdev=1455.23, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=66.67%, 2000=33.33% cpu : usr=0.17%, sys=6.05%, ctx=86, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=6593KiB/s (6751kB/s), 1715KiB/s-4945KiB/s (1756kB/s-5064kB/s), io=16.0MiB (16.8MB), run=2388-2485msec WRITE: bw=11.0MiB/s (11.6MB/s), 3430KiB/s-5159KiB/s (3513kB/s-5282kB/s), io=32.0MiB (33.6MB), run=2382-2901msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144950: Wed Sep 2 03:30:14 2026 read: IOPS=1, BW=4101KiB/s (4200kB/s)(12.0MiB/2996msec) clat (msec): min=297, max=1436, avg=986.23, stdev=606.08 lat (msec): min=297, max=1436, avg=986.23, stdev=606.08 clat percentiles (msec): | 1.00th=[ 296], 5.00th=[ 296], 10.00th=[ 296], 20.00th=[ 296], | 30.00th=[ 296], 40.00th=[ 1234], 50.00th=[ 1234], 60.00th=[ 1234], | 70.00th=[ 1435], 80.00th=[ 1435], 90.00th=[ 1435], 95.00th=[ 1435], | 99.00th=[ 1435], 99.50th=[ 1435], 99.90th=[ 1435], 99.95th=[ 1435], | 99.99th=[ 1435] bw ( KiB/s): min= 8143, max= 8143, per=100.00%, avg=8143.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.00%, sys=2.70%, ctx=58, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144951: Wed Sep 2 03:30:14 2026 read: IOPS=0, BW=1276KiB/s (1307kB/s)(4096KiB/3209msec) clat (nsec): min=1558.7M, max=1558.7M, avg=1558715645.00, stdev= 0.00 lat (nsec): min=1558.7M, max=1558.7M, avg=1558718236.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1552], 5.00th=[ 1552], 10.00th=[ 1552], 20.00th=[ 1552], | 30.00th=[ 1552], 40.00th=[ 1552], 50.00th=[ 1552], 60.00th=[ 1552], | 70.00th=[ 1552], 80.00th=[ 1552], 90.00th=[ 1552], 95.00th=[ 1552], | 99.00th=[ 1552], 99.50th=[ 1552], 99.90th=[ 1552], 99.95th=[ 1552], | 99.99th=[ 1552] bw ( KiB/s): min= 8126, max= 8126, per=100.00%, avg=8126.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2553KiB/s (2614kB/s)(8192KiB/3209msec); 0 zone resets clat (msec): min=697, max=810, avg=753.75, stdev=80.20 lat (msec): min=698, max=811, avg=754.64, stdev=79.95 clat percentiles (msec): | 1.00th=[ 701], 5.00th=[ 701], 10.00th=[ 701], 20.00th=[ 701], | 30.00th=[ 701], 40.00th=[ 701], 50.00th=[ 701], 60.00th=[ 810], | 70.00th=[ 810], 80.00th=[ 810], 90.00th=[ 810], 95.00th=[ 810], | 99.00th=[ 810], 99.50th=[ 810], 99.90th=[ 810], 99.95th=[ 810], | 99.99th=[ 810] bw ( KiB/s): min= 8126, max= 8126, per=80.11%, avg=8126.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=4.52%, ctx=55, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144952: Wed Sep 2 03:30:14 2026 write: IOPS=0, BW=3804KiB/s (3896kB/s)(12.0MiB/3230msec); 0 zone resets clat (msec): min=273, max=1427, avg=1025.91, stdev=652.45 lat (msec): min=273, max=1427, avg=1026.25, stdev=652.41 clat percentiles (msec): | 1.00th=[ 275], 5.00th=[ 275], 10.00th=[ 275], 20.00th=[ 275], | 30.00th=[ 275], 40.00th=[ 1385], 50.00th=[ 1385], 60.00th=[ 1385], | 70.00th=[ 1435], 80.00th=[ 1435], 90.00th=[ 1435], 95.00th=[ 1435], | 99.00th=[ 1435], 99.50th=[ 1435], 99.90th=[ 1435], 99.95th=[ 1435], | 99.99th=[ 1435] bw ( KiB/s): min= 8143, max= 8143, per=80.27%, avg=8143.00, stdev= 0.00, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.00%, sys=3.07%, ctx=53, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144953: Wed Sep 2 03:30:14 2026 write: IOPS=1, BW=5152KiB/s (5276kB/s)(12.0MiB/2385msec); 0 zone resets clat (msec): min=610, max=886, avg=775.40, stdev=145.47 lat (msec): min=611, max=886, avg=775.79, stdev=145.21 clat percentiles (msec): | 1.00th=[ 609], 5.00th=[ 609], 10.00th=[ 609], 20.00th=[ 609], | 30.00th=[ 609], 40.00th=[ 827], 50.00th=[ 827], 60.00th=[ 827], | 70.00th=[ 885], 80.00th=[ 885], 90.00th=[ 885], 95.00th=[ 885], | 99.00th=[ 885], 99.50th=[ 885], 99.90th=[ 885], 99.95th=[ 885], | 99.99th=[ 885] bw ( KiB/s): min= 8126, max= 8192, per=80.43%, avg=8159.00, stdev=46.67, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 750=33.33%, 1000=66.67% cpu : usr=0.00%, sys=6.25%, ctx=72, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5106KiB/s (5228kB/s), 1276KiB/s-4101KiB/s (1307kB/s-4200kB/s), io=16.0MiB (16.8MB), run=2996-3209msec WRITE: bw=9.91MiB/s (10.4MB/s), 2553KiB/s-5152KiB/s (2614kB/s-5276kB/s), io=32.0MiB (33.6MB), run=2385-3230msec