== sanity test 398b: DIO and buffer IO race ============== 01:42:36 (1783143756) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 2.85611 s, 17.6 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=180684: Sat Jul 4 01:43:48 2026 read: IOPS=24, BW=96.8KiB/s (99.1kB/s)(5992KiB/61890msec) clat (usec): min=34, max=118768, avg=22557.60, stdev=13366.85 lat (usec): min=35, max=118769, avg=22558.42, stdev=13366.84 clat percentiles (usec): | 1.00th=[ 55], 5.00th=[ 7373], 10.00th=[ 9765], 20.00th=[ 12387], | 30.00th=[ 14746], 40.00th=[ 17171], 50.00th=[ 20055], 60.00th=[ 22938], | 70.00th=[ 26608], 80.00th=[ 31327], 90.00th=[ 38536], 95.00th=[ 46400], | 99.00th=[ 70779], 99.50th=[ 77071], 99.90th=[111674], 99.95th=[119014], | 99.99th=[119014] bw ( KiB/s): min= 22, max= 191, per=25.12%, avg=96.46, stdev=27.05, samples=123 iops : min= 5, max= 47, avg=23.55, stdev= 6.78, samples=123 write: IOPS=25, BW=102KiB/s (104kB/s)(6296KiB/61890msec); 0 zone resets clat (usec): min=668, max=579259, avg=17691.58, stdev=20791.22 lat (usec): min=669, max=579260, avg=17692.76, stdev=20791.11 clat percentiles (usec): | 1.00th=[ 1090], 5.00th=[ 1532], 10.00th=[ 2114], 20.00th=[ 3326], | 30.00th=[ 5800], 40.00th=[ 10159], 50.00th=[ 13829], 60.00th=[ 17695], | 70.00th=[ 22152], 80.00th=[ 28967], 90.00th=[ 39060], 95.00th=[ 47449], | 99.00th=[ 68682], 99.50th=[ 74974], 99.90th=[ 92799], 99.95th=[583009], | 99.99th=[583009] bw ( KiB/s): min= 32, max= 223, per=25.40%, avg=102.10, stdev=32.40, samples=122 iops : min= 8, max= 55, avg=24.97, stdev= 8.10, samples=122 lat (usec) : 50=0.26%, 100=1.04%, 250=0.26%, 750=0.07%, 1000=0.29% lat (msec) : 2=4.17%, 4=7.91%, 10=11.46%, 20=32.45%, 50=38.22% lat (msec) : 100=3.74%, 250=0.10%, 750=0.03% cpu : usr=0.10%, sys=13.48%, ctx=7784, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180685: Sat Jul 4 01:43:48 2026 read: IOPS=23, BW=95.0KiB/s (97.3kB/s)(5940KiB/62505msec) clat (usec): min=21, max=130182, avg=22850.99, stdev=13745.41 lat (usec): min=22, max=130182, avg=22852.49, stdev=13746.34 clat percentiles (usec): | 1.00th=[ 78], 5.00th=[ 7832], 10.00th=[ 10159], 20.00th=[ 12649], | 30.00th=[ 15008], 40.00th=[ 17171], 50.00th=[ 20055], 60.00th=[ 23200], | 70.00th=[ 26608], 80.00th=[ 31065], 90.00th=[ 39060], 95.00th=[ 46924], | 99.00th=[ 73925], 99.50th=[ 77071], 99.90th=[115868], 99.95th=[130548], | 99.99th=[130548] bw ( KiB/s): min= 7, max= 176, per=24.64%, avg=94.60, stdev=26.57, samples=124 iops : min= 1, max= 44, avg=23.10, stdev= 6.68, samples=124 write: IOPS=25, BW=102KiB/s (104kB/s)(6348KiB/62505msec); 0 zone resets clat (usec): min=764, max=594327, avg=17832.07, stdev=21170.24 lat (usec): min=765, max=594328, avg=17833.06, stdev=21170.27 clat percentiles (usec): | 1.00th=[ 1074], 5.00th=[ 1483], 10.00th=[ 2114], 20.00th=[ 3326], | 30.00th=[ 5538], 40.00th=[ 10159], 50.00th=[ 13829], 60.00th=[ 17957], | 70.00th=[ 22676], 80.00th=[ 28967], 90.00th=[ 39584], 95.00th=[ 47449], | 99.00th=[ 68682], 99.50th=[ 74974], 99.90th=[ 99091], 99.95th=[591397], | 99.99th=[591397] bw ( KiB/s): min= 22, max= 256, per=25.09%, avg=100.86, stdev=33.80, samples=124 iops : min= 5, max= 64, avg=24.67, stdev= 8.48, samples=124 lat (usec) : 50=0.23%, 100=0.65%, 250=0.42%, 500=0.03%, 1000=0.29% lat (msec) : 2=4.39%, 4=7.75%, 10=11.46%, 20=32.16%, 50=38.18% lat (msec) : 100=4.26%, 250=0.13%, 750=0.03% cpu : usr=0.12%, sys=13.46%, ctx=7820, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180686: Sat Jul 4 01:43:48 2026 read: IOPS=24, BW=98.2KiB/s (101kB/s)(6028KiB/61395msec) clat (usec): min=38, max=567927, avg=22618.68, stdev=19587.21 lat (usec): min=39, max=567928, avg=22619.71, stdev=19587.28 clat percentiles (usec): | 1.00th=[ 59], 5.00th=[ 6718], 10.00th=[ 9503], 20.00th=[ 12125], | 30.00th=[ 14353], 40.00th=[ 17171], 50.00th=[ 20055], 60.00th=[ 22938], | 70.00th=[ 26346], 80.00th=[ 30802], 90.00th=[ 38011], 95.00th=[ 45351], | 99.00th=[ 70779], 99.50th=[ 91751], 99.90th=[145753], 99.95th=[566232], | 99.99th=[566232] bw ( KiB/s): min= 7, max= 160, per=25.48%, avg=97.84, stdev=26.75, samples=122 iops : min= 1, max= 40, avg=23.90, stdev= 6.69, samples=122 write: IOPS=25, BW=102KiB/s (104kB/s)(6260KiB/61395msec); 0 zone resets clat (usec): min=821, max=98798, avg=17290.88, stdev=15284.42 lat (usec): min=822, max=98800, avg=17292.22, stdev=15284.17 clat percentiles (usec): | 1.00th=[ 1074], 5.00th=[ 1450], 10.00th=[ 2114], 20.00th=[ 3392], | 30.00th=[ 5866], 40.00th=[ 9765], 50.00th=[13698], 60.00th=[17171], | 70.00th=[22414], 80.00th=[28967], 90.00th=[38536], 95.00th=[46924], | 99.00th=[63701], 99.50th=[78119], 99.90th=[96994], 99.95th=[99091], | 99.99th=[99091] bw ( KiB/s): min= 22, max= 191, per=25.22%, avg=101.39, stdev=32.12, samples=122 iops : min= 5, max= 47, avg=24.80, stdev= 8.03, samples=122 lat (usec) : 50=0.26%, 100=1.20%, 250=0.39%, 500=0.07%, 1000=0.20% lat (msec) : 2=4.52%, 4=7.26%, 10=12.53%, 20=31.45%, 50=38.67% lat (msec) : 100=3.32%, 250=0.10%, 750=0.03% cpu : usr=0.10%, sys=13.40%, ctx=7589, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180687: Sat Jul 4 01:43:48 2026 read: IOPS=24, BW=99.0KiB/s (101kB/s)(6052KiB/61106msec) clat (usec): min=32, max=612732, avg=22743.19, stdev=19983.19 lat (usec): min=32, max=612733, avg=22745.04, stdev=19982.09 clat percentiles (usec): | 1.00th=[ 65], 5.00th=[ 7701], 10.00th=[ 9634], 20.00th=[ 12387], | 30.00th=[ 14484], 40.00th=[ 16909], 50.00th=[ 19792], 60.00th=[ 23200], | 70.00th=[ 26870], 80.00th=[ 31065], 90.00th=[ 37487], 95.00th=[ 45351], | 99.00th=[ 68682], 99.50th=[ 77071], 99.90th=[ 99091], 99.95th=[616563], | 99.99th=[616563] bw ( KiB/s): min= 31, max= 151, per=25.85%, avg=99.26, stdev=24.50, samples=120 iops : min= 7, max= 37, avg=24.27, stdev= 6.12, samples=120 write: IOPS=25, BW=102KiB/s (105kB/s)(6236KiB/61106msec); 0 zone resets clat (usec): min=728, max=151111, avg=16939.50, stdev=15736.58 lat (usec): min=729, max=151112, avg=16946.28, stdev=15753.92 clat percentiles (usec): | 1.00th=[ 988], 5.00th=[ 1467], 10.00th=[ 2114], 20.00th=[ 3195], | 30.00th=[ 4817], 40.00th=[ 9241], 50.00th=[ 13173], 60.00th=[ 16909], | 70.00th=[ 21890], 80.00th=[ 28181], 90.00th=[ 37487], 95.00th=[ 47449], | 99.00th=[ 65274], 99.50th=[ 78119], 99.90th=[102237], 99.95th=[152044], | 99.99th=[152044] bw ( KiB/s): min= 30, max= 175, per=25.24%, avg=101.46, stdev=30.62, samples=121 iops : min= 7, max= 43, avg=24.82, stdev= 7.64, samples=121 lat (usec) : 50=0.20%, 100=0.78%, 250=0.49%, 500=0.03%, 750=0.10% lat (usec) : 1000=0.42% lat (msec) : 2=4.10%, 4=8.33%, 10=11.91%, 20=32.45%, 50=37.08% lat (msec) : 100=3.94%, 250=0.13%, 750=0.03% cpu : usr=0.11%, sys=13.52%, ctx=7678, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=384KiB/s (393kB/s), 95.0KiB/s-99.0KiB/s (97.3kB/s-101kB/s), io=23.4MiB (24.6MB), run=61106-62505msec WRITE: bw=402KiB/s (412kB/s), 102KiB/s-102KiB/s (104kB/s-105kB/s), io=24.6MiB (25.7MB), run=61106-62505msec rand-rw: (groupid=0, jobs=1): err= 0: pid=180689: Sat Jul 4 01:44:02 2026 read: IOPS=19, BW=78.8KiB/s (80.7kB/s)(5992KiB/76076msec) clat (msec): min=3, max=590, avg=20.31, stdev=22.82 lat (msec): min=3, max=590, avg=20.31, stdev=22.82 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 6], 10.00th=[ 7], 20.00th=[ 8], | 30.00th=[ 9], 40.00th=[ 11], 50.00th=[ 14], 60.00th=[ 17], | 70.00th=[ 22], 80.00th=[ 31], 90.00th=[ 45], 95.00th=[ 58], | 99.00th=[ 83], 99.50th=[ 92], 99.90th=[ 140], 99.95th=[ 592], | 99.99th=[ 592] bw ( KiB/s): min= 7, max= 240, per=24.90%, avg=78.45, stdev=53.47, samples=150 iops : min= 1, max= 60, avg=19.13, stdev=13.48, samples=150 write: IOPS=20, BW=82.8KiB/s (84.7kB/s)(6296KiB/76076msec); 0 zone resets clat (msec): min=5, max=169, avg=28.97, stdev=20.77 lat (msec): min=5, max=169, avg=28.97, stdev=20.77 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 11], 20.00th=[ 13], | 30.00th=[ 15], 40.00th=[ 18], 50.00th=[ 22], 60.00th=[ 28], | 70.00th=[ 36], 80.00th=[ 45], 90.00th=[ 57], 95.00th=[ 69], | 99.00th=[ 102], 99.50th=[ 114], 99.90th=[ 146], 99.95th=[ 169], | 99.99th=[ 169] bw ( KiB/s): min= 15, max= 248, per=24.97%, avg=82.40, stdev=53.85, samples=150 iops : min= 3, max= 62, avg=20.12, stdev=13.56, samples=150 lat (msec) : 4=0.36%, 10=21.81%, 20=33.59%, 50=32.94%, 100=10.64% lat (msec) : 250=0.62%, 750=0.03% cpu : usr=0.09%, sys=6.47%, ctx=5353, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180690: Sat Jul 4 01:44:02 2026 read: IOPS=19, BW=78.5KiB/s (80.4kB/s)(5940KiB/75675msec) clat (msec): min=3, max=609, avg=20.05, stdev=22.93 lat (msec): min=3, max=609, avg=20.05, stdev=22.93 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 6], 10.00th=[ 7], 20.00th=[ 8], | 30.00th=[ 9], 40.00th=[ 11], 50.00th=[ 14], 60.00th=[ 17], | 70.00th=[ 22], 80.00th=[ 29], 90.00th=[ 45], 95.00th=[ 56], | 99.00th=[ 83], 99.50th=[ 91], 99.90th=[ 138], 99.95th=[ 609], | 99.99th=[ 609] bw ( KiB/s): min= 15, max= 256, per=24.92%, avg=78.50, stdev=54.51, samples=149 iops : min= 3, max= 64, avg=19.15, stdev=13.73, samples=149 write: IOPS=20, BW=83.9KiB/s (85.9kB/s)(6348KiB/75675msec); 0 zone resets clat (msec): min=5, max=179, avg=28.89, stdev=20.52 lat (msec): min=5, max=179, avg=28.89, stdev=20.52 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 11], 20.00th=[ 13], | 30.00th=[ 16], 40.00th=[ 18], 50.00th=[ 22], 60.00th=[ 28], | 70.00th=[ 34], 80.00th=[ 44], 90.00th=[ 57], 95.00th=[ 69], | 99.00th=[ 102], 99.50th=[ 116], 99.90th=[ 144], 99.95th=[ 180], | 99.99th=[ 180] bw ( KiB/s): min= 23, max= 280, per=25.33%, avg=83.60, stdev=52.18, samples=149 iops : min= 5, max= 70, avg=20.42, stdev=13.16, samples=149 lat (msec) : 4=0.20%, 10=21.06%, 20=34.99%, 50=32.62%, 100=10.45% lat (msec) : 250=0.65%, 750=0.03% cpu : usr=0.09%, sys=6.53%, ctx=5355, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180691: Sat Jul 4 01:44:02 2026 read: IOPS=19, BW=79.2KiB/s (81.1kB/s)(6028KiB/76095msec) clat (msec): min=3, max=123, avg=20.68, stdev=18.30 lat (msec): min=3, max=123, avg=20.68, stdev=18.30 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 6], 10.00th=[ 7], 20.00th=[ 8], | 30.00th=[ 9], 40.00th=[ 11], 50.00th=[ 14], 60.00th=[ 18], | 70.00th=[ 23], 80.00th=[ 33], 90.00th=[ 49], 95.00th=[ 62], | 99.00th=[ 81], 99.50th=[ 94], 99.90th=[ 123], 99.95th=[ 124], | 99.99th=[ 124] bw ( KiB/s): min= 8, max= 232, per=25.08%, avg=78.99, stdev=53.87, samples=150 iops : min= 2, max= 58, avg=19.27, stdev=13.58, samples=150 write: IOPS=20, BW=82.3KiB/s (84.2kB/s)(6260KiB/76095msec); 0 zone resets clat (msec): min=5, max=621, avg=28.67, stdev=25.99 lat (msec): min=5, max=621, avg=28.67, stdev=25.99 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 13], | 30.00th=[ 15], 40.00th=[ 17], 50.00th=[ 21], 60.00th=[ 27], | 70.00th=[ 34], 80.00th=[ 43], 90.00th=[ 57], 95.00th=[ 70], | 99.00th=[ 114], 99.50th=[ 126], 99.90th=[ 184], 99.95th=[ 625], | 99.99th=[ 625] bw ( KiB/s): min= 15, max= 248, per=24.77%, avg=81.75, stdev=55.13, samples=150 iops : min= 3, max= 62, avg=19.96, stdev=13.89, samples=150 lat (msec) : 4=0.42%, 10=21.97%, 20=34.80%, 50=31.35%, 100=10.58% lat (msec) : 250=0.85%, 750=0.03% cpu : usr=0.09%, sys=6.53%, ctx=5410, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180692: Sat Jul 4 01:44:02 2026 read: IOPS=19, BW=79.7KiB/s (81.6kB/s)(6052KiB/75932msec) clat (msec): min=3, max=135, avg=20.18, stdev=18.29 lat (msec): min=3, max=135, avg=20.19, stdev=18.29 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 6], 10.00th=[ 7], 20.00th=[ 8], | 30.00th=[ 9], 40.00th=[ 11], 50.00th=[ 14], 60.00th=[ 17], | 70.00th=[ 22], 80.00th=[ 31], 90.00th=[ 46], 95.00th=[ 58], | 99.00th=[ 92], 99.50th=[ 100], 99.90th=[ 129], 99.95th=[ 136], | 99.99th=[ 136] bw ( KiB/s): min= 7, max= 264, per=25.37%, avg=79.91, stdev=54.48, samples=150 iops : min= 1, max= 66, avg=19.49, stdev=13.72, samples=150 write: IOPS=20, BW=82.1KiB/s (84.1kB/s)(6236KiB/75932msec); 0 zone resets clat (msec): min=5, max=608, avg=29.08, stdev=25.25 lat (msec): min=5, max=608, avg=29.08, stdev=25.25 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 11], 20.00th=[ 13], | 30.00th=[ 15], 40.00th=[ 18], 50.00th=[ 22], 60.00th=[ 28], | 70.00th=[ 35], 80.00th=[ 44], 90.00th=[ 58], 95.00th=[ 69], | 99.00th=[ 99], 99.50th=[ 117], 99.90th=[ 144], 99.95th=[ 609], | 99.99th=[ 609] bw ( KiB/s): min= 16, max= 264, per=24.91%, avg=82.19, stdev=54.91, samples=150 iops : min= 4, max= 66, avg=20.07, stdev=13.84, samples=150 lat (msec) : 4=0.26%, 10=22.14%, 20=34.86%, 50=31.45%, 100=10.61% lat (msec) : 250=0.65%, 750=0.03% cpu : usr=0.09%, sys=6.57%, ctx=5365, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=316KiB/s (323kB/s), 78.5KiB/s-79.7KiB/s (80.4kB/s-81.6kB/s), io=23.4MiB (24.6MB), run=75675-76095msec WRITE: bw=330KiB/s (338kB/s), 82.1KiB/s-83.9KiB/s (84.1kB/s-85.9kB/s), io=24.6MiB (25.7MB), run=75675-76095msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=180720: Sat Jul 4 01:44:24 2026 read: IOPS=23, BW=370KiB/s (379kB/s)(5920KiB/16002msec) clat (usec): min=36, max=74989, avg=21966.05, stdev=13277.12 lat (usec): min=36, max=74991, avg=21968.35, stdev=13276.61 clat percentiles (usec): | 1.00th=[ 42], 5.00th=[ 89], 10.00th=[ 202], 20.00th=[12256], | 30.00th=[15008], 40.00th=[17433], 50.00th=[20317], 60.00th=[23725], | 70.00th=[27657], 80.00th=[32113], 90.00th=[39060], 95.00th=[47449], | 99.00th=[63177], 99.50th=[73925], 99.90th=[74974], 99.95th=[74974], | 99.99th=[74974] bw ( KiB/s): min= 190, max= 541, per=24.83%, avg=365.68, stdev=90.04, samples=31 iops : min= 11, max= 33, avg=22.26, stdev= 5.75, samples=31 write: IOPS=24, BW=398KiB/s (408kB/s)(6368KiB/16002msec); 0 zone resets clat (usec): min=1266, max=100653, avg=19499.21, stdev=16031.56 lat (usec): min=1676, max=100655, avg=19503.61, stdev=16028.45 clat percentiles (usec): | 1.00th=[ 1795], 5.00th=[ 2409], 10.00th=[ 3490], 20.00th=[ 6063], | 30.00th=[ 9896], 40.00th=[ 12125], 50.00th=[ 15139], 60.00th=[ 19530], | 70.00th=[ 23725], 80.00th=[ 29754], 90.00th=[ 41681], 95.00th=[ 49546], | 99.00th=[ 88605], 99.50th=[ 99091], 99.90th=[100140], 99.95th=[100140], | 99.99th=[100140] bw ( KiB/s): min= 221, max= 608, per=25.71%, avg=398.52, stdev=99.64, samples=31 iops : min= 13, max= 38, avg=24.32, stdev= 6.25, samples=31 lat (usec) : 50=0.65%, 100=2.86%, 250=1.30% lat (msec) : 2=1.04%, 4=5.21%, 10=11.46%, 20=33.07%, 50=40.36% lat (msec) : 100=3.91%, 250=0.13% cpu : usr=0.11%, sys=16.72%, ctx=2236, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180722: Sat Jul 4 01:44:24 2026 read: IOPS=22, BW=353KiB/s (362kB/s)(5744KiB/16257msec) clat (usec): min=42, max=107916, avg=23930.88, stdev=14793.18 lat (usec): min=42, max=107918, avg=23931.83, stdev=14793.34 clat percentiles (usec): | 1.00th=[ 50], 5.00th=[ 125], 10.00th=[ 10159], 20.00th=[ 13698], | 30.00th=[ 16057], 40.00th=[ 18744], 50.00th=[ 21627], 60.00th=[ 24249], | 70.00th=[ 27657], 80.00th=[ 32375], 90.00th=[ 40633], 95.00th=[ 52691], | 99.00th=[ 80217], 99.50th=[ 87557], 99.90th=[107480], 99.95th=[107480], | 99.99th=[107480] bw ( KiB/s): min= 160, max= 479, per=23.81%, avg=350.78, stdev=89.02, samples=32 iops : min= 10, max= 29, avg=21.34, stdev= 5.50, samples=32 write: IOPS=25, BW=403KiB/s (412kB/s)(6544KiB/16257msec); 0 zone resets clat (usec): min=1132, max=72938, avg=18575.39, stdev=14927.75 lat (usec): min=1134, max=72939, avg=18581.30, stdev=14931.59 clat percentiles (usec): | 1.00th=[ 1860], 5.00th=[ 2999], 10.00th=[ 3851], 20.00th=[ 5145], | 30.00th=[ 7701], 40.00th=[10945], 50.00th=[14222], 60.00th=[18220], | 70.00th=[23725], 80.00th=[30540], 90.00th=[40109], 95.00th=[48497], | 99.00th=[63177], 99.50th=[70779], 99.90th=[72877], 99.95th=[72877], | 99.99th=[72877] bw ( KiB/s): min= 95, max= 667, per=25.68%, avg=398.00, stdev=118.86, samples=32 iops : min= 5, max= 41, avg=24.28, stdev= 7.48, samples=32 lat (usec) : 50=0.39%, 100=1.04%, 250=1.04% lat (msec) : 2=0.91%, 4=4.95%, 10=15.23%, 20=32.03%, 50=39.84% lat (msec) : 100=4.43%, 250=0.13% cpu : usr=0.08%, sys=17.20%, ctx=2230, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180723: Sat Jul 4 01:44:24 2026 read: IOPS=24, BW=393KiB/s (402kB/s)(6256KiB/15930msec) clat (usec): min=45, max=143752, avg=22569.57, stdev=13955.89 lat (usec): min=46, max=143753, avg=22570.54, stdev=13955.92 clat percentiles (usec): | 1.00th=[ 56], 5.00th=[ 92], 10.00th=[ 9241], 20.00th=[ 12911], | 30.00th=[ 15533], 40.00th=[ 18220], 50.00th=[ 20841], 60.00th=[ 24249], | 70.00th=[ 27395], 80.00th=[ 31327], 90.00th=[ 38011], 95.00th=[ 43779], | 99.00th=[ 63701], 99.50th=[ 77071], 99.90th=[143655], 99.95th=[143655], | 99.99th=[143655] bw ( KiB/s): min= 224, max= 608, per=26.71%, avg=393.48, stdev=83.81, samples=31 iops : min= 14, max= 38, avg=24.00, stdev= 5.34, samples=31 write: IOPS=23, BW=379KiB/s (388kB/s)(6032KiB/15930msec); 0 zone resets clat (usec): min=1583, max=144298, avg=18754.90, stdev=16352.26 lat (usec): min=1585, max=144300, avg=18757.63, stdev=16353.30 clat percentiles (usec): | 1.00th=[ 1942], 5.00th=[ 2835], 10.00th=[ 3851], 20.00th=[ 5342], | 30.00th=[ 8848], 40.00th=[ 12649], 50.00th=[ 15401], 60.00th=[ 19006], | 70.00th=[ 22676], 80.00th=[ 28967], 90.00th=[ 35914], 95.00th=[ 43254], | 99.00th=[ 88605], 99.50th=[129500], 99.90th=[143655], 99.95th=[143655], | 99.99th=[143655] bw ( KiB/s): min= 158, max= 608, per=24.17%, avg=374.71, stdev=104.61, samples=31 iops : min= 9, max= 38, avg=22.84, stdev= 6.55, samples=31 lat (usec) : 50=0.13%, 100=2.60%, 250=1.17% lat (msec) : 2=0.52%, 4=4.82%, 10=12.76%, 20=32.55%, 50=42.32% lat (msec) : 100=2.73%, 250=0.39% cpu : usr=0.13%, sys=17.20%, ctx=2335, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180724: Sat Jul 4 01:44:24 2026 read: IOPS=24, BW=386KiB/s (396kB/s)(6032KiB/15607msec) clat (usec): min=40, max=157857, avg=21846.21, stdev=15352.74 lat (usec): min=41, max=157859, avg=21847.33, stdev=15352.76 clat percentiles (usec): | 1.00th=[ 48], 5.00th=[ 84], 10.00th=[ 135], 20.00th=[ 11994], | 30.00th=[ 15270], 40.00th=[ 17957], 50.00th=[ 20579], 60.00th=[ 22938], | 70.00th=[ 25560], 80.00th=[ 29230], 90.00th=[ 38536], 95.00th=[ 48497], | 99.00th=[ 73925], 99.50th=[ 80217], 99.90th=[158335], 99.95th=[158335], | 99.99th=[158335] bw ( KiB/s): min= 192, max= 541, per=26.43%, avg=389.30, stdev=82.61, samples=30 iops : min= 12, max= 33, avg=23.73, stdev= 5.21, samples=30 write: IOPS=25, BW=401KiB/s (410kB/s)(6256KiB/15607msec); 0 zone resets clat (usec): min=1339, max=90408, avg=18655.77, stdev=15395.59 lat (usec): min=1341, max=90411, avg=18657.89, stdev=15395.47 clat percentiles (usec): | 1.00th=[ 1631], 5.00th=[ 2704], 10.00th=[ 3785], 20.00th=[ 4948], | 30.00th=[ 6915], 40.00th=[11731], 50.00th=[15533], 60.00th=[19268], | 70.00th=[22938], 80.00th=[29230], 90.00th=[39060], 95.00th=[49546], | 99.00th=[72877], 99.50th=[83362], 99.90th=[90702], 99.95th=[90702], | 99.99th=[90702] bw ( KiB/s): min= 222, max= 608, per=25.97%, avg=402.53, stdev=88.19, samples=30 iops : min= 13, max= 38, avg=24.57, stdev= 5.61, samples=30 lat (usec) : 50=0.52%, 100=2.47%, 250=2.60%, 750=0.13% lat (msec) : 2=1.43%, 4=4.82%, 10=13.41%, 20=30.08%, 50=39.97% lat (msec) : 100=4.43%, 250=0.13% cpu : usr=0.12%, sys=17.38%, ctx=2184, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1473KiB/s (1509kB/s), 353KiB/s-393KiB/s (362kB/s-402kB/s), io=23.4MiB (24.5MB), run=15607-16257msec WRITE: bw=1550KiB/s (1587kB/s), 379KiB/s-403KiB/s (388kB/s-412kB/s), io=24.6MiB (25.8MB), run=15607-16257msec rand-rw: (groupid=0, jobs=1): err= 0: pid=180725: Sat Jul 4 01:44:28 2026 read: IOPS=18, BW=289KiB/s (296kB/s)(5920KiB/20494msec) clat (msec): min=3, max=142, avg=23.00, stdev=19.74 lat (msec): min=3, max=142, avg=23.00, stdev=19.74 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 7], 10.00th=[ 8], 20.00th=[ 9], | 30.00th=[ 12], 40.00th=[ 13], 50.00th=[ 16], 60.00th=[ 19], | 70.00th=[ 26], 80.00th=[ 35], 90.00th=[ 52], 95.00th=[ 61], | 99.00th=[ 93], 99.50th=[ 121], 99.90th=[ 142], 99.95th=[ 142], | 99.99th=[ 142] bw ( KiB/s): min= 61, max= 766, per=24.00%, avg=279.32, stdev=163.33, samples=40 iops : min= 3, max= 47, avg=16.93, stdev=10.35, samples=40 write: IOPS=19, BW=311KiB/s (318kB/s)(6368KiB/20494msec); 0 zone resets clat (msec): min=8, max=163, avg=29.73, stdev=20.13 lat (msec): min=8, max=163, avg=29.73, stdev=20.13 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 12], 20.00th=[ 15], | 30.00th=[ 17], 40.00th=[ 20], 50.00th=[ 23], 60.00th=[ 29], | 70.00th=[ 35], 80.00th=[ 43], 90.00th=[ 62], 95.00th=[ 72], | 99.00th=[ 97], 99.50th=[ 106], 99.90th=[ 165], 99.95th=[ 165], | 99.99th=[ 165] bw ( KiB/s): min= 64, max= 704, per=24.97%, avg=305.65, stdev=177.36, samples=40 iops : min= 4, max= 44, avg=18.60, stdev=11.19, samples=40 lat (msec) : 4=0.13%, 10=14.71%, 20=36.59%, 50=36.33%, 100=11.59% lat (msec) : 250=0.65% cpu : usr=0.08%, sys=7.35%, ctx=1450, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180726: Sat Jul 4 01:44:28 2026 read: IOPS=17, BW=279KiB/s (286kB/s)(5744KiB/20577msec) clat (msec): min=3, max=123, avg=22.42, stdev=17.85 lat (msec): min=3, max=123, avg=22.43, stdev=17.85 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 6], 10.00th=[ 7], 20.00th=[ 10], | 30.00th=[ 11], 40.00th=[ 13], 50.00th=[ 16], 60.00th=[ 20], | 70.00th=[ 26], 80.00th=[ 35], 90.00th=[ 50], 95.00th=[ 63], | 99.00th=[ 75], 99.50th=[ 82], 99.90th=[ 124], 99.95th=[ 124], | 99.99th=[ 124] bw ( KiB/s): min= 53, max= 798, per=23.58%, avg=274.43, stdev=176.71, samples=40 iops : min= 3, max= 49, avg=16.62, stdev=11.10, samples=40 write: IOPS=19, BW=318KiB/s (326kB/s)(6544KiB/20577msec); 0 zone resets clat (msec): min=7, max=165, avg=30.29, stdev=20.88 lat (msec): min=7, max=165, avg=30.29, stdev=20.88 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 15], | 30.00th=[ 17], 40.00th=[ 19], 50.00th=[ 23], 60.00th=[ 29], | 70.00th=[ 36], 80.00th=[ 46], 90.00th=[ 61], 95.00th=[ 72], | 99.00th=[ 90], 99.50th=[ 103], 99.90th=[ 167], 99.95th=[ 167], | 99.99th=[ 167] bw ( KiB/s): min= 126, max= 736, per=24.94%, avg=305.30, stdev=166.55, samples=40 iops : min= 7, max= 46, avg=18.55, stdev=10.56, samples=40 lat (msec) : 4=0.39%, 10=14.45%, 20=36.20%, 50=36.20%, 100=12.24% lat (msec) : 250=0.52% cpu : usr=0.09%, sys=7.26%, ctx=1498, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180727: Sat Jul 4 01:44:28 2026 read: IOPS=19, BW=305KiB/s (313kB/s)(6256KiB/20483msec) clat (msec): min=4, max=121, avg=22.30, stdev=17.59 lat (msec): min=4, max=121, avg=22.30, stdev=17.59 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 7], 10.00th=[ 8], 20.00th=[ 10], | 30.00th=[ 12], 40.00th=[ 14], 50.00th=[ 16], 60.00th=[ 20], | 70.00th=[ 25], 80.00th=[ 33], 90.00th=[ 50], 95.00th=[ 58], | 99.00th=[ 85], 99.50th=[ 96], 99.90th=[ 122], 99.95th=[ 122], | 99.99th=[ 122] bw ( KiB/s): min= 127, max= 960, per=26.07%, avg=303.40, stdev=196.44, samples=40 iops : min= 7, max= 60, avg=18.45, stdev=12.36, samples=40 write: IOPS=18, BW=294KiB/s (302kB/s)(6032KiB/20483msec); 0 zone resets clat (msec): min=7, max=112, avg=31.06, stdev=20.67 lat (msec): min=7, max=112, avg=31.06, stdev=20.67 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 12], 20.00th=[ 15], | 30.00th=[ 17], 40.00th=[ 20], 50.00th=[ 24], 60.00th=[ 30], | 70.00th=[ 38], 80.00th=[ 46], 90.00th=[ 63], 95.00th=[ 73], | 99.00th=[ 100], 99.50th=[ 108], 99.90th=[ 112], 99.95th=[ 112], | 99.99th=[ 112] bw ( KiB/s): min= 127, max= 832, per=23.46%, avg=287.15, stdev=157.78, samples=40 iops : min= 7, max= 52, avg=17.43, stdev= 9.98, samples=40 lat (msec) : 10=14.84%, 20=36.98%, 50=34.51%, 100=13.15%, 250=0.52% cpu : usr=0.10%, sys=7.39%, ctx=1407, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180728: Sat Jul 4 01:44:28 2026 read: IOPS=18, BW=295KiB/s (302kB/s)(6032KiB/20436msec) clat (msec): min=4, max=151, avg=23.02, stdev=20.01 lat (msec): min=4, max=151, avg=23.03, stdev=20.01 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 7], 10.00th=[ 7], 20.00th=[ 9], | 30.00th=[ 11], 40.00th=[ 14], 50.00th=[ 16], 60.00th=[ 20], | 70.00th=[ 26], 80.00th=[ 36], 90.00th=[ 51], 95.00th=[ 64], | 99.00th=[ 87], 99.50th=[ 142], 99.90th=[ 153], 99.95th=[ 153], | 99.99th=[ 153] bw ( KiB/s): min= 95, max= 793, per=24.83%, avg=289.05, stdev=173.93, samples=40 iops : min= 5, max= 49, avg=17.55, stdev=10.98, samples=40 write: IOPS=19, BW=306KiB/s (313kB/s)(6256KiB/20436msec); 0 zone resets clat (msec): min=7, max=120, avg=29.66, stdev=19.35 lat (msec): min=7, max=120, avg=29.66, stdev=19.35 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 12], 20.00th=[ 14], | 30.00th=[ 17], 40.00th=[ 19], 50.00th=[ 24], 60.00th=[ 29], | 70.00th=[ 36], 80.00th=[ 45], 90.00th=[ 58], 95.00th=[ 69], | 99.00th=[ 101], 99.50th=[ 113], 99.90th=[ 121], 99.95th=[ 121], | 99.99th=[ 121] bw ( KiB/s): min= 127, max= 768, per=24.71%, avg=302.48, stdev=176.12, samples=40 iops : min= 7, max= 48, avg=18.38, stdev=11.15, samples=40 lat (msec) : 10=15.63%, 20=36.72%, 50=34.90%, 100=12.11%, 250=0.65% cpu : usr=0.11%, sys=7.38%, ctx=1457, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1164KiB/s (1192kB/s), 279KiB/s-305KiB/s (286kB/s-313kB/s), io=23.4MiB (24.5MB), run=20436-20577msec WRITE: bw=1225KiB/s (1254kB/s), 294KiB/s-318KiB/s (302kB/s-326kB/s), io=24.6MiB (25.8MB), run=20436-20577msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=180736: Sat Jul 4 01:44:37 2026 read: IOPS=2, BW=2093KiB/s (2143kB/s)(7168KiB/3425msec) clat (usec): min=919, max=1035.6k, avg=242448.32, stdev=356096.52 lat (usec): min=921, max=1035.6k, avg=242449.86, stdev=356096.91 clat percentiles (usec): | 1.00th=[ 922], 5.00th=[ 922], 10.00th=[ 922], | 20.00th=[ 61604], 30.00th=[ 103285], 40.00th=[ 103285], | 50.00th=[ 123208], 60.00th=[ 166724], 70.00th=[ 166724], | 80.00th=[ 204473], 90.00th=[1035994], 95.00th=[1035994], | 99.00th=[1035994], 99.50th=[1035994], 99.90th=[1035994], | 99.95th=[1035994], 99.99th=[1035994] bw ( KiB/s): min= 2011, max= 4087, per=52.82%, avg=3009.75, stdev=1134.76, samples=4 iops : min= 1, max= 3, avg= 2.25, stdev= 0.96, samples=4 write: IOPS=1, BW=1495KiB/s (1531kB/s)(5120KiB/3425msec); 0 zone resets clat (msec): min=145, max=628, avg=335.87, stdev=177.61 lat (msec): min=145, max=628, avg=335.94, stdev=177.62 clat percentiles (msec): | 1.00th=[ 146], 5.00th=[ 146], 10.00th=[ 146], 20.00th=[ 146], | 30.00th=[ 279], 40.00th=[ 279], 50.00th=[ 313], 60.00th=[ 313], | 70.00th=[ 317], 80.00th=[ 317], 90.00th=[ 625], 95.00th=[ 625], | 99.00th=[ 625], 99.50th=[ 625], 99.90th=[ 625], 99.95th=[ 625], | 99.99th=[ 625] bw ( KiB/s): min= 1946, max= 2043, per=25.21%, avg=2010.75, stdev=45.73, samples=4 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=4 lat (usec) : 1000=8.33% lat (msec) : 100=8.33%, 250=41.67%, 500=25.00%, 750=8.33%, 2000=8.33% cpu : usr=0.00%, sys=38.58%, ctx=1398, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180737: Sat Jul 4 01:44:37 2026 read: IOPS=0, BW=620KiB/s (635kB/s)(2048KiB/3305msec) clat (usec): min=20892, max=88780, avg=54836.61, stdev=48003.87 lat (usec): min=20894, max=88782, avg=54838.56, stdev=48004.47 clat percentiles (usec): | 1.00th=[20841], 5.00th=[20841], 10.00th=[20841], 20.00th=[20841], | 30.00th=[20841], 40.00th=[20841], 50.00th=[20841], 60.00th=[88605], | 70.00th=[88605], 80.00th=[88605], 90.00th=[88605], 95.00th=[88605], | 99.00th=[88605], 99.50th=[88605], 99.90th=[88605], 99.95th=[88605], | 99.99th=[88605] bw ( KiB/s): min= 1729, max= 2043, per=33.10%, avg=1886.00, stdev=222.03, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=3, BW=3098KiB/s (3173kB/s)(10.0MiB/3305msec); 0 zone resets clat (msec): min=82, max=1207, avg=318.22, stdev=327.42 lat (msec): min=82, max=1207, avg=318.30, stdev=327.42 clat percentiles (msec): | 1.00th=[ 83], 5.00th=[ 83], 10.00th=[ 83], 20.00th=[ 90], | 30.00th=[ 110], 40.00th=[ 211], 50.00th=[ 234], 60.00th=[ 259], | 70.00th=[ 321], 80.00th=[ 334], 90.00th=[ 338], 95.00th=[ 1200], | 99.00th=[ 1200], 99.50th=[ 1200], 99.90th=[ 1200], 99.95th=[ 1200], | 99.99th=[ 1200] bw ( KiB/s): min= 3893, max= 6035, per=56.73%, avg=4525.50, stdev=1010.48, samples=4 iops : min= 3, max= 5, avg= 3.50, stdev= 1.00, samples=4 lat (msec) : 50=8.33%, 100=25.00%, 250=25.00%, 500=33.33%, 2000=8.33% cpu : usr=0.00%, sys=40.85%, ctx=532, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180738: Sat Jul 4 01:44:37 2026 read: IOPS=1, BW=1818KiB/s (1861kB/s)(6144KiB/3380msec) clat (usec): min=845, max=330716, avg=170732.52, stdev=107292.24 lat (usec): min=847, max=330717, avg=170733.68, stdev=107292.06 clat percentiles (usec): | 1.00th=[ 848], 5.00th=[ 848], 10.00th=[ 848], 20.00th=[137364], | 30.00th=[137364], 40.00th=[166724], 50.00th=[166724], 60.00th=[173016], | 70.00th=[214959], 80.00th=[214959], 90.00th=[329253], 95.00th=[329253], | 99.00th=[329253], 99.50th=[329253], 99.90th=[329253], 99.95th=[329253], | 99.99th=[329253] bw ( KiB/s): min= 2011, max= 3893, per=43.83%, avg=2497.50, stdev=930.46, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 write: IOPS=1, BW=1818KiB/s (1861kB/s)(6144KiB/3380msec); 0 zone resets clat (msec): min=132, max=991, avg=387.36, stdev=309.95 lat (msec): min=132, max=991, avg=387.44, stdev=309.94 clat percentiles (msec): | 1.00th=[ 133], 5.00th=[ 133], 10.00th=[ 133], 20.00th=[ 218], | 30.00th=[ 218], 40.00th=[ 245], 50.00th=[ 245], 60.00th=[ 368], | 70.00th=[ 376], 80.00th=[ 376], 90.00th=[ 995], 95.00th=[ 995], | 99.00th=[ 995], 99.50th=[ 995], 99.90th=[ 995], 99.95th=[ 995], | 99.99th=[ 995] bw ( KiB/s): min= 1946, max= 3453, per=29.63%, avg=2363.25, stdev=727.62, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (usec) : 1000=8.33% lat (msec) : 250=58.33%, 500=25.00%, 1000=8.33% cpu : usr=0.00%, sys=34.71%, ctx=616, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180739: Sat Jul 4 01:44:37 2026 read: IOPS=1, BW=1425KiB/s (1459kB/s)(5120KiB/3594msec) clat (usec): min=676, max=211978, avg=138813.11, stdev=84778.87 lat (usec): min=677, max=211979, avg=138814.10, stdev=84778.58 clat percentiles (usec): | 1.00th=[ 676], 5.00th=[ 676], 10.00th=[ 676], 20.00th=[ 676], | 30.00th=[124257], 40.00th=[124257], 50.00th=[156238], 60.00th=[156238], | 70.00th=[200279], 80.00th=[200279], 90.00th=[212861], 95.00th=[212861], | 99.00th=[212861], 99.50th=[212861], 99.90th=[212861], 99.95th=[212861], | 99.99th=[212861] bw ( KiB/s): min= 2011, max= 6131, per=71.45%, avg=4071.00, stdev=2913.28, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 write: IOPS=1, BW=1994KiB/s (2042kB/s)(7168KiB/3594msec); 0 zone resets clat (msec): min=180, max=1027, avg=408.16, stdev=291.99 lat (msec): min=180, max=1027, avg=408.23, stdev=292.00 clat percentiles (msec): | 1.00th=[ 182], 5.00th=[ 182], 10.00th=[ 182], 20.00th=[ 203], | 30.00th=[ 243], 40.00th=[ 243], 50.00th=[ 338], 60.00th=[ 430], | 70.00th=[ 430], 80.00th=[ 439], 90.00th=[ 1028], 95.00th=[ 1028], | 99.00th=[ 1028], 99.50th=[ 1028], 99.90th=[ 1028], 99.95th=[ 1028], | 99.99th=[ 1028] bw ( KiB/s): min= 1726, max= 3893, per=30.32%, avg=2418.25, stdev=993.44, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (usec) : 750=8.33% lat (msec) : 250=58.33%, 500=25.00%, 2000=8.33% cpu : usr=0.00%, sys=34.54%, ctx=721, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5698KiB/s (5835kB/s), 620KiB/s-2093KiB/s (635kB/s-2143kB/s), io=20.0MiB (20.0MB), run=3305-3594msec WRITE: bw=7978KiB/s (8169kB/s), 1495KiB/s-3098KiB/s (1531kB/s-3173kB/s), io=28.0MiB (29.4MB), run=3305-3594msec rand-rw: (groupid=0, jobs=1): err= 0: pid=180741: Sat Jul 4 01:44:37 2026 read: IOPS=1, BW=1806KiB/s (1849kB/s)(7168KiB/3969msec) clat (msec): min=56, max=957, avg=375.01, stdev=381.86 lat (msec): min=56, max=957, avg=375.01, stdev=381.86 clat percentiles (msec): | 1.00th=[ 57], 5.00th=[ 57], 10.00th=[ 57], 20.00th=[ 68], | 30.00th=[ 163], 40.00th=[ 163], 50.00th=[ 224], 60.00th=[ 271], | 70.00th=[ 271], 80.00th=[ 885], 90.00th=[ 961], 95.00th=[ 961], | 99.00th=[ 961], 99.50th=[ 961], 99.90th=[ 961], 99.95th=[ 961], | 99.99th=[ 961] bw ( KiB/s): min= 2048, max= 3856, per=49.02%, avg=2500.00, stdev=904.00, samples=4 iops : min= 2, max= 3, avg= 2.25, stdev= 0.50, samples=4 write: IOPS=1, BW=1290KiB/s (1321kB/s)(5120KiB/3969msec); 0 zone resets clat (msec): min=55, max=550, avg=251.19, stdev=191.18 lat (msec): min=55, max=550, avg=251.28, stdev=191.15 clat percentiles (msec): | 1.00th=[ 56], 5.00th=[ 56], 10.00th=[ 56], 20.00th=[ 56], | 30.00th=[ 138], 40.00th=[ 138], 50.00th=[ 203], 60.00th=[ 203], | 70.00th=[ 309], 80.00th=[ 309], 90.00th=[ 550], 95.00th=[ 550], | 99.00th=[ 550], 99.50th=[ 550], 99.90th=[ 550], 99.95th=[ 550], | 99.99th=[ 550] bw ( KiB/s): min= 2048, max= 4087, per=42.96%, avg=3067.50, stdev=1441.79, samples=2 iops : min= 2, max= 3, avg= 2.50, stdev= 0.71, samples=2 lat (msec) : 100=25.00%, 250=33.33%, 500=16.67%, 750=8.33%, 1000=16.67% cpu : usr=0.05%, sys=12.10%, ctx=103, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180742: Sat Jul 4 01:44:37 2026 read: IOPS=0, BW=514KiB/s (526kB/s)(2048KiB/3985msec) clat (msec): min=166, max=354, avg=260.69, stdev=132.87 lat (msec): min=166, max=354, avg=260.69, stdev=132.87 clat percentiles (msec): | 1.00th=[ 167], 5.00th=[ 167], 10.00th=[ 167], 20.00th=[ 167], | 30.00th=[ 167], 40.00th=[ 167], 50.00th=[ 167], 60.00th=[ 355], | 70.00th=[ 355], 80.00th=[ 355], 90.00th=[ 355], 95.00th=[ 355], | 99.00th=[ 355], 99.50th=[ 355], 99.90th=[ 355], 99.95th=[ 355], | 99.99th=[ 355] bw ( KiB/s): min= 1738, max= 2043, per=37.07%, avg=1890.50, stdev=215.67, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2570KiB/s (2631kB/s)(10.0MiB/3985msec); 0 zone resets clat (msec): min=47, max=1357, avg=337.68, stdev=389.16 lat (msec): min=47, max=1357, avg=337.76, stdev=389.16 clat percentiles (msec): | 1.00th=[ 47], 5.00th=[ 47], 10.00th=[ 47], 20.00th=[ 57], | 30.00th=[ 78], 40.00th=[ 150], 50.00th=[ 203], 60.00th=[ 228], | 70.00th=[ 384], 80.00th=[ 401], 90.00th=[ 477], 95.00th=[ 1351], | 99.00th=[ 1351], 99.50th=[ 1351], 99.90th=[ 1351], 99.95th=[ 1351], | 99.99th=[ 1351] bw ( KiB/s): min= 2043, max= 3856, per=34.99%, avg=2498.75, stdev=904.84, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 0.82, samples=4 lat (msec) : 50=8.33%, 100=16.67%, 250=33.33%, 500=33.33%, 2000=8.33% cpu : usr=0.00%, sys=14.21%, ctx=327, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180743: Sat Jul 4 01:44:37 2026 read: IOPS=1, BW=1584KiB/s (1622kB/s)(6144KiB/3878msec) clat (msec): min=85, max=424, avg=271.91, stdev=151.24 lat (msec): min=85, max=424, avg=271.92, stdev=151.24 clat percentiles (msec): | 1.00th=[ 86], 5.00th=[ 86], 10.00th=[ 86], 20.00th=[ 91], | 30.00th=[ 91], 40.00th=[ 300], 50.00th=[ 300], 60.00th=[ 313], | 70.00th=[ 418], 80.00th=[ 418], 90.00th=[ 426], 95.00th=[ 426], | 99.00th=[ 426], 99.50th=[ 426], 99.90th=[ 426], 99.95th=[ 426], | 99.99th=[ 426] bw ( KiB/s): min= 4087, max= 4096, per=80.23%, avg=4091.50, stdev= 6.36, samples=2 iops : min= 3, max= 4, avg= 3.50, stdev= 0.71, samples=2 write: IOPS=1, BW=1584KiB/s (1622kB/s)(6144KiB/3878msec); 0 zone resets clat (msec): min=32, max=1376, avg=366.01, stdev=510.91 lat (msec): min=32, max=1377, avg=366.11, stdev=510.93 clat percentiles (msec): | 1.00th=[ 33], 5.00th=[ 33], 10.00th=[ 33], 20.00th=[ 68], | 30.00th=[ 68], 40.00th=[ 163], 50.00th=[ 163], 60.00th=[ 165], | 70.00th=[ 393], 80.00th=[ 393], 90.00th=[ 1385], 95.00th=[ 1385], | 99.00th=[ 1385], 99.50th=[ 1385], 99.90th=[ 1385], 99.95th=[ 1385], | 99.99th=[ 1385] bw ( KiB/s): min= 1928, max= 3459, per=34.71%, avg=2478.33, stdev=851.40, samples=3 iops : min= 1, max= 3, avg= 2.00, stdev= 1.00, samples=3 lat (msec) : 50=8.33%, 100=25.00%, 250=16.67%, 500=41.67%, 2000=8.33% cpu : usr=0.00%, sys=12.66%, ctx=341, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180744: Sat Jul 4 01:44:37 2026 read: IOPS=1, BW=1275KiB/s (1306kB/s)(5120KiB/4015msec) clat (msec): min=26, max=480, avg=224.90, stdev=163.10 lat (msec): min=26, max=480, avg=224.90, stdev=163.10 clat percentiles (msec): | 1.00th=[ 27], 5.00th=[ 27], 10.00th=[ 27], 20.00th=[ 27], | 30.00th=[ 184], 40.00th=[ 184], 50.00th=[ 215], 60.00th=[ 215], | 70.00th=[ 220], 80.00th=[ 220], 90.00th=[ 481], 95.00th=[ 481], | 99.00th=[ 481], 99.50th=[ 481], 99.90th=[ 481], 99.95th=[ 481], | 99.99th=[ 481] bw ( KiB/s): min= 1928, max= 4087, per=58.97%, avg=3007.50, stdev=1526.64, samples=2 iops : min= 1, max= 3, avg= 2.00, stdev= 1.41, samples=2 write: IOPS=1, BW=1785KiB/s (1828kB/s)(7168KiB/4015msec); 0 zone resets clat (msec): min=55, max=1311, avg=401.13, stdev=446.67 lat (msec): min=55, max=1311, avg=401.22, stdev=446.67 clat percentiles (msec): | 1.00th=[ 56], 5.00th=[ 56], 10.00th=[ 56], 20.00th=[ 59], | 30.00th=[ 88], 40.00th=[ 88], 50.00th=[ 351], 60.00th=[ 368], | 70.00th=[ 368], 80.00th=[ 575], 90.00th=[ 1318], 95.00th=[ 1318], | 99.00th=[ 1318], 99.50th=[ 1318], 99.90th=[ 1318], 99.95th=[ 1318], | 99.99th=[ 1318] bw ( KiB/s): min= 1762, max= 2048, per=27.26%, avg=1946.50, stdev=135.38, samples=4 iops : min= 1, max= 2, avg= 1.50, stdev= 0.58, samples=4 lat (msec) : 50=8.33%, 100=25.00%, 250=25.00%, 500=25.00%, 750=8.33% lat (msec) : 2000=8.33% cpu : usr=0.00%, sys=11.63%, ctx=218, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5101KiB/s (5223kB/s), 514KiB/s-1806KiB/s (526kB/s-1849kB/s), io=20.0MiB (20.0MB), run=3878-4015msec WRITE: bw=7141KiB/s (7313kB/s), 1290KiB/s-2570KiB/s (1321kB/s-2631kB/s), io=28.0MiB (29.4MB), run=3878-4015msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=180749: Sat Jul 4 01:44:44 2026 read: IOPS=1, BW=7933KiB/s (8123kB/s)(12.0MiB/1549msec) clat (msec): min=238, max=990, avg=511.65, stdev=416.17 lat (msec): min=238, max=990, avg=511.65, stdev=416.17 clat percentiles (msec): | 1.00th=[ 239], 5.00th=[ 239], 10.00th=[ 239], 20.00th=[ 239], | 30.00th=[ 239], 40.00th=[ 305], 50.00th=[ 305], 60.00th=[ 305], | 70.00th=[ 995], 80.00th=[ 995], 90.00th=[ 995], 95.00th=[ 995], | 99.00th=[ 995], 99.50th=[ 995], 99.90th=[ 995], 99.95th=[ 995], | 99.99th=[ 995] bw ( KiB/s): min= 7613, max= 8192, per=99.65%, avg=7902.50, stdev=409.41, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 250=33.33%, 500=33.33%, 1000=33.33% cpu : usr=0.00%, sys=10.85%, ctx=60, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180750: Sat Jul 4 01:44:44 2026 read: IOPS=0, BW=1983KiB/s (2030kB/s)(4096KiB/2066msec) clat (nsec): min=573960k, max=573960k, avg=573959732.00, stdev= 0.00 lat (nsec): min=573962k, max=573962k, avg=573962332.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 575], 5.00th=[ 575], 10.00th=[ 575], 20.00th=[ 575], | 30.00th=[ 575], 40.00th=[ 575], 50.00th=[ 575], 60.00th=[ 575], | 70.00th=[ 575], 80.00th=[ 575], 90.00th=[ 575], 95.00th=[ 575], | 99.00th=[ 575], 99.50th=[ 575], 99.90th=[ 575], 99.95th=[ 575], | 99.99th=[ 575] bw ( KiB/s): min= 8192, max= 8192, per=100.00%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 write: IOPS=0, BW=3965KiB/s (4060kB/s)(8192KiB/2066msec); 0 zone resets clat (msec): min=341, max=1119, avg=730.68, stdev=550.21 lat (msec): min=342, max=1120, avg=731.06, stdev=550.21 clat percentiles (msec): | 1.00th=[ 342], 5.00th=[ 342], 10.00th=[ 342], 20.00th=[ 342], | 30.00th=[ 342], 40.00th=[ 342], 50.00th=[ 342], 60.00th=[ 1116], | 70.00th=[ 1116], 80.00th=[ 1116], 90.00th=[ 1116], 95.00th=[ 1116], | 99.00th=[ 1116], 99.50th=[ 1116], 99.90th=[ 1116], 99.95th=[ 1116], | 99.99th=[ 1116] bw ( KiB/s): min= 8094, max= 8094, per=51.03%, avg=8094.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.00%, sys=7.41%, ctx=66, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180751: Sat Jul 4 01:44:44 2026 write: IOPS=1, BW=6377KiB/s (6530kB/s)(12.0MiB/1927msec); 0 zone resets clat (msec): min=153, max=862, avg=616.10, stdev=400.88 lat (msec): min=153, max=863, avg=616.51, stdev=400.97 clat percentiles (msec): | 1.00th=[ 155], 5.00th=[ 155], 10.00th=[ 155], 20.00th=[ 155], | 30.00th=[ 155], 40.00th=[ 835], 50.00th=[ 835], 60.00th=[ 835], | 70.00th=[ 860], 80.00th=[ 860], 90.00th=[ 860], 95.00th=[ 860], | 99.00th=[ 860], 99.50th=[ 860], 99.90th=[ 860], 99.95th=[ 860], | 99.99th=[ 860] bw ( KiB/s): min= 8192, max= 8192, per=51.65%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 1000=66.67% cpu : usr=0.00%, sys=10.70%, ctx=101, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180752: Sat Jul 4 01:44:44 2026 write: IOPS=1, BW=7099KiB/s (7269kB/s)(12.0MiB/1731msec); 0 zone resets clat (msec): min=174, max=1104, avg=556.34, stdev=486.97 lat (msec): min=174, max=1105, avg=556.77, stdev=486.89 clat percentiles (msec): | 1.00th=[ 176], 5.00th=[ 176], 10.00th=[ 176], 20.00th=[ 176], | 30.00th=[ 176], 40.00th=[ 388], 50.00th=[ 388], 60.00th=[ 388], | 70.00th=[ 1099], 80.00th=[ 1099], 90.00th=[ 1099], 95.00th=[ 1099], | 99.00th=[ 1099], 99.50th=[ 1099], 99.90th=[ 1099], 99.95th=[ 1099], | 99.99th=[ 1099] bw ( KiB/s): min= 7801, max= 7801, per=49.19%, avg=7801.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 500=33.33%, 2000=33.33% cpu : usr=0.00%, sys=13.58%, ctx=85, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=7930KiB/s (8121kB/s), 1983KiB/s-7933KiB/s (2030kB/s-8123kB/s), io=16.0MiB (16.8MB), run=1549-2066msec WRITE: bw=15.5MiB/s (16.2MB/s), 3965KiB/s-7099KiB/s (4060kB/s-7269kB/s), io=32.0MiB (33.6MB), run=1731-2066msec rand-rw: (groupid=0, jobs=1): err= 0: pid=180754: Sat Jul 4 01:44:45 2026 read: IOPS=2, BW=8696KiB/s (8905kB/s)(12.0MiB/1413msec) clat (msec): min=448, max=475, avg=463.42, stdev=13.62 lat (msec): min=448, max=475, avg=463.43, stdev=13.62 clat percentiles (msec): | 1.00th=[ 447], 5.00th=[ 447], 10.00th=[ 447], 20.00th=[ 447], | 30.00th=[ 447], 40.00th=[ 468], 50.00th=[ 468], 60.00th=[ 468], | 70.00th=[ 477], 80.00th=[ 477], 90.00th=[ 477], 95.00th=[ 477], | 99.00th=[ 477], 99.50th=[ 477], 99.90th=[ 477], 99.95th=[ 477], | 99.99th=[ 477] bw ( KiB/s): min= 7742, max= 8175, per=87.01%, avg=7958.50, stdev=306.18, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=100.00% cpu : usr=0.00%, sys=36.12%, ctx=1461, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180755: Sat Jul 4 01:44:45 2026 read: IOPS=0, BW=2287KiB/s (2342kB/s)(4096KiB/1791msec) clat (nsec): min=429511k, max=429511k, avg=429510769.00, stdev= 0.00 lat (nsec): min=429513k, max=429513k, avg=429513036.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 430], 5.00th=[ 430], 10.00th=[ 430], 20.00th=[ 430], | 30.00th=[ 430], 40.00th=[ 430], 50.00th=[ 430], 60.00th=[ 430], | 70.00th=[ 430], 80.00th=[ 430], 90.00th=[ 430], 95.00th=[ 430], | 99.00th=[ 430], 99.50th=[ 430], 99.90th=[ 430], 99.95th=[ 430], | 99.99th=[ 430] bw ( KiB/s): min= 5512, max= 5512, per=60.26%, avg=5512.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=1, BW=4574KiB/s (4684kB/s)(8192KiB/1791msec); 0 zone resets clat (msec): min=606, max=730, avg=668.49, stdev=87.42 lat (msec): min=607, max=730, avg=668.89, stdev=87.37 clat percentiles (msec): | 1.00th=[ 609], 5.00th=[ 609], 10.00th=[ 609], 20.00th=[ 609], | 30.00th=[ 609], 40.00th=[ 609], 50.00th=[ 609], 60.00th=[ 735], | 70.00th=[ 735], 80.00th=[ 735], 90.00th=[ 735], 95.00th=[ 735], | 99.00th=[ 735], 99.50th=[ 735], 99.90th=[ 735], 99.95th=[ 735], | 99.99th=[ 735] bw ( KiB/s): min= 8175, max= 8175, per=49.80%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 750=66.67% cpu : usr=0.00%, sys=19.33%, ctx=588, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180756: Sat Jul 4 01:44:45 2026 write: IOPS=1, BW=6156KiB/s (6304kB/s)(12.0MiB/1996msec); 0 zone resets clat (msec): min=119, max=1217, avg=652.77, stdev=550.03 lat (msec): min=119, max=1218, avg=653.08, stdev=550.12 clat percentiles (msec): | 1.00th=[ 120], 5.00th=[ 120], 10.00th=[ 120], 20.00th=[ 120], | 30.00th=[ 120], 40.00th=[ 625], 50.00th=[ 625], 60.00th=[ 625], | 70.00th=[ 1217], 80.00th=[ 1217], 90.00th=[ 1217], 95.00th=[ 1217], | 99.00th=[ 1217], 99.50th=[ 1217], 99.90th=[ 1217], 99.95th=[ 1217], | 99.99th=[ 1217] bw ( KiB/s): min= 8143, max= 8143, per=49.60%, avg=8143.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.00%, sys=7.02%, ctx=40, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180757: Sat Jul 4 01:44:45 2026 write: IOPS=2, BW=8557KiB/s (8762kB/s)(12.0MiB/1436msec); 0 zone resets clat (msec): min=296, max=588, avg=467.87, stdev=152.25 lat (msec): min=297, max=588, avg=468.38, stdev=152.19 clat percentiles (msec): | 1.00th=[ 296], 5.00th=[ 296], 10.00th=[ 296], 20.00th=[ 296], | 30.00th=[ 296], 40.00th=[ 518], 50.00th=[ 518], 60.00th=[ 518], | 70.00th=[ 592], 80.00th=[ 592], 90.00th=[ 592], 95.00th=[ 592], | 99.00th=[ 592], 99.50th=[ 592], 99.90th=[ 592], 99.95th=[ 592], | 99.99th=[ 592] bw ( KiB/s): min= 5557, max= 8175, per=41.83%, avg=6866.00, stdev=1851.21, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 750=66.67% cpu : usr=0.00%, sys=14.36%, ctx=69, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=9148KiB/s (9368kB/s), 2287KiB/s-8696KiB/s (2342kB/s-8905kB/s), io=16.0MiB (16.8MB), run=1413-1791msec WRITE: bw=16.0MiB/s (16.8MB/s), 4574KiB/s-8557KiB/s (4684kB/s-8762kB/s), io=32.0MiB (33.6MB), run=1436-1996msec