== sanity test 398b: DIO and buffer IO race ============== 06:12:48 (1765105968) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 3.58695 s, 14.0 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=149214: Sun Dec 7 06:13:54 2025 read: IOPS=27, BW=108KiB/s (111kB/s)(5992KiB/55356msec) clat (usec): min=89, max=725184, avg=18175.28, stdev=21401.53 lat (usec): min=89, max=725185, avg=18179.05, stdev=21401.62 clat percentiles (usec): | 1.00th=[ 192], 5.00th=[ 388], 10.00th=[ 7111], 20.00th=[ 9896], | 30.00th=[ 11863], 40.00th=[ 13698], 50.00th=[ 15795], 60.00th=[ 18220], | 70.00th=[ 21365], 80.00th=[ 25035], 90.00th=[ 31589], 95.00th=[ 36439], | 99.00th=[ 54264], 99.50th=[ 71828], 99.90th=[ 96994], 99.95th=[725615], | 99.99th=[725615] bw ( KiB/s): min= 5, max= 176, per=24.97%, avg=107.85, stdev=28.88, samples=109 iops : min= 1, max= 44, avg=26.50, stdev= 7.29, samples=109 write: IOPS=28, BW=114KiB/s (116kB/s)(6296KiB/55356msec); 0 zone resets clat (usec): min=916, max=125979, avg=17677.81, stdev=16312.47 lat (usec): min=917, max=125981, avg=17679.63, stdev=16312.48 clat percentiles (usec): | 1.00th=[ 1057], 5.00th=[ 1696], 10.00th=[ 2343], 20.00th=[ 3654], | 30.00th=[ 5997], 40.00th=[ 10945], 50.00th=[ 13960], 60.00th=[ 17695], | 70.00th=[ 22152], 80.00th=[ 28705], 90.00th=[ 38011], 95.00th=[ 46924], | 99.00th=[ 78119], 99.50th=[ 93848], 99.90th=[119014], 99.95th=[126354], | 99.99th=[126354] bw ( KiB/s): min= 40, max= 183, per=25.18%, avg=113.81, stdev=30.28, samples=108 iops : min= 10, max= 45, avg=28.00, stdev= 7.56, samples=108 lat (usec) : 100=0.03%, 250=0.78%, 500=2.21%, 750=0.65%, 1000=0.36% lat (msec) : 2=3.26%, 4=7.91%, 10=14.32%, 20=36.49%, 50=31.12% lat (msec) : 100=2.67%, 250=0.16%, 750=0.03% cpu : usr=0.14%, sys=21.75%, ctx=7784, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=149215: Sun Dec 7 06:13:54 2025 read: IOPS=26, BW=107KiB/s (110kB/s)(5940KiB/55270msec) clat (usec): min=82, max=92962, avg=18009.58, stdev=11289.29 lat (usec): min=82, max=92964, avg=18010.55, stdev=11289.33 clat percentiles (usec): | 1.00th=[ 157], 5.00th=[ 424], 10.00th=[ 7570], 20.00th=[ 9765], | 30.00th=[11731], 40.00th=[13698], 50.00th=[15270], 60.00th=[18220], | 70.00th=[22152], 80.00th=[26346], 90.00th=[32375], 95.00th=[37487], | 99.00th=[53740], 99.50th=[65274], 99.90th=[91751], 99.95th=[92799], | 99.99th=[92799] bw ( KiB/s): min= 5, max= 183, per=24.88%, avg=107.50, stdev=29.43, samples=109 iops : min= 1, max= 45, avg=26.41, stdev= 7.37, samples=109 write: IOPS=28, BW=115KiB/s (118kB/s)(6348KiB/55270msec); 0 zone resets clat (usec): min=851, max=710086, avg=17774.64, stdev=23735.57 lat (usec): min=852, max=710089, avg=17776.11, stdev=23735.57 clat percentiles (usec): | 1.00th=[ 1057], 5.00th=[ 1631], 10.00th=[ 2376], 20.00th=[ 3556], | 30.00th=[ 5538], 40.00th=[ 10028], 50.00th=[ 13829], 60.00th=[ 17171], | 70.00th=[ 22152], 80.00th=[ 28705], 90.00th=[ 37487], 95.00th=[ 45351], | 99.00th=[ 74974], 99.50th=[104334], 99.90th=[158335], 99.95th=[708838], | 99.99th=[708838] bw ( KiB/s): min= 55, max= 208, per=25.57%, avg=115.59, stdev=32.16, samples=108 iops : min= 13, max= 52, avg=28.44, stdev= 8.10, samples=108 lat (usec) : 100=0.03%, 250=1.07%, 500=1.73%, 750=0.49%, 1000=0.29% lat (msec) : 2=3.65%, 4=7.88%, 10=15.46%, 20=34.24%, 50=32.85% lat (msec) : 100=2.05%, 250=0.23%, 750=0.03% cpu : usr=0.14%, sys=21.33%, ctx=7817, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=149218: Sun Dec 7 06:13:54 2025 read: IOPS=27, BW=109KiB/s (111kB/s)(6028KiB/55547msec) clat (usec): min=106, max=146868, avg=18488.47, stdev=12984.56 lat (usec): min=107, max=146870, avg=18489.65, stdev=12984.53 clat percentiles (usec): | 1.00th=[ 180], 5.00th=[ 379], 10.00th=[ 6849], 20.00th=[ 9634], | 30.00th=[ 11731], 40.00th=[ 13698], 50.00th=[ 15664], 60.00th=[ 18744], | 70.00th=[ 22414], 80.00th=[ 26870], 90.00th=[ 33162], 95.00th=[ 39060], | 99.00th=[ 58983], 99.50th=[ 81265], 99.90th=[126354], 99.95th=[147850], | 99.99th=[147850] bw ( KiB/s): min= 31, max= 183, per=25.36%, avg=109.56, stdev=31.92, samples=109 iops : min= 7, max= 45, avg=26.93, stdev= 8.00, samples=109 write: IOPS=28, BW=113KiB/s (115kB/s)(6260KiB/55547msec); 0 zone resets clat (usec): min=719, max=720089, avg=17486.81, stdev=23538.93 lat (usec): min=722, max=720091, avg=17488.40, stdev=23538.95 clat percentiles (usec): | 1.00th=[ 1057], 5.00th=[ 1565], 10.00th=[ 2311], 20.00th=[ 3687], | 30.00th=[ 5735], 40.00th=[ 10421], 50.00th=[ 14222], 60.00th=[ 17695], | 70.00th=[ 21365], 80.00th=[ 27395], 90.00th=[ 36963], 95.00th=[ 43779], | 99.00th=[ 65274], 99.50th=[ 89654], 99.90th=[145753], 99.95th=[717226], | 99.99th=[717226] bw ( KiB/s): min= 10, max= 208, per=24.94%, avg=112.72, stdev=31.74, samples=110 iops : min= 2, max= 52, avg=27.72, stdev= 7.96, samples=110 lat (usec) : 250=0.88%, 500=2.31%, 750=0.55%, 1000=0.39% lat (msec) : 2=3.58%, 4=7.52%, 10=15.49%, 20=34.41%, 50=32.26% lat (msec) : 100=2.31%, 250=0.26%, 750=0.03% cpu : usr=0.14%, sys=21.35%, ctx=7804, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=149220: Sun Dec 7 06:13:54 2025 read: IOPS=27, BW=109KiB/s (112kB/s)(6052KiB/55570msec) clat (usec): min=78, max=137348, avg=18265.21, stdev=12771.04 lat (usec): min=78, max=137349, avg=18266.44, stdev=12771.05 clat percentiles (usec): | 1.00th=[ 151], 5.00th=[ 400], 10.00th=[ 6849], 20.00th=[ 9765], | 30.00th=[ 11863], 40.00th=[ 13829], 50.00th=[ 15926], 60.00th=[ 18744], | 70.00th=[ 22152], 80.00th=[ 25822], 90.00th=[ 31851], 95.00th=[ 37487], | 99.00th=[ 59507], 99.50th=[ 81265], 99.90th=[133694], 99.95th=[137364], | 99.99th=[137364] bw ( KiB/s): min= 23, max= 175, per=25.40%, avg=109.71, stdev=29.04, samples=109 iops : min= 5, max= 43, avg=26.96, stdev= 7.32, samples=109 write: IOPS=28, BW=112KiB/s (115kB/s)(6236KiB/55570msec); 0 zone resets clat (usec): min=801, max=787246, avg=17719.77, stdev=24877.12 lat (usec): min=801, max=787249, avg=17722.06, stdev=24878.00 clat percentiles (usec): | 1.00th=[ 1090], 5.00th=[ 1795], 10.00th=[ 2474], 20.00th=[ 3589], | 30.00th=[ 5407], 40.00th=[ 9896], 50.00th=[ 13960], 60.00th=[ 17433], | 70.00th=[ 22414], 80.00th=[ 27919], 90.00th=[ 38536], 95.00th=[ 46400], | 99.00th=[ 67634], 99.50th=[ 80217], 99.90th=[147850], 99.95th=[784335], | 99.99th=[784335] bw ( KiB/s): min= 31, max= 200, per=25.00%, avg=112.99, stdev=28.93, samples=109 iops : min= 7, max= 50, avg=27.79, stdev= 7.27, samples=109 lat (usec) : 100=0.07%, 250=1.20%, 500=1.76%, 750=0.62%, 1000=0.36% lat (msec) : 2=2.99%, 4=8.46%, 10=15.33%, 20=34.24%, 50=32.26% lat (msec) : 100=2.44%, 250=0.23%, 1000=0.03% cpu : usr=0.13%, sys=21.17%, ctx=7882, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=432KiB/s (442kB/s), 107KiB/s-109KiB/s (110kB/s-112kB/s), io=23.4MiB (24.6MB), run=55270-55570msec WRITE: bw=452KiB/s (463kB/s), 112KiB/s-115KiB/s (115kB/s-118kB/s), io=24.6MiB (25.7MB), run=55270-55570msec rand-rw: (groupid=0, jobs=1): err= 0: pid=149213: Sun Dec 7 06:14:45 2025 read: IOPS=14, BW=56.2KiB/s (57.6kB/s)(5992KiB/106590msec) clat (msec): min=3, max=731, avg=18.43, stdev=23.41 lat (msec): min=3, max=731, avg=18.43, stdev=23.41 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 6], 10.00th=[ 6], 20.00th=[ 7], | 30.00th=[ 9], 40.00th=[ 11], 50.00th=[ 15], 60.00th=[ 19], | 70.00th=[ 22], 80.00th=[ 26], 90.00th=[ 34], 95.00th=[ 45], | 99.00th=[ 74], 99.50th=[ 82], 99.90th=[ 157], 99.95th=[ 735], | 99.99th=[ 735] bw ( KiB/s): min= 7, max= 160, per=25.23%, avg=56.52, stdev=31.87, samples=210 iops : min= 1, max= 40, avg=13.72, stdev= 8.00, samples=210 write: IOPS=14, BW=59.1KiB/s (60.5kB/s)(6296KiB/106590msec); 0 zone resets clat (msec): min=16, max=228, avg=49.99, stdev=24.81 lat (msec): min=16, max=228, avg=49.99, stdev=24.81 clat percentiles (msec): | 1.00th=[ 21], 5.00th=[ 25], 10.00th=[ 28], 20.00th=[ 32], | 30.00th=[ 35], 40.00th=[ 40], 50.00th=[ 44], 60.00th=[ 49], | 70.00th=[ 56], 80.00th=[ 66], 90.00th=[ 81], 95.00th=[ 96], | 99.00th=[ 132], 99.50th=[ 167], 99.90th=[ 226], 99.95th=[ 230], | 99.99th=[ 230] bw ( KiB/s): min= 15, max= 136, per=25.23%, avg=59.05, stdev=24.69, samples=211 iops : min= 3, max= 34, avg=14.35, stdev= 6.26, samples=211 lat (msec) : 4=0.23%, 10=17.87%, 20=14.39%, 50=46.00%, 100=19.27% lat (msec) : 250=2.21%, 750=0.03% cpu : usr=0.09%, sys=5.46%, ctx=6031, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=149216: Sun Dec 7 06:14:45 2025 read: IOPS=13, BW=55.5KiB/s (56.8kB/s)(5940KiB/107072msec) clat (msec): min=3, max=726, avg=17.50, stdev=22.33 lat (msec): min=3, max=726, avg=17.50, stdev=22.33 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 5], 10.00th=[ 6], 20.00th=[ 7], | 30.00th=[ 9], 40.00th=[ 11], 50.00th=[ 15], 60.00th=[ 18], | 70.00th=[ 21], 80.00th=[ 25], 90.00th=[ 32], 95.00th=[ 41], | 99.00th=[ 64], 99.50th=[ 75], 99.90th=[ 133], 99.95th=[ 726], | 99.99th=[ 726] bw ( KiB/s): min= 7, max= 168, per=24.77%, avg=55.49, stdev=32.32, samples=212 iops : min= 1, max= 42, avg=13.46, stdev= 8.14, samples=212 write: IOPS=14, BW=59.3KiB/s (60.7kB/s)(6348KiB/107072msec); 0 zone resets clat (msec): min=16, max=232, avg=50.90, stdev=24.32 lat (msec): min=16, max=232, avg=50.90, stdev=24.32 clat percentiles (msec): | 1.00th=[ 21], 5.00th=[ 26], 10.00th=[ 28], 20.00th=[ 32], | 30.00th=[ 36], 40.00th=[ 40], 50.00th=[ 45], 60.00th=[ 51], | 70.00th=[ 59], 80.00th=[ 68], 90.00th=[ 83], 95.00th=[ 95], | 99.00th=[ 125], 99.50th=[ 153], 99.90th=[ 232], 99.95th=[ 232], | 99.99th=[ 232] bw ( KiB/s): min= 23, max= 128, per=25.34%, avg=59.30, stdev=23.87, samples=212 iops : min= 5, max= 32, avg=14.41, stdev= 6.04, samples=212 lat (msec) : 4=0.39%, 10=17.42%, 20=15.49%, 50=44.69%, 100=20.12% lat (msec) : 250=1.86%, 750=0.03% cpu : usr=0.09%, sys=5.43%, ctx=5970, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=149217: Sun Dec 7 06:14:45 2025 read: IOPS=14, BW=56.6KiB/s (57.9kB/s)(6028KiB/106562msec) clat (msec): min=3, max=207, avg=17.74, stdev=14.77 lat (msec): min=3, max=207, avg=17.74, stdev=14.77 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 6], 10.00th=[ 6], 20.00th=[ 8], | 30.00th=[ 9], 40.00th=[ 12], 50.00th=[ 15], 60.00th=[ 18], | 70.00th=[ 21], 80.00th=[ 25], 90.00th=[ 33], 95.00th=[ 44], | 99.00th=[ 71], 99.50th=[ 88], 99.90th=[ 142], 99.95th=[ 207], | 99.99th=[ 207] bw ( KiB/s): min= 7, max= 160, per=25.26%, avg=56.59, stdev=29.48, samples=211 iops : min= 1, max= 40, avg=13.73, stdev= 7.43, samples=211 write: IOPS=14, BW=58.7KiB/s (60.2kB/s)(6260KiB/106562msec); 0 zone resets clat (msec): min=15, max=751, avg=50.81, stdev=29.59 lat (msec): min=15, max=751, avg=50.82, stdev=29.59 clat percentiles (msec): | 1.00th=[ 21], 5.00th=[ 26], 10.00th=[ 28], 20.00th=[ 33], | 30.00th=[ 36], 40.00th=[ 40], 50.00th=[ 44], 60.00th=[ 50], | 70.00th=[ 56], 80.00th=[ 67], 90.00th=[ 81], 95.00th=[ 96], | 99.00th=[ 136], 99.50th=[ 163], 99.90th=[ 213], 99.95th=[ 751], | 99.99th=[ 751] bw ( KiB/s): min= 16, max= 136, per=25.11%, avg=58.75, stdev=24.23, samples=211 iops : min= 4, max= 34, avg=14.27, stdev= 6.14, samples=211 lat (msec) : 4=0.13%, 10=17.42%, 20=16.47%, 50=44.47%, 100=19.27% lat (msec) : 250=2.21%, 1000=0.03% cpu : usr=0.09%, sys=5.44%, ctx=5917, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=149219: Sun Dec 7 06:14:45 2025 read: IOPS=14, BW=57.2KiB/s (58.5kB/s)(6052KiB/105862msec) clat (msec): min=3, max=153, avg=17.41, stdev=14.36 lat (msec): min=3, max=153, avg=17.42, stdev=14.36 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 6], 10.00th=[ 6], 20.00th=[ 7], | 30.00th=[ 9], 40.00th=[ 11], 50.00th=[ 14], 60.00th=[ 17], | 70.00th=[ 21], 80.00th=[ 26], 90.00th=[ 33], 95.00th=[ 44], | 99.00th=[ 74], 99.50th=[ 91], 99.90th=[ 142], 99.95th=[ 155], | 99.99th=[ 155] bw ( KiB/s): min= 7, max= 152, per=25.64%, avg=57.44, stdev=31.24, samples=208 iops : min= 1, max= 38, avg=13.95, stdev= 7.89, samples=208 write: IOPS=14, BW=58.9KiB/s (60.3kB/s)(6236KiB/105862msec); 0 zone resets clat (msec): min=15, max=781, avg=50.81, stdev=30.29 lat (msec): min=15, max=781, avg=50.81, stdev=30.29 clat percentiles (msec): | 1.00th=[ 21], 5.00th=[ 26], 10.00th=[ 28], 20.00th=[ 32], | 30.00th=[ 36], 40.00th=[ 40], 50.00th=[ 44], 60.00th=[ 50], | 70.00th=[ 57], 80.00th=[ 67], 90.00th=[ 81], 95.00th=[ 95], | 99.00th=[ 132], 99.50th=[ 163], 99.90th=[ 234], 99.95th=[ 785], | 99.99th=[ 785] bw ( KiB/s): min= 23, max= 144, per=25.15%, avg=58.85, stdev=23.92, samples=209 iops : min= 5, max= 36, avg=14.30, stdev= 6.06, samples=209 lat (msec) : 4=0.36%, 10=18.98%, 20=14.68%, 50=44.92%, 100=18.85% lat (msec) : 250=2.18%, 1000=0.03% cpu : usr=0.10%, sys=5.41%, ctx=5985, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=224KiB/s (230kB/s), 55.5KiB/s-57.2KiB/s (56.8kB/s-58.5kB/s), io=23.4MiB (24.6MB), run=105862-107072msec WRITE: bw=235KiB/s (240kB/s), 58.7KiB/s-59.3KiB/s (60.2kB/s-60.7kB/s), io=24.6MiB (25.7MB), run=105862-107072msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=149252: Sun Dec 7 06:15:06 2025 read: IOPS=26, BW=431KiB/s (441kB/s)(5920KiB/13749msec) clat (usec): min=128, max=107368, avg=18793.85, stdev=14404.38 lat (usec): min=128, max=107369, avg=18794.86, stdev=14404.43 clat percentiles (usec): | 1.00th=[ 141], 5.00th=[ 302], 10.00th=[ 396], 20.00th=[ 8291], | 30.00th=[ 11994], 40.00th=[ 14746], 50.00th=[ 17695], 60.00th=[ 20579], | 70.00th=[ 23987], 80.00th=[ 27395], 90.00th=[ 34866], 95.00th=[ 44303], | 99.00th=[ 65799], 99.50th=[ 79168], 99.90th=[107480], 99.95th=[107480], | 99.99th=[107480] bw ( KiB/s): min= 254, max= 734, per=25.61%, avg=431.70, stdev=102.54, samples=27 iops : min= 15, max= 45, avg=26.33, stdev= 6.44, samples=27 write: IOPS=28, BW=463KiB/s (474kB/s)(6368KiB/13749msec); 0 zone resets clat (usec): min=1394, max=151854, avg=16758.75, stdev=14741.23 lat (usec): min=1394, max=151858, avg=16760.54, stdev=14741.31 clat percentiles (usec): | 1.00th=[ 1745], 5.00th=[ 2769], 10.00th=[ 3687], 20.00th=[ 5145], | 30.00th=[ 6849], 40.00th=[ 9503], 50.00th=[ 13304], 60.00th=[ 16581], | 70.00th=[ 20579], 80.00th=[ 26084], 90.00th=[ 36439], 95.00th=[ 43779], | 99.00th=[ 56886], 99.50th=[ 87557], 99.90th=[152044], 99.95th=[152044], | 99.99th=[152044] bw ( KiB/s): min= 64, max= 666, per=26.26%, avg=465.81, stdev=135.12, samples=27 iops : min= 4, max= 41, avg=28.52, stdev= 8.35, samples=27 lat (usec) : 250=1.82%, 500=4.04%, 750=2.08%, 1000=0.65% lat (msec) : 2=1.69%, 4=5.34%, 10=17.19%, 20=30.86%, 50=33.72% lat (msec) : 100=2.34%, 250=0.26% cpu : usr=0.08%, sys=26.16%, ctx=2061, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=149253: Sun Dec 7 06:15:06 2025 read: IOPS=25, BW=404KiB/s (414kB/s)(5744KiB/14202msec) clat (usec): min=125, max=102957, avg=19856.66, stdev=13984.92 lat (usec): min=125, max=102958, avg=19857.67, stdev=13984.97 clat percentiles (usec): | 1.00th=[ 137], 5.00th=[ 314], 10.00th=[ 529], 20.00th=[ 10683], | 30.00th=[ 13698], 40.00th=[ 16188], 50.00th=[ 18482], 60.00th=[ 20841], | 70.00th=[ 23987], 80.00th=[ 29492], 90.00th=[ 34866], 95.00th=[ 40633], | 99.00th=[ 74974], 99.50th=[ 80217], 99.90th=[103285], 99.95th=[103285], | 99.99th=[103285] bw ( KiB/s): min= 223, max= 734, per=23.96%, avg=403.93, stdev=107.87, samples=28 iops : min= 13, max= 45, avg=24.61, stdev= 6.73, samples=28 write: IOPS=28, BW=461KiB/s (472kB/s)(6544KiB/14202msec); 0 zone resets clat (usec): min=879, max=129124, avg=17202.01, stdev=16476.11 lat (usec): min=880, max=129127, avg=17204.04, stdev=16475.99 clat percentiles (usec): | 1.00th=[ 1418], 5.00th=[ 2343], 10.00th=[ 3294], 20.00th=[ 4621], | 30.00th=[ 6063], 40.00th=[ 8717], 50.00th=[ 12649], 60.00th=[ 16319], | 70.00th=[ 20841], 80.00th=[ 27395], 90.00th=[ 37487], 95.00th=[ 47973], | 99.00th=[ 72877], 99.50th=[ 95945], 99.90th=[129500], 99.95th=[129500], | 99.99th=[129500] bw ( KiB/s): min= 286, max= 701, per=25.88%, avg=459.07, stdev=101.82, samples=28 iops : min= 17, max= 43, avg=28.07, stdev= 6.39, samples=28 lat (usec) : 250=1.43%, 500=2.86%, 750=1.82%, 1000=0.39% lat (msec) : 2=1.82%, 4=5.60%, 10=17.06%, 20=32.42%, 50=33.59% lat (msec) : 100=2.60%, 250=0.39% cpu : usr=0.15%, sys=25.55%, ctx=2034, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=149254: Sun Dec 7 06:15:06 2025 read: IOPS=27, BW=442KiB/s (453kB/s)(6256KiB/14154msec) clat (usec): min=118, max=99343, avg=18996.17, stdev=14207.31 lat (usec): min=118, max=99344, avg=18997.51, stdev=14207.37 clat percentiles (usec): | 1.00th=[ 141], 5.00th=[ 306], 10.00th=[ 404], 20.00th=[ 5866], | 30.00th=[12256], 40.00th=[15008], 50.00th=[17433], 60.00th=[20841], | 70.00th=[25035], 80.00th=[29754], 90.00th=[35390], 95.00th=[41681], | 99.00th=[72877], 99.50th=[84411], 99.90th=[99091], 99.95th=[99091], | 99.99th=[99091] bw ( KiB/s): min= 158, max= 761, per=26.56%, avg=447.78, stdev=140.83, samples=27 iops : min= 9, max= 47, avg=27.37, stdev= 8.82, samples=27 write: IOPS=26, BW=426KiB/s (436kB/s)(6032KiB/14154msec); 0 zone resets clat (usec): min=1453, max=129980, avg=17633.46, stdev=15713.41 lat (usec): min=1454, max=129984, avg=17635.41, stdev=15713.57 clat percentiles (usec): | 1.00th=[ 1713], 5.00th=[ 2311], 10.00th=[ 3458], 20.00th=[ 4948], | 30.00th=[ 6390], 40.00th=[ 9372], 50.00th=[ 12911], 60.00th=[ 17695], | 70.00th=[ 22152], 80.00th=[ 28443], 90.00th=[ 39060], 95.00th=[ 46400], | 99.00th=[ 67634], 99.50th=[ 78119], 99.90th=[129500], 99.95th=[129500], | 99.99th=[129500] bw ( KiB/s): min= 223, max= 694, per=23.84%, avg=423.00, stdev=102.25, samples=27 iops : min= 13, max= 43, avg=25.81, stdev= 6.40, samples=27 lat (usec) : 250=1.82%, 500=5.47%, 750=1.82%, 1000=0.52% lat (msec) : 2=1.69%, 4=4.82%, 10=15.76%, 20=29.56%, 50=35.94% lat (msec) : 100=2.47%, 250=0.13% cpu : usr=0.12%, sys=25.44%, ctx=2034, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=149255: Sun Dec 7 06:15:06 2025 read: IOPS=26, BW=429KiB/s (440kB/s)(6032KiB/14047msec) clat (usec): min=110, max=145398, avg=19038.81, stdev=15422.33 lat (usec): min=111, max=145399, avg=19040.65, stdev=15426.80 clat percentiles (usec): | 1.00th=[ 149], 5.00th=[ 297], 10.00th=[ 429], 20.00th=[ 7963], | 30.00th=[ 12387], 40.00th=[ 15270], 50.00th=[ 17957], 60.00th=[ 20579], | 70.00th=[ 23462], 80.00th=[ 28443], 90.00th=[ 35390], 95.00th=[ 42730], | 99.00th=[ 70779], 99.50th=[100140], 99.90th=[145753], 99.95th=[145753], | 99.99th=[145753] bw ( KiB/s): min= 256, max= 606, per=25.62%, avg=432.00, stdev=85.07, samples=27 iops : min= 16, max= 37, avg=26.37, stdev= 5.22, samples=27 write: IOPS=27, BW=445KiB/s (456kB/s)(6256KiB/14047msec); 0 zone resets clat (usec): min=1494, max=86995, avg=17396.43, stdev=15453.14 lat (usec): min=1495, max=86997, avg=17398.34, stdev=15453.15 clat percentiles (usec): | 1.00th=[ 1811], 5.00th=[ 2835], 10.00th=[ 3458], 20.00th=[ 4752], | 30.00th=[ 6652], 40.00th=[ 9110], 50.00th=[12649], 60.00th=[16450], | 70.00th=[21627], 80.00th=[27919], 90.00th=[37487], 95.00th=[47449], | 99.00th=[81265], 99.50th=[85459], 99.90th=[86508], 99.95th=[86508], | 99.99th=[86508] bw ( KiB/s): min= 223, max= 638, per=25.18%, avg=446.63, stdev=99.93, samples=27 iops : min= 13, max= 39, avg=27.30, stdev= 6.29, samples=27 lat (usec) : 250=1.43%, 500=4.17%, 750=2.34%, 1000=0.52% lat (msec) : 2=1.69%, 4=5.73%, 10=16.80%, 20=29.30%, 50=35.03% lat (msec) : 100=2.86%, 250=0.13% cpu : usr=0.13%, sys=25.40%, ctx=1969, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1687KiB/s (1727kB/s), 404KiB/s-442KiB/s (414kB/s-453kB/s), io=23.4MiB (24.5MB), run=13749-14202msec WRITE: bw=1774KiB/s (1817kB/s), 426KiB/s-463KiB/s (436kB/s-474kB/s), io=24.6MiB (25.8MB), run=13749-14202msec rand-rw: (groupid=0, jobs=1): err= 0: pid=149257: Sun Dec 7 06:15:22 2025 read: IOPS=12, BW=194KiB/s (198kB/s)(5920KiB/30575msec) clat (msec): min=4, max=141, avg=22.48, stdev=19.62 lat (msec): min=4, max=141, avg=22.48, stdev=19.62 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 7], 10.00th=[ 8], 20.00th=[ 9], | 30.00th=[ 10], 40.00th=[ 13], 50.00th=[ 17], 60.00th=[ 22], | 70.00th=[ 26], 80.00th=[ 32], 90.00th=[ 46], 95.00th=[ 63], | 99.00th=[ 104], 99.50th=[ 121], 99.90th=[ 142], 99.95th=[ 142], | 99.99th=[ 142] bw ( KiB/s): min= 31, max= 384, per=24.13%, avg=188.90, stdev=85.52, samples=60 iops : min= 1, max= 24, avg=11.25, stdev= 5.37, samples=60 write: IOPS=13, BW=208KiB/s (213kB/s)(6368KiB/30575msec); 0 zone resets clat (msec): min=18, max=260, avg=55.75, stdev=26.51 lat (msec): min=18, max=260, avg=55.75, stdev=26.51 clat percentiles (msec): | 1.00th=[ 23], 5.00th=[ 30], 10.00th=[ 33], 20.00th=[ 37], | 30.00th=[ 42], 40.00th=[ 46], 50.00th=[ 50], 60.00th=[ 55], | 70.00th=[ 61], 80.00th=[ 68], 90.00th=[ 87], 95.00th=[ 106], | 99.00th=[ 169], 99.50th=[ 178], 99.90th=[ 262], 99.95th=[ 262], | 99.99th=[ 262] bw ( KiB/s): min= 62, max= 351, per=24.89%, avg=205.08, stdev=85.54, samples=60 iops : min= 3, max= 21, avg=12.27, stdev= 5.35, samples=60 lat (msec) : 10=15.49%, 20=12.11%, 50=43.23%, 100=25.13%, 250=3.91% lat (msec) : 500=0.13% cpu : usr=0.12%, sys=5.60%, ctx=1690, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=149258: Sun Dec 7 06:15:22 2025 read: IOPS=11, BW=189KiB/s (194kB/s)(5744KiB/30363msec) clat (msec): min=4, max=123, avg=21.05, stdev=16.53 lat (msec): min=4, max=123, avg=21.05, stdev=16.53 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 7], 10.00th=[ 7], 20.00th=[ 9], | 30.00th=[ 11], 40.00th=[ 13], 50.00th=[ 17], 60.00th=[ 21], | 70.00th=[ 25], 80.00th=[ 30], 90.00th=[ 42], 95.00th=[ 51], | 99.00th=[ 86], 99.50th=[ 110], 99.90th=[ 124], 99.95th=[ 124], | 99.99th=[ 124] bw ( KiB/s): min= 31, max= 542, per=24.46%, avg=191.49, stdev=104.24, samples=59 iops : min= 1, max= 33, avg=11.42, stdev= 6.56, samples=59 write: IOPS=13, BW=216KiB/s (221kB/s)(6544KiB/30363msec); 0 zone resets clat (msec): min=21, max=192, avg=55.39, stdev=23.15 lat (msec): min=21, max=192, avg=55.39, stdev=23.15 clat percentiles (msec): | 1.00th=[ 27], 5.00th=[ 30], 10.00th=[ 33], 20.00th=[ 37], | 30.00th=[ 42], 40.00th=[ 47], 50.00th=[ 51], 60.00th=[ 55], | 70.00th=[ 63], 80.00th=[ 69], 90.00th=[ 83], 95.00th=[ 96], | 99.00th=[ 146], 99.50th=[ 159], 99.90th=[ 192], 99.95th=[ 192], | 99.99th=[ 192] bw ( KiB/s): min= 95, max= 415, per=26.03%, avg=214.47, stdev=77.50, samples=60 iops : min= 5, max= 25, avg=12.85, stdev= 4.85, samples=60 lat (msec) : 10=13.15%, 20=14.19%, 50=43.36%, 100=26.69%, 250=2.60% cpu : usr=0.08%, sys=5.66%, ctx=1647, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=149259: Sun Dec 7 06:15:22 2025 read: IOPS=13, BW=211KiB/s (216kB/s)(6256KiB/29637msec) clat (msec): min=4, max=124, avg=20.42, stdev=17.18 lat (msec): min=4, max=124, avg=20.42, stdev=17.18 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 6], 10.00th=[ 7], 20.00th=[ 9], | 30.00th=[ 11], 40.00th=[ 12], 50.00th=[ 16], 60.00th=[ 19], | 70.00th=[ 24], 80.00th=[ 29], 90.00th=[ 38], 95.00th=[ 55], | 99.00th=[ 91], 99.50th=[ 105], 99.90th=[ 125], 99.95th=[ 125], | 99.99th=[ 125] bw ( KiB/s): min= 32, max= 509, per=27.22%, avg=213.12, stdev=104.51, samples=58 iops : min= 2, max= 31, avg=12.76, stdev= 6.52, samples=58 write: IOPS=12, BW=204KiB/s (208kB/s)(6032KiB/29637msec); 0 zone resets clat (msec): min=23, max=181, avg=57.06, stdev=21.85 lat (msec): min=23, max=181, avg=57.07, stdev=21.85 clat percentiles (msec): | 1.00th=[ 27], 5.00th=[ 31], 10.00th=[ 35], 20.00th=[ 39], | 30.00th=[ 44], 40.00th=[ 48], 50.00th=[ 53], 60.00th=[ 59], | 70.00th=[ 65], 80.00th=[ 73], 90.00th=[ 84], 95.00th=[ 96], | 99.00th=[ 128], 99.50th=[ 169], 99.90th=[ 182], 99.95th=[ 182], | 99.99th=[ 182] bw ( KiB/s): min= 63, max= 320, per=24.45%, avg=201.47, stdev=68.97, samples=58 iops : min= 3, max= 20, avg=12.03, stdev= 4.34, samples=58 lat (msec) : 10=15.23%, 20=17.84%, 50=36.85%, 100=27.99%, 250=2.08% cpu : usr=0.11%, sys=5.86%, ctx=1632, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=149260: Sun Dec 7 06:15:22 2025 read: IOPS=12, BW=199KiB/s (203kB/s)(6032KiB/30363msec) clat (msec): min=4, max=145, avg=20.90, stdev=17.35 lat (msec): min=4, max=145, avg=20.91, stdev=17.35 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 7], 10.00th=[ 8], 20.00th=[ 9], | 30.00th=[ 10], 40.00th=[ 12], 50.00th=[ 16], 60.00th=[ 19], | 70.00th=[ 24], 80.00th=[ 31], 90.00th=[ 43], 95.00th=[ 56], | 99.00th=[ 89], 99.50th=[ 121], 99.90th=[ 146], 99.95th=[ 146], | 99.99th=[ 146] bw ( KiB/s): min= 31, max= 446, per=25.09%, avg=196.43, stdev=103.48, samples=60 iops : min= 1, max= 27, avg=11.73, stdev= 6.47, samples=60 write: IOPS=12, BW=206KiB/s (211kB/s)(6256KiB/30363msec); 0 zone resets clat (msec): min=21, max=263, avg=57.14, stdev=25.61 lat (msec): min=21, max=263, avg=57.14, stdev=25.61 clat percentiles (msec): | 1.00th=[ 27], 5.00th=[ 31], 10.00th=[ 34], 20.00th=[ 39], | 30.00th=[ 43], 40.00th=[ 46], 50.00th=[ 51], 60.00th=[ 57], | 70.00th=[ 65], 80.00th=[ 72], 90.00th=[ 86], 95.00th=[ 97], | 99.00th=[ 150], 99.50th=[ 186], 99.90th=[ 264], 99.95th=[ 264], | 99.99th=[ 264] bw ( KiB/s): min= 63, max= 352, per=24.93%, avg=205.40, stdev=70.18, samples=60 iops : min= 3, max= 22, avg=12.28, stdev= 4.44, samples=60 lat (msec) : 10=16.15%, 20=14.71%, 50=39.58%, 100=26.95%, 250=2.47% lat (msec) : 500=0.13% cpu : usr=0.10%, sys=5.92%, ctx=1687, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=783KiB/s (802kB/s), 189KiB/s-211KiB/s (194kB/s-216kB/s), io=23.4MiB (24.5MB), run=29637-30575msec WRITE: bw=824KiB/s (844kB/s), 204KiB/s-216KiB/s (208kB/s-221kB/s), io=24.6MiB (25.8MB), run=29637-30575msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=149270: Sun Dec 7 06:15:31 2025 read: IOPS=3, BW=3275KiB/s (3353kB/s)(7168KiB/2189msec) clat (msec): min=5, max=182, avg=127.37, stdev=62.03 lat (msec): min=5, max=182, avg=127.37, stdev=62.03 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 6], 10.00th=[ 6], 20.00th=[ 99], | 30.00th=[ 129], 40.00th=[ 129], 50.00th=[ 131], 60.00th=[ 171], | 70.00th=[ 171], 80.00th=[ 176], 90.00th=[ 184], 95.00th=[ 184], | 99.00th=[ 184], 99.50th=[ 184], 99.90th=[ 184], 99.95th=[ 184], | 99.99th=[ 184] bw ( KiB/s): min= 2039, max= 5215, per=59.83%, avg=3713.33, stdev=1595.02, samples=3 iops : min= 1, max= 5, avg= 3.00, stdev= 2.00, samples=3 write: IOPS=2, BW=2339KiB/s (2395kB/s)(5120KiB/2189msec); 0 zone resets clat (msec): min=157, max=379, avg=249.38, stdev=92.98 lat (msec): min=157, max=379, avg=249.46, stdev=92.99 clat percentiles (msec): | 1.00th=[ 159], 5.00th=[ 159], 10.00th=[ 159], 20.00th=[ 159], | 30.00th=[ 169], 40.00th=[ 169], 50.00th=[ 239], 60.00th=[ 239], | 70.00th=[ 305], 80.00th=[ 305], 90.00th=[ 380], 95.00th=[ 380], | 99.00th=[ 380], 99.50th=[ 380], 99.90th=[ 380], 99.95th=[ 380], | 99.99th=[ 380] bw ( KiB/s): min= 1943, max= 4079, per=30.61%, avg=2659.67, stdev=1229.20, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (msec) : 10=8.33%, 100=8.33%, 250=66.67%, 500=16.67% cpu : usr=0.05%, sys=48.54%, ctx=684, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=149271: Sun Dec 7 06:15:31 2025 read: IOPS=0, BW=621KiB/s (636kB/s)(2048KiB/3300msec) clat (msec): min=104, max=112, avg=108.66, stdev= 6.11 lat (msec): min=104, max=112, avg=108.66, stdev= 6.11 clat percentiles (msec): | 1.00th=[ 105], 5.00th=[ 105], 10.00th=[ 105], 20.00th=[ 105], | 30.00th=[ 105], 40.00th=[ 105], 50.00th=[ 105], 60.00th=[ 113], | 70.00th=[ 113], 80.00th=[ 113], 90.00th=[ 113], 95.00th=[ 113], | 99.00th=[ 113], 99.50th=[ 113], 99.90th=[ 113], 99.95th=[ 113], | 99.99th=[ 113] bw ( KiB/s): min= 1741, max= 2039, per=30.45%, avg=1890.00, stdev=210.72, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=3, BW=3103KiB/s (3178kB/s)(10.0MiB/3300msec); 0 zone resets clat (msec): min=118, max=568, avg=306.82, stdev=160.28 lat (msec): min=118, max=568, avg=306.91, stdev=160.26 clat percentiles (msec): | 1.00th=[ 120], 5.00th=[ 120], 10.00th=[ 120], 20.00th=[ 132], | 30.00th=[ 192], 40.00th=[ 218], 50.00th=[ 241], 60.00th=[ 317], | 70.00th=[ 347], 80.00th=[ 372], 90.00th=[ 558], 95.00th=[ 567], | 99.00th=[ 567], 99.50th=[ 567], 99.90th=[ 567], 99.95th=[ 567], | 99.99th=[ 567] bw ( KiB/s): min= 1957, max= 5829, per=41.25%, avg=3583.80, stdev=1620.66, samples=5 iops : min= 1, max= 5, avg= 2.60, stdev= 1.67, samples=5 lat (msec) : 250=58.33%, 500=25.00%, 750=16.67% cpu : usr=0.03%, sys=40.25%, ctx=305, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=149272: Sun Dec 7 06:15:31 2025 read: IOPS=2, BW=2843KiB/s (2911kB/s)(6144KiB/2161msec) clat (usec): min=859, max=262715, avg=88678.10, stdev=110661.35 lat (usec): min=861, max=262715, avg=88679.33, stdev=110661.08 clat percentiles (usec): | 1.00th=[ 857], 5.00th=[ 857], 10.00th=[ 857], 20.00th=[ 906], | 30.00th=[ 906], 40.00th=[ 2671], 50.00th=[ 2671], 60.00th=[ 86508], | 70.00th=[179307], 80.00th=[179307], 90.00th=[263193], 95.00th=[263193], | 99.00th=[263193], 99.50th=[263193], 99.90th=[263193], 99.95th=[263193], | 99.99th=[263193] bw ( KiB/s): min= 2039, max= 3915, per=52.85%, avg=3280.00, stdev=1074.84, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 write: IOPS=2, BW=2843KiB/s (2911kB/s)(6144KiB/2161msec); 0 zone resets clat (msec): min=190, max=424, avg=263.93, stdev=90.29 lat (msec): min=190, max=424, avg=264.00, stdev=90.28 clat percentiles (msec): | 1.00th=[ 190], 5.00th=[ 190], 10.00th=[ 190], 20.00th=[ 201], | 30.00th=[ 201], 40.00th=[ 207], 50.00th=[ 207], 60.00th=[ 253], | 70.00th=[ 309], 80.00th=[ 309], 90.00th=[ 426], 95.00th=[ 426], | 99.00th=[ 426], 99.50th=[ 426], 99.90th=[ 426], 99.95th=[ 426], | 99.99th=[ 426] bw ( KiB/s): min= 1943, max= 3471, per=27.08%, avg=2352.50, stdev=746.87, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (usec) : 1000=16.67% lat (msec) : 4=8.33%, 100=8.33%, 250=33.33%, 500=33.33% cpu : usr=0.00%, sys=43.24%, ctx=492, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=149273: Sun Dec 7 06:15:31 2025 read: IOPS=1, BW=1769KiB/s (1812kB/s)(5120KiB/2894msec) clat (usec): min=768, max=284278, avg=159342.18, stdev=101428.37 lat (usec): min=769, max=284279, avg=159343.19, stdev=101428.28 clat percentiles (usec): | 1.00th=[ 766], 5.00th=[ 766], 10.00th=[ 766], 20.00th=[ 766], | 30.00th=[166724], 40.00th=[166724], 50.00th=[170918], 60.00th=[170918], | 70.00th=[173016], 80.00th=[173016], 90.00th=[283116], 95.00th=[283116], | 99.00th=[283116], 99.50th=[283116], 99.90th=[283116], 99.95th=[283116], | 99.99th=[283116] bw ( KiB/s): min= 8159, max= 8159, per=100.00%, avg=8159.00, stdev= 0.00, samples=1 iops : min= 7, max= 7, avg= 7.00, stdev= 0.00, samples=1 write: IOPS=2, BW=2477KiB/s (2536kB/s)(7168KiB/2894msec); 0 zone resets clat (msec): min=158, max=466, avg=294.26, stdev=107.69 lat (msec): min=158, max=466, avg=294.35, stdev=107.69 clat percentiles (msec): | 1.00th=[ 159], 5.00th=[ 159], 10.00th=[ 159], 20.00th=[ 192], | 30.00th=[ 245], 40.00th=[ 245], 50.00th=[ 284], 60.00th=[ 351], | 70.00th=[ 351], 80.00th=[ 368], 90.00th=[ 468], 95.00th=[ 468], | 99.00th=[ 468], 99.50th=[ 468], 99.90th=[ 468], 99.95th=[ 468], | 99.99th=[ 468] bw ( KiB/s): min= 1738, max= 4007, per=33.39%, avg=2900.75, stdev=1227.70, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 1.15, samples=4 lat (usec) : 1000=8.33% lat (msec) : 250=50.00%, 500=41.67% cpu : usr=0.00%, sys=39.61%, ctx=218, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=6206KiB/s (6355kB/s), 621KiB/s-3275KiB/s (636kB/s-3353kB/s), io=20.0MiB (20.0MB), run=2161-3300msec WRITE: bw=8688KiB/s (8897kB/s), 2339KiB/s-3103KiB/s (2395kB/s-3178kB/s), io=28.0MiB (29.4MB), run=2161-3300msec rand-rw: (groupid=0, jobs=1): err= 0: pid=149275: Sun Dec 7 06:15:32 2025 read: IOPS=2, BW=2123KiB/s (2174kB/s)(7168KiB/3376msec) clat (msec): min=48, max=588, avg=229.09, stdev=177.50 lat (msec): min=48, max=588, avg=229.10, stdev=177.50 clat percentiles (msec): | 1.00th=[ 48], 5.00th=[ 48], 10.00th=[ 48], 20.00th=[ 125], | 30.00th=[ 153], 40.00th=[ 153], 50.00th=[ 178], 60.00th=[ 203], | 70.00th=[ 203], 80.00th=[ 313], 90.00th=[ 592], 95.00th=[ 592], | 99.00th=[ 592], 99.50th=[ 592], 99.90th=[ 592], 99.95th=[ 592], | 99.99th=[ 592] bw ( KiB/s): min= 1984, max= 5036, per=46.55%, avg=2777.75, stdev=1505.78, samples=4 iops : min= 1, max= 4, avg= 2.00, stdev= 1.41, samples=4 write: IOPS=1, BW=1517KiB/s (1553kB/s)(5120KiB/3376msec); 0 zone resets clat (msec): min=220, max=485, avg=350.77, stdev=127.47 lat (msec): min=220, max=485, avg=350.88, stdev=127.48 clat percentiles (msec): | 1.00th=[ 222], 5.00th=[ 222], 10.00th=[ 222], 20.00th=[ 222], | 30.00th=[ 241], 40.00th=[ 241], 50.00th=[ 330], 60.00th=[ 330], | 70.00th=[ 481], 80.00th=[ 481], 90.00th=[ 485], 95.00th=[ 485], | 99.00th=[ 485], 99.50th=[ 485], 99.90th=[ 485], 99.95th=[ 485], | 99.99th=[ 485] bw ( KiB/s): min= 2043, max= 3785, per=31.41%, avg=2623.67, stdev=1005.74, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (msec) : 50=8.33%, 250=50.00%, 500=33.33%, 750=8.33% cpu : usr=0.00%, sys=13.66%, ctx=114, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=149276: Sun Dec 7 06:15:32 2025 read: IOPS=0, BW=608KiB/s (622kB/s)(2048KiB/3369msec) clat (msec): min=154, max=309, avg=232.06, stdev=110.08 lat (msec): min=154, max=309, avg=232.07, stdev=110.08 clat percentiles (msec): | 1.00th=[ 155], 5.00th=[ 155], 10.00th=[ 155], 20.00th=[ 155], | 30.00th=[ 155], 40.00th=[ 155], 50.00th=[ 155], 60.00th=[ 309], | 70.00th=[ 309], 80.00th=[ 309], 90.00th=[ 309], 95.00th=[ 309], | 99.00th=[ 309], 99.50th=[ 309], 99.90th=[ 309], 99.95th=[ 309], | 99.99th=[ 309] bw ( KiB/s): min= 1735, max= 1892, per=30.39%, avg=1813.50, stdev=111.02, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=3039KiB/s (3112kB/s)(10.0MiB/3369msec); 0 zone resets clat (msec): min=134, max=728, avg=284.43, stdev=179.02 lat (msec): min=135, max=728, avg=284.52, stdev=179.03 clat percentiles (msec): | 1.00th=[ 136], 5.00th=[ 136], 10.00th=[ 136], 20.00th=[ 171], | 30.00th=[ 211], 40.00th=[ 211], 50.00th=[ 213], 60.00th=[ 220], | 70.00th=[ 239], 80.00th=[ 251], 90.00th=[ 464], 95.00th=[ 726], | 99.00th=[ 726], 99.50th=[ 726], 99.90th=[ 726], 99.95th=[ 726], | 99.99th=[ 726] bw ( KiB/s): min= 1892, max= 6144, per=48.15%, avg=4022.75, stdev=1736.56, samples=4 iops : min= 1, max= 6, avg= 3.25, stdev= 2.06, samples=4 lat (msec) : 250=66.67%, 500=25.00%, 750=8.33% cpu : usr=0.03%, sys=16.72%, ctx=210, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=149277: Sun Dec 7 06:15:32 2025 read: IOPS=1, BW=1863KiB/s (1908kB/s)(6144KiB/3298msec) clat (msec): min=104, max=410, avg=235.55, stdev=111.11 lat (msec): min=104, max=410, avg=235.55, stdev=111.11 clat percentiles (msec): | 1.00th=[ 105], 5.00th=[ 105], 10.00th=[ 105], 20.00th=[ 169], | 30.00th=[ 169], 40.00th=[ 190], 50.00th=[ 190], 60.00th=[ 220], | 70.00th=[ 321], 80.00th=[ 321], 90.00th=[ 409], 95.00th=[ 409], | 99.00th=[ 409], 99.50th=[ 409], 99.90th=[ 409], 99.95th=[ 409], | 99.99th=[ 409] bw ( KiB/s): min= 1984, max= 3785, per=41.31%, avg=2465.00, stdev=880.48, samples=4 iops : min= 1, max= 3, avg= 1.75, stdev= 0.96, samples=4 write: IOPS=1, BW=1863KiB/s (1908kB/s)(6144KiB/3298msec); 0 zone resets clat (msec): min=116, max=636, avg=304.23, stdev=205.17 lat (msec): min=116, max=636, avg=304.31, stdev=205.17 clat percentiles (msec): | 1.00th=[ 116], 5.00th=[ 116], 10.00th=[ 116], 20.00th=[ 133], | 30.00th=[ 133], 40.00th=[ 163], 50.00th=[ 163], 60.00th=[ 372], | 70.00th=[ 405], 80.00th=[ 405], 90.00th=[ 634], 95.00th=[ 634], | 99.00th=[ 634], 99.50th=[ 634], 99.90th=[ 634], 99.95th=[ 634], | 99.99th=[ 634] bw ( KiB/s): min= 1723, max= 2048, per=23.41%, avg=1955.50, stdev=128.66, samples=6 iops : min= 1, max= 2, avg= 1.17, stdev= 0.41, samples=6 lat (msec) : 250=58.33%, 500=33.33%, 750=8.33% cpu : usr=0.06%, sys=13.77%, ctx=116, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=149278: Sun Dec 7 06:15:32 2025 read: IOPS=1, BW=1492KiB/s (1528kB/s)(5120KiB/3432msec) clat (msec): min=27, max=406, avg=201.56, stdev=176.98 lat (msec): min=27, max=406, avg=201.56, stdev=176.98 clat percentiles (msec): | 1.00th=[ 28], 5.00th=[ 28], 10.00th=[ 28], 20.00th=[ 28], | 30.00th=[ 79], 40.00th=[ 79], 50.00th=[ 120], 60.00th=[ 120], | 70.00th=[ 376], 80.00th=[ 376], 90.00th=[ 409], 95.00th=[ 409], | 99.00th=[ 409], 99.50th=[ 409], 99.90th=[ 409], 99.95th=[ 409], | 99.99th=[ 409] bw ( KiB/s): min= 1892, max= 4087, per=44.48%, avg=2654.33, stdev=1241.58, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 write: IOPS=2, BW=2089KiB/s (2139kB/s)(7168KiB/3432msec); 0 zone resets clat (msec): min=62, max=528, avg=336.89, stdev=174.31 lat (msec): min=62, max=528, avg=336.98, stdev=174.31 clat percentiles (msec): | 1.00th=[ 63], 5.00th=[ 63], 10.00th=[ 63], 20.00th=[ 209], | 30.00th=[ 279], 40.00th=[ 279], 50.00th=[ 296], 60.00th=[ 485], | 70.00th=[ 485], 80.00th=[ 498], 90.00th=[ 531], 95.00th=[ 531], | 99.00th=[ 531], 99.50th=[ 531], 99.90th=[ 531], 99.95th=[ 531], | 99.99th=[ 531] bw ( KiB/s): min= 1726, max= 2048, per=23.57%, avg=1968.80, stdev=138.26, samples=5 iops : min= 1, max= 2, avg= 1.20, stdev= 0.45, samples=5 lat (msec) : 50=8.33%, 100=16.67%, 250=16.67%, 500=50.00%, 750=8.33% cpu : usr=0.06%, sys=14.08%, ctx=123, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5967KiB/s (6111kB/s), 608KiB/s-2123KiB/s (622kB/s-2174kB/s), io=20.0MiB (20.0MB), run=3298-3432msec WRITE: bw=8354KiB/s (8555kB/s), 1517KiB/s-3039KiB/s (1553kB/s-3112kB/s), io=28.0MiB (29.4MB), run=3298-3432msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=149284: Sun Dec 7 06:15:40 2025 read: IOPS=1, BW=8021KiB/s (8213kB/s)(12.0MiB/1532msec) clat (msec): min=410, max=555, avg=493.01, stdev=74.70 lat (msec): min=410, max=555, avg=493.01, stdev=74.70 clat percentiles (msec): | 1.00th=[ 409], 5.00th=[ 409], 10.00th=[ 409], 20.00th=[ 409], | 30.00th=[ 409], 40.00th=[ 514], 50.00th=[ 514], 60.00th=[ 514], | 70.00th=[ 558], 80.00th=[ 558], 90.00th=[ 558], 95.00th=[ 558], | 99.00th=[ 558], 99.50th=[ 558], 99.90th=[ 558], 99.95th=[ 558], | 99.99th=[ 558] bw ( KiB/s): min= 6595, max= 8175, per=98.99%, avg=7385.00, stdev=1117.23, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 750=66.67% cpu : usr=0.07%, sys=55.39%, ctx=2696, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=149287: Sun Dec 7 06:15:40 2025 read: IOPS=0, BW=1865KiB/s (1910kB/s)(4096KiB/2196msec) clat (nsec): min=529764k, max=529764k, avg=529764474.00, stdev= 0.00 lat (nsec): min=529767k, max=529767k, avg=529767116.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 531], 5.00th=[ 531], 10.00th=[ 531], 20.00th=[ 531], | 30.00th=[ 531], 40.00th=[ 531], 50.00th=[ 531], 60.00th=[ 531], | 70.00th=[ 531], 80.00th=[ 531], 90.00th=[ 531], 95.00th=[ 531], | 99.00th=[ 531], 99.50th=[ 531], 99.90th=[ 531], 99.95th=[ 531], | 99.99th=[ 531] bw ( KiB/s): min= 6681, max= 6681, per=89.56%, avg=6681.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=3730KiB/s (3820kB/s)(8192KiB/2196msec); 0 zone resets clat (msec): min=176, max=1418, avg=797.49, stdev=877.54 lat (msec): min=177, max=1418, avg=797.81, stdev=877.50 clat percentiles (msec): | 1.00th=[ 178], 5.00th=[ 178], 10.00th=[ 178], 20.00th=[ 178], | 30.00th=[ 178], 40.00th=[ 178], 50.00th=[ 178], 60.00th=[ 1418], | 70.00th=[ 1418], 80.00th=[ 1418], 90.00th=[ 1418], 95.00th=[ 1418], | 99.00th=[ 1418], 99.50th=[ 1418], 99.90th=[ 1418], 99.95th=[ 1418], | 99.99th=[ 1418] bw ( KiB/s): min= 8192, max= 8192, per=54.90%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.05%, sys=15.26%, ctx=977, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=149289: Sun Dec 7 06:15:40 2025 write: IOPS=2, BW=9714KiB/s (9947kB/s)(12.0MiB/1265msec); 0 zone resets clat (msec): min=169, max=909, avg=416.85, stdev=426.95 lat (msec): min=170, max=910, avg=417.45, stdev=426.68 clat percentiles (msec): | 1.00th=[ 169], 5.00th=[ 169], 10.00th=[ 169], 20.00th=[ 169], | 30.00th=[ 169], 40.00th=[ 171], 50.00th=[ 171], 60.00th=[ 171], | 70.00th=[ 911], 80.00th=[ 911], 90.00th=[ 911], 95.00th=[ 911], | 99.00th=[ 911], 99.50th=[ 911], 99.90th=[ 911], 99.95th=[ 911], | 99.99th=[ 911] bw ( KiB/s): min=12029, max=12029, per=80.62%, avg=12029.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 250=66.67%, 1000=33.33% cpu : usr=0.00%, sys=19.86%, ctx=219, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=149290: Sun Dec 7 06:15:40 2025 write: IOPS=1, BW=6564KiB/s (6722kB/s)(12.0MiB/1872msec); 0 zone resets clat (msec): min=242, max=1021, avg=608.54, stdev=391.94 lat (msec): min=242, max=1022, avg=608.87, stdev=391.95 clat percentiles (msec): | 1.00th=[ 243], 5.00th=[ 243], 10.00th=[ 243], 20.00th=[ 243], | 30.00th=[ 243], 40.00th=[ 558], 50.00th=[ 558], 60.00th=[ 558], | 70.00th=[ 1020], 80.00th=[ 1020], 90.00th=[ 1020], 95.00th=[ 1020], | 99.00th=[ 1020], 99.50th=[ 1020], 99.90th=[ 1020], 99.95th=[ 1020], | 99.99th=[ 1020] bw ( KiB/s): min= 8175, max= 8175, per=54.79%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.05%, sys=22.13%, ctx=89, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=7461KiB/s (7640kB/s), 1865KiB/s-8021KiB/s (1910kB/s-8213kB/s), io=16.0MiB (16.8MB), run=1532-2196msec WRITE: bw=14.6MiB/s (15.3MB/s), 3730KiB/s-9714KiB/s (3820kB/s-9947kB/s), io=32.0MiB (33.6MB), run=1265-2196msec rand-rw: (groupid=0, jobs=1): err= 0: pid=149285: Sun Dec 7 06:15:40 2025 read: IOPS=1, BW=6621KiB/s (6780kB/s)(12.0MiB/1856msec) clat (msec): min=531, max=668, avg=605.59, stdev=69.03 lat (msec): min=531, max=668, avg=605.60, stdev=69.03 clat percentiles (msec): | 1.00th=[ 531], 5.00th=[ 531], 10.00th=[ 531], 20.00th=[ 531], | 30.00th=[ 531], 40.00th=[ 617], 50.00th=[ 617], 60.00th=[ 617], | 70.00th=[ 667], 80.00th=[ 667], 90.00th=[ 667], 95.00th=[ 667], | 99.00th=[ 667], 99.50th=[ 667], 99.90th=[ 667], 99.95th=[ 667], | 99.99th=[ 667] bw ( KiB/s): min= 8110, max= 8175, per=94.04%, avg=8142.50, stdev=45.96, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=100.00% cpu : usr=0.00%, sys=14.88%, ctx=73, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=149286: Sun Dec 7 06:15:40 2025 read: IOPS=0, BW=2165KiB/s (2217kB/s)(4096KiB/1892msec) clat (nsec): min=1028.1M, max=1028.1M, avg=1028099530.00, stdev= 0.00 lat (nsec): min=1028.1M, max=1028.1M, avg=1028102227.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1028], 5.00th=[ 1028], 10.00th=[ 1028], 20.00th=[ 1028], | 30.00th=[ 1028], 40.00th=[ 1028], 50.00th=[ 1028], 60.00th=[ 1028], | 70.00th=[ 1028], 80.00th=[ 1028], 90.00th=[ 1028], 95.00th=[ 1028], | 99.00th=[ 1028], 99.50th=[ 1028], 99.90th=[ 1028], 99.95th=[ 1028], | 99.99th=[ 1028] bw ( KiB/s): min= 8110, max= 8110, per=93.66%, avg=8110.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=1, BW=4330KiB/s (4434kB/s)(8192KiB/1892msec); 0 zone resets clat (msec): min=232, max=585, avg=409.33, stdev=249.48 lat (msec): min=233, max=586, avg=409.64, stdev=249.48 clat percentiles (msec): | 1.00th=[ 234], 5.00th=[ 234], 10.00th=[ 234], 20.00th=[ 234], | 30.00th=[ 234], 40.00th=[ 234], 50.00th=[ 234], 60.00th=[ 584], | 70.00th=[ 584], 80.00th=[ 584], 90.00th=[ 584], 95.00th=[ 584], | 99.00th=[ 584], 99.50th=[ 584], 99.90th=[ 584], 99.95th=[ 584], | 99.99th=[ 584] lat (msec) : 250=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.00%, sys=19.78%, ctx=68, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=149288: Sun Dec 7 06:15:40 2025 write: IOPS=1, BW=5601KiB/s (5735kB/s)(12.0MiB/2194msec); 0 zone resets clat (msec): min=191, max=1620, avg=712.18, stdev=789.15 lat (msec): min=192, max=1620, avg=712.48, stdev=789.15 clat percentiles (msec): | 1.00th=[ 192], 5.00th=[ 192], 10.00th=[ 192], 20.00th=[ 192], | 30.00th=[ 192], 40.00th=[ 326], 50.00th=[ 326], 60.00th=[ 326], | 70.00th=[ 1620], 80.00th=[ 1620], 90.00th=[ 1620], 95.00th=[ 1620], | 99.00th=[ 1620], 99.50th=[ 1620], 99.90th=[ 1620], 99.95th=[ 1620], | 99.99th=[ 1620] bw ( KiB/s): min=16384, max=16384, per=100.00%, avg=16384.00, stdev= 0.00, samples=1 iops : min= 4, max= 4, avg= 4.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 500=33.33%, 2000=33.33% cpu : usr=0.05%, sys=13.36%, ctx=85, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=149291: Sun Dec 7 06:15:40 2025 write: IOPS=1, BW=7557KiB/s (7739kB/s)(12.0MiB/1626msec); 0 zone resets clat (msec): min=172, max=1111, avg=533.61, stdev=505.70 lat (msec): min=173, max=1112, avg=534.10, stdev=505.55 clat percentiles (msec): | 1.00th=[ 174], 5.00th=[ 174], 10.00th=[ 174], 20.00th=[ 174], | 30.00th=[ 174], 40.00th=[ 317], 50.00th=[ 317], 60.00th=[ 317], | 70.00th=[ 1116], 80.00th=[ 1116], 90.00th=[ 1116], 95.00th=[ 1116], | 99.00th=[ 1116], 99.50th=[ 1116], 99.90th=[ 1116], 99.95th=[ 1116], | 99.99th=[ 1116] bw ( KiB/s): min=12545, max=12545, per=84.00%, avg=12545.00, stdev= 0.00, samples=1 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 500=33.33%, 2000=33.33% cpu : usr=0.06%, sys=17.42%, ctx=73, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=8660KiB/s (8867kB/s), 2165KiB/s-6621KiB/s (2217kB/s-6780kB/s), io=16.0MiB (16.8MB), run=1856-1892msec WRITE: bw=14.6MiB/s (15.3MB/s), 4330KiB/s-7557KiB/s (4434kB/s-7739kB/s), io=32.0MiB (33.6MB), run=1626-2194msec