== sanity test 398b: DIO and buffer IO race ============== 06:20:50 (1765106450) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 3.0959 s, 16.3 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=174888: Sun Dec 7 06:21:53 2025 read: IOPS=28, BW=113KiB/s (116kB/s)(5992KiB/52853msec) clat (usec): min=159, max=808572, avg=18660.42, stdev=22936.16 lat (usec): min=161, max=808572, avg=18661.38, stdev=22936.18 clat percentiles (usec): | 1.00th=[ 322], 5.00th=[ 5080], 10.00th=[ 7635], 20.00th=[ 10159], | 30.00th=[ 11994], 40.00th=[ 14353], 50.00th=[ 16319], 60.00th=[ 18744], | 70.00th=[ 21890], 80.00th=[ 25560], 90.00th=[ 31065], 95.00th=[ 35390], | 99.00th=[ 55313], 99.50th=[ 63177], 99.90th=[101188], 99.95th=[809501], | 99.99th=[809501] bw ( KiB/s): min= 13, max= 191, per=25.10%, avg=113.21, stdev=32.33, samples=105 iops : min= 3, max= 47, avg=27.90, stdev= 8.14, samples=105 write: IOPS=29, BW=119KiB/s (122kB/s)(6296KiB/52853msec); 0 zone resets clat (usec): min=639, max=101997, avg=15638.92, stdev=12249.06 lat (usec): min=640, max=101998, avg=15640.04, stdev=12249.02 clat percentiles (usec): | 1.00th=[ 1123], 5.00th=[ 2311], 10.00th=[ 3032], 20.00th=[ 4555], | 30.00th=[ 6718], 40.00th=[ 9765], 50.00th=[ 12518], 60.00th=[ 15926], | 70.00th=[ 20055], 80.00th=[ 25822], 90.00th=[ 33162], 95.00th=[ 38536], | 99.00th=[ 51643], 99.50th=[ 59507], 99.90th=[ 74974], 99.95th=[102237], | 99.99th=[102237] bw ( KiB/s): min= 8, max= 208, per=25.37%, avg=119.99, stdev=33.79, samples=104 iops : min= 2, max= 52, avg=29.60, stdev= 8.47, samples=104 lat (usec) : 250=0.16%, 500=0.98%, 750=0.81%, 1000=0.36% lat (msec) : 2=1.53%, 4=6.54%, 10=19.79%, 20=36.78%, 50=31.74% lat (msec) : 100=1.20%, 250=0.07%, 1000=0.03% cpu : usr=0.14%, sys=28.99%, ctx=9311, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=174889: Sun Dec 7 06:21:53 2025 read: IOPS=28, BW=113KiB/s (116kB/s)(5940KiB/52489msec) clat (usec): min=106, max=101621, avg=18349.13, stdev=10526.20 lat (usec): min=106, max=101621, avg=18350.92, stdev=10525.51 clat percentiles (usec): | 1.00th=[ 338], 5.00th=[ 6456], 10.00th=[ 8029], 20.00th=[ 10421], | 30.00th=[ 12649], 40.00th=[ 14746], 50.00th=[ 16712], 60.00th=[ 18744], | 70.00th=[ 21365], 80.00th=[ 25297], 90.00th=[ 30016], 95.00th=[ 34866], | 99.00th=[ 57410], 99.50th=[ 66847], 99.90th=[ 99091], 99.95th=[101188], | 99.99th=[101188] bw ( KiB/s): min= 6, max= 199, per=25.33%, avg=114.25, stdev=29.82, samples=103 iops : min= 1, max= 49, avg=28.16, stdev= 7.53, samples=103 write: IOPS=30, BW=121KiB/s (124kB/s)(6348KiB/52489msec); 0 zone resets clat (usec): min=605, max=807790, avg=15732.40, stdev=23309.89 lat (usec): min=606, max=807792, avg=15734.02, stdev=23309.90 clat percentiles (usec): | 1.00th=[ 1074], 5.00th=[ 2507], 10.00th=[ 3097], 20.00th=[ 4817], | 30.00th=[ 6849], 40.00th=[ 9634], 50.00th=[ 12518], 60.00th=[ 15664], | 70.00th=[ 19006], 80.00th=[ 23987], 90.00th=[ 31065], 95.00th=[ 37487], | 99.00th=[ 54264], 99.50th=[ 74974], 99.90th=[106431], 99.95th=[809501], | 99.99th=[809501] bw ( KiB/s): min= 40, max= 240, per=25.75%, avg=121.82, stdev=37.14, samples=103 iops : min= 10, max= 60, avg=30.05, stdev= 9.34, samples=103 lat (usec) : 250=0.23%, 500=0.75%, 750=0.72%, 1000=0.26% lat (msec) : 2=1.01%, 4=6.28%, 10=20.51%, 20=38.54%, 50=30.21% lat (msec) : 100=1.40%, 250=0.07%, 1000=0.03% cpu : usr=0.12%, sys=28.90%, ctx=9358, majf=0, minf=19 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=174890: Sun Dec 7 06:21:53 2025 read: IOPS=28, BW=114KiB/s (117kB/s)(6028KiB/52861msec) clat (usec): min=121, max=757924, avg=18275.96, stdev=21939.25 lat (usec): min=122, max=757925, avg=18284.05, stdev=21939.55 clat percentiles (usec): | 1.00th=[ 330], 5.00th=[ 1012], 10.00th=[ 7504], 20.00th=[ 9503], | 30.00th=[ 11731], 40.00th=[ 13960], 50.00th=[ 15926], 60.00th=[ 18482], | 70.00th=[ 21103], 80.00th=[ 24773], 90.00th=[ 30540], 95.00th=[ 36439], | 99.00th=[ 54264], 99.50th=[ 67634], 99.90th=[106431], 99.95th=[759170], | 99.99th=[759170] bw ( KiB/s): min= 32, max= 184, per=25.50%, avg=115.01, stdev=30.97, samples=104 iops : min= 8, max= 46, avg=28.35, stdev= 7.76, samples=104 write: IOPS=29, BW=118KiB/s (121kB/s)(6260KiB/52861msec); 0 zone resets clat (usec): min=648, max=84870, avg=15998.30, stdev=12090.37 lat (usec): min=649, max=84871, avg=16000.30, stdev=12090.27 clat percentiles (usec): | 1.00th=[ 930], 5.00th=[ 2343], 10.00th=[ 3294], 20.00th=[ 5145], | 30.00th=[ 7242], 40.00th=[10028], 50.00th=[13304], 60.00th=[17171], | 70.00th=[20841], 80.00th=[25297], 90.00th=[32375], 95.00th=[38011], | 99.00th=[52167], 99.50th=[63177], 99.90th=[74974], 99.95th=[84411], | 99.99th=[84411] bw ( KiB/s): min= 8, max= 192, per=24.99%, avg=118.20, stdev=33.99, samples=105 iops : min= 2, max= 48, avg=29.15, stdev= 8.49, samples=105 lat (usec) : 250=0.16%, 500=1.11%, 750=1.11%, 1000=0.75% lat (msec) : 2=1.14%, 4=5.57%, 10=21.22%, 20=35.87%, 50=31.74% lat (msec) : 100=1.27%, 250=0.03%, 1000=0.03% cpu : usr=0.15%, sys=28.92%, ctx=9242, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=174891: Sun Dec 7 06:21:53 2025 read: IOPS=28, BW=114KiB/s (117kB/s)(6052KiB/53129msec) clat (usec): min=83, max=83375, avg=18147.22, stdev=10500.02 lat (usec): min=84, max=83375, avg=18148.12, stdev=10500.04 clat percentiles (usec): | 1.00th=[ 338], 5.00th=[ 4490], 10.00th=[ 7504], 20.00th=[ 9896], | 30.00th=[12256], 40.00th=[14222], 50.00th=[16188], 60.00th=[18744], | 70.00th=[21890], 80.00th=[25822], 90.00th=[31065], 95.00th=[36963], | 99.00th=[53740], 99.50th=[60556], 99.90th=[71828], 99.95th=[83362], | 99.99th=[83362] bw ( KiB/s): min= 47, max= 200, per=25.23%, avg=113.78, stdev=30.29, samples=104 iops : min= 11, max= 50, avg=28.04, stdev= 7.66, samples=104 write: IOPS=29, BW=117KiB/s (120kB/s)(6236KiB/53129msec); 0 zone resets clat (usec): min=624, max=741522, avg=16290.81, stdev=22579.37 lat (usec): min=625, max=741524, avg=16291.95, stdev=22579.36 clat percentiles (usec): | 1.00th=[ 857], 5.00th=[ 2245], 10.00th=[ 2999], 20.00th=[ 4686], | 30.00th=[ 6849], 40.00th=[ 10028], 50.00th=[ 12911], 60.00th=[ 15926], | 70.00th=[ 19530], 80.00th=[ 25035], 90.00th=[ 32900], 95.00th=[ 40109], | 99.00th=[ 57934], 99.50th=[ 82314], 99.90th=[110625], 99.95th=[742392], | 99.99th=[742392] bw ( KiB/s): min= 13, max= 207, per=24.60%, avg=116.38, stdev=35.10, samples=105 iops : min= 3, max= 51, avg=28.70, stdev= 8.77, samples=105 lat (usec) : 100=0.10%, 250=0.16%, 500=0.98%, 750=0.88%, 1000=0.65% lat (msec) : 2=1.24%, 4=6.41%, 10=20.05%, 20=36.88%, 50=31.09% lat (msec) : 100=1.46%, 250=0.07%, 750=0.03% cpu : usr=0.13%, sys=28.62%, ctx=9474, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=452KiB/s (463kB/s), 113KiB/s-114KiB/s (116kB/s-117kB/s), io=23.4MiB (24.6MB), run=52489-53129msec WRITE: bw=473KiB/s (485kB/s), 117KiB/s-121KiB/s (120kB/s-124kB/s), io=24.6MiB (25.7MB), run=52489-53129msec rand-rw: (groupid=0, jobs=1): err= 0: pid=174892: Sun Dec 7 06:22:15 2025 read: IOPS=20, BW=80.2KiB/s (82.1kB/s)(5992KiB/74691msec) clat (msec): min=2, max=828, avg=14.63, stdev=25.20 lat (msec): min=2, max=828, avg=14.63, stdev=25.20 clat percentiles (msec): | 1.00th=[ 3], 5.00th=[ 4], 10.00th=[ 4], 20.00th=[ 5], | 30.00th=[ 6], 40.00th=[ 7], 50.00th=[ 9], 60.00th=[ 12], | 70.00th=[ 16], 80.00th=[ 22], 90.00th=[ 32], 95.00th=[ 43], | 99.00th=[ 65], 99.50th=[ 81], 99.90th=[ 121], 99.95th=[ 827], | 99.99th=[ 827] bw ( KiB/s): min= 23, max= 208, per=25.27%, avg=80.35, stdev=45.43, samples=147 iops : min= 5, max= 52, avg=19.78, stdev=11.52, samples=147 write: IOPS=21, BW=84.3KiB/s (86.3kB/s)(6296KiB/74691msec); 0 zone resets clat (msec): min=13, max=146, avg=33.36, stdev=17.47 lat (msec): min=13, max=146, avg=33.37, stdev=17.47 clat percentiles (msec): | 1.00th=[ 15], 5.00th=[ 17], 10.00th=[ 18], 20.00th=[ 21], | 30.00th=[ 23], 40.00th=[ 25], 50.00th=[ 28], 60.00th=[ 32], | 70.00th=[ 37], 80.00th=[ 44], 90.00th=[ 56], 95.00th=[ 67], | 99.00th=[ 99], 99.50th=[ 116], 99.90th=[ 133], 99.95th=[ 146], | 99.99th=[ 146] bw ( KiB/s): min= 23, max= 176, per=25.50%, avg=84.90, stdev=42.39, samples=146 iops : min= 5, max= 44, avg=20.92, stdev=10.79, samples=146 lat (msec) : 4=5.86%, 10=20.74%, 20=21.71%, 50=42.38%, 100=8.72% lat (msec) : 250=0.55%, 1000=0.03% cpu : usr=0.12%, sys=9.43%, ctx=5738, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=174893: Sun Dec 7 06:22:15 2025 read: IOPS=19, BW=78.7KiB/s (80.6kB/s)(5940KiB/75448msec) clat (msec): min=2, max=768, avg=15.48, stdev=24.99 lat (msec): min=2, max=768, avg=15.49, stdev=24.99 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 4], 10.00th=[ 4], 20.00th=[ 5], | 30.00th=[ 6], 40.00th=[ 7], 50.00th=[ 9], 60.00th=[ 13], | 70.00th=[ 17], 80.00th=[ 23], 90.00th=[ 35], 95.00th=[ 48], | 99.00th=[ 78], 99.50th=[ 92], 99.90th=[ 140], 99.95th=[ 768], | 99.99th=[ 768] bw ( KiB/s): min= 8, max= 208, per=24.84%, avg=79.01, stdev=46.44, samples=149 iops : min= 2, max= 52, avg=19.45, stdev=11.78, samples=149 write: IOPS=21, BW=84.1KiB/s (86.2kB/s)(6348KiB/75448msec); 0 zone resets clat (msec): min=11, max=153, avg=32.89, stdev=17.34 lat (msec): min=11, max=153, avg=32.89, stdev=17.34 clat percentiles (msec): | 1.00th=[ 15], 5.00th=[ 16], 10.00th=[ 18], 20.00th=[ 21], | 30.00th=[ 23], 40.00th=[ 25], 50.00th=[ 28], 60.00th=[ 32], | 70.00th=[ 37], 80.00th=[ 44], 90.00th=[ 55], 95.00th=[ 67], | 99.00th=[ 101], 99.50th=[ 115], 99.90th=[ 132], 99.95th=[ 153], | 99.99th=[ 153] bw ( KiB/s): min= 23, max= 216, per=25.46%, avg=84.78, stdev=42.82, samples=148 iops : min= 5, max= 54, avg=20.89, stdev=10.90, samples=148 lat (msec) : 4=5.96%, 10=20.21%, 20=20.64%, 50=44.21%, 100=8.30% lat (msec) : 250=0.65%, 1000=0.03% cpu : usr=0.11%, sys=9.50%, ctx=5796, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=174894: Sun Dec 7 06:22:15 2025 read: IOPS=20, BW=80.4KiB/s (82.3kB/s)(6028KiB/74980msec) clat (msec): min=2, max=113, avg=14.39, stdev=14.08 lat (msec): min=2, max=113, avg=14.39, stdev=14.08 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 4], 10.00th=[ 4], 20.00th=[ 5], | 30.00th=[ 6], 40.00th=[ 7], 50.00th=[ 9], 60.00th=[ 13], | 70.00th=[ 17], 80.00th=[ 22], 90.00th=[ 32], 95.00th=[ 44], | 99.00th=[ 69], 99.50th=[ 82], 99.90th=[ 99], 99.95th=[ 114], | 99.99th=[ 114] bw ( KiB/s): min= 7, max= 240, per=25.39%, avg=80.73, stdev=45.15, samples=148 iops : min= 1, max= 60, avg=19.88, stdev=11.46, samples=148 write: IOPS=20, BW=83.5KiB/s (85.5kB/s)(6260KiB/74980msec); 0 zone resets clat (msec): min=12, max=777, avg=33.89, stdev=25.18 lat (msec): min=12, max=777, avg=33.89, stdev=25.18 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 17], 10.00th=[ 18], 20.00th=[ 21], | 30.00th=[ 23], 40.00th=[ 26], 50.00th=[ 28], 60.00th=[ 32], | 70.00th=[ 38], 80.00th=[ 46], 90.00th=[ 57], 95.00th=[ 67], | 99.00th=[ 92], 99.50th=[ 111], 99.90th=[ 129], 99.95th=[ 776], | 99.99th=[ 776] bw ( KiB/s): min= 24, max= 176, per=25.14%, avg=83.70, stdev=41.63, samples=148 iops : min= 6, max= 44, avg=20.62, stdev=10.60, samples=148 lat (msec) : 4=5.50%, 10=20.48%, 20=22.43%, 50=42.58%, 100=8.59% lat (msec) : 250=0.39%, 1000=0.03% cpu : usr=0.08%, sys=9.58%, ctx=5840, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=174895: Sun Dec 7 06:22:15 2025 read: IOPS=20, BW=80.5KiB/s (82.4kB/s)(6052KiB/75175msec) clat (msec): min=2, max=109, avg=14.32, stdev=14.07 lat (msec): min=2, max=109, avg=14.32, stdev=14.07 clat percentiles (msec): | 1.00th=[ 3], 5.00th=[ 4], 10.00th=[ 4], 20.00th=[ 5], | 30.00th=[ 6], 40.00th=[ 7], 50.00th=[ 9], 60.00th=[ 13], | 70.00th=[ 16], 80.00th=[ 22], 90.00th=[ 34], 95.00th=[ 44], | 99.00th=[ 69], 99.50th=[ 77], 99.90th=[ 96], 99.95th=[ 110], | 99.99th=[ 110] bw ( KiB/s): min= 23, max= 240, per=25.58%, avg=81.35, stdev=47.42, samples=146 iops : min= 5, max= 60, avg=20.03, stdev=12.01, samples=146 write: IOPS=20, BW=82.0KiB/s (84.9kB/s)(6236KiB/75175msec); 0 zone resets clat (msec): min=13, max=775, avg=34.16, stdev=25.98 lat (msec): min=13, max=775, avg=34.16, stdev=25.98 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 17], 10.00th=[ 18], 20.00th=[ 21], | 30.00th=[ 23], 40.00th=[ 25], 50.00th=[ 28], 60.00th=[ 32], | 70.00th=[ 38], 80.00th=[ 46], 90.00th=[ 58], 95.00th=[ 69], | 99.00th=[ 101], 99.50th=[ 117], 99.90th=[ 150], 99.95th=[ 776], | 99.99th=[ 776] bw ( KiB/s): min= 16, max= 176, per=24.89%, avg=82.89, stdev=41.92, samples=148 iops : min= 4, max= 44, avg=20.42, stdev=10.68, samples=148 lat (msec) : 4=5.50%, 10=21.58%, 20=20.90%, 50=42.35%, 100=9.11% lat (msec) : 250=0.52%, 1000=0.03% cpu : usr=0.12%, sys=9.45%, ctx=5843, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=318KiB/s (326kB/s), 78.7KiB/s-80.5KiB/s (80.6kB/s-82.4kB/s), io=23.4MiB (24.6MB), run=74691-75448msec WRITE: bw=333KiB/s (341kB/s), 82.0KiB/s-84.3KiB/s (84.9kB/s-86.3kB/s), io=24.6MiB (25.7MB), run=74691-75448msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=174925: Sun Dec 7 06:22:39 2025 read: IOPS=19, BW=319KiB/s (326kB/s)(5920KiB/18573msec) clat (usec): min=139, max=98804, avg=25426.46, stdev=14409.54 lat (usec): min=141, max=98805, avg=25427.82, stdev=14409.54 clat percentiles (usec): | 1.00th=[ 367], 5.00th=[ 775], 10.00th=[ 9634], 20.00th=[14484], | 30.00th=[18482], 40.00th=[21103], 50.00th=[24511], 60.00th=[27395], | 70.00th=[31327], 80.00th=[34341], 90.00th=[41681], 95.00th=[50070], | 99.00th=[76022], 99.50th=[83362], 99.90th=[99091], 99.95th=[99091], | 99.99th=[99091] bw ( KiB/s): min= 158, max= 510, per=24.55%, avg=311.28, stdev=78.96, samples=36 iops : min= 9, max= 31, avg=18.75, stdev= 4.95, samples=36 write: IOPS=21, BW=343KiB/s (351kB/s)(6368KiB/18573msec); 0 zone resets clat (usec): min=1228, max=93240, avg=22752.16, stdev=15223.52 lat (usec): min=1231, max=93242, avg=22755.23, stdev=15224.18 clat percentiles (usec): | 1.00th=[ 2114], 5.00th=[ 5604], 10.00th=[ 7701], 20.00th=[10028], | 30.00th=[12125], 40.00th=[15270], 50.00th=[18220], 60.00th=[22676], | 70.00th=[28967], 80.00th=[35390], 90.00th=[43254], 95.00th=[52167], | 99.00th=[79168], 99.50th=[83362], 99.90th=[92799], 99.95th=[92799], | 99.99th=[92799] bw ( KiB/s): min= 95, max= 542, per=25.36%, avg=338.36, stdev=96.29, samples=36 iops : min= 5, max= 33, avg=20.44, stdev= 6.08, samples=36 lat (usec) : 250=0.26%, 500=0.65%, 750=1.30%, 1000=1.17% lat (msec) : 2=0.52%, 4=0.91%, 10=10.55%, 20=28.91%, 50=50.26% lat (msec) : 100=5.47% cpu : usr=0.12%, sys=31.37%, ctx=3004, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=174926: Sun Dec 7 06:22:39 2025 read: IOPS=19, BW=304KiB/s (311kB/s)(5744KiB/18885msec) clat (usec): min=315, max=120065, avg=26175.05, stdev=15049.43 lat (usec): min=315, max=120066, avg=26176.55, stdev=15049.54 clat percentiles (usec): | 1.00th=[ 437], 5.00th=[ 857], 10.00th=[ 11469], 20.00th=[ 15533], | 30.00th=[ 18482], 40.00th=[ 22152], 50.00th=[ 24773], 60.00th=[ 27657], | 70.00th=[ 30540], 80.00th=[ 35914], 90.00th=[ 41157], 95.00th=[ 46400], | 99.00th=[ 84411], 99.50th=[105382], 99.90th=[120062], 99.95th=[120062], | 99.99th=[120062] bw ( KiB/s): min= 127, max= 512, per=23.69%, avg=300.35, stdev=86.32, samples=37 iops : min= 7, max= 32, avg=18.08, stdev= 5.47, samples=37 write: IOPS=21, BW=347KiB/s (355kB/s)(6544KiB/18885msec); 0 zone resets clat (usec): min=1110, max=105161, avg=23082.38, stdev=15493.70 lat (usec): min=1111, max=105165, avg=23085.68, stdev=15493.96 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 7], 10.00th=[ 8], 20.00th=[ 10], | 30.00th=[ 13], 40.00th=[ 17], 50.00th=[ 20], 60.00th=[ 23], | 70.00th=[ 28], 80.00th=[ 34], 90.00th=[ 45], 95.00th=[ 55], | 99.00th=[ 67], 99.50th=[ 74], 99.90th=[ 106], 99.95th=[ 106], | 99.99th=[ 106] bw ( KiB/s): min= 190, max= 480, per=25.49%, avg=340.03, stdev=86.21, samples=37 iops : min= 11, max= 30, avg=20.57, stdev= 5.42, samples=37 lat (usec) : 500=0.52%, 750=1.43%, 1000=0.52% lat (msec) : 2=0.39%, 4=0.65%, 10=11.33%, 20=28.26%, 50=50.52% lat (msec) : 100=5.73%, 250=0.65% cpu : usr=0.11%, sys=32.07%, ctx=2986, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=174927: Sun Dec 7 06:22:39 2025 read: IOPS=20, BW=335KiB/s (343kB/s)(6256KiB/18700msec) clat (usec): min=116, max=109755, avg=25865.16, stdev=15037.88 lat (usec): min=117, max=109757, avg=25866.92, stdev=15037.89 clat percentiles (usec): | 1.00th=[ 388], 5.00th=[ 652], 10.00th=[ 8586], 20.00th=[ 15008], | 30.00th=[ 18744], 40.00th=[ 21890], 50.00th=[ 25035], 60.00th=[ 27919], | 70.00th=[ 31589], 80.00th=[ 36439], 90.00th=[ 43779], 95.00th=[ 50594], | 99.00th=[ 71828], 99.50th=[ 91751], 99.90th=[109577], 99.95th=[109577], | 99.99th=[109577] bw ( KiB/s): min= 190, max= 542, per=26.39%, avg=334.65, stdev=83.54, samples=37 iops : min= 11, max= 33, avg=20.24, stdev= 5.34, samples=37 write: IOPS=20, BW=323KiB/s (330kB/s)(6032KiB/18700msec); 0 zone resets clat (usec): min=1450, max=71164, avg=22580.28, stdev=14118.38 lat (usec): min=1452, max=71167, avg=22582.80, stdev=14118.41 clat percentiles (usec): | 1.00th=[ 2147], 5.00th=[ 5342], 10.00th=[ 6980], 20.00th=[ 9503], | 30.00th=[12649], 40.00th=[15926], 50.00th=[19268], 60.00th=[22938], | 70.00th=[29492], 80.00th=[34866], 90.00th=[42730], 95.00th=[49546], | 99.00th=[61080], 99.50th=[67634], 99.90th=[70779], 99.95th=[70779], | 99.99th=[70779] bw ( KiB/s): min= 160, max= 508, per=24.06%, avg=321.00, stdev=93.66, samples=37 iops : min= 10, max= 31, avg=19.38, stdev= 5.82, samples=37 lat (usec) : 250=0.39%, 500=0.65%, 750=2.21%, 1000=1.17% lat (msec) : 2=0.65%, 4=0.78%, 10=10.81%, 20=26.56%, 50=52.08% lat (msec) : 100=4.56%, 250=0.13% cpu : usr=0.10%, sys=31.48%, ctx=3013, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=174928: Sun Dec 7 06:22:39 2025 read: IOPS=20, BW=334KiB/s (342kB/s)(6032KiB/18072msec) clat (usec): min=225, max=95840, avg=23917.77, stdev=13868.98 lat (usec): min=226, max=95841, avg=23919.38, stdev=13869.29 clat percentiles (usec): | 1.00th=[ 388], 5.00th=[ 603], 10.00th=[ 881], 20.00th=[14091], | 30.00th=[17695], 40.00th=[20841], 50.00th=[23987], 60.00th=[27132], | 70.00th=[29754], 80.00th=[32900], 90.00th=[40633], 95.00th=[49021], | 99.00th=[61080], 99.50th=[66847], 99.90th=[95945], 99.95th=[95945], | 99.99th=[95945] bw ( KiB/s): min= 222, max= 447, per=25.83%, avg=327.57, stdev=71.73, samples=35 iops : min= 13, max= 27, avg=19.77, stdev= 4.49, samples=35 write: IOPS=21, BW=346KiB/s (354kB/s)(6256KiB/18072msec); 0 zone resets clat (usec): min=1313, max=86690, avg=22911.48, stdev=14690.63 lat (usec): min=1314, max=86692, avg=22914.20, stdev=14691.00 clat percentiles (usec): | 1.00th=[ 3621], 5.00th=[ 6194], 10.00th=[ 7767], 20.00th=[ 9765], | 30.00th=[12649], 40.00th=[16057], 50.00th=[19006], 60.00th=[23725], | 70.00th=[28705], 80.00th=[34866], 90.00th=[43254], 95.00th=[52167], | 99.00th=[71828], 99.50th=[73925], 99.90th=[86508], 99.95th=[86508], | 99.99th=[86508] bw ( KiB/s): min= 191, max= 603, per=25.83%, avg=344.60, stdev=97.23, samples=35 iops : min= 11, max= 37, avg=20.86, stdev= 5.98, samples=35 lat (usec) : 250=0.13%, 500=1.17%, 750=2.60%, 1000=1.30% lat (msec) : 2=0.91%, 4=0.52%, 10=11.07%, 20=26.95%, 50=50.26% lat (msec) : 100=5.08% cpu : usr=0.18%, sys=31.75%, ctx=2843, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1268KiB/s (1299kB/s), 304KiB/s-335KiB/s (311kB/s-343kB/s), io=23.4MiB (24.5MB), run=18072-18885msec WRITE: bw=1334KiB/s (1366kB/s), 323KiB/s-347KiB/s (330kB/s-355kB/s), io=24.6MiB (25.8MB), run=18072-18885msec rand-rw: (groupid=0, jobs=1): err= 0: pid=174920: Sun Dec 7 06:22:44 2025 read: IOPS=15, BW=255KiB/s (261kB/s)(5920KiB/23193msec) clat (msec): min=2, max=169, avg=21.10, stdev=21.28 lat (msec): min=2, max=169, avg=21.10, stdev=21.28 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 4], 10.00th=[ 5], 20.00th=[ 6], | 30.00th=[ 7], 40.00th=[ 9], 50.00th=[ 15], 60.00th=[ 19], | 70.00th=[ 24], 80.00th=[ 33], 90.00th=[ 51], 95.00th=[ 66], | 99.00th=[ 94], 99.50th=[ 105], 99.90th=[ 169], 99.95th=[ 169], | 99.99th=[ 169] bw ( KiB/s): min= 95, max= 672, per=24.00%, avg=245.76, stdev=151.01, samples=45 iops : min= 5, max= 42, avg=14.78, stdev= 9.67, samples=45 write: IOPS=17, BW=275KiB/s (281kB/s)(6368KiB/23193msec); 0 zone resets clat (msec): min=14, max=143, avg=38.51, stdev=21.15 lat (msec): min=14, max=143, avg=38.52, stdev=21.15 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 18], 10.00th=[ 19], 20.00th=[ 21], | 30.00th=[ 24], 40.00th=[ 28], 50.00th=[ 33], 60.00th=[ 37], | 70.00th=[ 45], 80.00th=[ 54], 90.00th=[ 69], 95.00th=[ 82], | 99.00th=[ 112], 99.50th=[ 133], 99.90th=[ 144], 99.95th=[ 144], | 99.99th=[ 144] bw ( KiB/s): min= 63, max= 672, per=24.93%, avg=268.71, stdev=152.20, samples=45 iops : min= 3, max= 42, avg=16.22, stdev= 9.79, samples=45 lat (msec) : 4=3.26%, 10=16.54%, 20=18.23%, 50=44.79%, 100=15.76% lat (msec) : 250=1.43% cpu : usr=0.14%, sys=11.40%, ctx=1758, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=174921: Sun Dec 7 06:22:44 2025 read: IOPS=15, BW=247KiB/s (253kB/s)(5744KiB/23272msec) clat (msec): min=2, max=173, avg=20.79, stdev=21.17 lat (msec): min=2, max=173, avg=20.79, stdev=21.17 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 4], 10.00th=[ 5], 20.00th=[ 6], | 30.00th=[ 7], 40.00th=[ 12], 50.00th=[ 15], 60.00th=[ 18], | 70.00th=[ 22], 80.00th=[ 31], 90.00th=[ 49], 95.00th=[ 65], | 99.00th=[ 100], 99.50th=[ 133], 99.90th=[ 174], 99.95th=[ 174], | 99.99th=[ 174] bw ( KiB/s): min= 63, max= 704, per=23.97%, avg=245.41, stdev=154.22, samples=46 iops : min= 3, max= 44, avg=14.78, stdev= 9.89, samples=46 write: IOPS=17, BW=281KiB/s (288kB/s)(6544KiB/23272msec); 0 zone resets clat (msec): min=13, max=160, avg=38.53, stdev=22.07 lat (msec): min=13, max=160, avg=38.54, stdev=22.07 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 17], 10.00th=[ 19], 20.00th=[ 21], | 30.00th=[ 24], 40.00th=[ 27], 50.00th=[ 33], 60.00th=[ 39], | 70.00th=[ 45], 80.00th=[ 53], 90.00th=[ 68], 95.00th=[ 81], | 99.00th=[ 118], 99.50th=[ 134], 99.90th=[ 161], 99.95th=[ 161], | 99.99th=[ 161] bw ( KiB/s): min= 127, max= 672, per=25.91%, avg=279.33, stdev=157.58, samples=46 iops : min= 7, max= 42, avg=16.89, stdev=10.12, samples=46 lat (msec) : 4=2.47%, 10=15.10%, 20=21.88%, 50=43.49%, 100=15.49% lat (msec) : 250=1.56% cpu : usr=0.11%, sys=11.84%, ctx=1750, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=174922: Sun Dec 7 06:22:44 2025 read: IOPS=16, BW=270KiB/s (276kB/s)(6256KiB/23180msec) clat (msec): min=2, max=129, avg=21.15, stdev=20.20 lat (msec): min=2, max=129, avg=21.15, stdev=20.20 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 4], 10.00th=[ 5], 20.00th=[ 6], | 30.00th=[ 8], 40.00th=[ 12], 50.00th=[ 16], 60.00th=[ 19], | 70.00th=[ 24], 80.00th=[ 32], 90.00th=[ 47], 95.00th=[ 61], | 99.00th=[ 112], 99.50th=[ 120], 99.90th=[ 130], 99.95th=[ 130], | 99.99th=[ 130] bw ( KiB/s): min= 95, max= 1024, per=26.18%, avg=268.11, stdev=179.41, samples=45 iops : min= 5, max= 64, avg=16.18, stdev=11.42, samples=45 write: IOPS=16, BW=260KiB/s (266kB/s)(6032KiB/23180msec); 0 zone resets clat (msec): min=13, max=165, avg=39.43, stdev=22.53 lat (msec): min=13, max=165, avg=39.43, stdev=22.53 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 18], 10.00th=[ 20], 20.00th=[ 23], | 30.00th=[ 26], 40.00th=[ 28], 50.00th=[ 33], 60.00th=[ 38], | 70.00th=[ 44], 80.00th=[ 55], 90.00th=[ 69], 95.00th=[ 84], | 99.00th=[ 118], 99.50th=[ 159], 99.90th=[ 165], 99.95th=[ 165], | 99.99th=[ 165] bw ( KiB/s): min= 126, max= 608, per=23.47%, avg=253.02, stdev=136.62, samples=45 iops : min= 7, max= 38, avg=15.24, stdev= 8.78, samples=45 lat (msec) : 4=3.39%, 10=15.36%, 20=18.88%, 50=46.61%, 100=13.93% lat (msec) : 250=1.82% cpu : usr=0.12%, sys=11.76%, ctx=1699, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=174923: Sun Dec 7 06:22:44 2025 read: IOPS=16, BW=258KiB/s (264kB/s)(6032KiB/23370msec) clat (msec): min=2, max=106, avg=21.06, stdev=19.17 lat (msec): min=2, max=106, avg=21.06, stdev=19.17 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 4], 10.00th=[ 5], 20.00th=[ 6], | 30.00th=[ 7], 40.00th=[ 11], 50.00th=[ 16], 60.00th=[ 19], | 70.00th=[ 26], 80.00th=[ 35], 90.00th=[ 51], 95.00th=[ 65], | 99.00th=[ 80], 99.50th=[ 83], 99.90th=[ 107], 99.95th=[ 107], | 99.99th=[ 107] bw ( KiB/s): min= 63, max= 736, per=24.90%, avg=254.96, stdev=166.04, samples=46 iops : min= 3, max= 46, avg=15.37, stdev=10.57, samples=46 write: IOPS=16, BW=268KiB/s (274kB/s)(6256KiB/23370msec); 0 zone resets clat (msec): min=11, max=166, avg=39.38, stdev=23.23 lat (msec): min=11, max=166, avg=39.39, stdev=23.22 clat percentiles (msec): | 1.00th=[ 15], 5.00th=[ 17], 10.00th=[ 19], 20.00th=[ 22], | 30.00th=[ 25], 40.00th=[ 28], 50.00th=[ 33], 60.00th=[ 37], | 70.00th=[ 44], 80.00th=[ 55], 90.00th=[ 72], 95.00th=[ 85], | 99.00th=[ 129], 99.50th=[ 157], 99.90th=[ 167], 99.95th=[ 167], | 99.99th=[ 167] bw ( KiB/s): min= 95, max= 640, per=24.44%, avg=263.48, stdev=148.40, samples=46 iops : min= 5, max= 40, avg=15.91, stdev= 9.59, samples=46 lat (msec) : 4=4.30%, 10=14.58%, 20=20.44%, 50=43.62%, 100=15.76% lat (msec) : 250=1.30% cpu : usr=0.12%, sys=11.84%, ctx=1769, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1025KiB/s (1050kB/s), 247KiB/s-270KiB/s (253kB/s-276kB/s), io=23.4MiB (24.5MB), run=23180-23370msec WRITE: bw=1078KiB/s (1104kB/s), 260KiB/s-281KiB/s (266kB/s-288kB/s), io=24.6MiB (25.8MB), run=23180-23370msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=174939: Sun Dec 7 06:22:54 2025 read: IOPS=1, BW=1969KiB/s (2016kB/s)(7168KiB/3640msec) clat (usec): min=1019, max=425399, avg=214058.28, stdev=139177.60 lat (usec): min=1021, max=425400, avg=214059.72, stdev=139177.55 clat percentiles (usec): | 1.00th=[ 1020], 5.00th=[ 1020], 10.00th=[ 1020], 20.00th=[135267], | 30.00th=[158335], 40.00th=[158335], 50.00th=[177210], 60.00th=[299893], | 70.00th=[299893], 80.00th=[304088], 90.00th=[425722], 95.00th=[425722], | 99.00th=[425722], 99.50th=[425722], 99.90th=[425722], 99.95th=[425722], | 99.99th=[425722] bw ( KiB/s): min= 1965, max= 4063, per=62.92%, avg=3028.75, stdev=1180.92, samples=4 iops : min= 1, max= 3, avg= 2.25, stdev= 0.96, samples=4 write: IOPS=1, BW=1407KiB/s (1440kB/s)(5120KiB/3640msec); 0 zone resets clat (msec): min=209, max=632, avg=424.79, stdev=182.49 lat (msec): min=209, max=632, avg=424.85, stdev=182.49 clat percentiles (msec): | 1.00th=[ 211], 5.00th=[ 211], 10.00th=[ 211], 20.00th=[ 211], | 30.00th=[ 296], 40.00th=[ 296], 50.00th=[ 401], 60.00th=[ 401], | 70.00th=[ 584], 80.00th=[ 584], 90.00th=[ 634], 95.00th=[ 634], | 99.00th=[ 634], 99.50th=[ 634], 99.90th=[ 634], 99.95th=[ 634], | 99.99th=[ 634] bw ( KiB/s): min= 1756, max= 2048, per=29.22%, avg=1969.50, stdev=142.51, samples=4 iops : min= 1, max= 2, avg= 1.25, stdev= 0.50, samples=4 lat (msec) : 2=8.33%, 250=33.33%, 500=41.67%, 750=16.67% cpu : usr=0.00%, sys=46.28%, ctx=716, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=174940: Sun Dec 7 06:22:54 2025 read: IOPS=0, BW=481KiB/s (493kB/s)(2048KiB/4254msec) clat (usec): min=1135, max=154939, avg=78037.23, stdev=108755.90 lat (usec): min=1135, max=154942, avg=78038.98, stdev=108757.32 clat percentiles (usec): | 1.00th=[ 1139], 5.00th=[ 1139], 10.00th=[ 1139], 20.00th=[ 1139], | 30.00th=[ 1139], 40.00th=[ 1139], 50.00th=[ 1139], 60.00th=[154141], | 70.00th=[154141], 80.00th=[154141], 90.00th=[154141], 95.00th=[154141], | 99.00th=[154141], 99.50th=[154141], 99.90th=[154141], 99.95th=[154141], | 99.99th=[154141] bw ( KiB/s): min= 1984, max= 2048, per=41.88%, avg=2016.00, stdev=45.25, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 write: IOPS=2, BW=2407KiB/s (2465kB/s)(10.0MiB/4254msec); 0 zone resets clat (msec): min=204, max=725, avg=408.54, stdev=178.39 lat (msec): min=204, max=725, avg=408.64, stdev=178.39 clat percentiles (msec): | 1.00th=[ 205], 5.00th=[ 205], 10.00th=[ 205], 20.00th=[ 220], | 30.00th=[ 266], 40.00th=[ 292], 50.00th=[ 368], 60.00th=[ 388], | 70.00th=[ 447], 80.00th=[ 542], 90.00th=[ 642], 95.00th=[ 726], | 99.00th=[ 726], 99.50th=[ 726], 99.90th=[ 726], 99.95th=[ 726], | 99.99th=[ 726] bw ( KiB/s): min= 1756, max= 4079, per=37.73%, avg=2542.86, stdev=987.60, samples=7 iops : min= 1, max= 3, avg= 1.71, stdev= 0.95, samples=7 lat (msec) : 2=8.33%, 250=25.00%, 500=41.67%, 750=25.00% cpu : usr=0.00%, sys=44.44%, ctx=430, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=174942: Sun Dec 7 06:22:54 2025 read: IOPS=1, BW=1756KiB/s (1798kB/s)(6144KiB/3499msec) clat (msec): min=39, max=320, avg=190.13, stdev=110.82 lat (msec): min=39, max=320, avg=190.13, stdev=110.82 clat percentiles (msec): | 1.00th=[ 40], 5.00th=[ 40], 10.00th=[ 40], 20.00th=[ 111], | 30.00th=[ 111], 40.00th=[ 134], 50.00th=[ 134], 60.00th=[ 268], | 70.00th=[ 271], 80.00th=[ 271], 90.00th=[ 321], 95.00th=[ 321], | 99.00th=[ 321], 99.50th=[ 321], 99.90th=[ 321], 99.95th=[ 321], | 99.99th=[ 321] bw ( KiB/s): min= 1765, max= 3923, per=50.74%, avg=2442.75, stdev=995.42, samples=4 iops : min= 1, max= 3, avg= 1.75, stdev= 0.96, samples=4 write: IOPS=1, BW=1756KiB/s (1798kB/s)(6144KiB/3499msec); 0 zone resets clat (msec): min=199, max=562, avg=389.80, stdev=144.36 lat (msec): min=199, max=562, avg=389.89, stdev=144.37 clat percentiles (msec): | 1.00th=[ 201], 5.00th=[ 201], 10.00th=[ 201], 20.00th=[ 230], | 30.00th=[ 230], 40.00th=[ 414], 50.00th=[ 414], 60.00th=[ 447], | 70.00th=[ 485], 80.00th=[ 485], 90.00th=[ 567], 95.00th=[ 567], | 99.00th=[ 567], 99.50th=[ 567], 99.90th=[ 567], 99.95th=[ 567], | 99.99th=[ 567] bw ( KiB/s): min= 1765, max= 2745, per=31.58%, avg=2128.20, stdev=365.34, samples=5 iops : min= 1, max= 2, avg= 1.60, stdev= 0.55, samples=5 lat (msec) : 50=8.33%, 250=33.33%, 500=50.00%, 750=8.33% cpu : usr=0.00%, sys=40.14%, ctx=161, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=174944: Sun Dec 7 06:22:54 2025 read: IOPS=1, BW=1571KiB/s (1608kB/s)(5120KiB/3260msec) clat (usec): min=710, max=361830, avg=143340.51, stdev=195119.71 lat (usec): min=711, max=361831, avg=143341.61, stdev=195119.97 clat percentiles (usec): | 1.00th=[ 709], 5.00th=[ 709], 10.00th=[ 709], 20.00th=[ 709], | 30.00th=[ 857], 40.00th=[ 857], 50.00th=[ 1029], 60.00th=[ 1029], | 70.00th=[350225], 80.00th=[350225], 90.00th=[362808], 95.00th=[362808], | 99.00th=[362808], 99.50th=[362808], 99.90th=[362808], 99.95th=[362808], | 99.99th=[362808] bw ( KiB/s): min= 2035, max= 5296, per=76.14%, avg=3665.50, stdev=2305.88, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 write: IOPS=2, BW=2199KiB/s (2252kB/s)(7168KiB/3260msec); 0 zone resets clat (msec): min=203, max=539, avg=357.58, stdev=121.41 lat (msec): min=203, max=539, avg=357.66, stdev=121.39 clat percentiles (msec): | 1.00th=[ 203], 5.00th=[ 203], 10.00th=[ 203], 20.00th=[ 213], | 30.00th=[ 355], 40.00th=[ 355], 50.00th=[ 368], 60.00th=[ 368], | 70.00th=[ 368], 80.00th=[ 460], 90.00th=[ 542], 95.00th=[ 542], | 99.00th=[ 542], 99.50th=[ 542], 99.90th=[ 542], 99.95th=[ 542], | 99.99th=[ 542] bw ( KiB/s): min= 1372, max= 4096, per=34.10%, avg=2298.50, stdev=1223.10, samples=4 iops : min= 1, max= 4, avg= 1.75, stdev= 1.50, samples=4 lat (usec) : 750=8.33%, 1000=8.33% lat (msec) : 2=8.33%, 250=16.67%, 500=50.00%, 750=8.33% cpu : usr=0.00%, sys=49.25%, ctx=142, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4814KiB/s (4930kB/s), 481KiB/s-1969KiB/s (493kB/s-2016kB/s), io=20.0MiB (20.0MB), run=3260-4254msec WRITE: bw=6740KiB/s (6902kB/s), 1407KiB/s-2407KiB/s (1440kB/s-2465kB/s), io=28.0MiB (29.4MB), run=3260-4254msec rand-rw: (groupid=0, jobs=1): err= 0: pid=174941: Sun Dec 7 06:22:54 2025 read: IOPS=1, BW=1794KiB/s (1837kB/s)(7168KiB/3996msec) clat (msec): min=76, max=357, avg=216.54, stdev=93.09 lat (msec): min=76, max=357, avg=216.54, stdev=93.09 clat percentiles (msec): | 1.00th=[ 77], 5.00th=[ 77], 10.00th=[ 77], 20.00th=[ 130], | 30.00th=[ 209], 40.00th=[ 209], 50.00th=[ 220], 60.00th=[ 245], | 70.00th=[ 245], 80.00th=[ 279], 90.00th=[ 359], 95.00th=[ 359], | 99.00th=[ 359], 99.50th=[ 359], 99.90th=[ 359], 99.95th=[ 359], | 99.99th=[ 359] bw ( KiB/s): min= 1756, max= 4007, per=52.39%, avg=2463.50, stdev=1038.01, samples=4 iops : min= 1, max= 3, avg= 1.75, stdev= 0.96, samples=4 write: IOPS=1, BW=1281KiB/s (1312kB/s)(5120KiB/3996msec); 0 zone resets clat (msec): min=247, max=754, avg=488.96, stdev=201.68 lat (msec): min=247, max=754, avg=489.07, stdev=201.68 clat percentiles (msec): | 1.00th=[ 247], 5.00th=[ 247], 10.00th=[ 247], 20.00th=[ 247], | 30.00th=[ 342], 40.00th=[ 342], 50.00th=[ 510], 60.00th=[ 510], | 70.00th=[ 592], 80.00th=[ 592], 90.00th=[ 751], 95.00th=[ 751], | 99.00th=[ 751], 99.50th=[ 751], 99.90th=[ 751], 99.95th=[ 751], | 99.99th=[ 751] bw ( KiB/s): min= 1756, max= 2048, per=29.75%, avg=1958.75, stdev=137.38, samples=4 iops : min= 1, max= 2, avg= 1.25, stdev= 0.50, samples=4 lat (msec) : 100=8.33%, 250=41.67%, 500=25.00%, 750=16.67%, 1000=8.33% cpu : usr=0.05%, sys=18.72%, ctx=170, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=174943: Sun Dec 7 06:22:54 2025 read: IOPS=0, BW=472KiB/s (483kB/s)(2048KiB/4338msec) clat (msec): min=137, max=159, avg=148.50, stdev=16.14 lat (msec): min=137, max=159, avg=148.50, stdev=16.14 clat percentiles (msec): | 1.00th=[ 138], 5.00th=[ 138], 10.00th=[ 138], 20.00th=[ 138], | 30.00th=[ 138], 40.00th=[ 138], 50.00th=[ 138], 60.00th=[ 161], | 70.00th=[ 161], 80.00th=[ 161], 90.00th=[ 161], 95.00th=[ 161], | 99.00th=[ 161], 99.50th=[ 161], 99.90th=[ 161], 99.95th=[ 161], | 99.99th=[ 161] bw ( KiB/s): min= 1367, max= 1935, per=35.11%, avg=1651.00, stdev=401.64, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2361KiB/s (2417kB/s)(10.0MiB/4338msec); 0 zone resets clat (msec): min=65, max=1152, avg=395.67, stdev=376.18 lat (msec): min=65, max=1152, avg=395.77, stdev=376.18 clat percentiles (msec): | 1.00th=[ 66], 5.00th=[ 66], 10.00th=[ 66], 20.00th=[ 85], | 30.00th=[ 94], 40.00th=[ 199], 50.00th=[ 211], 60.00th=[ 284], | 70.00th=[ 351], 80.00th=[ 600], 90.00th=[ 919], 95.00th=[ 1150], | 99.00th=[ 1150], 99.50th=[ 1150], 99.90th=[ 1150], 99.95th=[ 1150], | 99.99th=[ 1150] bw ( KiB/s): min= 1765, max= 3976, per=36.88%, avg=2427.75, stdev=1038.17, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (msec) : 100=25.00%, 250=33.33%, 500=16.67%, 750=8.33%, 1000=8.33% lat (msec) : 2000=8.33% cpu : usr=0.00%, sys=19.25%, ctx=224, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=174945: Sun Dec 7 06:22:54 2025 read: IOPS=1, BW=1568KiB/s (1605kB/s)(6144KiB/3919msec) clat (msec): min=82, max=431, avg=200.12, stdev=132.27 lat (msec): min=82, max=431, avg=200.12, stdev=132.27 clat percentiles (msec): | 1.00th=[ 83], 5.00th=[ 83], 10.00th=[ 83], 20.00th=[ 106], | 30.00th=[ 106], 40.00th=[ 109], 50.00th=[ 109], 60.00th=[ 226], | 70.00th=[ 247], 80.00th=[ 247], 90.00th=[ 430], 95.00th=[ 430], | 99.00th=[ 430], 99.50th=[ 430], 99.90th=[ 430], 99.95th=[ 430], | 99.99th=[ 430] bw ( KiB/s): min= 1935, max= 4096, per=67.79%, avg=3187.33, stdev=1120.74, samples=3 iops : min= 1, max= 4, avg= 2.67, stdev= 1.53, samples=3 write: IOPS=1, BW=1568KiB/s (1605kB/s)(6144KiB/3919msec); 0 zone resets clat (msec): min=211, max=941, avg=439.34, stdev=275.91 lat (msec): min=211, max=941, avg=439.44, stdev=275.93 clat percentiles (msec): | 1.00th=[ 211], 5.00th=[ 211], 10.00th=[ 211], 20.00th=[ 262], | 30.00th=[ 262], 40.00th=[ 300], 50.00th=[ 300], 60.00th=[ 351], | 70.00th=[ 575], 80.00th=[ 575], 90.00th=[ 944], 95.00th=[ 944], | 99.00th=[ 944], 99.50th=[ 944], 99.90th=[ 944], 99.95th=[ 944], | 99.99th=[ 944] bw ( KiB/s): min= 1988, max= 3871, per=36.43%, avg=2398.00, stdev=823.80, samples=5 iops : min= 1, max= 3, avg= 1.80, stdev= 0.84, samples=5 lat (msec) : 100=8.33%, 250=41.67%, 500=33.33%, 750=8.33%, 1000=8.33% cpu : usr=0.00%, sys=18.04%, ctx=166, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=174946: Sun Dec 7 06:22:54 2025 read: IOPS=1, BW=1176KiB/s (1204kB/s)(5120KiB/4355msec) clat (msec): min=21, max=951, avg=301.15, stdev=379.18 lat (msec): min=21, max=951, avg=301.15, stdev=379.18 clat percentiles (msec): | 1.00th=[ 22], 5.00th=[ 22], 10.00th=[ 22], 20.00th=[ 22], | 30.00th=[ 67], 40.00th=[ 67], 50.00th=[ 161], 60.00th=[ 161], | 70.00th=[ 305], 80.00th=[ 305], 90.00th=[ 953], 95.00th=[ 953], | 99.00th=[ 953], 99.50th=[ 953], 99.90th=[ 953], 99.95th=[ 953], | 99.99th=[ 953] bw ( KiB/s): min= 3531, max= 3871, per=78.71%, avg=3701.00, stdev=240.42, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1646KiB/s (1685kB/s)(7168KiB/4355msec); 0 zone resets clat (msec): min=62, max=847, avg=396.81, stdev=307.65 lat (msec): min=62, max=847, avg=396.91, stdev=307.65 clat percentiles (msec): | 1.00th=[ 64], 5.00th=[ 64], 10.00th=[ 64], 20.00th=[ 80], | 30.00th=[ 174], 40.00th=[ 174], 50.00th=[ 372], 60.00th=[ 600], | 70.00th=[ 600], 80.00th=[ 642], 90.00th=[ 852], 95.00th=[ 852], | 99.00th=[ 852], 99.50th=[ 852], 99.90th=[ 852], 99.95th=[ 852], | 99.99th=[ 852] bw ( KiB/s): min= 1765, max= 3976, per=39.44%, avg=2596.33, stdev=1203.18, samples=3 iops : min= 1, max= 3, avg= 2.00, stdev= 1.00, samples=3 lat (msec) : 50=8.33%, 100=25.00%, 250=16.67%, 500=16.67%, 750=16.67% lat (msec) : 1000=16.67% cpu : usr=0.00%, sys=15.82%, ctx=171, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4703KiB/s (4816kB/s), 472KiB/s-1794KiB/s (483kB/s-1837kB/s), io=20.0MiB (20.0MB), run=3919-4355msec WRITE: bw=6584KiB/s (6742kB/s), 1281KiB/s-2361KiB/s (1312kB/s-2417kB/s), io=28.0MiB (29.4MB), run=3919-4355msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=174957: Sun Dec 7 06:23:02 2025 read: IOPS=1, BW=7511KiB/s (7691kB/s)(12.0MiB/1636msec) clat (msec): min=518, max=560, avg=538.65, stdev=20.73 lat (msec): min=518, max=560, avg=538.65, stdev=20.73 clat percentiles (msec): | 1.00th=[ 518], 5.00th=[ 518], 10.00th=[ 518], 20.00th=[ 518], | 30.00th=[ 518], 40.00th=[ 542], 50.00th=[ 542], 60.00th=[ 542], | 70.00th=[ 558], 80.00th=[ 558], 90.00th=[ 558], 95.00th=[ 558], | 99.00th=[ 558], 99.50th=[ 558], 99.90th=[ 558], 99.95th=[ 558], | 99.99th=[ 558] bw ( KiB/s): min= 7846, max= 8192, per=100.00%, avg=8019.00, stdev=244.66, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 750=100.00% cpu : usr=0.06%, sys=59.57%, ctx=2638, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=174958: Sun Dec 7 06:23:02 2025 read: IOPS=0, BW=1817KiB/s (1861kB/s)(4096KiB/2254msec) clat (nsec): min=583467k, max=583467k, avg=583466623.00, stdev= 0.00 lat (nsec): min=583470k, max=583470k, avg=583469590.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 584], 5.00th=[ 584], 10.00th=[ 584], 20.00th=[ 584], | 30.00th=[ 584], 40.00th=[ 584], 50.00th=[ 584], 60.00th=[ 584], | 70.00th=[ 584], 80.00th=[ 584], 90.00th=[ 584], 95.00th=[ 584], | 99.00th=[ 584], 99.50th=[ 584], 99.90th=[ 584], 99.95th=[ 584], | 99.99th=[ 584] bw ( KiB/s): min= 8192, max= 8192, per=100.00%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 write: IOPS=0, BW=3634KiB/s (3722kB/s)(8192KiB/2254msec); 0 zone resets clat (msec): min=726, max=917, avg=821.90, stdev=134.53 lat (msec): min=727, max=917, avg=822.33, stdev=134.58 clat percentiles (msec): | 1.00th=[ 726], 5.00th=[ 726], 10.00th=[ 726], 20.00th=[ 726], | 30.00th=[ 726], 40.00th=[ 726], 50.00th=[ 726], 60.00th=[ 919], | 70.00th=[ 919], 80.00th=[ 919], 90.00th=[ 919], 95.00th=[ 919], | 99.00th=[ 919], 99.50th=[ 919], 99.90th=[ 919], 99.95th=[ 919], | 99.99th=[ 919] bw ( KiB/s): min= 7846, max= 7846, per=53.97%, avg=7846.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=66.67%, 1000=33.33% cpu : usr=0.09%, sys=15.62%, ctx=694, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=174959: Sun Dec 7 06:23:02 2025 write: IOPS=1, BW=5538KiB/s (5671kB/s)(12.0MiB/2219msec); 0 zone resets clat (msec): min=192, max=1391, avg=729.77, stdev=609.52 lat (msec): min=192, max=1392, avg=730.16, stdev=609.54 clat percentiles (msec): | 1.00th=[ 192], 5.00th=[ 192], 10.00th=[ 192], 20.00th=[ 192], | 30.00th=[ 192], 40.00th=[ 609], 50.00th=[ 609], 60.00th=[ 609], | 70.00th=[ 1385], 80.00th=[ 1385], 90.00th=[ 1385], 95.00th=[ 1385], | 99.00th=[ 1385], 99.50th=[ 1385], 99.90th=[ 1385], 99.95th=[ 1385], | 99.99th=[ 1385] bw ( KiB/s): min= 7846, max= 8192, per=55.16%, avg=8019.00, stdev=244.66, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 250=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.05%, sys=16.73%, ctx=85, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=174960: Sun Dec 7 06:23:02 2025 write: IOPS=1, BW=6203KiB/s (6352kB/s)(12.0MiB/1981msec); 0 zone resets clat (msec): min=434, max=1081, avg=653.54, stdev=370.44 lat (msec): min=435, max=1081, avg=654.05, stdev=370.60 clat percentiles (msec): | 1.00th=[ 435], 5.00th=[ 435], 10.00th=[ 435], 20.00th=[ 435], | 30.00th=[ 435], 40.00th=[ 443], 50.00th=[ 443], 60.00th=[ 443], | 70.00th=[ 1083], 80.00th=[ 1083], 90.00th=[ 1083], 95.00th=[ 1083], | 99.00th=[ 1083], 99.50th=[ 1083], 99.90th=[ 1083], 99.95th=[ 1083], | 99.99th=[ 1083] bw ( KiB/s): min= 8094, max= 8094, per=55.68%, avg=8094.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=66.67%, 2000=33.33% cpu : usr=0.00%, sys=18.99%, ctx=59, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=7269KiB/s (7443kB/s), 1817KiB/s-7511KiB/s (1861kB/s-7691kB/s), io=16.0MiB (16.8MB), run=1636-2254msec WRITE: bw=14.2MiB/s (14.9MB/s), 3634KiB/s-6203KiB/s (3722kB/s-6352kB/s), io=32.0MiB (33.6MB), run=1981-2254msec rand-rw: (groupid=0, jobs=1): err= 0: pid=174953: Sun Dec 7 06:23:02 2025 read: IOPS=1, BW=5945KiB/s (6088kB/s)(12.0MiB/2067msec) clat (msec): min=218, max=1045, avg=676.78, stdev=421.04 lat (msec): min=218, max=1045, avg=676.78, stdev=421.04 clat percentiles (msec): | 1.00th=[ 220], 5.00th=[ 220], 10.00th=[ 220], 20.00th=[ 220], | 30.00th=[ 220], 40.00th=[ 768], 50.00th=[ 768], 60.00th=[ 768], | 70.00th=[ 1045], 80.00th=[ 1045], 90.00th=[ 1045], 95.00th=[ 1045], | 99.00th=[ 1045], 99.50th=[ 1045], 99.90th=[ 1045], 99.95th=[ 1045], | 99.99th=[ 1045] bw ( KiB/s): min= 8062, max= 8159, per=100.00%, avg=8110.50, stdev=68.59, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 250=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=14.13%, ctx=70, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=174954: Sun Dec 7 06:23:02 2025 read: IOPS=0, BW=1744KiB/s (1786kB/s)(4096KiB/2348msec) clat (nsec): min=928291k, max=928291k, avg=928290702.00, stdev= 0.00 lat (nsec): min=928293k, max=928293k, avg=928293199.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 927], 5.00th=[ 927], 10.00th=[ 927], 20.00th=[ 927], | 30.00th=[ 927], 40.00th=[ 927], 50.00th=[ 927], 60.00th=[ 927], | 70.00th=[ 927], 80.00th=[ 927], 90.00th=[ 927], 95.00th=[ 927], | 99.00th=[ 927], 99.50th=[ 927], 99.90th=[ 927], 99.95th=[ 927], | 99.99th=[ 927] bw ( KiB/s): min= 8175, max= 8175, per=100.00%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=3489KiB/s (3573kB/s)(8192KiB/2348msec); 0 zone resets clat (msec): min=444, max=948, avg=696.34, stdev=356.06 lat (msec): min=444, max=948, avg=696.74, stdev=356.11 clat percentiles (msec): | 1.00th=[ 443], 5.00th=[ 443], 10.00th=[ 443], 20.00th=[ 443], | 30.00th=[ 443], 40.00th=[ 443], 50.00th=[ 443], 60.00th=[ 953], | 70.00th=[ 953], 80.00th=[ 953], 90.00th=[ 953], 95.00th=[ 953], | 99.00th=[ 953], 99.50th=[ 953], 99.90th=[ 953], 99.95th=[ 953], | 99.99th=[ 953] bw ( KiB/s): min= 8062, max= 8062, per=57.77%, avg=8062.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 1000=66.67% cpu : usr=0.04%, sys=17.04%, ctx=77, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=174955: Sun Dec 7 06:23:02 2025 write: IOPS=2, BW=10.5MiB/s (11.0MB/s)(12.0MiB/1139msec); 0 zone resets clat (msec): min=177, max=594, avg=371.49, stdev=210.14 lat (msec): min=177, max=595, avg=371.86, stdev=210.26 clat percentiles (msec): | 1.00th=[ 178], 5.00th=[ 178], 10.00th=[ 178], 20.00th=[ 178], | 30.00th=[ 178], 40.00th=[ 342], 50.00th=[ 342], 60.00th=[ 342], | 70.00th=[ 592], 80.00th=[ 592], 90.00th=[ 592], 95.00th=[ 592], | 99.00th=[ 592], 99.50th=[ 592], 99.90th=[ 592], 99.95th=[ 592], | 99.99th=[ 592] bw ( KiB/s): min=14760, max=14760, per=100.00%, avg=14760.00, stdev= 0.00, samples=1 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 500=33.33%, 750=33.33% cpu : usr=0.09%, sys=28.38%, ctx=102, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=174956: Sun Dec 7 06:23:02 2025 write: IOPS=1, BW=6599KiB/s (6758kB/s)(12.0MiB/1862msec); 0 zone resets clat (msec): min=195, max=938, avg=610.38, stdev=379.30 lat (msec): min=195, max=939, avg=610.90, stdev=379.51 clat percentiles (msec): | 1.00th=[ 197], 5.00th=[ 197], 10.00th=[ 197], 20.00th=[ 197], | 30.00th=[ 197], 40.00th=[ 701], 50.00th=[ 701], 60.00th=[ 701], | 70.00th=[ 936], 80.00th=[ 936], 90.00th=[ 936], 95.00th=[ 936], | 99.00th=[ 936], 99.50th=[ 936], 99.90th=[ 936], 99.95th=[ 936], | 99.99th=[ 936] bw ( KiB/s): min= 7433, max= 8159, per=55.87%, avg=7796.00, stdev=513.36, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 250=33.33%, 750=33.33%, 1000=33.33% cpu : usr=0.11%, sys=16.87%, ctx=64, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=6978KiB/s (7145kB/s), 1744KiB/s-5945KiB/s (1786kB/s-6088kB/s), io=16.0MiB (16.8MB), run=2067-2348msec WRITE: bw=13.6MiB/s (14.3MB/s), 3489KiB/s-10.5MiB/s (3573kB/s-11.0MB/s), io=32.0MiB (33.6MB), run=1139-2348msec