== sanity test 398b: DIO and buffer IO race ============== 16:57:15 (1786309035) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 4.91491 s, 10.2 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144617: Sun Aug 9 16:59:28 2026 read: IOPS=12, BW=51.9KiB/s (53.2kB/s)(5992KiB/115375msec) clat (usec): min=26, max=404335, avg=36678.65, stdev=29750.81 lat (usec): min=26, max=404336, avg=36682.12, stdev=29750.49 clat percentiles (usec): | 1.00th=[ 48], 5.00th=[ 57], 10.00th=[ 77], 20.00th=[ 16909], | 30.00th=[ 21365], 40.00th=[ 26608], 50.00th=[ 31589], 60.00th=[ 37487], | 70.00th=[ 45351], 80.00th=[ 53740], 90.00th=[ 68682], 95.00th=[ 85459], | 99.00th=[135267], 99.50th=[168821], 99.90th=[304088], 99.95th=[404751], | 99.99th=[404751] bw ( KiB/s): min= 7, max= 119, per=24.75%, avg=51.23, stdev=22.82, samples=227 iops : min= 1, max= 29, avg=12.18, stdev= 5.75, samples=227 write: IOPS=13, BW=54.6KiB/s (55.9kB/s)(6296KiB/115375msec); 0 zone resets clat (usec): min=953, max=255310, avg=38293.84, stdev=38914.66 lat (usec): min=954, max=255311, avg=38296.47, stdev=38914.98 clat percentiles (usec): | 1.00th=[ 1221], 5.00th=[ 1369], 10.00th=[ 1663], 20.00th=[ 4359], | 30.00th=[ 8979], 40.00th=[ 18482], 50.00th=[ 28967], 60.00th=[ 39584], | 70.00th=[ 50070], 80.00th=[ 65799], 90.00th=[ 88605], 95.00th=[110625], | 99.00th=[185598], 99.50th=[208667], 99.90th=[248513], 99.95th=[254804], | 99.99th=[254804] bw ( KiB/s): min= 7, max= 168, per=24.86%, avg=53.96, stdev=22.42, samples=227 iops : min= 1, max= 42, avg=12.86, stdev= 5.66, samples=227 lat (usec) : 50=0.72%, 100=4.52%, 250=0.26%, 500=0.07%, 750=0.03% lat (usec) : 1000=0.10% lat (msec) : 2=6.22%, 4=3.71%, 10=6.84%, 20=11.69%, 50=38.96% lat (msec) : 100=21.81%, 250=4.98%, 500=0.10% cpu : usr=0.08%, sys=5.73%, ctx=6494, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144618: Sun Aug 9 16:59:28 2026 read: IOPS=13, BW=52.1KiB/s (53.3kB/s)(5940KiB/114108msec) clat (usec): min=32, max=362289, avg=35251.17, stdev=27037.77 lat (usec): min=32, max=362291, avg=35256.92, stdev=27036.40 clat percentiles (usec): | 1.00th=[ 48], 5.00th=[ 58], 10.00th=[ 74], 20.00th=[ 15664], | 30.00th=[ 20841], 40.00th=[ 25297], 50.00th=[ 30802], 60.00th=[ 36963], | 70.00th=[ 44827], 80.00th=[ 54264], 90.00th=[ 67634], 95.00th=[ 80217], | 99.00th=[115868], 99.50th=[122160], 99.90th=[212861], 99.95th=[362808], | 99.99th=[362808] bw ( KiB/s): min= 5, max= 119, per=25.03%, avg=51.81, stdev=20.63, samples=224 iops : min= 1, max= 29, avg=12.33, stdev= 5.21, samples=224 write: IOPS=13, BW=55.6KiB/s (56.0kB/s)(6348KiB/114108msec); 0 zone resets clat (usec): min=1006, max=334186, avg=38803.61, stdev=39511.22 lat (usec): min=1007, max=335412, avg=38807.41, stdev=39516.08 clat percentiles (usec): | 1.00th=[ 1205], 5.00th=[ 1385], 10.00th=[ 1876], 20.00th=[ 4752], | 30.00th=[ 9372], 40.00th=[ 19530], 50.00th=[ 29492], 60.00th=[ 38536], | 70.00th=[ 51119], 80.00th=[ 65799], 90.00th=[ 87557], 95.00th=[111674], | 99.00th=[187696], 99.50th=[210764], 99.90th=[312476], 99.95th=[333448], | 99.99th=[333448] bw ( KiB/s): min= 7, max= 133, per=25.42%, avg=55.16, stdev=24.04, samples=225 iops : min= 1, max= 33, avg=13.17, stdev= 6.05, samples=225 lat (usec) : 50=0.65%, 100=4.92%, 250=0.26%, 500=0.10%, 1000=0.03% lat (msec) : 2=5.57%, 4=3.87%, 10=7.06%, 20=12.27%, 50=37.63% lat (msec) : 100=23.05%, 250=4.43%, 500=0.16% cpu : usr=0.08%, sys=5.79%, ctx=6447, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144619: Sun Aug 9 16:59:28 2026 read: IOPS=13, BW=52.6KiB/s (53.8kB/s)(6028KiB/114672msec) clat (usec): min=31, max=231970, avg=35075.55, stdev=26676.92 lat (usec): min=32, max=231972, avg=35078.10, stdev=26677.01 clat percentiles (usec): | 1.00th=[ 49], 5.00th=[ 57], 10.00th=[ 75], 20.00th=[ 15795], | 30.00th=[ 20317], 40.00th=[ 25035], 50.00th=[ 29492], 60.00th=[ 34866], | 70.00th=[ 43254], 80.00th=[ 53216], 90.00th=[ 68682], 95.00th=[ 85459], | 99.00th=[115868], 99.50th=[141558], 99.90th=[191890], 99.95th=[231736], | 99.99th=[231736] bw ( KiB/s): min= 7, max= 127, per=25.44%, avg=52.65, stdev=23.42, samples=224 iops : min= 1, max= 31, avg=12.53, stdev= 5.88, samples=224 write: IOPS=13, BW=54.6KiB/s (55.9kB/s)(6260KiB/114672msec); 0 zone resets clat (usec): min=843, max=464639, avg=39397.78, stdev=39778.34 lat (usec): min=844, max=464643, avg=39399.84, stdev=39778.53 clat percentiles (usec): | 1.00th=[ 1188], 5.00th=[ 1369], 10.00th=[ 1827], 20.00th=[ 4752], | 30.00th=[ 10290], 40.00th=[ 21365], 50.00th=[ 31065], 60.00th=[ 40633], | 70.00th=[ 51119], 80.00th=[ 65799], 90.00th=[ 88605], 95.00th=[109577], | 99.00th=[170918], 99.50th=[191890], 99.90th=[350225], 99.95th=[463471], | 99.99th=[463471] bw ( KiB/s): min= 7, max= 142, per=24.97%, avg=54.19, stdev=21.72, samples=226 iops : min= 1, max= 35, avg=12.92, stdev= 5.44, samples=226 lat (usec) : 50=0.59%, 100=4.72%, 250=0.33%, 500=0.10%, 750=0.07% lat (usec) : 1000=0.20% lat (msec) : 2=5.63%, 4=3.68%, 10=6.25%, 20=12.50%, 50=38.74% lat (msec) : 100=22.59%, 250=4.49%, 500=0.13% cpu : usr=0.07%, sys=5.95%, ctx=6509, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144620: Sun Aug 9 16:59:28 2026 read: IOPS=13, BW=52.3KiB/s (53.6kB/s)(6052KiB/115641msec) clat (usec): min=30, max=456018, avg=36268.25, stdev=28224.53 lat (usec): min=30, max=456019, avg=36271.32, stdev=28227.05 clat percentiles (usec): | 1.00th=[ 45], 5.00th=[ 58], 10.00th=[ 74], 20.00th=[ 16581], | 30.00th=[ 21890], 40.00th=[ 26608], 50.00th=[ 31589], 60.00th=[ 37487], | 70.00th=[ 44827], 80.00th=[ 54789], 90.00th=[ 70779], 95.00th=[ 85459], | 99.00th=[116917], 99.50th=[145753], 99.90th=[179307], 99.95th=[455082], | 99.99th=[455082] bw ( KiB/s): min= 7, max= 140, per=25.29%, avg=52.36, stdev=22.96, samples=226 iops : min= 1, max= 35, avg=12.46, stdev= 5.78, samples=226 write: IOPS=13, BW=53.9KiB/s (55.2kB/s)(6236KiB/115641msec); 0 zone resets clat (usec): min=915, max=509329, avg=38857.60, stdev=42012.98 lat (usec): min=917, max=509332, avg=38860.23, stdev=42014.03 clat percentiles (usec): | 1.00th=[ 1205], 5.00th=[ 1336], 10.00th=[ 1663], 20.00th=[ 4293], | 30.00th=[ 8848], 40.00th=[ 18482], 50.00th=[ 27919], 60.00th=[ 38011], | 70.00th=[ 49021], 80.00th=[ 66323], 90.00th=[ 92799], 95.00th=[113771], | 99.00th=[173016], 99.50th=[221250], 99.90th=[417334], 99.95th=[509608], | 99.99th=[509608] bw ( KiB/s): min= 7, max= 125, per=24.62%, avg=53.42, stdev=21.91, samples=228 iops : min= 1, max= 31, avg=12.73, stdev= 5.52, samples=228 lat (usec) : 50=0.88%, 100=4.69%, 250=0.20%, 500=0.07%, 750=0.03% lat (usec) : 1000=0.13% lat (msec) : 2=6.35%, 4=3.32%, 10=6.93%, 20=11.10%, 50=39.81% lat (msec) : 100=21.45%, 250=4.95%, 500=0.07%, 750=0.03% cpu : usr=0.08%, sys=5.87%, ctx=6523, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=208KiB/s (213kB/s), 51.9KiB/s-52.6KiB/s (53.2kB/s-53.8kB/s), io=23.4MiB (24.6MB), run=114108-115641msec WRITE: bw=217KiB/s (223kB/s), 53.9KiB/s-55.6KiB/s (55.2kB/s-56.0kB/s), io=24.6MiB (25.7MB), run=114108-115641msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144612: Sun Aug 9 17:01:45 2026 read: IOPS=5, BW=23.6KiB/s (24.2kB/s)(5992KiB/253683msec) clat (msec): min=5, max=976, avg=35.15, stdev=39.50 lat (msec): min=5, max=976, avg=35.16, stdev=39.50 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 15], | 30.00th=[ 18], 40.00th=[ 22], 50.00th=[ 26], 60.00th=[ 31], | 70.00th=[ 37], 80.00th=[ 48], 90.00th=[ 68], 95.00th=[ 93], | 99.00th=[ 169], 99.50th=[ 192], 99.90th=[ 334], 99.95th=[ 978], | 99.99th=[ 978] bw ( KiB/s): min= 7, max= 88, per=27.83%, avg=26.16, stdev=17.10, samples=443 iops : min= 1, max= 22, avg= 5.93, stdev= 4.31, samples=443 write: IOPS=6, BW=24.8KiB/s (25.4kB/s)(6296KiB/253683msec); 0 zone resets clat (msec): min=34, max=588, avg=127.45, stdev=61.33 lat (msec): min=34, max=588, avg=127.45, stdev=61.33 clat percentiles (msec): | 1.00th=[ 44], 5.00th=[ 60], 10.00th=[ 67], 20.00th=[ 80], | 30.00th=[ 91], 40.00th=[ 102], 50.00th=[ 114], 60.00th=[ 128], | 70.00th=[ 144], 80.00th=[ 167], 90.00th=[ 205], 95.00th=[ 243], | 99.00th=[ 355], 99.50th=[ 380], 99.90th=[ 468], 99.95th=[ 592], | 99.99th=[ 592] bw ( KiB/s): min= 7, max= 56, per=24.76%, avg=24.51, stdev=10.48, samples=495 iops : min= 1, max= 14, avg= 5.51, stdev= 2.68, samples=495 lat (msec) : 10=3.84%, 20=13.80%, 50=23.40%, 100=25.36%, 250=31.15% lat (msec) : 500=2.38%, 750=0.03%, 1000=0.03% cpu : usr=0.05%, sys=1.48%, ctx=5592, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144613: Sun Aug 9 17:01:45 2026 read: IOPS=5, BW=23.4KiB/s (23.0kB/s)(5940KiB/253699msec) clat (msec): min=5, max=942, avg=34.17, stdev=38.84 lat (msec): min=5, max=942, avg=34.17, stdev=38.84 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 15], | 30.00th=[ 18], 40.00th=[ 22], 50.00th=[ 26], 60.00th=[ 31], | 70.00th=[ 36], 80.00th=[ 45], 90.00th=[ 64], 95.00th=[ 85], | 99.00th=[ 174], 99.50th=[ 224], 99.90th=[ 359], 99.95th=[ 944], | 99.99th=[ 944] bw ( KiB/s): min= 7, max= 94, per=27.76%, avg=26.10, stdev=16.90, samples=440 iops : min= 1, max= 23, avg= 5.91, stdev= 4.27, samples=440 write: IOPS=6, BW=25.0KiB/s (25.6kB/s)(6348KiB/253699msec); 0 zone resets clat (msec): min=34, max=469, avg=127.62, stdev=59.53 lat (msec): min=34, max=469, avg=127.62, stdev=59.53 clat percentiles (msec): | 1.00th=[ 47], 5.00th=[ 58], 10.00th=[ 67], 20.00th=[ 81], | 30.00th=[ 92], 40.00th=[ 103], 50.00th=[ 115], 60.00th=[ 130], | 70.00th=[ 146], 80.00th=[ 167], 90.00th=[ 205], 95.00th=[ 243], | 99.00th=[ 351], 99.50th=[ 368], 99.90th=[ 439], 99.95th=[ 468], | 99.99th=[ 468] bw ( KiB/s): min= 7, max= 56, per=24.93%, avg=24.69, stdev=10.45, samples=496 iops : min= 1, max= 14, avg= 5.55, stdev= 2.67, samples=496 lat (msec) : 10=4.07%, 20=14.03%, 50=23.86%, 100=24.80%, 250=30.89% lat (msec) : 500=2.31%, 1000=0.03% cpu : usr=0.03%, sys=1.46%, ctx=5546, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144614: Sun Aug 9 17:01:45 2026 read: IOPS=5, BW=23.8KiB/s (24.3kB/s)(6028KiB/253537msec) clat (msec): min=5, max=345, avg=35.57, stdev=31.99 lat (msec): min=5, max=345, avg=35.57, stdev=31.99 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 15], | 30.00th=[ 18], 40.00th=[ 22], 50.00th=[ 26], 60.00th=[ 31], | 70.00th=[ 38], 80.00th=[ 52], 90.00th=[ 74], 95.00th=[ 96], | 99.00th=[ 153], 99.50th=[ 192], 99.90th=[ 330], 99.95th=[ 347], | 99.99th=[ 347] bw ( KiB/s): min= 7, max= 95, per=27.56%, avg=25.90, stdev=17.15, samples=450 iops : min= 1, max= 23, avg= 5.86, stdev= 4.33, samples=450 write: IOPS=6, BW=24.7KiB/s (25.3kB/s)(6260KiB/253537msec); 0 zone resets clat (msec): min=31, max=1042, avg=127.47, stdev=62.68 lat (msec): min=31, max=1042, avg=127.47, stdev=62.68 clat percentiles (msec): | 1.00th=[ 45], 5.00th=[ 59], 10.00th=[ 68], 20.00th=[ 81], | 30.00th=[ 93], 40.00th=[ 103], 50.00th=[ 114], 60.00th=[ 127], | 70.00th=[ 142], 80.00th=[ 165], 90.00th=[ 209], 95.00th=[ 241], | 99.00th=[ 330], 99.50th=[ 363], 99.90th=[ 472], 99.95th=[ 1045], | 99.99th=[ 1045] bw ( KiB/s): min= 7, max= 63, per=24.55%, avg=24.30, stdev=10.97, samples=497 iops : min= 1, max= 15, avg= 5.45, stdev= 2.79, samples=497 lat (msec) : 10=2.99%, 20=15.40%, 50=21.55%, 100=26.11%, 250=31.64% lat (msec) : 500=2.28%, 2000=0.03% cpu : usr=0.05%, sys=1.45%, ctx=5545, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144615: Sun Aug 9 17:01:45 2026 read: IOPS=5, BW=23.9KiB/s (24.5kB/s)(6052KiB/253362msec) clat (msec): min=5, max=343, avg=35.33, stdev=32.26 lat (msec): min=5, max=343, avg=35.34, stdev=32.26 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 15], | 30.00th=[ 19], 40.00th=[ 22], 50.00th=[ 26], 60.00th=[ 31], | 70.00th=[ 38], 80.00th=[ 48], 90.00th=[ 72], 95.00th=[ 92], | 99.00th=[ 167], 99.50th=[ 205], 99.90th=[ 309], 99.95th=[ 342], | 99.99th=[ 342] bw ( KiB/s): min= 7, max= 87, per=27.48%, avg=25.83, stdev=16.94, samples=453 iops : min= 1, max= 21, avg= 5.84, stdev= 4.29, samples=453 write: IOPS=6, BW=24.6KiB/s (25.2kB/s)(6236KiB/253362msec); 0 zone resets clat (msec): min=38, max=1102, avg=127.95, stdev=62.31 lat (msec): min=38, max=1102, avg=127.95, stdev=62.31 clat percentiles (msec): | 1.00th=[ 50], 5.00th=[ 62], 10.00th=[ 68], 20.00th=[ 81], | 30.00th=[ 90], 40.00th=[ 103], 50.00th=[ 116], 60.00th=[ 130], | 70.00th=[ 146], 80.00th=[ 167], 90.00th=[ 205], 95.00th=[ 236], | 99.00th=[ 334], 99.50th=[ 359], 99.90th=[ 447], 99.95th=[ 1099], | 99.99th=[ 1099] bw ( KiB/s): min= 7, max= 56, per=24.54%, avg=24.29, stdev=10.43, samples=496 iops : min= 1, max= 14, avg= 5.45, stdev= 2.66, samples=496 lat (msec) : 10=2.93%, 20=14.65%, 50=23.40%, 100=25.20%, 250=31.90% lat (msec) : 500=1.89%, 2000=0.03% cpu : usr=0.05%, sys=1.49%, ctx=5608, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=94.6KiB/s (96.9kB/s), 23.4KiB/s-23.9KiB/s (23.0kB/s-24.5kB/s), io=23.4MiB (24.6MB), run=253362-253699msec WRITE: bw=99.1KiB/s (101kB/s), 24.6KiB/s-25.0KiB/s (25.2kB/s-25.6kB/s), io=24.6MiB (25.7MB), run=253362-253699msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144681: Sun Aug 9 17:02:19 2026 read: IOPS=15, BW=252KiB/s (258kB/s)(5920KiB/23486msec) clat (usec): min=40, max=326586, avg=34220.27, stdev=29706.05 lat (usec): min=40, max=326587, avg=34221.63, stdev=29706.04 clat percentiles (usec): | 1.00th=[ 42], 5.00th=[ 55], 10.00th=[ 61], 20.00th=[ 80], | 30.00th=[ 21627], 40.00th=[ 28181], 50.00th=[ 31851], 60.00th=[ 37487], | 70.00th=[ 43254], 80.00th=[ 53216], 90.00th=[ 65799], 95.00th=[ 77071], | 99.00th=[111674], 99.50th=[158335], 99.90th=[325059], 99.95th=[325059], | 99.99th=[325059] bw ( KiB/s): min= 63, max= 510, per=25.72%, avg=250.54, stdev=78.78, samples=46 iops : min= 3, max= 31, avg=14.89, stdev= 4.94, samples=46 write: IOPS=16, BW=271KiB/s (278kB/s)(6368KiB/23486msec); 0 zone resets clat (usec): min=1376, max=194857, avg=26787.30, stdev=28821.82 lat (usec): min=1377, max=194859, avg=26789.61, stdev=28821.93 clat percentiles (usec): | 1.00th=[ 1516], 5.00th=[ 1844], 10.00th=[ 2057], 20.00th=[ 3982], | 30.00th=[ 6849], 40.00th=[ 9634], 50.00th=[ 16581], 60.00th=[ 25560], | 70.00th=[ 33817], 80.00th=[ 45876], 90.00th=[ 64750], 95.00th=[ 80217], | 99.00th=[143655], 99.50th=[143655], 99.90th=[193987], 99.95th=[193987], | 99.99th=[193987] bw ( KiB/s): min= 95, max= 476, per=26.47%, avg=271.30, stdev=91.12, samples=46 iops : min= 5, max= 29, avg=16.20, stdev= 5.69, samples=46 lat (usec) : 50=1.56%, 100=8.46%, 250=0.26%, 750=0.13% lat (msec) : 2=4.69%, 4=5.99%, 10=11.07%, 20=9.24%, 50=37.50% lat (msec) : 100=18.75%, 250=2.21%, 500=0.13% cpu : usr=0.10%, sys=7.02%, ctx=1389, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144682: Sun Aug 9 17:02:19 2026 read: IOPS=14, BW=234KiB/s (239kB/s)(5744KiB/24582msec) clat (usec): min=37, max=203460, avg=36368.99, stdev=26977.89 lat (usec): min=37, max=203461, avg=36371.79, stdev=26980.51 clat percentiles (usec): | 1.00th=[ 43], 5.00th=[ 58], 10.00th=[ 69], 20.00th=[ 17695], | 30.00th=[ 23987], 40.00th=[ 28181], 50.00th=[ 34866], 60.00th=[ 39584], | 70.00th=[ 45876], 80.00th=[ 53740], 90.00th=[ 65799], 95.00th=[ 80217], | 99.00th=[143655], 99.50th=[156238], 99.90th=[204473], 99.95th=[204473], | 99.99th=[204473] bw ( KiB/s): min= 55, max= 445, per=23.82%, avg=231.98, stdev=88.21, samples=48 iops : min= 3, max= 27, avg=13.71, stdev= 5.47, samples=48 write: IOPS=16, BW=266KiB/s (273kB/s)(6544KiB/24582msec); 0 zone resets clat (usec): min=1480, max=137305, avg=27977.72, stdev=27623.23 lat (usec): min=1481, max=137307, avg=27983.13, stdev=27620.44 clat percentiles (usec): | 1.00th=[ 1713], 5.00th=[ 1926], 10.00th=[ 2507], 20.00th=[ 4490], | 30.00th=[ 7963], 40.00th=[ 11731], 50.00th=[ 19006], 60.00th=[ 26870], | 70.00th=[ 37487], 80.00th=[ 48497], 90.00th=[ 68682], 95.00th=[ 83362], | 99.00th=[122160], 99.50th=[130548], 99.90th=[137364], 99.95th=[137364], | 99.99th=[137364] bw ( KiB/s): min= 94, max= 539, per=25.81%, avg=264.52, stdev=90.90, samples=48 iops : min= 5, max= 33, avg=15.75, stdev= 5.74, samples=48 lat (usec) : 50=1.04%, 100=5.99%, 250=0.39%, 500=0.13% lat (msec) : 2=3.26%, 4=6.12%, 10=9.64%, 20=11.20%, 50=40.76% lat (msec) : 100=19.27%, 250=2.21% cpu : usr=0.11%, sys=6.68%, ctx=1441, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144683: Sun Aug 9 17:02:19 2026 read: IOPS=16, BW=262KiB/s (268kB/s)(6256KiB/23911msec) clat (usec): min=42, max=229240, avg=33956.12, stdev=27781.81 lat (usec): min=42, max=229241, avg=33957.66, stdev=27781.80 clat percentiles (usec): | 1.00th=[ 53], 5.00th=[ 58], 10.00th=[ 61], 20.00th=[ 87], | 30.00th=[ 21103], 40.00th=[ 26870], 50.00th=[ 32375], 60.00th=[ 38011], | 70.00th=[ 45876], 80.00th=[ 52691], 90.00th=[ 64750], 95.00th=[ 77071], | 99.00th=[102237], 99.50th=[202376], 99.90th=[229639], 99.95th=[229639], | 99.99th=[229639] bw ( KiB/s): min= 63, max= 447, per=27.00%, avg=263.00, stdev=89.79, samples=47 iops : min= 3, max= 27, avg=15.66, stdev= 5.67, samples=47 write: IOPS=15, BW=252KiB/s (258kB/s)(6032KiB/23911msec); 0 zone resets clat (usec): min=1531, max=156162, avg=27773.22, stdev=28021.46 lat (usec): min=1533, max=156164, avg=27775.94, stdev=28021.22 clat percentiles (usec): | 1.00th=[ 1598], 5.00th=[ 1909], 10.00th=[ 2540], 20.00th=[ 4555], | 30.00th=[ 7373], 40.00th=[ 11600], 50.00th=[ 20579], 60.00th=[ 27395], | 70.00th=[ 34341], 80.00th=[ 48497], 90.00th=[ 66847], 95.00th=[ 85459], | 99.00th=[129500], 99.50th=[143655], 99.90th=[156238], 99.95th=[156238], | 99.99th=[156238] bw ( KiB/s): min= 95, max= 447, per=24.46%, avg=250.68, stdev=103.60, samples=47 iops : min= 5, max= 27, avg=14.89, stdev= 6.50, samples=47 lat (usec) : 50=0.39%, 100=10.29%, 250=0.26%, 500=0.13% lat (msec) : 2=3.52%, 4=5.21%, 10=9.24%, 20=9.24%, 50=40.89% lat (msec) : 100=19.14%, 250=1.69% cpu : usr=0.10%, sys=6.57%, ctx=1390, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144684: Sun Aug 9 17:02:19 2026 read: IOPS=16, BW=261KiB/s (268kB/s)(6032KiB/23074msec) clat (usec): min=38, max=257010, avg=32759.25, stdev=27510.25 lat (usec): min=38, max=257012, avg=32760.70, stdev=27510.29 clat percentiles (usec): | 1.00th=[ 40], 5.00th=[ 56], 10.00th=[ 62], 20.00th=[ 247], | 30.00th=[ 19792], 40.00th=[ 25822], 50.00th=[ 31065], 60.00th=[ 35914], | 70.00th=[ 42730], 80.00th=[ 51119], 90.00th=[ 61604], 95.00th=[ 79168], | 99.00th=[105382], 99.50th=[177210], 99.90th=[256902], 99.95th=[256902], | 99.99th=[256902] bw ( KiB/s): min= 94, max= 407, per=26.75%, avg=260.56, stdev=81.19, samples=45 iops : min= 5, max= 25, avg=15.51, stdev= 5.13, samples=45 write: IOPS=16, BW=271KiB/s (278kB/s)(6256KiB/23074msec); 0 zone resets clat (usec): min=1549, max=186954, avg=26864.21, stdev=29803.94 lat (usec): min=1550, max=186957, avg=26877.35, stdev=29795.52 clat percentiles (usec): | 1.00th=[ 1663], 5.00th=[ 1893], 10.00th=[ 2180], 20.00th=[ 4555], | 30.00th=[ 6980], 40.00th=[ 10028], 50.00th=[ 16057], 60.00th=[ 22414], | 70.00th=[ 32113], 80.00th=[ 45876], 90.00th=[ 65274], 95.00th=[ 86508], | 99.00th=[149947], 99.50th=[164627], 99.90th=[187696], 99.95th=[187696], | 99.99th=[187696] bw ( KiB/s): min= 63, max= 510, per=26.51%, avg=271.78, stdev=100.34, samples=45 iops : min= 3, max= 31, avg=16.22, stdev= 6.32, samples=45 lat (usec) : 50=1.04%, 100=8.59%, 250=0.26%, 500=0.26%, 750=0.13% lat (msec) : 2=4.43%, 4=4.95%, 10=11.33%, 20=12.76%, 50=38.15% lat (msec) : 100=16.02%, 250=1.95%, 500=0.13% cpu : usr=0.06%, sys=6.71%, ctx=1377, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=974KiB/s (998kB/s), 234KiB/s-262KiB/s (239kB/s-268kB/s), io=23.4MiB (24.5MB), run=23074-24582msec WRITE: bw=1025KiB/s (1050kB/s), 252KiB/s-271KiB/s (258kB/s-278kB/s), io=24.6MiB (25.8MB), run=23074-24582msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144686: Sun Aug 9 17:03:06 2026 read: IOPS=5, BW=82.0KiB/s (84.9kB/s)(5920KiB/71363msec) clat (msec): min=6, max=206, avg=36.26, stdev=32.90 lat (msec): min=6, max=206, avg=36.26, stdev=32.90 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 14], 20.00th=[ 17], | 30.00th=[ 20], 40.00th=[ 23], 50.00th=[ 26], 60.00th=[ 30], | 70.00th=[ 36], 80.00th=[ 45], 90.00th=[ 68], 95.00th=[ 104], | 99.00th=[ 190], 99.50th=[ 194], 99.90th=[ 207], 99.95th=[ 207], | 99.99th=[ 207] bw ( KiB/s): min= 30, max= 384, per=27.73%, avg=92.88, stdev=58.51, samples=125 iops : min= 1, max= 24, avg= 5.02, stdev= 3.72, samples=125 write: IOPS=5, BW=89.2KiB/s (91.4kB/s)(6368KiB/71363msec); 0 zone resets clat (msec): min=44, max=330, avg=144.75, stdev=54.50 lat (msec): min=44, max=330, avg=144.76, stdev=54.50 clat percentiles (msec): | 1.00th=[ 52], 5.00th=[ 70], 10.00th=[ 81], 20.00th=[ 97], | 30.00th=[ 112], 40.00th=[ 125], 50.00th=[ 136], 60.00th=[ 153], | 70.00th=[ 165], 80.00th=[ 188], 90.00th=[ 224], 95.00th=[ 249], | 99.00th=[ 296], 99.50th=[ 317], 99.90th=[ 330], 99.95th=[ 330], | 99.99th=[ 330] bw ( KiB/s): min= 30, max= 191, per=25.26%, avg=89.18, stdev=32.39, samples=140 iops : min= 1, max= 11, avg= 4.76, stdev= 2.07, samples=140 lat (msec) : 10=2.21%, 20=12.24%, 50=25.91%, 100=16.28%, 250=40.89% lat (msec) : 500=2.47% cpu : usr=0.04%, sys=1.32%, ctx=1280, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144687: Sun Aug 9 17:03:06 2026 read: IOPS=5, BW=80.6KiB/s (82.6kB/s)(5744KiB/71228msec) clat (msec): min=6, max=271, avg=34.95, stdev=29.76 lat (msec): min=6, max=271, avg=34.97, stdev=29.78 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 17], | 30.00th=[ 20], 40.00th=[ 22], 50.00th=[ 26], 60.00th=[ 30], | 70.00th=[ 36], 80.00th=[ 50], 90.00th=[ 68], 95.00th=[ 92], | 99.00th=[ 165], 99.50th=[ 174], 99.90th=[ 271], 99.95th=[ 271], | 99.99th=[ 271] bw ( KiB/s): min= 28, max= 288, per=27.52%, avg=92.20, stdev=58.24, samples=123 iops : min= 1, max= 18, avg= 4.96, stdev= 3.70, samples=123 write: IOPS=5, BW=91.9KiB/s (94.1kB/s)(6544KiB/71228msec); 0 zone resets clat (msec): min=42, max=349, avg=142.54, stdev=55.38 lat (msec): min=42, max=349, avg=142.54, stdev=55.38 clat percentiles (msec): | 1.00th=[ 58], 5.00th=[ 67], 10.00th=[ 79], 20.00th=[ 93], | 30.00th=[ 107], 40.00th=[ 122], 50.00th=[ 138], 60.00th=[ 148], | 70.00th=[ 161], 80.00th=[ 190], 90.00th=[ 220], 95.00th=[ 253], | 99.00th=[ 292], 99.50th=[ 317], 99.90th=[ 351], 99.95th=[ 351], | 99.99th=[ 351] bw ( KiB/s): min= 28, max= 191, per=25.84%, avg=91.21, stdev=34.31, samples=141 iops : min= 1, max= 11, avg= 4.89, stdev= 2.19, samples=141 lat (msec) : 10=1.95%, 20=14.71%, 50=21.22%, 100=20.18%, 250=39.06% lat (msec) : 500=2.86% cpu : usr=0.04%, sys=1.28%, ctx=1247, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144688: Sun Aug 9 17:03:06 2026 read: IOPS=5, BW=91.9KiB/s (94.1kB/s)(6256KiB/68102msec) clat (msec): min=7, max=239, avg=35.52, stdev=32.57 lat (msec): min=7, max=239, avg=35.52, stdev=32.57 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 16], | 30.00th=[ 19], 40.00th=[ 22], 50.00th=[ 26], 60.00th=[ 30], | 70.00th=[ 35], 80.00th=[ 46], 90.00th=[ 67], 95.00th=[ 114], | 99.00th=[ 163], 99.50th=[ 213], 99.90th=[ 241], 99.95th=[ 241], | 99.99th=[ 241] bw ( KiB/s): min= 31, max= 319, per=30.00%, avg=100.51, stdev=63.06, samples=123 iops : min= 1, max= 19, avg= 5.49, stdev= 3.96, samples=123 write: IOPS=5, BW=88.6KiB/s (90.7kB/s)(6032KiB/68102msec); 0 zone resets clat (msec): min=41, max=382, avg=143.15, stdev=55.72 lat (msec): min=41, max=382, avg=143.15, stdev=55.72 clat percentiles (msec): | 1.00th=[ 52], 5.00th=[ 72], 10.00th=[ 82], 20.00th=[ 99], | 30.00th=[ 112], 40.00th=[ 121], 50.00th=[ 132], 60.00th=[ 144], | 70.00th=[ 161], 80.00th=[ 192], 90.00th=[ 224], 95.00th=[ 249], | 99.00th=[ 292], 99.50th=[ 355], 99.90th=[ 384], 99.95th=[ 384], | 99.99th=[ 384] bw ( KiB/s): min= 30, max= 159, per=25.27%, avg=89.22, stdev=31.46, samples=132 iops : min= 1, max= 9, avg= 4.77, stdev= 1.99, samples=132 lat (msec) : 10=2.34%, 20=14.84%, 50=25.26%, 100=15.63%, 250=39.58% lat (msec) : 500=2.34% cpu : usr=0.05%, sys=1.46%, ctx=1329, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144689: Sun Aug 9 17:03:06 2026 read: IOPS=5, BW=86.3KiB/s (88.4kB/s)(6032KiB/69907msec) clat (msec): min=7, max=229, avg=36.33, stdev=33.69 lat (msec): min=7, max=229, avg=36.33, stdev=33.69 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 13], 20.00th=[ 17], | 30.00th=[ 20], 40.00th=[ 22], 50.00th=[ 26], 60.00th=[ 29], | 70.00th=[ 36], 80.00th=[ 47], 90.00th=[ 72], 95.00th=[ 112], | 99.00th=[ 197], 99.50th=[ 205], 99.90th=[ 230], 99.95th=[ 230], | 99.99th=[ 230] bw ( KiB/s): min= 31, max= 319, per=28.38%, avg=95.07, stdev=63.64, samples=124 iops : min= 1, max= 19, avg= 5.14, stdev= 4.01, samples=124 write: IOPS=5, BW=89.5KiB/s (91.6kB/s)(6256KiB/69907msec); 0 zone resets clat (msec): min=42, max=393, avg=143.45, stdev=56.21 lat (msec): min=42, max=393, avg=143.46, stdev=56.20 clat percentiles (msec): | 1.00th=[ 53], 5.00th=[ 70], 10.00th=[ 83], 20.00th=[ 99], | 30.00th=[ 110], 40.00th=[ 122], 50.00th=[ 133], 60.00th=[ 148], | 70.00th=[ 165], 80.00th=[ 182], 90.00th=[ 211], 95.00th=[ 245], | 99.00th=[ 338], 99.50th=[ 376], 99.90th=[ 393], 99.95th=[ 393], | 99.99th=[ 393] bw ( KiB/s): min= 30, max= 191, per=25.41%, avg=89.69, stdev=32.33, samples=137 iops : min= 1, max= 11, avg= 4.80, stdev= 2.07, samples=137 lat (msec) : 10=1.30%, 20=14.45%, 50=25.13%, 100=16.28%, 250=40.49% lat (msec) : 500=2.34% cpu : usr=0.03%, sys=1.39%, ctx=1361, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=336KiB/s (344kB/s), 80.6KiB/s-91.9KiB/s (82.6kB/s-94.1kB/s), io=23.4MiB (24.5MB), run=68102-71363msec WRITE: bw=353KiB/s (362kB/s), 88.6KiB/s-91.9KiB/s (90.7kB/s-94.1kB/s), io=24.6MiB (25.8MB), run=68102-71363msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144720: Sun Aug 9 17:03:20 2026 read: IOPS=2, BW=2150KiB/s (2202kB/s)(7168KiB/3334msec) clat (usec): min=622, max=230928, avg=139086.53, stdev=74902.21 lat (usec): min=623, max=230930, avg=139088.02, stdev=74902.36 clat percentiles (usec): | 1.00th=[ 619], 5.00th=[ 619], 10.00th=[ 619], 20.00th=[ 90702], | 30.00th=[145753], 40.00th=[145753], 50.00th=[147850], 60.00th=[164627], | 70.00th=[164627], 80.00th=[193987], 90.00th=[231736], 95.00th=[231736], | 99.00th=[231736], 99.50th=[231736], 99.90th=[231736], 99.95th=[231736], | 99.99th=[231736] bw ( KiB/s): min= 1939, max= 4087, per=59.87%, avg=2933.25, stdev=1108.36, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 1.15, samples=4 write: IOPS=1, BW=1536KiB/s (1573kB/s)(5120KiB/3334msec); 0 zone resets clat (msec): min=242, max=699, avg=439.25, stdev=194.66 lat (msec): min=242, max=699, avg=439.35, stdev=194.64 clat percentiles (msec): | 1.00th=[ 243], 5.00th=[ 243], 10.00th=[ 243], 20.00th=[ 243], | 30.00th=[ 264], 40.00th=[ 264], 50.00th=[ 430], 60.00th=[ 430], | 70.00th=[ 558], 80.00th=[ 558], 90.00th=[ 701], 95.00th=[ 701], | 99.00th=[ 701], 99.50th=[ 701], 99.90th=[ 701], 99.95th=[ 701], | 99.99th=[ 701] bw ( KiB/s): min= 1939, max= 4047, per=39.02%, avg=2676.33, stdev=1188.17, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (usec) : 750=8.33% lat (msec) : 100=8.33%, 250=50.00%, 500=16.67%, 750=16.67% cpu : usr=0.00%, sys=13.74%, ctx=250, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144721: Sun Aug 9 17:03:20 2026 read: IOPS=0, BW=490KiB/s (502kB/s)(2048KiB/4180msec) clat (usec): min=963, max=557630, avg=279296.96, stdev=393622.79 lat (usec): min=965, max=557632, avg=279298.71, stdev=393623.25 clat percentiles (usec): | 1.00th=[ 963], 5.00th=[ 963], 10.00th=[ 963], 20.00th=[ 963], | 30.00th=[ 963], 40.00th=[ 963], 50.00th=[ 963], 60.00th=[557843], | 70.00th=[557843], 80.00th=[557843], 90.00th=[557843], 95.00th=[557843], | 99.00th=[557843], 99.50th=[557843], 99.90th=[557843], 99.95th=[557843], | 99.99th=[557843] bw ( KiB/s): min= 2023, max= 2031, per=41.38%, avg=2027.00, stdev= 5.66, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2450KiB/s (2509kB/s)(10.0MiB/4180msec); 0 zone resets clat (msec): min=63, max=967, avg=339.09, stdev=248.34 lat (msec): min=63, max=967, avg=339.23, stdev=248.31 clat percentiles (msec): | 1.00th=[ 64], 5.00th=[ 64], 10.00th=[ 64], 20.00th=[ 92], | 30.00th=[ 264], 40.00th=[ 271], 50.00th=[ 292], 60.00th=[ 305], | 70.00th=[ 334], 80.00th=[ 380], 90.00th=[ 426], 95.00th=[ 969], | 99.00th=[ 969], 99.50th=[ 969], 99.90th=[ 969], 99.95th=[ 969], | 99.99th=[ 969] bw ( KiB/s): min= 2023, max= 4087, per=44.34%, avg=3041.00, stdev=1105.16, samples=6 iops : min= 1, max= 3, avg= 2.00, stdev= 1.10, samples=6 lat (usec) : 1000=8.33% lat (msec) : 100=16.67%, 500=58.33%, 750=8.33%, 1000=8.33% cpu : usr=0.00%, sys=14.17%, ctx=120, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144722: Sun Aug 9 17:03:20 2026 read: IOPS=2, BW=2375KiB/s (2432kB/s)(6144KiB/2587msec) clat (usec): min=527, max=55818, avg=18815.56, stdev=22796.70 lat (usec): min=528, max=55819, avg=18816.84, stdev=22796.58 clat percentiles (usec): | 1.00th=[ 529], 5.00th=[ 529], 10.00th=[ 529], 20.00th=[ 545], | 30.00th=[ 545], 40.00th=[ 758], 50.00th=[ 758], 60.00th=[21365], | 70.00th=[33817], 80.00th=[33817], 90.00th=[55837], 95.00th=[55837], | 99.00th=[55837], 99.50th=[55837], 99.90th=[55837], 99.95th=[55837], | 99.99th=[55837] bw ( KiB/s): min= 2023, max= 6035, per=68.73%, avg=3367.00, stdev=2310.58, samples=3 iops : min= 1, max= 5, avg= 2.33, stdev= 2.31, samples=3 write: IOPS=2, BW=2375KiB/s (2432kB/s)(6144KiB/2587msec); 0 zone resets clat (msec): min=247, max=550, avg=400.46, stdev=109.43 lat (msec): min=247, max=550, avg=400.66, stdev=109.36 clat percentiles (msec): | 1.00th=[ 249], 5.00th=[ 249], 10.00th=[ 249], 20.00th=[ 347], | 30.00th=[ 347], 40.00th=[ 355], 50.00th=[ 355], 60.00th=[ 409], | 70.00th=[ 498], 80.00th=[ 498], 90.00th=[ 550], 95.00th=[ 550], | 99.00th=[ 550], 99.50th=[ 550], 99.90th=[ 550], 99.95th=[ 550], | 99.99th=[ 550] bw ( KiB/s): min= 1903, max= 2043, per=29.19%, avg=2002.20, stdev=56.67, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 lat (usec) : 750=16.67%, 1000=8.33% lat (msec) : 50=16.67%, 100=8.33%, 250=8.33%, 500=33.33%, 750=8.33% cpu : usr=0.00%, sys=16.05%, ctx=132, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144723: Sun Aug 9 17:03:20 2026 read: IOPS=1, BW=1376KiB/s (1409kB/s)(5120KiB/3722msec) clat (usec): min=525, max=457654, avg=225223.74, stdev=213435.30 lat (usec): min=526, max=457656, avg=225225.09, stdev=213435.38 clat percentiles (usec): | 1.00th=[ 529], 5.00th=[ 529], 10.00th=[ 529], 20.00th=[ 529], | 30.00th=[ 3425], 40.00th=[ 3425], 50.00th=[278922], 60.00th=[278922], | 70.00th=[383779], 80.00th=[383779], 90.00th=[459277], 95.00th=[459277], | 99.00th=[459277], 99.50th=[459277], 99.90th=[459277], 99.95th=[459277], | 99.99th=[459277] bw ( KiB/s): min= 1976, max= 3984, per=54.18%, avg=2654.33, stdev=1151.60, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 write: IOPS=1, BW=1926KiB/s (1972kB/s)(7168KiB/3722msec); 0 zone resets clat (msec): min=147, max=519, avg=338.98, stdev=119.85 lat (msec): min=147, max=519, avg=339.11, stdev=119.89 clat percentiles (msec): | 1.00th=[ 148], 5.00th=[ 148], 10.00th=[ 148], 20.00th=[ 247], | 30.00th=[ 321], 40.00th=[ 321], 50.00th=[ 334], 60.00th=[ 401], | 70.00th=[ 401], 80.00th=[ 405], 90.00th=[ 518], 95.00th=[ 518], | 99.00th=[ 518], 99.50th=[ 518], 99.90th=[ 518], 99.95th=[ 518], | 99.99th=[ 518] bw ( KiB/s): min= 1372, max= 2048, per=27.54%, avg=1889.20, stdev=289.97, samples=5 iops : min= 1, max= 2, avg= 1.20, stdev= 0.45, samples=5 lat (usec) : 750=8.33% lat (msec) : 4=8.33%, 250=16.67%, 500=58.33%, 750=8.33% cpu : usr=0.00%, sys=13.28%, ctx=161, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4900KiB/s (5017kB/s), 490KiB/s-2375KiB/s (502kB/s-2432kB/s), io=20.0MiB (20.0MB), run=2587-4180msec WRITE: bw=6859KiB/s (7024kB/s), 1536KiB/s-2450KiB/s (1573kB/s-2509kB/s), io=28.0MiB (29.4MB), run=2587-4180msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144715: Sun Aug 9 17:03:20 2026 read: IOPS=1, BW=1759KiB/s (1801kB/s)(7168KiB/4075msec) clat (msec): min=113, max=339, avg=194.23, stdev=84.54 lat (msec): min=113, max=339, avg=194.23, stdev=84.54 clat percentiles (msec): | 1.00th=[ 113], 5.00th=[ 113], 10.00th=[ 113], 20.00th=[ 114], | 30.00th=[ 144], 40.00th=[ 144], 50.00th=[ 161], 60.00th=[ 236], | 70.00th=[ 236], 80.00th=[ 251], 90.00th=[ 338], 95.00th=[ 338], | 99.00th=[ 338], 99.50th=[ 338], 99.90th=[ 338], 99.95th=[ 338], | 99.99th=[ 338] bw ( KiB/s): min= 1954, max= 3946, per=66.83%, avg=2863.75, stdev=1015.34, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 1.15, samples=4 write: IOPS=1, BW=1256KiB/s (1287kB/s)(5120KiB/4075msec); 0 zone resets clat (msec): min=364, max=863, avg=522.99, stdev=195.80 lat (msec): min=364, max=863, avg=523.10, stdev=195.77 clat percentiles (msec): | 1.00th=[ 363], 5.00th=[ 363], 10.00th=[ 363], 20.00th=[ 363], | 30.00th=[ 439], 40.00th=[ 439], 50.00th=[ 468], 60.00th=[ 468], | 70.00th=[ 481], 80.00th=[ 481], 90.00th=[ 860], 95.00th=[ 860], | 99.00th=[ 860], 99.50th=[ 860], 99.90th=[ 860], 99.95th=[ 860], | 99.99th=[ 860] bw ( KiB/s): min= 1914, max= 4063, per=44.56%, avg=2673.33, stdev=1205.21, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (msec) : 250=41.67%, 500=50.00%, 1000=8.33% cpu : usr=0.02%, sys=4.57%, ctx=80, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144717: Sun Aug 9 17:03:20 2026 read: IOPS=0, BW=429KiB/s (439kB/s)(2048KiB/4779msec) clat (msec): min=109, max=344, avg=227.19, stdev=166.00 lat (msec): min=109, max=344, avg=227.19, stdev=165.99 clat percentiles (msec): | 1.00th=[ 110], 5.00th=[ 110], 10.00th=[ 110], 20.00th=[ 110], | 30.00th=[ 110], 40.00th=[ 110], 50.00th=[ 110], 60.00th=[ 347], | 70.00th=[ 347], 80.00th=[ 347], 90.00th=[ 347], 95.00th=[ 347], | 99.00th=[ 347], 99.50th=[ 347], 99.90th=[ 347], 99.95th=[ 347], | 99.99th=[ 347] bw ( KiB/s): min= 1805, max= 2031, per=44.76%, avg=1918.00, stdev=159.81, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2143KiB/s (2194kB/s)(10.0MiB/4779msec); 0 zone resets clat (msec): min=153, max=1727, avg=421.83, stdev=477.64 lat (msec): min=157, max=1728, avg=422.61, stdev=477.70 clat percentiles (msec): | 1.00th=[ 155], 5.00th=[ 155], 10.00th=[ 155], 20.00th=[ 171], | 30.00th=[ 176], 40.00th=[ 184], 50.00th=[ 211], 60.00th=[ 330], | 70.00th=[ 334], 80.00th=[ 342], 90.00th=[ 592], 95.00th=[ 1720], | 99.00th=[ 1720], 99.50th=[ 1720], 99.90th=[ 1720], 99.95th=[ 1720], | 99.99th=[ 1720] bw ( KiB/s): min= 1805, max= 5885, per=58.23%, avg=3493.40, stdev=1666.47, samples=5 iops : min= 1, max= 5, avg= 2.60, stdev= 1.67, samples=5 lat (msec) : 250=50.00%, 500=33.33%, 750=8.33%, 2000=8.33% cpu : usr=0.02%, sys=4.65%, ctx=58, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144718: Sun Aug 9 17:03:20 2026 read: IOPS=1, BW=1312KiB/s (1344kB/s)(6144KiB/4682msec) clat (msec): min=65, max=910, avg=322.33, stdev=318.89 lat (msec): min=65, max=910, avg=322.33, stdev=318.89 clat percentiles (msec): | 1.00th=[ 66], 5.00th=[ 66], 10.00th=[ 66], 20.00th=[ 159], | 30.00th=[ 159], 40.00th=[ 161], 50.00th=[ 161], 60.00th=[ 174], | 70.00th=[ 468], 80.00th=[ 468], 90.00th=[ 911], 95.00th=[ 911], | 99.00th=[ 911], 99.50th=[ 911], 99.90th=[ 911], 99.95th=[ 911], | 99.99th=[ 911] bw ( KiB/s): min= 1914, max= 2003, per=45.76%, avg=1961.00, stdev=32.27, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 write: IOPS=1, BW=1312KiB/s (1344kB/s)(6144KiB/4682msec); 0 zone resets clat (msec): min=155, max=955, avg=445.33, stdev=304.04 lat (msec): min=155, max=955, avg=445.41, stdev=304.05 clat percentiles (msec): | 1.00th=[ 157], 5.00th=[ 157], 10.00th=[ 157], 20.00th=[ 165], | 30.00th=[ 165], 40.00th=[ 326], 50.00th=[ 326], 60.00th=[ 472], | 70.00th=[ 600], 80.00th=[ 600], 90.00th=[ 953], 95.00th=[ 953], | 99.00th=[ 953], 99.50th=[ 953], 99.90th=[ 953], 99.95th=[ 953], | 99.99th=[ 953] bw ( KiB/s): min= 1935, max= 3923, per=39.43%, avg=2365.60, stdev=871.57, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 lat (msec) : 100=8.33%, 250=41.67%, 500=25.00%, 750=8.33%, 1000=16.67% cpu : usr=0.02%, sys=3.23%, ctx=80, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144719: Sun Aug 9 17:03:20 2026 read: IOPS=1, BW=1670KiB/s (1711kB/s)(5120KiB/3065msec) clat (msec): min=91, max=413, avg=208.49, stdev=139.18 lat (msec): min=91, max=413, avg=208.49, stdev=139.18 clat percentiles (msec): | 1.00th=[ 92], 5.00th=[ 92], 10.00th=[ 92], 20.00th=[ 92], | 30.00th=[ 99], 40.00th=[ 99], 50.00th=[ 150], 60.00th=[ 150], | 70.00th=[ 288], 80.00th=[ 288], 90.00th=[ 414], 95.00th=[ 414], | 99.00th=[ 414], 99.50th=[ 414], 99.90th=[ 414], 99.95th=[ 414], | 99.99th=[ 414] bw ( KiB/s): min= 3828, max= 3946, per=90.71%, avg=3887.00, stdev=83.44, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2339KiB/s (2395kB/s)(7168KiB/3065msec); 0 zone resets clat (msec): min=151, max=466, avg=285.29, stdev=112.79 lat (msec): min=151, max=466, avg=285.38, stdev=112.79 clat percentiles (msec): | 1.00th=[ 153], 5.00th=[ 153], 10.00th=[ 153], 20.00th=[ 180], | 30.00th=[ 220], 40.00th=[ 220], 50.00th=[ 271], 60.00th=[ 351], | 70.00th=[ 351], 80.00th=[ 363], 90.00th=[ 468], 95.00th=[ 468], | 99.00th=[ 468], 99.50th=[ 468], 99.90th=[ 468], 99.95th=[ 468], | 99.99th=[ 468] bw ( KiB/s): min= 1914, max= 3500, per=38.21%, avg=2292.20, stdev=677.13, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 lat (msec) : 100=16.67%, 250=33.33%, 500=50.00% cpu : usr=0.07%, sys=4.60%, ctx=53, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4285KiB/s (4388kB/s), 429KiB/s-1759KiB/s (439kB/s-1801kB/s), io=20.0MiB (20.0MB), run=3065-4779msec WRITE: bw=6000KiB/s (6144kB/s), 1256KiB/s-2339KiB/s (1287kB/s-2395kB/s), io=28.0MiB (29.4MB), run=3065-4779msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144734: Sun Aug 9 17:03:38 2026 read: IOPS=1, BW=4939KiB/s (5057kB/s)(12.0MiB/2488msec) clat (msec): min=801, max=848, avg=821.73, stdev=24.04 lat (msec): min=801, max=848, avg=821.73, stdev=24.04 clat percentiles (msec): | 1.00th=[ 802], 5.00th=[ 802], 10.00th=[ 802], 20.00th=[ 802], | 30.00th=[ 802], 40.00th=[ 818], 50.00th=[ 818], 60.00th=[ 818], | 70.00th=[ 852], 80.00th=[ 852], 90.00th=[ 852], 95.00th=[ 852], | 99.00th=[ 852], 99.50th=[ 852], 99.90th=[ 852], 99.95th=[ 852], | 99.99th=[ 852] bw ( KiB/s): min= 8031, max= 8143, per=100.00%, avg=8087.00, stdev=79.20, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=100.00% cpu : usr=0.00%, sys=10.13%, ctx=320, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144735: Sun Aug 9 17:03:38 2026 read: IOPS=0, BW=1516KiB/s (1552kB/s)(4096KiB/2702msec) clat (nsec): min=861840k, max=861840k, avg=861840451.00, stdev= 0.00 lat (nsec): min=861843k, max=861843k, avg=861843454.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 860], 5.00th=[ 860], 10.00th=[ 860], 20.00th=[ 860], | 30.00th=[ 860], 40.00th=[ 860], 50.00th=[ 860], 60.00th=[ 860], | 70.00th=[ 860], 80.00th=[ 860], 90.00th=[ 860], 95.00th=[ 860], | 99.00th=[ 860], 99.50th=[ 860], 99.90th=[ 860], 99.95th=[ 860], | 99.99th=[ 860] bw ( KiB/s): min= 8031, max= 8031, per=100.00%, avg=8031.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=3032KiB/s (3105kB/s)(8192KiB/2702msec); 0 zone resets clat (msec): min=616, max=1219, avg=918.08, stdev=425.93 lat (msec): min=617, max=1219, avg=918.60, stdev=425.76 clat percentiles (msec): | 1.00th=[ 617], 5.00th=[ 617], 10.00th=[ 617], 20.00th=[ 617], | 30.00th=[ 617], 40.00th=[ 617], 50.00th=[ 617], 60.00th=[ 1217], | 70.00th=[ 1217], 80.00th=[ 1217], 90.00th=[ 1217], 95.00th=[ 1217], | 99.00th=[ 1217], 99.50th=[ 1217], 99.90th=[ 1217], 99.95th=[ 1217], | 99.99th=[ 1217] bw ( KiB/s): min= 7627, max= 7627, per=80.31%, avg=7627.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.26%, sys=6.66%, ctx=124, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144736: Sun Aug 9 17:03:38 2026 write: IOPS=0, BW=3562KiB/s (3647kB/s)(12.0MiB/3450msec); 0 zone resets clat (msec): min=428, max=1704, avg=1147.70, stdev=653.17 lat (msec): min=429, max=1706, avg=1148.62, stdev=653.70 clat percentiles (msec): | 1.00th=[ 430], 5.00th=[ 430], 10.00th=[ 430], 20.00th=[ 430], | 30.00th=[ 430], 40.00th=[ 1318], 50.00th=[ 1318], 60.00th=[ 1318], | 70.00th=[ 1703], 80.00th=[ 1703], 90.00th=[ 1703], 95.00th=[ 1703], | 99.00th=[ 1703], 99.50th=[ 1703], 99.90th=[ 1703], 99.95th=[ 1703], | 99.99th=[ 1703] bw ( KiB/s): min= 7627, max= 8159, per=83.11%, avg=7893.00, stdev=376.18, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.00%, sys=4.78%, ctx=42, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144737: Sun Aug 9 17:03:38 2026 write: IOPS=1, BW=4234KiB/s (4336kB/s)(12.0MiB/2902msec); 0 zone resets clat (msec): min=335, max=1692, avg=965.97, stdev=683.67 lat (msec): min=336, max=1693, avg=966.60, stdev=683.63 clat percentiles (msec): | 1.00th=[ 338], 5.00th=[ 338], 10.00th=[ 338], 20.00th=[ 338], | 30.00th=[ 338], 40.00th=[ 869], 50.00th=[ 869], 60.00th=[ 869], | 70.00th=[ 1687], 80.00th=[ 1687], 90.00th=[ 1687], 95.00th=[ 1687], | 99.00th=[ 1687], 99.50th=[ 1687], 99.90th=[ 1687], 99.95th=[ 1687], | 99.99th=[ 1687] bw ( KiB/s): min= 7627, max= 8031, per=82.44%, avg=7829.00, stdev=285.67, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=3.21%, ctx=47, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=6064KiB/s (6209kB/s), 1516KiB/s-4939KiB/s (1552kB/s-5057kB/s), io=16.0MiB (16.8MB), run=2488-2702msec WRITE: bw=9498KiB/s (9726kB/s), 3032KiB/s-4234KiB/s (3105kB/s-4336kB/s), io=32.0MiB (33.6MB), run=2702-3450msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144729: Sun Aug 9 17:03:38 2026 read: IOPS=1, BW=7132KiB/s (7303kB/s)(12.0MiB/1723msec) clat (msec): min=378, max=714, avg=512.99, stdev=177.75 lat (msec): min=378, max=714, avg=512.99, stdev=177.75 clat percentiles (msec): | 1.00th=[ 380], 5.00th=[ 380], 10.00th=[ 380], 20.00th=[ 380], | 30.00th=[ 380], 40.00th=[ 447], 50.00th=[ 447], 60.00th=[ 447], | 70.00th=[ 718], 80.00th=[ 718], 90.00th=[ 718], 95.00th=[ 718], | 99.00th=[ 718], 99.50th=[ 718], 99.90th=[ 718], 99.95th=[ 718], | 99.99th=[ 718] bw ( KiB/s): min=16062, max=16062, per=100.00%, avg=16062.00, stdev= 0.00, samples=1 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=1 lat (msec) : 500=66.67%, 750=33.33% cpu : usr=0.00%, sys=7.14%, ctx=58, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144731: Sun Aug 9 17:03:38 2026 read: IOPS=0, BW=1020KiB/s (1044kB/s)(4096KiB/4017msec) clat (nsec): min=1393.5M, max=1393.5M, avg=1393547700.00, stdev= 0.00 lat (nsec): min=1393.5M, max=1393.5M, avg=1393549770.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1401], 5.00th=[ 1401], 10.00th=[ 1401], 20.00th=[ 1401], | 30.00th=[ 1401], 40.00th=[ 1401], 50.00th=[ 1401], 60.00th=[ 1401], | 70.00th=[ 1401], 80.00th=[ 1401], 90.00th=[ 1401], 95.00th=[ 1401], | 99.00th=[ 1401], 99.50th=[ 1401], 99.90th=[ 1401], 99.95th=[ 1401], | 99.99th=[ 1401] bw ( KiB/s): min= 8078, max= 8078, per=100.00%, avg=8078.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2039KiB/s (2088kB/s)(8192KiB/4017msec); 0 zone resets clat (msec): min=907, max=1607, avg=1257.53, stdev=494.49 lat (msec): min=908, max=1607, avg=1257.89, stdev=494.35 clat percentiles (msec): | 1.00th=[ 911], 5.00th=[ 911], 10.00th=[ 911], 20.00th=[ 911], | 30.00th=[ 911], 40.00th=[ 911], 50.00th=[ 911], 60.00th=[ 1603], | 70.00th=[ 1603], 80.00th=[ 1603], 90.00th=[ 1603], 95.00th=[ 1603], | 99.00th=[ 1603], 99.50th=[ 1603], 99.90th=[ 1603], 99.95th=[ 1603], | 99.99th=[ 1603] bw ( KiB/s): min= 7876, max= 7876, per=100.00%, avg=7876.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 1000=33.33%, 2000=66.67% cpu : usr=0.02%, sys=2.44%, ctx=42, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144732: Sun Aug 9 17:03:38 2026 write: IOPS=0, BW=2720KiB/s (2785kB/s)(12.0MiB/4518msec); 0 zone resets clat (msec): min=283, max=2488, avg=1468.31, stdev=1111.68 lat (msec): min=283, max=2492, avg=1469.92, stdev=1113.22 clat percentiles (msec): | 1.00th=[ 284], 5.00th=[ 284], 10.00th=[ 284], 20.00th=[ 284], | 30.00th=[ 284], 40.00th=[ 1636], 50.00th=[ 1636], 60.00th=[ 1636], | 70.00th=[ 2500], 80.00th=[ 2500], 90.00th=[ 2500], 95.00th=[ 2500], | 99.00th=[ 2500], 99.50th=[ 2500], 99.90th=[ 2500], 99.95th=[ 2500], | 99.99th=[ 2500] bw ( KiB/s): min= 7876, max= 8159, per=100.00%, avg=8017.50, stdev=200.11, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.04%, sys=2.41%, ctx=57, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144733: Sun Aug 9 17:03:38 2026 write: IOPS=0, BW=4077KiB/s (4175kB/s)(12.0MiB/3014msec); 0 zone resets clat (msec): min=402, max=1758, avg=988.48, stdev=696.59 lat (msec): min=402, max=1759, avg=989.19, stdev=696.53 clat percentiles (msec): | 1.00th=[ 401], 5.00th=[ 401], 10.00th=[ 401], 20.00th=[ 401], | 30.00th=[ 401], 40.00th=[ 802], 50.00th=[ 802], 60.00th=[ 802], | 70.00th=[ 1754], 80.00th=[ 1754], 90.00th=[ 1754], 95.00th=[ 1754], | 99.00th=[ 1754], 99.50th=[ 1754], 99.90th=[ 1754], 99.95th=[ 1754], | 99.99th=[ 1754] bw ( KiB/s): min= 6450, max= 8078, per=100.00%, avg=7264.00, stdev=1151.17, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=3.25%, ctx=48, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4079KiB/s (4177kB/s), 1020KiB/s-7132KiB/s (1044kB/s-7303kB/s), io=16.0MiB (16.8MB), run=1723-4017msec WRITE: bw=7253KiB/s (7427kB/s), 2039KiB/s-4077KiB/s (2088kB/s-4175kB/s), io=32.0MiB (33.6MB), run=3014-4518msec