== sanity test 398b: DIO and buffer IO race ============== 15:24:38 (1787858678) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 4.98484 s, 10.1 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=146944: Thu Aug 27 15:26:40 2026 read: IOPS=14, BW=56.6KiB/s (58.0kB/s)(5992KiB/105777msec) clat (usec): min=32, max=740350, avg=34513.18, stdev=31493.31 lat (usec): min=32, max=740351, avg=34514.29, stdev=31493.37 clat percentiles (usec): | 1.00th=[ 49], 5.00th=[ 57], 10.00th=[ 562], 20.00th=[ 15926], | 30.00th=[ 20841], 40.00th=[ 24773], 50.00th=[ 29492], 60.00th=[ 35914], | 70.00th=[ 41681], 80.00th=[ 50594], 90.00th=[ 63177], 95.00th=[ 77071], | 99.00th=[123208], 99.50th=[141558], 99.90th=[379585], 99.95th=[742392], | 99.99th=[742392] bw ( KiB/s): min= 7, max= 135, per=25.29%, avg=56.91, stdev=23.79, samples=206 iops : min= 1, max= 33, avg=13.61, stdev= 5.98, samples=206 write: IOPS=14, BW=59.5KiB/s (60.9kB/s)(6296KiB/105777msec); 0 zone resets clat (usec): min=911, max=319539, avg=34183.34, stdev=36729.49 lat (usec): min=912, max=319541, avg=34185.09, stdev=36729.20 clat percentiles (usec): | 1.00th=[ 1045], 5.00th=[ 1139], 10.00th=[ 1336], 20.00th=[ 3523], | 30.00th=[ 6783], 40.00th=[ 14222], 50.00th=[ 24249], 60.00th=[ 33162], | 70.00th=[ 45351], 80.00th=[ 59507], 90.00th=[ 83362], 95.00th=[102237], | 99.00th=[156238], 99.50th=[200279], 99.90th=[308282], 99.95th=[320865], | 99.99th=[320865] bw ( KiB/s): min= 7, max= 135, per=25.21%, avg=59.49, stdev=22.51, samples=207 iops : min= 1, max= 33, avg=14.25, stdev= 5.69, samples=207 lat (usec) : 50=0.94%, 100=3.45%, 250=0.39%, 500=0.07%, 750=0.03% lat (usec) : 1000=0.29% lat (msec) : 2=7.23%, 4=3.58%, 10=7.98%, 20=13.12%, 50=39.52% lat (msec) : 100=19.53%, 250=3.71%, 500=0.13%, 750=0.03% cpu : usr=0.11%, sys=5.79%, ctx=6558, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146945: Thu Aug 27 15:26:40 2026 read: IOPS=14, BW=56.8KiB/s (58.2kB/s)(5940KiB/104543msec) clat (usec): min=32, max=298218, avg=34659.39, stdev=27326.26 lat (usec): min=33, max=298219, avg=34661.93, stdev=27325.87 clat percentiles (usec): | 1.00th=[ 47], 5.00th=[ 56], 10.00th=[ 6063], 20.00th=[ 15926], | 30.00th=[ 20055], 40.00th=[ 23987], 50.00th=[ 28705], 60.00th=[ 34866], | 70.00th=[ 41681], 80.00th=[ 52167], 90.00th=[ 66847], 95.00th=[ 80217], | 99.00th=[121111], 99.50th=[154141], 99.90th=[299893], 99.95th=[299893], | 99.99th=[299893] bw ( KiB/s): min= 7, max= 143, per=25.16%, avg=56.60, stdev=24.14, samples=206 iops : min= 1, max= 35, avg=13.53, stdev= 6.08, samples=206 write: IOPS=15, BW=60.7KiB/s (62.2kB/s)(6348KiB/104543msec); 0 zone resets clat (usec): min=931, max=732184, avg=33274.69, stdev=37295.75 lat (usec): min=933, max=732185, avg=33276.23, stdev=37296.00 clat percentiles (usec): | 1.00th=[ 1045], 5.00th=[ 1156], 10.00th=[ 1401], 20.00th=[ 3654], | 30.00th=[ 7504], 40.00th=[ 16909], 50.00th=[ 25297], 60.00th=[ 33424], | 70.00th=[ 43254], 80.00th=[ 56361], 90.00th=[ 76022], 95.00th=[ 93848], | 99.00th=[149947], 99.50th=[175113], 99.90th=[274727], 99.95th=[734004], | 99.99th=[734004] bw ( KiB/s): min= 7, max= 134, per=25.66%, avg=60.56, stdev=24.16, samples=206 iops : min= 1, max= 33, avg=14.52, stdev= 6.09, samples=206 lat (usec) : 50=0.98%, 100=3.39%, 250=0.33%, 500=0.03%, 1000=0.13% lat (msec) : 2=6.90%, 4=4.00%, 10=6.58%, 20=14.29%, 50=40.23% lat (msec) : 100=20.18%, 250=2.80%, 500=0.13%, 750=0.03% cpu : usr=0.10%, sys=5.89%, ctx=6466, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146946: Thu Aug 27 15:26:40 2026 read: IOPS=14, BW=56.7KiB/s (58.0kB/s)(6028KiB/106336msec) clat (usec): min=32, max=750309, avg=33622.46, stdev=30504.32 lat (usec): min=32, max=750310, avg=33624.26, stdev=30503.83 clat percentiles (usec): | 1.00th=[ 46], 5.00th=[ 57], 10.00th=[ 2474], 20.00th=[ 15533], | 30.00th=[ 19792], 40.00th=[ 24249], 50.00th=[ 28443], 60.00th=[ 34866], | 70.00th=[ 40633], 80.00th=[ 50070], 90.00th=[ 62653], 95.00th=[ 74974], | 99.00th=[112722], 99.50th=[154141], 99.90th=[202376], 99.95th=[750781], | 99.99th=[750781] bw ( KiB/s): min= 7, max= 116, per=25.17%, avg=56.64, stdev=23.13, samples=208 iops : min= 1, max= 29, avg=13.54, stdev= 5.82, samples=208 write: IOPS=14, BW=58.9KiB/s (60.3kB/s)(6260KiB/106336msec); 0 zone resets clat (usec): min=887, max=255600, avg=35403.11, stdev=35692.98 lat (usec): min=888, max=255601, avg=35405.18, stdev=35693.14 clat percentiles (usec): | 1.00th=[ 1045], 5.00th=[ 1156], 10.00th=[ 1549], 20.00th=[ 4113], | 30.00th=[ 8455], 40.00th=[ 17957], 50.00th=[ 26608], 60.00th=[ 35390], | 70.00th=[ 46400], 80.00th=[ 60556], 90.00th=[ 80217], 95.00th=[101188], | 99.00th=[164627], 99.50th=[193987], 99.90th=[229639], 99.95th=[254804], | 99.99th=[254804] bw ( KiB/s): min= 7, max= 127, per=24.60%, avg=58.06, stdev=23.17, samples=210 iops : min= 1, max= 31, avg=13.91, stdev= 5.83, samples=210 lat (usec) : 50=1.04%, 100=3.29%, 250=0.36%, 500=0.03%, 1000=0.13% lat (msec) : 2=6.18%, 4=3.78%, 10=6.84%, 20=14.71%, 50=40.07% lat (msec) : 100=19.99%, 250=3.52%, 500=0.03%, 1000=0.03% cpu : usr=0.08%, sys=5.75%, ctx=6484, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146947: Thu Aug 27 15:26:40 2026 read: IOPS=14, BW=58.1KiB/s (59.5kB/s)(6052KiB/104191msec) clat (usec): min=32, max=820055, avg=33636.32, stdev=31748.05 lat (usec): min=33, max=820057, avg=33637.37, stdev=31748.06 clat percentiles (usec): | 1.00th=[ 48], 5.00th=[ 56], 10.00th=[ 210], 20.00th=[ 15664], | 30.00th=[ 19792], 40.00th=[ 24511], 50.00th=[ 28967], 60.00th=[ 33817], | 70.00th=[ 40633], 80.00th=[ 49021], 90.00th=[ 63177], 95.00th=[ 74974], | 99.00th=[119014], 99.50th=[143655], 99.90th=[274727], 99.95th=[817890], | 99.99th=[817890] bw ( KiB/s): min= 7, max= 120, per=25.61%, avg=57.63, stdev=22.63, samples=206 iops : min= 1, max= 30, avg=13.80, stdev= 5.70, samples=206 write: IOPS=14, BW=59.9KiB/s (61.3kB/s)(6236KiB/104191msec); 0 zone resets clat (usec): min=930, max=332086, avg=34022.15, stdev=34462.04 lat (usec): min=930, max=332087, avg=34024.60, stdev=34463.48 clat percentiles (usec): | 1.00th=[ 1057], 5.00th=[ 1188], 10.00th=[ 1450], 20.00th=[ 3720], | 30.00th=[ 8094], 40.00th=[ 17433], 50.00th=[ 26346], 60.00th=[ 34866], | 70.00th=[ 44827], 80.00th=[ 57934], 90.00th=[ 78119], 95.00th=[100140], | 99.00th=[141558], 99.50th=[175113], 99.90th=[244319], 99.95th=[333448], | 99.99th=[333448] bw ( KiB/s): min= 7, max= 134, per=25.27%, avg=59.64, stdev=22.02, samples=205 iops : min= 1, max= 33, avg=14.30, stdev= 5.54, samples=205 lat (usec) : 50=0.81%, 100=3.74%, 250=0.39%, 500=0.13%, 750=0.03% lat (usec) : 1000=0.26% lat (msec) : 2=6.38%, 4=4.04%, 10=6.80%, 20=14.36%, 50=40.79% lat (msec) : 100=18.85%, 250=3.32%, 500=0.07%, 1000=0.03% cpu : usr=0.09%, sys=5.94%, ctx=6427, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=226KiB/s (231kB/s), 56.6KiB/s-58.1KiB/s (58.0kB/s-59.5kB/s), io=23.4MiB (24.6MB), run=104191-106336msec WRITE: bw=236KiB/s (242kB/s), 58.9KiB/s-60.7KiB/s (60.3kB/s-62.2kB/s), io=24.6MiB (25.7MB), run=104191-106336msec rand-rw: (groupid=0, jobs=1): err= 0: pid=146939: Thu Aug 27 15:28:44 2026 read: IOPS=6, BW=26.3KiB/s (26.9kB/s)(5992KiB/227844msec) clat (msec): min=4, max=757, avg=28.43, stdev=36.91 lat (msec): min=4, max=757, avg=28.43, stdev=36.91 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 11], | 30.00th=[ 13], 40.00th=[ 16], 50.00th=[ 18], 60.00th=[ 21], | 70.00th=[ 27], 80.00th=[ 39], 90.00th=[ 60], 95.00th=[ 85], | 99.00th=[ 163], 99.50th=[ 197], 99.90th=[ 418], 99.95th=[ 760], | 99.99th=[ 760] bw ( KiB/s): min= 7, max= 103, per=27.95%, avg=29.07, stdev=19.13, samples=401 iops : min= 1, max= 25, avg= 6.67, stdev= 4.83, samples=401 write: IOPS=6, BW=27.6KiB/s (28.3kB/s)(6296KiB/227844msec); 0 zone resets clat (msec): min=28, max=451, avg=117.48, stdev=54.91 lat (msec): min=28, max=451, avg=117.49, stdev=54.91 clat percentiles (msec): | 1.00th=[ 44], 5.00th=[ 55], 10.00th=[ 63], 20.00th=[ 75], | 30.00th=[ 84], 40.00th=[ 93], 50.00th=[ 105], 60.00th=[ 117], | 70.00th=[ 134], 80.00th=[ 157], 90.00th=[ 190], 95.00th=[ 222], | 99.00th=[ 300], 99.50th=[ 359], 99.90th=[ 426], 99.95th=[ 451], | 99.99th=[ 451] bw ( KiB/s): min= 7, max= 64, per=25.09%, avg=27.34, stdev=11.88, samples=447 iops : min= 1, max= 16, avg= 6.23, stdev= 3.05, samples=447 lat (msec) : 10=7.52%, 20=20.74%, 50=15.43%, 100=27.64%, 250=27.05% lat (msec) : 500=1.60%, 1000=0.03% cpu : usr=0.04%, sys=1.20%, ctx=5263, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146940: Thu Aug 27 15:28:44 2026 read: IOPS=6, BW=25.8KiB/s (26.4kB/s)(5940KiB/230080msec) clat (msec): min=5, max=841, avg=27.72, stdev=35.25 lat (msec): min=5, max=841, avg=27.72, stdev=35.25 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 11], | 30.00th=[ 14], 40.00th=[ 16], 50.00th=[ 18], 60.00th=[ 22], | 70.00th=[ 27], 80.00th=[ 36], 90.00th=[ 61], 95.00th=[ 77], | 99.00th=[ 138], 99.50th=[ 190], 99.90th=[ 317], 99.95th=[ 844], | 99.99th=[ 844] bw ( KiB/s): min= 7, max= 128, per=27.35%, avg=28.44, stdev=18.78, samples=405 iops : min= 1, max= 32, avg= 6.52, stdev= 4.75, samples=405 write: IOPS=6, BW=27.6KiB/s (28.3kB/s)(6348KiB/230080msec); 0 zone resets clat (msec): min=32, max=443, avg=118.83, stdev=53.38 lat (msec): min=32, max=443, avg=118.84, stdev=53.38 clat percentiles (msec): | 1.00th=[ 43], 5.00th=[ 55], 10.00th=[ 64], 20.00th=[ 77], | 30.00th=[ 86], 40.00th=[ 96], 50.00th=[ 107], 60.00th=[ 122], | 70.00th=[ 138], 80.00th=[ 157], 90.00th=[ 188], 95.00th=[ 222], | 99.00th=[ 288], 99.50th=[ 334], 99.90th=[ 430], 99.95th=[ 443], | 99.99th=[ 443] bw ( KiB/s): min= 7, max= 56, per=24.97%, avg=27.22, stdev=11.43, samples=452 iops : min= 1, max= 14, avg= 6.21, stdev= 2.93, samples=452 lat (msec) : 10=7.45%, 20=20.48%, 50=15.49%, 100=26.11%, 250=29.04% lat (msec) : 500=1.40%, 1000=0.03% cpu : usr=0.04%, sys=1.14%, ctx=5195, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146941: Thu Aug 27 15:28:44 2026 read: IOPS=6, BW=26.3KiB/s (26.0kB/s)(6028KiB/228973msec) clat (msec): min=5, max=378, avg=28.45, stdev=29.92 lat (msec): min=5, max=378, avg=28.46, stdev=29.92 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 11], | 30.00th=[ 13], 40.00th=[ 16], 50.00th=[ 18], 60.00th=[ 22], | 70.00th=[ 28], 80.00th=[ 40], 90.00th=[ 65], 95.00th=[ 82], | 99.00th=[ 144], 99.50th=[ 188], 99.90th=[ 288], 99.95th=[ 380], | 99.99th=[ 380] bw ( KiB/s): min= 7, max= 127, per=26.76%, avg=27.83, stdev=19.21, samples=421 iops : min= 1, max= 31, avg= 6.36, stdev= 4.86, samples=421 write: IOPS=6, BW=27.3KiB/s (27.0kB/s)(6260KiB/228973msec); 0 zone resets clat (msec): min=31, max=964, avg=118.71, stdev=56.64 lat (msec): min=31, max=964, avg=118.71, stdev=56.64 clat percentiles (msec): | 1.00th=[ 44], 5.00th=[ 53], 10.00th=[ 63], 20.00th=[ 75], | 30.00th=[ 87], 40.00th=[ 96], 50.00th=[ 109], 60.00th=[ 121], | 70.00th=[ 134], 80.00th=[ 157], 90.00th=[ 186], 95.00th=[ 220], | 99.00th=[ 288], 99.50th=[ 342], 99.90th=[ 447], 99.95th=[ 961], | 99.99th=[ 961] bw ( KiB/s): min= 7, max= 63, per=24.80%, avg=27.03, stdev=11.82, samples=449 iops : min= 1, max= 15, avg= 6.16, stdev= 3.03, samples=449 lat (msec) : 10=7.91%, 20=19.73%, 50=15.95%, 100=25.81%, 250=29.30% lat (msec) : 500=1.27%, 1000=0.03% cpu : usr=0.04%, sys=1.20%, ctx=5281, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146942: Thu Aug 27 15:28:44 2026 read: IOPS=6, BW=26.5KiB/s (27.1kB/s)(6052KiB/228485msec) clat (msec): min=5, max=389, avg=28.14, stdev=31.36 lat (msec): min=5, max=389, avg=28.15, stdev=31.36 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 11], | 30.00th=[ 13], 40.00th=[ 15], 50.00th=[ 18], 60.00th=[ 22], | 70.00th=[ 26], 80.00th=[ 36], 90.00th=[ 64], 95.00th=[ 93], | 99.00th=[ 140], 99.50th=[ 165], 99.90th=[ 376], 99.95th=[ 388], | 99.99th=[ 388] bw ( KiB/s): min= 7, max= 128, per=27.94%, avg=29.06, stdev=20.13, samples=405 iops : min= 1, max= 32, avg= 6.68, stdev= 5.11, samples=405 write: IOPS=6, BW=27.3KiB/s (27.9kB/s)(6236KiB/228485msec); 0 zone resets clat (msec): min=33, max=939, avg=119.00, stdev=56.96 lat (msec): min=33, max=939, avg=119.00, stdev=56.97 clat percentiles (msec): | 1.00th=[ 45], 5.00th=[ 56], 10.00th=[ 63], 20.00th=[ 74], | 30.00th=[ 86], 40.00th=[ 96], 50.00th=[ 108], 60.00th=[ 120], | 70.00th=[ 136], 80.00th=[ 155], 90.00th=[ 192], 95.00th=[ 220], | 99.00th=[ 288], 99.50th=[ 347], 99.90th=[ 447], 99.95th=[ 936], | 99.99th=[ 936] bw ( KiB/s): min= 7, max= 56, per=24.59%, avg=26.80, stdev=11.66, samples=451 iops : min= 1, max= 14, avg= 6.10, stdev= 2.99, samples=451 lat (msec) : 10=7.88%, 20=20.48%, 50=15.04%, 100=25.81%, 250=29.46% lat (msec) : 500=1.30%, 1000=0.03% cpu : usr=0.04%, sys=1.16%, ctx=5242, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=104KiB/s (107kB/s), 25.8KiB/s-26.5KiB/s (26.4kB/s-27.1kB/s), io=23.4MiB (24.6MB), run=227844-230080msec WRITE: bw=109KiB/s (112kB/s), 27.3KiB/s-27.6KiB/s (27.9kB/s-28.3kB/s), io=24.6MiB (25.7MB), run=227844-230080msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=146995: Thu Aug 27 15:29:16 2026 read: IOPS=15, BW=247KiB/s (253kB/s)(5920KiB/24006msec) clat (usec): min=37, max=147620, avg=31733.05, stdev=25300.67 lat (usec): min=38, max=147621, avg=31734.08, stdev=25300.68 clat percentiles (usec): | 1.00th=[ 41], 5.00th=[ 51], 10.00th=[ 61], 20.00th=[ 153], | 30.00th=[ 17171], 40.00th=[ 23987], 50.00th=[ 29492], 60.00th=[ 35914], | 70.00th=[ 43254], 80.00th=[ 52167], 90.00th=[ 65799], 95.00th=[ 77071], | 99.00th=[103285], 99.50th=[108528], 99.90th=[147850], 99.95th=[147850], | 99.99th=[147850] bw ( KiB/s): min= 63, max= 475, per=24.07%, avg=240.00, stdev=86.92, samples=47 iops : min= 3, max= 29, avg=14.21, stdev= 5.49, samples=47 write: IOPS=16, BW=265KiB/s (272kB/s)(6368KiB/24006msec); 0 zone resets clat (usec): min=1380, max=228021, avg=30059.51, stdev=31865.92 lat (usec): min=1382, max=228023, avg=30064.06, stdev=31863.66 clat percentiles (usec): | 1.00th=[ 1450], 5.00th=[ 1762], 10.00th=[ 2409], 20.00th=[ 4359], | 30.00th=[ 8356], 40.00th=[ 12780], 50.00th=[ 21627], 60.00th=[ 28967], | 70.00th=[ 37487], 80.00th=[ 50594], 90.00th=[ 69731], 95.00th=[ 88605], | 99.00th=[158335], 99.50th=[214959], 99.90th=[227541], 99.95th=[227541], | 99.99th=[227541] bw ( KiB/s): min= 95, max= 601, per=24.87%, avg=260.94, stdev=97.09, samples=47 iops : min= 5, max= 37, avg=15.53, stdev= 6.12, samples=47 lat (usec) : 50=2.21%, 100=6.90%, 250=0.78%, 500=0.39%, 750=0.13% lat (usec) : 1000=0.13% lat (msec) : 2=3.65%, 4=6.12%, 10=7.81%, 20=13.28%, 50=36.85% lat (msec) : 100=19.40%, 250=2.34% cpu : usr=0.08%, sys=7.34%, ctx=1435, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146996: Thu Aug 27 15:29:16 2026 read: IOPS=15, BW=243KiB/s (249kB/s)(5744KiB/23627msec) clat (usec): min=38, max=166735, avg=33449.89, stdev=25459.63 lat (usec): min=38, max=166736, avg=33451.02, stdev=25459.88 clat percentiles (usec): | 1.00th=[ 42], 5.00th=[ 55], 10.00th=[ 65], 20.00th=[ 11207], | 30.00th=[ 19792], 40.00th=[ 25297], 50.00th=[ 31065], 60.00th=[ 35390], | 70.00th=[ 44303], 80.00th=[ 56361], 90.00th=[ 67634], 95.00th=[ 79168], | 99.00th=[100140], 99.50th=[104334], 99.90th=[166724], 99.95th=[166724], | 99.99th=[166724] bw ( KiB/s): min= 94, max= 480, per=24.45%, avg=243.74, stdev=93.61, samples=46 iops : min= 5, max= 30, avg=14.46, stdev= 5.93, samples=46 write: IOPS=17, BW=277KiB/s (284kB/s)(6544KiB/23627msec); 0 zone resets clat (usec): min=1455, max=385898, avg=27942.15, stdev=35534.22 lat (usec): min=1456, max=385899, avg=27943.85, stdev=35534.15 clat percentiles (usec): | 1.00th=[ 1516], 5.00th=[ 1696], 10.00th=[ 2212], 20.00th=[ 3916], | 30.00th=[ 5669], 40.00th=[ 9241], 50.00th=[ 15401], 60.00th=[ 25297], | 70.00th=[ 34866], 80.00th=[ 46400], 90.00th=[ 65799], 95.00th=[ 90702], | 99.00th=[131597], 99.50th=[183501], 99.90th=[387974], 99.95th=[387974], | 99.99th=[387974] bw ( KiB/s): min= 63, max= 541, per=26.46%, avg=277.57, stdev=94.12, samples=46 iops : min= 3, max= 33, avg=16.59, stdev= 5.93, samples=46 lat (usec) : 50=1.17%, 100=6.25%, 250=0.65%, 1000=0.13% lat (msec) : 2=5.08%, 4=6.90%, 10=11.20%, 20=12.37%, 50=35.94% lat (msec) : 100=18.10%, 250=2.08%, 500=0.13% cpu : usr=0.07%, sys=6.89%, ctx=1420, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146998: Thu Aug 27 15:29:16 2026 read: IOPS=16, BW=266KiB/s (273kB/s)(6256KiB/23478msec) clat (usec): min=37, max=296760, avg=33312.18, stdev=30704.66 lat (usec): min=38, max=296762, avg=33313.67, stdev=30704.81 clat percentiles (usec): | 1.00th=[ 42], 5.00th=[ 55], 10.00th=[ 62], 20.00th=[ 208], | 30.00th=[ 21627], 40.00th=[ 24773], 50.00th=[ 29230], 60.00th=[ 34866], | 70.00th=[ 40633], 80.00th=[ 50070], 90.00th=[ 61604], 95.00th=[ 79168], | 99.00th=[156238], 99.50th=[206570], 99.90th=[295699], 99.95th=[295699], | 99.99th=[295699] bw ( KiB/s): min= 95, max= 478, per=26.87%, avg=267.85, stdev=86.89, samples=46 iops : min= 5, max= 29, avg=15.98, stdev= 5.50, samples=46 write: IOPS=16, BW=257KiB/s (263kB/s)(6032KiB/23478msec); 0 zone resets clat (usec): min=1445, max=209741, avg=27541.44, stdev=29307.18 lat (usec): min=1447, max=209743, avg=27543.18, stdev=29307.19 clat percentiles (usec): | 1.00th=[ 1565], 5.00th=[ 1696], 10.00th=[ 2278], 20.00th=[ 3982], | 30.00th=[ 6259], 40.00th=[ 10290], 50.00th=[ 16057], 60.00th=[ 26608], | 70.00th=[ 36439], 80.00th=[ 49021], 90.00th=[ 65274], 95.00th=[ 80217], | 99.00th=[117965], 99.50th=[160433], 99.90th=[210764], 99.95th=[210764], | 99.99th=[210764] bw ( KiB/s): min= 63, max= 508, per=24.29%, avg=254.78, stdev=103.04, samples=46 iops : min= 3, max= 31, avg=15.15, stdev= 6.49, samples=46 lat (usec) : 50=1.04%, 100=8.07%, 250=1.17%, 500=0.13%, 750=0.13% lat (msec) : 2=4.04%, 4=6.25%, 10=9.24%, 20=10.16%, 50=39.97% lat (msec) : 100=17.58%, 250=2.08%, 500=0.13% cpu : usr=0.08%, sys=7.12%, ctx=1482, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146999: Thu Aug 27 15:29:16 2026 read: IOPS=16, BW=269KiB/s (275kB/s)(6032KiB/22462msec) clat (usec): min=36, max=170173, avg=30800.76, stdev=24339.77 lat (usec): min=36, max=170174, avg=30807.50, stdev=24345.32 clat percentiles (usec): | 1.00th=[ 41], 5.00th=[ 54], 10.00th=[ 61], 20.00th=[ 109], | 30.00th=[ 19006], 40.00th=[ 23987], 50.00th=[ 29230], 60.00th=[ 35390], | 70.00th=[ 41681], 80.00th=[ 50070], 90.00th=[ 61080], 95.00th=[ 69731], | 99.00th=[109577], 99.50th=[141558], 99.90th=[170918], 99.95th=[170918], | 99.99th=[170918] bw ( KiB/s): min= 31, max= 447, per=26.71%, avg=266.32, stdev=100.00, samples=44 iops : min= 1, max= 27, avg=15.89, stdev= 6.31, samples=44 write: IOPS=17, BW=279KiB/s (285kB/s)(6256KiB/22462msec); 0 zone resets clat (usec): min=1373, max=294541, avg=27230.70, stdev=33177.74 lat (usec): min=1374, max=294543, avg=27232.39, stdev=33177.79 clat percentiles (usec): | 1.00th=[ 1467], 5.00th=[ 1762], 10.00th=[ 2376], 20.00th=[ 4228], | 30.00th=[ 6652], 40.00th=[ 10028], 50.00th=[ 13960], 60.00th=[ 20579], | 70.00th=[ 33162], 80.00th=[ 45876], 90.00th=[ 66323], 95.00th=[ 90702], | 99.00th=[166724], 99.50th=[170918], 99.90th=[295699], 99.95th=[295699], | 99.99th=[295699] bw ( KiB/s): min= 95, max= 448, per=26.49%, avg=277.84, stdev=95.57, samples=44 iops : min= 5, max= 28, avg=16.61, stdev= 6.07, samples=44 lat (usec) : 50=1.30%, 100=8.46%, 250=0.52%, 500=0.26%, 1000=0.39% lat (msec) : 2=4.04%, 4=5.34%, 10=11.59%, 20=13.28%, 50=35.42% lat (msec) : 100=17.32%, 250=1.95%, 500=0.13% cpu : usr=0.06%, sys=7.27%, ctx=1453, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=998KiB/s (1022kB/s), 243KiB/s-269KiB/s (249kB/s-275kB/s), io=23.4MiB (24.5MB), run=22462-24006msec WRITE: bw=1050KiB/s (1075kB/s), 257KiB/s-279KiB/s (263kB/s-285kB/s), io=24.6MiB (25.8MB), run=22462-24006msec rand-rw: (groupid=0, jobs=1): err= 0: pid=146997: Thu Aug 27 15:29:48 2026 read: IOPS=6, BW=108KiB/s (111kB/s)(5920KiB/54666msec) clat (msec): min=6, max=240, avg=30.63, stdev=31.63 lat (msec): min=6, max=240, avg=30.64, stdev=31.63 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 9], 10.00th=[ 10], 20.00th=[ 13], | 30.00th=[ 15], 40.00th=[ 17], 50.00th=[ 20], 60.00th=[ 22], | 70.00th=[ 27], 80.00th=[ 39], 90.00th=[ 78], 95.00th=[ 96], | 99.00th=[ 165], 99.50th=[ 220], 99.90th=[ 241], 99.95th=[ 241], | 99.99th=[ 241] bw ( KiB/s): min= 30, max= 383, per=26.53%, avg=114.60, stdev=68.08, samples=101 iops : min= 1, max= 23, avg= 6.43, stdev= 4.30, samples=101 write: IOPS=7, BW=116KiB/s (119kB/s)(6368KiB/54666msec); 0 zone resets clat (msec): min=42, max=444, avg=108.55, stdev=54.51 lat (msec): min=42, max=444, avg=108.55, stdev=54.51 clat percentiles (msec): | 1.00th=[ 47], 5.00th=[ 53], 10.00th=[ 61], 20.00th=[ 70], | 30.00th=[ 78], 40.00th=[ 85], 50.00th=[ 94], 60.00th=[ 104], | 70.00th=[ 118], 80.00th=[ 136], 90.00th=[ 178], 95.00th=[ 220], | 99.00th=[ 326], 99.50th=[ 439], 99.90th=[ 443], 99.95th=[ 443], | 99.99th=[ 443] bw ( KiB/s): min= 31, max= 223, per=25.42%, avg=115.67, stdev=51.94, samples=108 iops : min= 1, max= 13, avg= 6.49, stdev= 3.31, samples=108 lat (msec) : 10=4.82%, 20=21.35%, 50=15.36%, 100=34.51%, 250=22.92% lat (msec) : 500=1.04% cpu : usr=0.03%, sys=1.42%, ctx=1294, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147000: Thu Aug 27 15:29:48 2026 read: IOPS=6, BW=104KiB/s (106kB/s)(5744KiB/55384msec) clat (msec): min=6, max=214, avg=32.06, stdev=32.08 lat (msec): min=6, max=214, avg=32.06, stdev=32.08 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 11], 20.00th=[ 13], | 30.00th=[ 15], 40.00th=[ 17], 50.00th=[ 20], 60.00th=[ 23], | 70.00th=[ 29], 80.00th=[ 45], 90.00th=[ 72], 95.00th=[ 110], | 99.00th=[ 155], 99.50th=[ 163], 99.90th=[ 215], 99.95th=[ 215], | 99.99th=[ 215] bw ( KiB/s): min= 21, max= 383, per=26.01%, avg=112.38, stdev=72.29, samples=100 iops : min= 1, max= 23, avg= 6.25, stdev= 4.53, samples=100 write: IOPS=7, BW=118KiB/s (121kB/s)(6544KiB/55384msec); 0 zone resets clat (msec): min=34, max=439, avg=106.78, stdev=52.39 lat (msec): min=34, max=439, avg=106.78, stdev=52.39 clat percentiles (msec): | 1.00th=[ 44], 5.00th=[ 53], 10.00th=[ 57], 20.00th=[ 68], | 30.00th=[ 75], 40.00th=[ 82], 50.00th=[ 91], 60.00th=[ 106], | 70.00th=[ 120], 80.00th=[ 140], 90.00th=[ 174], 95.00th=[ 215], | 99.00th=[ 275], 99.50th=[ 321], 99.90th=[ 439], 99.95th=[ 439], | 99.99th=[ 439] bw ( KiB/s): min= 31, max= 223, per=25.85%, avg=117.60, stdev=51.88, samples=109 iops : min= 1, max= 13, avg= 6.58, stdev= 3.30, samples=109 lat (msec) : 10=3.26%, 20=20.83%, 50=16.80%, 100=33.33%, 250=24.61% lat (msec) : 500=1.17% cpu : usr=0.05%, sys=1.40%, ctx=1307, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147001: Thu Aug 27 15:29:48 2026 read: IOPS=7, BW=116KiB/s (119kB/s)(6256KiB/53832msec) clat (msec): min=5, max=243, avg=28.69, stdev=29.73 lat (msec): min=5, max=243, avg=28.70, stdev=29.73 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 10], 10.00th=[ 11], 20.00th=[ 13], | 30.00th=[ 15], 40.00th=[ 17], 50.00th=[ 19], 60.00th=[ 24], | 70.00th=[ 28], 80.00th=[ 34], 90.00th=[ 54], 95.00th=[ 84], | 99.00th=[ 171], 99.50th=[ 218], 99.90th=[ 245], 99.95th=[ 245], | 99.99th=[ 245] bw ( KiB/s): min= 31, max= 352, per=29.19%, avg=126.08, stdev=84.65, samples=98 iops : min= 1, max= 22, avg= 7.15, stdev= 5.32, samples=98 write: IOPS=7, BW=112KiB/s (115kB/s)(6032KiB/53832msec); 0 zone resets clat (msec): min=39, max=358, avg=112.38, stdev=52.48 lat (msec): min=39, max=358, avg=112.38, stdev=52.48 clat percentiles (msec): | 1.00th=[ 43], 5.00th=[ 55], 10.00th=[ 61], 20.00th=[ 72], | 30.00th=[ 81], 40.00th=[ 89], 50.00th=[ 101], 60.00th=[ 110], | 70.00th=[ 121], 80.00th=[ 142], 90.00th=[ 188], 95.00th=[ 224], | 99.00th=[ 292], 99.50th=[ 305], 99.90th=[ 359], 99.95th=[ 359], | 99.99th=[ 359] bw ( KiB/s): min= 31, max= 223, per=24.39%, avg=110.97, stdev=47.43, samples=106 iops : min= 1, max= 13, avg= 6.18, stdev= 3.00, samples=106 lat (msec) : 10=3.78%, 20=23.18%, 50=19.53%, 100=27.08%, 250=25.26% lat (msec) : 500=1.17% cpu : usr=0.04%, sys=1.55%, ctx=1397, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147002: Thu Aug 27 15:29:48 2026 read: IOPS=6, BW=110KiB/s (112kB/s)(6032KiB/54986msec) clat (msec): min=5, max=484, avg=31.96, stdev=41.46 lat (msec): min=5, max=484, avg=31.97, stdev=41.46 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 11], 20.00th=[ 13], | 30.00th=[ 14], 40.00th=[ 16], 50.00th=[ 18], 60.00th=[ 22], | 70.00th=[ 27], 80.00th=[ 39], 90.00th=[ 69], 95.00th=[ 106], | 99.00th=[ 199], 99.50th=[ 262], 99.90th=[ 485], 99.95th=[ 485], | 99.99th=[ 485] bw ( KiB/s): min= 30, max= 345, per=26.83%, avg=115.91, stdev=73.29, samples=102 iops : min= 1, max= 21, avg= 6.52, stdev= 4.68, samples=102 write: IOPS=7, BW=114KiB/s (117kB/s)(6256KiB/54986msec); 0 zone resets clat (msec): min=38, max=415, avg=109.12, stdev=51.88 lat (msec): min=38, max=415, avg=109.12, stdev=51.88 clat percentiles (msec): | 1.00th=[ 42], 5.00th=[ 54], 10.00th=[ 60], 20.00th=[ 71], | 30.00th=[ 79], 40.00th=[ 86], 50.00th=[ 97], 60.00th=[ 107], | 70.00th=[ 122], 80.00th=[ 138], 90.00th=[ 178], 95.00th=[ 220], | 99.00th=[ 296], 99.50th=[ 359], 99.90th=[ 418], 99.95th=[ 418], | 99.99th=[ 418] bw ( KiB/s): min= 30, max= 253, per=25.16%, avg=114.49, stdev=50.16, samples=108 iops : min= 1, max= 15, avg= 6.42, stdev= 3.18, samples=108 lat (msec) : 10=4.56%, 20=23.05%, 50=15.63%, 100=29.95%, 250=25.26% lat (msec) : 500=1.56% cpu : usr=0.04%, sys=1.45%, ctx=1362, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=432KiB/s (443kB/s), 104KiB/s-116KiB/s (106kB/s-119kB/s), io=23.4MiB (24.5MB), run=53832-55384msec WRITE: bw=455KiB/s (466kB/s), 112KiB/s-118KiB/s (115kB/s-121kB/s), io=24.6MiB (25.8MB), run=53832-55384msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=147016: Thu Aug 27 15:30:00 2026 read: IOPS=2, BW=2271KiB/s (2325kB/s)(7168KiB/3157msec) clat (usec): min=1087, max=316913, avg=202182.74, stdev=101281.46 lat (usec): min=1088, max=316914, avg=202183.95, stdev=101281.48 clat percentiles (usec): | 1.00th=[ 1090], 5.00th=[ 1090], 10.00th=[ 1090], 20.00th=[162530], | 30.00th=[193987], 40.00th=[193987], 50.00th=[229639], 60.00th=[250610], | 70.00th=[250610], 80.00th=[258999], 90.00th=[316670], 95.00th=[316670], | 99.00th=[316670], 99.50th=[316670], 99.90th=[316670], 99.95th=[316670], | 99.99th=[316670] bw ( KiB/s): min= 1928, max= 4087, per=54.32%, avg=2995.25, stdev=1168.82, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 1.15, samples=4 write: IOPS=1, BW=1622KiB/s (1661kB/s)(5120KiB/3157msec); 0 zone resets clat (msec): min=120, max=658, avg=340.77, stdev=251.69 lat (msec): min=120, max=658, avg=341.36, stdev=251.42 clat percentiles (msec): | 1.00th=[ 122], 5.00th=[ 122], 10.00th=[ 122], 20.00th=[ 122], | 30.00th=[ 128], 40.00th=[ 128], 50.00th=[ 239], 60.00th=[ 239], | 70.00th=[ 558], 80.00th=[ 558], 90.00th=[ 659], 95.00th=[ 659], | 99.00th=[ 659], 99.50th=[ 659], 99.90th=[ 659], 99.95th=[ 659], | 99.99th=[ 659] bw ( KiB/s): min= 2043, max= 6119, per=52.87%, avg=4081.00, stdev=2882.17, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 lat (msec) : 2=8.33%, 250=50.00%, 500=25.00%, 750=16.67% cpu : usr=0.00%, sys=19.52%, ctx=263, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147017: Thu Aug 27 15:30:00 2026 read: IOPS=0, BW=551KiB/s (565kB/s)(2048KiB/3714msec) clat (usec): min=524, max=205335, avg=102930.26, stdev=144823.05 lat (usec): min=526, max=205342, avg=102934.19, stdev=144826.96 clat percentiles (usec): | 1.00th=[ 529], 5.00th=[ 529], 10.00th=[ 529], 20.00th=[ 529], | 30.00th=[ 529], 40.00th=[ 529], 50.00th=[ 529], 60.00th=[204473], | 70.00th=[204473], 80.00th=[204473], 90.00th=[204473], 95.00th=[204473], | 99.00th=[204473], 99.50th=[204473], 99.90th=[204473], 99.95th=[204473], | 99.99th=[204473] bw ( KiB/s): min= 1928, max= 1976, per=35.40%, avg=1952.00, stdev=33.94, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2757KiB/s (2823kB/s)(10.0MiB/3714msec); 0 zone resets clat (msec): min=153, max=1030, avg=335.95, stdev=288.30 lat (msec): min=154, max=1030, avg=336.06, stdev=288.29 clat percentiles (msec): | 1.00th=[ 155], 5.00th=[ 155], 10.00th=[ 155], 20.00th=[ 155], | 30.00th=[ 180], 40.00th=[ 188], 50.00th=[ 188], 60.00th=[ 243], | 70.00th=[ 255], 80.00th=[ 296], 90.00th=[ 676], 95.00th=[ 1028], | 99.00th=[ 1028], 99.50th=[ 1028], 99.90th=[ 1028], 99.95th=[ 1028], | 99.99th=[ 1028] bw ( KiB/s): min= 2039, max= 6131, per=58.69%, avg=4530.25, stdev=1972.46, samples=4 iops : min= 1, max= 5, avg= 3.50, stdev= 1.91, samples=4 lat (usec) : 750=8.33% lat (msec) : 250=58.33%, 500=16.67%, 750=8.33%, 2000=8.33% cpu : usr=0.03%, sys=16.05%, ctx=128, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147018: Thu Aug 27 15:30:00 2026 read: IOPS=2, BW=2231KiB/s (2284kB/s)(6144KiB/2754msec) clat (usec): min=483, max=228829, avg=75336.23, stdev=104890.21 lat (usec): min=484, max=228831, avg=75337.30, stdev=104890.29 clat percentiles (usec): | 1.00th=[ 486], 5.00th=[ 486], 10.00th=[ 486], 20.00th=[ 486], | 30.00th=[ 486], 40.00th=[ 523], 50.00th=[ 523], 60.00th=[ 32900], | 70.00th=[187696], 80.00th=[187696], 90.00th=[229639], 95.00th=[229639], | 99.00th=[229639], 99.50th=[229639], 99.90th=[229639], 99.95th=[229639], | 99.99th=[229639] bw ( KiB/s): min= 4087, max= 6000, per=91.47%, avg=5043.50, stdev=1352.70, samples=2 iops : min= 3, max= 5, avg= 4.00, stdev= 1.41, samples=2 write: IOPS=2, BW=2231KiB/s (2284kB/s)(6144KiB/2754msec); 0 zone resets clat (msec): min=161, max=705, avg=375.65, stdev=233.26 lat (msec): min=161, max=705, avg=375.70, stdev=233.27 clat percentiles (msec): | 1.00th=[ 161], 5.00th=[ 161], 10.00th=[ 161], 20.00th=[ 197], | 30.00th=[ 197], 40.00th=[ 232], 50.00th=[ 232], 60.00th=[ 334], | 70.00th=[ 625], 80.00th=[ 625], 90.00th=[ 709], 95.00th=[ 709], | 99.00th=[ 709], 99.50th=[ 709], 99.90th=[ 709], 99.95th=[ 709], | 99.99th=[ 709] bw ( KiB/s): min= 2000, max= 2864, per=28.97%, avg=2236.50, stdev=418.78, samples=4 iops : min= 1, max= 2, avg= 1.25, stdev= 0.50, samples=4 lat (usec) : 500=16.67%, 750=8.33% lat (msec) : 50=8.33%, 250=41.67%, 500=8.33%, 750=16.67% cpu : usr=0.04%, sys=13.55%, ctx=163, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147019: Thu Aug 27 15:30:00 2026 read: IOPS=1, BW=1617KiB/s (1656kB/s)(5120KiB/3166msec) clat (usec): min=503, max=190129, avg=102137.29, stdev=95472.25 lat (usec): min=504, max=190130, avg=102138.69, stdev=95472.30 clat percentiles (usec): | 1.00th=[ 502], 5.00th=[ 502], 10.00th=[ 502], 20.00th=[ 502], | 30.00th=[ 1713], 40.00th=[ 1713], 50.00th=[129500], 60.00th=[129500], | 70.00th=[189793], 80.00th=[189793], 90.00th=[189793], 95.00th=[189793], | 99.00th=[189793], 99.50th=[189793], 99.90th=[189793], 99.95th=[189793], | 99.99th=[189793] bw ( KiB/s): min= 4079, max= 4079, per=73.98%, avg=4079.00, stdev= 0.00, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2264KiB/s (2318kB/s)(7168KiB/3166msec); 0 zone resets clat (msec): min=174, max=623, avg=362.12, stdev=175.34 lat (msec): min=174, max=623, avg=362.19, stdev=175.35 clat percentiles (msec): | 1.00th=[ 176], 5.00th=[ 176], 10.00th=[ 176], 20.00th=[ 224], | 30.00th=[ 249], 40.00th=[ 249], 50.00th=[ 309], 60.00th=[ 384], | 70.00th=[ 384], 80.00th=[ 575], 90.00th=[ 625], 95.00th=[ 625], | 99.00th=[ 625], 99.50th=[ 625], 99.90th=[ 625], 99.95th=[ 625], | 99.99th=[ 625] bw ( KiB/s): min= 1928, max= 2043, per=26.07%, avg=2012.67, stdev=47.37, samples=6 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=6 lat (usec) : 750=8.33% lat (msec) : 2=8.33%, 250=50.00%, 500=16.67%, 750=16.67% cpu : usr=0.00%, sys=19.27%, ctx=170, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5514KiB/s (5647kB/s), 551KiB/s-2271KiB/s (565kB/s-2325kB/s), io=20.0MiB (20.0MB), run=2754-3714msec WRITE: bw=7720KiB/s (7905kB/s), 1622KiB/s-2757KiB/s (1661kB/s-2823kB/s), io=28.0MiB (29.4MB), run=2754-3714msec rand-rw: (groupid=0, jobs=1): err= 0: pid=147021: Thu Aug 27 15:30:01 2026 read: IOPS=1, BW=1646KiB/s (1685kB/s)(7168KiB/4355msec) clat (msec): min=73, max=980, avg=353.86, stdev=320.01 lat (msec): min=73, max=980, avg=353.86, stdev=320.01 clat percentiles (msec): | 1.00th=[ 74], 5.00th=[ 74], 10.00th=[ 74], 20.00th=[ 108], | 30.00th=[ 150], 40.00th=[ 150], 50.00th=[ 243], 60.00th=[ 414], | 70.00th=[ 414], 80.00th=[ 514], 90.00th=[ 978], 95.00th=[ 978], | 99.00th=[ 978], 99.50th=[ 978], 99.90th=[ 978], 99.95th=[ 978], | 99.99th=[ 978] bw ( KiB/s): min= 1505, max= 4071, per=49.92%, avg=2333.80, stdev=997.58, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 write: IOPS=1, BW=1176KiB/s (1204kB/s)(5120KiB/4355msec); 0 zone resets clat (msec): min=118, max=1039, avg=349.88, stdev=387.64 lat (msec): min=118, max=1039, avg=349.96, stdev=387.64 clat percentiles (msec): | 1.00th=[ 120], 5.00th=[ 120], 10.00th=[ 120], 20.00th=[ 120], | 30.00th=[ 155], 40.00th=[ 155], 50.00th=[ 215], 60.00th=[ 215], | 70.00th=[ 222], 80.00th=[ 222], 90.00th=[ 1036], 95.00th=[ 1036], | 99.00th=[ 1036], 99.50th=[ 1036], 99.90th=[ 1036], 99.95th=[ 1036], | 99.99th=[ 1036] bw ( KiB/s): min= 1980, max= 4015, per=40.93%, avg=2679.33, stdev=1157.15, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (msec) : 100=8.33%, 250=58.33%, 500=8.33%, 750=8.33%, 1000=8.33% lat (msec) : 2000=8.33% cpu : usr=0.09%, sys=3.22%, ctx=64, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147022: Thu Aug 27 15:30:01 2026 read: IOPS=0, BW=512KiB/s (524kB/s)(2048KiB/4003msec) clat (msec): min=140, max=170, avg=155.67, stdev=21.61 lat (msec): min=140, max=170, avg=155.68, stdev=21.61 clat percentiles (msec): | 1.00th=[ 140], 5.00th=[ 140], 10.00th=[ 140], 20.00th=[ 140], | 30.00th=[ 140], 40.00th=[ 140], 50.00th=[ 140], 60.00th=[ 171], | 70.00th=[ 171], 80.00th=[ 171], 90.00th=[ 171], 95.00th=[ 171], | 99.00th=[ 171], 99.50th=[ 171], 99.90th=[ 171], 99.95th=[ 171], | 99.99th=[ 171] bw ( KiB/s): min= 1471, max= 2043, per=37.58%, avg=1757.00, stdev=404.47, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2558KiB/s (2619kB/s)(10.0MiB/4003msec); 0 zone resets clat (msec): min=160, max=708, avg=357.26, stdev=201.78 lat (msec): min=160, max=708, avg=357.89, stdev=202.39 clat percentiles (msec): | 1.00th=[ 161], 5.00th=[ 161], 10.00th=[ 161], 20.00th=[ 163], | 30.00th=[ 211], 40.00th=[ 236], 50.00th=[ 236], 60.00th=[ 309], | 70.00th=[ 363], 80.00th=[ 558], 90.00th=[ 625], 95.00th=[ 709], | 99.00th=[ 709], 99.50th=[ 709], 99.90th=[ 709], 99.95th=[ 709], | 99.99th=[ 709] bw ( KiB/s): min= 1980, max= 4087, per=41.21%, avg=2697.33, stdev=1070.46, samples=6 iops : min= 1, max= 3, avg= 1.67, stdev= 1.03, samples=6 lat (msec) : 250=58.33%, 500=16.67%, 750=25.00% cpu : usr=0.10%, sys=6.92%, ctx=93, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147023: Thu Aug 27 15:30:01 2026 read: IOPS=1, BW=1516KiB/s (1553kB/s)(6144KiB/4052msec) clat (msec): min=101, max=234, avg=145.84, stdev=53.56 lat (msec): min=101, max=234, avg=145.85, stdev=53.56 clat percentiles (msec): | 1.00th=[ 102], 5.00th=[ 102], 10.00th=[ 102], 20.00th=[ 108], | 30.00th=[ 108], 40.00th=[ 110], 50.00th=[ 110], 60.00th=[ 136], | 70.00th=[ 186], 80.00th=[ 186], 90.00th=[ 234], 95.00th=[ 234], | 99.00th=[ 234], 99.50th=[ 234], 99.90th=[ 234], 99.95th=[ 234], | 99.99th=[ 234] bw ( KiB/s): min= 1980, max= 4087, per=54.12%, avg=2530.25, stdev=1038.15, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 write: IOPS=1, BW=1516KiB/s (1553kB/s)(6144KiB/4052msec); 0 zone resets clat (msec): min=173, max=1316, avg=511.52, stdev=436.49 lat (msec): min=173, max=1317, avg=511.59, stdev=436.50 clat percentiles (msec): | 1.00th=[ 174], 5.00th=[ 174], 10.00th=[ 174], 20.00th=[ 243], | 30.00th=[ 243], 40.00th=[ 305], 50.00th=[ 305], 60.00th=[ 326], | 70.00th=[ 709], 80.00th=[ 709], 90.00th=[ 1318], 95.00th=[ 1318], | 99.00th=[ 1318], 99.50th=[ 1318], 99.90th=[ 1318], 99.95th=[ 1318], | 99.99th=[ 1318] bw ( KiB/s): min= 2011, max= 2959, per=34.59%, avg=2264.00, stdev=463.58, samples=4 iops : min= 1, max= 2, avg= 1.25, stdev= 0.50, samples=4 lat (msec) : 250=66.67%, 500=16.67%, 750=8.33%, 2000=8.33% cpu : usr=0.00%, sys=4.59%, ctx=70, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147024: Thu Aug 27 15:30:01 2026 read: IOPS=1, BW=1169KiB/s (1197kB/s)(5120KiB/4380msec) clat (msec): min=95, max=221, avg=147.49, stdev=62.15 lat (msec): min=95, max=221, avg=147.49, stdev=62.15 clat percentiles (msec): | 1.00th=[ 96], 5.00th=[ 96], 10.00th=[ 96], 20.00th=[ 96], | 30.00th=[ 100], 40.00th=[ 100], 50.00th=[ 113], 60.00th=[ 113], | 70.00th=[ 209], 80.00th=[ 209], 90.00th=[ 222], 95.00th=[ 222], | 99.00th=[ 222], 99.50th=[ 222], 99.90th=[ 222], 99.95th=[ 222], | 99.99th=[ 222] bw ( KiB/s): min= 2043, max= 6131, per=87.42%, avg=4087.00, stdev=2890.65, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 write: IOPS=1, BW=1637KiB/s (1676kB/s)(7168KiB/4380msec); 0 zone resets clat (msec): min=119, max=1194, avg=500.78, stdev=462.34 lat (msec): min=119, max=1194, avg=500.86, stdev=462.33 clat percentiles (msec): | 1.00th=[ 120], 5.00th=[ 120], 10.00th=[ 120], 20.00th=[ 138], | 30.00th=[ 262], 40.00th=[ 262], 50.00th=[ 292], 60.00th=[ 368], | 70.00th=[ 368], 80.00th=[ 1133], 90.00th=[ 1200], 95.00th=[ 1200], | 99.00th=[ 1200], 99.50th=[ 1200], 99.90th=[ 1200], 99.95th=[ 1200], | 99.99th=[ 1200] bw ( KiB/s): min= 1494, max= 4015, per=35.34%, avg=2313.40, stdev=978.35, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 lat (msec) : 100=16.67%, 250=41.67%, 500=25.00%, 2000=16.67% cpu : usr=0.02%, sys=3.90%, ctx=68, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4676KiB/s (4788kB/s), 512KiB/s-1646KiB/s (524kB/s-1685kB/s), io=20.0MiB (20.0MB), run=4003-4380msec WRITE: bw=6546KiB/s (6703kB/s), 1176KiB/s-2558KiB/s (1204kB/s-2619kB/s), io=28.0MiB (29.4MB), run=4003-4380msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=147032: Thu Aug 27 15:30:14 2026 read: IOPS=1, BW=6667KiB/s (6827kB/s)(12.0MiB/1843msec) clat (msec): min=203, max=1300, avg=595.52, stdev=612.09 lat (msec): min=203, max=1300, avg=595.52, stdev=612.09 clat percentiles (msec): | 1.00th=[ 203], 5.00th=[ 203], 10.00th=[ 203], 20.00th=[ 203], | 30.00th=[ 203], 40.00th=[ 284], 50.00th=[ 284], 60.00th=[ 284], | 70.00th=[ 1301], 80.00th=[ 1301], 90.00th=[ 1301], 95.00th=[ 1301], | 99.00th=[ 1301], 99.50th=[ 1301], 99.90th=[ 1301], 99.95th=[ 1301], | 99.99th=[ 1301] bw ( KiB/s): min=12190, max=12190, per=100.00%, avg=12190.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 500=33.33%, 2000=33.33% cpu : usr=0.00%, sys=7.17%, ctx=57, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147033: Thu Aug 27 15:30:14 2026 read: IOPS=0, BW=2271KiB/s (2325kB/s)(4096KiB/1804msec) clat (nsec): min=429907k, max=429907k, avg=429907109.00, stdev= 0.00 lat (nsec): min=429909k, max=429909k, avg=429909287.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 430], 5.00th=[ 430], 10.00th=[ 430], 20.00th=[ 430], | 30.00th=[ 430], 40.00th=[ 430], 50.00th=[ 430], 60.00th=[ 430], | 70.00th=[ 430], 80.00th=[ 430], 90.00th=[ 430], 95.00th=[ 430], | 99.00th=[ 430], 99.50th=[ 430], 99.90th=[ 430], 99.95th=[ 430], | 99.99th=[ 430] bw ( KiB/s): min= 6104, max= 6104, per=68.67%, avg=6104.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=1, BW=4541KiB/s (4650kB/s)(8192KiB/1804msec); 0 zone resets clat (msec): min=612, max=678, avg=645.67, stdev=46.80 lat (msec): min=612, max=679, avg=646.06, stdev=46.78 clat percentiles (msec): | 1.00th=[ 617], 5.00th=[ 617], 10.00th=[ 617], 20.00th=[ 617], | 30.00th=[ 617], 40.00th=[ 617], 50.00th=[ 617], 60.00th=[ 676], | 70.00th=[ 676], 80.00th=[ 676], 90.00th=[ 676], 95.00th=[ 676], | 99.00th=[ 676], 99.50th=[ 676], 99.90th=[ 676], 99.95th=[ 676], | 99.99th=[ 676] bw ( KiB/s): min= 8175, max= 8175, per=80.14%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 750=66.67% cpu : usr=0.06%, sys=9.32%, ctx=83, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147034: Thu Aug 27 15:30:14 2026 write: IOPS=0, BW=3826KiB/s (3917kB/s)(12.0MiB/3212msec); 0 zone resets clat (msec): min=787, max=1260, avg=1038.58, stdev=237.69 lat (msec): min=788, max=1261, avg=1038.89, stdev=237.72 clat percentiles (msec): | 1.00th=[ 785], 5.00th=[ 785], 10.00th=[ 785], 20.00th=[ 785], | 30.00th=[ 785], 40.00th=[ 1070], 50.00th=[ 1070], 60.00th=[ 1070], | 70.00th=[ 1267], 80.00th=[ 1267], 90.00th=[ 1267], 95.00th=[ 1267], | 99.00th=[ 1267], 99.50th=[ 1267], 99.90th=[ 1267], 99.95th=[ 1267], | 99.99th=[ 1267] bw ( KiB/s): min= 8175, max= 8192, per=80.22%, avg=8183.50, stdev=12.02, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 1000=33.33%, 2000=66.67% cpu : usr=0.03%, sys=6.14%, ctx=106, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147035: Thu Aug 27 15:30:14 2026 write: IOPS=1, BW=6215KiB/s (6365kB/s)(12.0MiB/1977msec); 0 zone resets clat (msec): min=419, max=922, avg=624.16, stdev=264.11 lat (msec): min=419, max=922, avg=624.59, stdev=264.29 clat percentiles (msec): | 1.00th=[ 422], 5.00th=[ 422], 10.00th=[ 422], 20.00th=[ 422], | 30.00th=[ 422], 40.00th=[ 531], 50.00th=[ 531], 60.00th=[ 531], | 70.00th=[ 919], 80.00th=[ 919], 90.00th=[ 919], 95.00th=[ 919], | 99.00th=[ 919], 99.50th=[ 919], 99.90th=[ 919], 99.95th=[ 919], | 99.99th=[ 919] bw ( KiB/s): min= 6131, max= 8175, per=70.12%, avg=7153.00, stdev=1445.33, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 750=33.33%, 1000=33.33% cpu : usr=0.05%, sys=6.93%, ctx=69, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=8890KiB/s (9103kB/s), 2271KiB/s-6667KiB/s (2325kB/s-6827kB/s), io=16.0MiB (16.8MB), run=1804-1843msec WRITE: bw=9.96MiB/s (10.4MB/s), 3826KiB/s-6215KiB/s (3917kB/s-6365kB/s), io=32.0MiB (33.6MB), run=1804-3212msec rand-rw: (groupid=0, jobs=1): err= 0: pid=147037: Thu Aug 27 15:30:14 2026 read: IOPS=1, BW=5144KiB/s (5267kB/s)(12.0MiB/2389msec) clat (msec): min=583, max=995, avg=757.25, stdev=213.70 lat (msec): min=583, max=995, avg=757.25, stdev=213.70 clat percentiles (msec): | 1.00th=[ 584], 5.00th=[ 584], 10.00th=[ 584], 20.00th=[ 584], | 30.00th=[ 584], 40.00th=[ 693], 50.00th=[ 693], 60.00th=[ 693], | 70.00th=[ 995], 80.00th=[ 995], 90.00th=[ 995], 95.00th=[ 995], | 99.00th=[ 995], 99.50th=[ 995], 99.90th=[ 995], 99.95th=[ 995], | 99.99th=[ 995] bw ( KiB/s): min= 8159, max= 8175, per=100.00%, avg=8167.00, stdev=11.31, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=66.67%, 1000=33.33% cpu : usr=0.00%, sys=19.18%, ctx=436, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147038: Thu Aug 27 15:30:14 2026 read: IOPS=0, BW=1367KiB/s (1400kB/s)(4096KiB/2996msec) clat (nsec): min=634092k, max=634092k, avg=634092142.00, stdev= 0.00 lat (nsec): min=634094k, max=634094k, avg=634094344.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 634], 5.00th=[ 634], 10.00th=[ 634], 20.00th=[ 634], | 30.00th=[ 634], 40.00th=[ 634], 50.00th=[ 634], 60.00th=[ 634], | 70.00th=[ 634], 80.00th=[ 634], 90.00th=[ 634], 95.00th=[ 634], | 99.00th=[ 634], 99.50th=[ 634], 99.90th=[ 634], 99.95th=[ 634], | 99.99th=[ 634] bw ( KiB/s): min= 8159, max= 8159, per=100.00%, avg=8159.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2734KiB/s (2800kB/s)(8192KiB/2996msec); 0 zone resets clat (msec): min=915, max=1289, avg=1102.71, stdev=264.67 lat (msec): min=915, max=1290, avg=1103.02, stdev=264.71 clat percentiles (msec): | 1.00th=[ 919], 5.00th=[ 919], 10.00th=[ 919], 20.00th=[ 919], | 30.00th=[ 919], 40.00th=[ 919], 50.00th=[ 919], 60.00th=[ 1284], | 70.00th=[ 1284], 80.00th=[ 1284], 90.00th=[ 1284], 95.00th=[ 1284], | 99.00th=[ 1284], 99.50th=[ 1284], 99.90th=[ 1284], 99.95th=[ 1284], | 99.99th=[ 1284] bw ( KiB/s): min= 8175, max= 8175, per=77.84%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=5.61%, ctx=86, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147039: Thu Aug 27 15:30:14 2026 write: IOPS=0, BW=3938KiB/s (4033kB/s)(12.0MiB/3120msec); 0 zone resets clat (msec): min=390, max=1416, avg=1001.31, stdev=540.24 lat (msec): min=390, max=1421, avg=1003.18, stdev=541.86 clat percentiles (msec): | 1.00th=[ 393], 5.00th=[ 393], 10.00th=[ 393], 20.00th=[ 393], | 30.00th=[ 393], 40.00th=[ 1200], 50.00th=[ 1200], 60.00th=[ 1200], | 70.00th=[ 1418], 80.00th=[ 1418], 90.00th=[ 1418], 95.00th=[ 1418], | 99.00th=[ 1418], 99.50th=[ 1418], 99.90th=[ 1418], 99.95th=[ 1418], | 99.99th=[ 1418] bw ( KiB/s): min= 8159, max= 8159, per=77.69%, avg=8159.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.00%, sys=4.39%, ctx=57, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147040: Thu Aug 27 15:30:14 2026 write: IOPS=1, BW=4498KiB/s (4606kB/s)(12.0MiB/2732msec); 0 zone resets clat (msec): min=278, max=1164, avg=854.77, stdev=499.13 lat (msec): min=282, max=1164, avg=855.98, stdev=497.56 clat percentiles (msec): | 1.00th=[ 279], 5.00th=[ 279], 10.00th=[ 279], 20.00th=[ 279], | 30.00th=[ 279], 40.00th=[ 1116], 50.00th=[ 1116], 60.00th=[ 1116], | 70.00th=[ 1167], 80.00th=[ 1167], 90.00th=[ 1167], 95.00th=[ 1167], | 99.00th=[ 1167], 99.50th=[ 1167], 99.90th=[ 1167], 99.95th=[ 1167], | 99.99th=[ 1167] bw ( KiB/s): min= 8159, max= 8175, per=77.77%, avg=8167.00, stdev=11.31, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.00%, sys=4.76%, ctx=61, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5469KiB/s (5600kB/s), 1367KiB/s-5144KiB/s (1400kB/s-5267kB/s), io=16.0MiB (16.8MB), run=2389-2996msec WRITE: bw=10.3MiB/s (10.8MB/s), 2734KiB/s-4498KiB/s (2800kB/s-4606kB/s), io=32.0MiB (33.6MB), run=2732-3120msec