== sanity test 398b: DIO and buffer IO race ============== 09:22:32 (1787836952) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 6.33378 s, 7.9 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=180490: Thu Aug 27 09:25:02 2026 read: IOPS=11, BW=45.5KiB/s (46.6kB/s)(5992KiB/131739msec) clat (usec): min=42, max=993311, avg=48705.58, stdev=40105.28 lat (usec): min=43, max=993313, avg=48707.40, stdev=40105.14 clat percentiles (usec): | 1.00th=[ 59], 5.00th=[ 11600], 10.00th=[ 17171], 20.00th=[ 23725], | 30.00th=[ 29230], 40.00th=[ 35390], 50.00th=[ 42206], 60.00th=[ 48497], | 70.00th=[ 58459], 80.00th=[ 67634], 90.00th=[ 86508], 95.00th=[107480], | 99.00th=[168821], 99.50th=[191890], 99.90th=[242222], 99.95th=[994051], | 99.99th=[994051] bw ( KiB/s): min= 7, max= 103, per=24.76%, avg=45.07, stdev=18.13, samples=259 iops : min= 1, max= 25, avg=10.63, stdev= 4.56, samples=259 write: IOPS=11, BW=47.8KiB/s (48.9kB/s)(6296KiB/131739msec); 0 zone resets clat (usec): min=1000, max=202455, avg=37061.03, stdev=36292.37 lat (usec): min=1000, max=202458, avg=37065.99, stdev=36293.25 clat percentiles (usec): | 1.00th=[ 1139], 5.00th=[ 1336], 10.00th=[ 1876], 20.00th=[ 4146], | 30.00th=[ 8455], 40.00th=[ 18482], 50.00th=[ 27919], 60.00th=[ 38011], | 70.00th=[ 50070], 80.00th=[ 64226], 90.00th=[ 87557], 95.00th=[105382], | 99.00th=[154141], 99.50th=[177210], 99.90th=[202376], 99.95th=[202376], | 99.99th=[202376] bw ( KiB/s): min= 7, max= 136, per=24.99%, avg=47.48, stdev=20.62, samples=258 iops : min= 1, max= 34, avg=11.24, stdev= 5.18, samples=258 lat (usec) : 50=0.13%, 100=1.46%, 250=0.23%, 500=0.03%, 750=0.03% lat (msec) : 2=5.57%, 4=4.49%, 10=6.67%, 20=9.60%, 50=37.79% lat (msec) : 100=27.34%, 250=6.61%, 1000=0.03% cpu : usr=0.08%, sys=5.20%, ctx=6683, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180491: Thu Aug 27 09:25:02 2026 read: IOPS=11, BW=46.2KiB/s (47.3kB/s)(5940KiB/128598msec) clat (usec): min=28, max=238728, avg=47197.58, stdev=30603.32 lat (usec): min=28, max=238729, avg=47199.79, stdev=30603.47 clat percentiles (usec): | 1.00th=[ 55], 5.00th=[ 9372], 10.00th=[ 17171], 20.00th=[ 23987], | 30.00th=[ 29492], 40.00th=[ 34341], 50.00th=[ 40633], 60.00th=[ 48497], | 70.00th=[ 56361], 80.00th=[ 67634], 90.00th=[ 86508], 95.00th=[101188], | 99.00th=[154141], 99.50th=[164627], 99.90th=[219153], 99.95th=[238027], | 99.99th=[238027] bw ( KiB/s): min= 6, max= 103, per=25.19%, avg=45.85, stdev=17.93, samples=253 iops : min= 1, max= 25, avg=10.83, stdev= 4.52, samples=253 write: IOPS=12, BW=49.4KiB/s (50.5kB/s)(6348KiB/128598msec); 0 zone resets clat (usec): min=1029, max=864223, avg=36573.74, stdev=42279.50 lat (usec): min=1030, max=864226, avg=36577.09, stdev=42278.98 clat percentiles (usec): | 1.00th=[ 1172], 5.00th=[ 1467], 10.00th=[ 2114], 20.00th=[ 4359], | 30.00th=[ 8029], 40.00th=[ 17695], 50.00th=[ 25035], 60.00th=[ 34866], | 70.00th=[ 45876], 80.00th=[ 62653], 90.00th=[ 89654], 95.00th=[108528], | 99.00th=[158335], 99.50th=[185598], 99.90th=[248513], 99.95th=[868221], | 99.99th=[868221] bw ( KiB/s): min= 6, max= 134, per=26.05%, avg=49.50, stdev=23.02, samples=251 iops : min= 1, max= 33, avg=11.74, stdev= 5.77, samples=251 lat (usec) : 50=0.20%, 100=1.86%, 250=0.13%, 500=0.10% lat (msec) : 2=4.98%, 4=4.49%, 10=7.19%, 20=10.06%, 50=38.64% lat (msec) : 100=26.27%, 250=6.05%, 1000=0.03% cpu : usr=0.09%, sys=5.44%, ctx=6786, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180492: Thu Aug 27 09:25:02 2026 read: IOPS=11, BW=46.4KiB/s (47.5kB/s)(6028KiB/129894msec) clat (usec): min=42, max=231195, avg=46634.26, stdev=30319.02 lat (usec): min=43, max=231196, avg=46637.27, stdev=30318.38 clat percentiles (usec): | 1.00th=[ 56], 5.00th=[ 11600], 10.00th=[ 17957], 20.00th=[ 23725], | 30.00th=[ 28967], 40.00th=[ 33817], 50.00th=[ 40109], 60.00th=[ 47449], | 70.00th=[ 55313], 80.00th=[ 66847], 90.00th=[ 85459], 95.00th=[106431], | 99.00th=[147850], 99.50th=[173016], 99.90th=[208667], 99.95th=[231736], | 99.99th=[231736] bw ( KiB/s): min= 7, max= 103, per=25.35%, avg=46.14, stdev=17.43, samples=254 iops : min= 1, max= 25, avg=10.90, stdev= 4.39, samples=254 write: IOPS=12, BW=48.2KiB/s (49.3kB/s)(6260KiB/129894msec); 0 zone resets clat (usec): min=947, max=936569, avg=37817.91, stdev=43492.07 lat (usec): min=949, max=936571, avg=37822.89, stdev=43492.09 clat percentiles (usec): | 1.00th=[ 1139], 5.00th=[ 1352], 10.00th=[ 2057], 20.00th=[ 4293], | 30.00th=[ 8979], 40.00th=[ 19268], 50.00th=[ 27919], 60.00th=[ 36963], | 70.00th=[ 48497], 80.00th=[ 64226], 90.00th=[ 86508], 95.00th=[111674], | 99.00th=[162530], 99.50th=[187696], 99.90th=[278922], 99.95th=[935330], | 99.99th=[935330] bw ( KiB/s): min= 7, max= 117, per=25.18%, avg=47.84, stdev=19.75, samples=254 iops : min= 1, max= 29, avg=11.33, stdev= 4.97, samples=254 lat (usec) : 50=0.16%, 100=1.37%, 250=0.29%, 1000=0.10% lat (msec) : 2=4.98%, 4=4.65%, 10=6.74%, 20=8.98%, 50=40.59% lat (msec) : 100=25.65%, 250=6.41%, 500=0.03%, 1000=0.03% cpu : usr=0.09%, sys=5.21%, ctx=6736, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180493: Thu Aug 27 09:25:02 2026 read: IOPS=11, BW=46.6KiB/s (47.7kB/s)(6052KiB/129845msec) clat (usec): min=41, max=227961, avg=47757.35, stdev=29916.62 lat (usec): min=41, max=227963, avg=47763.10, stdev=29915.81 clat percentiles (usec): | 1.00th=[ 60], 5.00th=[ 11863], 10.00th=[ 18482], 20.00th=[ 24511], | 30.00th=[ 29754], 40.00th=[ 35390], 50.00th=[ 41681], 60.00th=[ 49021], | 70.00th=[ 57410], 80.00th=[ 68682], 90.00th=[ 85459], 95.00th=[101188], | 99.00th=[143655], 99.50th=[168821], 99.90th=[217056], 99.95th=[227541], | 99.99th=[227541] bw ( KiB/s): min= 7, max= 103, per=25.74%, avg=46.84, stdev=18.32, samples=252 iops : min= 1, max= 25, avg=11.08, stdev= 4.61, samples=252 write: IOPS=12, BW=48.0KiB/s (49.2kB/s)(6236KiB/129845msec); 0 zone resets clat (usec): min=969, max=878288, avg=36658.03, stdev=43334.57 lat (usec): min=970, max=878290, avg=36660.65, stdev=43334.56 clat percentiles (usec): | 1.00th=[ 1156], 5.00th=[ 1385], 10.00th=[ 1926], 20.00th=[ 4178], | 30.00th=[ 7439], 40.00th=[ 15795], 50.00th=[ 25560], 60.00th=[ 35390], | 70.00th=[ 46924], 80.00th=[ 61604], 90.00th=[ 87557], 95.00th=[112722], | 99.00th=[166724], 99.50th=[200279], 99.90th=[265290], 99.95th=[876610], | 99.99th=[876610] bw ( KiB/s): min= 7, max= 120, per=25.10%, avg=47.69, stdev=21.04, samples=255 iops : min= 1, max= 30, avg=11.29, stdev= 5.28, samples=255 lat (usec) : 50=0.07%, 100=1.53%, 250=0.13%, 500=0.07%, 750=0.03% lat (usec) : 1000=0.07% lat (msec) : 2=5.44%, 4=4.49%, 10=7.29%, 20=9.21%, 50=38.74% lat (msec) : 100=26.66%, 250=6.22%, 500=0.03%, 1000=0.03% cpu : usr=0.08%, sys=5.43%, ctx=6821, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=182KiB/s (187kB/s), 45.5KiB/s-46.6KiB/s (46.6kB/s-47.7kB/s), io=23.4MiB (24.6MB), run=128598-131739msec WRITE: bw=191KiB/s (195kB/s), 47.8KiB/s-49.4KiB/s (48.9kB/s-50.5kB/s), io=24.6MiB (25.7MB), run=128598-131739msec rand-rw: (groupid=0, jobs=1): err= 0: pid=180486: Thu Aug 27 09:25:36 2026 read: IOPS=9, BW=36.2KiB/s (37.1kB/s)(5992KiB/165495msec) clat (msec): min=5, max=976, avg=43.35, stdev=46.96 lat (msec): min=5, max=976, avg=43.36, stdev=46.96 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 12], 20.00th=[ 16], | 30.00th=[ 19], 40.00th=[ 23], 50.00th=[ 28], 60.00th=[ 35], | 70.00th=[ 45], 80.00th=[ 63], 90.00th=[ 96], 95.00th=[ 129], | 99.00th=[ 205], 99.50th=[ 230], 99.90th=[ 326], 99.95th=[ 978], | 99.99th=[ 978] bw ( KiB/s): min= 7, max= 165, per=25.58%, avg=36.84, stdev=26.48, samples=315 iops : min= 1, max= 41, avg= 8.57, stdev= 6.68, samples=315 write: IOPS=9, BW=38.0KiB/s (38.0kB/s)(6296KiB/165495msec); 0 zone resets clat (msec): min=10, max=413, avg=63.62, stdev=49.10 lat (msec): min=10, max=413, avg=63.62, stdev=49.10 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 21], 10.00th=[ 24], 20.00th=[ 28], | 30.00th=[ 33], 40.00th=[ 38], 50.00th=[ 45], 60.00th=[ 56], | 70.00th=[ 73], 80.00th=[ 99], 90.00th=[ 130], 95.00th=[ 159], | 99.00th=[ 243], 99.50th=[ 288], 99.90th=[ 380], 99.95th=[ 414], | 99.99th=[ 414] bw ( KiB/s): min= 7, max= 126, per=24.90%, avg=37.60, stdev=25.73, samples=325 iops : min= 1, max= 31, avg= 8.75, stdev= 6.47, samples=325 lat (msec) : 10=2.44%, 20=16.11%, 50=45.80%, 100=21.42%, 250=13.57% lat (msec) : 500=0.62%, 1000=0.03% cpu : usr=0.06%, sys=1.89%, ctx=4807, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180487: Thu Aug 27 09:25:36 2026 read: IOPS=8, BW=35.8KiB/s (36.7kB/s)(5940KiB/165790msec) clat (msec): min=5, max=884, avg=43.51, stdev=47.55 lat (msec): min=5, max=884, avg=43.51, stdev=47.55 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 15], | 30.00th=[ 18], 40.00th=[ 22], 50.00th=[ 27], 60.00th=[ 34], | 70.00th=[ 44], 80.00th=[ 62], 90.00th=[ 105], 95.00th=[ 142], | 99.00th=[ 203], 99.50th=[ 222], 99.90th=[ 266], 99.95th=[ 885], | 99.99th=[ 885] bw ( KiB/s): min= 7, max= 136, per=25.48%, avg=36.70, stdev=27.23, samples=315 iops : min= 1, max= 34, avg= 8.52, stdev= 6.87, samples=315 write: IOPS=9, BW=38.3KiB/s (39.2kB/s)(6348KiB/165790msec); 0 zone resets clat (msec): min=10, max=335, avg=63.50, stdev=46.69 lat (msec): min=10, max=335, avg=63.50, stdev=46.69 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 20], 10.00th=[ 23], 20.00th=[ 28], | 30.00th=[ 33], 40.00th=[ 40], 50.00th=[ 47], 60.00th=[ 58], | 70.00th=[ 75], 80.00th=[ 96], 90.00th=[ 128], 95.00th=[ 157], | 99.00th=[ 226], 99.50th=[ 275], 99.90th=[ 321], 99.95th=[ 334], | 99.99th=[ 334] bw ( KiB/s): min= 7, max= 119, per=25.31%, avg=38.22, stdev=25.56, samples=323 iops : min= 1, max= 29, avg= 8.90, stdev= 6.43, samples=323 lat (msec) : 10=2.80%, 20=17.97%, 50=43.03%, 100=21.52%, 250=14.23% lat (msec) : 500=0.42%, 1000=0.03% cpu : usr=0.07%, sys=1.88%, ctx=4952, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180488: Thu Aug 27 09:25:36 2026 read: IOPS=9, BW=36.5KiB/s (37.4kB/s)(6028KiB/165099msec) clat (msec): min=5, max=333, avg=42.80, stdev=42.68 lat (msec): min=5, max=333, avg=42.81, stdev=42.69 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 15], | 30.00th=[ 19], 40.00th=[ 22], 50.00th=[ 27], 60.00th=[ 34], | 70.00th=[ 44], 80.00th=[ 62], 90.00th=[ 101], 95.00th=[ 133], | 99.00th=[ 207], 99.50th=[ 247], 99.90th=[ 321], 99.95th=[ 334], | 99.99th=[ 334] bw ( KiB/s): min= 7, max= 136, per=25.85%, avg=37.22, stdev=26.53, samples=314 iops : min= 1, max= 34, avg= 8.66, stdev= 6.68, samples=314 write: IOPS=9, BW=37.9KiB/s (38.8kB/s)(6260KiB/165099msec); 0 zone resets clat (msec): min=8, max=911, avg=64.03, stdev=52.31 lat (msec): min=8, max=911, avg=64.03, stdev=52.31 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 20], 10.00th=[ 23], 20.00th=[ 28], | 30.00th=[ 33], 40.00th=[ 39], 50.00th=[ 47], 60.00th=[ 57], | 70.00th=[ 74], 80.00th=[ 97], 90.00th=[ 126], 95.00th=[ 159], | 99.00th=[ 245], 99.50th=[ 284], 99.90th=[ 414], 99.95th=[ 911], | 99.99th=[ 911] bw ( KiB/s): min= 7, max= 126, per=25.22%, avg=38.08, stdev=25.99, samples=318 iops : min= 1, max= 31, avg= 8.87, stdev= 6.57, samples=318 lat (msec) : 10=2.80%, 20=17.55%, 50=43.55%, 100=21.71%, 250=13.74% lat (msec) : 500=0.62%, 1000=0.03% cpu : usr=0.06%, sys=1.93%, ctx=4870, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180489: Thu Aug 27 09:25:36 2026 read: IOPS=9, BW=36.7KiB/s (37.6kB/s)(6052KiB/164806msec) clat (msec): min=6, max=383, avg=42.96, stdev=41.85 lat (msec): min=6, max=383, avg=42.97, stdev=41.85 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 16], | 30.00th=[ 19], 40.00th=[ 23], 50.00th=[ 27], 60.00th=[ 34], | 70.00th=[ 45], 80.00th=[ 63], 90.00th=[ 102], 95.00th=[ 133], | 99.00th=[ 188], 99.50th=[ 234], 99.90th=[ 342], 99.95th=[ 384], | 99.99th=[ 384] bw ( KiB/s): min= 7, max= 135, per=26.12%, avg=37.61, stdev=26.60, samples=313 iops : min= 1, max= 33, avg= 8.76, stdev= 6.70, samples=313 write: IOPS=9, BW=37.8KiB/s (38.7kB/s)(6236KiB/164806msec); 0 zone resets clat (msec): min=11, max=920, avg=63.76, stdev=51.58 lat (msec): min=11, max=920, avg=63.76, stdev=51.58 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 20], 10.00th=[ 24], 20.00th=[ 29], | 30.00th=[ 34], 40.00th=[ 40], 50.00th=[ 47], 60.00th=[ 58], | 70.00th=[ 73], 80.00th=[ 94], 90.00th=[ 124], 95.00th=[ 161], | 99.00th=[ 226], 99.50th=[ 271], 99.90th=[ 414], 99.95th=[ 919], | 99.99th=[ 919] bw ( KiB/s): min= 7, max= 127, per=24.94%, avg=37.66, stdev=25.78, samples=322 iops : min= 1, max= 31, avg= 8.77, stdev= 6.51, samples=322 lat (msec) : 10=2.64%, 20=17.15%, 50=43.85%, 100=22.59%, 250=13.28% lat (msec) : 500=0.46%, 1000=0.03% cpu : usr=0.07%, sys=1.83%, ctx=4823, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=145KiB/s (148kB/s), 35.8KiB/s-36.7KiB/s (36.7kB/s-37.6kB/s), io=23.4MiB (24.6MB), run=164806-165790msec WRITE: bw=152KiB/s (155kB/s), 37.8KiB/s-38.3KiB/s (38.7kB/s-39.2kB/s), io=24.6MiB (25.7MB), run=164806-165790msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=180540: Thu Aug 27 09:26:21 2026 read: IOPS=11, BW=182KiB/s (186kB/s)(5920KiB/32553msec) clat (usec): min=41, max=157980, avg=44896.67, stdev=29200.92 lat (usec): min=42, max=157981, avg=44898.76, stdev=29200.42 clat percentiles (usec): | 1.00th=[ 52], 5.00th=[ 68], 10.00th=[ 12649], 20.00th=[ 21890], | 30.00th=[ 28443], 40.00th=[ 35390], 50.00th=[ 41157], 60.00th=[ 46400], | 70.00th=[ 55313], 80.00th=[ 66847], 90.00th=[ 84411], 95.00th=[ 96994], | 99.00th=[135267], 99.50th=[154141], 99.90th=[158335], 99.95th=[158335], | 99.99th=[158335] bw ( KiB/s): min= 31, max= 381, per=25.28%, avg=181.25, stdev=77.62, samples=64 iops : min= 1, max= 23, avg=10.61, stdev= 4.87, samples=64 write: IOPS=12, BW=196KiB/s (200kB/s)(6368KiB/32553msec); 0 zone resets clat (usec): min=1651, max=224413, avg=39900.55, stdev=39022.55 lat (usec): min=1653, max=224416, avg=39954.12, stdev=39038.85 clat percentiles (usec): | 1.00th=[ 1729], 5.00th=[ 2245], 10.00th=[ 3589], 20.00th=[ 6718], | 30.00th=[ 12125], 40.00th=[ 20841], 50.00th=[ 27132], 60.00th=[ 36963], | 70.00th=[ 49021], 80.00th=[ 66323], 90.00th=[ 95945], 95.00th=[121111], | 99.00th=[164627], 99.50th=[179307], 99.90th=[225444], 99.95th=[225444], | 99.99th=[225444] bw ( KiB/s): min= 28, max= 382, per=25.84%, avg=195.08, stdev=82.51, samples=64 iops : min= 1, max= 23, avg=11.47, stdev= 5.26, samples=64 lat (usec) : 50=0.39%, 100=3.39%, 250=0.39%, 500=0.13% lat (msec) : 2=2.21%, 4=4.56%, 10=7.68%, 20=9.64%, 50=38.67% lat (msec) : 100=26.04%, 250=6.90% cpu : usr=0.09%, sys=5.99%, ctx=1828, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180541: Thu Aug 27 09:26:21 2026 read: IOPS=10, BW=175KiB/s (179kB/s)(5744KiB/32814msec) clat (usec): min=41, max=204941, avg=47581.85, stdev=27617.49 lat (usec): min=42, max=204942, avg=47595.56, stdev=27606.48 clat percentiles (usec): | 1.00th=[ 57], 5.00th=[ 297], 10.00th=[ 20317], 20.00th=[ 26870], | 30.00th=[ 32375], 40.00th=[ 36439], 50.00th=[ 43779], 60.00th=[ 50594], | 70.00th=[ 57410], 80.00th=[ 65799], 90.00th=[ 81265], 95.00th=[ 96994], | 99.00th=[133694], 99.50th=[166724], 99.90th=[204473], 99.95th=[204473], | 99.99th=[204473] bw ( KiB/s): min= 31, max= 438, per=24.20%, avg=173.50, stdev=73.29, samples=64 iops : min= 1, max= 27, avg=10.14, stdev= 4.70, samples=64 write: IOPS=12, BW=199KiB/s (204kB/s)(6544KiB/32814msec); 0 zone resets clat (usec): min=1564, max=201941, avg=38308.20, stdev=35161.87 lat (usec): min=1566, max=201945, avg=38310.76, stdev=35161.85 clat percentiles (usec): | 1.00th=[ 1729], 5.00th=[ 2737], 10.00th=[ 3916], 20.00th=[ 6718], | 30.00th=[ 12387], 40.00th=[ 20579], 50.00th=[ 29230], 60.00th=[ 36963], | 70.00th=[ 50594], 80.00th=[ 66847], 90.00th=[ 87557], 95.00th=[108528], | 99.00th=[149947], 99.50th=[166724], 99.90th=[202376], 99.95th=[202376], | 99.99th=[202376] bw ( KiB/s): min= 63, max= 351, per=26.12%, avg=197.17, stdev=68.07, samples=64 iops : min= 3, max= 21, avg=11.61, stdev= 4.32, samples=64 lat (usec) : 50=0.13%, 100=1.56%, 250=0.39%, 500=0.26% lat (msec) : 2=1.30%, 4=4.30%, 10=8.33%, 20=9.11%, 50=38.93% lat (msec) : 100=30.34%, 250=5.34% cpu : usr=0.05%, sys=6.37%, ctx=1850, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180542: Thu Aug 27 09:26:21 2026 read: IOPS=11, BW=187KiB/s (192kB/s)(6256KiB/33371msec) clat (usec): min=50, max=244849, avg=47376.16, stdev=33657.19 lat (usec): min=51, max=244850, avg=47378.81, stdev=33656.81 clat percentiles (usec): | 1.00th=[ 55], 5.00th=[ 67], 10.00th=[ 2966], 20.00th=[ 23987], | 30.00th=[ 30016], 40.00th=[ 36439], 50.00th=[ 42206], 60.00th=[ 51119], | 70.00th=[ 57410], 80.00th=[ 67634], 90.00th=[ 85459], 95.00th=[104334], | 99.00th=[168821], 99.50th=[227541], 99.90th=[244319], 99.95th=[244319], | 99.99th=[244319] bw ( KiB/s): min= 31, max= 415, per=26.06%, avg=186.86, stdev=74.11, samples=65 iops : min= 1, max= 25, avg=10.95, stdev= 4.64, samples=65 write: IOPS=11, BW=181KiB/s (185kB/s)(6032KiB/33371msec); 0 zone resets clat (usec): min=1642, max=168081, avg=39288.39, stdev=34770.05 lat (usec): min=1644, max=168083, avg=39290.95, stdev=34769.91 clat percentiles (usec): | 1.00th=[ 1745], 5.00th=[ 3097], 10.00th=[ 4555], 20.00th=[ 8979], | 30.00th=[ 12518], 40.00th=[ 22152], 50.00th=[ 31851], 60.00th=[ 40109], | 70.00th=[ 48497], 80.00th=[ 62653], 90.00th=[ 90702], 95.00th=[111674], | 99.00th=[154141], 99.50th=[166724], 99.90th=[168821], 99.95th=[168821], | 99.99th=[168821] bw ( KiB/s): min= 31, max= 381, per=23.48%, avg=177.25, stdev=76.21, samples=65 iops : min= 1, max= 23, avg=10.34, stdev= 4.77, samples=65 lat (usec) : 100=4.17%, 250=0.65%, 500=0.26% lat (msec) : 2=1.43%, 4=2.86%, 10=7.68%, 20=9.51%, 50=38.54% lat (msec) : 100=28.52%, 250=6.38% cpu : usr=0.07%, sys=6.00%, ctx=1869, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180543: Thu Aug 27 09:26:21 2026 read: IOPS=12, BW=194KiB/s (199kB/s)(6032KiB/31068msec) clat (usec): min=46, max=175347, avg=43105.70, stdev=31610.39 lat (usec): min=47, max=175348, avg=43106.97, stdev=31610.42 clat percentiles (usec): | 1.00th=[ 55], 5.00th=[ 67], 10.00th=[ 127], 20.00th=[ 21890], | 30.00th=[ 27657], 40.00th=[ 31851], 50.00th=[ 37487], 60.00th=[ 43254], | 70.00th=[ 51119], 80.00th=[ 63701], 90.00th=[ 83362], 95.00th=[105382], | 99.00th=[149947], 99.50th=[160433], 99.90th=[175113], 99.95th=[175113], | 99.99th=[175113] bw ( KiB/s): min= 31, max= 381, per=26.80%, avg=192.18, stdev=72.25, samples=61 iops : min= 1, max= 23, avg=11.31, stdev= 4.57, samples=61 write: IOPS=12, BW=201KiB/s (206kB/s)(6256KiB/31068msec); 0 zone resets clat (usec): min=1503, max=206603, avg=37728.28, stdev=36413.03 lat (usec): min=1506, max=206605, avg=37730.57, stdev=36413.08 clat percentiles (usec): | 1.00th=[ 1663], 5.00th=[ 2343], 10.00th=[ 3228], 20.00th=[ 6128], | 30.00th=[ 10421], 40.00th=[ 17433], 50.00th=[ 25560], 60.00th=[ 36439], | 70.00th=[ 47973], 80.00th=[ 64750], 90.00th=[ 93848], 95.00th=[112722], | 99.00th=[141558], 99.50th=[162530], 99.90th=[206570], 99.95th=[206570], | 99.99th=[206570] bw ( KiB/s): min= 31, max= 532, per=26.55%, avg=200.46, stdev=93.25, samples=61 iops : min= 1, max= 33, avg=11.80, stdev= 5.92, samples=61 lat (usec) : 50=0.26%, 100=4.17%, 250=0.78%, 500=0.26%, 750=0.13% lat (msec) : 2=1.69%, 4=5.21%, 10=8.59%, 20=8.85%, 50=40.36% lat (msec) : 100=22.66%, 250=7.03% cpu : usr=0.10%, sys=6.10%, ctx=1704, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=718KiB/s (735kB/s), 175KiB/s-194KiB/s (179kB/s-199kB/s), io=23.4MiB (24.5MB), run=31068-33371msec WRITE: bw=755KiB/s (773kB/s), 181KiB/s-201KiB/s (185kB/s-206kB/s), io=24.6MiB (25.8MB), run=31068-33371msec rand-rw: (groupid=0, jobs=1): err= 0: pid=180535: Thu Aug 27 09:26:33 2026 read: IOPS=8, BW=129KiB/s (132kB/s)(5920KiB/45884msec) clat (msec): min=9, max=241, avg=48.67, stdev=38.19 lat (msec): min=9, max=241, avg=48.67, stdev=38.19 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 15], 10.00th=[ 17], 20.00th=[ 21], | 30.00th=[ 25], 40.00th=[ 29], 50.00th=[ 35], 60.00th=[ 43], | 70.00th=[ 55], 80.00th=[ 69], 90.00th=[ 106], 95.00th=[ 138], | 99.00th=[ 192], 99.50th=[ 207], 99.90th=[ 243], 99.95th=[ 243], | 99.99th=[ 243] bw ( KiB/s): min= 31, max= 383, per=24.74%, avg=128.42, stdev=75.90, samples=89 iops : min= 1, max= 23, avg= 7.18, stdev= 4.78, samples=89 write: IOPS=8, BW=139KiB/s (142kB/s)(6368KiB/45884msec); 0 zone resets clat (msec): min=13, max=284, avg=69.61, stdev=46.00 lat (msec): min=13, max=284, avg=69.61, stdev=46.00 clat percentiles (msec): | 1.00th=[ 20], 5.00th=[ 25], 10.00th=[ 28], 20.00th=[ 33], | 30.00th=[ 40], 40.00th=[ 48], 50.00th=[ 57], 60.00th=[ 66], | 70.00th=[ 80], 80.00th=[ 96], 90.00th=[ 136], 95.00th=[ 165], | 99.00th=[ 241], 99.50th=[ 275], 99.90th=[ 284], 99.95th=[ 284], | 99.99th=[ 284] bw ( KiB/s): min= 31, max= 380, per=25.20%, avg=137.58, stdev=74.52, samples=90 iops : min= 1, max= 23, avg= 7.77, stdev= 4.70, samples=90 lat (msec) : 10=0.26%, 20=9.24%, 50=45.05%, 100=30.60%, 250=14.58% lat (msec) : 500=0.26% cpu : usr=0.05%, sys=1.86%, ctx=1215, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180536: Thu Aug 27 09:26:33 2026 read: IOPS=7, BW=127KiB/s (130kB/s)(5744KiB/45116msec) clat (msec): min=5, max=217, avg=47.84, stdev=39.18 lat (msec): min=5, max=217, avg=47.84, stdev=39.18 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 14], 10.00th=[ 16], 20.00th=[ 21], | 30.00th=[ 24], 40.00th=[ 29], 50.00th=[ 34], 60.00th=[ 40], | 70.00th=[ 50], 80.00th=[ 74], 90.00th=[ 101], 95.00th=[ 140], | 99.00th=[ 188], 99.50th=[ 199], 99.90th=[ 218], 99.95th=[ 218], | 99.99th=[ 218] bw ( KiB/s): min= 31, max= 446, per=25.66%, avg=133.18, stdev=80.68, samples=85 iops : min= 1, max= 27, avg= 7.48, stdev= 5.07, samples=85 write: IOPS=9, BW=145KiB/s (149kB/s)(6544KiB/45116msec); 0 zone resets clat (msec): min=16, max=311, avg=68.22, stdev=42.78 lat (msec): min=16, max=311, avg=68.22, stdev=42.79 clat percentiles (msec): | 1.00th=[ 20], 5.00th=[ 26], 10.00th=[ 31], 20.00th=[ 37], | 30.00th=[ 42], 40.00th=[ 47], 50.00th=[ 55], 60.00th=[ 66], | 70.00th=[ 79], 80.00th=[ 96], 90.00th=[ 123], 95.00th=[ 153], | 99.00th=[ 203], 99.50th=[ 275], 99.90th=[ 313], 99.95th=[ 313], | 99.99th=[ 313] bw ( KiB/s): min= 31, max= 412, per=27.06%, avg=147.77, stdev=75.30, samples=87 iops : min= 1, max= 25, avg= 8.40, stdev= 4.75, samples=87 lat (msec) : 10=0.91%, 20=8.85%, 50=46.48%, 100=29.82%, 250=13.54% lat (msec) : 500=0.39% cpu : usr=0.07%, sys=1.94%, ctx=1169, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180537: Thu Aug 27 09:26:33 2026 read: IOPS=8, BW=136KiB/s (140kB/s)(6256KiB/45839msec) clat (msec): min=7, max=241, avg=47.54, stdev=41.35 lat (msec): min=7, max=241, avg=47.54, stdev=41.35 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 12], 10.00th=[ 15], 20.00th=[ 19], | 30.00th=[ 23], 40.00th=[ 28], 50.00th=[ 33], 60.00th=[ 39], | 70.00th=[ 53], 80.00th=[ 68], 90.00th=[ 103], 95.00th=[ 134], | 99.00th=[ 215], 99.50th=[ 239], 99.90th=[ 243], 99.95th=[ 243], | 99.99th=[ 243] bw ( KiB/s): min= 30, max= 447, per=27.23%, avg=141.33, stdev=100.97, samples=87 iops : min= 1, max= 27, avg= 8.00, stdev= 6.33, samples=87 write: IOPS=8, BW=132KiB/s (135kB/s)(6032KiB/45839msec); 0 zone resets clat (msec): min=16, max=260, avg=71.92, stdev=46.44 lat (msec): min=16, max=260, avg=71.93, stdev=46.45 clat percentiles (msec): | 1.00th=[ 20], 5.00th=[ 24], 10.00th=[ 28], 20.00th=[ 35], | 30.00th=[ 41], 40.00th=[ 50], 50.00th=[ 57], 60.00th=[ 71], | 70.00th=[ 87], 80.00th=[ 103], 90.00th=[ 138], 95.00th=[ 167], | 99.00th=[ 243], 99.50th=[ 257], 99.90th=[ 262], 99.95th=[ 262], | 99.99th=[ 262] bw ( KiB/s): min= 31, max= 349, per=23.64%, avg=129.09, stdev=72.18, samples=90 iops : min= 1, max= 21, avg= 7.23, stdev= 4.55, samples=90 lat (msec) : 10=0.91%, 20=11.72%, 50=42.45%, 100=28.39%, 250=16.28% lat (msec) : 500=0.26% cpu : usr=0.06%, sys=1.92%, ctx=1278, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180538: Thu Aug 27 09:26:33 2026 read: IOPS=8, BW=131KiB/s (134kB/s)(6032KiB/46129msec) clat (msec): min=8, max=238, avg=49.06, stdev=39.00 lat (msec): min=8, max=238, avg=49.06, stdev=39.00 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 14], 10.00th=[ 17], 20.00th=[ 22], | 30.00th=[ 26], 40.00th=[ 31], 50.00th=[ 36], 60.00th=[ 45], | 70.00th=[ 53], 80.00th=[ 69], 90.00th=[ 101], 95.00th=[ 140], | 99.00th=[ 203], 99.50th=[ 213], 99.90th=[ 239], 99.95th=[ 239], | 99.99th=[ 239] bw ( KiB/s): min= 31, max= 349, per=26.10%, avg=135.45, stdev=77.11, samples=87 iops : min= 1, max= 21, avg= 7.63, stdev= 4.87, samples=87 write: IOPS=8, BW=136KiB/s (139kB/s)(6256KiB/46129msec); 0 zone resets clat (msec): min=15, max=312, avg=70.27, stdev=47.01 lat (msec): min=15, max=312, avg=70.28, stdev=47.01 clat percentiles (msec): | 1.00th=[ 18], 5.00th=[ 26], 10.00th=[ 29], 20.00th=[ 35], | 30.00th=[ 41], 40.00th=[ 46], 50.00th=[ 55], 60.00th=[ 65], | 70.00th=[ 83], 80.00th=[ 101], 90.00th=[ 134], 95.00th=[ 165], | 99.00th=[ 243], 99.50th=[ 305], 99.90th=[ 313], 99.95th=[ 313], | 99.99th=[ 313] bw ( KiB/s): min= 31, max= 349, per=25.01%, avg=136.57, stdev=73.09, samples=90 iops : min= 1, max= 21, avg= 7.69, stdev= 4.58, samples=90 lat (msec) : 10=0.39%, 20=9.11%, 50=46.09%, 100=29.17%, 250=14.84% lat (msec) : 500=0.39% cpu : usr=0.04%, sys=2.02%, ctx=1235, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=519KiB/s (532kB/s), 127KiB/s-136KiB/s (130kB/s-140kB/s), io=23.4MiB (24.5MB), run=45116-46129msec WRITE: bw=546KiB/s (559kB/s), 132KiB/s-145KiB/s (135kB/s-149kB/s), io=24.6MiB (25.8MB), run=45116-46129msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=180555: Thu Aug 27 09:26:47 2026 read: IOPS=1, BW=1999KiB/s (2047kB/s)(7168KiB/3585msec) clat (msec): min=122, max=967, avg=301.10, stdev=304.38 lat (msec): min=122, max=967, avg=301.10, stdev=304.38 clat percentiles (msec): | 1.00th=[ 123], 5.00th=[ 123], 10.00th=[ 123], 20.00th=[ 133], | 30.00th=[ 136], 40.00th=[ 136], 50.00th=[ 182], 60.00th=[ 218], | 70.00th=[ 218], 80.00th=[ 351], 90.00th=[ 969], 95.00th=[ 969], | 99.00th=[ 969], 99.50th=[ 969], 99.90th=[ 969], 99.95th=[ 969], | 99.99th=[ 969] bw ( KiB/s): min= 2048, max= 5976, per=94.19%, avg=4040.00, stdev=1964.60, samples=3 iops : min= 2, max= 5, avg= 3.67, stdev= 1.53, samples=3 write: IOPS=1, BW=1428KiB/s (1462kB/s)(5120KiB/3585msec); 0 zone resets clat (msec): min=112, max=604, avg=289.93, stdev=195.91 lat (msec): min=112, max=604, avg=290.28, stdev=195.90 clat percentiles (msec): | 1.00th=[ 113], 5.00th=[ 113], 10.00th=[ 113], 20.00th=[ 113], | 30.00th=[ 142], 40.00th=[ 142], 50.00th=[ 279], 60.00th=[ 279], | 70.00th=[ 313], 80.00th=[ 313], 90.00th=[ 609], 95.00th=[ 609], | 99.00th=[ 609], 99.50th=[ 609], 99.90th=[ 609], 99.95th=[ 609], | 99.99th=[ 609] bw ( KiB/s): min= 1796, max= 4096, per=41.17%, avg=2472.50, stdev=1087.29, samples=4 iops : min= 1, max= 4, avg= 2.00, stdev= 1.41, samples=4 lat (msec) : 250=58.33%, 500=25.00%, 750=8.33%, 1000=8.33% cpu : usr=0.00%, sys=4.10%, ctx=68, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180556: Thu Aug 27 09:26:47 2026 read: IOPS=0, BW=429KiB/s (439kB/s)(2048KiB/4774msec) clat (msec): min=104, max=536, avg=320.62, stdev=305.99 lat (msec): min=104, max=536, avg=320.62, stdev=305.99 clat percentiles (msec): | 1.00th=[ 105], 5.00th=[ 105], 10.00th=[ 105], 20.00th=[ 105], | 30.00th=[ 105], 40.00th=[ 105], 50.00th=[ 105], 60.00th=[ 542], | 70.00th=[ 542], 80.00th=[ 542], 90.00th=[ 542], 95.00th=[ 542], | 99.00th=[ 542], 99.50th=[ 542], 99.90th=[ 542], 99.95th=[ 542], | 99.99th=[ 542] bw ( KiB/s): min= 1980, max= 2048, per=46.96%, avg=2014.00, stdev=48.08, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 write: IOPS=2, BW=2145KiB/s (2196kB/s)(10.0MiB/4774msec); 0 zone resets clat (msec): min=149, max=816, avg=404.04, stdev=238.37 lat (msec): min=149, max=816, avg=404.25, stdev=238.41 clat percentiles (msec): | 1.00th=[ 150], 5.00th=[ 150], 10.00th=[ 150], 20.00th=[ 150], | 30.00th=[ 161], 40.00th=[ 180], 50.00th=[ 418], 60.00th=[ 439], | 70.00th=[ 523], 80.00th=[ 542], 90.00th=[ 667], 95.00th=[ 818], | 99.00th=[ 818], 99.50th=[ 818], 99.90th=[ 818], 99.95th=[ 818], | 99.99th=[ 818] bw ( KiB/s): min= 1796, max= 3961, per=42.26%, avg=2538.00, stdev=960.70, samples=7 iops : min= 1, max= 3, avg= 2.00, stdev= 0.82, samples=7 lat (msec) : 250=41.67%, 500=16.67%, 750=33.33%, 1000=8.33% cpu : usr=0.02%, sys=6.58%, ctx=87, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180557: Thu Aug 27 09:26:47 2026 read: IOPS=1, BW=1593KiB/s (1631kB/s)(6144KiB/3857msec) clat (msec): min=71, max=694, avg=271.40, stdev=238.43 lat (msec): min=71, max=694, avg=271.40, stdev=238.43 clat percentiles (msec): | 1.00th=[ 72], 5.00th=[ 72], 10.00th=[ 72], 20.00th=[ 82], | 30.00th=[ 82], 40.00th=[ 125], 50.00th=[ 125], 60.00th=[ 309], | 70.00th=[ 351], 80.00th=[ 351], 90.00th=[ 693], 95.00th=[ 693], | 99.00th=[ 693], 99.50th=[ 693], 99.90th=[ 693], 99.95th=[ 693], | 99.99th=[ 693] bw ( KiB/s): min= 1796, max= 2048, per=46.06%, avg=1975.40, stdev=108.31, samples=5 iops : min= 1, max= 2, avg= 1.40, stdev= 0.55, samples=5 write: IOPS=1, BW=1593KiB/s (1631kB/s)(6144KiB/3857msec); 0 zone resets clat (msec): min=131, max=630, avg=352.25, stdev=222.03 lat (msec): min=131, max=630, avg=352.32, stdev=222.02 clat percentiles (msec): | 1.00th=[ 132], 5.00th=[ 132], 10.00th=[ 132], 20.00th=[ 157], | 30.00th=[ 157], 40.00th=[ 215], 50.00th=[ 215], 60.00th=[ 380], | 70.00th=[ 600], 80.00th=[ 600], 90.00th=[ 634], 95.00th=[ 634], | 99.00th=[ 634], 99.50th=[ 634], 99.90th=[ 634], 99.95th=[ 634], | 99.99th=[ 634] bw ( KiB/s): min= 1796, max= 4063, per=41.44%, avg=2488.75, stdev=1056.20, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 0.82, samples=4 lat (msec) : 100=16.67%, 250=33.33%, 500=25.00%, 750=25.00% cpu : usr=0.00%, sys=3.97%, ctx=77, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180558: Thu Aug 27 09:26:47 2026 read: IOPS=1, BW=1148KiB/s (1176kB/s)(5120KiB/4459msec) clat (msec): min=88, max=960, avg=515.09, stdev=395.45 lat (msec): min=88, max=960, avg=515.09, stdev=395.45 clat percentiles (msec): | 1.00th=[ 89], 5.00th=[ 89], 10.00th=[ 89], 20.00th=[ 89], | 30.00th=[ 112], 40.00th=[ 112], 50.00th=[ 642], 60.00th=[ 642], | 70.00th=[ 768], 80.00th=[ 768], 90.00th=[ 961], 95.00th=[ 961], | 99.00th=[ 961], 99.50th=[ 961], 99.90th=[ 961], 99.95th=[ 961], | 99.99th=[ 961] bw ( KiB/s): min= 1988, max= 2048, per=47.37%, avg=2031.75, stdev=29.26, samples=4 iops : min= 1, max= 2, avg= 1.50, stdev= 0.58, samples=4 write: IOPS=1, BW=1608KiB/s (1646kB/s)(7168KiB/4459msec); 0 zone resets clat (msec): min=93, max=484, avg=259.73, stdev=140.01 lat (msec): min=93, max=484, avg=259.81, stdev=140.01 clat percentiles (msec): | 1.00th=[ 93], 5.00th=[ 93], 10.00th=[ 93], 20.00th=[ 188], | 30.00th=[ 199], 40.00th=[ 199], 50.00th=[ 215], 60.00th=[ 215], | 70.00th=[ 215], 80.00th=[ 422], 90.00th=[ 485], 95.00th=[ 485], | 99.00th=[ 485], 99.50th=[ 485], 99.90th=[ 485], 99.95th=[ 485], | 99.99th=[ 485] bw ( KiB/s): min= 1954, max= 4213, per=55.96%, avg=3360.67, stdev=1227.29, samples=3 iops : min= 1, max= 4, avg= 2.67, stdev= 1.53, samples=3 lat (msec) : 100=16.67%, 250=41.67%, 500=16.67%, 750=8.33%, 1000=16.67% cpu : usr=0.00%, sys=5.00%, ctx=71, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4290KiB/s (4393kB/s), 429KiB/s-1999KiB/s (439kB/s-2047kB/s), io=20.0MiB (20.0MB), run=3585-4774msec WRITE: bw=6006KiB/s (6150kB/s), 1428KiB/s-2145KiB/s (1462kB/s-2196kB/s), io=28.0MiB (29.4MB), run=3585-4774msec rand-rw: (groupid=0, jobs=1): err= 0: pid=180560: Thu Aug 27 09:26:48 2026 read: IOPS=2, BW=2096KiB/s (2146kB/s)(7168KiB/3420msec) clat (usec): min=455, max=642124, avg=250815.09, stdev=218504.54 lat (usec): min=456, max=642125, avg=250816.38, stdev=218504.60 clat percentiles (usec): | 1.00th=[ 457], 5.00th=[ 457], 10.00th=[ 457], 20.00th=[ 502], | 30.00th=[231736], 40.00th=[231736], 50.00th=[274727], 60.00th=[274727], | 70.00th=[274727], 80.00th=[329253], 90.00th=[641729], 95.00th=[641729], | 99.00th=[641729], 99.50th=[641729], 99.90th=[641729], 99.95th=[641729], | 99.99th=[641729] bw ( KiB/s): min= 2035, max= 4063, per=57.08%, avg=2839.25, stdev=988.22, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 1.15, samples=4 write: IOPS=1, BW=1497KiB/s (1533kB/s)(5120KiB/3420msec); 0 zone resets clat (msec): min=297, max=362, avg=332.14, stdev=29.03 lat (msec): min=297, max=363, avg=332.35, stdev=29.23 clat percentiles (msec): | 1.00th=[ 300], 5.00th=[ 300], 10.00th=[ 300], 20.00th=[ 300], | 30.00th=[ 317], 40.00th=[ 317], 50.00th=[ 321], 60.00th=[ 321], | 70.00th=[ 363], 80.00th=[ 363], 90.00th=[ 363], 95.00th=[ 363], | 99.00th=[ 363], 99.50th=[ 363], 99.90th=[ 363], 99.95th=[ 363], | 99.99th=[ 363] bw ( KiB/s): min= 2031, max= 2039, per=29.24%, avg=2036.00, stdev= 3.83, samples=4 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=4 lat (usec) : 500=8.33%, 750=8.33% lat (msec) : 250=8.33%, 500=66.67%, 750=8.33% cpu : usr=0.00%, sys=18.87%, ctx=227, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180561: Thu Aug 27 09:26:48 2026 read: IOPS=0, BW=497KiB/s (509kB/s)(2048KiB/4117msec) clat (msec): min=180, max=293, avg=237.34, stdev=79.78 lat (msec): min=180, max=293, avg=237.35, stdev=79.78 clat percentiles (msec): | 1.00th=[ 182], 5.00th=[ 182], 10.00th=[ 182], 20.00th=[ 182], | 30.00th=[ 182], 40.00th=[ 182], 50.00th=[ 182], 60.00th=[ 296], | 70.00th=[ 296], 80.00th=[ 296], 90.00th=[ 296], 95.00th=[ 296], | 99.00th=[ 296], 99.50th=[ 296], 99.90th=[ 296], 99.95th=[ 296], | 99.99th=[ 296] bw ( KiB/s): min= 1695, max= 2039, per=37.54%, avg=1867.00, stdev=243.24, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2487KiB/s (2547kB/s)(10.0MiB/4117msec); 0 zone resets clat (msec): min=119, max=770, avg=363.25, stdev=226.58 lat (msec): min=119, max=770, avg=363.58, stdev=226.60 clat percentiles (msec): | 1.00th=[ 120], 5.00th=[ 120], 10.00th=[ 120], 20.00th=[ 136], | 30.00th=[ 215], 40.00th=[ 245], 50.00th=[ 288], 60.00th=[ 355], | 70.00th=[ 372], 80.00th=[ 393], 90.00th=[ 743], 95.00th=[ 768], | 99.00th=[ 768], 99.50th=[ 768], 99.90th=[ 768], 99.95th=[ 768], | 99.99th=[ 768] bw ( KiB/s): min= 1695, max= 4096, per=33.37%, avg=2323.83, stdev=878.96, samples=6 iops : min= 1, max= 4, avg= 1.50, stdev= 1.22, samples=6 lat (msec) : 250=41.67%, 500=41.67%, 750=8.33%, 1000=8.33% cpu : usr=0.00%, sys=17.66%, ctx=187, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180562: Thu Aug 27 09:26:48 2026 read: IOPS=1, BW=1695KiB/s (1736kB/s)(6144KiB/3625msec) clat (usec): min=527, max=442326, avg=180819.22, stdev=166045.17 lat (usec): min=528, max=442327, avg=180820.31, stdev=166045.06 clat percentiles (usec): | 1.00th=[ 529], 5.00th=[ 529], 10.00th=[ 529], 20.00th=[ 1762], | 30.00th=[ 1762], 40.00th=[181404], 50.00th=[181404], 60.00th=[219153], | 70.00th=[240124], 80.00th=[240124], 90.00th=[442500], 95.00th=[442500], | 99.00th=[442500], 99.50th=[442500], 99.90th=[442500], 99.95th=[442500], | 99.99th=[442500] bw ( KiB/s): min= 2039, max= 4079, per=68.23%, avg=3393.67, stdev=1173.20, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 write: IOPS=1, BW=1695KiB/s (1736kB/s)(6144KiB/3625msec); 0 zone resets clat (msec): min=202, max=608, avg=422.67, stdev=181.76 lat (msec): min=202, max=608, avg=422.79, stdev=181.69 clat percentiles (msec): | 1.00th=[ 203], 5.00th=[ 203], 10.00th=[ 203], 20.00th=[ 236], | 30.00th=[ 236], 40.00th=[ 359], 50.00th=[ 359], 60.00th=[ 523], | 70.00th=[ 609], 80.00th=[ 609], 90.00th=[ 609], 95.00th=[ 609], | 99.00th=[ 609], 99.50th=[ 609], 99.90th=[ 609], 99.95th=[ 609], | 99.99th=[ 609] bw ( KiB/s): min= 1549, max= 2043, per=27.87%, avg=1941.00, stdev=219.15, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 lat (usec) : 750=8.33% lat (msec) : 2=8.33%, 250=41.67%, 500=16.67%, 750=25.00% cpu : usr=0.00%, sys=18.57%, ctx=306, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180563: Thu Aug 27 09:26:48 2026 read: IOPS=1, BW=1317KiB/s (1348kB/s)(5120KiB/3889msec) clat (usec): min=308, max=548774, avg=160222.23, stdev=242722.06 lat (usec): min=309, max=548776, avg=160222.98, stdev=242722.17 clat percentiles (usec): | 1.00th=[ 310], 5.00th=[ 310], 10.00th=[ 310], 20.00th=[ 310], | 30.00th=[ 619], 40.00th=[ 619], 50.00th=[ 701], 60.00th=[ 701], | 70.00th=[250610], 80.00th=[250610], 90.00th=[549454], 95.00th=[549454], | 99.00th=[549454], 99.50th=[549454], 99.90th=[549454], 99.95th=[549454], | 99.99th=[549454] bw ( KiB/s): min= 2048, max= 6119, per=82.10%, avg=4083.50, stdev=2878.63, samples=2 iops : min= 2, max= 5, avg= 3.50, stdev= 2.12, samples=2 write: IOPS=1, BW=1843KiB/s (1887kB/s)(7168KiB/3889msec); 0 zone resets clat (msec): min=158, max=880, avg=434.38, stdev=267.27 lat (msec): min=159, max=880, avg=434.60, stdev=267.44 clat percentiles (msec): | 1.00th=[ 159], 5.00th=[ 159], 10.00th=[ 159], 20.00th=[ 234], | 30.00th=[ 271], 40.00th=[ 271], 50.00th=[ 359], 60.00th=[ 426], | 70.00th=[ 426], 80.00th=[ 718], 90.00th=[ 877], 95.00th=[ 877], | 99.00th=[ 877], 99.50th=[ 877], 99.90th=[ 877], 99.95th=[ 877], | 99.99th=[ 877] bw ( KiB/s): min= 2035, max= 4063, per=36.56%, avg=2546.25, stdev=1011.18, samples=4 iops : min= 1, max= 3, avg= 1.75, stdev= 0.96, samples=4 lat (usec) : 500=8.33%, 750=16.67% lat (msec) : 250=16.67%, 500=33.33%, 750=16.67%, 1000=8.33% cpu : usr=0.00%, sys=16.31%, ctx=196, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4974KiB/s (5094kB/s), 497KiB/s-2096KiB/s (509kB/s-2146kB/s), io=20.0MiB (20.0MB), run=3420-4117msec WRITE: bw=6964KiB/s (7131kB/s), 1497KiB/s-2487KiB/s (1533kB/s-2547kB/s), io=28.0MiB (29.4MB), run=3420-4117msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=180574: Thu Aug 27 09:27:02 2026 read: IOPS=1, BW=4724KiB/s (4838kB/s)(12.0MiB/2601msec) clat (msec): min=787, max=943, avg=845.33, stdev=85.54 lat (msec): min=787, max=943, avg=845.34, stdev=85.54 clat percentiles (msec): | 1.00th=[ 785], 5.00th=[ 785], 10.00th=[ 785], 20.00th=[ 785], | 30.00th=[ 785], 40.00th=[ 802], 50.00th=[ 802], 60.00th=[ 802], | 70.00th=[ 944], 80.00th=[ 944], 90.00th=[ 944], 95.00th=[ 944], | 99.00th=[ 944], 99.50th=[ 944], 99.90th=[ 944], 99.95th=[ 944], | 99.99th=[ 944] bw ( KiB/s): min= 8126, max= 8159, per=100.00%, avg=8142.50, stdev=23.33, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=100.00% cpu : usr=0.00%, sys=14.62%, ctx=445, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180575: Thu Aug 27 09:27:02 2026 read: IOPS=0, BW=1333KiB/s (1365kB/s)(4096KiB/3073msec) clat (nsec): min=720758k, max=720758k, avg=720757811.00, stdev= 0.00 lat (nsec): min=720761k, max=720761k, avg=720761235.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 718], 5.00th=[ 718], 10.00th=[ 718], 20.00th=[ 718], | 30.00th=[ 718], 40.00th=[ 718], 50.00th=[ 718], 60.00th=[ 718], | 70.00th=[ 718], 80.00th=[ 718], 90.00th=[ 718], 95.00th=[ 718], | 99.00th=[ 718], 99.50th=[ 718], 99.90th=[ 718], 99.95th=[ 718], | 99.99th=[ 718] bw ( KiB/s): min= 8159, max= 8159, per=100.00%, avg=8159.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2666KiB/s (2730kB/s)(8192KiB/3073msec); 0 zone resets clat (msec): min=609, max=1568, avg=1089.07, stdev=677.60 lat (msec): min=610, max=1575, avg=1093.25, stdev=682.11 clat percentiles (msec): | 1.00th=[ 609], 5.00th=[ 609], 10.00th=[ 609], 20.00th=[ 609], | 30.00th=[ 609], 40.00th=[ 609], 50.00th=[ 609], 60.00th=[ 1569], | 70.00th=[ 1569], 80.00th=[ 1569], 90.00th=[ 1569], 95.00th=[ 1569], | 99.00th=[ 1569], 99.50th=[ 1569], 99.90th=[ 1569], 99.95th=[ 1569], | 99.99th=[ 1569] bw ( KiB/s): min= 8192, max= 8192, per=87.53%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 750=66.67%, 2000=33.33% cpu : usr=0.00%, sys=6.90%, ctx=100, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180576: Thu Aug 27 09:27:02 2026 write: IOPS=0, BW=3510KiB/s (3594kB/s)(12.0MiB/3501msec); 0 zone resets clat (msec): min=695, max=1681, avg=1093.81, stdev=519.47 lat (msec): min=695, max=1682, avg=1094.89, stdev=519.50 clat percentiles (msec): | 1.00th=[ 693], 5.00th=[ 693], 10.00th=[ 693], 20.00th=[ 693], | 30.00th=[ 693], 40.00th=[ 902], 50.00th=[ 902], 60.00th=[ 902], | 70.00th=[ 1687], 80.00th=[ 1687], 90.00th=[ 1687], 95.00th=[ 1687], | 99.00th=[ 1687], 99.50th=[ 1687], 99.90th=[ 1687], 99.95th=[ 1687], | 99.99th=[ 1687] bw ( KiB/s): min= 8126, max= 8126, per=86.83%, avg=8126.00, stdev= 0.00, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=3.74%, ctx=58, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180577: Thu Aug 27 09:27:02 2026 write: IOPS=1, BW=4963KiB/s (5082kB/s)(12.0MiB/2476msec); 0 zone resets clat (msec): min=543, max=991, avg=774.42, stdev=224.46 lat (msec): min=543, max=991, avg=775.20, stdev=224.58 clat percentiles (msec): | 1.00th=[ 542], 5.00th=[ 542], 10.00th=[ 542], 20.00th=[ 542], | 30.00th=[ 542], 40.00th=[ 793], 50.00th=[ 793], 60.00th=[ 793], | 70.00th=[ 995], 80.00th=[ 995], 90.00th=[ 995], 95.00th=[ 995], | 99.00th=[ 995], 99.50th=[ 995], 99.90th=[ 995], 99.95th=[ 995], | 99.99th=[ 995] bw ( KiB/s): min= 8126, max= 8159, per=87.00%, avg=8142.50, stdev=23.33, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 1000=66.67% cpu : usr=0.00%, sys=7.68%, ctx=71, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5332KiB/s (5460kB/s), 1333KiB/s-4724KiB/s (1365kB/s-4838kB/s), io=16.0MiB (16.8MB), run=2601-3073msec WRITE: bw=9360KiB/s (9584kB/s), 2666KiB/s-4963KiB/s (2730kB/s-5082kB/s), io=32.0MiB (33.6MB), run=2476-3501msec rand-rw: (groupid=0, jobs=1): err= 0: pid=180570: Thu Aug 27 09:27:02 2026 read: IOPS=1, BW=6519KiB/s (6675kB/s)(12.0MiB/1885msec) clat (msec): min=254, max=1004, avg=534.59, stdev=409.48 lat (msec): min=254, max=1004, avg=534.59, stdev=409.48 clat percentiles (msec): | 1.00th=[ 255], 5.00th=[ 255], 10.00th=[ 255], 20.00th=[ 255], | 30.00th=[ 255], 40.00th=[ 347], 50.00th=[ 347], 60.00th=[ 347], | 70.00th=[ 1003], 80.00th=[ 1003], 90.00th=[ 1003], 95.00th=[ 1003], | 99.00th=[ 1003], 99.50th=[ 1003], 99.90th=[ 1003], 99.95th=[ 1003], | 99.99th=[ 1003] bw ( KiB/s): min= 5997, max= 7984, per=100.00%, avg=6990.50, stdev=1405.02, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=66.67%, 2000=33.33% cpu : usr=0.00%, sys=6.48%, ctx=66, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180571: Thu Aug 27 09:27:02 2026 read: IOPS=0, BW=1031KiB/s (1056kB/s)(4096KiB/3973msec) clat (nsec): min=1147.1M, max=1147.1M, avg=1147082984.00, stdev= 0.00 lat (nsec): min=1147.1M, max=1147.1M, avg=1147085289.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1150], 5.00th=[ 1150], 10.00th=[ 1150], 20.00th=[ 1150], | 30.00th=[ 1150], 40.00th=[ 1150], 50.00th=[ 1150], 60.00th=[ 1150], | 70.00th=[ 1150], 80.00th=[ 1150], 90.00th=[ 1150], 95.00th=[ 1150], | 99.00th=[ 1150], 99.50th=[ 1150], 99.90th=[ 1150], 99.95th=[ 1150], | 99.99th=[ 1150] bw ( KiB/s): min= 8078, max= 8078, per=100.00%, avg=8078.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2062KiB/s (2111kB/s)(8192KiB/3973msec); 0 zone resets clat (msec): min=314, max=2230, avg=1272.34, stdev=1354.73 lat (msec): min=314, max=2230, avg=1272.89, stdev=1354.87 clat percentiles (msec): | 1.00th=[ 313], 5.00th=[ 313], 10.00th=[ 313], 20.00th=[ 313], | 30.00th=[ 313], 40.00th=[ 313], 50.00th=[ 313], 60.00th=[ 2232], | 70.00th=[ 2232], 80.00th=[ 2232], 90.00th=[ 2232], 95.00th=[ 2232], | 99.00th=[ 2232], 99.50th=[ 2232], 99.90th=[ 2232], 99.95th=[ 2232], | 99.99th=[ 2232] bw ( KiB/s): min= 8175, max= 8175, per=99.13%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=3.02%, ctx=61, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180572: Thu Aug 27 09:27:02 2026 write: IOPS=0, BW=3485KiB/s (3569kB/s)(12.0MiB/3526msec); 0 zone resets clat (msec): min=618, max=1806, avg=1078.94, stdev=637.68 lat (msec): min=619, max=1807, avg=1079.55, stdev=637.43 clat percentiles (msec): | 1.00th=[ 617], 5.00th=[ 617], 10.00th=[ 617], 20.00th=[ 617], | 30.00th=[ 617], 40.00th=[ 810], 50.00th=[ 810], 60.00th=[ 810], | 70.00th=[ 1804], 80.00th=[ 1804], 90.00th=[ 1804], 95.00th=[ 1804], | 99.00th=[ 1804], 99.50th=[ 1804], 99.90th=[ 1804], 99.95th=[ 1804], | 99.99th=[ 1804] bw ( KiB/s): min= 8159, max= 8175, per=99.03%, avg=8167.00, stdev=11.31, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=4.71%, ctx=79, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180573: Thu Aug 27 09:27:02 2026 write: IOPS=1, BW=4701KiB/s (4814kB/s)(12.0MiB/2614msec); 0 zone resets clat (msec): min=345, max=1180, avg=784.41, stdev=419.16 lat (msec): min=349, max=1180, avg=786.15, stdev=417.14 clat percentiles (msec): | 1.00th=[ 347], 5.00th=[ 347], 10.00th=[ 347], 20.00th=[ 347], | 30.00th=[ 347], 40.00th=[ 827], 50.00th=[ 827], 60.00th=[ 827], | 70.00th=[ 1183], 80.00th=[ 1183], 90.00th=[ 1183], 95.00th=[ 1183], | 99.00th=[ 1183], 99.50th=[ 1183], 99.90th=[ 1183], 99.95th=[ 1183], | 99.99th=[ 1183] bw ( KiB/s): min= 6350, max= 8078, per=87.47%, avg=7214.00, stdev=1221.88, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=4.98%, ctx=67, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4124KiB/s (4223kB/s), 1031KiB/s-6519KiB/s (1056kB/s-6675kB/s), io=16.0MiB (16.8MB), run=1885-3973msec WRITE: bw=8248KiB/s (8446kB/s), 2062KiB/s-4701KiB/s (2111kB/s-4814kB/s), io=32.0MiB (33.6MB), run=2614-3973msec