== sanity test 398b: DIO and buffer IO race ============== 04:24:50 (1789028690) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 7.2016 s, 7.0 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=178263: Thu Sep 10 04:27:34 2026 read: IOPS=10, BW=42.0KiB/s (44.0kB/s)(5992KiB/139422msec) clat (usec): min=44, max=1093.7k, avg=50574.79, stdev=44240.45 lat (usec): min=45, max=1093.7k, avg=50583.11, stdev=44235.64 clat percentiles (usec): | 1.00th=[ 58], 5.00th=[ 2802], 10.00th=[ 17171], | 20.00th=[ 24249], 30.00th=[ 30016], 40.00th=[ 35390], | 50.00th=[ 41681], 60.00th=[ 50070], 70.00th=[ 60031], | 80.00th=[ 72877], 90.00th=[ 90702], 95.00th=[ 109577], | 99.00th=[ 164627], 99.50th=[ 202376], 99.90th=[ 471860], | 99.95th=[1098908], 99.99th=[1098908] bw ( KiB/s): min= 7, max= 95, per=25.25%, avg=42.93, stdev=18.25, samples=272 iops : min= 1, max= 23, avg=10.05, stdev= 4.58, samples=272 write: IOPS=11, BW=45.2KiB/s (46.2kB/s)(6296KiB/139422msec); 0 zone resets clat (usec): min=893, max=278790, avg=40062.50, stdev=41593.13 lat (usec): min=894, max=278791, avg=40066.48, stdev=41593.54 clat percentiles (usec): | 1.00th=[ 1090], 5.00th=[ 1319], 10.00th=[ 2040], 20.00th=[ 4555], | 30.00th=[ 8586], 40.00th=[ 18220], 50.00th=[ 28443], 60.00th=[ 38536], | 70.00th=[ 51119], 80.00th=[ 69731], 90.00th=[ 98042], 95.00th=[125305], | 99.00th=[177210], 99.50th=[191890], 99.90th=[261096], 99.95th=[278922], | 99.99th=[278922] bw ( KiB/s): min= 7, max= 117, per=25.33%, avg=45.09, stdev=20.61, samples=272 iops : min= 1, max= 29, avg=10.60, stdev= 5.20, samples=272 lat (usec) : 50=0.07%, 100=1.99%, 250=0.23%, 500=0.03%, 1000=0.03% lat (msec) : 2=5.05%, 4=4.23%, 10=7.45%, 20=8.63%, 50=36.78% lat (msec) : 100=26.89%, 250=8.43%, 500=0.16%, 2000=0.03% cpu : usr=0.10%, sys=4.82%, ctx=6570, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178264: Thu Sep 10 04:27:34 2026 read: IOPS=10, BW=42.0KiB/s (44.0kB/s)(5940KiB/138232msec) clat (usec): min=34, max=416827, avg=51312.60, stdev=34746.14 lat (usec): min=34, max=416828, avg=51314.64, stdev=34745.88 clat percentiles (usec): | 1.00th=[ 54], 5.00th=[ 9896], 10.00th=[ 17957], 20.00th=[ 25035], | 30.00th=[ 31589], 40.00th=[ 38536], 50.00th=[ 45351], 60.00th=[ 53216], | 70.00th=[ 61604], 80.00th=[ 72877], 90.00th=[ 90702], 95.00th=[108528], | 99.00th=[170918], 99.50th=[200279], 99.90th=[287310], 99.95th=[417334], | 99.99th=[417334] bw ( KiB/s): min= 5, max= 95, per=25.34%, avg=43.07, stdev=18.23, samples=268 iops : min= 1, max= 23, avg=10.09, stdev= 4.58, samples=268 write: IOPS=11, BW=45.9KiB/s (47.0kB/s)(6348KiB/138232msec); 0 zone resets clat (usec): min=862, max=994684, avg=38728.89, stdev=48385.00 lat (usec): min=863, max=994686, avg=38735.48, stdev=48381.81 clat percentiles (usec): | 1.00th=[ 1106], 5.00th=[ 1254], 10.00th=[ 1565], 20.00th=[ 3490], | 30.00th=[ 7242], 40.00th=[ 13960], 50.00th=[ 25560], 60.00th=[ 36439], | 70.00th=[ 49021], 80.00th=[ 65799], 90.00th=[ 93848], 95.00th=[123208], | 99.00th=[187696], 99.50th=[227541], 99.90th=[304088], 99.95th=[994051], | 99.99th=[994051] bw ( KiB/s): min= 7, max= 166, per=25.63%, avg=45.61, stdev=23.03, samples=270 iops : min= 1, max= 41, avg=10.73, stdev= 5.79, samples=270 lat (usec) : 50=0.26%, 100=1.73%, 250=0.13%, 500=0.07%, 1000=0.16% lat (msec) : 2=6.74%, 4=4.20%, 10=7.75%, 20=8.30%, 50=34.41% lat (msec) : 100=28.48%, 250=7.49%, 500=0.26%, 1000=0.03% cpu : usr=0.09%, sys=4.96%, ctx=6427, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178267: Thu Sep 10 04:27:34 2026 read: IOPS=11, BW=44.0KiB/s (45.1kB/s)(6028KiB/136964msec) clat (usec): min=40, max=1042.0k, avg=50311.07, stdev=42778.48 lat (usec): min=40, max=1042.0k, avg=50313.03, stdev=42778.36 clat percentiles (usec): | 1.00th=[ 55], 5.00th=[ 1483], 10.00th=[ 17433], | 20.00th=[ 24249], 30.00th=[ 30016], 40.00th=[ 35914], | 50.00th=[ 43254], 60.00th=[ 50070], 70.00th=[ 58983], | 80.00th=[ 70779], 90.00th=[ 92799], 95.00th=[ 112722], | 99.00th=[ 175113], 99.50th=[ 202376], 99.90th=[ 329253], | 99.95th=[1044382], 99.99th=[1044382] bw ( KiB/s): min= 5, max= 111, per=25.72%, avg=43.72, stdev=19.39, samples=269 iops : min= 1, max= 27, avg=10.26, stdev= 4.85, samples=269 write: IOPS=11, BW=45.7KiB/s (46.8kB/s)(6260KiB/136964msec); 0 zone resets clat (usec): min=1034, max=297592, avg=38733.51, stdev=41585.72 lat (usec): min=1035, max=297593, avg=38738.81, stdev=41585.25 clat percentiles (usec): | 1.00th=[ 1090], 5.00th=[ 1237], 10.00th=[ 1663], 20.00th=[ 3884], | 30.00th=[ 7439], 40.00th=[ 15795], 50.00th=[ 26870], 60.00th=[ 37487], | 70.00th=[ 49546], 80.00th=[ 67634], 90.00th=[ 93848], 95.00th=[121111], | 99.00th=[181404], 99.50th=[208667], 99.90th=[291505], 99.95th=[295699], | 99.99th=[295699] bw ( KiB/s): min= 7, max= 119, per=25.55%, avg=45.48, stdev=20.98, samples=268 iops : min= 1, max= 29, avg=10.71, stdev= 5.29, samples=268 lat (usec) : 50=0.20%, 100=1.82%, 250=0.23%, 500=0.07%, 750=0.03% lat (usec) : 1000=0.07% lat (msec) : 2=6.18%, 4=4.46%, 10=7.00%, 20=8.11%, 50=37.11% lat (msec) : 100=26.37%, 250=8.14%, 500=0.20%, 2000=0.03% cpu : usr=0.09%, sys=4.75%, ctx=6413, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178269: Thu Sep 10 04:27:34 2026 read: IOPS=10, BW=43.0KiB/s (44.1kB/s)(6052KiB/140656msec) clat (usec): min=36, max=232604, avg=50153.39, stdev=32710.84 lat (usec): min=36, max=232605, avg=50157.57, stdev=32709.15 clat percentiles (usec): | 1.00th=[ 56], 5.00th=[ 2147], 10.00th=[ 17695], 20.00th=[ 24511], | 30.00th=[ 30016], 40.00th=[ 36439], 50.00th=[ 44303], 60.00th=[ 52167], | 70.00th=[ 61080], 80.00th=[ 71828], 90.00th=[ 91751], 95.00th=[110625], | 99.00th=[160433], 99.50th=[181404], 99.90th=[206570], 99.95th=[231736], | 99.99th=[231736] bw ( KiB/s): min= 7, max= 119, per=25.19%, avg=42.83, stdev=19.27, samples=274 iops : min= 1, max= 29, avg=10.03, stdev= 4.86, samples=274 write: IOPS=11, BW=44.3KiB/s (45.4kB/s)(6236KiB/140656msec); 0 zone resets clat (usec): min=1041, max=1059.4k, avg=41212.58, stdev=51288.07 lat (usec): min=1042, max=1059.4k, avg=41215.18, stdev=51288.50 clat percentiles (usec): | 1.00th=[ 1123], 5.00th=[ 1287], 10.00th=[ 1762], | 20.00th=[ 4555], 30.00th=[ 8094], 40.00th=[ 16450], | 50.00th=[ 27919], 60.00th=[ 38536], 70.00th=[ 51119], | 80.00th=[ 69731], 90.00th=[ 100140], 95.00th=[ 128451], | 99.00th=[ 189793], 99.50th=[ 235930], 99.90th=[ 312476], | 99.95th=[1061159], 99.99th=[1061159] bw ( KiB/s): min= 5, max= 119, per=24.71%, avg=43.98, stdev=19.94, samples=275 iops : min= 1, max= 29, avg=10.33, stdev= 5.03, samples=275 lat (usec) : 50=0.16%, 100=2.08%, 250=0.10%, 750=0.03%, 1000=0.07% lat (msec) : 2=5.76%, 4=3.58%, 10=7.88%, 20=8.85%, 50=34.83% lat (msec) : 100=28.03%, 250=8.40%, 500=0.20%, 2000=0.03% cpu : usr=0.06%, sys=4.76%, ctx=6513, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=171KiB/s (175kB/s), 42.0KiB/s-44.0KiB/s (44.0kB/s-45.1kB/s), io=23.4MiB (24.6MB), run=136964-140656msec WRITE: bw=179KiB/s (183kB/s), 44.3KiB/s-45.9KiB/s (45.4kB/s-47.0kB/s), io=24.6MiB (25.7MB), run=136964-140656msec rand-rw: (groupid=0, jobs=1): err= 0: pid=178262: Thu Sep 10 04:28:23 2026 read: IOPS=7, BW=31.6KiB/s (32.4kB/s)(5992KiB/189504msec) clat (msec): min=6, max=1077, avg=49.57, stdev=51.55 lat (msec): min=6, max=1077, avg=49.57, stdev=51.55 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 18], | 30.00th=[ 23], 40.00th=[ 28], 50.00th=[ 34], 60.00th=[ 42], | 70.00th=[ 54], 80.00th=[ 71], 90.00th=[ 108], 95.00th=[ 146], | 99.00th=[ 226], 99.50th=[ 255], 99.90th=[ 351], 99.95th=[ 1083], | 99.99th=[ 1083] bw ( KiB/s): min= 7, max= 112, per=26.16%, avg=32.96, stdev=22.67, samples=352 iops : min= 1, max= 28, avg= 7.59, stdev= 5.71, samples=352 write: IOPS=8, BW=33.2KiB/s (34.0kB/s)(6296KiB/189504msec); 0 zone resets clat (msec): min=10, max=387, avg=72.92, stdev=51.75 lat (msec): min=10, max=387, avg=72.92, stdev=51.75 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 24], 10.00th=[ 28], 20.00th=[ 35], | 30.00th=[ 40], 40.00th=[ 47], 50.00th=[ 56], 60.00th=[ 68], | 70.00th=[ 85], 80.00th=[ 106], 90.00th=[ 142], 95.00th=[ 174], | 99.00th=[ 262], 99.50th=[ 305], 99.90th=[ 372], 99.95th=[ 388], | 99.99th=[ 388] bw ( KiB/s): min= 7, max= 112, per=24.93%, avg=32.90, stdev=21.26, samples=370 iops : min= 1, max= 28, avg= 7.58, stdev= 5.36, samples=370 lat (msec) : 10=1.30%, 20=12.04%, 50=42.38%, 100=27.25%, 250=16.24% lat (msec) : 500=0.75%, 2000=0.03% cpu : usr=0.06%, sys=1.67%, ctx=4865, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178265: Thu Sep 10 04:28:23 2026 read: IOPS=7, BW=31.4KiB/s (32.2kB/s)(5940KiB/189028msec) clat (msec): min=6, max=1214, avg=49.25, stdev=51.97 lat (msec): min=6, max=1214, avg=49.27, stdev=51.97 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 15], 20.00th=[ 19], | 30.00th=[ 23], 40.00th=[ 28], 50.00th=[ 34], 60.00th=[ 41], | 70.00th=[ 52], 80.00th=[ 70], 90.00th=[ 107], 95.00th=[ 140], | 99.00th=[ 211], 99.50th=[ 243], 99.90th=[ 288], 99.95th=[ 1217], | 99.99th=[ 1217] bw ( KiB/s): min= 7, max= 159, per=25.90%, avg=32.63, stdev=22.62, samples=353 iops : min= 1, max= 39, avg= 7.52, stdev= 5.70, samples=353 write: IOPS=8, BW=33.6KiB/s (34.4kB/s)(6348KiB/189028msec); 0 zone resets clat (msec): min=11, max=492, avg=72.71, stdev=52.76 lat (msec): min=11, max=492, avg=72.71, stdev=52.76 clat percentiles (msec): | 1.00th=[ 18], 5.00th=[ 24], 10.00th=[ 27], 20.00th=[ 33], | 30.00th=[ 41], 40.00th=[ 47], 50.00th=[ 56], 60.00th=[ 67], | 70.00th=[ 83], 80.00th=[ 107], 90.00th=[ 144], 95.00th=[ 176], | 99.00th=[ 239], 99.50th=[ 326], 99.90th=[ 451], 99.95th=[ 493], | 99.99th=[ 493] bw ( KiB/s): min= 7, max= 131, per=25.33%, avg=33.44, stdev=20.80, samples=367 iops : min= 1, max= 32, avg= 7.71, stdev= 5.23, samples=367 lat (msec) : 10=1.33%, 20=11.26%, 50=43.07%, 100=27.15%, 250=16.54% lat (msec) : 500=0.62%, 2000=0.03% cpu : usr=0.07%, sys=1.69%, ctx=4966, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178266: Thu Sep 10 04:28:23 2026 read: IOPS=7, BW=31.7KiB/s (32.5kB/s)(6028KiB/189877msec) clat (msec): min=6, max=358, avg=48.59, stdev=42.97 lat (msec): min=6, max=358, avg=48.60, stdev=42.99 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 15], 20.00th=[ 20], | 30.00th=[ 24], 40.00th=[ 29], 50.00th=[ 35], 60.00th=[ 43], | 70.00th=[ 52], 80.00th=[ 69], 90.00th=[ 104], 95.00th=[ 138], | 99.00th=[ 213], 99.50th=[ 259], 99.90th=[ 313], 99.95th=[ 359], | 99.99th=[ 359] bw ( KiB/s): min= 7, max= 136, per=25.57%, avg=32.22, stdev=21.89, samples=362 iops : min= 1, max= 34, avg= 7.41, stdev= 5.52, samples=362 write: IOPS=8, BW=32.0KiB/s (33.8kB/s)(6260KiB/189877msec); 0 zone resets clat (msec): min=11, max=1299, avg=74.21, stdev=61.28 lat (msec): min=11, max=1299, avg=74.21, stdev=61.28 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 23], 10.00th=[ 28], 20.00th=[ 34], | 30.00th=[ 40], 40.00th=[ 47], 50.00th=[ 56], 60.00th=[ 69], | 70.00th=[ 86], 80.00th=[ 109], 90.00th=[ 144], 95.00th=[ 176], | 99.00th=[ 271], 99.50th=[ 309], 99.90th=[ 498], 99.95th=[ 1301], | 99.99th=[ 1301] bw ( KiB/s): min= 7, max= 115, per=25.04%, avg=33.05, stdev=21.17, samples=367 iops : min= 1, max= 28, avg= 7.61, stdev= 5.33, samples=367 lat (msec) : 10=1.53%, 20=11.04%, 50=43.88%, 100=26.53%, 250=16.08% lat (msec) : 500=0.91%, 2000=0.03% cpu : usr=0.07%, sys=1.65%, ctx=4902, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178268: Thu Sep 10 04:28:23 2026 read: IOPS=8, BW=32.1KiB/s (32.9kB/s)(6052KiB/188295msec) clat (msec): min=5, max=313, avg=47.73, stdev=42.39 lat (msec): min=5, max=313, avg=47.73, stdev=42.39 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 18], | 30.00th=[ 23], 40.00th=[ 28], 50.00th=[ 33], 60.00th=[ 41], | 70.00th=[ 53], 80.00th=[ 72], 90.00th=[ 104], 95.00th=[ 138], | 99.00th=[ 201], 99.50th=[ 262], 99.90th=[ 300], 99.95th=[ 313], | 99.99th=[ 313] bw ( KiB/s): min= 7, max= 132, per=26.49%, avg=33.38, stdev=23.16, samples=352 iops : min= 1, max= 33, avg= 7.70, stdev= 5.84, samples=352 write: IOPS=8, BW=33.1KiB/s (33.9kB/s)(6236KiB/188295msec); 0 zone resets clat (msec): min=11, max=1291, avg=74.16, stdev=61.08 lat (msec): min=11, max=1291, avg=74.16, stdev=61.08 clat percentiles (msec): | 1.00th=[ 19], 5.00th=[ 24], 10.00th=[ 27], 20.00th=[ 34], | 30.00th=[ 40], 40.00th=[ 47], 50.00th=[ 56], 60.00th=[ 68], | 70.00th=[ 86], 80.00th=[ 109], 90.00th=[ 142], 95.00th=[ 184], | 99.00th=[ 257], 99.50th=[ 321], 99.90th=[ 447], 99.95th=[ 1284], | 99.99th=[ 1284] bw ( KiB/s): min= 7, max= 119, per=25.17%, avg=33.22, stdev=20.41, samples=364 iops : min= 1, max= 29, avg= 7.65, stdev= 5.13, samples=364 lat (msec) : 10=1.79%, 20=11.04%, 50=43.29%, 100=26.82%, 250=16.24% lat (msec) : 500=0.78%, 2000=0.03% cpu : usr=0.06%, sys=1.63%, ctx=4793, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=126KiB/s (129kB/s), 31.4KiB/s-32.1KiB/s (32.2kB/s-32.9kB/s), io=23.4MiB (24.6MB), run=188295-189877msec WRITE: bw=132KiB/s (136kB/s), 32.0KiB/s-33.6KiB/s (33.8kB/s-34.4kB/s), io=24.6MiB (25.7MB), run=188295-189877msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=178317: Thu Sep 10 04:29:13 2026 read: IOPS=9, BW=151KiB/s (155kB/s)(5920KiB/39136msec) clat (usec): min=37, max=271317, avg=55843.65, stdev=40492.88 lat (usec): min=37, max=271319, avg=55854.15, stdev=40489.44 clat percentiles (usec): | 1.00th=[ 43], 5.00th=[ 65], 10.00th=[ 91], 20.00th=[ 26084], | 30.00th=[ 35390], 40.00th=[ 43779], 50.00th=[ 49546], 60.00th=[ 57410], | 70.00th=[ 68682], 80.00th=[ 80217], 90.00th=[105382], 95.00th=[132645], | 99.00th=[191890], 99.50th=[231736], 99.90th=[270533], 99.95th=[270533], | 99.99th=[270533] bw ( KiB/s): min= 61, max= 320, per=24.65%, avg=150.88, stdev=66.08, samples=77 iops : min= 3, max= 20, avg= 8.66, stdev= 4.16, samples=77 write: IOPS=10, BW=163KiB/s (167kB/s)(6368KiB/39136msec); 0 zone resets clat (usec): min=1467, max=395303, avg=46021.58, stdev=48881.10 lat (usec): min=1468, max=395306, avg=46026.32, stdev=48880.31 clat percentiles (usec): | 1.00th=[ 1565], 5.00th=[ 2180], 10.00th=[ 3523], 20.00th=[ 7570], | 30.00th=[ 12649], 40.00th=[ 22414], 50.00th=[ 32375], 60.00th=[ 45351], | 70.00th=[ 57934], 80.00th=[ 77071], 90.00th=[103285], 95.00th=[132645], | 99.00th=[219153], 99.50th=[299893], 99.90th=[396362], 99.95th=[396362], | 99.99th=[396362] bw ( KiB/s): min= 29, max= 529, per=25.60%, avg=164.58, stdev=84.93, samples=76 iops : min= 1, max= 33, avg= 9.53, stdev= 5.41, samples=76 lat (usec) : 50=0.78%, 100=4.04%, 250=0.78%, 500=0.13% lat (msec) : 2=2.34%, 4=4.04%, 10=7.29%, 20=7.55%, 50=31.12% lat (msec) : 100=30.99%, 250=10.55%, 500=0.39% cpu : usr=0.07%, sys=5.04%, ctx=1682, majf=0, minf=19 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178318: Thu Sep 10 04:29:13 2026 read: IOPS=9, BW=153KiB/s (157kB/s)(5744KiB/37561msec) clat (usec): min=38, max=314183, avg=58206.36, stdev=42491.08 lat (usec): min=38, max=314184, avg=58215.76, stdev=42494.39 clat percentiles (usec): | 1.00th=[ 57], 5.00th=[ 68], 10.00th=[ 109], 20.00th=[ 28967], | 30.00th=[ 36439], 40.00th=[ 43779], 50.00th=[ 51643], 60.00th=[ 60556], | 70.00th=[ 70779], 80.00th=[ 84411], 90.00th=[107480], 95.00th=[131597], | 99.00th=[217056], 99.50th=[244319], 99.90th=[312476], 99.95th=[312476], | 99.99th=[312476] bw ( KiB/s): min= 30, max= 309, per=24.99%, avg=152.93, stdev=69.07, samples=74 iops : min= 1, max= 19, avg= 8.78, stdev= 4.39, samples=74 write: IOPS=10, BW=174KiB/s (178kB/s)(6544KiB/37561msec); 0 zone resets clat (usec): min=1496, max=285347, avg=40281.12, stdev=43401.91 lat (usec): min=1496, max=285348, avg=40283.74, stdev=43402.36 clat percentiles (usec): | 1.00th=[ 1549], 5.00th=[ 1991], 10.00th=[ 3195], 20.00th=[ 5538], | 30.00th=[ 9241], 40.00th=[ 15008], 50.00th=[ 28705], 60.00th=[ 38011], | 70.00th=[ 51119], 80.00th=[ 69731], 90.00th=[ 92799], 95.00th=[135267], | 99.00th=[179307], 99.50th=[219153], 99.90th=[287310], 99.95th=[287310], | 99.99th=[287310] bw ( KiB/s): min= 31, max= 415, per=27.02%, avg=173.73, stdev=76.30, samples=74 iops : min= 1, max= 25, avg=10.11, stdev= 4.81, samples=74 lat (usec) : 50=0.26%, 100=4.30%, 250=0.52%, 500=0.13% lat (msec) : 2=2.99%, 4=4.04%, 10=10.81%, 20=7.16%, 50=28.39% lat (msec) : 100=30.86%, 250=10.16%, 500=0.39% cpu : usr=0.08%, sys=5.12%, ctx=1628, majf=0, minf=19 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178319: Thu Sep 10 04:29:13 2026 read: IOPS=10, BW=161KiB/s (165kB/s)(6256KiB/38835msec) clat (usec): min=40, max=350289, avg=54257.57, stdev=40939.86 lat (usec): min=41, max=350290, avg=54259.16, stdev=40939.70 clat percentiles (usec): | 1.00th=[ 53], 5.00th=[ 69], 10.00th=[ 117], 20.00th=[ 25297], | 30.00th=[ 33817], 40.00th=[ 42206], 50.00th=[ 49546], 60.00th=[ 56886], | 70.00th=[ 67634], 80.00th=[ 80217], 90.00th=[ 99091], 95.00th=[122160], | 99.00th=[170918], 99.50th=[308282], 99.90th=[350225], 99.95th=[350225], | 99.99th=[350225] bw ( KiB/s): min= 30, max= 341, per=26.70%, avg=163.40, stdev=67.76, samples=75 iops : min= 1, max= 21, avg= 9.45, stdev= 4.32, samples=75 write: IOPS=9, BW=155KiB/s (159kB/s)(6032KiB/38835msec); 0 zone resets clat (usec): min=1527, max=311374, avg=45948.81, stdev=50392.34 lat (usec): min=1529, max=311376, avg=45953.47, stdev=50391.92 clat percentiles (usec): | 1.00th=[ 1795], 5.00th=[ 2040], 10.00th=[ 3556], 20.00th=[ 6587], | 30.00th=[ 10421], 40.00th=[ 19530], 50.00th=[ 30802], 60.00th=[ 42730], | 70.00th=[ 54789], 80.00th=[ 78119], 90.00th=[113771], 95.00th=[141558], | 99.00th=[231736], 99.50th=[299893], 99.90th=[312476], 99.95th=[312476], | 99.99th=[312476] bw ( KiB/s): min= 31, max= 349, per=23.82%, avg=153.18, stdev=70.85, samples=76 iops : min= 1, max= 21, avg= 8.82, stdev= 4.49, samples=76 lat (usec) : 50=0.39%, 100=4.56%, 250=1.17%, 500=0.13% lat (msec) : 2=2.47%, 4=3.65%, 10=8.33%, 20=7.16%, 50=30.21% lat (msec) : 100=30.99%, 250=10.29%, 500=0.65% cpu : usr=0.06%, sys=4.69%, ctx=1663, majf=0, minf=19 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178320: Thu Sep 10 04:29:13 2026 read: IOPS=10, BW=161KiB/s (165kB/s)(6032KiB/37481msec) clat (usec): min=44, max=250171, avg=54386.37, stdev=40467.12 lat (usec): min=46, max=250172, avg=54389.03, stdev=40465.52 clat percentiles (usec): | 1.00th=[ 52], 5.00th=[ 64], 10.00th=[ 83], 20.00th=[ 23987], | 30.00th=[ 35914], 40.00th=[ 42730], 50.00th=[ 49546], 60.00th=[ 56361], | 70.00th=[ 66847], 80.00th=[ 81265], 90.00th=[103285], 95.00th=[131597], | 99.00th=[187696], 99.50th=[244319], 99.90th=[250610], 99.95th=[250610], | 99.99th=[250610] bw ( KiB/s): min= 31, max= 347, per=26.03%, avg=159.30, stdev=75.94, samples=73 iops : min= 1, max= 21, avg= 9.19, stdev= 4.86, samples=73 write: IOPS=10, BW=167KiB/s (171kB/s)(6256KiB/37481msec); 0 zone resets clat (usec): min=1369, max=363529, avg=43195.69, stdev=43499.49 lat (usec): min=1371, max=363533, avg=43205.00, stdev=43493.48 clat percentiles (usec): | 1.00th=[ 1549], 5.00th=[ 2573], 10.00th=[ 4359], 20.00th=[ 7308], | 30.00th=[ 10945], 40.00th=[ 20841], 50.00th=[ 31851], 60.00th=[ 44827], | 70.00th=[ 55313], 80.00th=[ 74974], 90.00th=[ 96994], 95.00th=[117965], | 99.00th=[173016], 99.50th=[267387], 99.90th=[362808], 99.95th=[362808], | 99.99th=[362808] bw ( KiB/s): min= 30, max= 410, per=25.83%, avg=166.11, stdev=73.61, samples=73 iops : min= 1, max= 25, avg= 9.63, stdev= 4.61, samples=73 lat (usec) : 50=0.26%, 100=5.34%, 250=1.04%, 500=0.13% lat (msec) : 2=2.21%, 4=3.12%, 10=9.64%, 20=6.51%, 50=29.95% lat (msec) : 100=32.16%, 250=9.24%, 500=0.39% cpu : usr=0.07%, sys=5.07%, ctx=1641, majf=0, minf=20 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=612KiB/s (627kB/s), 151KiB/s-161KiB/s (155kB/s-165kB/s), io=23.4MiB (24.5MB), run=37481-39136msec WRITE: bw=644KiB/s (659kB/s), 155KiB/s-174KiB/s (159kB/s-178kB/s), io=24.6MiB (25.8MB), run=37481-39136msec fio: pid=178323, err=5/file:backend.c:481, func=full resid, error=Input/output error fio: pid=178322, err=5/file:backend.c:481, func=full resid, error=Input/output error rand-rw: (groupid=0, jobs=1): err= 5 (file:backend.c:481, func=full resid, error=Input/output error): pid=178322: Thu Sep 10 04:29:24 2026 read: IOPS=7, BW=114KiB/s (117kB/s)(5536KiB/48448msec) clat (msec): min=8, max=707, avg=54.66, stdev=59.70 lat (msec): min=8, max=707, avg=54.66, stdev=59.70 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 13], 10.00th=[ 15], 20.00th=[ 19], | 30.00th=[ 23], 40.00th=[ 28], 50.00th=[ 35], 60.00th=[ 44], | 70.00th=[ 56], 80.00th=[ 80], 90.00th=[ 134], 95.00th=[ 171], | 99.00th=[ 226], 99.50th=[ 262], 99.90th=[ 709], 99.95th=[ 709], | 99.99th=[ 709] bw ( KiB/s): min= 30, max= 480, per=27.05%, avg=114.97, stdev=86.34, samples=94 iops : min= 1, max= 30, avg= 6.40, stdev= 5.48, samples=94 write: IOPS=7, BW=123KiB/s (126kB/s)(5952KiB/48448msec); 0 zone resets clat (msec): min=14, max=534, avg=78.99, stdev=59.46 lat (msec): min=14, max=534, avg=78.99, stdev=59.46 clat percentiles (msec): | 1.00th=[ 19], 5.00th=[ 24], 10.00th=[ 28], 20.00th=[ 34], | 30.00th=[ 42], 40.00th=[ 48], 50.00th=[ 59], 60.00th=[ 75], | 70.00th=[ 93], 80.00th=[ 120], 90.00th=[ 155], 95.00th=[ 186], | 99.00th=[ 271], 99.50th=[ 393], 99.90th=[ 535], 99.95th=[ 535], | 99.99th=[ 535] bw ( KiB/s): min= 26, max= 415, per=28.64%, avg=127.15, stdev=84.76, samples=92 iops : min= 1, max= 25, avg= 7.16, stdev= 5.37, samples=92 lat (msec) : 10=1.11%, 20=11.68%, 50=41.03%, 100=25.73%, 250=19.19% lat (msec) : 500=0.83%, 750=0.28% cpu : usr=0.06%, sys=1.47%, ctx=1094, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=347,372,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 5 (file:backend.c:481, func=full resid, error=Input/output error): pid=178323: Thu Sep 10 04:29:24 2026 read: IOPS=5, BW=86.4KiB/s (88.5kB/s)(3712KiB/42945msec) clat (msec): min=8, max=297, avg=70.09, stdev=53.07 lat (msec): min=8, max=297, avg=70.10, stdev=53.06 clat percentiles (msec): | 1.00th=[ 12], 5.00th=[ 19], 10.00th=[ 24], 20.00th=[ 28], | 30.00th=[ 34], 40.00th=[ 42], 50.00th=[ 53], 60.00th=[ 65], | 70.00th=[ 86], 80.00th=[ 117], 90.00th=[ 136], 95.00th=[ 169], | 99.00th=[ 253], 99.50th=[ 259], 99.90th=[ 296], 99.95th=[ 296], | 99.99th=[ 296] bw ( KiB/s): min= 27, max= 254, per=21.58%, avg=91.72, stdev=55.11, samples=79 iops : min= 1, max= 15, avg= 4.92, stdev= 3.48, samples=79 write: IOPS=6, BW=99.1KiB/s (101kB/s)(4256KiB/42945msec); 0 zone resets clat (msec): min=24, max=373, avg=98.87, stdev=54.73 lat (msec): min=24, max=373, avg=98.88, stdev=54.73 clat percentiles (msec): | 1.00th=[ 26], 5.00th=[ 36], 10.00th=[ 42], 20.00th=[ 52], | 30.00th=[ 63], 40.00th=[ 72], 50.00th=[ 84], 60.00th=[ 101], | 70.00th=[ 123], 80.00th=[ 144], 90.00th=[ 176], 95.00th=[ 197], | 99.00th=[ 271], 99.50th=[ 309], 99.90th=[ 372], 99.95th=[ 372], | 99.99th=[ 372] bw ( KiB/s): min= 26, max= 288, per=22.69%, avg=100.76, stdev=50.74, samples=82 iops : min= 1, max= 18, avg= 5.49, stdev= 3.23, samples=82 lat (msec) : 10=0.40%, 20=2.40%, 50=28.66%, 100=35.47%, 250=31.46% lat (msec) : 500=1.40% cpu : usr=0.04%, sys=1.17%, ctx=660, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=233,266,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178324: Thu Sep 10 04:29:24 2026 read: IOPS=7, BW=124KiB/s (127kB/s)(6256KiB/50628msec) clat (msec): min=7, max=245, avg=53.91, stdev=50.66 lat (msec): min=7, max=245, avg=53.91, stdev=50.66 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 18], | 30.00th=[ 21], 40.00th=[ 26], 50.00th=[ 32], 60.00th=[ 43], | 70.00th=[ 63], 80.00th=[ 89], 90.00th=[ 129], 95.00th=[ 180], | 99.00th=[ 226], 99.50th=[ 232], 99.90th=[ 247], 99.95th=[ 247], | 99.99th=[ 247] bw ( KiB/s): min= 31, max= 506, per=29.95%, avg=127.28, stdev=108.01, samples=96 iops : min= 1, max= 31, avg= 7.18, stdev= 6.81, samples=96 write: IOPS=7, BW=119KiB/s (122kB/s)(6032KiB/50628msec); 0 zone resets clat (msec): min=15, max=562, avg=77.31, stdev=62.97 lat (msec): min=15, max=562, avg=77.31, stdev=62.97 clat percentiles (msec): | 1.00th=[ 20], 5.00th=[ 23], 10.00th=[ 26], 20.00th=[ 32], | 30.00th=[ 40], 40.00th=[ 45], 50.00th=[ 55], 60.00th=[ 73], | 70.00th=[ 89], 80.00th=[ 113], 90.00th=[ 155], 95.00th=[ 194], | 99.00th=[ 296], 99.50th=[ 376], 99.90th=[ 567], 99.95th=[ 567], | 99.99th=[ 567] bw ( KiB/s): min= 27, max= 416, per=27.75%, avg=123.21, stdev=86.31, samples=94 iops : min= 1, max= 26, avg= 6.91, stdev= 5.52, samples=94 lat (msec) : 10=1.30%, 20=14.45%, 50=39.19%, 100=25.26%, 250=18.75% lat (msec) : 500=0.91%, 750=0.13% cpu : usr=0.03%, sys=1.58%, ctx=1322, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178325: Thu Sep 10 04:29:24 2026 read: IOPS=7, BW=121KiB/s (124kB/s)(6032KiB/49908msec) clat (msec): min=7, max=724, avg=54.91, stdev=65.80 lat (msec): min=7, max=724, avg=54.92, stdev=65.80 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 15], 20.00th=[ 19], | 30.00th=[ 23], 40.00th=[ 27], 50.00th=[ 34], 60.00th=[ 41], | 70.00th=[ 54], 80.00th=[ 75], 90.00th=[ 125], 95.00th=[ 169], | 99.00th=[ 268], 99.50th=[ 567], 99.90th=[ 726], 99.95th=[ 726], | 99.99th=[ 726] bw ( KiB/s): min= 26, max= 411, per=29.59%, avg=125.76, stdev=89.14, samples=94 iops : min= 1, max= 25, avg= 7.06, stdev= 5.63, samples=94 write: IOPS=7, BW=125KiB/s (128kB/s)(6256KiB/49908msec); 0 zone resets clat (msec): min=15, max=396, avg=73.65, stdev=54.58 lat (msec): min=15, max=396, avg=73.67, stdev=54.57 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 24], 10.00th=[ 29], 20.00th=[ 34], | 30.00th=[ 41], 40.00th=[ 46], 50.00th=[ 56], 60.00th=[ 65], | 70.00th=[ 82], 80.00th=[ 111], 90.00th=[ 146], 95.00th=[ 197], | 99.00th=[ 259], 99.50th=[ 292], 99.90th=[ 397], 99.95th=[ 397], | 99.99th=[ 397] bw ( KiB/s): min= 30, max= 379, per=28.56%, avg=126.82, stdev=88.08, samples=97 iops : min= 1, max= 23, avg= 7.15, stdev= 5.57, samples=97 lat (msec) : 10=1.82%, 20=11.98%, 50=41.80%, 100=26.30%, 250=16.93% lat (msec) : 500=0.91%, 750=0.26% cpu : usr=0.05%, sys=1.49%, ctx=1205, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=425KiB/s (436kB/s), 86.4KiB/s-124KiB/s (88.5kB/s-127kB/s), io=21.0MiB (22.1MB), run=42945-50628msec WRITE: bw=444KiB/s (455kB/s), 99.1KiB/s-125KiB/s (101kB/s-128kB/s), io=21.0MiB (23.0MB), run=42945-50628msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: Laying out IO file (1 file / 12MiB) fio: file creation disallowed by allow_file_create=0 rand-rw: Laying out IO file (1 file / 12MiB) fio: file creation disallowed by allow_file_create=0 rand-rw: Laying out IO file (1 file / 12MiB) fio: file creation disallowed by allow_file_create=0 rand-rw: Laying out IO file (1 file / 12MiB) fio: file creation disallowed by allow_file_create=0 Run status group 0 (all jobs): rand-rw: (groupid=0, jobs=1): err= 0: pid=178339: Thu Sep 10 04:29:39 2026 read: IOPS=4, BW=4661KiB/s (4772kB/s)(7168KiB/1538msec) clat (msec): min=78, max=139, avg=102.86, stdev=18.56 lat (msec): min=78, max=139, avg=102.86, stdev=18.56 clat percentiles (msec): | 1.00th=[ 79], 5.00th=[ 79], 10.00th=[ 79], 20.00th=[ 93], | 30.00th=[ 100], 40.00th=[ 100], 50.00th=[ 101], 60.00th=[ 105], | 70.00th=[ 105], 80.00th=[ 106], 90.00th=[ 140], 95.00th=[ 140], | 99.00th=[ 140], 99.50th=[ 140], 99.90th=[ 140], 99.95th=[ 140], | 99.99th=[ 140] bw ( KiB/s): min= 2027, max= 5953, per=39.51%, avg=3990.00, stdev=2776.10, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 write: IOPS=3, BW=3329KiB/s (3409kB/s)(5120KiB/1538msec); 0 zone resets clat (msec): min=130, max=184, avg=154.74, stdev=20.71 lat (msec): min=131, max=184, avg=155.08, stdev=20.36 clat percentiles (msec): | 1.00th=[ 131], 5.00th=[ 131], 10.00th=[ 131], 20.00th=[ 131], | 30.00th=[ 146], 40.00th=[ 146], 50.00th=[ 148], 60.00th=[ 148], | 70.00th=[ 167], 80.00th=[ 167], 90.00th=[ 184], 95.00th=[ 184], | 99.00th=[ 184], 99.50th=[ 184], 99.90th=[ 184], 99.95th=[ 184], | 99.99th=[ 184] bw ( KiB/s): min= 1488, max= 6083, per=26.78%, avg=3785.50, stdev=3249.16, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 lat (msec) : 100=33.33%, 250=66.67% cpu : usr=0.13%, sys=6.90%, ctx=37, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178340: Thu Sep 10 04:29:39 2026 read: IOPS=1, BW=1130KiB/s (1157kB/s)(2048KiB/1813msec) clat (msec): min=78, max=109, avg=94.14, stdev=21.76 lat (msec): min=78, max=109, avg=94.14, stdev=21.76 clat percentiles (msec): | 1.00th=[ 80], 5.00th=[ 80], 10.00th=[ 80], 20.00th=[ 80], | 30.00th=[ 80], 40.00th=[ 80], 50.00th=[ 80], 60.00th=[ 110], | 70.00th=[ 110], 80.00th=[ 110], 90.00th=[ 110], 95.00th=[ 110], | 99.00th=[ 110], 99.50th=[ 110], 99.90th=[ 110], 99.95th=[ 110], | 99.99th=[ 110] bw ( KiB/s): min= 1526, max= 2027, per=17.59%, avg=1776.50, stdev=354.26, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=5, BW=5648KiB/s (5784kB/s)(10.0MiB/1813msec); 0 zone resets clat (msec): min=91, max=265, avg=141.53, stdev=55.67 lat (msec): min=91, max=265, avg=141.91, stdev=55.56 clat percentiles (msec): | 1.00th=[ 91], 5.00th=[ 91], 10.00th=[ 91], 20.00th=[ 103], | 30.00th=[ 111], 40.00th=[ 122], 50.00th=[ 123], 60.00th=[ 124], | 70.00th=[ 131], 80.00th=[ 131], 90.00th=[ 220], 95.00th=[ 266], | 99.00th=[ 266], 99.50th=[ 266], 99.90th=[ 266], 99.95th=[ 266], | 99.99th=[ 266] bw ( KiB/s): min= 3052, max= 6083, per=35.68%, avg=5045.00, stdev=1726.49, samples=3 iops : min= 2, max= 5, avg= 4.00, stdev= 1.73, samples=3 lat (msec) : 100=16.67%, 250=75.00%, 500=8.33% cpu : usr=0.00%, sys=5.68%, ctx=50, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178341: Thu Sep 10 04:29:39 2026 read: IOPS=3, BW=3644KiB/s (3732kB/s)(6144KiB/1686msec) clat (msec): min=64, max=130, avg=107.25, stdev=25.79 lat (msec): min=64, max=130, avg=107.25, stdev=25.79 clat percentiles (msec): | 1.00th=[ 65], 5.00th=[ 65], 10.00th=[ 65], 20.00th=[ 90], | 30.00th=[ 90], 40.00th=[ 109], 50.00th=[ 109], 60.00th=[ 118], | 70.00th=[ 131], 80.00th=[ 131], 90.00th=[ 131], 95.00th=[ 131], | 99.00th=[ 131], 99.50th=[ 131], 99.90th=[ 131], 99.95th=[ 131], | 99.99th=[ 131] bw ( KiB/s): min= 6083, max= 6083, per=60.24%, avg=6083.00, stdev= 0.00, samples=1 iops : min= 5, max= 5, avg= 5.00, stdev= 0.00, samples=1 write: IOPS=3, BW=3644KiB/s (3732kB/s)(6144KiB/1686msec); 0 zone resets clat (msec): min=101, max=225, avg=142.32, stdev=55.16 lat (msec): min=101, max=225, avg=142.42, stdev=55.17 clat percentiles (msec): | 1.00th=[ 102], 5.00th=[ 102], 10.00th=[ 102], 20.00th=[ 105], | 30.00th=[ 105], 40.00th=[ 112], 50.00th=[ 112], 60.00th=[ 113], | 70.00th=[ 201], 80.00th=[ 201], 90.00th=[ 226], 95.00th=[ 226], | 99.00th=[ 226], 99.50th=[ 226], 99.90th=[ 226], 99.95th=[ 226], | 99.99th=[ 226] bw ( KiB/s): min= 2976, max= 4055, per=24.87%, avg=3515.50, stdev=762.97, samples=2 iops : min= 2, max= 3, avg= 2.50, stdev= 0.71, samples=2 lat (msec) : 100=16.67%, 250=83.33% cpu : usr=0.06%, sys=6.65%, ctx=59, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178342: Thu Sep 10 04:29:39 2026 read: IOPS=2, BW=2525KiB/s (2585kB/s)(5120KiB/2028msec) clat (msec): min=99, max=201, avg=150.21, stdev=40.43 lat (msec): min=99, max=201, avg=150.21, stdev=40.43 clat percentiles (msec): | 1.00th=[ 101], 5.00th=[ 101], 10.00th=[ 101], 20.00th=[ 101], | 30.00th=[ 122], 40.00th=[ 122], 50.00th=[ 157], 60.00th=[ 157], | 70.00th=[ 171], 80.00th=[ 171], 90.00th=[ 203], 95.00th=[ 203], | 99.00th=[ 203], 99.50th=[ 203], 99.90th=[ 203], 99.95th=[ 203], | 99.99th=[ 203] bw ( KiB/s): min= 2000, max= 6083, per=40.02%, avg=4041.50, stdev=2887.12, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 write: IOPS=3, BW=3535KiB/s (3619kB/s)(7168KiB/2028msec); 0 zone resets clat (msec): min=90, max=236, avg=153.34, stdev=50.94 lat (msec): min=90, max=236, avg=153.48, stdev=50.87 clat percentiles (msec): | 1.00th=[ 91], 5.00th=[ 91], 10.00th=[ 91], 20.00th=[ 118], | 30.00th=[ 121], 40.00th=[ 121], 50.00th=[ 138], 60.00th=[ 184], | 70.00th=[ 184], 80.00th=[ 188], 90.00th=[ 236], 95.00th=[ 236], | 99.00th=[ 236], 99.50th=[ 236], 99.90th=[ 236], 99.95th=[ 236], | 99.99th=[ 236] bw ( KiB/s): min= 2000, max= 4704, per=20.59%, avg=2910.33, stdev=1553.42, samples=3 iops : min= 1, max= 4, avg= 2.00, stdev= 1.73, samples=3 lat (msec) : 100=16.67%, 250=83.33% cpu : usr=0.00%, sys=5.82%, ctx=72, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=9.86MiB/s (10.3MB/s), 1130KiB/s-4661KiB/s (1157kB/s-4772kB/s), io=20.0MiB (20.0MB), run=1538-2028msec WRITE: bw=13.8MiB/s (14.5MB/s), 3329KiB/s-5648KiB/s (3409kB/s-5784kB/s), io=28.0MiB (29.4MB), run=1538-2028msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: Laying out IO file (1 file / 12MiB) fio: file creation disallowed by allow_file_create=0 rand-rw: Laying out IO file (1 file / 12MiB) fio: file creation disallowed by allow_file_create=0 rand-rw: Laying out IO file (1 file / 12MiB) fio: file creation disallowed by allow_file_create=0 rand-rw: Laying out IO file (1 file / 12MiB) fio: file creation disallowed by allow_file_create=0 Run status group 0 (all jobs): rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: Laying out IO file (1 file / 12MiB) fio: file creation disallowed by allow_file_create=0 rand-rw: Laying out IO file (1 file / 12MiB) fio: file creation disallowed by allow_file_create=0 rand-rw: Laying out IO file (1 file / 12MiB) fio: file creation disallowed by allow_file_create=0 rand-rw: Laying out IO file (1 file / 12MiB) fio: file creation disallowed by allow_file_create=0 Run status group 0 (all jobs):