== sanity test 398b: DIO and buffer IO race ============== 01:38:46 (1788932326) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 7.08673 s, 7.1 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144692: Wed Sep 9 01:41:25 2026 read: IOPS=11, BW=44.0KiB/s (45.1kB/s)(5992KiB/136155msec) clat (usec): min=31, max=753714, avg=43967.98, stdev=39535.55 lat (usec): min=31, max=753716, avg=43969.30, stdev=39535.54 clat percentiles (usec): | 1.00th=[ 46], 5.00th=[ 59], 10.00th=[ 79], 20.00th=[ 19530], | 30.00th=[ 24773], 40.00th=[ 30278], 50.00th=[ 36439], 60.00th=[ 45351], | 70.00th=[ 53216], 80.00th=[ 65274], 90.00th=[ 84411], 95.00th=[102237], | 99.00th=[166724], 99.50th=[189793], 99.90th=[421528], 99.95th=[750781], | 99.99th=[750781] bw ( KiB/s): min= 7, max= 101, per=25.42%, avg=43.98, stdev=19.92, samples=265 iops : min= 1, max= 25, avg=10.36, stdev= 5.01, samples=265 write: IOPS=11, BW=46.2KiB/s (47.4kB/s)(6296KiB/136155msec); 0 zone resets clat (usec): min=947, max=431840, avg=44246.14, stdev=47379.07 lat (usec): min=947, max=431842, avg=44251.08, stdev=47377.49 clat percentiles (usec): | 1.00th=[ 1057], 5.00th=[ 1205], 10.00th=[ 1631], 20.00th=[ 4293], | 30.00th=[ 8717], 40.00th=[ 20055], 50.00th=[ 32113], 60.00th=[ 43779], | 70.00th=[ 58459], 80.00th=[ 76022], 90.00th=[103285], 95.00th=[131597], | 99.00th=[193987], 99.50th=[240124], 99.90th=[408945], 99.95th=[429917], | 99.99th=[429917] bw ( KiB/s): min= 7, max= 112, per=25.39%, avg=46.21, stdev=19.57, samples=265 iops : min= 1, max= 28, avg=10.91, stdev= 4.93, samples=265 lat (usec) : 50=0.81%, 100=4.30%, 250=0.29%, 500=0.13%, 1000=0.26% lat (msec) : 2=6.25%, 4=3.58%, 10=6.61%, 20=8.53%, 50=34.31% lat (msec) : 100=26.82%, 250=7.78%, 500=0.29%, 1000=0.03% cpu : usr=0.08%, sys=5.09%, ctx=6448, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144693: Wed Sep 9 01:41:25 2026 read: IOPS=10, BW=43.0KiB/s (44.0kB/s)(5940KiB/138090msec) clat (usec): min=29, max=637464, avg=42909.53, stdev=37890.11 lat (usec): min=30, max=637466, avg=42911.40, stdev=37890.19 clat percentiles (usec): | 1.00th=[ 49], 5.00th=[ 59], 10.00th=[ 98], 20.00th=[ 17957], | 30.00th=[ 24249], 40.00th=[ 29230], 50.00th=[ 35390], 60.00th=[ 43254], | 70.00th=[ 52167], 80.00th=[ 64750], 90.00th=[ 82314], 95.00th=[101188], | 99.00th=[181404], 99.50th=[208667], 99.90th=[295699], 99.95th=[633340], | 99.99th=[633340] bw ( KiB/s): min= 5, max= 103, per=24.91%, avg=43.10, stdev=19.73, samples=268 iops : min= 1, max= 25, avg=10.14, stdev= 4.96, samples=268 write: IOPS=11, BW=45.0KiB/s (47.1kB/s)(6348KiB/138090msec); 0 zone resets clat (usec): min=936, max=1079.0k, avg=46517.76, stdev=53989.06 lat (usec): min=937, max=1079.0k, avg=46521.37, stdev=53992.71 clat percentiles (usec): | 1.00th=[ 1057], 5.00th=[ 1205], 10.00th=[ 1418], | 20.00th=[ 3654], 30.00th=[ 8455], 40.00th=[ 20055], | 50.00th=[ 33162], 60.00th=[ 46924], 70.00th=[ 61604], | 80.00th=[ 81265], 90.00th=[ 114820], 95.00th=[ 137364], | 99.00th=[ 191890], 99.50th=[ 221250], 99.90th=[ 367002], | 99.95th=[1082131], 99.99th=[1082131] bw ( KiB/s): min= 7, max= 135, per=25.15%, avg=45.78, stdev=20.61, samples=269 iops : min= 1, max= 33, avg=10.81, stdev= 5.17, samples=269 lat (usec) : 50=0.59%, 100=4.30%, 250=0.81%, 500=0.10%, 750=0.16% lat (usec) : 1000=0.23% lat (msec) : 2=6.87%, 4=3.87%, 10=6.05%, 20=8.69%, 50=33.37% lat (msec) : 100=25.23%, 250=9.44%, 500=0.23%, 750=0.03%, 2000=0.03% cpu : usr=0.07%, sys=5.01%, ctx=6500, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144694: Wed Sep 9 01:41:25 2026 read: IOPS=11, BW=44.1KiB/s (45.2kB/s)(6028KiB/136606msec) clat (usec): min=30, max=1159.3k, avg=42575.42, stdev=43684.93 lat (usec): min=30, max=1159.3k, avg=42578.17, stdev=43685.67 clat percentiles (usec): | 1.00th=[ 48], 5.00th=[ 60], 10.00th=[ 123], | 20.00th=[ 19006], 30.00th=[ 25035], 40.00th=[ 30278], | 50.00th=[ 35914], 60.00th=[ 42730], 70.00th=[ 51643], | 80.00th=[ 63701], 90.00th=[ 80217], 95.00th=[ 93848], | 99.00th=[ 141558], 99.50th=[ 191890], 99.90th=[ 371196], | 99.95th=[1166017], 99.99th=[1166017] bw ( KiB/s): min= 7, max= 102, per=25.64%, avg=44.36, stdev=19.70, samples=265 iops : min= 1, max= 25, avg=10.45, stdev= 4.96, samples=265 write: IOPS=11, BW=45.8KiB/s (46.9kB/s)(6260KiB/136606msec); 0 zone resets clat (usec): min=888, max=432620, avg=45958.66, stdev=48254.72 lat (usec): min=889, max=432622, avg=45960.97, stdev=48254.52 clat percentiles (usec): | 1.00th=[ 1057], 5.00th=[ 1205], 10.00th=[ 1713], 20.00th=[ 4817], | 30.00th=[ 10028], 40.00th=[ 20841], 50.00th=[ 32637], 60.00th=[ 44827], | 70.00th=[ 60556], 80.00th=[ 81265], 90.00th=[108528], 95.00th=[135267], | 99.00th=[202376], 99.50th=[244319], 99.90th=[337642], 99.95th=[434111], | 99.99th=[434111] bw ( KiB/s): min= 7, max= 110, per=25.27%, avg=45.99, stdev=20.05, samples=265 iops : min= 1, max= 27, avg=10.87, stdev= 5.05, samples=265 lat (usec) : 50=0.62%, 100=4.04%, 250=0.65%, 500=0.16%, 750=0.16% lat (usec) : 1000=0.26% lat (msec) : 2=5.60%, 4=3.78%, 10=6.12%, 20=9.02%, 50=35.51% lat (msec) : 100=25.78%, 250=7.94%, 500=0.33%, 2000=0.03% cpu : usr=0.07%, sys=5.05%, ctx=6439, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144695: Wed Sep 9 01:41:25 2026 read: IOPS=11, BW=44.0KiB/s (46.1kB/s)(6052KiB/134553msec) clat (usec): min=33, max=1123.6k, avg=43790.00, stdev=44111.39 lat (usec): min=34, max=1123.6k, avg=43793.36, stdev=44112.18 clat percentiles (usec): | 1.00th=[ 48], 5.00th=[ 59], 10.00th=[ 117], | 20.00th=[ 18482], 30.00th=[ 24773], 40.00th=[ 30278], | 50.00th=[ 35914], 60.00th=[ 43779], 70.00th=[ 52691], | 80.00th=[ 65274], 90.00th=[ 83362], 95.00th=[ 102237], | 99.00th=[ 170918], 99.50th=[ 223347], 99.90th=[ 299893], | 99.95th=[1115685], 99.99th=[1115685] bw ( KiB/s): min= 7, max= 103, per=26.50%, avg=45.84, stdev=19.37, samples=257 iops : min= 1, max= 25, avg=10.83, stdev= 4.88, samples=257 write: IOPS=11, BW=46.3KiB/s (47.5kB/s)(6236KiB/134553msec); 0 zone resets clat (usec): min=948, max=593753, avg=43492.67, stdev=47888.29 lat (usec): min=949, max=593754, avg=43496.02, stdev=47890.60 clat percentiles (usec): | 1.00th=[ 1020], 5.00th=[ 1172], 10.00th=[ 1303], 20.00th=[ 3294], | 30.00th=[ 7898], 40.00th=[ 17171], 50.00th=[ 31851], 60.00th=[ 43254], | 70.00th=[ 58983], 80.00th=[ 76022], 90.00th=[104334], 95.00th=[127402], | 99.00th=[198181], 99.50th=[229639], 99.90th=[434111], 99.95th=[591397], | 99.99th=[591397] bw ( KiB/s): min= 7, max= 110, per=25.40%, avg=46.23, stdev=18.99, samples=262 iops : min= 1, max= 27, avg=10.92, stdev= 4.80, samples=262 lat (usec) : 50=0.81%, 100=3.91%, 250=0.62%, 500=0.10%, 750=0.10% lat (usec) : 1000=0.20% lat (msec) : 2=7.52%, 4=3.45%, 10=5.79%, 20=10.06%, 50=33.59% lat (msec) : 100=25.42%, 250=8.11%, 500=0.26%, 750=0.03%, 2000=0.03% cpu : usr=0.07%, sys=4.93%, ctx=6323, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=174KiB/s (178kB/s), 43.0KiB/s-44.0KiB/s (44.0kB/s-46.1kB/s), io=23.4MiB (24.6MB), run=134553-138090msec WRITE: bw=182KiB/s (186kB/s), 45.8KiB/s-46.3KiB/s (46.9kB/s-47.5kB/s), io=24.6MiB (25.7MB), run=134553-138090msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144696: Wed Sep 9 01:43:45 2026 read: IOPS=5, BW=21.7KiB/s (22.2kB/s)(5992KiB/276280msec) clat (msec): min=4, max=828, avg=35.25, stdev=43.45 lat (msec): min=4, max=828, avg=35.26, stdev=43.45 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 10], 10.00th=[ 11], 20.00th=[ 14], | 30.00th=[ 16], 40.00th=[ 18], 50.00th=[ 21], 60.00th=[ 26], | 70.00th=[ 32], 80.00th=[ 46], 90.00th=[ 83], 95.00th=[ 112], | 99.00th=[ 188], 99.50th=[ 209], 99.90th=[ 489], 99.95th=[ 827], | 99.99th=[ 827] bw ( KiB/s): min= 7, max= 87, per=29.29%, avg=25.19, stdev=16.35, samples=459 iops : min= 1, max= 21, avg= 5.68, stdev= 4.14, samples=459 write: IOPS=5, BW=22.8KiB/s (23.3kB/s)(6296KiB/276280msec); 0 zone resets clat (msec): min=38, max=562, avg=141.71, stdev=73.62 lat (msec): min=38, max=562, avg=141.71, stdev=73.62 clat percentiles (msec): | 1.00th=[ 51], 5.00th=[ 65], 10.00th=[ 73], 20.00th=[ 85], | 30.00th=[ 96], 40.00th=[ 107], 50.00th=[ 120], 60.00th=[ 136], | 70.00th=[ 159], 80.00th=[ 192], 90.00th=[ 245], 95.00th=[ 284], | 99.00th=[ 401], 99.50th=[ 451], 99.90th=[ 558], 99.95th=[ 567], | 99.99th=[ 567] bw ( KiB/s): min= 6, max= 56, per=25.12%, avg=22.61, stdev=11.11, samples=535 iops : min= 1, max= 14, avg= 5.02, stdev= 2.85, samples=535 lat (msec) : 10=3.78%, 20=19.27%, 50=17.25%, 100=22.92%, 250=32.06% lat (msec) : 500=4.62%, 750=0.07%, 1000=0.03% cpu : usr=0.04%, sys=1.06%, ctx=5264, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144697: Wed Sep 9 01:43:45 2026 read: IOPS=5, BW=21.3KiB/s (21.9kB/s)(5940KiB/278353msec) clat (msec): min=5, max=1216, avg=35.00, stdev=46.30 lat (msec): min=5, max=1216, avg=35.01, stdev=46.30 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 14], | 30.00th=[ 16], 40.00th=[ 19], 50.00th=[ 22], 60.00th=[ 26], | 70.00th=[ 32], 80.00th=[ 46], 90.00th=[ 79], 95.00th=[ 113], | 99.00th=[ 171], 99.50th=[ 201], 99.90th=[ 300], 99.95th=[ 1217], | 99.99th=[ 1217] bw ( KiB/s): min= 7, max= 95, per=29.37%, avg=25.26, stdev=16.69, samples=455 iops : min= 1, max= 23, avg= 5.70, stdev= 4.21, samples=455 write: IOPS=5, BW=22.8KiB/s (23.4kB/s)(6348KiB/278353msec); 0 zone resets clat (msec): min=37, max=680, avg=142.40, stdev=75.09 lat (msec): min=37, max=680, avg=142.40, stdev=75.09 clat percentiles (msec): | 1.00th=[ 50], 5.00th=[ 63], 10.00th=[ 73], 20.00th=[ 86], | 30.00th=[ 96], 40.00th=[ 108], 50.00th=[ 120], 60.00th=[ 134], | 70.00th=[ 157], 80.00th=[ 197], 90.00th=[ 253], 95.00th=[ 296], | 99.00th=[ 393], 99.50th=[ 435], 99.90th=[ 617], 99.95th=[ 684], | 99.99th=[ 684] bw ( KiB/s): min= 7, max= 56, per=25.02%, avg=22.52, stdev=11.03, samples=543 iops : min= 1, max= 14, avg= 5.01, stdev= 2.84, samples=543 lat (msec) : 10=3.06%, 20=19.34%, 50=17.68%, 100=22.27%, 250=32.36% lat (msec) : 500=5.18%, 750=0.10%, 2000=0.03% cpu : usr=0.04%, sys=1.06%, ctx=5241, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144698: Wed Sep 9 01:43:45 2026 read: IOPS=5, BW=21.7KiB/s (22.2kB/s)(6028KiB/278347msec) clat (msec): min=5, max=543, avg=37.17, stdev=42.57 lat (msec): min=5, max=543, avg=37.18, stdev=42.57 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 11], 20.00th=[ 14], | 30.00th=[ 16], 40.00th=[ 19], 50.00th=[ 22], 60.00th=[ 27], | 70.00th=[ 34], 80.00th=[ 53], 90.00th=[ 89], 95.00th=[ 120], | 99.00th=[ 190], 99.50th=[ 234], 99.90th=[ 493], 99.95th=[ 542], | 99.99th=[ 542] bw ( KiB/s): min= 6, max= 111, per=28.38%, avg=24.41, stdev=17.01, samples=477 iops : min= 1, max= 27, avg= 5.48, stdev= 4.29, samples=477 write: IOPS=5, BW=22.5KiB/s (23.0kB/s)(6260KiB/278347msec); 0 zone resets clat (msec): min=34, max=1411, avg=141.83, stdev=80.18 lat (msec): min=34, max=1411, avg=141.83, stdev=80.18 clat percentiles (msec): | 1.00th=[ 52], 5.00th=[ 64], 10.00th=[ 73], 20.00th=[ 86], | 30.00th=[ 96], 40.00th=[ 107], 50.00th=[ 121], 60.00th=[ 134], | 70.00th=[ 159], 80.00th=[ 188], 90.00th=[ 245], 95.00th=[ 292], | 99.00th=[ 393], 99.50th=[ 443], 99.90th=[ 634], 99.95th=[ 1418], | 99.99th=[ 1418] bw ( KiB/s): min= 7, max= 55, per=25.18%, avg=22.67, stdev=11.23, samples=532 iops : min= 1, max= 13, avg= 5.04, stdev= 2.89, samples=532 lat (msec) : 10=3.97%, 20=18.03%, 50=17.22%, 100=23.73%, 250=32.16% lat (msec) : 500=4.69%, 750=0.16%, 2000=0.03% cpu : usr=0.05%, sys=1.14%, ctx=5194, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144699: Wed Sep 9 01:43:45 2026 read: IOPS=5, BW=22.0KiB/s (22.5kB/s)(6052KiB/274924msec) clat (msec): min=3, max=434, avg=34.98, stdev=39.84 lat (msec): min=3, max=434, avg=34.98, stdev=39.84 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 11], 20.00th=[ 14], | 30.00th=[ 16], 40.00th=[ 18], 50.00th=[ 22], 60.00th=[ 26], | 70.00th=[ 33], 80.00th=[ 47], 90.00th=[ 80], 95.00th=[ 110], | 99.00th=[ 209], 99.50th=[ 249], 99.90th=[ 397], 99.95th=[ 435], | 99.99th=[ 435] bw ( KiB/s): min= 7, max= 103, per=29.71%, avg=25.55, stdev=17.95, samples=458 iops : min= 1, max= 25, avg= 5.76, stdev= 4.55, samples=458 write: IOPS=5, BW=22.7KiB/s (23.2kB/s)(6236KiB/274924msec); 0 zone resets clat (msec): min=35, max=1231, avg=142.06, stdev=80.26 lat (msec): min=35, max=1231, avg=142.07, stdev=80.26 clat percentiles (msec): | 1.00th=[ 48], 5.00th=[ 64], 10.00th=[ 72], 20.00th=[ 84], | 30.00th=[ 95], 40.00th=[ 107], 50.00th=[ 121], 60.00th=[ 136], | 70.00th=[ 159], 80.00th=[ 192], 90.00th=[ 245], 95.00th=[ 288], | 99.00th=[ 384], 99.50th=[ 451], 99.90th=[ 726], 99.95th=[ 1234], | 99.99th=[ 1234] bw ( KiB/s): min= 7, max= 55, per=25.03%, avg=22.53, stdev=10.94, samples=533 iops : min= 1, max= 13, avg= 5.01, stdev= 2.81, samples=533 lat (msec) : 4=0.03%, 10=3.71%, 20=19.37%, 50=17.51%, 100=22.69% lat (msec) : 250=32.00%, 500=4.46%, 750=0.20%, 2000=0.03% cpu : usr=0.04%, sys=1.10%, ctx=5233, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=86.3KiB/s (88.3kB/s), 21.3KiB/s-22.0KiB/s (21.9kB/s-22.5kB/s), io=23.4MiB (24.6MB), run=274924-278353msec WRITE: bw=90.3KiB/s (92.5kB/s), 22.5KiB/s-22.8KiB/s (23.0kB/s-23.4kB/s), io=24.6MiB (25.7MB), run=274924-278353msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144757: Wed Sep 9 01:44:19 2026 read: IOPS=15, BW=253KiB/s (259kB/s)(5920KiB/23388msec) clat (usec): min=30, max=109442, avg=31094.41, stdev=26811.43 lat (usec): min=30, max=109444, avg=31095.46, stdev=26811.47 clat percentiles (usec): | 1.00th=[ 39], 5.00th=[ 51], 10.00th=[ 57], 20.00th=[ 69], | 30.00th=[ 14091], 40.00th=[ 22676], 50.00th=[ 30802], 60.00th=[ 36439], | 70.00th=[ 42730], 80.00th=[ 51119], 90.00th=[ 66323], 95.00th=[ 82314], | 99.00th=[100140], 99.50th=[108528], 99.90th=[109577], 99.95th=[109577], | 99.99th=[109577] bw ( KiB/s): min= 31, max= 603, per=26.20%, avg=254.17, stdev=120.02, samples=46 iops : min= 1, max= 37, avg=15.13, stdev= 7.58, samples=46 write: IOPS=17, BW=272KiB/s (279kB/s)(6368KiB/23388msec); 0 zone resets clat (usec): min=1400, max=226816, avg=29345.39, stdev=33796.64 lat (usec): min=1401, max=226818, avg=29347.86, stdev=33796.27 clat percentiles (usec): | 1.00th=[ 1450], 5.00th=[ 1680], 10.00th=[ 2147], 20.00th=[ 4359], | 30.00th=[ 6390], 40.00th=[ 9896], 50.00th=[ 17695], 60.00th=[ 27132], | 70.00th=[ 35914], 80.00th=[ 49546], 90.00th=[ 72877], 95.00th=[ 90702], | 99.00th=[164627], 99.50th=[217056], 99.90th=[227541], 99.95th=[227541], | 99.99th=[227541] bw ( KiB/s): min= 30, max= 638, per=26.79%, avg=273.28, stdev=129.64, samples=46 iops : min= 1, max= 39, avg=16.33, stdev= 8.19, samples=46 lat (usec) : 50=2.21%, 100=10.03%, 250=0.78%, 750=0.13% lat (msec) : 2=4.95%, 4=4.82%, 10=12.11%, 20=10.16%, 50=34.24% lat (msec) : 100=17.97%, 250=2.60% cpu : usr=0.07%, sys=7.29%, ctx=1390, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144758: Wed Sep 9 01:44:19 2026 read: IOPS=14, BW=238KiB/s (243kB/s)(5744KiB/24173msec) clat (usec): min=37, max=193134, avg=31484.52, stdev=29061.37 lat (usec): min=37, max=193135, avg=31485.53, stdev=29061.40 clat percentiles (usec): | 1.00th=[ 40], 5.00th=[ 50], 10.00th=[ 56], 20.00th=[ 70], | 30.00th=[ 13435], 40.00th=[ 23200], 50.00th=[ 29230], 60.00th=[ 35914], | 70.00th=[ 43254], 80.00th=[ 52167], 90.00th=[ 65274], 95.00th=[ 76022], | 99.00th=[145753], 99.50th=[183501], 99.90th=[193987], 99.95th=[193987], | 99.99th=[193987] bw ( KiB/s): min= 30, max= 572, per=24.56%, avg=238.23, stdev=121.29, samples=47 iops : min= 1, max= 35, avg=14.15, stdev= 7.66, samples=47 write: IOPS=16, BW=271KiB/s (277kB/s)(6544KiB/24173msec); 0 zone resets clat (usec): min=1335, max=260632, avg=31001.76, stdev=37177.32 lat (usec): min=1336, max=260634, avg=31003.65, stdev=37177.30 clat percentiles (usec): | 1.00th=[ 1434], 5.00th=[ 1713], 10.00th=[ 2147], 20.00th=[ 4228], | 30.00th=[ 5997], 40.00th=[ 9896], 50.00th=[ 16057], 60.00th=[ 26346], | 70.00th=[ 39584], 80.00th=[ 53740], 90.00th=[ 79168], 95.00th=[ 99091], | 99.00th=[189793], 99.50th=[198181], 99.90th=[261096], 99.95th=[261096], | 99.99th=[261096] bw ( KiB/s): min= 91, max= 444, per=26.70%, avg=272.30, stdev=89.33, samples=47 iops : min= 5, max= 27, avg=16.30, stdev= 5.71, samples=47 lat (usec) : 50=2.60%, 100=8.98%, 250=0.65%, 500=0.26%, 750=0.13% lat (msec) : 2=4.56%, 4=5.47%, 10=12.24%, 20=10.03%, 50=32.68% lat (msec) : 100=19.01%, 250=3.26%, 500=0.13% cpu : usr=0.07%, sys=6.78%, ctx=1351, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144759: Wed Sep 9 01:44:19 2026 read: IOPS=15, BW=253KiB/s (260kB/s)(6256KiB/24682msec) clat (usec): min=35, max=150799, avg=30757.06, stdev=27528.18 lat (usec): min=35, max=150800, avg=30758.33, stdev=27528.45 clat percentiles (usec): | 1.00th=[ 41], 5.00th=[ 53], 10.00th=[ 57], 20.00th=[ 80], | 30.00th=[ 13829], 40.00th=[ 21890], 50.00th=[ 29492], 60.00th=[ 35914], | 70.00th=[ 41157], 80.00th=[ 49546], 90.00th=[ 64750], 95.00th=[ 80217], | 99.00th=[127402], 99.50th=[137364], 99.90th=[149947], 99.95th=[149947], | 99.99th=[149947] bw ( KiB/s): min= 63, max= 509, per=26.55%, avg=257.53, stdev=104.15, samples=47 iops : min= 3, max= 31, avg=15.36, stdev= 6.56, samples=47 write: IOPS=15, BW=244KiB/s (250kB/s)(6032KiB/24682msec); 0 zone resets clat (usec): min=1342, max=232059, avg=33274.93, stdev=36602.37 lat (usec): min=1343, max=232061, avg=33283.13, stdev=36597.87 clat percentiles (usec): | 1.00th=[ 1434], 5.00th=[ 1696], 10.00th=[ 2245], 20.00th=[ 3916], | 30.00th=[ 7832], 40.00th=[ 14484], 50.00th=[ 21103], 60.00th=[ 30278], | 70.00th=[ 42206], 80.00th=[ 57934], 90.00th=[ 81265], 95.00th=[ 95945], | 99.00th=[208667], 99.50th=[219153], 99.90th=[231736], 99.95th=[231736], | 99.99th=[231736] bw ( KiB/s): min= 60, max= 534, per=23.53%, avg=239.96, stdev=96.41, samples=48 iops : min= 3, max= 33, avg=14.25, stdev= 6.12, samples=48 lat (usec) : 50=1.17%, 100=10.81%, 250=1.43%, 500=0.52%, 750=0.13% lat (usec) : 1000=0.13% lat (msec) : 2=3.91%, 4=5.99%, 10=7.16%, 20=10.16%, 50=37.37% lat (msec) : 100=17.97%, 250=3.26% cpu : usr=0.09%, sys=6.94%, ctx=1499, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144760: Wed Sep 9 01:44:19 2026 read: IOPS=15, BW=252KiB/s (258kB/s)(6032KiB/23947msec) clat (usec): min=36, max=176880, avg=30943.43, stdev=26167.09 lat (usec): min=36, max=176881, avg=30944.48, stdev=26167.02 clat percentiles (usec): | 1.00th=[ 41], 5.00th=[ 52], 10.00th=[ 60], 20.00th=[ 75], | 30.00th=[ 15401], 40.00th=[ 24511], 50.00th=[ 30278], 60.00th=[ 35390], | 70.00th=[ 42730], 80.00th=[ 51119], 90.00th=[ 67634], 95.00th=[ 76022], | 99.00th=[101188], 99.50th=[107480], 99.90th=[177210], 99.95th=[177210], | 99.99th=[177210] bw ( KiB/s): min= 64, max= 510, per=26.25%, avg=254.63, stdev=105.14, samples=46 iops : min= 4, max= 31, avg=15.17, stdev= 6.58, samples=46 write: IOPS=16, BW=261KiB/s (268kB/s)(6256KiB/23947msec); 0 zone resets clat (usec): min=1387, max=224464, avg=30830.51, stdev=34142.68 lat (usec): min=1388, max=224465, avg=30832.74, stdev=34142.66 clat percentiles (usec): | 1.00th=[ 1450], 5.00th=[ 1713], 10.00th=[ 2802], 20.00th=[ 5014], | 30.00th=[ 8356], 40.00th=[ 11600], 50.00th=[ 17957], 60.00th=[ 26084], | 70.00th=[ 40109], 80.00th=[ 53216], 90.00th=[ 77071], 95.00th=[ 94897], | 99.00th=[147850], 99.50th=[223347], 99.90th=[225444], 99.95th=[225444], | 99.99th=[225444] bw ( KiB/s): min= 30, max= 544, per=25.51%, avg=260.19, stdev=105.81, samples=47 iops : min= 1, max= 34, avg=15.51, stdev= 6.69, samples=47 lat (usec) : 50=1.95%, 100=9.77%, 250=0.65%, 500=0.13%, 750=0.39% lat (usec) : 1000=0.13% lat (msec) : 2=4.04%, 4=4.69%, 10=10.29%, 20=12.24%, 50=33.98% lat (msec) : 100=18.75%, 250=2.99% cpu : usr=0.13%, sys=7.35%, ctx=1454, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=970KiB/s (994kB/s), 238KiB/s-253KiB/s (243kB/s-260kB/s), io=23.4MiB (24.5MB), run=23388-24682msec WRITE: bw=1021KiB/s (1045kB/s), 244KiB/s-272KiB/s (250kB/s-279kB/s), io=24.6MiB (25.8MB), run=23388-24682msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144752: Wed Sep 9 01:45:01 2026 read: IOPS=5, BW=89.7KiB/s (91.8kB/s)(5920KiB/66031msec) clat (msec): min=6, max=274, avg=33.84, stdev=30.46 lat (msec): min=6, max=274, avg=33.85, stdev=30.46 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 12], 10.00th=[ 13], 20.00th=[ 16], | 30.00th=[ 18], 40.00th=[ 21], 50.00th=[ 25], 60.00th=[ 27], | 70.00th=[ 33], 80.00th=[ 47], 90.00th=[ 69], 95.00th=[ 89], | 99.00th=[ 157], 99.50th=[ 188], 99.90th=[ 275], 99.95th=[ 275], | 99.99th=[ 275] bw ( KiB/s): min= 31, max= 384, per=27.34%, avg=98.44, stdev=60.16, samples=117 iops : min= 1, max= 24, avg= 5.46, stdev= 3.91, samples=117 write: IOPS=6, BW=96.4KiB/s (98.8kB/s)(6368KiB/66031msec); 0 zone resets clat (msec): min=44, max=405, avg=134.23, stdev=55.01 lat (msec): min=44, max=405, avg=134.23, stdev=55.01 clat percentiles (msec): | 1.00th=[ 59], 5.00th=[ 68], 10.00th=[ 79], 20.00th=[ 90], | 30.00th=[ 99], 40.00th=[ 109], 50.00th=[ 125], 60.00th=[ 136], | 70.00th=[ 150], 80.00th=[ 171], 90.00th=[ 203], 95.00th=[ 245], | 99.00th=[ 321], 99.50th=[ 347], 99.90th=[ 405], 99.95th=[ 405], | 99.99th=[ 405] bw ( KiB/s): min= 30, max= 190, per=25.22%, avg=95.60, stdev=37.01, samples=130 iops : min= 1, max= 11, avg= 5.28, stdev= 2.43, samples=130 lat (msec) : 10=1.17%, 20=17.58%, 50=20.70%, 100=23.70%, 250=34.24% lat (msec) : 500=2.60% cpu : usr=0.05%, sys=1.31%, ctx=1279, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144753: Wed Sep 9 01:45:01 2026 read: IOPS=5, BW=86.5KiB/s (88.6kB/s)(5744KiB/66391msec) clat (msec): min=6, max=218, avg=33.56, stdev=31.98 lat (msec): min=6, max=218, avg=33.56, stdev=31.99 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 12], 20.00th=[ 16], | 30.00th=[ 18], 40.00th=[ 20], 50.00th=[ 23], 60.00th=[ 26], | 70.00th=[ 32], 80.00th=[ 41], 90.00th=[ 74], 95.00th=[ 108], | 99.00th=[ 155], 99.50th=[ 186], 99.90th=[ 220], 99.95th=[ 220], | 99.99th=[ 220] bw ( KiB/s): min= 29, max= 319, per=27.65%, avg=99.54, stdev=65.49, samples=113 iops : min= 1, max= 19, avg= 5.55, stdev= 4.08, samples=113 write: IOPS=6, BW=98.6KiB/s (101kB/s)(6544KiB/66391msec); 0 zone resets clat (msec): min=44, max=385, avg=132.50, stdev=54.02 lat (msec): min=44, max=385, avg=132.50, stdev=54.02 clat percentiles (msec): | 1.00th=[ 56], 5.00th=[ 66], 10.00th=[ 72], 20.00th=[ 88], | 30.00th=[ 99], 40.00th=[ 111], 50.00th=[ 124], 60.00th=[ 138], | 70.00th=[ 153], 80.00th=[ 174], 90.00th=[ 205], 95.00th=[ 232], | 99.00th=[ 313], 99.50th=[ 321], 99.90th=[ 384], 99.95th=[ 384], | 99.99th=[ 384] bw ( KiB/s): min= 31, max= 221, per=25.87%, avg=98.05, stdev=41.04, samples=131 iops : min= 1, max= 13, avg= 5.43, stdev= 2.70, samples=131 lat (msec) : 10=1.56%, 20=18.62%, 50=19.53%, 100=20.83%, 250=37.76% lat (msec) : 500=1.69% cpu : usr=0.04%, sys=1.36%, ctx=1332, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144754: Wed Sep 9 01:45:01 2026 read: IOPS=6, BW=99.0KiB/s (101kB/s)(6256KiB/63181msec) clat (msec): min=8, max=193, avg=32.63, stdev=27.49 lat (msec): min=8, max=193, avg=32.63, stdev=27.49 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 16], | 30.00th=[ 19], 40.00th=[ 21], 50.00th=[ 23], 60.00th=[ 28], | 70.00th=[ 33], 80.00th=[ 43], 90.00th=[ 64], 95.00th=[ 88], | 99.00th=[ 165], 99.50th=[ 184], 99.90th=[ 194], 99.95th=[ 194], | 99.99th=[ 194] bw ( KiB/s): min= 31, max= 380, per=29.35%, avg=105.68, stdev=73.19, samples=117 iops : min= 1, max= 23, avg= 5.90, stdev= 4.61, samples=117 write: IOPS=5, BW=95.5KiB/s (97.8kB/s)(6032KiB/63181msec); 0 zone resets clat (msec): min=50, max=338, avg=133.26, stdev=55.61 lat (msec): min=50, max=338, avg=133.26, stdev=55.61 clat percentiles (msec): | 1.00th=[ 56], 5.00th=[ 66], 10.00th=[ 74], 20.00th=[ 89], | 30.00th=[ 96], 40.00th=[ 109], 50.00th=[ 120], 60.00th=[ 136], | 70.00th=[ 153], 80.00th=[ 176], 90.00th=[ 207], 95.00th=[ 243], | 99.00th=[ 309], 99.50th=[ 317], 99.90th=[ 338], 99.95th=[ 338], | 99.99th=[ 338] bw ( KiB/s): min= 31, max= 189, per=25.18%, avg=95.44, stdev=37.96, samples=124 iops : min= 1, max= 11, avg= 5.26, stdev= 2.50, samples=124 lat (msec) : 10=1.69%, 20=18.36%, 50=22.92%, 100=21.61%, 250=33.07% lat (msec) : 500=2.34% cpu : usr=0.06%, sys=1.36%, ctx=1342, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144755: Wed Sep 9 01:45:01 2026 read: IOPS=5, BW=92.1KiB/s (94.3kB/s)(6032KiB/65509msec) clat (msec): min=6, max=184, avg=34.26, stdev=29.30 lat (msec): min=6, max=184, avg=34.27, stdev=29.30 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 16], | 30.00th=[ 19], 40.00th=[ 22], 50.00th=[ 24], 60.00th=[ 28], | 70.00th=[ 34], 80.00th=[ 46], 90.00th=[ 70], 95.00th=[ 97], | 99.00th=[ 155], 99.50th=[ 182], 99.90th=[ 184], 99.95th=[ 184], | 99.99th=[ 184] bw ( KiB/s): min= 31, max= 347, per=28.12%, avg=101.23, stdev=64.91, samples=116 iops : min= 1, max= 21, avg= 5.63, stdev= 4.11, samples=116 write: IOPS=5, BW=95.5KiB/s (97.8kB/s)(6256KiB/65509msec); 0 zone resets clat (msec): min=41, max=409, avg=133.98, stdev=53.63 lat (msec): min=41, max=409, avg=133.98, stdev=53.63 clat percentiles (msec): | 1.00th=[ 51], 5.00th=[ 68], 10.00th=[ 73], 20.00th=[ 91], | 30.00th=[ 101], 40.00th=[ 111], 50.00th=[ 126], 60.00th=[ 140], | 70.00th=[ 153], 80.00th=[ 171], 90.00th=[ 207], 95.00th=[ 236], | 99.00th=[ 288], 99.50th=[ 355], 99.90th=[ 409], 99.95th=[ 409], | 99.99th=[ 409] bw ( KiB/s): min= 29, max= 191, per=25.10%, avg=95.12, stdev=35.21, samples=129 iops : min= 1, max= 11, avg= 5.24, stdev= 2.31, samples=129 lat (msec) : 10=1.43%, 20=15.36%, 50=24.22%, 100=21.74%, 250=35.29% lat (msec) : 500=1.95% cpu : usr=0.04%, sys=1.31%, ctx=1295, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=361KiB/s (369kB/s), 86.5KiB/s-99.0KiB/s (88.6kB/s-101kB/s), io=23.4MiB (24.5MB), run=63181-66391msec WRITE: bw=380KiB/s (389kB/s), 95.5KiB/s-98.6KiB/s (97.8kB/s-101kB/s), io=24.6MiB (25.8MB), run=63181-66391msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144784: Wed Sep 9 01:45:26 2026 read: IOPS=1, BW=1704KiB/s (1745kB/s)(7168KiB/4207msec) clat (usec): min=461, max=726812, avg=331589.14, stdev=240045.93 lat (usec): min=462, max=726814, avg=331590.65, stdev=240046.07 clat percentiles (usec): | 1.00th=[ 461], 5.00th=[ 461], 10.00th=[ 461], 20.00th=[102237], | 30.00th=[320865], 40.00th=[320865], 50.00th=[325059], 60.00th=[346031], | 70.00th=[346031], 80.00th=[497026], 90.00th=[725615], 95.00th=[725615], | 99.00th=[725615], 99.50th=[725615], 99.90th=[725615], 99.95th=[725615], | 99.99th=[725615] bw ( KiB/s): min= 1374, max= 2035, per=80.88%, avg=1848.20, stdev=280.67, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 write: IOPS=1, BW=1217KiB/s (1246kB/s)(5120KiB/4207msec); 0 zone resets clat (msec): min=203, max=652, avg=375.78, stdev=176.43 lat (msec): min=203, max=653, avg=375.84, stdev=176.45 clat percentiles (msec): | 1.00th=[ 205], 5.00th=[ 205], 10.00th=[ 205], 20.00th=[ 205], | 30.00th=[ 268], 40.00th=[ 268], 50.00th=[ 321], 60.00th=[ 321], | 70.00th=[ 435], 80.00th=[ 435], 90.00th=[ 651], 95.00th=[ 651], | 99.00th=[ 651], 99.50th=[ 651], 99.90th=[ 651], 99.95th=[ 651], | 99.99th=[ 651] bw ( KiB/s): min= 2027, max= 4031, per=84.22%, avg=2695.00, stdev=1157.01, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (usec) : 500=8.33% lat (msec) : 250=16.67%, 500=58.33%, 750=16.67% cpu : usr=0.05%, sys=6.66%, ctx=123, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144785: Wed Sep 9 01:45:26 2026 read: IOPS=0, BW=229KiB/s (234kB/s)(2048KiB/8960msec) clat (msec): min=156, max=434, avg=295.29, stdev=196.23 lat (msec): min=156, max=434, avg=295.29, stdev=196.23 clat percentiles (msec): | 1.00th=[ 157], 5.00th=[ 157], 10.00th=[ 157], 20.00th=[ 157], | 30.00th=[ 157], 40.00th=[ 157], 50.00th=[ 157], 60.00th=[ 435], | 70.00th=[ 435], 80.00th=[ 435], 90.00th=[ 435], 95.00th=[ 435], | 99.00th=[ 435], 99.50th=[ 435], 99.90th=[ 435], 99.95th=[ 435], | 99.99th=[ 435] bw ( KiB/s): min= 2000, max= 2011, per=87.77%, avg=2005.50, stdev= 7.78, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1143KiB/s (1170kB/s)(10.0MiB/8960msec); 0 zone resets clat (msec): min=180, max=4691, avg=835.96, stdev=1367.61 lat (msec): min=180, max=4691, avg=836.11, stdev=1367.58 clat percentiles (msec): | 1.00th=[ 182], 5.00th=[ 182], 10.00th=[ 182], 20.00th=[ 184], | 30.00th=[ 300], 40.00th=[ 342], 50.00th=[ 380], 60.00th=[ 460], | 70.00th=[ 481], 80.00th=[ 514], 90.00th=[ 835], 95.00th=[ 4665], | 99.00th=[ 4665], 99.50th=[ 4665], 99.90th=[ 4665], 99.95th=[ 4665], | 99.99th=[ 4665] bw ( KiB/s): min= 1805, max= 4047, per=80.28%, avg=2569.00, stdev=1010.17, samples=7 iops : min= 1, max= 3, avg= 1.57, stdev= 0.98, samples=7 lat (msec) : 250=25.00%, 500=50.00%, 750=8.33%, 1000=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=6.02%, ctx=231, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144786: Wed Sep 9 01:45:26 2026 read: IOPS=0, BW=707KiB/s (724kB/s)(6144KiB/8695msec) clat (usec): min=429, max=486344, avg=209221.43, stdev=202549.07 lat (usec): min=429, max=486345, avg=209222.50, stdev=202548.99 clat percentiles (usec): | 1.00th=[ 429], 5.00th=[ 429], 10.00th=[ 429], 20.00th=[ 938], | 30.00th=[ 938], 40.00th=[164627], 50.00th=[164627], 60.00th=[196084], | 70.00th=[408945], 80.00th=[408945], 90.00th=[484443], 95.00th=[484443], | 99.00th=[484443], 99.50th=[484443], 99.90th=[484443], 99.95th=[484443], | 99.99th=[484443] bw ( KiB/s): min= 2019, max= 6035, per=100.00%, avg=3365.67, stdev=2311.74, samples=3 iops : min= 1, max= 5, avg= 2.33, stdev= 2.31, samples=3 write: IOPS=0, BW=707KiB/s (724kB/s)(6144KiB/8695msec); 0 zone resets clat (msec): min=184, max=4552, avg=1237.09, stdev=1736.85 lat (msec): min=184, max=4552, avg=1237.14, stdev=1736.85 clat percentiles (msec): | 1.00th=[ 184], 5.00th=[ 184], 10.00th=[ 184], 20.00th=[ 199], | 30.00th=[ 199], 40.00th=[ 279], 50.00th=[ 279], 60.00th=[ 414], | 70.00th=[ 1787], 80.00th=[ 1787], 90.00th=[ 4530], 95.00th=[ 4530], | 99.00th=[ 4530], 99.50th=[ 4530], 99.90th=[ 4530], 99.95th=[ 4530], | 99.99th=[ 4530] bw ( KiB/s): min= 1805, max= 2048, per=61.75%, avg=1976.00, stdev=89.87, samples=6 iops : min= 1, max= 2, avg= 1.17, stdev= 0.41, samples=6 lat (usec) : 500=8.33%, 1000=8.33% lat (msec) : 250=33.33%, 500=33.33%, 2000=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=5.05%, ctx=160, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144787: Wed Sep 9 01:45:26 2026 read: IOPS=0, BW=632KiB/s (648kB/s)(5120KiB/8096msec) clat (usec): min=963, max=4004.5k, avg=826103.34, stdev=1777389.94 lat (usec): min=965, max=4004.5k, avg=826105.05, stdev=1777389.69 clat percentiles (usec): | 1.00th=[ 963], 5.00th=[ 963], 10.00th=[ 963], | 20.00th=[ 963], 30.00th=[ 5473], 40.00th=[ 5473], | 50.00th=[ 6456], 60.00th=[ 6456], 70.00th=[ 112722], | 80.00th=[ 112722], 90.00th=[4009755], 95.00th=[4009755], | 99.00th=[4009755], 99.50th=[4009755], 99.90th=[4009755], | 99.95th=[4009755], 99.99th=[4009755] bw ( KiB/s): min= 4031, max= 4031, per=100.00%, avg=4031.00, stdev= 0.00, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 write: IOPS=0, BW=885KiB/s (907kB/s)(7168KiB/8096msec); 0 zone resets clat (msec): min=121, max=1637, avg=560.89, stdev=528.39 lat (msec): min=121, max=1637, avg=561.00, stdev=528.34 clat percentiles (msec): | 1.00th=[ 123], 5.00th=[ 123], 10.00th=[ 123], 20.00th=[ 176], | 30.00th=[ 226], 40.00th=[ 226], 50.00th=[ 435], 60.00th=[ 558], | 70.00th=[ 558], 80.00th=[ 776], 90.00th=[ 1636], 95.00th=[ 1636], | 99.00th=[ 1636], 99.50th=[ 1636], 99.90th=[ 1636], 99.95th=[ 1636], | 99.99th=[ 1636] bw ( KiB/s): min= 1370, max= 4031, per=71.69%, avg=2294.00, stdev=1011.36, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 lat (usec) : 1000=8.33% lat (msec) : 10=16.67%, 250=33.33%, 500=8.33%, 750=8.33%, 1000=8.33% lat (msec) : 2000=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=5.37%, ctx=513, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2286KiB/s (2341kB/s), 229KiB/s-1704KiB/s (234kB/s-1745kB/s), io=20.0MiB (20.0MB), run=4207-8960msec WRITE: bw=3200KiB/s (3277kB/s), 707KiB/s-1217KiB/s (724kB/s-1246kB/s), io=28.0MiB (29.4MB), run=4207-8960msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144779: Wed Sep 9 01:45:27 2026 read: IOPS=1, BW=1753KiB/s (1795kB/s)(7168KiB/4089msec) clat (msec): min=105, max=600, avg=254.09, stdev=162.86 lat (msec): min=105, max=600, avg=254.09, stdev=162.86 clat percentiles (msec): | 1.00th=[ 106], 5.00th=[ 106], 10.00th=[ 106], 20.00th=[ 138], | 30.00th=[ 199], 40.00th=[ 199], 50.00th=[ 243], 60.00th=[ 243], | 70.00th=[ 243], 80.00th=[ 255], 90.00th=[ 600], 95.00th=[ 600], | 99.00th=[ 600], 99.50th=[ 600], 99.90th=[ 600], 99.95th=[ 600], | 99.99th=[ 600] bw ( KiB/s): min= 1921, max= 3413, per=100.00%, avg=2265.00, stdev=642.90, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 write: IOPS=1, BW=1252KiB/s (1282kB/s)(5120KiB/4089msec); 0 zone resets clat (msec): min=274, max=558, avg=427.48, stdev=113.28 lat (msec): min=274, max=558, avg=427.56, stdev=113.27 clat percentiles (msec): | 1.00th=[ 275], 5.00th=[ 275], 10.00th=[ 275], 20.00th=[ 275], | 30.00th=[ 355], 40.00th=[ 355], 50.00th=[ 456], 60.00th=[ 456], | 70.00th=[ 493], 80.00th=[ 493], 90.00th=[ 558], 95.00th=[ 558], | 99.00th=[ 558], 99.50th=[ 558], 99.90th=[ 558], 99.95th=[ 558], | 99.99th=[ 558] bw ( KiB/s): min= 1921, max= 2027, per=71.13%, avg=1969.50, stdev=43.59, samples=4 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=4 lat (msec) : 250=41.67%, 500=41.67%, 750=16.67% cpu : usr=0.00%, sys=3.82%, ctx=61, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144780: Wed Sep 9 01:45:27 2026 read: IOPS=0, BW=198KiB/s (203kB/s)(2048KiB/10351msec) clat (msec): min=177, max=180, avg=178.94, stdev= 1.91 lat (msec): min=177, max=180, avg=178.94, stdev= 1.90 clat percentiles (msec): | 1.00th=[ 178], 5.00th=[ 178], 10.00th=[ 178], 20.00th=[ 178], | 30.00th=[ 178], 40.00th=[ 178], 50.00th=[ 178], 60.00th=[ 180], | 70.00th=[ 180], 80.00th=[ 180], 90.00th=[ 180], 95.00th=[ 180], | 99.00th=[ 180], 99.50th=[ 180], 99.90th=[ 180], 99.95th=[ 180], | 99.99th=[ 180] bw ( KiB/s): min= 1675, max= 2023, per=93.48%, avg=1849.00, stdev=246.07, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=0, BW=989KiB/s (1013kB/s)(10.0MiB/10351msec); 0 zone resets clat (msec): min=132, max=4573, avg=976.77, stdev=1353.76 lat (msec): min=132, max=4573, avg=977.47, stdev=1354.10 clat percentiles (msec): | 1.00th=[ 133], 5.00th=[ 133], 10.00th=[ 133], 20.00th=[ 190], | 30.00th=[ 257], 40.00th=[ 305], 50.00th=[ 338], 60.00th=[ 363], | 70.00th=[ 944], 80.00th=[ 1011], 90.00th=[ 1653], 95.00th=[ 4597], | 99.00th=[ 4597], 99.50th=[ 4597], 99.90th=[ 4597], 99.95th=[ 4597], | 99.99th=[ 4597] bw ( KiB/s): min= 1961, max= 4096, per=92.64%, avg=2565.29, stdev=962.24, samples=7 iops : min= 1, max= 4, avg= 1.71, stdev= 1.25, samples=7 lat (msec) : 250=33.33%, 500=33.33%, 1000=8.33%, 2000=16.67%, >=2000=8.33% cpu : usr=0.02%, sys=2.54%, ctx=197, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144781: Wed Sep 9 01:45:27 2026 read: IOPS=0, BW=670KiB/s (686kB/s)(6144KiB/9170msec) clat (msec): min=110, max=1008, avg=394.34, stdev=325.65 lat (msec): min=110, max=1008, avg=394.34, stdev=325.65 clat percentiles (msec): | 1.00th=[ 110], 5.00th=[ 110], 10.00th=[ 110], 20.00th=[ 169], | 30.00th=[ 169], 40.00th=[ 271], 50.00th=[ 271], 60.00th=[ 351], | 70.00th=[ 460], 80.00th=[ 460], 90.00th=[ 1011], 95.00th=[ 1011], | 99.00th=[ 1011], 99.50th=[ 1011], 99.90th=[ 1011], 99.95th=[ 1011], | 99.99th=[ 1011] bw ( KiB/s): min= 1965, max= 2043, per=100.00%, avg=2002.20, stdev=35.46, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 write: IOPS=0, BW=670KiB/s (686kB/s)(6144KiB/9170msec); 0 zone resets clat (msec): min=175, max=4468, avg=1130.25, stdev=1662.91 lat (msec): min=175, max=4468, avg=1130.33, stdev=1662.93 clat percentiles (msec): | 1.00th=[ 176], 5.00th=[ 176], 10.00th=[ 176], 20.00th=[ 330], | 30.00th=[ 330], 40.00th=[ 359], 50.00th=[ 359], 60.00th=[ 405], | 70.00th=[ 1045], 80.00th=[ 1045], 90.00th=[ 4463], 95.00th=[ 4463], | 99.00th=[ 4463], 99.50th=[ 4463], 99.90th=[ 4463], 99.95th=[ 4463], | 99.99th=[ 4463] bw ( KiB/s): min= 1799, max= 2023, per=70.23%, avg=1944.60, stdev=91.21, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 lat (msec) : 250=25.00%, 500=50.00%, 2000=16.67%, >=2000=8.33% cpu : usr=0.00%, sys=1.48%, ctx=62, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144782: Wed Sep 9 01:45:27 2026 read: IOPS=1, BW=1071KiB/s (1097kB/s)(5120KiB/4780msec) clat (msec): min=143, max=713, avg=301.54, stdev=237.62 lat (msec): min=143, max=713, avg=301.54, stdev=237.62 clat percentiles (msec): | 1.00th=[ 144], 5.00th=[ 144], 10.00th=[ 144], 20.00th=[ 144], | 30.00th=[ 159], 40.00th=[ 159], 50.00th=[ 199], 60.00th=[ 199], | 70.00th=[ 296], 80.00th=[ 296], 90.00th=[ 718], 95.00th=[ 718], | 99.00th=[ 718], 99.50th=[ 718], 99.90th=[ 718], 99.95th=[ 718], | 99.99th=[ 718] bw ( KiB/s): min= 3900, max= 3938, per=100.00%, avg=3919.00, stdev=26.87, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1500KiB/s (1536kB/s)(7168KiB/4780msec); 0 zone resets clat (msec): min=267, max=658, avg=447.98, stdev=145.41 lat (msec): min=267, max=658, avg=448.07, stdev=145.40 clat percentiles (msec): | 1.00th=[ 268], 5.00th=[ 268], 10.00th=[ 268], 20.00th=[ 363], | 30.00th=[ 363], 40.00th=[ 363], 50.00th=[ 372], 60.00th=[ 502], | 70.00th=[ 502], 80.00th=[ 609], 90.00th=[ 659], 95.00th=[ 659], | 99.00th=[ 659], 99.50th=[ 659], 99.90th=[ 659], 99.95th=[ 659], | 99.99th=[ 659] bw ( KiB/s): min= 1428, max= 3806, per=81.78%, avg=2264.60, stdev=900.21, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 lat (msec) : 250=25.00%, 500=41.67%, 750=33.33% cpu : usr=0.00%, sys=2.41%, ctx=85, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1979KiB/s (2026kB/s), 198KiB/s-1753KiB/s (203kB/s-1795kB/s), io=20.0MiB (20.0MB), run=4089-10351msec WRITE: bw=2770KiB/s (2836kB/s), 670KiB/s-1500KiB/s (686kB/s-1536kB/s), io=28.0MiB (29.4MB), run=4089-10351msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144798: Wed Sep 9 01:45:42 2026 read: IOPS=1, BW=4114KiB/s (4213kB/s)(12.0MiB/2987msec) clat (msec): min=722, max=1086, avg=922.74, stdev=184.59 lat (msec): min=722, max=1086, avg=922.74, stdev=184.59 clat percentiles (msec): | 1.00th=[ 726], 5.00th=[ 726], 10.00th=[ 726], 20.00th=[ 726], | 30.00th=[ 726], 40.00th=[ 961], 50.00th=[ 961], 60.00th=[ 961], | 70.00th=[ 1083], 80.00th=[ 1083], 90.00th=[ 1083], 95.00th=[ 1083], | 99.00th=[ 1083], 99.50th=[ 1083], 99.90th=[ 1083], 99.95th=[ 1083], | 99.99th=[ 1083] bw ( KiB/s): min= 8110, max= 8192, per=100.00%, avg=8151.00, stdev=57.98, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 750=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=9.44%, ctx=218, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144800: Wed Sep 9 01:45:42 2026 read: IOPS=0, BW=896KiB/s (918kB/s)(4096KiB/4570msec) clat (nsec): min=1097.9M, max=1097.9M, avg=1097950175.00, stdev= 0.00 lat (nsec): min=1097.0M, max=1097.0M, avg=1097952373.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1099], 5.00th=[ 1099], 10.00th=[ 1099], 20.00th=[ 1099], | 30.00th=[ 1099], 40.00th=[ 1099], 50.00th=[ 1099], 60.00th=[ 1099], | 70.00th=[ 1099], 80.00th=[ 1099], 90.00th=[ 1099], 95.00th=[ 1099], | 99.00th=[ 1099], 99.50th=[ 1099], 99.90th=[ 1099], 99.95th=[ 1099], | 99.99th=[ 1099] bw ( KiB/s): min= 8110, max= 8110, per=100.00%, avg=8110.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=1793KiB/s (1836kB/s)(8192KiB/4570msec); 0 zone resets clat (msec): min=982, max=2376, avg=1679.74, stdev=985.76 lat (msec): min=983, max=2377, avg=1680.51, stdev=985.56 clat percentiles (msec): | 1.00th=[ 986], 5.00th=[ 986], 10.00th=[ 986], 20.00th=[ 986], | 30.00th=[ 986], 40.00th=[ 986], 50.00th=[ 986], 60.00th=[ 2366], | 70.00th=[ 2366], 80.00th=[ 2366], 90.00th=[ 2366], 95.00th=[ 2366], | 99.00th=[ 2366], 99.50th=[ 2366], 99.90th=[ 2366], 99.95th=[ 2366], | 99.99th=[ 2366] bw ( KiB/s): min= 8192, max= 8192, per=100.00%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 1000=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=3.90%, ctx=87, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144801: Wed Sep 9 01:45:42 2026 write: IOPS=0, BW=2872KiB/s (2941kB/s)(12.0MiB/4279msec); 0 zone resets clat (msec): min=465, max=1938, avg=1374.26, stdev=794.61 lat (msec): min=466, max=1938, avg=1374.68, stdev=794.38 clat percentiles (msec): | 1.00th=[ 464], 5.00th=[ 464], 10.00th=[ 464], 20.00th=[ 464], | 30.00th=[ 464], 40.00th=[ 1720], 50.00th=[ 1720], 60.00th=[ 1720], | 70.00th=[ 1938], 80.00th=[ 1938], 90.00th=[ 1938], 95.00th=[ 1938], | 99.00th=[ 1938], 99.50th=[ 1938], 99.90th=[ 1938], 99.95th=[ 1938], | 99.99th=[ 1938] bw ( KiB/s): min= 7846, max= 8175, per=100.00%, avg=8010.50, stdev=232.64, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.00%, sys=2.52%, ctx=43, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144802: Wed Sep 9 01:45:42 2026 write: IOPS=0, BW=3779KiB/s (3869kB/s)(12.0MiB/3252msec); 0 zone resets clat (msec): min=703, max=1226, avg=988.22, stdev=264.26 lat (msec): min=707, max=1226, avg=989.80, stdev=262.65 clat percentiles (msec): | 1.00th=[ 701], 5.00th=[ 701], 10.00th=[ 701], 20.00th=[ 701], | 30.00th=[ 701], 40.00th=[ 1036], 50.00th=[ 1036], 60.00th=[ 1036], | 70.00th=[ 1234], 80.00th=[ 1234], 90.00th=[ 1234], 95.00th=[ 1234], | 99.00th=[ 1234], 99.50th=[ 1234], 99.90th=[ 1234], 99.95th=[ 1234], | 99.99th=[ 1234] bw ( KiB/s): min= 8110, max= 8192, per=100.00%, avg=8151.00, stdev=57.98, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 750=33.33%, 2000=66.67% cpu : usr=0.00%, sys=4.86%, ctx=82, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3585KiB/s (3671kB/s), 896KiB/s-4114KiB/s (918kB/s-4213kB/s), io=16.0MiB (16.8MB), run=2987-4570msec WRITE: bw=7170KiB/s (7342kB/s), 1793KiB/s-3779KiB/s (1836kB/s-3869kB/s), io=32.0MiB (33.6MB), run=3252-4570msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144795: Wed Sep 9 01:45:42 2026 read: IOPS=0, BW=2655KiB/s (2719kB/s)(12.0MiB/4628msec) clat (msec): min=399, max=2047, avg=1454.77, stdev=915.84 lat (msec): min=399, max=2047, avg=1454.78, stdev=915.84 clat percentiles (msec): | 1.00th=[ 401], 5.00th=[ 401], 10.00th=[ 401], 20.00th=[ 401], | 30.00th=[ 401], 40.00th=[ 1921], 50.00th=[ 1921], 60.00th=[ 1921], | 70.00th=[ 2056], 80.00th=[ 2056], 90.00th=[ 2056], 95.00th=[ 2056], | 99.00th=[ 2056], 99.50th=[ 2056], 99.90th=[ 2056], 99.95th=[ 2056], | 99.99th=[ 2056] bw ( KiB/s): min= 8159, max= 8159, per=100.00%, avg=8159.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=2.16%, ctx=56, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144796: Wed Sep 9 01:45:42 2026 read: IOPS=0, BW=1171KiB/s (1199kB/s)(4096KiB/3499msec) clat (nsec): min=471688k, max=471688k, avg=471688037.00, stdev= 0.00 lat (nsec): min=471690k, max=471690k, avg=471690341.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 472], 5.00th=[ 472], 10.00th=[ 472], 20.00th=[ 472], | 30.00th=[ 472], 40.00th=[ 472], 50.00th=[ 472], 60.00th=[ 472], | 70.00th=[ 472], 80.00th=[ 472], 90.00th=[ 472], 95.00th=[ 472], | 99.00th=[ 472], 99.50th=[ 472], 99.90th=[ 472], 99.95th=[ 472], | 99.99th=[ 472] bw ( KiB/s): min= 7846, max= 7846, per=100.00%, avg=7846.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2341KiB/s (2397kB/s)(8192KiB/3499msec); 0 zone resets clat (msec): min=1255, max=1627, avg=1441.82, stdev=263.22 lat (msec): min=1256, max=1629, avg=1442.74, stdev=264.00 clat percentiles (msec): | 1.00th=[ 1250], 5.00th=[ 1250], 10.00th=[ 1250], 20.00th=[ 1250], | 30.00th=[ 1250], 40.00th=[ 1250], 50.00th=[ 1250], 60.00th=[ 1636], | 70.00th=[ 1636], 80.00th=[ 1636], 90.00th=[ 1636], 95.00th=[ 1636], | 99.00th=[ 1636], 99.50th=[ 1636], 99.90th=[ 1636], 99.95th=[ 1636], | 99.99th=[ 1636] bw ( KiB/s): min= 8192, max= 8192, per=89.26%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.17%, sys=4.89%, ctx=55, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144797: Wed Sep 9 01:45:42 2026 write: IOPS=0, BW=3442KiB/s (3525kB/s)(12.0MiB/3570msec); 0 zone resets clat (msec): min=432, max=1657, avg=1123.34, stdev=627.20 lat (msec): min=432, max=1657, avg=1123.85, stdev=627.35 clat percentiles (msec): | 1.00th=[ 435], 5.00th=[ 435], 10.00th=[ 435], 20.00th=[ 435], | 30.00th=[ 435], 40.00th=[ 1284], 50.00th=[ 1284], 60.00th=[ 1284], | 70.00th=[ 1653], 80.00th=[ 1653], 90.00th=[ 1653], 95.00th=[ 1653], | 99.00th=[ 1653], 99.50th=[ 1653], 99.90th=[ 1653], 99.95th=[ 1653], | 99.99th=[ 1653] bw ( KiB/s): min= 8015, max= 8175, per=88.20%, avg=8095.00, stdev=113.14, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.08%, sys=4.82%, ctx=53, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144799: Wed Sep 9 01:45:42 2026 write: IOPS=1, BW=4653KiB/s (4764kB/s)(12.0MiB/2641msec); 0 zone resets clat (msec): min=492, max=1350, avg=806.30, stdev=472.89 lat (msec): min=494, max=1350, avg=807.23, stdev=472.35 clat percentiles (msec): | 1.00th=[ 493], 5.00th=[ 493], 10.00th=[ 493], 20.00th=[ 493], | 30.00th=[ 493], 40.00th=[ 575], 50.00th=[ 575], 60.00th=[ 575], | 70.00th=[ 1351], 80.00th=[ 1351], 90.00th=[ 1351], 95.00th=[ 1351], | 99.00th=[ 1351], 99.50th=[ 1351], 99.90th=[ 1351], 99.95th=[ 1351], | 99.99th=[ 1351] bw ( KiB/s): min= 7846, max= 8015, per=86.41%, avg=7930.50, stdev=119.50, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.00%, sys=3.52%, ctx=40, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3540KiB/s (3625kB/s), 1171KiB/s-2655KiB/s (1199kB/s-2719kB/s), io=16.0MiB (16.8MB), run=3499-4628msec WRITE: bw=9179KiB/s (9399kB/s), 2341KiB/s-4653KiB/s (2397kB/s-4764kB/s), io=32.0MiB (33.6MB), run=2641-3570msec