== sanity test 398b: DIO and buffer IO race ============== 13:25:13 (1790789113) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 6.15877 s, 8.2 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=145071: Wed Sep 30 13:27:52 2026 read: IOPS=10, BW=42.6KiB/s (43.6kB/s)(5992KiB/140748msec) clat (usec): min=30, max=492772, avg=45289.41, stdev=37265.46 lat (usec): min=31, max=492774, avg=45296.52, stdev=37261.98 clat percentiles (usec): | 1.00th=[ 50], 5.00th=[ 64], 10.00th=[ 141], 20.00th=[ 20317], | 30.00th=[ 26346], 40.00th=[ 32113], 50.00th=[ 37487], 60.00th=[ 45351], | 70.00th=[ 55313], 80.00th=[ 67634], 90.00th=[ 86508], 95.00th=[104334], | 99.00th=[187696], 99.50th=[214959], 99.90th=[295699], 99.95th=[492831], | 99.99th=[492831] bw ( KiB/s): min= 7, max= 134, per=25.10%, avg=42.68, stdev=20.71, samples=274 iops : min= 1, max= 33, avg=10.00, stdev= 5.19, samples=274 write: IOPS=11, BW=44.7KiB/s (45.8kB/s)(6296KiB/140748msec); 0 zone resets clat (usec): min=943, max=1112.9k, avg=45979.20, stdev=53860.22 lat (usec): min=943, max=1112.9k, avg=45985.50, stdev=53861.09 clat percentiles (usec): | 1.00th=[ 1106], 5.00th=[ 1319], 10.00th=[ 2057], | 20.00th=[ 4752], 30.00th=[ 8979], 40.00th=[ 19006], | 50.00th=[ 33817], 60.00th=[ 45876], 70.00th=[ 60031], | 80.00th=[ 79168], 90.00th=[ 107480], 95.00th=[ 137364], | 99.00th=[ 198181], 99.50th=[ 233833], 99.90th=[ 408945], | 99.95th=[1115685], 99.99th=[1115685] bw ( KiB/s): min= 7, max= 158, per=25.16%, avg=44.78, stdev=20.81, samples=274 iops : min= 1, max= 39, avg=10.54, stdev= 5.23, samples=274 lat (usec) : 50=0.42%, 100=4.10%, 250=0.62%, 500=0.07%, 1000=0.29% lat (msec) : 2=5.05%, 4=3.91%, 10=7.36%, 20=8.33%, 50=33.66% lat (msec) : 100=27.18%, 250=8.69%, 500=0.29%, 2000=0.03% cpu : usr=0.08%, sys=4.73%, ctx=6696, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145072: Wed Sep 30 13:27:52 2026 read: IOPS=10, BW=43.1KiB/s (44.2kB/s)(5940KiB/137700msec) clat (usec): min=34, max=388017, avg=44057.17, stdev=33716.13 lat (usec): min=34, max=388018, avg=44059.61, stdev=33716.28 clat percentiles (usec): | 1.00th=[ 52], 5.00th=[ 65], 10.00th=[ 217], 20.00th=[ 20055], | 30.00th=[ 25560], 40.00th=[ 31327], 50.00th=[ 37487], 60.00th=[ 45876], | 70.00th=[ 54789], 80.00th=[ 66847], 90.00th=[ 85459], 95.00th=[106431], | 99.00th=[145753], 99.50th=[170918], 99.90th=[263193], 99.95th=[387974], | 99.99th=[387974] bw ( KiB/s): min= 7, max= 103, per=25.31%, avg=43.03, stdev=19.48, samples=268 iops : min= 1, max= 25, avg=10.09, stdev= 4.89, samples=268 write: IOPS=11, BW=46.1KiB/s (47.2kB/s)(6348KiB/137700msec); 0 zone resets clat (usec): min=1007, max=1101.6k, avg=45196.01, stdev=55342.29 lat (usec): min=1008, max=1101.7k, avg=45201.88, stdev=55345.10 clat percentiles (usec): | 1.00th=[ 1106], 5.00th=[ 1270], 10.00th=[ 1745], | 20.00th=[ 4555], 30.00th=[ 8717], 40.00th=[ 19268], | 50.00th=[ 32113], 60.00th=[ 43779], 70.00th=[ 57934], | 80.00th=[ 77071], 90.00th=[ 108528], 95.00th=[ 133694], | 99.00th=[ 204473], 99.50th=[ 254804], 99.90th=[ 513803], | 99.95th=[1098908], 99.99th=[1098908] bw ( KiB/s): min= 7, max= 134, per=25.98%, avg=46.24, stdev=20.72, samples=266 iops : min= 1, max= 33, avg=10.91, stdev= 5.22, samples=266 lat (usec) : 50=0.36%, 100=3.97%, 250=0.59%, 500=0.13%, 750=0.10% lat (usec) : 1000=0.07% lat (msec) : 2=6.05%, 4=3.65%, 10=7.36%, 20=8.30%, 50=34.86% lat (msec) : 100=25.46%, 250=8.72%, 500=0.33%, 750=0.03%, 2000=0.03% cpu : usr=0.08%, sys=4.81%, ctx=6487, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145073: Wed Sep 30 13:27:52 2026 read: IOPS=10, BW=42.7KiB/s (43.7kB/s)(6028KiB/141160msec) clat (usec): min=30, max=382738, avg=44985.86, stdev=35579.58 lat (usec): min=30, max=382739, avg=44987.54, stdev=35579.49 clat percentiles (usec): | 1.00th=[ 50], 5.00th=[ 67], 10.00th=[ 269], 20.00th=[ 20055], | 30.00th=[ 26084], 40.00th=[ 31589], 50.00th=[ 37487], 60.00th=[ 45876], | 70.00th=[ 55837], 80.00th=[ 67634], 90.00th=[ 85459], 95.00th=[107480], | 99.00th=[156238], 99.50th=[177210], 99.90th=[367002], 99.95th=[383779], | 99.99th=[383779] bw ( KiB/s): min= 7, max= 111, per=25.18%, avg=42.81, stdev=19.85, samples=273 iops : min= 1, max= 27, avg=10.04, stdev= 5.00, samples=273 write: IOPS=11, BW=44.3KiB/s (45.4kB/s)(6260KiB/141160msec); 0 zone resets clat (usec): min=973, max=1390.4k, avg=46478.87, stdev=56624.81 lat (usec): min=974, max=1390.4k, avg=46484.85, stdev=56622.85 clat percentiles (usec): | 1.00th=[ 1123], 5.00th=[ 1303], 10.00th=[ 1795], | 20.00th=[ 4686], 30.00th=[ 10028], 40.00th=[ 21365], | 50.00th=[ 35390], 60.00th=[ 47449], 70.00th=[ 61604], | 80.00th=[ 78119], 90.00th=[ 106431], 95.00th=[ 135267], | 99.00th=[ 196084], 99.50th=[ 210764], 99.90th=[ 299893], | 99.95th=[1384121], 99.99th=[1384121] bw ( KiB/s): min= 7, max= 110, per=24.95%, avg=44.42, stdev=19.40, samples=273 iops : min= 1, max= 27, avg=10.45, stdev= 4.91, samples=273 lat (usec) : 50=0.49%, 100=3.68%, 250=0.72%, 500=0.23%, 750=0.03% lat (usec) : 1000=0.07% lat (msec) : 2=5.53%, 4=3.45%, 10=6.58%, 20=8.79%, 50=33.82% lat (msec) : 100=27.41%, 250=9.02%, 500=0.16%, 2000=0.03% cpu : usr=0.08%, sys=4.72%, ctx=6664, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145074: Wed Sep 30 13:27:52 2026 read: IOPS=10, BW=43.3KiB/s (44.4kB/s)(6052KiB/139704msec) clat (usec): min=33, max=1159.3k, avg=45501.90, stdev=43939.68 lat (usec): min=34, max=1159.3k, avg=45507.71, stdev=43938.65 clat percentiles (usec): | 1.00th=[ 47], 5.00th=[ 60], 10.00th=[ 118], | 20.00th=[ 20579], 30.00th=[ 26346], 40.00th=[ 32637], | 50.00th=[ 38011], 60.00th=[ 45876], 70.00th=[ 54789], | 80.00th=[ 67634], 90.00th=[ 86508], 95.00th=[ 105382], | 99.00th=[ 143655], 99.50th=[ 198181], 99.90th=[ 252707], | 99.95th=[1166017], 99.99th=[1166017] bw ( KiB/s): min= 7, max= 95, per=25.39%, avg=43.16, stdev=18.79, samples=273 iops : min= 1, max= 23, avg=10.13, stdev= 4.71, samples=273 write: IOPS=11, BW=44.6KiB/s (45.7kB/s)(6236KiB/139704msec); 0 zone resets clat (usec): min=951, max=385181, avg=45124.15, stdev=46179.96 lat (usec): min=952, max=385184, avg=45126.00, stdev=46179.94 clat percentiles (usec): | 1.00th=[ 1090], 5.00th=[ 1270], 10.00th=[ 1647], 20.00th=[ 4555], | 30.00th=[ 9765], 40.00th=[ 21103], 50.00th=[ 33817], 60.00th=[ 46924], | 70.00th=[ 59507], 80.00th=[ 76022], 90.00th=[106431], 95.00th=[130548], | 99.00th=[198181], 99.50th=[229639], 99.90th=[346031], 99.95th=[383779], | 99.99th=[383779] bw ( KiB/s): min= 7, max= 111, per=25.07%, avg=44.62, stdev=19.36, samples=272 iops : min= 1, max= 27, avg=10.50, stdev= 4.87, samples=272 lat (usec) : 50=0.72%, 100=3.81%, 250=0.78%, 500=0.16%, 1000=0.13% lat (msec) : 2=5.70%, 4=3.42%, 10=6.38%, 20=8.30%, 50=34.24% lat (msec) : 100=27.28%, 250=8.82%, 500=0.23%, 2000=0.03% cpu : usr=0.06%, sys=4.75%, ctx=6610, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=170KiB/s (174kB/s), 42.6KiB/s-43.3KiB/s (43.6kB/s-44.4kB/s), io=23.4MiB (24.6MB), run=137700-141160msec WRITE: bw=178KiB/s (182kB/s), 44.3KiB/s-46.1KiB/s (45.4kB/s-47.2kB/s), io=24.6MiB (25.7MB), run=137700-141160msec rand-rw: (groupid=0, jobs=1): err= 0: pid=145075: Wed Sep 30 13:30:26 2026 read: IOPS=5, BW=20.3KiB/s (20.8kB/s)(5992KiB/294539msec) clat (msec): min=5, max=1106, avg=40.15, stdev=47.79 lat (msec): min=5, max=1106, avg=40.15, stdev=47.79 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 16], | 30.00th=[ 20], 40.00th=[ 23], 50.00th=[ 28], 60.00th=[ 33], | 70.00th=[ 41], 80.00th=[ 54], 90.00th=[ 83], 95.00th=[ 112], | 99.00th=[ 194], 99.50th=[ 271], 99.90th=[ 447], 99.95th=[ 1099], | 99.99th=[ 1099] bw ( KiB/s): min= 7, max= 87, per=28.57%, avg=23.14, stdev=15.89, samples=498 iops : min= 1, max= 21, avg= 5.15, stdev= 4.01, samples=498 write: IOPS=5, BW=21.4KiB/s (21.9kB/s)(6296KiB/294539msec); 0 zone resets clat (msec): min=40, max=655, avg=148.62, stdev=73.33 lat (msec): min=40, max=655, avg=148.62, stdev=73.33 clat percentiles (msec): | 1.00th=[ 53], 5.00th=[ 66], 10.00th=[ 77], 20.00th=[ 90], | 30.00th=[ 102], 40.00th=[ 116], 50.00th=[ 131], 60.00th=[ 148], | 70.00th=[ 169], 80.00th=[ 201], 90.00th=[ 245], 95.00th=[ 284], | 99.00th=[ 401], 99.50th=[ 456], 99.90th=[ 535], 99.95th=[ 659], | 99.99th=[ 659] bw ( KiB/s): min= 7, max= 55, per=24.79%, avg=21.07, stdev= 9.99, samples=572 iops : min= 1, max= 13, avg= 4.62, stdev= 2.53, samples=572 lat (msec) : 10=1.76%, 20=14.29%, 50=22.07%, 100=22.36%, 250=34.41% lat (msec) : 500=4.95%, 750=0.13%, 2000=0.03% cpu : usr=0.05%, sys=1.07%, ctx=5165, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145076: Wed Sep 30 13:30:26 2026 read: IOPS=5, BW=20.1KiB/s (20.6kB/s)(5940KiB/295079msec) clat (msec): min=5, max=1200, avg=40.67, stdev=49.36 lat (msec): min=5, max=1200, avg=40.68, stdev=49.36 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 16], | 30.00th=[ 20], 40.00th=[ 23], 50.00th=[ 27], 60.00th=[ 33], | 70.00th=[ 41], 80.00th=[ 55], 90.00th=[ 87], 95.00th=[ 114], | 99.00th=[ 184], 99.50th=[ 245], 99.90th=[ 531], 99.95th=[ 1200], | 99.99th=[ 1200] bw ( KiB/s): min= 6, max= 96, per=28.55%, avg=23.13, stdev=15.64, samples=494 iops : min= 1, max= 24, avg= 5.14, stdev= 3.93, samples=494 write: IOPS=5, BW=21.5KiB/s (22.0kB/s)(6348KiB/295079msec); 0 zone resets clat (msec): min=44, max=502, avg=147.63, stdev=67.48 lat (msec): min=44, max=502, avg=147.63, stdev=67.48 clat percentiles (msec): | 1.00th=[ 55], 5.00th=[ 69], 10.00th=[ 79], 20.00th=[ 91], | 30.00th=[ 105], 40.00th=[ 117], 50.00th=[ 132], 60.00th=[ 148], | 70.00th=[ 171], 80.00th=[ 199], 90.00th=[ 236], 95.00th=[ 279], | 99.00th=[ 368], 99.50th=[ 422], 99.90th=[ 498], 99.95th=[ 502], | 99.99th=[ 502] bw ( KiB/s): min= 7, max= 48, per=24.93%, avg=21.19, stdev= 9.55, samples=574 iops : min= 1, max= 12, avg= 4.65, stdev= 2.43, samples=574 lat (msec) : 10=1.86%, 20=13.83%, 50=22.04%, 100=20.93%, 250=36.85% lat (msec) : 500=4.39%, 750=0.07%, 2000=0.03% cpu : usr=0.05%, sys=1.13%, ctx=5321, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145077: Wed Sep 30 13:30:26 2026 read: IOPS=5, BW=20.5KiB/s (21.0kB/s)(6028KiB/293325msec) clat (msec): min=6, max=430, avg=40.48, stdev=39.54 lat (msec): min=6, max=430, avg=40.49, stdev=39.54 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 17], | 30.00th=[ 21], 40.00th=[ 24], 50.00th=[ 28], 60.00th=[ 34], | 70.00th=[ 42], 80.00th=[ 55], 90.00th=[ 85], 95.00th=[ 114], | 99.00th=[ 190], 99.50th=[ 279], 99.90th=[ 384], 99.95th=[ 430], | 99.99th=[ 430] bw ( KiB/s): min= 7, max= 78, per=28.12%, avg=22.78, stdev=15.70, samples=509 iops : min= 1, max= 19, avg= 5.06, stdev= 3.95, samples=509 write: IOPS=5, BW=21.3KiB/s (21.9kB/s)(6260KiB/293325msec); 0 zone resets clat (msec): min=39, max=1389, avg=148.18, stdev=77.33 lat (msec): min=39, max=1389, avg=148.19, stdev=77.33 clat percentiles (msec): | 1.00th=[ 53], 5.00th=[ 68], 10.00th=[ 75], 20.00th=[ 89], | 30.00th=[ 104], 40.00th=[ 116], 50.00th=[ 130], 60.00th=[ 148], | 70.00th=[ 169], 80.00th=[ 197], 90.00th=[ 243], 95.00th=[ 288], | 99.00th=[ 376], 99.50th=[ 430], 99.90th=[ 542], 99.95th=[ 1385], | 99.99th=[ 1385] bw ( KiB/s): min= 7, max= 48, per=24.74%, avg=21.03, stdev= 9.73, samples=571 iops : min= 1, max= 12, avg= 4.61, stdev= 2.48, samples=571 lat (msec) : 10=1.37%, 20=13.38%, 50=23.86%, 100=20.67%, 250=35.87% lat (msec) : 500=4.72%, 750=0.10%, 2000=0.03% cpu : usr=0.04%, sys=1.13%, ctx=5274, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145078: Wed Sep 30 13:30:26 2026 read: IOPS=5, BW=20.7KiB/s (21.1kB/s)(6052KiB/293035msec) clat (msec): min=6, max=531, avg=41.48, stdev=41.60 lat (msec): min=6, max=531, avg=41.48, stdev=41.60 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 17], | 30.00th=[ 20], 40.00th=[ 24], 50.00th=[ 28], 60.00th=[ 34], | 70.00th=[ 43], 80.00th=[ 58], 90.00th=[ 86], 95.00th=[ 120], | 99.00th=[ 201], 99.50th=[ 253], 99.90th=[ 393], 99.95th=[ 531], | 99.99th=[ 531] bw ( KiB/s): min= 7, max= 80, per=29.43%, avg=23.84, stdev=16.24, samples=489 iops : min= 1, max= 20, avg= 5.31, stdev= 4.09, samples=489 write: IOPS=5, BW=21.3KiB/s (21.8kB/s)(6236KiB/293035msec); 0 zone resets clat (msec): min=38, max=1253, avg=147.44, stdev=75.83 lat (msec): min=38, max=1253, avg=147.45, stdev=75.83 clat percentiles (msec): | 1.00th=[ 54], 5.00th=[ 66], 10.00th=[ 74], 20.00th=[ 89], | 30.00th=[ 102], 40.00th=[ 114], 50.00th=[ 130], 60.00th=[ 148], | 70.00th=[ 169], 80.00th=[ 199], 90.00th=[ 245], 95.00th=[ 284], | 99.00th=[ 393], 99.50th=[ 426], 99.90th=[ 531], 99.95th=[ 1250], | 99.99th=[ 1250] bw ( KiB/s): min= 7, max= 48, per=24.77%, avg=21.05, stdev= 9.62, samples=567 iops : min= 1, max= 12, avg= 4.62, stdev= 2.45, samples=567 lat (msec) : 10=2.05%, 20=13.09%, 50=22.46%, 100=22.62%, 250=34.80% lat (msec) : 500=4.88%, 750=0.07%, 2000=0.03% cpu : usr=0.04%, sys=1.16%, ctx=5505, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=81.4KiB/s (83.3kB/s), 20.1KiB/s-20.7KiB/s (20.6kB/s-21.1kB/s), io=23.4MiB (24.6MB), run=293035-295079msec WRITE: bw=85.2KiB/s (87.2kB/s), 21.3KiB/s-21.5KiB/s (21.8kB/s-22.0kB/s), io=24.6MiB (25.7MB), run=293035-295079msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=145146: Wed Sep 30 13:31:02 2026 read: IOPS=14, BW=236KiB/s (242kB/s)(5920KiB/25065msec) clat (usec): min=38, max=239989, avg=33888.03, stdev=29740.77 lat (usec): min=38, max=239991, avg=33889.55, stdev=29740.57 clat percentiles (usec): | 1.00th=[ 42], 5.00th=[ 58], 10.00th=[ 76], 20.00th=[ 130], | 30.00th=[ 17695], 40.00th=[ 24773], 50.00th=[ 30540], 60.00th=[ 38011], | 70.00th=[ 47449], 80.00th=[ 57934], 90.00th=[ 68682], 95.00th=[ 83362], | 99.00th=[110625], 99.50th=[156238], 99.90th=[240124], 99.95th=[240124], | 99.99th=[240124] bw ( KiB/s): min= 64, max= 534, per=26.39%, avg=235.41, stdev=91.96, samples=49 iops : min= 4, max= 33, avg=13.98, stdev= 5.76, samples=49 write: IOPS=15, BW=254KiB/s (260kB/s)(6368KiB/25065msec); 0 zone resets clat (usec): min=1511, max=234396, avg=30677.40, stdev=31380.39 lat (usec): min=1514, max=234398, avg=30679.97, stdev=31380.29 clat percentiles (usec): | 1.00th=[ 1614], 5.00th=[ 2024], 10.00th=[ 3032], 20.00th=[ 5538], | 30.00th=[ 7635], 40.00th=[ 11600], 50.00th=[ 17957], 60.00th=[ 30278], | 70.00th=[ 39060], 80.00th=[ 53740], 90.00th=[ 74974], 95.00th=[ 92799], | 99.00th=[127402], 99.50th=[143655], 99.90th=[233833], 99.95th=[233833], | 99.99th=[233833] bw ( KiB/s): min= 30, max= 447, per=27.16%, avg=255.00, stdev=90.46, samples=49 iops : min= 1, max= 27, avg=15.20, stdev= 5.67, samples=49 lat (usec) : 50=1.30%, 100=6.90%, 250=2.34%, 500=0.91%, 750=0.65% lat (usec) : 1000=0.13% lat (msec) : 2=2.99%, 4=4.95%, 10=12.11%, 20=10.29%, 50=33.33% lat (msec) : 100=21.35%, 250=2.73% cpu : usr=0.08%, sys=6.67%, ctx=1505, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145147: Wed Sep 30 13:31:02 2026 read: IOPS=13, BW=214KiB/s (219kB/s)(5744KiB/26825msec) clat (usec): min=35, max=178684, avg=33071.76, stdev=30052.12 lat (usec): min=35, max=178685, avg=33082.01, stdev=30042.97 clat percentiles (usec): | 1.00th=[ 40], 5.00th=[ 54], 10.00th=[ 64], 20.00th=[ 88], | 30.00th=[ 13960], 40.00th=[ 25035], 50.00th=[ 30802], 60.00th=[ 37487], | 70.00th=[ 45351], 80.00th=[ 54789], 90.00th=[ 70779], 95.00th=[ 83362], | 99.00th=[137364], 99.50th=[156238], 99.90th=[179307], 99.95th=[179307], | 99.99th=[179307] bw ( KiB/s): min= 31, max= 507, per=25.45%, avg=227.02, stdev=110.29, samples=50 iops : min= 1, max= 31, avg=13.44, stdev= 6.97, samples=50 write: IOPS=15, BW=244KiB/s (250kB/s)(6544KiB/26825msec); 0 zone resets clat (usec): min=1437, max=423016, avg=35673.44, stdev=44976.92 lat (usec): min=1438, max=423019, avg=35685.81, stdev=44987.42 clat percentiles (usec): | 1.00th=[ 1582], 5.00th=[ 2114], 10.00th=[ 2966], 20.00th=[ 4686], | 30.00th=[ 7308], 40.00th=[ 10814], 50.00th=[ 19006], 60.00th=[ 30802], | 70.00th=[ 43254], 80.00th=[ 61080], 90.00th=[ 83362], 95.00th=[113771], | 99.00th=[219153], 99.50th=[233833], 99.90th=[421528], 99.95th=[421528], | 99.99th=[421528] bw ( KiB/s): min= 31, max= 447, per=25.95%, avg=243.70, stdev=108.63, samples=53 iops : min= 1, max= 27, avg=14.47, stdev= 6.79, samples=53 lat (usec) : 50=1.95%, 100=7.68%, 250=1.95%, 500=1.17%, 750=0.13% lat (msec) : 2=3.12%, 4=5.86%, 10=12.11%, 20=9.38%, 50=31.77% lat (msec) : 100=19.79%, 250=4.95%, 500=0.13% cpu : usr=0.08%, sys=6.58%, ctx=1519, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145149: Wed Sep 30 13:31:02 2026 read: IOPS=15, BW=247KiB/s (253kB/s)(6256KiB/25337msec) clat (usec): min=38, max=153990, avg=34028.68, stdev=26395.68 lat (usec): min=38, max=153990, avg=34033.13, stdev=26391.98 clat percentiles (usec): | 1.00th=[ 45], 5.00th=[ 60], 10.00th=[ 72], 20.00th=[ 139], | 30.00th=[ 22152], 40.00th=[ 28443], 50.00th=[ 32113], 60.00th=[ 39060], | 70.00th=[ 44303], 80.00th=[ 53216], 90.00th=[ 69731], 95.00th=[ 78119], | 99.00th=[103285], 99.50th=[135267], 99.90th=[154141], 99.95th=[154141], | 99.99th=[154141] bw ( KiB/s): min= 94, max= 503, per=27.72%, avg=247.28, stdev=87.97, samples=50 iops : min= 5, max= 31, avg=14.72, stdev= 5.57, samples=50 write: IOPS=14, BW=238KiB/s (244kB/s)(6032KiB/25337msec); 0 zone resets clat (usec): min=1412, max=318234, avg=31650.94, stdev=35889.46 lat (usec): min=1414, max=318237, avg=31654.78, stdev=35890.54 clat percentiles (usec): | 1.00th=[ 1483], 5.00th=[ 2376], 10.00th=[ 3130], 20.00th=[ 4621], | 30.00th=[ 6849], 40.00th=[ 10421], 50.00th=[ 19006], 60.00th=[ 28967], | 70.00th=[ 41157], 80.00th=[ 55837], 90.00th=[ 76022], 95.00th=[ 95945], | 99.00th=[149947], 99.50th=[219153], 99.90th=[316670], 99.95th=[316670], | 99.99th=[316670] bw ( KiB/s): min= 62, max= 478, per=25.26%, avg=237.16, stdev=94.83, samples=50 iops : min= 3, max= 29, avg=14.08, stdev= 5.96, samples=50 lat (usec) : 50=0.78%, 100=7.42%, 250=2.73%, 500=0.39%, 750=0.13% lat (usec) : 1000=0.13% lat (msec) : 2=1.95%, 4=6.12%, 10=11.98%, 20=7.16%, 50=38.15% lat (msec) : 100=19.92%, 250=2.99%, 500=0.13% cpu : usr=0.10%, sys=7.17%, ctx=1541, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145152: Wed Sep 30 13:31:02 2026 read: IOPS=14, BW=230KiB/s (236kB/s)(6032KiB/26214msec) clat (usec): min=35, max=186963, avg=33098.16, stdev=30027.11 lat (usec): min=35, max=186967, avg=33101.01, stdev=30025.45 clat percentiles (usec): | 1.00th=[ 41], 5.00th=[ 59], 10.00th=[ 69], 20.00th=[ 99], | 30.00th=[ 14222], 40.00th=[ 23987], 50.00th=[ 30540], 60.00th=[ 36439], | 70.00th=[ 44303], 80.00th=[ 57934], 90.00th=[ 71828], 95.00th=[ 81265], | 99.00th=[108528], 99.50th=[156238], 99.90th=[187696], 99.95th=[187696], | 99.99th=[187696] bw ( KiB/s): min= 31, max= 535, per=26.32%, avg=234.80, stdev=101.69, samples=50 iops : min= 1, max= 33, avg=13.92, stdev= 6.37, samples=50 write: IOPS=14, BW=239KiB/s (244kB/s)(6256KiB/26214msec); 0 zone resets clat (usec): min=1486, max=354339, avg=34032.40, stdev=40875.71 lat (usec): min=1488, max=354341, avg=34035.39, stdev=40875.66 clat percentiles (usec): | 1.00th=[ 1696], 5.00th=[ 2114], 10.00th=[ 2835], 20.00th=[ 5342], | 30.00th=[ 7963], 40.00th=[ 13304], 50.00th=[ 20579], 60.00th=[ 29230], | 70.00th=[ 39584], 80.00th=[ 54789], 90.00th=[ 82314], 95.00th=[108528], | 99.00th=[191890], 99.50th=[263193], 99.90th=[354419], 99.95th=[354419], | 99.99th=[354419] bw ( KiB/s): min= 42, max= 445, per=25.53%, avg=239.73, stdev=97.20, samples=51 iops : min= 2, max= 27, avg=14.24, stdev= 6.12, samples=51 lat (usec) : 50=0.91%, 100=9.24%, 250=2.34%, 500=1.30%, 750=0.26% lat (msec) : 2=2.73%, 4=4.95%, 10=10.94%, 20=9.77%, 50=31.64% lat (msec) : 100=21.61%, 250=4.04%, 500=0.26% cpu : usr=0.09%, sys=6.92%, ctx=1523, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=893KiB/s (914kB/s), 214KiB/s-247KiB/s (219kB/s-253kB/s), io=23.4MiB (24.5MB), run=25065-26825msec WRITE: bw=939KiB/s (962kB/s), 238KiB/s-254KiB/s (244kB/s-260kB/s), io=24.6MiB (25.8MB), run=25065-26825msec rand-rw: (groupid=0, jobs=1): err= 0: pid=145148: Wed Sep 30 13:31:46 2026 read: IOPS=5, BW=84.8KiB/s (86.8kB/s)(5920KiB/69810msec) clat (msec): min=6, max=255, avg=38.44, stdev=35.13 lat (msec): min=6, max=255, avg=38.44, stdev=35.13 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 13], 10.00th=[ 14], 20.00th=[ 17], | 30.00th=[ 21], 40.00th=[ 24], 50.00th=[ 28], 60.00th=[ 33], | 70.00th=[ 40], 80.00th=[ 50], 90.00th=[ 72], 95.00th=[ 103], | 99.00th=[ 207], 99.50th=[ 247], 99.90th=[ 255], 99.95th=[ 255], | 99.99th=[ 255] bw ( KiB/s): min= 31, max= 413, per=27.77%, avg=93.87, stdev=58.69, samples=124 iops : min= 1, max= 25, avg= 5.08, stdev= 3.75, samples=124 write: IOPS=5, BW=91.2KiB/s (93.4kB/s)(6368KiB/69810msec); 0 zone resets clat (msec): min=50, max=447, avg=138.76, stdev=58.92 lat (msec): min=50, max=447, avg=138.76, stdev=58.92 clat percentiles (msec): | 1.00th=[ 59], 5.00th=[ 70], 10.00th=[ 78], 20.00th=[ 90], | 30.00th=[ 102], 40.00th=[ 111], 50.00th=[ 125], 60.00th=[ 144], | 70.00th=[ 159], 80.00th=[ 180], 90.00th=[ 220], 95.00th=[ 251], | 99.00th=[ 317], 99.50th=[ 359], 99.90th=[ 447], 99.95th=[ 447], | 99.99th=[ 447] bw ( KiB/s): min= 31, max= 191, per=25.76%, avg=91.45, stdev=39.26, samples=137 iops : min= 1, max= 11, avg= 4.93, stdev= 2.51, samples=137 lat (msec) : 10=0.78%, 20=13.41%, 50=24.48%, 100=21.88%, 250=36.72% lat (msec) : 500=2.73% cpu : usr=0.04%, sys=1.36%, ctx=1299, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145150: Wed Sep 30 13:31:46 2026 read: IOPS=5, BW=81.1KiB/s (83.0kB/s)(5744KiB/70840msec) clat (msec): min=6, max=259, avg=37.46, stdev=32.22 lat (msec): min=6, max=259, avg=37.47, stdev=32.21 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 17], | 30.00th=[ 20], 40.00th=[ 23], 50.00th=[ 27], 60.00th=[ 32], | 70.00th=[ 39], 80.00th=[ 52], 90.00th=[ 72], 95.00th=[ 100], | 99.00th=[ 178], 99.50th=[ 228], 99.90th=[ 259], 99.95th=[ 259], | 99.99th=[ 259] bw ( KiB/s): min= 29, max= 319, per=27.77%, avg=93.88, stdev=60.65, samples=120 iops : min= 1, max= 19, avg= 5.08, stdev= 3.84, samples=120 write: IOPS=5, BW=92.4KiB/s (94.6kB/s)(6544KiB/70840msec); 0 zone resets clat (msec): min=42, max=358, avg=139.91, stdev=59.28 lat (msec): min=42, max=358, avg=139.92, stdev=59.28 clat percentiles (msec): | 1.00th=[ 56], 5.00th=[ 69], 10.00th=[ 79], 20.00th=[ 91], | 30.00th=[ 104], 40.00th=[ 116], 50.00th=[ 128], 60.00th=[ 140], | 70.00th=[ 157], 80.00th=[ 184], 90.00th=[ 226], 95.00th=[ 264], | 99.00th=[ 338], 99.50th=[ 347], 99.90th=[ 359], 99.95th=[ 359], | 99.99th=[ 359] bw ( KiB/s): min= 29, max= 191, per=26.10%, avg=92.64, stdev=37.82, samples=139 iops : min= 1, max= 11, avg= 5.00, stdev= 2.43, samples=139 lat (msec) : 10=0.26%, 20=14.32%, 50=22.79%, 100=22.14%, 250=37.11% lat (msec) : 500=3.39% cpu : usr=0.04%, sys=1.46%, ctx=1307, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145151: Wed Sep 30 13:31:46 2026 read: IOPS=5, BW=94.5KiB/s (96.7kB/s)(6256KiB/66217msec) clat (msec): min=8, max=195, avg=37.78, stdev=33.19 lat (msec): min=8, max=195, avg=37.78, stdev=33.19 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 12], 10.00th=[ 13], 20.00th=[ 17], | 30.00th=[ 21], 40.00th=[ 23], 50.00th=[ 27], 60.00th=[ 31], | 70.00th=[ 36], 80.00th=[ 50], 90.00th=[ 77], 95.00th=[ 116], | 99.00th=[ 180], 99.50th=[ 194], 99.90th=[ 197], 99.95th=[ 197], | 99.99th=[ 197] bw ( KiB/s): min= 31, max= 349, per=30.78%, avg=104.05, stdev=72.91, samples=119 iops : min= 1, max= 21, avg= 5.71, stdev= 4.62, samples=119 write: IOPS=5, BW=91.1KiB/s (93.3kB/s)(6032KiB/66217msec); 0 zone resets clat (msec): min=45, max=352, avg=135.54, stdev=56.57 lat (msec): min=45, max=352, avg=135.55, stdev=56.57 clat percentiles (msec): | 1.00th=[ 50], 5.00th=[ 65], 10.00th=[ 73], 20.00th=[ 86], | 30.00th=[ 101], 40.00th=[ 112], 50.00th=[ 126], 60.00th=[ 140], | 70.00th=[ 161], 80.00th=[ 180], 90.00th=[ 205], 95.00th=[ 241], | 99.00th=[ 321], 99.50th=[ 338], 99.90th=[ 355], 99.95th=[ 355], | 99.99th=[ 355] bw ( KiB/s): min= 31, max= 191, per=25.64%, avg=91.03, stdev=36.24, samples=130 iops : min= 1, max= 11, avg= 4.89, stdev= 2.36, samples=130 lat (msec) : 10=1.17%, 20=14.32%, 50=26.43%, 100=20.05%, 250=35.81% lat (msec) : 500=2.21% cpu : usr=0.06%, sys=1.52%, ctx=1412, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145153: Wed Sep 30 13:31:46 2026 read: IOPS=5, BW=87.6KiB/s (89.7kB/s)(6032KiB/68866msec) clat (msec): min=8, max=184, avg=36.82, stdev=30.44 lat (msec): min=8, max=184, avg=36.82, stdev=30.44 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 17], | 30.00th=[ 20], 40.00th=[ 22], 50.00th=[ 27], 60.00th=[ 32], | 70.00th=[ 38], 80.00th=[ 51], 90.00th=[ 73], 95.00th=[ 100], | 99.00th=[ 163], 99.50th=[ 178], 99.90th=[ 184], 99.95th=[ 184], | 99.99th=[ 184] bw ( KiB/s): min= 31, max= 384, per=28.88%, avg=97.61, stdev=66.24, samples=121 iops : min= 1, max= 24, avg= 5.31, stdev= 4.21, samples=121 write: IOPS=5, BW=90.8KiB/s (93.0kB/s)(6256KiB/68866msec); 0 zone resets clat (msec): min=48, max=404, avg=139.83, stdev=60.19 lat (msec): min=48, max=404, avg=139.84, stdev=60.19 clat percentiles (msec): | 1.00th=[ 51], 5.00th=[ 69], 10.00th=[ 79], 20.00th=[ 92], | 30.00th=[ 101], 40.00th=[ 111], 50.00th=[ 127], 60.00th=[ 138], | 70.00th=[ 161], 80.00th=[ 186], 90.00th=[ 224], 95.00th=[ 259], | 99.00th=[ 334], 99.50th=[ 388], 99.90th=[ 405], 99.95th=[ 405], | 99.99th=[ 405] bw ( KiB/s): min= 29, max= 191, per=25.48%, avg=90.46, stdev=37.71, samples=136 iops : min= 1, max= 11, avg= 4.87, stdev= 2.43, samples=136 lat (msec) : 10=1.04%, 20=14.32%, 50=24.22%, 100=22.92%, 250=34.51% lat (msec) : 500=2.99% cpu : usr=0.06%, sys=1.42%, ctx=1281, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=338KiB/s (346kB/s), 81.1KiB/s-94.5KiB/s (83.0kB/s-96.7kB/s), io=23.4MiB (24.5MB), run=66217-70840msec WRITE: bw=356KiB/s (364kB/s), 90.8KiB/s-92.4KiB/s (93.0kB/s-94.6kB/s), io=24.6MiB (25.8MB), run=66217-70840msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=145170: Wed Sep 30 13:32:08 2026 read: IOPS=1, BW=1178KiB/s (1206kB/s)(7168KiB/6085msec) clat (usec): min=488, max=1802.8k, avg=386010.34, stdev=643647.77 lat (usec): min=488, max=1802.8k, avg=386012.06, stdev=643647.62 clat percentiles (usec): | 1.00th=[ 490], 5.00th=[ 490], 10.00th=[ 490], | 20.00th=[ 619], 30.00th=[ 3949], 40.00th=[ 3949], | 50.00th=[ 208667], 60.00th=[ 333448], 70.00th=[ 333448], | 80.00th=[ 354419], 90.00th=[1803551], 95.00th=[1803551], | 99.00th=[1803551], 99.50th=[1803551], 99.90th=[1803551], | 99.95th=[1803551], 99.99th=[1803551] bw ( KiB/s): min= 1984, max= 6083, per=100.00%, avg=3023.50, stdev=2039.76, samples=4 iops : min= 1, max= 5, avg= 2.00, stdev= 2.00, samples=4 write: IOPS=0, BW=841KiB/s (862kB/s)(5120KiB/6085msec); 0 zone resets clat (msec): min=52, max=2303, avg=635.38, stdev=941.36 lat (msec): min=52, max=2303, avg=635.46, stdev=941.42 clat percentiles (msec): | 1.00th=[ 53], 5.00th=[ 53], 10.00th=[ 53], 20.00th=[ 53], | 30.00th=[ 133], 40.00th=[ 133], 50.00th=[ 326], 60.00th=[ 326], | 70.00th=[ 368], 80.00th=[ 368], 90.00th=[ 2299], 95.00th=[ 2299], | 99.00th=[ 2299], 99.50th=[ 2299], 99.90th=[ 2299], 99.95th=[ 2299], | 99.99th=[ 2299] bw ( KiB/s): min= 1984, max= 4055, per=69.85%, avg=2690.00, stdev=1182.36, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (usec) : 500=8.33%, 750=8.33% lat (msec) : 4=8.33%, 100=8.33%, 250=16.67%, 500=33.33%, 2000=8.33% lat (msec) : >=2000=8.33% cpu : usr=0.02%, sys=5.88%, ctx=198, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145171: Wed Sep 30 13:32:08 2026 read: IOPS=0, BW=275KiB/s (282kB/s)(2048KiB/7445msec) clat (msec): min=2, max=2938, avg=1470.57, stdev=2076.45 lat (msec): min=2, max=2938, avg=1470.57, stdev=2076.45 clat percentiles (msec): | 1.00th=[ 3], 5.00th=[ 3], 10.00th=[ 3], 20.00th=[ 3], | 30.00th=[ 3], 40.00th=[ 3], 50.00th=[ 3], 60.00th=[ 2937], | 70.00th=[ 2937], 80.00th=[ 2937], 90.00th=[ 2937], 95.00th=[ 2937], | 99.00th=[ 2937], 99.50th=[ 2937], 99.90th=[ 2937], 99.95th=[ 2937], | 99.99th=[ 2937] bw ( KiB/s): min= 2031, max= 2039, per=74.00%, avg=2035.00, stdev= 5.66, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1375KiB/s (1408kB/s)(10.0MiB/7445msec); 0 zone resets clat (msec): min=181, max=1675, avg=395.97, stdev=458.60 lat (msec): min=181, max=1675, avg=396.15, stdev=458.55 clat percentiles (msec): | 1.00th=[ 182], 5.00th=[ 182], 10.00th=[ 182], 20.00th=[ 190], | 30.00th=[ 209], 40.00th=[ 211], 50.00th=[ 222], 60.00th=[ 241], | 70.00th=[ 264], 80.00th=[ 275], 90.00th=[ 493], 95.00th=[ 1670], | 99.00th=[ 1670], 99.50th=[ 1670], 99.90th=[ 1670], 99.95th=[ 1670], | 99.99th=[ 1670] bw ( KiB/s): min= 1984, max= 5953, per=83.35%, avg=3210.00, stdev=1772.26, samples=5 iops : min= 1, max= 5, avg= 2.20, stdev= 1.79, samples=5 lat (msec) : 4=8.33%, 250=50.00%, 500=25.00%, 2000=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=7.29%, ctx=279, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145172: Wed Sep 30 13:32:08 2026 read: IOPS=1, BW=1317KiB/s (1349kB/s)(6144KiB/4664msec) clat (usec): min=845, max=990704, avg=321456.25, stdev=378564.57 lat (usec): min=847, max=990705, avg=321458.20, stdev=378564.40 clat percentiles (usec): | 1.00th=[ 848], 5.00th=[ 848], 10.00th=[ 848], 20.00th=[ 2606], | 30.00th=[ 2606], 40.00th=[196084], 50.00th=[196084], 60.00th=[219153], | 70.00th=[517997], 80.00th=[517997], 90.00th=[994051], 95.00th=[994051], | 99.00th=[994051], 99.50th=[994051], 99.90th=[994051], 99.95th=[994051], | 99.99th=[994051] bw ( KiB/s): min= 2039, max= 6144, per=100.00%, avg=3407.33, stdev=2370.02, samples=3 iops : min= 1, max= 6, avg= 2.67, stdev= 2.89, samples=3 write: IOPS=1, BW=1317KiB/s (1349kB/s)(6144KiB/4664msec); 0 zone resets clat (msec): min=125, max=1355, avg=424.74, stdev=478.66 lat (msec): min=125, max=1355, avg=424.84, stdev=478.67 clat percentiles (msec): | 1.00th=[ 126], 5.00th=[ 126], 10.00th=[ 126], 20.00th=[ 163], | 30.00th=[ 163], 40.00th=[ 190], 50.00th=[ 190], 60.00th=[ 190], | 70.00th=[ 527], 80.00th=[ 527], 90.00th=[ 1351], 95.00th=[ 1351], | 99.00th=[ 1351], 99.50th=[ 1351], 99.90th=[ 1351], 99.95th=[ 1351], | 99.99th=[ 1351] bw ( KiB/s): min= 1935, max= 3806, per=61.55%, avg=2370.20, stdev=803.89, samples=5 iops : min= 1, max= 3, avg= 1.60, stdev= 0.89, samples=5 lat (usec) : 1000=8.33% lat (msec) : 4=8.33%, 250=50.00%, 750=16.67%, 1000=8.33%, 2000=8.33% cpu : usr=0.00%, sys=8.54%, ctx=203, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145173: Wed Sep 30 13:32:08 2026 read: IOPS=0, BW=954KiB/s (977kB/s)(5120KiB/5366msec) clat (usec): min=1089, max=1153.0k, avg=363616.26, stdev=467484.84 lat (usec): min=1091, max=1153.0k, avg=363618.09, stdev=467484.67 clat percentiles (usec): | 1.00th=[ 1090], 5.00th=[ 1090], 10.00th=[ 1090], | 20.00th=[ 1090], 30.00th=[ 23462], 40.00th=[ 23462], | 50.00th=[ 312476], 60.00th=[ 312476], 70.00th=[ 329253], | 80.00th=[ 329253], 90.00th=[1149240], 95.00th=[1149240], | 99.00th=[1149240], 99.50th=[1149240], 99.90th=[1149240], | 99.95th=[1149240], 99.99th=[1149240] bw ( KiB/s): min= 2048, max= 6119, per=100.00%, avg=4083.50, stdev=2878.63, samples=2 iops : min= 2, max= 5, avg= 3.50, stdev= 2.12, samples=2 write: IOPS=1, BW=1336KiB/s (1368kB/s)(7168KiB/5366msec); 0 zone resets clat (msec): min=158, max=1116, avg=495.50, stdev=372.60 lat (msec): min=158, max=1117, avg=496.18, stdev=372.48 clat percentiles (msec): | 1.00th=[ 159], 5.00th=[ 159], 10.00th=[ 159], 20.00th=[ 268], | 30.00th=[ 284], 40.00th=[ 284], 50.00th=[ 292], 60.00th=[ 418], | 70.00th=[ 418], 80.00th=[ 927], 90.00th=[ 1116], 95.00th=[ 1116], | 99.00th=[ 1116], 99.50th=[ 1116], 99.90th=[ 1116], 99.95th=[ 1116], | 99.99th=[ 1116] bw ( KiB/s): min= 1861, max= 4063, per=72.40%, avg=2788.20, stdev=1158.09, samples=5 iops : min= 1, max= 3, avg= 1.80, stdev= 1.10, samples=5 lat (msec) : 2=8.33%, 50=8.33%, 250=8.33%, 500=50.00%, 1000=8.33% lat (msec) : 2000=16.67% cpu : usr=0.02%, sys=8.89%, ctx=210, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2751KiB/s (2817kB/s), 275KiB/s-1317KiB/s (282kB/s-1349kB/s), io=20.0MiB (20.0MB), run=4664-7445msec WRITE: bw=3851KiB/s (3944kB/s), 841KiB/s-1375KiB/s (862kB/s-1408kB/s), io=28.0MiB (29.4MB), run=4664-7445msec rand-rw: (groupid=0, jobs=1): err= 0: pid=145175: Wed Sep 30 13:32:10 2026 read: IOPS=1, BW=1135KiB/s (1162kB/s)(7168KiB/6315msec) clat (msec): min=114, max=1249, avg=374.50, stdev=401.85 lat (msec): min=114, max=1249, avg=374.50, stdev=401.85 clat percentiles (msec): | 1.00th=[ 114], 5.00th=[ 114], 10.00th=[ 114], 20.00th=[ 114], | 30.00th=[ 190], 40.00th=[ 190], 50.00th=[ 209], 60.00th=[ 317], | 70.00th=[ 317], 80.00th=[ 430], 90.00th=[ 1250], 95.00th=[ 1250], | 99.00th=[ 1250], 99.50th=[ 1250], 99.90th=[ 1250], 99.95th=[ 1250], | 99.99th=[ 1250] bw ( KiB/s): min= 1943, max= 3992, per=98.29%, avg=2384.60, stdev=899.24, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 write: IOPS=0, BW=811KiB/s (830kB/s)(5120KiB/6315msec); 0 zone resets clat (msec): min=143, max=1760, avg=733.37, stdev=633.43 lat (msec): min=143, max=1760, avg=733.72, stdev=633.23 clat percentiles (msec): | 1.00th=[ 144], 5.00th=[ 144], 10.00th=[ 144], 20.00th=[ 144], | 30.00th=[ 288], 40.00th=[ 288], 50.00th=[ 684], 60.00th=[ 684], | 70.00th=[ 793], 80.00th=[ 793], 90.00th=[ 1754], 95.00th=[ 1754], | 99.00th=[ 1754], 99.50th=[ 1754], 99.90th=[ 1754], 99.95th=[ 1754], | 99.99th=[ 1754] bw ( KiB/s): min= 1961, max= 3886, per=72.72%, avg=2469.50, stdev=944.82, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (msec) : 250=41.67%, 500=25.00%, 750=8.33%, 1000=8.33%, 2000=16.67% cpu : usr=0.00%, sys=2.64%, ctx=83, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145176: Wed Sep 30 13:32:10 2026 read: IOPS=0, BW=243KiB/s (248kB/s)(2048KiB/8441msec) clat (msec): min=146, max=3163, avg=1655.04, stdev=2133.16 lat (msec): min=146, max=3163, avg=1655.04, stdev=2133.17 clat percentiles (msec): | 1.00th=[ 146], 5.00th=[ 146], 10.00th=[ 146], 20.00th=[ 146], | 30.00th=[ 146], 40.00th=[ 146], 50.00th=[ 146], 60.00th=[ 3171], | 70.00th=[ 3171], 80.00th=[ 3171], 90.00th=[ 3171], 95.00th=[ 3171], | 99.00th=[ 3171], 99.50th=[ 3171], 99.90th=[ 3171], 99.95th=[ 3171], | 99.99th=[ 3171] bw ( KiB/s): min= 2035, max= 2035, per=83.88%, avg=2035.00, stdev= 0.00, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1213KiB/s (1242kB/s)(10.0MiB/8441msec); 0 zone resets clat (msec): min=251, max=1584, avg=509.55, stdev=409.94 lat (msec): min=252, max=1584, avg=509.72, stdev=409.90 clat percentiles (msec): | 1.00th=[ 253], 5.00th=[ 253], 10.00th=[ 253], 20.00th=[ 262], | 30.00th=[ 296], 40.00th=[ 305], 50.00th=[ 338], 60.00th=[ 347], | 70.00th=[ 401], 80.00th=[ 542], 90.00th=[ 776], 95.00th=[ 1586], | 99.00th=[ 1586], 99.50th=[ 1586], 99.90th=[ 1586], 99.95th=[ 1586], | 99.99th=[ 1586] bw ( KiB/s): min= 1943, max= 4071, per=76.15%, avg=2586.14, stdev=988.17, samples=7 iops : min= 1, max= 3, avg= 1.57, stdev= 0.98, samples=7 lat (msec) : 250=8.33%, 500=58.33%, 750=8.33%, 1000=8.33%, 2000=8.33% lat (msec) : >=2000=8.33% cpu : usr=0.00%, sys=1.98%, ctx=61, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145177: Wed Sep 30 13:32:10 2026 read: IOPS=0, BW=767KiB/s (785kB/s)(6144KiB/8014msec) clat (msec): min=182, max=420, avg=299.76, stdev=77.48 lat (msec): min=182, max=420, avg=299.76, stdev=77.48 clat percentiles (msec): | 1.00th=[ 184], 5.00th=[ 184], 10.00th=[ 184], 20.00th=[ 279], | 30.00th=[ 279], 40.00th=[ 284], 50.00th=[ 284], 60.00th=[ 305], | 70.00th=[ 330], 80.00th=[ 330], 90.00th=[ 422], 95.00th=[ 422], | 99.00th=[ 422], 99.50th=[ 422], 99.90th=[ 422], 99.95th=[ 422], | 99.99th=[ 422] bw ( KiB/s): min= 1943, max= 2035, per=82.48%, avg=2001.00, stdev=45.21, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 write: IOPS=0, BW=767KiB/s (785kB/s)(6144KiB/8014msec); 0 zone resets clat (msec): min=355, max=3594, avg=1015.20, stdev=1268.66 lat (msec): min=355, max=3594, avg=1015.36, stdev=1268.69 clat percentiles (msec): | 1.00th=[ 355], 5.00th=[ 355], 10.00th=[ 355], 20.00th=[ 409], | 30.00th=[ 409], 40.00th=[ 493], 50.00th=[ 493], 60.00th=[ 575], | 70.00th=[ 667], 80.00th=[ 667], 90.00th=[ 3608], 95.00th=[ 3608], | 99.00th=[ 3608], 99.50th=[ 3608], 99.90th=[ 3608], 99.95th=[ 3608], | 99.99th=[ 3608] bw ( KiB/s): min= 1943, max= 2035, per=58.74%, avg=1994.83, stdev=36.93, samples=6 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=6 lat (msec) : 250=8.33%, 500=66.67%, 750=16.67%, >=2000=8.33% cpu : usr=0.05%, sys=1.58%, ctx=54, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145178: Wed Sep 30 13:32:10 2026 read: IOPS=0, BW=616KiB/s (631kB/s)(5120KiB/8306msec) clat (msec): min=101, max=881, avg=413.18, stdev=307.28 lat (msec): min=101, max=881, avg=413.18, stdev=307.28 clat percentiles (msec): | 1.00th=[ 102], 5.00th=[ 102], 10.00th=[ 102], 20.00th=[ 102], | 30.00th=[ 222], 40.00th=[ 222], 50.00th=[ 326], 60.00th=[ 326], | 70.00th=[ 542], 80.00th=[ 542], 90.00th=[ 885], 95.00th=[ 885], | 99.00th=[ 885], 99.50th=[ 885], 99.90th=[ 885], 99.95th=[ 885], | 99.99th=[ 885] bw ( KiB/s): min= 2035, max= 4071, per=100.00%, avg=2713.67, stdev=1175.49, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 write: IOPS=0, BW=863KiB/s (884kB/s)(7168KiB/8306msec); 0 zone resets clat (msec): min=278, max=3480, avg=870.12, stdev=1172.37 lat (msec): min=278, max=3481, avg=870.23, stdev=1172.39 clat percentiles (msec): | 1.00th=[ 279], 5.00th=[ 279], 10.00th=[ 279], 20.00th=[ 300], | 30.00th=[ 317], 40.00th=[ 317], 50.00th=[ 321], 60.00th=[ 485], | 70.00th=[ 485], 80.00th=[ 911], 90.00th=[ 3473], 95.00th=[ 3473], | 99.00th=[ 3473], 99.50th=[ 3473], 99.90th=[ 3473], 99.95th=[ 3473], | 99.99th=[ 3473] bw ( KiB/s): min= 1996, max= 4063, per=69.34%, avg=2354.67, stdev=837.11, samples=6 iops : min= 1, max= 3, avg= 1.33, stdev= 0.82, samples=6 lat (msec) : 250=16.67%, 500=50.00%, 750=8.33%, 1000=16.67%, >=2000=8.33% cpu : usr=0.00%, sys=1.52%, ctx=63, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2426KiB/s (2484kB/s), 243KiB/s-1135KiB/s (248kB/s-1162kB/s), io=20.0MiB (20.0MB), run=6315-8441msec WRITE: bw=3397KiB/s (3478kB/s), 767KiB/s-1213KiB/s (785kB/s-1242kB/s), io=28.0MiB (29.4MB), run=6315-8441msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=145187: Wed Sep 30 13:32:30 2026 read: IOPS=0, BW=2952KiB/s (3023kB/s)(12.0MiB/4163msec) clat (msec): min=876, max=1784, avg=1342.86, stdev=454.78 lat (msec): min=876, max=1784, avg=1342.86, stdev=454.78 clat percentiles (msec): | 1.00th=[ 877], 5.00th=[ 877], 10.00th=[ 877], 20.00th=[ 877], | 30.00th=[ 877], 40.00th=[ 1368], 50.00th=[ 1368], 60.00th=[ 1368], | 70.00th=[ 1787], 80.00th=[ 1787], 90.00th=[ 1787], 95.00th=[ 1787], | 99.00th=[ 1787], 99.50th=[ 1787], 99.90th=[ 1787], 99.95th=[ 1787], | 99.99th=[ 1787] bw ( KiB/s): min= 8110, max= 8192, per=100.00%, avg=8151.00, stdev=57.98, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 1000=33.33%, 2000=66.67% cpu : usr=0.00%, sys=1.63%, ctx=36, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145189: Wed Sep 30 13:32:30 2026 read: IOPS=0, BW=835KiB/s (855kB/s)(4096KiB/4908msec) clat (nsec): min=2319.2M, max=2319.2M, avg=2319199878.00, stdev= 0.00 lat (nsec): min=2319.2M, max=2319.2M, avg=2319203878.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 2333], 5.00th=[ 2333], 10.00th=[ 2333], 20.00th=[ 2333], | 30.00th=[ 2333], 40.00th=[ 2333], 50.00th=[ 2333], 60.00th=[ 2333], | 70.00th=[ 2333], 80.00th=[ 2333], 90.00th=[ 2333], 95.00th=[ 2333], | 99.00th=[ 2333], 99.50th=[ 2333], 99.90th=[ 2333], 99.95th=[ 2333], | 99.99th=[ 2333] bw ( KiB/s): min= 8192, max= 8192, per=100.00%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 write: IOPS=0, BW=1669KiB/s (1709kB/s)(8192KiB/4908msec); 0 zone resets clat (msec): min=996, max=1229, avg=1112.92, stdev=164.55 lat (msec): min=997, max=1234, avg=1115.61, stdev=167.65 clat percentiles (msec): | 1.00th=[ 995], 5.00th=[ 995], 10.00th=[ 995], 20.00th=[ 995], | 30.00th=[ 995], 40.00th=[ 995], 50.00th=[ 995], 60.00th=[ 1234], | 70.00th=[ 1234], 80.00th=[ 1234], 90.00th=[ 1234], 95.00th=[ 1234], | 99.00th=[ 1234], 99.50th=[ 1234], 99.90th=[ 1234], 99.95th=[ 1234], | 99.99th=[ 1234] bw ( KiB/s): min= 8126, max= 8126, per=100.00%, avg=8126.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 1000=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=2.26%, ctx=57, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145191: Wed Sep 30 13:32:30 2026 write: IOPS=0, BW=2651KiB/s (2715kB/s)(12.0MiB/4635msec); 0 zone resets clat (msec): min=476, max=2766, avg=1502.98, stdev=1162.99 lat (msec): min=477, max=2766, avg=1503.64, stdev=1162.94 clat percentiles (msec): | 1.00th=[ 477], 5.00th=[ 477], 10.00th=[ 477], 20.00th=[ 477], | 30.00th=[ 477], 40.00th=[ 1267], 50.00th=[ 1267], 60.00th=[ 1267], | 70.00th=[ 2769], 80.00th=[ 2769], 90.00th=[ 2769], 95.00th=[ 2769], | 99.00th=[ 2769], 99.50th=[ 2769], 99.90th=[ 2769], 99.95th=[ 2769], | 99.99th=[ 2769] bw ( KiB/s): min= 7772, max= 7772, per=100.00%, avg=7772.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=3.54%, ctx=66, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145192: Wed Sep 30 13:32:30 2026 write: IOPS=0, BW=3604KiB/s (3690kB/s)(12.0MiB/3410msec); 0 zone resets clat (msec): min=570, max=1582, avg=1046.89, stdev=508.48 lat (msec): min=570, max=1582, avg=1047.42, stdev=508.49 clat percentiles (msec): | 1.00th=[ 575], 5.00th=[ 575], 10.00th=[ 575], 20.00th=[ 575], | 30.00th=[ 575], 40.00th=[ 986], 50.00th=[ 986], 60.00th=[ 986], | 70.00th=[ 1586], 80.00th=[ 1586], 90.00th=[ 1586], 95.00th=[ 1586], | 99.00th=[ 1586], 99.50th=[ 1586], 99.90th=[ 1586], 99.95th=[ 1586], | 99.99th=[ 1586] bw ( KiB/s): min= 8143, max= 8143, per=100.00%, avg=8143.00, stdev= 0.00, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=2.96%, ctx=51, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3338KiB/s (3418kB/s), 835KiB/s-2952KiB/s (855kB/s-3023kB/s), io=16.0MiB (16.8MB), run=4163-4908msec WRITE: bw=6676KiB/s (6837kB/s), 1669KiB/s-3604KiB/s (1709kB/s-3690kB/s), io=32.0MiB (33.6MB), run=3410-4908msec rand-rw: (groupid=0, jobs=1): err= 0: pid=145186: Wed Sep 30 13:32:30 2026 read: IOPS=0, BW=3533KiB/s (3618kB/s)(12.0MiB/3478msec) clat (msec): min=861, max=1240, avg=1106.89, stdev=213.16 lat (msec): min=861, max=1240, avg=1106.89, stdev=213.16 clat percentiles (msec): | 1.00th=[ 860], 5.00th=[ 860], 10.00th=[ 860], 20.00th=[ 860], | 30.00th=[ 860], 40.00th=[ 1217], 50.00th=[ 1217], 60.00th=[ 1217], | 70.00th=[ 1234], 80.00th=[ 1234], 90.00th=[ 1234], 95.00th=[ 1234], | 99.00th=[ 1234], 99.50th=[ 1234], 99.90th=[ 1234], 99.95th=[ 1234], | 99.99th=[ 1234] bw ( KiB/s): min= 8175, max= 8192, per=100.00%, avg=8183.50, stdev=12.02, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 1000=33.33%, 2000=66.67% cpu : usr=0.00%, sys=9.61%, ctx=278, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145188: Wed Sep 30 13:32:30 2026 read: IOPS=0, BW=962KiB/s (985kB/s)(4096KiB/4260msec) clat (nsec): min=1660.0M, max=1660.0M, avg=1660044972.00, stdev= 0.00 lat (nsec): min=1660.0M, max=1660.0M, avg=1660047801.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1653], 5.00th=[ 1653], 10.00th=[ 1653], 20.00th=[ 1653], | 30.00th=[ 1653], 40.00th=[ 1653], 50.00th=[ 1653], 60.00th=[ 1653], | 70.00th=[ 1653], 80.00th=[ 1653], 90.00th=[ 1653], 95.00th=[ 1653], | 99.00th=[ 1653], 99.50th=[ 1653], 99.90th=[ 1653], 99.95th=[ 1653], | 99.99th=[ 1653] bw ( KiB/s): min= 8192, max= 8192, per=100.00%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 write: IOPS=0, BW=1923KiB/s (1969kB/s)(8192KiB/4260msec); 0 zone resets clat (msec): min=733, max=1819, avg=1276.54, stdev=768.46 lat (msec): min=733, max=1820, avg=1277.07, stdev=768.42 clat percentiles (msec): | 1.00th=[ 735], 5.00th=[ 735], 10.00th=[ 735], 20.00th=[ 735], | 30.00th=[ 735], 40.00th=[ 735], 50.00th=[ 735], 60.00th=[ 1821], | 70.00th=[ 1821], 80.00th=[ 1821], 90.00th=[ 1821], 95.00th=[ 1821], | 99.00th=[ 1821], 99.50th=[ 1821], 99.90th=[ 1821], 99.95th=[ 1821], | 99.99th=[ 1821] bw ( KiB/s): min= 8078, max= 8078, per=100.00%, avg=8078.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, 2000=66.67% cpu : usr=0.07%, sys=4.95%, ctx=105, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145190: Wed Sep 30 13:32:30 2026 write: IOPS=0, BW=2333KiB/s (2389kB/s)(12.0MiB/5266msec); 0 zone resets clat (msec): min=331, max=3993, avg=1729.04, stdev=1978.56 lat (msec): min=332, max=3994, avg=1730.15, stdev=1978.92 clat percentiles (msec): | 1.00th=[ 334], 5.00th=[ 334], 10.00th=[ 334], 20.00th=[ 334], | 30.00th=[ 334], 40.00th=[ 860], 50.00th=[ 860], 60.00th=[ 860], | 70.00th=[ 4010], 80.00th=[ 4010], 90.00th=[ 4010], 95.00th=[ 4010], | 99.00th=[ 4010], 99.50th=[ 4010], 99.90th=[ 4010], 99.95th=[ 4010], | 99.99th=[ 4010] bw ( KiB/s): min= 8159, max= 8175, per=100.00%, avg=8167.00, stdev=11.31, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 1000=33.33%, >=2000=33.33% cpu : usr=0.08%, sys=2.79%, ctx=72, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145193: Wed Sep 30 13:32:30 2026 write: IOPS=0, BW=2835KiB/s (2903kB/s)(12.0MiB/4335msec); 0 zone resets clat (msec): min=846, max=1754, avg=1347.43, stdev=461.33 lat (msec): min=848, max=1755, avg=1348.53, stdev=460.40 clat percentiles (msec): | 1.00th=[ 844], 5.00th=[ 844], 10.00th=[ 844], 20.00th=[ 844], | 30.00th=[ 844], 40.00th=[ 1435], 50.00th=[ 1435], 60.00th=[ 1435], | 70.00th=[ 1754], 80.00th=[ 1754], 90.00th=[ 1754], 95.00th=[ 1754], | 99.00th=[ 1754], 99.50th=[ 1754], 99.90th=[ 1754], 99.95th=[ 1754], | 99.99th=[ 1754] bw ( KiB/s): min= 8078, max= 8192, per=100.00%, avg=8135.00, stdev=80.61, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 1000=33.33%, 2000=66.67% cpu : usr=0.12%, sys=3.46%, ctx=73, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3846KiB/s (3938kB/s), 962KiB/s-3533KiB/s (985kB/s-3618kB/s), io=16.0MiB (16.8MB), run=3478-4260msec WRITE: bw=6223KiB/s (6372kB/s), 1923KiB/s-2835KiB/s (1969kB/s-2903kB/s), io=32.0MiB (33.6MB), run=4260-5266msec