== sanity test 398b: DIO and buffer IO race ============== 09:12:08 (1788441128) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 7.46181 s, 6.7 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144470: Thu Sep 3 09:14:48 2026 read: IOPS=10, BW=43.5KiB/s (44.5kB/s)(5992KiB/137835msec) clat (usec): min=30, max=550858, avg=45260.08, stdev=38999.24 lat (usec): min=30, max=550859, avg=45264.03, stdev=38999.61 clat percentiles (usec): | 1.00th=[ 53], 5.00th=[ 64], 10.00th=[ 130], 20.00th=[ 19268], | 30.00th=[ 25035], 40.00th=[ 31065], 50.00th=[ 36963], 60.00th=[ 43779], | 70.00th=[ 54264], 80.00th=[ 67634], 90.00th=[ 89654], 95.00th=[109577], | 99.00th=[164627], 99.50th=[229639], 99.90th=[362808], 99.95th=[549454], | 99.99th=[549454] bw ( KiB/s): min= 7, max= 119, per=24.75%, avg=43.07, stdev=20.43, samples=271 iops : min= 1, max= 29, avg=10.14, stdev= 5.15, samples=271 write: IOPS=11, BW=45.7KiB/s (46.8kB/s)(6296KiB/137835msec); 0 zone resets clat (usec): min=925, max=649988, avg=44385.32, stdev=50297.73 lat (usec): min=926, max=649989, avg=44392.31, stdev=50298.96 clat percentiles (usec): | 1.00th=[ 1090], 5.00th=[ 1287], 10.00th=[ 1860], 20.00th=[ 4113], | 30.00th=[ 8160], 40.00th=[ 17957], 50.00th=[ 30278], 60.00th=[ 42730], | 70.00th=[ 57934], 80.00th=[ 77071], 90.00th=[107480], 95.00th=[135267], | 99.00th=[202376], 99.50th=[221250], 99.90th=[557843], 99.95th=[650118], | 99.99th=[650118] bw ( KiB/s): min= 6, max= 112, per=24.78%, avg=45.10, stdev=21.00, samples=272 iops : min= 1, max= 28, avg=10.65, stdev= 5.30, samples=272 lat (usec) : 50=0.33%, 100=4.36%, 250=0.42%, 500=0.26%, 750=0.07% lat (usec) : 1000=0.10% lat (msec) : 2=5.60%, 4=4.43%, 10=7.10%, 20=9.08%, 50=33.82% lat (msec) : 100=24.80%, 250=9.28%, 500=0.26%, 750=0.10% cpu : usr=0.07%, sys=5.50%, ctx=6633, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144471: Thu Sep 3 09:14:48 2026 read: IOPS=10, BW=43.7KiB/s (44.7kB/s)(5940KiB/136042msec) clat (usec): min=33, max=379431, avg=42388.69, stdev=34240.16 lat (usec): min=33, max=379433, avg=42390.36, stdev=34240.17 clat percentiles (usec): | 1.00th=[ 50], 5.00th=[ 63], 10.00th=[ 92], 20.00th=[ 18744], | 30.00th=[ 23987], 40.00th=[ 29230], 50.00th=[ 34866], 60.00th=[ 41681], | 70.00th=[ 50070], 80.00th=[ 64226], 90.00th=[ 86508], 95.00th=[103285], | 99.00th=[156238], 99.50th=[175113], 99.90th=[299893], 99.95th=[379585], | 99.99th=[379585] bw ( KiB/s): min= 6, max= 111, per=25.14%, avg=43.75, stdev=19.87, samples=265 iops : min= 1, max= 27, avg=10.31, stdev= 5.01, samples=265 write: IOPS=11, BW=46.7KiB/s (47.8kB/s)(6348KiB/136042msec); 0 zone resets clat (usec): min=879, max=309602, avg=45960.24, stdev=47774.03 lat (usec): min=880, max=309604, avg=45962.48, stdev=47773.64 clat percentiles (usec): | 1.00th=[ 1074], 5.00th=[ 1287], 10.00th=[ 1827], 20.00th=[ 4555], | 30.00th=[ 8717], 40.00th=[ 19530], 50.00th=[ 32113], 60.00th=[ 46400], | 70.00th=[ 61080], 80.00th=[ 81265], 90.00th=[111674], 95.00th=[137364], | 99.00th=[210764], 99.50th=[223347], 99.90th=[291505], 99.95th=[308282], | 99.99th=[308282] bw ( KiB/s): min= 6, max= 119, per=25.46%, avg=46.34, stdev=21.25, samples=267 iops : min= 1, max= 29, avg=10.96, stdev= 5.35, samples=267 lat (usec) : 50=0.39%, 100=4.62%, 250=0.52%, 500=0.07%, 750=0.03% lat (usec) : 1000=0.13% lat (msec) : 2=5.66%, 4=4.00%, 10=7.03%, 20=8.98%, 50=34.70% lat (msec) : 100=24.22%, 250=9.38%, 500=0.26% cpu : usr=0.08%, sys=5.44%, ctx=6574, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144472: Thu Sep 3 09:14:48 2026 read: IOPS=10, BW=43.8KiB/s (44.9kB/s)(6028KiB/137585msec) clat (usec): min=29, max=647143, avg=43259.44, stdev=38676.70 lat (usec): min=29, max=647144, avg=43264.48, stdev=38675.03 clat percentiles (usec): | 1.00th=[ 51], 5.00th=[ 66], 10.00th=[ 200], 20.00th=[ 18744], | 30.00th=[ 25035], 40.00th=[ 30278], 50.00th=[ 35914], 60.00th=[ 43254], | 70.00th=[ 52167], 80.00th=[ 64750], 90.00th=[ 81265], 95.00th=[103285], | 99.00th=[160433], 99.50th=[181404], 99.90th=[608175], 99.95th=[650118], | 99.99th=[650118] bw ( KiB/s): min= 7, max= 103, per=24.89%, avg=43.31, stdev=21.03, samples=270 iops : min= 1, max= 25, avg=10.20, stdev= 5.28, samples=270 write: IOPS=11, BW=45.5KiB/s (46.6kB/s)(6260KiB/137585msec); 0 zone resets clat (usec): min=935, max=487057, avg=46127.58, stdev=50225.28 lat (usec): min=935, max=487059, avg=46138.34, stdev=50219.20 clat percentiles (usec): | 1.00th=[ 1074], 5.00th=[ 1336], 10.00th=[ 1991], 20.00th=[ 4948], | 30.00th=[ 9634], 40.00th=[ 19268], 50.00th=[ 32637], 60.00th=[ 44303], | 70.00th=[ 60031], 80.00th=[ 78119], 90.00th=[108528], 95.00th=[143655], | 99.00th=[214959], 99.50th=[246416], 99.90th=[341836], 99.95th=[488637], | 99.99th=[488637] bw ( KiB/s): min= 6, max= 136, per=24.59%, avg=44.76, stdev=21.11, samples=271 iops : min= 1, max= 34, avg=10.57, stdev= 5.34, samples=271 lat (usec) : 50=0.42%, 100=3.84%, 250=0.72%, 500=0.20%, 750=0.10% lat (usec) : 1000=0.03% lat (msec) : 2=5.24%, 4=3.74%, 10=6.93%, 20=9.96%, 50=34.70% lat (msec) : 100=25.33%, 250=8.53%, 500=0.20%, 750=0.07% cpu : usr=0.07%, sys=5.28%, ctx=6612, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144473: Thu Sep 3 09:14:48 2026 read: IOPS=10, BW=43.9KiB/s (45.0kB/s)(6052KiB/137708msec) clat (usec): min=32, max=552813, avg=43314.44, stdev=37649.86 lat (usec): min=33, max=552814, avg=43318.30, stdev=37649.38 clat percentiles (usec): | 1.00th=[ 47], 5.00th=[ 65], 10.00th=[ 102], 20.00th=[ 18482], | 30.00th=[ 24249], 40.00th=[ 29754], 50.00th=[ 34866], 60.00th=[ 41681], | 70.00th=[ 52691], 80.00th=[ 65799], 90.00th=[ 87557], 95.00th=[108528], | 99.00th=[156238], 99.50th=[198181], 99.90th=[371196], 99.95th=[549454], | 99.99th=[549454] bw ( KiB/s): min= 7, max= 112, per=25.73%, avg=44.77, stdev=20.66, samples=264 iops : min= 1, max= 28, avg=10.57, stdev= 5.20, samples=264 write: IOPS=11, BW=45.3KiB/s (46.4kB/s)(6236KiB/137708msec); 0 zone resets clat (usec): min=996, max=640370, avg=46178.71, stdev=53649.47 lat (usec): min=996, max=640373, avg=46184.81, stdev=53657.15 clat percentiles (usec): | 1.00th=[ 1106], 5.00th=[ 1287], 10.00th=[ 1827], 20.00th=[ 4621], | 30.00th=[ 8848], 40.00th=[ 19006], 50.00th=[ 29754], 60.00th=[ 42206], | 70.00th=[ 58459], 80.00th=[ 77071], 90.00th=[115868], 95.00th=[149947], | 99.00th=[217056], 99.50th=[287310], 99.90th=[484443], 99.95th=[641729], | 99.99th=[641729] bw ( KiB/s): min= 6, max= 120, per=24.67%, avg=44.90, stdev=20.73, samples=271 iops : min= 1, max= 30, avg=10.60, stdev= 5.23, samples=271 lat (usec) : 50=0.62%, 100=4.23%, 250=0.59%, 500=0.20%, 750=0.07% lat (usec) : 1000=0.07% lat (msec) : 2=5.57%, 4=3.45%, 10=7.29%, 20=9.86%, 50=34.41% lat (msec) : 100=23.76%, 250=9.41%, 500=0.42%, 750=0.07% cpu : usr=0.09%, sys=5.41%, ctx=6600, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=174KiB/s (178kB/s), 43.5KiB/s-43.9KiB/s (44.5kB/s-45.0kB/s), io=23.4MiB (24.6MB), run=136042-137835msec WRITE: bw=182KiB/s (187kB/s), 45.3KiB/s-46.7KiB/s (46.4kB/s-47.8kB/s), io=24.6MiB (25.7MB), run=136042-137835msec fio: pid=144464, err=5/file:backend.c:481, func=full resid, error=Input/output error fio: pid=144466, err=5/file:backend.c:481, func=full resid, error=Input/output error rand-rw: (groupid=0, jobs=1): err= 5 (file:backend.c:481, func=full resid, error=Input/output error): pid=144464: Thu Sep 3 09:16:47 2026 read: IOPS=4, BW=16.7KiB/s (17.1kB/s)(2856KiB/171350msec) clat (msec): min=6, max=1092, avg=53.91, stdev=61.06 lat (msec): min=6, max=1092, avg=53.91, stdev=61.05 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 18], | 30.00th=[ 23], 40.00th=[ 29], 50.00th=[ 38], 60.00th=[ 50], | 70.00th=[ 63], 80.00th=[ 80], 90.00th=[ 114], 95.00th=[ 140], | 99.00th=[ 239], 99.50th=[ 275], 99.90th=[ 1099], 99.95th=[ 1099], | 99.99th=[ 1099] bw ( KiB/s): min= 7, max= 87, per=29.31%, avg=20.23, stdev=14.52, samples=269 iops : min= 1, max= 21, avg= 4.40, stdev= 3.64, samples=269 write: IOPS=4, BW=17.4KiB/s (17.8kB/s)(2980KiB/171350msec); 0 zone resets clat (msec): min=47, max=685, avg=177.77, stdev=91.72 lat (msec): min=47, max=685, avg=177.78, stdev=91.72 clat percentiles (msec): | 1.00th=[ 59], 5.00th=[ 77], 10.00th=[ 85], 20.00th=[ 104], | 30.00th=[ 122], 40.00th=[ 138], 50.00th=[ 157], 60.00th=[ 182], | 70.00th=[ 203], 80.00th=[ 245], 90.00th=[ 292], 95.00th=[ 342], | 99.00th=[ 531], 99.50th=[ 625], 99.90th=[ 684], 99.95th=[ 684], | 99.99th=[ 684] bw ( KiB/s): min= 7, max= 47, per=23.90%, avg=17.21, stdev= 9.05, samples=328 iops : min= 1, max= 11, avg= 3.64, stdev= 2.30, samples=328 lat (msec) : 10=2.19%, 20=10.41%, 50=17.40%, 100=21.85%, 250=38.49% lat (msec) : 500=8.97%, 750=0.55%, 2000=0.07% cpu : usr=0.03%, sys=0.95%, ctx=2158, majf=0, minf=20 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=715,745,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144465: Thu Sep 3 09:16:47 2026 read: IOPS=5, BW=23.0KiB/s (23.6kB/s)(5940KiB/257954msec) clat (msec): min=5, max=1099, avg=35.47, stdev=47.36 lat (msec): min=5, max=1099, avg=35.47, stdev=47.37 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 13], | 30.00th=[ 15], 40.00th=[ 18], 50.00th=[ 21], 60.00th=[ 27], | 70.00th=[ 34], 80.00th=[ 47], 90.00th=[ 82], 95.00th=[ 113], | 99.00th=[ 182], 99.50th=[ 220], 99.90th=[ 451], 99.95th=[ 1099], | 99.99th=[ 1099] bw ( KiB/s): min= 7, max= 103, per=38.42%, avg=26.51, stdev=18.54, samples=434 iops : min= 1, max= 25, avg= 5.99, stdev= 4.68, samples=434 write: IOPS=6, BW=24.6KiB/s (25.2kB/s)(6348KiB/257954msec); 0 zone resets clat (msec): min=40, max=696, avg=129.07, stdev=79.94 lat (msec): min=40, max=696, avg=129.08, stdev=79.94 clat percentiles (msec): | 1.00th=[ 46], 5.00th=[ 56], 10.00th=[ 63], 20.00th=[ 72], | 30.00th=[ 82], 40.00th=[ 91], 50.00th=[ 103], 60.00th=[ 117], | 70.00th=[ 140], 80.00th=[ 176], 90.00th=[ 236], 95.00th=[ 300], | 99.00th=[ 401], 99.50th=[ 472], 99.90th=[ 676], 99.95th=[ 701], | 99.99th=[ 701] bw ( KiB/s): min= 7, max= 56, per=34.05%, avg=24.52, stdev=13.23, samples=500 iops : min= 1, max= 14, avg= 5.49, stdev= 3.35, samples=500 lat (msec) : 10=4.82%, 20=18.68%, 50=16.93%, 100=29.23%, 250=25.68% lat (msec) : 500=4.43%, 750=0.20%, 2000=0.03% cpu : usr=0.05%, sys=1.21%, ctx=5836, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 5 (file:backend.c:481, func=full resid, error=Input/output error): pid=144466: Thu Sep 3 09:16:47 2026 read: IOPS=4, BW=17.4KiB/s (17.8kB/s)(3016KiB/173404msec) clat (msec): min=5, max=513, avg=53.24, stdev=47.56 lat (msec): min=5, max=513, avg=53.24, stdev=47.56 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 18], | 30.00th=[ 23], 40.00th=[ 30], 50.00th=[ 39], 60.00th=[ 52], | 70.00th=[ 65], 80.00th=[ 84], 90.00th=[ 109], 95.00th=[ 138], | 99.00th=[ 199], 99.50th=[ 271], 99.90th=[ 514], 99.95th=[ 514], | 99.99th=[ 514] bw ( KiB/s): min= 7, max= 103, per=28.46%, avg=19.64, stdev=14.26, samples=292 iops : min= 1, max= 25, avg= 4.25, stdev= 3.57, samples=292 write: IOPS=4, BW=17.6KiB/s (18.0kB/s)(3056KiB/173404msec); 0 zone resets clat (msec): min=46, max=1195, avg=173.88, stdev=93.45 lat (msec): min=46, max=1195, avg=173.88, stdev=93.45 clat percentiles (msec): | 1.00th=[ 58], 5.00th=[ 73], 10.00th=[ 83], 20.00th=[ 101], | 30.00th=[ 118], 40.00th=[ 136], 50.00th=[ 155], 60.00th=[ 176], | 70.00th=[ 197], 80.00th=[ 236], 90.00th=[ 288], 95.00th=[ 342], | 99.00th=[ 456], 99.50th=[ 510], 99.90th=[ 1200], 99.95th=[ 1200], | 99.99th=[ 1200] bw ( KiB/s): min= 7, max= 47, per=24.54%, avg=17.67, stdev= 9.42, samples=328 iops : min= 1, max= 11, avg= 3.75, stdev= 2.39, samples=328 lat (msec) : 10=1.58%, 20=10.07%, 50=17.45%, 100=24.03%, 250=38.05% lat (msec) : 500=8.36%, 750=0.33%, 2000=0.07% cpu : usr=0.03%, sys=1.03%, ctx=2332, majf=0, minf=19 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=755,764,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144467: Thu Sep 3 09:16:47 2026 read: IOPS=5, BW=23.9KiB/s (24.4kB/s)(6052KiB/253538msec) clat (msec): min=5, max=457, avg=35.94, stdev=40.93 lat (msec): min=5, max=457, avg=35.94, stdev=40.93 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 10], 20.00th=[ 13], | 30.00th=[ 15], 40.00th=[ 18], 50.00th=[ 21], 60.00th=[ 26], | 70.00th=[ 33], 80.00th=[ 50], 90.00th=[ 86], 95.00th=[ 120], | 99.00th=[ 184], 99.50th=[ 226], 99.90th=[ 439], 99.95th=[ 460], | 99.99th=[ 460] bw ( KiB/s): min= 7, max= 95, per=39.33%, avg=27.14, stdev=19.11, samples=432 iops : min= 1, max= 23, avg= 6.15, stdev= 4.80, samples=432 write: IOPS=6, BW=24.6KiB/s (25.2kB/s)(6236KiB/253538msec); 0 zone resets clat (msec): min=34, max=1197, avg=127.46, stdev=80.97 lat (msec): min=34, max=1197, avg=127.46, stdev=80.97 clat percentiles (msec): | 1.00th=[ 47], 5.00th=[ 55], 10.00th=[ 62], 20.00th=[ 71], | 30.00th=[ 81], 40.00th=[ 90], 50.00th=[ 102], 60.00th=[ 117], | 70.00th=[ 140], 80.00th=[ 174], 90.00th=[ 232], 95.00th=[ 284], | 99.00th=[ 384], 99.50th=[ 443], 99.90th=[ 667], 99.95th=[ 1200], | 99.99th=[ 1200] bw ( KiB/s): min= 7, max= 63, per=34.11%, avg=24.56, stdev=13.38, samples=490 iops : min= 1, max= 15, avg= 5.50, stdev= 3.39, samples=490 lat (msec) : 10=5.27%, 20=18.29%, 50=17.19%, 100=29.79%, 250=25.03% lat (msec) : 500=4.26%, 750=0.13%, 2000=0.03% cpu : usr=0.04%, sys=1.26%, ctx=5726, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=69.3KiB/s (70.9kB/s), 16.7KiB/s-23.9KiB/s (17.1kB/s-24.4kB/s), io=17.4MiB (18.3MB), run=171350-257954msec WRITE: bw=72.2KiB/s (73.9kB/s), 17.4KiB/s-24.6KiB/s (17.8kB/s-25.2kB/s), io=18.2MiB (19.1MB), run=171350-257954msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144528: Thu Sep 3 09:17:29 2026 read: IOPS=11, BW=181KiB/s (186kB/s)(5920KiB/32638msec) clat (usec): min=41, max=247723, avg=46228.71, stdev=37538.64 lat (usec): min=41, max=247724, avg=46230.28, stdev=37538.29 clat percentiles (usec): | 1.00th=[ 48], 5.00th=[ 63], 10.00th=[ 78], 20.00th=[ 15664], | 30.00th=[ 29492], 40.00th=[ 34866], 50.00th=[ 42730], 60.00th=[ 48497], | 70.00th=[ 55837], 80.00th=[ 67634], 90.00th=[ 89654], 95.00th=[117965], | 99.00th=[193987], 99.50th=[204473], 99.90th=[248513], 99.95th=[248513], | 99.99th=[248513] bw ( KiB/s): min= 31, max= 541, per=25.17%, avg=184.51, stdev=82.28, samples=63 iops : min= 1, max= 33, avg=10.75, stdev= 5.14, samples=63 write: IOPS=12, BW=195KiB/s (200kB/s)(6368KiB/32638msec); 0 zone resets clat (usec): min=1341, max=487245, avg=38546.11, stdev=48099.91 lat (usec): min=1343, max=487246, avg=38548.45, stdev=48100.04 clat percentiles (usec): | 1.00th=[ 1516], 5.00th=[ 2147], 10.00th=[ 3949], 20.00th=[ 6587], | 30.00th=[ 9634], 40.00th=[ 13566], 50.00th=[ 19792], 60.00th=[ 31851], | 70.00th=[ 47449], 80.00th=[ 67634], 90.00th=[ 93848], 95.00th=[115868], | 99.00th=[261096], 99.50th=[291505], 99.90th=[488637], 99.95th=[488637], | 99.99th=[488637] bw ( KiB/s): min= 31, max= 382, per=25.25%, avg=194.92, stdev=88.57, samples=64 iops : min= 1, max= 23, avg=11.41, stdev= 5.61, samples=64 lat (usec) : 50=0.52%, 100=5.34%, 250=1.82%, 750=0.13% lat (msec) : 2=2.34%, 4=3.52%, 10=10.55%, 20=12.24%, 50=30.21% lat (msec) : 100=25.13%, 250=7.55%, 500=0.65% cpu : usr=0.09%, sys=5.78%, ctx=1578, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144529: Thu Sep 3 09:17:29 2026 read: IOPS=11, BW=182KiB/s (186kB/s)(5744KiB/31615msec) clat (usec): min=40, max=195177, avg=44516.09, stdev=34336.52 lat (usec): min=41, max=195177, avg=44517.34, stdev=34336.58 clat percentiles (usec): | 1.00th=[ 46], 5.00th=[ 64], 10.00th=[ 79], 20.00th=[ 17433], | 30.00th=[ 26346], 40.00th=[ 33817], 50.00th=[ 41157], 60.00th=[ 48497], | 70.00th=[ 55313], 80.00th=[ 66323], 90.00th=[ 88605], 95.00th=[108528], | 99.00th=[164627], 99.50th=[179307], 99.90th=[196084], 99.95th=[196084], | 99.99th=[196084] bw ( KiB/s): min= 31, max= 351, per=25.09%, avg=183.90, stdev=83.68, samples=61 iops : min= 1, max= 21, avg=10.70, stdev= 5.30, samples=61 write: IOPS=12, BW=207KiB/s (212kB/s)(6544KiB/31615msec); 0 zone resets clat (usec): min=1447, max=307563, avg=37730.17, stdev=43092.39 lat (usec): min=1450, max=307566, avg=37736.17, stdev=43090.84 clat percentiles (usec): | 1.00th=[ 1647], 5.00th=[ 1958], 10.00th=[ 3195], 20.00th=[ 5866], | 30.00th=[ 9110], 40.00th=[ 13698], 50.00th=[ 21627], 60.00th=[ 32637], | 70.00th=[ 44827], 80.00th=[ 65274], 90.00th=[ 93848], 95.00th=[121111], | 99.00th=[191890], 99.50th=[227541], 99.90th=[308282], 99.95th=[308282], | 99.99th=[308282] bw ( KiB/s): min= 62, max= 447, per=26.65%, avg=205.77, stdev=85.38, samples=62 iops : min= 3, max= 27, avg=12.10, stdev= 5.39, samples=62 lat (usec) : 50=0.52%, 100=5.21%, 250=1.43%, 500=0.26%, 750=0.26% lat (msec) : 2=3.52%, 4=3.91%, 10=11.20%, 20=9.77%, 50=32.68% lat (msec) : 100=23.05%, 250=7.94%, 500=0.26% cpu : usr=0.08%, sys=5.98%, ctx=1551, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144530: Thu Sep 3 09:17:29 2026 read: IOPS=12, BW=194KiB/s (199kB/s)(6256KiB/32224msec) clat (usec): min=38, max=227303, avg=44063.56, stdev=36039.26 lat (usec): min=39, max=227304, avg=44084.60, stdev=36046.76 clat percentiles (usec): | 1.00th=[ 47], 5.00th=[ 62], 10.00th=[ 72], 20.00th=[ 2606], | 30.00th=[ 24511], 40.00th=[ 32113], 50.00th=[ 39060], 60.00th=[ 47973], | 70.00th=[ 56886], 80.00th=[ 69731], 90.00th=[ 87557], 95.00th=[113771], | 99.00th=[170918], 99.50th=[189793], 99.90th=[227541], 99.95th=[227541], | 99.99th=[227541] bw ( KiB/s): min= 30, max= 539, per=26.61%, avg=195.08, stdev=82.82, samples=63 iops : min= 1, max= 33, avg=11.41, stdev= 5.22, samples=63 write: IOPS=11, BW=187KiB/s (192kB/s)(6032KiB/32224msec); 0 zone resets clat (usec): min=1439, max=312796, avg=39266.49, stdev=46697.49 lat (usec): min=1441, max=312797, avg=39269.48, stdev=46696.97 clat percentiles (usec): | 1.00th=[ 1598], 5.00th=[ 1991], 10.00th=[ 2933], 20.00th=[ 5669], | 30.00th=[ 8356], 40.00th=[ 13304], 50.00th=[ 22414], 60.00th=[ 33817], | 70.00th=[ 47973], 80.00th=[ 63701], 90.00th=[ 94897], 95.00th=[137364], | 99.00th=[225444], 99.50th=[308282], 99.90th=[312476], 99.95th=[312476], | 99.99th=[312476] bw ( KiB/s): min= 31, max= 477, per=23.90%, avg=184.54, stdev=90.25, samples=63 iops : min= 1, max= 29, avg=10.75, stdev= 5.67, samples=63 lat (usec) : 50=0.65%, 100=7.16%, 250=1.82%, 500=0.39%, 1000=0.13% lat (msec) : 2=2.47%, 4=5.21%, 10=10.29%, 20=6.90%, 50=32.42% lat (msec) : 100=24.74%, 250=7.55%, 500=0.26% cpu : usr=0.06%, sys=5.68%, ctx=1556, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144531: Thu Sep 3 09:17:29 2026 read: IOPS=12, BW=193KiB/s (198kB/s)(6032KiB/31203msec) clat (usec): min=38, max=302359, avg=44991.64, stdev=39925.48 lat (usec): min=38, max=302360, avg=44994.95, stdev=39924.20 clat percentiles (usec): | 1.00th=[ 48], 5.00th=[ 63], 10.00th=[ 74], 20.00th=[ 799], | 30.00th=[ 26346], 40.00th=[ 32900], 50.00th=[ 39584], 60.00th=[ 46400], | 70.00th=[ 55313], 80.00th=[ 71828], 90.00th=[ 91751], 95.00th=[106431], | 99.00th=[204473], 99.50th=[250610], 99.90th=[304088], 99.95th=[304088], | 99.99th=[304088] bw ( KiB/s): min= 31, max= 349, per=26.06%, avg=191.03, stdev=69.73, samples=61 iops : min= 1, max= 21, avg=11.16, stdev= 4.43, samples=61 write: IOPS=12, BW=200KiB/s (205kB/s)(6256KiB/31203msec); 0 zone resets clat (usec): min=1554, max=222810, avg=36120.68, stdev=39878.75 lat (usec): min=1555, max=222812, avg=36127.28, stdev=39878.60 clat percentiles (usec): | 1.00th=[ 1647], 5.00th=[ 1958], 10.00th=[ 3130], 20.00th=[ 5211], | 30.00th=[ 7701], 40.00th=[ 11994], 50.00th=[ 20055], 60.00th=[ 31327], | 70.00th=[ 45876], 80.00th=[ 65274], 90.00th=[ 91751], 95.00th=[115868], | 99.00th=[189793], 99.50th=[208667], 99.90th=[223347], 99.95th=[223347], | 99.99th=[223347] bw ( KiB/s): min= 62, max= 502, per=25.88%, avg=199.80, stdev=90.32, samples=61 iops : min= 3, max= 31, avg=11.72, stdev= 5.71, samples=61 lat (usec) : 50=0.52%, 100=6.90%, 250=1.95%, 500=0.26%, 750=0.13% lat (usec) : 1000=0.26% lat (msec) : 2=2.86%, 4=5.21%, 10=10.94%, 20=8.72%, 50=30.21% lat (msec) : 100=24.74%, 250=7.03%, 500=0.26% cpu : usr=0.07%, sys=6.21%, ctx=1549, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=734KiB/s (751kB/s), 181KiB/s-194KiB/s (186kB/s-199kB/s), io=23.4MiB (24.5MB), run=31203-32638msec WRITE: bw=772KiB/s (791kB/s), 187KiB/s-207KiB/s (192kB/s-212kB/s), io=24.6MiB (25.8MB), run=31203-32638msec fio: pid=144533, err=5/file:backend.c:481, func=full resid, error=Input/output error rand-rw: (groupid=0, jobs=1): err= 5 (file:backend.c:481, func=full resid, error=Input/output error): pid=144533: Thu Sep 3 09:18:06 2026 read: IOPS=4, BW=64.6KiB/s (66.2kB/s)(2784KiB/43087msec) clat (msec): min=7, max=327, avg=60.59, stdev=59.43 lat (msec): min=7, max=327, avg=60.59, stdev=59.43 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 13], 10.00th=[ 17], 20.00th=[ 22], | 30.00th=[ 26], 40.00th=[ 31], 50.00th=[ 36], 60.00th=[ 44], | 70.00th=[ 60], 80.00th=[ 101], 90.00th=[ 144], 95.00th=[ 188], | 99.00th=[ 292], 99.50th=[ 330], 99.90th=[ 330], 99.95th=[ 330], | 99.99th=[ 330] bw ( KiB/s): min= 30, max= 223, per=26.31%, avg=78.93, stdev=48.40, samples=68 iops : min= 1, max= 13, avg= 4.19, stdev= 3.14, samples=68 write: IOPS=4, BW=67.2KiB/s (68.8kB/s)(2896KiB/43087msec); 0 zone resets clat (msec): min=58, max=591, avg=179.45, stdev=92.92 lat (msec): min=58, max=591, avg=179.45, stdev=92.92 clat percentiles (msec): | 1.00th=[ 65], 5.00th=[ 77], 10.00th=[ 89], 20.00th=[ 108], | 30.00th=[ 123], 40.00th=[ 140], 50.00th=[ 157], 60.00th=[ 176], | 70.00th=[ 197], 80.00th=[ 251], 90.00th=[ 305], 95.00th=[ 363], | 99.00th=[ 550], 99.50th=[ 592], 99.90th=[ 592], 99.95th=[ 592], | 99.99th=[ 592] bw ( KiB/s): min= 27, max= 159, per=21.94%, avg=68.67, stdev=35.77, samples=81 iops : min= 1, max= 9, avg= 3.52, stdev= 2.31, samples=81 lat (msec) : 10=1.12%, 20=7.87%, 50=22.19%, 100=16.57%, 250=40.45% lat (msec) : 500=10.96%, 750=0.56% cpu : usr=0.04%, sys=1.27%, ctx=621, majf=0, minf=20 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=175,181,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144534: Thu Sep 3 09:18:06 2026 read: IOPS=5, BW=82.9KiB/s (84.9kB/s)(5744KiB/69298msec) clat (msec): min=7, max=281, avg=38.17, stdev=40.72 lat (msec): min=7, max=281, avg=38.18, stdev=40.72 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 13], 20.00th=[ 16], | 30.00th=[ 18], 40.00th=[ 21], 50.00th=[ 24], 60.00th=[ 28], | 70.00th=[ 33], 80.00th=[ 47], 90.00th=[ 91], 95.00th=[ 121], | 99.00th=[ 230], 99.50th=[ 271], 99.90th=[ 284], 99.95th=[ 284], | 99.99th=[ 284] bw ( KiB/s): min= 27, max= 350, per=33.20%, avg=99.61, stdev=66.34, samples=114 iops : min= 1, max= 21, avg= 5.46, stdev= 4.19, samples=114 write: IOPS=5, BW=94.4KiB/s (96.7kB/s)(6544KiB/69298msec); 0 zone resets clat (msec): min=32, max=646, avg=135.74, stdev=75.95 lat (msec): min=32, max=646, avg=135.75, stdev=75.95 clat percentiles (msec): | 1.00th=[ 51], 5.00th=[ 65], 10.00th=[ 71], 20.00th=[ 83], | 30.00th=[ 92], 40.00th=[ 102], 50.00th=[ 112], 60.00th=[ 126], | 70.00th=[ 148], 80.00th=[ 174], 90.00th=[ 236], 95.00th=[ 296], | 99.00th=[ 380], 99.50th=[ 422], 99.90th=[ 651], 99.95th=[ 651], | 99.99th=[ 651] bw ( KiB/s): min= 30, max= 192, per=31.45%, avg=98.45, stdev=44.27, samples=131 iops : min= 1, max= 12, avg= 5.41, stdev= 2.84, samples=131 lat (msec) : 10=1.04%, 20=17.19%, 50=20.44%, 100=24.61%, 250=32.16% lat (msec) : 500=4.30%, 750=0.26% cpu : usr=0.04%, sys=1.33%, ctx=1414, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144535: Thu Sep 3 09:18:06 2026 read: IOPS=5, BW=93.4KiB/s (95.6kB/s)(6256KiB/66989msec) clat (msec): min=6, max=319, avg=36.94, stdev=42.05 lat (msec): min=6, max=319, avg=36.94, stdev=42.05 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 15], | 30.00th=[ 18], 40.00th=[ 20], 50.00th=[ 23], 60.00th=[ 27], | 70.00th=[ 32], 80.00th=[ 43], 90.00th=[ 80], 95.00th=[ 121], | 99.00th=[ 249], 99.50th=[ 259], 99.90th=[ 321], 99.95th=[ 321], | 99.99th=[ 321] bw ( KiB/s): min= 30, max= 351, per=34.97%, avg=104.92, stdev=73.20, samples=118 iops : min= 1, max= 21, avg= 5.81, stdev= 4.69, samples=118 write: IOPS=5, BW=90.0KiB/s (92.2kB/s)(6032KiB/66989msec); 0 zone resets clat (msec): min=43, max=420, avg=139.21, stdev=74.13 lat (msec): min=43, max=420, avg=139.22, stdev=74.13 clat percentiles (msec): | 1.00th=[ 50], 5.00th=[ 66], 10.00th=[ 72], 20.00th=[ 88], | 30.00th=[ 94], 40.00th=[ 104], 50.00th=[ 116], 60.00th=[ 128], | 70.00th=[ 144], 80.00th=[ 184], 90.00th=[ 245], 95.00th=[ 296], | 99.00th=[ 393], 99.50th=[ 405], 99.90th=[ 422], 99.95th=[ 422], | 99.99th=[ 422] bw ( KiB/s): min= 30, max= 191, per=29.26%, avg=91.59, stdev=43.11, samples=129 iops : min= 1, max= 11, avg= 4.97, stdev= 2.74, samples=129 lat (msec) : 10=1.69%, 20=19.66%, 50=21.35%, 100=22.01%, 250=30.34% lat (msec) : 500=4.95% cpu : usr=0.04%, sys=1.32%, ctx=1439, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144536: Thu Sep 3 09:18:06 2026 read: IOPS=5, BW=89.3KiB/s (91.4kB/s)(6032KiB/67576msec) clat (msec): min=8, max=322, avg=37.32, stdev=42.39 lat (msec): min=8, max=322, avg=37.33, stdev=42.39 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 15], | 30.00th=[ 17], 40.00th=[ 19], 50.00th=[ 22], 60.00th=[ 26], | 70.00th=[ 32], 80.00th=[ 44], 90.00th=[ 88], 95.00th=[ 138], | 99.00th=[ 220], 99.50th=[ 245], 99.90th=[ 321], 99.95th=[ 321], | 99.99th=[ 321] bw ( KiB/s): min= 30, max= 320, per=33.72%, avg=101.16, stdev=70.50, samples=116 iops : min= 1, max= 20, avg= 5.55, stdev= 4.54, samples=116 write: IOPS=5, BW=92.6KiB/s (94.8kB/s)(6256KiB/67576msec); 0 zone resets clat (msec): min=33, max=491, avg=136.74, stdev=73.89 lat (msec): min=33, max=491, avg=136.74, stdev=73.89 clat percentiles (msec): | 1.00th=[ 53], 5.00th=[ 66], 10.00th=[ 71], 20.00th=[ 84], | 30.00th=[ 94], 40.00th=[ 103], 50.00th=[ 112], 60.00th=[ 127], | 70.00th=[ 146], 80.00th=[ 182], 90.00th=[ 247], 95.00th=[ 296], | 99.00th=[ 393], 99.50th=[ 485], 99.90th=[ 493], 99.95th=[ 493], | 99.99th=[ 493] bw ( KiB/s): min= 29, max= 192, per=30.39%, avg=95.11, stdev=45.30, samples=129 iops : min= 1, max= 12, avg= 5.19, stdev= 2.89, samples=129 lat (msec) : 10=1.43%, 20=20.44%, 50=19.01%, 100=23.05%, 250=31.25% lat (msec) : 500=4.82% cpu : usr=0.04%, sys=1.27%, ctx=1349, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=300KiB/s (308kB/s), 64.6KiB/s-93.4KiB/s (66.2kB/s-95.6kB/s), io=20.3MiB (21.3MB), run=43087-69298msec WRITE: bw=314KiB/s (321kB/s), 67.2KiB/s-94.4KiB/s (68.8kB/s-96.7kB/s), io=21.2MiB (22.2MB), run=43087-69298msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144555: Thu Sep 3 09:18:20 2026 read: IOPS=2, BW=2140KiB/s (2192kB/s)(7168KiB/3349msec) clat (usec): min=515, max=295391, avg=181105.81, stdev=90947.90 lat (usec): min=516, max=295393, avg=181107.18, stdev=90948.28 clat percentiles (usec): | 1.00th=[ 515], 5.00th=[ 515], 10.00th=[ 515], 20.00th=[177210], | 30.00th=[179307], 40.00th=[179307], 50.00th=[181404], 60.00th=[191890], | 70.00th=[191890], 80.00th=[242222], 90.00th=[295699], 95.00th=[295699], | 99.00th=[295699], 99.50th=[295699], 99.90th=[295699], 99.95th=[295699], | 99.99th=[295699] bw ( KiB/s): min= 1510, max= 3828, per=49.60%, avg=2789.50, stdev=1215.19, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 1.15, samples=4 write: IOPS=1, BW=1529KiB/s (1566kB/s)(5120KiB/3349msec); 0 zone resets clat (msec): min=140, max=749, avg=363.46, stdev=253.66 lat (msec): min=140, max=750, avg=363.54, stdev=253.65 clat percentiles (msec): | 1.00th=[ 142], 5.00th=[ 142], 10.00th=[ 142], 20.00th=[ 142], | 30.00th=[ 174], 40.00th=[ 174], 50.00th=[ 271], 60.00th=[ 271], | 70.00th=[ 481], 80.00th=[ 481], 90.00th=[ 751], 95.00th=[ 751], | 99.00th=[ 751], 99.50th=[ 751], 99.90th=[ 751], 99.95th=[ 751], | 99.99th=[ 751] bw ( KiB/s): min= 1914, max= 4031, per=33.57%, avg=2643.00, stdev=1202.55, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (usec) : 750=8.33% lat (msec) : 250=58.33%, 500=25.00%, 750=8.33% cpu : usr=0.00%, sys=14.58%, ctx=167, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144556: Thu Sep 3 09:18:20 2026 read: IOPS=0, BW=562KiB/s (576kB/s)(2048KiB/3641msec) clat (msec): min=144, max=232, avg=188.73, stdev=62.38 lat (msec): min=144, max=232, avg=188.73, stdev=62.38 clat percentiles (msec): | 1.00th=[ 144], 5.00th=[ 144], 10.00th=[ 144], 20.00th=[ 144], | 30.00th=[ 144], 40.00th=[ 144], 50.00th=[ 144], 60.00th=[ 234], | 70.00th=[ 234], 80.00th=[ 234], 90.00th=[ 234], 95.00th=[ 234], | 99.00th=[ 234], 99.50th=[ 234], 99.90th=[ 234], 99.95th=[ 234], | 99.99th=[ 234] bw ( KiB/s): min= 1512, max= 1984, per=31.08%, avg=1748.00, stdev=333.75, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2812KiB/s (2880kB/s)(10.0MiB/3641msec); 0 zone resets clat (msec): min=102, max=692, avg=295.54, stdev=186.91 lat (msec): min=103, max=692, avg=295.69, stdev=186.84 clat percentiles (msec): | 1.00th=[ 103], 5.00th=[ 103], 10.00th=[ 103], 20.00th=[ 121], | 30.00th=[ 155], 40.00th=[ 209], 50.00th=[ 211], 60.00th=[ 266], | 70.00th=[ 284], 80.00th=[ 443], 90.00th=[ 472], 95.00th=[ 693], | 99.00th=[ 693], 99.50th=[ 693], 99.90th=[ 693], 99.95th=[ 693], | 99.99th=[ 693] bw ( KiB/s): min= 1914, max= 5742, per=39.72%, avg=3127.80, stdev=1701.99, samples=5 iops : min= 1, max= 5, avg= 2.20, stdev= 1.79, samples=5 lat (msec) : 250=58.33%, 500=33.33%, 750=8.33% cpu : usr=0.08%, sys=13.19%, ctx=159, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144559: Thu Sep 3 09:18:20 2026 read: IOPS=1, BW=1973KiB/s (2020kB/s)(6144KiB/3114msec) clat (usec): min=565, max=298289, avg=92662.37, stdev=130463.15 lat (usec): min=566, max=298290, avg=92663.51, stdev=130462.92 clat percentiles (usec): | 1.00th=[ 570], 5.00th=[ 570], 10.00th=[ 570], 20.00th=[ 685], | 30.00th=[ 685], 40.00th=[ 4047], 50.00th=[ 4047], 60.00th=[ 37487], | 70.00th=[214959], 80.00th=[214959], 90.00th=[299893], 95.00th=[299893], | 99.00th=[299893], 99.50th=[299893], 99.90th=[299893], 99.95th=[299893], | 99.99th=[299893] bw ( KiB/s): min= 3968, max= 4031, per=71.11%, avg=3999.50, stdev=44.55, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1973KiB/s (2020kB/s)(6144KiB/3114msec); 0 zone resets clat (msec): min=122, max=1185, avg=411.95, stdev=393.51 lat (msec): min=122, max=1185, avg=412.02, stdev=393.52 clat percentiles (msec): | 1.00th=[ 123], 5.00th=[ 123], 10.00th=[ 123], 20.00th=[ 161], | 30.00th=[ 161], 40.00th=[ 259], 50.00th=[ 259], 60.00th=[ 347], | 70.00th=[ 397], 80.00th=[ 397], 90.00th=[ 1183], 95.00th=[ 1183], | 99.00th=[ 1183], 99.50th=[ 1183], 99.90th=[ 1183], 99.95th=[ 1183], | 99.99th=[ 1183] bw ( KiB/s): min= 1984, max= 2856, per=29.02%, avg=2285.00, stdev=494.74, samples=3 iops : min= 1, max= 2, avg= 1.33, stdev= 0.58, samples=3 lat (usec) : 750=16.67% lat (msec) : 10=8.33%, 50=8.33%, 250=25.00%, 500=33.33%, 2000=8.33% cpu : usr=0.00%, sys=11.05%, ctx=119, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144561: Thu Sep 3 09:18:20 2026 read: IOPS=1, BW=1493KiB/s (1529kB/s)(5120KiB/3430msec) clat (usec): min=346, max=234099, avg=47480.41, stdev=104324.47 lat (usec): min=346, max=234100, avg=47481.62, stdev=104324.41 clat percentiles (usec): | 1.00th=[ 347], 5.00th=[ 347], 10.00th=[ 347], 20.00th=[ 347], | 30.00th=[ 619], 40.00th=[ 619], 50.00th=[ 627], 60.00th=[ 627], | 70.00th=[ 1713], 80.00th=[ 1713], 90.00th=[233833], 95.00th=[233833], | 99.00th=[233833], 99.50th=[233833], 99.90th=[233833], 99.95th=[233833], | 99.99th=[233833] bw ( KiB/s): min= 8062, max= 8062, per=100.00%, avg=8062.00, stdev= 0.00, samples=1 iops : min= 7, max= 7, avg= 7.00, stdev= 0.00, samples=1 write: IOPS=2, BW=2090KiB/s (2140kB/s)(7168KiB/3430msec); 0 zone resets clat (msec): min=117, max=982, avg=427.21, stdev=296.26 lat (msec): min=117, max=982, avg=427.29, stdev=296.28 clat percentiles (msec): | 1.00th=[ 118], 5.00th=[ 118], 10.00th=[ 118], 20.00th=[ 150], | 30.00th=[ 268], 40.00th=[ 268], 50.00th=[ 422], 60.00th=[ 523], | 70.00th=[ 523], 80.00th=[ 535], 90.00th=[ 986], 95.00th=[ 986], | 99.00th=[ 986], 99.50th=[ 986], 99.90th=[ 986], 99.95th=[ 986], | 99.99th=[ 986] bw ( KiB/s): min= 1444, max= 3984, per=28.81%, avg=2268.20, stdev=986.61, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 lat (usec) : 500=8.33%, 750=16.67% lat (msec) : 2=8.33%, 250=25.00%, 500=16.67%, 750=16.67%, 1000=8.33% cpu : usr=0.00%, sys=11.37%, ctx=94, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5625KiB/s (5760kB/s), 562KiB/s-2140KiB/s (576kB/s-2192kB/s), io=20.0MiB (20.0MB), run=3114-3641msec WRITE: bw=7875KiB/s (8064kB/s), 1529KiB/s-2812KiB/s (1566kB/s-2880kB/s), io=28.0MiB (29.4MB), run=3114-3641msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144554: Thu Sep 3 09:18:21 2026 read: IOPS=2, BW=2203KiB/s (2256kB/s)(7168KiB/3254msec) clat (msec): min=79, max=260, avg=151.63, stdev=62.34 lat (msec): min=79, max=260, avg=151.63, stdev=62.34 clat percentiles (msec): | 1.00th=[ 80], 5.00th=[ 80], 10.00th=[ 80], 20.00th=[ 104], | 30.00th=[ 113], 40.00th=[ 113], 50.00th=[ 142], 60.00th=[ 165], | 70.00th=[ 165], 80.00th=[ 199], 90.00th=[ 262], 95.00th=[ 262], | 99.00th=[ 262], 99.50th=[ 262], 99.90th=[ 262], 99.95th=[ 262], | 99.99th=[ 262] bw ( KiB/s): min= 2027, max= 4243, per=76.75%, avg=3356.33, stdev=1172.45, samples=3 iops : min= 1, max= 4, avg= 2.67, stdev= 1.53, samples=3 write: IOPS=1, BW=1573KiB/s (1611kB/s)(5120KiB/3254msec); 0 zone resets clat (msec): min=181, max=650, avg=404.18, stdev=182.80 lat (msec): min=182, max=650, avg=404.30, stdev=182.76 clat percentiles (msec): | 1.00th=[ 182], 5.00th=[ 182], 10.00th=[ 182], 20.00th=[ 182], | 30.00th=[ 317], 40.00th=[ 317], 50.00th=[ 355], 60.00th=[ 355], | 70.00th=[ 518], 80.00th=[ 518], 90.00th=[ 651], 95.00th=[ 651], | 99.00th=[ 651], 99.50th=[ 651], 99.90th=[ 651], 99.95th=[ 651], | 99.99th=[ 651] bw ( KiB/s): min= 1899, max= 2027, per=31.91%, avg=1953.25, stdev=62.86, samples=4 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=4 lat (msec) : 100=8.33%, 250=50.00%, 500=25.00%, 750=16.67% cpu : usr=0.00%, sys=3.32%, ctx=53, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144557: Thu Sep 3 09:18:21 2026 read: IOPS=0, BW=437KiB/s (448kB/s)(2048KiB/4683msec) clat (msec): min=68, max=362, avg=215.43, stdev=208.30 lat (msec): min=68, max=362, avg=215.43, stdev=208.30 clat percentiles (msec): | 1.00th=[ 68], 5.00th=[ 68], 10.00th=[ 68], 20.00th=[ 68], | 30.00th=[ 68], 40.00th=[ 68], 50.00th=[ 68], 60.00th=[ 363], | 70.00th=[ 363], 80.00th=[ 363], 90.00th=[ 363], 95.00th=[ 363], | 99.00th=[ 363], 99.50th=[ 363], 99.90th=[ 363], 99.95th=[ 363], | 99.99th=[ 363] bw ( KiB/s): min= 1899, max= 2035, per=44.98%, avg=1967.00, stdev=96.17, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2187KiB/s (2239kB/s)(10.0MiB/4683msec); 0 zone resets clat (msec): min=196, max=926, avg=388.71, stdev=239.12 lat (msec): min=196, max=926, avg=388.80, stdev=239.12 clat percentiles (msec): | 1.00th=[ 197], 5.00th=[ 197], 10.00th=[ 197], 20.00th=[ 205], | 30.00th=[ 222], 40.00th=[ 232], 50.00th=[ 249], 60.00th=[ 275], | 70.00th=[ 468], 80.00th=[ 523], 90.00th=[ 600], 95.00th=[ 927], | 99.00th=[ 927], 99.50th=[ 927], 99.90th=[ 927], 99.95th=[ 927], | 99.99th=[ 927] bw ( KiB/s): min= 1903, max= 6047, per=43.66%, avg=2673.17, stdev=1653.65, samples=6 iops : min= 1, max= 5, avg= 1.67, stdev= 1.63, samples=6 lat (msec) : 100=8.33%, 250=41.67%, 500=25.00%, 750=16.67%, 1000=8.33% cpu : usr=0.00%, sys=4.21%, ctx=106, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144558: Thu Sep 3 09:18:21 2026 read: IOPS=1, BW=1400KiB/s (1434kB/s)(6144KiB/4388msec) clat (msec): min=106, max=678, avg=333.61, stdev=242.61 lat (msec): min=106, max=678, avg=333.61, stdev=242.61 clat percentiles (msec): | 1.00th=[ 107], 5.00th=[ 107], 10.00th=[ 107], 20.00th=[ 120], | 30.00th=[ 120], 40.00th=[ 144], 50.00th=[ 144], 60.00th=[ 464], | 70.00th=[ 493], 80.00th=[ 493], 90.00th=[ 676], 95.00th=[ 676], | 99.00th=[ 676], 99.50th=[ 676], 99.90th=[ 676], 99.95th=[ 676], | 99.99th=[ 676] bw ( KiB/s): min= 1903, max= 2043, per=45.61%, avg=1994.40, stdev=55.48, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 write: IOPS=1, BW=1400KiB/s (1434kB/s)(6144KiB/4388msec); 0 zone resets clat (msec): min=199, max=800, avg=390.87, stdev=245.82 lat (msec): min=199, max=800, avg=390.96, stdev=245.79 clat percentiles (msec): | 1.00th=[ 199], 5.00th=[ 199], 10.00th=[ 199], 20.00th=[ 224], | 30.00th=[ 224], 40.00th=[ 226], 50.00th=[ 226], 60.00th=[ 317], | 70.00th=[ 584], 80.00th=[ 584], 90.00th=[ 802], 95.00th=[ 802], | 99.00th=[ 802], 99.50th=[ 802], 99.90th=[ 802], 99.95th=[ 802], | 99.99th=[ 802] bw ( KiB/s): min= 1899, max= 2734, per=34.85%, avg=2133.40, stdev=339.74, samples=5 iops : min= 1, max= 2, avg= 1.20, stdev= 0.45, samples=5 lat (msec) : 250=50.00%, 500=25.00%, 750=16.67%, 1000=8.33% cpu : usr=0.02%, sys=3.21%, ctx=53, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144560: Thu Sep 3 09:18:21 2026 read: IOPS=1, BW=1182KiB/s (1211kB/s)(5120KiB/4330msec) clat (msec): min=89, max=359, avg=238.81, stdev=97.26 lat (msec): min=89, max=359, avg=238.81, stdev=97.26 clat percentiles (msec): | 1.00th=[ 90], 5.00th=[ 90], 10.00th=[ 90], 20.00th=[ 90], | 30.00th=[ 226], 40.00th=[ 226], 50.00th=[ 255], 60.00th=[ 255], | 70.00th=[ 266], 80.00th=[ 266], 90.00th=[ 359], 95.00th=[ 359], | 99.00th=[ 359], 99.50th=[ 359], 99.90th=[ 359], 99.95th=[ 359], | 99.99th=[ 359] bw ( KiB/s): min= 4055, max= 4087, per=93.09%, avg=4071.00, stdev=22.63, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1655KiB/s (1695kB/s)(7168KiB/4330msec); 0 zone resets clat (msec): min=165, max=1032, avg=431.63, stdev=316.80 lat (msec): min=166, max=1032, avg=431.99, stdev=317.01 clat percentiles (msec): | 1.00th=[ 167], 5.00th=[ 167], 10.00th=[ 167], 20.00th=[ 201], | 30.00th=[ 220], 40.00th=[ 220], 50.00th=[ 288], 60.00th=[ 468], | 70.00th=[ 468], 80.00th=[ 651], 90.00th=[ 1036], 95.00th=[ 1036], | 99.00th=[ 1036], 99.50th=[ 1036], 99.90th=[ 1036], 99.95th=[ 1036], | 99.99th=[ 1036] bw ( KiB/s): min= 1528, max= 6047, per=54.91%, avg=3361.50, stdev=2087.16, samples=4 iops : min= 1, max= 5, avg= 2.50, stdev= 1.91, samples=4 lat (msec) : 100=8.33%, 250=33.33%, 500=41.67%, 750=8.33%, 2000=8.33% cpu : usr=0.02%, sys=4.18%, ctx=70, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4373KiB/s (4478kB/s), 437KiB/s-2203KiB/s (448kB/s-2256kB/s), io=20.0MiB (20.0MB), run=3254-4683msec WRITE: bw=6123KiB/s (6270kB/s), 1400KiB/s-2187KiB/s (1434kB/s-2239kB/s), io=28.0MiB (29.4MB), run=3254-4683msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144567: Thu Sep 3 09:18:34 2026 read: IOPS=1, BW=4294KiB/s (4397kB/s)(12.0MiB/2862msec) clat (msec): min=748, max=1200, avg=911.67, stdev=250.71 lat (msec): min=748, max=1200, avg=911.67, stdev=250.71 clat percentiles (msec): | 1.00th=[ 751], 5.00th=[ 751], 10.00th=[ 751], 20.00th=[ 751], | 30.00th=[ 751], 40.00th=[ 785], 50.00th=[ 785], 60.00th=[ 785], | 70.00th=[ 1200], 80.00th=[ 1200], 90.00th=[ 1200], 95.00th=[ 1200], | 99.00th=[ 1200], 99.50th=[ 1200], 99.90th=[ 1200], 99.95th=[ 1200], | 99.99th=[ 1200] bw ( KiB/s): min= 8094, max= 8175, per=100.00%, avg=8134.50, stdev=57.28, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=14.12%, ctx=280, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144568: Thu Sep 3 09:18:34 2026 read: IOPS=0, BW=1251KiB/s (1281kB/s)(4096KiB/3274msec) clat (nsec): min=781215k, max=781215k, avg=781215090.00, stdev= 0.00 lat (nsec): min=781217k, max=781217k, avg=781217114.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 785], 5.00th=[ 785], 10.00th=[ 785], 20.00th=[ 785], | 30.00th=[ 785], 40.00th=[ 785], 50.00th=[ 785], 60.00th=[ 785], | 70.00th=[ 785], 80.00th=[ 785], 90.00th=[ 785], 95.00th=[ 785], | 99.00th=[ 785], 99.50th=[ 785], 99.90th=[ 785], 99.95th=[ 785], | 99.99th=[ 785] bw ( KiB/s): min= 8094, max= 8094, per=100.00%, avg=8094.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2502KiB/s (2562kB/s)(8192KiB/3274msec); 0 zone resets clat (msec): min=729, max=1610, avg=1170.36, stdev=622.96 lat (msec): min=732, max=1612, avg=1172.40, stdev=622.27 clat percentiles (msec): | 1.00th=[ 735], 5.00th=[ 735], 10.00th=[ 735], 20.00th=[ 735], | 30.00th=[ 735], 40.00th=[ 735], 50.00th=[ 735], 60.00th=[ 1620], | 70.00th=[ 1620], 80.00th=[ 1620], 90.00th=[ 1620], 95.00th=[ 1620], | 99.00th=[ 1620], 99.50th=[ 1620], 99.90th=[ 1620], 99.95th=[ 1620], | 99.99th=[ 1620] bw ( KiB/s): min= 8159, max= 8159, per=84.99%, avg=8159.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=4.71%, ctx=118, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144569: Thu Sep 3 09:18:34 2026 write: IOPS=0, BW=3600KiB/s (3687kB/s)(12.0MiB/3413msec); 0 zone resets clat (msec): min=968, max=1241, avg=1110.43, stdev=136.55 lat (msec): min=969, max=1241, avg=1110.79, stdev=136.56 clat percentiles (msec): | 1.00th=[ 969], 5.00th=[ 969], 10.00th=[ 969], 20.00th=[ 969], | 30.00th=[ 969], 40.00th=[ 1116], 50.00th=[ 1116], 60.00th=[ 1116], | 70.00th=[ 1234], 80.00th=[ 1234], 90.00th=[ 1234], 95.00th=[ 1234], | 99.00th=[ 1234], 99.50th=[ 1234], 99.90th=[ 1234], 99.95th=[ 1234], | 99.99th=[ 1234] bw ( KiB/s): min= 8143, max= 8192, per=85.08%, avg=8167.50, stdev=34.65, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 1000=33.33%, 2000=66.67% cpu : usr=0.00%, sys=7.06%, ctx=117, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144571: Thu Sep 3 09:18:34 2026 write: IOPS=1, BW=4779KiB/s (4894kB/s)(12.0MiB/2571msec); 0 zone resets clat (msec): min=463, max=1314, avg=834.21, stdev=435.92 lat (msec): min=464, max=1315, avg=834.59, stdev=435.97 clat percentiles (msec): | 1.00th=[ 464], 5.00th=[ 464], 10.00th=[ 464], 20.00th=[ 464], | 30.00th=[ 464], 40.00th=[ 726], 50.00th=[ 726], 60.00th=[ 726], | 70.00th=[ 1318], 80.00th=[ 1318], 90.00th=[ 1318], 95.00th=[ 1318], | 99.00th=[ 1318], 99.50th=[ 1318], 99.90th=[ 1318], 99.95th=[ 1318], | 99.99th=[ 1318] bw ( KiB/s): min= 8175, max= 8192, per=85.24%, avg=8183.50, stdev=12.02, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 500=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.00%, sys=3.97%, ctx=45, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5004KiB/s (5124kB/s), 1251KiB/s-4294KiB/s (1281kB/s-4397kB/s), io=16.0MiB (16.8MB), run=2862-3274msec WRITE: bw=9601KiB/s (9831kB/s), 2502KiB/s-4779KiB/s (2562kB/s-4894kB/s), io=32.0MiB (33.6MB), run=2571-3413msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144572: Thu Sep 3 09:18:35 2026 read: IOPS=0, BW=3213KiB/s (3290kB/s)(12.0MiB/3825msec) clat (msec): min=145, max=1982, avg=1274.66, stdev=987.98 lat (msec): min=145, max=1982, avg=1274.66, stdev=987.98 clat percentiles (msec): | 1.00th=[ 146], 5.00th=[ 146], 10.00th=[ 146], 20.00th=[ 146], | 30.00th=[ 146], 40.00th=[ 1703], 50.00th=[ 1703], 60.00th=[ 1703], | 70.00th=[ 1989], 80.00th=[ 1989], 90.00th=[ 1989], 95.00th=[ 1989], | 99.00th=[ 1989], 99.50th=[ 1989], 99.90th=[ 1989], 99.95th=[ 1989], | 99.99th=[ 1989] bw ( KiB/s): min= 8126, max= 8192, per=100.00%, avg=8159.00, stdev=46.67, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 250=33.33%, 2000=66.67% cpu : usr=0.00%, sys=2.48%, ctx=34, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144573: Thu Sep 3 09:18:35 2026 read: IOPS=0, BW=1119KiB/s (1146kB/s)(4096KiB/3661msec) clat (nsec): min=1012.0M, max=1012.0M, avg=1012028581.00, stdev= 0.00 lat (nsec): min=1012.0M, max=1012.0M, avg=1012031209.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1011], 5.00th=[ 1011], 10.00th=[ 1011], 20.00th=[ 1011], | 30.00th=[ 1011], 40.00th=[ 1011], 50.00th=[ 1011], 60.00th=[ 1011], | 70.00th=[ 1011], 80.00th=[ 1011], 90.00th=[ 1011], 95.00th=[ 1011], | 99.00th=[ 1011], 99.50th=[ 1011], 99.90th=[ 1011], 99.95th=[ 1011], | 99.99th=[ 1011] bw ( KiB/s): min= 7892, max= 7892, per=100.00%, avg=7892.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2238KiB/s (2291kB/s)(8192KiB/3661msec); 0 zone resets clat (msec): min=665, max=1894, avg=1280.38, stdev=869.12 lat (msec): min=667, max=1897, avg=1282.44, stdev=869.40 clat percentiles (msec): | 1.00th=[ 667], 5.00th=[ 667], 10.00th=[ 667], 20.00th=[ 667], | 30.00th=[ 667], 40.00th=[ 667], 50.00th=[ 667], 60.00th=[ 1888], | 70.00th=[ 1888], 80.00th=[ 1888], 90.00th=[ 1888], 95.00th=[ 1888], | 99.00th=[ 1888], 99.50th=[ 1888], 99.90th=[ 1888], 99.95th=[ 1888], | 99.99th=[ 1888] bw ( KiB/s): min= 8126, max= 8126, per=90.79%, avg=8126.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, 2000=66.67% cpu : usr=0.00%, sys=3.69%, ctx=74, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144574: Thu Sep 3 09:18:35 2026 write: IOPS=0, BW=3456KiB/s (3539kB/s)(12.0MiB/3556msec); 0 zone resets clat (msec): min=353, max=1685, avg=1181.30, stdev=722.16 lat (msec): min=354, max=1685, avg=1184.52, stdev=723.98 clat percentiles (msec): | 1.00th=[ 355], 5.00th=[ 355], 10.00th=[ 355], 20.00th=[ 355], | 30.00th=[ 355], 40.00th=[ 1502], 50.00th=[ 1502], 60.00th=[ 1502], | 70.00th=[ 1687], 80.00th=[ 1687], 90.00th=[ 1687], 95.00th=[ 1687], | 99.00th=[ 1687], 99.50th=[ 1687], 99.90th=[ 1687], 99.95th=[ 1687], | 99.99th=[ 1687] bw ( KiB/s): min= 8159, max= 8192, per=91.35%, avg=8175.50, stdev=23.33, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.00%, sys=2.84%, ctx=45, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144575: Thu Sep 3 09:18:35 2026 write: IOPS=1, BW=4361KiB/s (4465kB/s)(12.0MiB/2818msec); 0 zone resets clat (msec): min=390, max=1601, avg=925.32, stdev=617.70 lat (msec): min=390, max=1601, avg=928.10, stdev=616.91 clat percentiles (msec): | 1.00th=[ 393], 5.00th=[ 393], 10.00th=[ 393], 20.00th=[ 393], | 30.00th=[ 393], 40.00th=[ 785], 50.00th=[ 785], 60.00th=[ 785], | 70.00th=[ 1603], 80.00th=[ 1603], 90.00th=[ 1603], 95.00th=[ 1603], | 99.00th=[ 1603], 99.50th=[ 1603], 99.90th=[ 1603], 99.95th=[ 1603], | 99.99th=[ 1603] bw ( KiB/s): min= 7892, max= 8175, per=89.76%, avg=8033.50, stdev=200.11, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.04%, sys=3.80%, ctx=57, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4283KiB/s (4386kB/s), 1119KiB/s-3213KiB/s (1146kB/s-3290kB/s), io=16.0MiB (16.8MB), run=3661-3825msec WRITE: bw=8951KiB/s (9165kB/s), 2238KiB/s-4361KiB/s (2291kB/s-4465kB/s), io=32.0MiB (33.6MB), run=2818-3661msec