== sanity test 398b: DIO and buffer IO race ============== 22:10:58 (1787710258) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 6.43948 s, 7.8 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144599: Tue Aug 25 22:13:38 2026 read: IOPS=10, BW=43.6KiB/s (44.6kB/s)(5992KiB/137565msec) clat (usec): min=30, max=868809, avg=43413.68, stdev=38881.72 lat (usec): min=30, max=868810, avg=43417.34, stdev=38882.01 clat percentiles (usec): | 1.00th=[ 46], 5.00th=[ 60], 10.00th=[ 123], 20.00th=[ 19006], | 30.00th=[ 24773], 40.00th=[ 30540], 50.00th=[ 35914], 60.00th=[ 43254], | 70.00th=[ 51643], 80.00th=[ 66323], 90.00th=[ 86508], 95.00th=[105382], | 99.00th=[158335], 99.50th=[185598], 99.90th=[217056], 99.95th=[868221], | 99.99th=[868221] bw ( KiB/s): min= 6, max= 102, per=25.65%, avg=43.86, stdev=19.53, samples=266 iops : min= 1, max= 25, avg=10.33, stdev= 4.92, samples=266 write: IOPS=11, BW=45.8KiB/s (46.9kB/s)(6296KiB/137565msec); 0 zone resets clat (usec): min=866, max=645112, avg=45780.49, stdev=51249.97 lat (usec): min=867, max=645113, avg=45788.75, stdev=51246.14 clat percentiles (usec): | 1.00th=[ 1057], 5.00th=[ 1188], 10.00th=[ 1483], 20.00th=[ 4359], | 30.00th=[ 8848], 40.00th=[ 20841], 50.00th=[ 33424], 60.00th=[ 45351], | 70.00th=[ 60031], 80.00th=[ 78119], 90.00th=[106431], 95.00th=[133694], | 99.00th=[212861], 99.50th=[250610], 99.90th=[505414], 99.95th=[641729], | 99.99th=[641729] bw ( KiB/s): min= 7, max= 127, per=25.45%, avg=45.55, stdev=21.20, samples=269 iops : min= 1, max= 31, avg=10.76, stdev= 5.35, samples=269 lat (usec) : 50=0.75%, 100=3.71%, 250=0.75%, 500=0.13%, 750=0.10% lat (usec) : 1000=0.20% lat (msec) : 2=6.41%, 4=3.39%, 10=6.67%, 20=8.33%, 50=35.22% lat (msec) : 100=25.20%, 250=8.85%, 500=0.20%, 750=0.07%, 1000=0.03% cpu : usr=0.08%, sys=4.97%, ctx=6279, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144600: Tue Aug 25 22:13:38 2026 read: IOPS=10, BW=42.7KiB/s (43.7kB/s)(5940KiB/139199msec) clat (usec): min=34, max=343256, avg=46429.03, stdev=36390.79 lat (usec): min=34, max=343257, avg=46436.82, stdev=36386.84 clat percentiles (usec): | 1.00th=[ 52], 5.00th=[ 64], 10.00th=[ 9241], 20.00th=[ 20579], | 30.00th=[ 26346], 40.00th=[ 31851], 50.00th=[ 38536], 60.00th=[ 46400], | 70.00th=[ 55837], 80.00th=[ 68682], 90.00th=[ 90702], 95.00th=[110625], | 99.00th=[170918], 99.50th=[206570], 99.90th=[316670], 99.95th=[341836], | 99.99th=[341836] bw ( KiB/s): min= 6, max= 110, per=24.82%, avg=42.45, stdev=18.87, samples=271 iops : min= 1, max= 27, avg= 9.97, stdev= 4.76, samples=271 write: IOPS=11, BW=45.6KiB/s (46.7kB/s)(6348KiB/139199msec); 0 zone resets clat (usec): min=859, max=823017, avg=43900.75, stdev=49054.25 lat (usec): min=861, max=823018, avg=43902.51, stdev=49054.22 clat percentiles (usec): | 1.00th=[ 1057], 5.00th=[ 1172], 10.00th=[ 1385], 20.00th=[ 3916], | 30.00th=[ 8717], 40.00th=[ 18482], 50.00th=[ 31589], 60.00th=[ 44303], | 70.00th=[ 57934], 80.00th=[ 77071], 90.00th=[106431], 95.00th=[128451], | 99.00th=[185598], 99.50th=[225444], 99.90th=[383779], 99.95th=[826278], | 99.99th=[826278] bw ( KiB/s): min= 7, max= 116, per=25.28%, avg=45.25, stdev=22.17, samples=271 iops : min= 1, max= 29, avg=10.68, stdev= 5.59, samples=271 lat (usec) : 50=0.39%, 100=3.58%, 250=0.42%, 500=0.07%, 750=0.03% lat (usec) : 1000=0.10% lat (msec) : 2=6.71%, 4=3.91%, 10=6.25%, 20=8.89%, 50=33.79% lat (msec) : 100=26.30%, 250=9.34%, 500=0.20%, 1000=0.03% cpu : usr=0.08%, sys=5.24%, ctx=6591, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144601: Tue Aug 25 22:13:38 2026 read: IOPS=10, BW=43.4KiB/s (44.4kB/s)(6028KiB/139023msec) clat (usec): min=31, max=632852, avg=43957.24, stdev=37707.98 lat (usec): min=32, max=632853, avg=43960.23, stdev=37707.35 clat percentiles (usec): | 1.00th=[ 47], 5.00th=[ 61], 10.00th=[ 108], 20.00th=[ 19268], | 30.00th=[ 24773], 40.00th=[ 30278], 50.00th=[ 35390], 60.00th=[ 42730], | 70.00th=[ 53216], 80.00th=[ 65799], 90.00th=[ 87557], 95.00th=[107480], | 99.00th=[164627], 99.50th=[202376], 99.90th=[283116], 99.95th=[633340], | 99.99th=[633340] bw ( KiB/s): min= 7, max= 111, per=25.40%, avg=43.44, stdev=21.60, samples=270 iops : min= 1, max= 27, avg=10.23, stdev= 5.43, samples=270 write: IOPS=11, BW=45.0KiB/s (46.1kB/s)(6260KiB/139023msec); 0 zone resets clat (usec): min=901, max=975572, avg=46178.46, stdev=52268.12 lat (usec): min=902, max=975575, avg=46184.81, stdev=52265.46 clat percentiles (usec): | 1.00th=[ 1057], 5.00th=[ 1205], 10.00th=[ 1631], 20.00th=[ 4686], | 30.00th=[ 9634], 40.00th=[ 22152], 50.00th=[ 33424], 60.00th=[ 45876], | 70.00th=[ 58459], 80.00th=[ 77071], 90.00th=[111674], 95.00th=[141558], | 99.00th=[202376], 99.50th=[225444], 99.90th=[304088], 99.95th=[977273], | 99.99th=[977273] bw ( KiB/s): min= 7, max= 111, per=25.04%, avg=44.82, stdev=20.96, samples=272 iops : min= 1, max= 27, avg=10.57, stdev= 5.30, samples=272 lat (usec) : 50=0.68%, 100=4.17%, 250=0.46%, 500=0.13%, 750=0.07% lat (usec) : 1000=0.23% lat (msec) : 2=5.83%, 4=3.42%, 10=6.38%, 20=8.56%, 50=35.32% lat (msec) : 100=25.23%, 250=9.28%, 500=0.20%, 750=0.03%, 1000=0.03% cpu : usr=0.07%, sys=5.11%, ctx=6550, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144602: Tue Aug 25 22:13:38 2026 read: IOPS=10, BW=43.2KiB/s (44.3kB/s)(6052KiB/139940msec) clat (usec): min=34, max=707326, avg=43893.50, stdev=38527.47 lat (usec): min=34, max=707327, avg=43897.70, stdev=38526.44 clat percentiles (usec): | 1.00th=[ 50], 5.00th=[ 59], 10.00th=[ 95], 20.00th=[ 18482], | 30.00th=[ 25297], 40.00th=[ 30540], 50.00th=[ 36963], 60.00th=[ 44827], | 70.00th=[ 53216], 80.00th=[ 64750], 90.00th=[ 85459], 95.00th=[106431], | 99.00th=[164627], 99.50th=[193987], 99.90th=[350225], 99.95th=[708838], | 99.99th=[708838] bw ( KiB/s): min= 7, max= 151, per=25.51%, avg=43.63, stdev=20.40, samples=270 iops : min= 1, max= 37, avg=10.27, stdev= 5.13, samples=270 write: IOPS=11, BW=44.6KiB/s (45.6kB/s)(6236KiB/139940msec); 0 zone resets clat (usec): min=969, max=1023.2k, avg=46863.49, stdev=55615.53 lat (usec): min=970, max=1023.2k, avg=46866.41, stdev=55615.36 clat percentiles (usec): | 1.00th=[ 1057], 5.00th=[ 1188], 10.00th=[ 1549], | 20.00th=[ 4359], 30.00th=[ 9634], 40.00th=[ 22938], | 50.00th=[ 34341], 60.00th=[ 46400], 70.00th=[ 58983], | 80.00th=[ 78119], 90.00th=[ 106431], 95.00th=[ 137364], | 99.00th=[ 221250], 99.50th=[ 283116], 99.90th=[ 530580], | 99.95th=[1019216], 99.99th=[1019216] bw ( KiB/s): min= 7, max= 151, per=25.21%, avg=45.13, stdev=22.04, samples=269 iops : min= 1, max= 37, avg=10.64, stdev= 5.54, samples=269 lat (usec) : 50=0.62%, 100=4.43%, 250=0.33%, 500=0.10%, 750=0.07% lat (usec) : 1000=0.10% lat (msec) : 2=6.32%, 4=3.45%, 10=6.02%, 20=8.53%, 50=34.83% lat (msec) : 100=26.30%, 250=8.50%, 500=0.33%, 750=0.07%, 2000=0.03% cpu : usr=0.08%, sys=5.08%, ctx=6457, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=172KiB/s (176kB/s), 42.7KiB/s-43.6KiB/s (43.7kB/s-44.6kB/s), io=23.4MiB (24.6MB), run=137565-139940msec WRITE: bw=180KiB/s (184kB/s), 44.6KiB/s-45.8KiB/s (45.6kB/s-46.9kB/s), io=24.6MiB (25.7MB), run=137565-139940msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144595: Tue Aug 25 22:15:54 2026 read: IOPS=5, BW=21.8KiB/s (22.3kB/s)(5992KiB/275090msec) clat (msec): min=5, max=866, avg=35.54, stdev=46.36 lat (msec): min=5, max=866, avg=35.54, stdev=46.35 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 11], 20.00th=[ 14], | 30.00th=[ 16], 40.00th=[ 18], 50.00th=[ 21], 60.00th=[ 25], | 70.00th=[ 31], 80.00th=[ 45], 90.00th=[ 79], 95.00th=[ 111], | 99.00th=[ 211], 99.50th=[ 275], 99.90th=[ 567], 99.95th=[ 869], | 99.99th=[ 869] bw ( KiB/s): min= 7, max= 100, per=28.74%, avg=24.72, stdev=17.40, samples=468 iops : min= 1, max= 25, avg= 5.54, stdev= 4.38, samples=468 write: IOPS=5, BW=22.9KiB/s (23.4kB/s)(6296KiB/275090msec); 0 zone resets clat (msec): min=42, max=714, avg=140.66, stdev=76.74 lat (msec): min=42, max=714, avg=140.66, stdev=76.74 clat percentiles (msec): | 1.00th=[ 52], 5.00th=[ 65], 10.00th=[ 73], 20.00th=[ 86], | 30.00th=[ 96], 40.00th=[ 107], 50.00th=[ 120], 60.00th=[ 132], | 70.00th=[ 150], 80.00th=[ 184], 90.00th=[ 239], 95.00th=[ 288], | 99.00th=[ 435], 99.50th=[ 485], 99.90th=[ 684], 99.95th=[ 718], | 99.99th=[ 718] bw ( KiB/s): min= 7, max= 55, per=25.36%, avg=22.83, stdev=10.86, samples=530 iops : min= 1, max= 13, avg= 5.06, stdev= 2.77, samples=530 lat (msec) : 10=3.03%, 20=20.57%, 50=16.67%, 100=22.49%, 250=32.45% lat (msec) : 500=4.49%, 750=0.26%, 1000=0.03% cpu : usr=0.05%, sys=1.13%, ctx=5278, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144596: Tue Aug 25 22:15:54 2026 read: IOPS=5, BW=21.5KiB/s (21.0kB/s)(5940KiB/276516msec) clat (msec): min=5, max=815, avg=34.77, stdev=46.23 lat (msec): min=5, max=815, avg=34.77, stdev=46.23 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 14], | 30.00th=[ 16], 40.00th=[ 19], 50.00th=[ 22], 60.00th=[ 25], | 70.00th=[ 31], 80.00th=[ 44], 90.00th=[ 74], 95.00th=[ 104], | 99.00th=[ 184], 99.50th=[ 309], 99.90th=[ 567], 99.95th=[ 818], | 99.99th=[ 818] bw ( KiB/s): min= 7, max= 95, per=29.21%, avg=25.12, stdev=17.36, samples=456 iops : min= 1, max= 23, avg= 5.65, stdev= 4.39, samples=456 write: IOPS=5, BW=22.0KiB/s (23.5kB/s)(6348KiB/276516msec); 0 zone resets clat (msec): min=39, max=711, avg=141.36, stdev=81.93 lat (msec): min=39, max=711, avg=141.36, stdev=81.93 clat percentiles (msec): | 1.00th=[ 50], 5.00th=[ 62], 10.00th=[ 71], 20.00th=[ 84], | 30.00th=[ 94], 40.00th=[ 105], 50.00th=[ 117], 60.00th=[ 130], | 70.00th=[ 153], 80.00th=[ 188], 90.00th=[ 249], 95.00th=[ 300], | 99.00th=[ 447], 99.50th=[ 506], 99.90th=[ 693], 99.95th=[ 709], | 99.99th=[ 709] bw ( KiB/s): min= 7, max= 48, per=25.32%, avg=22.79, stdev=11.37, samples=535 iops : min= 1, max= 12, avg= 5.05, stdev= 2.91, samples=535 lat (msec) : 10=3.06%, 20=19.76%, 50=17.71%, 100=23.96%, 250=30.14% lat (msec) : 500=5.01%, 750=0.33%, 1000=0.03% cpu : usr=0.04%, sys=1.11%, ctx=5262, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144597: Tue Aug 25 22:15:54 2026 read: IOPS=5, BW=22.1KiB/s (22.7kB/s)(6028KiB/272358msec) clat (msec): min=5, max=477, avg=35.80, stdev=39.70 lat (msec): min=5, max=477, avg=35.80, stdev=39.70 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 11], 20.00th=[ 14], | 30.00th=[ 16], 40.00th=[ 19], 50.00th=[ 21], 60.00th=[ 26], | 70.00th=[ 34], 80.00th=[ 49], 90.00th=[ 83], 95.00th=[ 109], | 99.00th=[ 182], 99.50th=[ 264], 99.90th=[ 376], 99.95th=[ 477], | 99.99th=[ 477] bw ( KiB/s): min= 7, max= 128, per=28.90%, avg=24.85, stdev=17.68, samples=468 iops : min= 1, max= 32, avg= 5.57, stdev= 4.46, samples=468 write: IOPS=5, BW=22.0KiB/s (23.5kB/s)(6260KiB/272358msec); 0 zone resets clat (msec): min=39, max=981, avg=139.24, stdev=79.96 lat (msec): min=39, max=981, avg=139.24, stdev=79.96 clat percentiles (msec): | 1.00th=[ 52], 5.00th=[ 64], 10.00th=[ 71], 20.00th=[ 82], | 30.00th=[ 93], 40.00th=[ 105], 50.00th=[ 115], 60.00th=[ 131], | 70.00th=[ 150], 80.00th=[ 182], 90.00th=[ 239], 95.00th=[ 313], | 99.00th=[ 422], 99.50th=[ 456], 99.90th=[ 617], 99.95th=[ 978], | 99.99th=[ 978] bw ( KiB/s): min= 7, max= 53, per=25.53%, avg=22.98, stdev=11.47, samples=524 iops : min= 1, max= 13, avg= 5.10, stdev= 2.93, samples=524 lat (msec) : 10=3.68%, 20=19.43%, 50=16.63%, 100=24.58%, 250=30.99% lat (msec) : 500=4.49%, 750=0.16%, 1000=0.03% cpu : usr=0.04%, sys=1.16%, ctx=5466, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144598: Tue Aug 25 22:15:54 2026 read: IOPS=5, BW=21.9KiB/s (22.5kB/s)(6052KiB/275935msec) clat (msec): min=4, max=658, avg=36.17, stdev=46.92 lat (msec): min=4, max=658, avg=36.18, stdev=46.92 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 11], 20.00th=[ 13], | 30.00th=[ 16], 40.00th=[ 18], 50.00th=[ 21], 60.00th=[ 25], | 70.00th=[ 31], 80.00th=[ 47], 90.00th=[ 81], 95.00th=[ 117], | 99.00th=[ 209], 99.50th=[ 338], 99.90th=[ 447], 99.95th=[ 659], | 99.99th=[ 659] bw ( KiB/s): min= 7, max= 111, per=29.41%, avg=25.30, stdev=17.78, samples=462 iops : min= 1, max= 27, avg= 5.69, stdev= 4.48, samples=462 write: IOPS=5, BW=22.6KiB/s (23.1kB/s)(6236KiB/275935msec); 0 zone resets clat (msec): min=44, max=989, avg=141.59, stdev=80.67 lat (msec): min=44, max=989, avg=141.59, stdev=80.67 clat percentiles (msec): | 1.00th=[ 55], 5.00th=[ 65], 10.00th=[ 73], 20.00th=[ 85], | 30.00th=[ 95], 40.00th=[ 106], 50.00th=[ 120], 60.00th=[ 136], | 70.00th=[ 153], 80.00th=[ 184], 90.00th=[ 239], 95.00th=[ 313], | 99.00th=[ 422], 99.50th=[ 493], 99.90th=[ 726], 99.95th=[ 986], | 99.99th=[ 986] bw ( KiB/s): min= 7, max= 48, per=25.12%, avg=22.61, stdev=11.05, samples=530 iops : min= 1, max= 12, avg= 5.01, stdev= 2.82, samples=530 lat (msec) : 10=3.81%, 20=19.89%, 50=16.73%, 100=23.11%, 250=31.71% lat (msec) : 500=4.49%, 750=0.23%, 1000=0.03% cpu : usr=0.05%, sys=1.08%, ctx=5262, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=86.8KiB/s (88.9kB/s), 21.5KiB/s-22.1KiB/s (21.0kB/s-22.7kB/s), io=23.4MiB (24.6MB), run=272358-276516msec WRITE: bw=90.9KiB/s (93.1kB/s), 22.6KiB/s-22.0KiB/s (23.1kB/s-23.5kB/s), io=24.6MiB (25.7MB), run=272358-276516msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144662: Tue Aug 25 22:16:31 2026 read: IOPS=14, BW=230KiB/s (235kB/s)(5920KiB/25784msec) clat (usec): min=37, max=397388, avg=34499.51, stdev=34628.50 lat (usec): min=38, max=397389, avg=34507.02, stdev=34626.08 clat percentiles (usec): | 1.00th=[ 43], 5.00th=[ 56], 10.00th=[ 60], 20.00th=[ 88], | 30.00th=[ 17957], 40.00th=[ 24249], 50.00th=[ 29492], 60.00th=[ 36439], | 70.00th=[ 44827], 80.00th=[ 55313], 90.00th=[ 74974], 95.00th=[ 88605], | 99.00th=[129500], 99.50th=[160433], 99.90th=[396362], 99.95th=[396362], | 99.99th=[396362] bw ( KiB/s): min= 31, max= 478, per=26.39%, avg=233.80, stdev=102.21, samples=49 iops : min= 1, max= 29, avg=13.84, stdev= 6.45, samples=49 write: IOPS=15, BW=247KiB/s (253kB/s)(6368KiB/25784msec); 0 zone resets clat (usec): min=1321, max=270717, avg=32129.60, stdev=36943.10 lat (usec): min=1323, max=270719, avg=32131.41, stdev=36943.14 clat percentiles (usec): | 1.00th=[ 1582], 5.00th=[ 1680], 10.00th=[ 2073], 20.00th=[ 4047], | 30.00th=[ 6718], 40.00th=[ 10028], 50.00th=[ 19792], 60.00th=[ 29230], | 70.00th=[ 40109], 80.00th=[ 56886], 90.00th=[ 82314], 95.00th=[105382], | 99.00th=[149947], 99.50th=[242222], 99.90th=[270533], 99.95th=[270533], | 99.99th=[270533] bw ( KiB/s): min= 31, max= 476, per=26.58%, avg=247.68, stdev=98.59, samples=50 iops : min= 1, max= 29, avg=14.72, stdev= 6.18, samples=50 lat (usec) : 50=0.91%, 100=9.24%, 250=0.78%, 500=0.39%, 1000=0.13% lat (msec) : 2=5.34%, 4=5.34%, 10=10.68%, 20=9.11%, 50=34.77% lat (msec) : 100=18.75%, 250=4.30%, 500=0.26% cpu : usr=0.05%, sys=5.78%, ctx=1350, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144663: Tue Aug 25 22:16:31 2026 read: IOPS=13, BW=218KiB/s (223kB/s)(5744KiB/26333msec) clat (usec): min=34, max=165878, avg=34950.47, stdev=31156.65 lat (usec): min=34, max=165879, avg=34951.52, stdev=31156.66 clat percentiles (usec): | 1.00th=[ 39], 5.00th=[ 52], 10.00th=[ 59], 20.00th=[ 74], | 30.00th=[ 17171], 40.00th=[ 24511], 50.00th=[ 32637], 60.00th=[ 38536], | 70.00th=[ 45876], 80.00th=[ 55837], 90.00th=[ 78119], 95.00th=[ 93848], | 99.00th=[129500], 99.50th=[145753], 99.90th=[166724], 99.95th=[166724], | 99.99th=[166724] bw ( KiB/s): min= 31, max= 442, per=25.09%, avg=222.32, stdev=97.82, samples=50 iops : min= 1, max= 27, avg=13.12, stdev= 6.20, samples=50 write: IOPS=15, BW=249KiB/s (254kB/s)(6544KiB/26333msec); 0 zone resets clat (usec): min=1334, max=426790, avg=33178.07, stdev=43382.74 lat (usec): min=1335, max=426791, avg=33179.82, stdev=43382.70 clat percentiles (usec): | 1.00th=[ 1418], 5.00th=[ 1598], 10.00th=[ 1811], 20.00th=[ 4686], | 30.00th=[ 7242], 40.00th=[ 10814], 50.00th=[ 16712], 60.00th=[ 26608], | 70.00th=[ 39060], 80.00th=[ 56886], 90.00th=[ 80217], 95.00th=[107480], | 99.00th=[208667], 99.50th=[217056], 99.90th=[425722], 99.95th=[425722], | 99.99th=[425722] bw ( KiB/s): min= 31, max= 570, per=26.50%, avg=246.96, stdev=117.59, samples=51 iops : min= 1, max= 35, avg=14.67, stdev= 7.41, samples=51 lat (usec) : 50=1.43%, 100=9.64%, 250=0.52%, 500=0.26%, 750=0.13% lat (msec) : 2=5.86%, 4=4.56%, 10=11.07%, 20=10.29%, 50=30.99% lat (msec) : 100=20.44%, 250=4.69%, 500=0.13% cpu : usr=0.09%, sys=5.59%, ctx=1313, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144664: Tue Aug 25 22:16:31 2026 read: IOPS=14, BW=231KiB/s (237kB/s)(6256KiB/27030msec) clat (usec): min=37, max=162768, avg=34533.90, stdev=28555.17 lat (usec): min=37, max=162770, avg=34536.46, stdev=28555.91 clat percentiles (usec): | 1.00th=[ 40], 5.00th=[ 54], 10.00th=[ 57], 20.00th=[ 72], | 30.00th=[ 18744], 40.00th=[ 26608], 50.00th=[ 32900], 60.00th=[ 39584], | 70.00th=[ 45876], 80.00th=[ 56886], 90.00th=[ 72877], 95.00th=[ 84411], | 99.00th=[132645], 99.50th=[143655], 99.90th=[162530], 99.95th=[162530], | 99.99th=[162530] bw ( KiB/s): min= 63, max= 380, per=27.20%, avg=241.02, stdev=81.73, samples=51 iops : min= 3, max= 23, avg=14.27, stdev= 5.18, samples=51 write: IOPS=13, BW=223KiB/s (229kB/s)(6032KiB/27030msec); 0 zone resets clat (usec): min=1380, max=539225, avg=35183.77, stdev=44293.44 lat (usec): min=1382, max=539225, avg=35191.04, stdev=44294.17 clat percentiles (usec): | 1.00th=[ 1434], 5.00th=[ 1680], 10.00th=[ 1991], 20.00th=[ 4228], | 30.00th=[ 6783], 40.00th=[ 11338], 50.00th=[ 20579], 60.00th=[ 31589], | 70.00th=[ 49021], 80.00th=[ 61604], 90.00th=[ 84411], 95.00th=[110625], | 99.00th=[162530], 99.50th=[212861], 99.90th=[541066], 99.95th=[541066], | 99.99th=[541066] bw ( KiB/s): min= 56, max= 456, per=24.00%, avg=223.69, stdev=93.88, samples=52 iops : min= 3, max= 28, avg=13.17, stdev= 5.92, samples=52 lat (usec) : 50=1.04%, 100=10.16%, 250=0.65%, 500=0.13%, 750=0.13% lat (usec) : 1000=0.26% lat (msec) : 2=4.95%, 4=4.43%, 10=9.64%, 20=8.72%, 50=33.07% lat (msec) : 100=23.05%, 250=3.65%, 750=0.13% cpu : usr=0.09%, sys=5.90%, ctx=1441, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144665: Tue Aug 25 22:16:31 2026 read: IOPS=14, BW=234KiB/s (240kB/s)(6032KiB/25790msec) clat (usec): min=32, max=189161, avg=34310.29, stdev=30618.34 lat (usec): min=32, max=189162, avg=34311.27, stdev=30618.34 clat percentiles (usec): | 1.00th=[ 39], 5.00th=[ 51], 10.00th=[ 57], 20.00th=[ 74], | 30.00th=[ 16909], 40.00th=[ 26084], 50.00th=[ 31065], 60.00th=[ 40633], | 70.00th=[ 47973], 80.00th=[ 54789], 90.00th=[ 68682], 95.00th=[ 88605], | 99.00th=[149947], 99.50th=[154141], 99.90th=[189793], 99.95th=[189793], | 99.99th=[189793] bw ( KiB/s): min= 95, max= 471, per=27.42%, avg=242.96, stdev=94.05, samples=48 iops : min= 5, max= 29, avg=14.42, stdev= 5.94, samples=48 write: IOPS=15, BW=243KiB/s (248kB/s)(6256KiB/25790msec); 0 zone resets clat (usec): min=1309, max=344525, avg=32532.35, stdev=38758.08 lat (usec): min=1310, max=344528, avg=32539.21, stdev=38754.75 clat percentiles (usec): | 1.00th=[ 1418], 5.00th=[ 1663], 10.00th=[ 2008], 20.00th=[ 4359], | 30.00th=[ 6783], 40.00th=[ 9896], 50.00th=[ 16581], 60.00th=[ 26870], | 70.00th=[ 42206], 80.00th=[ 57410], 90.00th=[ 77071], 95.00th=[102237], | 99.00th=[181404], 99.50th=[191890], 99.90th=[346031], 99.95th=[346031], | 99.99th=[346031] bw ( KiB/s): min= 82, max= 416, per=25.89%, avg=241.28, stdev=74.83, samples=50 iops : min= 5, max= 26, avg=14.32, stdev= 4.70, samples=50 lat (usec) : 50=1.95%, 100=10.03%, 250=0.91% lat (msec) : 2=5.08%, 4=4.30%, 10=11.33%, 20=9.51%, 50=30.73% lat (msec) : 100=22.01%, 250=4.04%, 500=0.13% cpu : usr=0.09%, sys=6.05%, ctx=1352, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=886KiB/s (907kB/s), 218KiB/s-234KiB/s (223kB/s-240kB/s), io=23.4MiB (24.5MB), run=25784-27030msec WRITE: bw=932KiB/s (955kB/s), 223KiB/s-249KiB/s (229kB/s-254kB/s), io=24.6MiB (25.8MB), run=25784-27030msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144657: Tue Aug 25 22:17:11 2026 read: IOPS=5, BW=89.8KiB/s (91.9kB/s)(5920KiB/65937msec) clat (msec): min=6, max=260, avg=33.87, stdev=33.84 lat (msec): min=6, max=260, avg=33.89, stdev=33.86 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 12], 20.00th=[ 15], | 30.00th=[ 18], 40.00th=[ 21], 50.00th=[ 23], 60.00th=[ 27], | 70.00th=[ 33], 80.00th=[ 43], 90.00th=[ 69], 95.00th=[ 99], | 99.00th=[ 215], 99.50th=[ 249], 99.90th=[ 262], 99.95th=[ 262], | 99.99th=[ 262] bw ( KiB/s): min= 30, max= 320, per=25.98%, avg=93.79, stdev=59.78, samples=123 iops : min= 1, max= 20, avg= 5.18, stdev= 3.78, samples=123 write: IOPS=6, BW=96.6KiB/s (98.9kB/s)(6368KiB/65937msec); 0 zone resets clat (msec): min=39, max=455, avg=133.80, stdev=60.46 lat (msec): min=39, max=455, avg=133.81, stdev=60.46 clat percentiles (msec): | 1.00th=[ 57], 5.00th=[ 69], 10.00th=[ 78], 20.00th=[ 90], | 30.00th=[ 100], 40.00th=[ 110], 50.00th=[ 122], 60.00th=[ 131], | 70.00th=[ 146], 80.00th=[ 165], 90.00th=[ 203], 95.00th=[ 259], | 99.00th=[ 380], 99.50th=[ 439], 99.90th=[ 456], 99.95th=[ 456], | 99.99th=[ 456] bw ( KiB/s): min= 30, max= 192, per=25.50%, avg=96.91, stdev=38.51, samples=129 iops : min= 1, max= 12, avg= 5.36, stdev= 2.54, samples=129 lat (msec) : 10=1.17%, 20=18.10%, 50=22.01%, 100=20.70%, 250=34.90% lat (msec) : 500=3.12% cpu : usr=0.03%, sys=1.24%, ctx=1336, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144658: Tue Aug 25 22:17:11 2026 read: IOPS=5, BW=86.7KiB/s (88.8kB/s)(5744KiB/66248msec) clat (msec): min=6, max=334, avg=37.39, stdev=43.70 lat (msec): min=6, max=334, avg=37.39, stdev=43.70 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 12], 20.00th=[ 15], | 30.00th=[ 17], 40.00th=[ 20], 50.00th=[ 23], 60.00th=[ 27], | 70.00th=[ 31], 80.00th=[ 45], 90.00th=[ 89], 95.00th=[ 118], | 99.00th=[ 234], 99.50th=[ 317], 99.90th=[ 334], 99.95th=[ 334], | 99.99th=[ 334] bw ( KiB/s): min= 27, max= 352, per=27.65%, avg=99.81, stdev=64.89, samples=114 iops : min= 1, max= 22, avg= 5.56, stdev= 4.19, samples=114 write: IOPS=6, BW=98.8KiB/s (101kB/s)(6544KiB/66248msec); 0 zone resets clat (msec): min=51, max=603, avg=129.04, stdev=60.54 lat (msec): min=51, max=603, avg=129.04, stdev=60.54 clat percentiles (msec): | 1.00th=[ 59], 5.00th=[ 67], 10.00th=[ 74], 20.00th=[ 86], | 30.00th=[ 94], 40.00th=[ 103], 50.00th=[ 114], 60.00th=[ 125], | 70.00th=[ 138], 80.00th=[ 167], 90.00th=[ 211], 95.00th=[ 251], | 99.00th=[ 334], 99.50th=[ 355], 99.90th=[ 600], 99.95th=[ 600], | 99.99th=[ 600] bw ( KiB/s): min= 31, max= 191, per=26.11%, avg=99.21, stdev=43.48, samples=130 iops : min= 1, max= 11, avg= 5.51, stdev= 2.82, samples=130 lat (msec) : 10=1.82%, 20=17.58%, 50=19.53%, 100=24.61%, 250=33.46% lat (msec) : 500=2.86%, 750=0.13% cpu : usr=0.04%, sys=1.24%, ctx=1369, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144660: Tue Aug 25 22:17:11 2026 read: IOPS=6, BW=100KiB/s (103kB/s)(6256KiB/62486msec) clat (msec): min=6, max=344, avg=32.32, stdev=34.75 lat (msec): min=6, max=344, avg=32.33, stdev=34.75 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 15], | 30.00th=[ 17], 40.00th=[ 20], 50.00th=[ 22], 60.00th=[ 26], | 70.00th=[ 31], 80.00th=[ 39], 90.00th=[ 62], 95.00th=[ 90], | 99.00th=[ 209], 99.50th=[ 234], 99.90th=[ 347], 99.95th=[ 347], | 99.99th=[ 347] bw ( KiB/s): min= 30, max= 349, per=30.09%, avg=108.61, stdev=75.66, samples=114 iops : min= 1, max= 21, avg= 6.11, stdev= 4.83, samples=114 write: IOPS=6, BW=96.5KiB/s (98.8kB/s)(6032KiB/62486msec); 0 zone resets clat (msec): min=43, max=608, avg=131.55, stdev=62.07 lat (msec): min=43, max=608, avg=131.55, stdev=62.07 clat percentiles (msec): | 1.00th=[ 58], 5.00th=[ 67], 10.00th=[ 72], 20.00th=[ 84], | 30.00th=[ 94], 40.00th=[ 104], 50.00th=[ 116], 60.00th=[ 130], | 70.00th=[ 148], 80.00th=[ 174], 90.00th=[ 207], 95.00th=[ 247], | 99.00th=[ 334], 99.50th=[ 359], 99.90th=[ 609], 99.95th=[ 609], | 99.99th=[ 609] bw ( KiB/s): min= 31, max= 191, per=25.68%, avg=97.58, stdev=37.24, samples=121 iops : min= 1, max= 11, avg= 5.41, stdev= 2.44, samples=121 lat (msec) : 10=1.82%, 20=20.96%, 50=21.74%, 100=22.14%, 250=30.99% lat (msec) : 500=2.21%, 750=0.13% cpu : usr=0.04%, sys=1.22%, ctx=1375, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144661: Tue Aug 25 22:17:11 2026 read: IOPS=5, BW=91.9KiB/s (94.1kB/s)(6032KiB/65622msec) clat (msec): min=7, max=335, avg=35.71, stdev=39.61 lat (msec): min=7, max=335, avg=35.71, stdev=39.61 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 15], | 30.00th=[ 18], 40.00th=[ 21], 50.00th=[ 23], 60.00th=[ 26], | 70.00th=[ 32], 80.00th=[ 42], 90.00th=[ 86], 95.00th=[ 115], | 99.00th=[ 215], 99.50th=[ 313], 99.90th=[ 338], 99.95th=[ 338], | 99.99th=[ 338] bw ( KiB/s): min= 30, max= 288, per=28.55%, avg=103.05, stdev=66.61, samples=114 iops : min= 1, max= 18, avg= 5.75, stdev= 4.29, samples=114 write: IOPS=5, BW=95.3KiB/s (97.6kB/s)(6256KiB/65622msec); 0 zone resets clat (msec): min=42, max=532, avg=133.00, stdev=60.28 lat (msec): min=42, max=532, avg=133.00, stdev=60.28 clat percentiles (msec): | 1.00th=[ 55], 5.00th=[ 68], 10.00th=[ 78], 20.00th=[ 88], | 30.00th=[ 99], 40.00th=[ 110], 50.00th=[ 121], 60.00th=[ 133], | 70.00th=[ 146], 80.00th=[ 167], 90.00th=[ 207], 95.00th=[ 236], | 99.00th=[ 334], 99.50th=[ 481], 99.90th=[ 531], 99.95th=[ 531], | 99.99th=[ 531] bw ( KiB/s): min= 30, max= 160, per=25.58%, avg=97.19, stdev=38.36, samples=126 iops : min= 1, max= 10, avg= 5.39, stdev= 2.54, samples=126 lat (msec) : 10=2.08%, 20=17.58%, 50=21.35%, 100=21.22%, 250=35.55% lat (msec) : 500=2.08%, 750=0.13% cpu : usr=0.03%, sys=1.24%, ctx=1342, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=362KiB/s (370kB/s), 86.7KiB/s-100KiB/s (88.8kB/s-103kB/s), io=23.4MiB (24.5MB), run=62486-66248msec WRITE: bw=380KiB/s (390kB/s), 95.3KiB/s-98.8KiB/s (97.6kB/s-101kB/s), io=24.6MiB (25.8MB), run=62486-66248msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144686: Tue Aug 25 22:17:30 2026 read: IOPS=1, BW=1214KiB/s (1243kB/s)(7168KiB/5904msec) clat (usec): min=1013, max=3802.5k, avg=646229.01, stdev=1394892.39 lat (usec): min=1014, max=3802.5k, avg=646230.75, stdev=1394893.88 clat percentiles (usec): | 1.00th=[ 1012], 5.00th=[ 1012], 10.00th=[ 1012], | 20.00th=[ 1614], 30.00th=[ 141558], 40.00th=[ 141558], | 50.00th=[ 149947], 60.00th=[ 160433], 70.00th=[ 160433], | 80.00th=[ 263193], 90.00th=[3808429], 95.00th=[3808429], | 99.00th=[3808429], 99.50th=[3808429], 99.90th=[3808429], | 99.95th=[3808429], 99.99th=[3808429] bw ( KiB/s): min= 1882, max= 4071, per=100.00%, avg=3012.00, stdev=1210.91, samples=4 iops : min= 1, max= 3, avg= 2.25, stdev= 0.96, samples=4 write: IOPS=0, BW=867KiB/s (888kB/s)(5120KiB/5904msec); 0 zone resets clat (msec): min=133, max=360, avg=261.80, stdev=90.01 lat (msec): min=133, max=360, avg=263.96, stdev=90.26 clat percentiles (msec): | 1.00th=[ 134], 5.00th=[ 134], 10.00th=[ 134], 20.00th=[ 134], | 30.00th=[ 209], 40.00th=[ 209], 50.00th=[ 300], 60.00th=[ 300], | 70.00th=[ 305], 80.00th=[ 305], 90.00th=[ 359], 95.00th=[ 359], | 99.00th=[ 359], 99.50th=[ 359], 99.90th=[ 359], 99.95th=[ 359], | 99.99th=[ 359] bw ( KiB/s): min= 2023, max= 6144, per=100.00%, avg=4083.50, stdev=2913.99, samples=2 iops : min= 1, max= 6, avg= 3.50, stdev= 3.54, samples=2 lat (msec) : 2=16.67%, 250=41.67%, 500=33.33%, >=2000=8.33% cpu : usr=0.00%, sys=7.62%, ctx=567, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144688: Tue Aug 25 22:17:30 2026 read: IOPS=0, BW=253KiB/s (259kB/s)(2048KiB/8106msec) clat (msec): min=123, max=206, avg=165.06, stdev=58.85 lat (msec): min=123, max=206, avg=165.06, stdev=58.84 clat percentiles (msec): | 1.00th=[ 124], 5.00th=[ 124], 10.00th=[ 124], 20.00th=[ 124], | 30.00th=[ 124], 40.00th=[ 124], 50.00th=[ 124], 60.00th=[ 207], | 70.00th=[ 207], 80.00th=[ 207], 90.00th=[ 207], 95.00th=[ 207], | 99.00th=[ 207], 99.50th=[ 207], 99.90th=[ 207], 99.95th=[ 207], | 99.99th=[ 207] bw ( KiB/s): min= 1551, max= 2031, per=70.90%, avg=1791.00, stdev=339.41, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1263KiB/s (1294kB/s)(10.0MiB/8106msec); 0 zone resets clat (msec): min=156, max=4197, avg=764.93, stdev=1238.22 lat (msec): min=156, max=4197, avg=765.00, stdev=1238.22 clat percentiles (msec): | 1.00th=[ 157], 5.00th=[ 157], 10.00th=[ 157], 20.00th=[ 165], | 30.00th=[ 182], 40.00th=[ 234], 50.00th=[ 257], 60.00th=[ 338], | 70.00th=[ 351], 80.00th=[ 776], 90.00th=[ 995], 95.00th=[ 4212], | 99.00th=[ 4212], 99.50th=[ 4212], 99.90th=[ 4212], 99.95th=[ 4212], | 99.99th=[ 4212] bw ( KiB/s): min= 1939, max= 4063, per=90.64%, avg=3206.00, stdev=1114.63, samples=5 iops : min= 1, max= 3, avg= 2.20, stdev= 1.10, samples=5 lat (msec) : 250=50.00%, 500=25.00%, 1000=16.67%, >=2000=8.33% cpu : usr=0.01%, sys=6.84%, ctx=255, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144690: Tue Aug 25 22:17:30 2026 read: IOPS=0, BW=771KiB/s (790kB/s)(6144KiB/7965msec) clat (usec): min=479, max=333780, avg=202176.01, stdev=122155.02 lat (usec): min=480, max=333781, avg=202177.01, stdev=122154.92 clat percentiles (usec): | 1.00th=[ 478], 5.00th=[ 478], 10.00th=[ 478], 20.00th=[170918], | 30.00th=[170918], 40.00th=[173016], 50.00th=[173016], 60.00th=[210764], | 70.00th=[325059], 80.00th=[325059], 90.00th=[333448], 95.00th=[333448], | 99.00th=[333448], 99.50th=[333448], 99.90th=[333448], 99.95th=[333448], | 99.99th=[333448] bw ( KiB/s): min= 1980, max= 2035, per=79.90%, avg=2018.40, stdev=22.80, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 write: IOPS=0, BW=771KiB/s (790kB/s)(6144KiB/7965msec); 0 zone resets clat (msec): min=178, max=4623, avg=1103.92, stdev=1728.39 lat (msec): min=179, max=4623, avg=1103.98, stdev=1728.40 clat percentiles (msec): | 1.00th=[ 180], 5.00th=[ 180], 10.00th=[ 180], 20.00th=[ 368], | 30.00th=[ 368], 40.00th=[ 443], 50.00th=[ 443], 60.00th=[ 493], | 70.00th=[ 518], 80.00th=[ 518], 90.00th=[ 4597], 95.00th=[ 4597], | 99.00th=[ 4597], 99.50th=[ 4597], 99.90th=[ 4597], 99.95th=[ 4597], | 99.99th=[ 4597] bw ( KiB/s): min= 1499, max= 4063, per=65.62%, avg=2321.00, stdev=999.34, samples=5 iops : min= 1, max= 3, avg= 1.60, stdev= 0.89, samples=5 lat (usec) : 500=8.33% lat (msec) : 250=33.33%, 500=41.67%, 750=8.33%, >=2000=8.33% cpu : usr=0.01%, sys=6.42%, ctx=166, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144691: Tue Aug 25 22:17:30 2026 read: IOPS=0, BW=783KiB/s (802kB/s)(5120KiB/6539msec) clat (usec): min=459, max=327456, avg=115348.88, stdev=159413.31 lat (usec): min=461, max=327457, avg=115349.80, stdev=159413.18 clat percentiles (usec): | 1.00th=[ 461], 5.00th=[ 461], 10.00th=[ 461], 20.00th=[ 461], | 30.00th=[ 725], 40.00th=[ 725], 50.00th=[ 1221], 60.00th=[ 1221], | 70.00th=[246416], 80.00th=[246416], 90.00th=[329253], 95.00th=[329253], | 99.00th=[329253], 99.50th=[329253], 99.90th=[329253], 99.95th=[329253], | 99.99th=[329253] bw ( KiB/s): min= 4031, max= 4071, per=100.00%, avg=4051.00, stdev=28.28, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1096KiB/s (1123kB/s)(7168KiB/6539msec); 0 zone resets clat (msec): min=75, max=3916, avg=819.93, stdev=1372.02 lat (msec): min=75, max=3917, avg=820.03, stdev=1372.01 clat percentiles (msec): | 1.00th=[ 77], 5.00th=[ 77], 10.00th=[ 77], 20.00th=[ 224], | 30.00th=[ 305], 40.00th=[ 305], 50.00th=[ 338], 60.00th=[ 384], | 70.00th=[ 384], 80.00th=[ 502], 90.00th=[ 3910], 95.00th=[ 3910], | 99.00th=[ 3910], 99.50th=[ 3910], 99.90th=[ 3910], 99.95th=[ 3910], | 99.99th=[ 3910] bw ( KiB/s): min= 1570, max= 4071, per=65.37%, avg=2312.00, stdev=999.05, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 lat (usec) : 500=8.33%, 750=8.33% lat (msec) : 2=8.33%, 100=8.33%, 250=16.67%, 500=33.33%, 750=8.33% lat (msec) : >=2000=8.33% cpu : usr=0.00%, sys=6.27%, ctx=111, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2527KiB/s (2587kB/s), 253KiB/s-1214KiB/s (259kB/s-1243kB/s), io=20.0MiB (20.0MB), run=5904-8106msec WRITE: bw=3537KiB/s (3622kB/s), 771KiB/s-1263KiB/s (790kB/s-1294kB/s), io=28.0MiB (29.4MB), run=5904-8106msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144684: Tue Aug 25 22:17:31 2026 read: IOPS=0, BW=945KiB/s (968kB/s)(7168KiB/7582msec) clat (msec): min=86, max=3817, avg=666.74, stdev=1390.03 lat (msec): min=86, max=3817, avg=666.75, stdev=1390.03 clat percentiles (msec): | 1.00th=[ 87], 5.00th=[ 87], 10.00th=[ 87], 20.00th=[ 107], | 30.00th=[ 140], 40.00th=[ 140], 50.00th=[ 155], 60.00th=[ 161], | 70.00th=[ 161], 80.00th=[ 201], 90.00th=[ 3809], 95.00th=[ 3809], | 99.00th=[ 3809], 99.50th=[ 3809], 99.90th=[ 3809], 99.95th=[ 3809], | 99.99th=[ 3809] bw ( KiB/s): min= 1896, max= 4096, per=100.00%, avg=2390.00, stdev=954.99, samples=5 iops : min= 1, max= 4, avg= 1.60, stdev= 1.34, samples=5 write: IOPS=0, BW=675KiB/s (691kB/s)(5120KiB/7582msec); 0 zone resets clat (msec): min=267, max=981, avg=576.99, stdev=276.06 lat (msec): min=267, max=981, avg=577.29, stdev=275.88 clat percentiles (msec): | 1.00th=[ 268], 5.00th=[ 268], 10.00th=[ 268], 20.00th=[ 268], | 30.00th=[ 418], 40.00th=[ 418], 50.00th=[ 514], 60.00th=[ 514], | 70.00th=[ 701], 80.00th=[ 701], 90.00th=[ 986], 95.00th=[ 986], | 99.00th=[ 986], 99.50th=[ 986], 99.90th=[ 986], 99.95th=[ 986], | 99.99th=[ 986] bw ( KiB/s): min= 1939, max= 2048, per=60.85%, avg=1988.00, stdev=45.61, samples=4 iops : min= 1, max= 2, avg= 1.25, stdev= 0.50, samples=4 lat (msec) : 100=8.33%, 250=41.67%, 500=16.67%, 750=16.67%, 1000=8.33% lat (msec) : >=2000=8.33% cpu : usr=0.03%, sys=2.65%, ctx=95, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144685: Tue Aug 25 22:17:31 2026 read: IOPS=0, BW=252KiB/s (258kB/s)(2048KiB/8134msec) clat (msec): min=169, max=227, avg=198.44, stdev=41.04 lat (msec): min=169, max=227, avg=198.44, stdev=41.04 clat percentiles (msec): | 1.00th=[ 169], 5.00th=[ 169], 10.00th=[ 169], 20.00th=[ 169], | 30.00th=[ 169], 40.00th=[ 169], 50.00th=[ 169], 60.00th=[ 228], | 70.00th=[ 228], 80.00th=[ 228], 90.00th=[ 228], 95.00th=[ 228], | 99.00th=[ 228], 99.50th=[ 228], 99.90th=[ 228], 99.95th=[ 228], | 99.99th=[ 228] bw ( KiB/s): min= 1802, max= 1973, per=80.90%, avg=1887.50, stdev=120.92, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1259KiB/s (1289kB/s)(10.0MiB/8134msec); 0 zone resets clat (msec): min=190, max=3992, avg=760.57, stdev=1168.38 lat (msec): min=190, max=3993, avg=760.66, stdev=1168.38 clat percentiles (msec): | 1.00th=[ 190], 5.00th=[ 190], 10.00th=[ 190], 20.00th=[ 253], | 30.00th=[ 255], 40.00th=[ 264], 50.00th=[ 271], 60.00th=[ 338], | 70.00th=[ 372], 80.00th=[ 550], 90.00th=[ 1133], 95.00th=[ 3977], | 99.00th=[ 3977], 99.50th=[ 3977], 99.90th=[ 3977], 99.95th=[ 3977], | 99.99th=[ 3977] bw ( KiB/s): min= 1939, max= 4071, per=81.11%, avg=2650.00, stdev=1036.51, samples=6 iops : min= 1, max= 3, avg= 1.83, stdev= 0.98, samples=6 lat (msec) : 250=25.00%, 500=50.00%, 750=8.33%, 2000=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=2.63%, ctx=76, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144687: Tue Aug 25 22:17:31 2026 read: IOPS=0, BW=788KiB/s (807kB/s)(6144KiB/7799msec) clat (msec): min=77, max=293, avg=191.48, stdev=92.67 lat (msec): min=77, max=293, avg=191.49, stdev=92.67 clat percentiles (msec): | 1.00th=[ 79], 5.00th=[ 79], 10.00th=[ 79], 20.00th=[ 79], | 30.00th=[ 79], 40.00th=[ 207], 50.00th=[ 207], 60.00th=[ 230], | 70.00th=[ 264], 80.00th=[ 264], 90.00th=[ 292], 95.00th=[ 292], | 99.00th=[ 292], 99.50th=[ 292], 99.90th=[ 292], 99.95th=[ 292], | 99.99th=[ 292] bw ( KiB/s): min= 1939, max= 3938, per=100.00%, avg=2471.25, stdev=978.64, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 write: IOPS=0, BW=788KiB/s (807kB/s)(6144KiB/7799msec); 0 zone resets clat (msec): min=291, max=4039, avg=1084.72, stdev=1455.83 lat (msec): min=291, max=4039, avg=1084.82, stdev=1455.81 clat percentiles (msec): | 1.00th=[ 292], 5.00th=[ 292], 10.00th=[ 292], 20.00th=[ 338], | 30.00th=[ 338], 40.00th=[ 558], 50.00th=[ 558], 60.00th=[ 584], | 70.00th=[ 693], 80.00th=[ 693], 90.00th=[ 4044], 95.00th=[ 4044], | 99.00th=[ 4044], 99.50th=[ 4044], 99.90th=[ 4044], 99.95th=[ 4044], | 99.99th=[ 4044] bw ( KiB/s): min= 1910, max= 2048, per=60.50%, avg=1976.40, stdev=61.37, samples=5 iops : min= 1, max= 2, avg= 1.20, stdev= 0.45, samples=5 lat (msec) : 100=16.67%, 250=16.67%, 500=33.33%, 750=25.00%, >=2000=8.33% cpu : usr=0.03%, sys=1.85%, ctx=69, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144689: Tue Aug 25 22:17:31 2026 read: IOPS=0, BW=583KiB/s (597kB/s)(5120KiB/8776msec) clat (msec): min=55, max=653, avg=292.28, stdev=222.21 lat (msec): min=55, max=653, avg=292.28, stdev=222.21 clat percentiles (msec): | 1.00th=[ 56], 5.00th=[ 56], 10.00th=[ 56], 20.00th=[ 56], | 30.00th=[ 203], 40.00th=[ 203], 50.00th=[ 241], 60.00th=[ 241], | 70.00th=[ 309], 80.00th=[ 309], 90.00th=[ 651], 95.00th=[ 651], | 99.00th=[ 651], 99.50th=[ 651], 99.90th=[ 651], 99.95th=[ 651], | 99.99th=[ 651] bw ( KiB/s): min= 1973, max= 4063, per=100.00%, avg=2683.67, stdev=1194.72, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 write: IOPS=0, BW=817KiB/s (836kB/s)(7168KiB/8776msec); 0 zone resets clat (msec): min=142, max=4261, avg=1018.02, stdev=1466.75 lat (msec): min=142, max=4261, avg=1018.75, stdev=1466.31 clat percentiles (msec): | 1.00th=[ 142], 5.00th=[ 142], 10.00th=[ 142], 20.00th=[ 159], | 30.00th=[ 215], 40.00th=[ 215], 50.00th=[ 584], 60.00th=[ 793], | 70.00th=[ 793], 80.00th=[ 969], 90.00th=[ 4245], 95.00th=[ 4245], | 99.00th=[ 4245], 99.50th=[ 4245], 99.90th=[ 4245], 99.95th=[ 4245], | 99.99th=[ 4245] bw ( KiB/s): min= 1969, max= 2039, per=61.10%, avg=1996.00, stdev=32.43, samples=4 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=4 lat (msec) : 100=8.33%, 250=41.67%, 500=8.33%, 750=16.67%, 1000=16.67% lat (msec) : >=2000=8.33% cpu : usr=0.01%, sys=1.83%, ctx=78, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2334KiB/s (2390kB/s), 252KiB/s-945KiB/s (258kB/s-968kB/s), io=20.0MiB (20.0MB), run=7582-8776msec WRITE: bw=3267KiB/s (3346kB/s), 675KiB/s-1259KiB/s (691kB/s-1289kB/s), io=28.0MiB (29.4MB), run=7582-8776msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144704: Tue Aug 25 22:17:47 2026 read: IOPS=0, BW=2515KiB/s (2575kB/s)(12.0MiB/4886msec) clat (msec): min=403, max=3466, avg=1627.84, stdev=1621.31 lat (msec): min=403, max=3466, avg=1627.84, stdev=1621.31 clat percentiles (msec): | 1.00th=[ 405], 5.00th=[ 405], 10.00th=[ 405], 20.00th=[ 405], | 30.00th=[ 405], 40.00th=[ 1011], 50.00th=[ 1011], 60.00th=[ 1011], | 70.00th=[ 3473], 80.00th=[ 3473], 90.00th=[ 3473], 95.00th=[ 3473], | 99.00th=[ 3473], 99.50th=[ 3473], 99.90th=[ 3473], 99.95th=[ 3473], | 99.99th=[ 3473] bw ( KiB/s): min= 8078, max= 8143, per=100.00%, avg=8110.50, stdev=45.96, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=2.52%, ctx=44, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144705: Tue Aug 25 22:17:47 2026 read: IOPS=0, BW=785KiB/s (804kB/s)(4096KiB/5219msec) clat (nsec): min=3172.2M, max=3172.2M, avg=3172194282.00, stdev= 0.00 lat (nsec): min=3172.2M, max=3172.2M, avg=3172197062.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 3171], 5.00th=[ 3171], 10.00th=[ 3171], 20.00th=[ 3171], | 30.00th=[ 3171], 40.00th=[ 3171], 50.00th=[ 3171], 60.00th=[ 3171], | 70.00th=[ 3171], 80.00th=[ 3171], 90.00th=[ 3171], 95.00th=[ 3171], | 99.00th=[ 3171], 99.50th=[ 3171], 99.90th=[ 3171], 99.95th=[ 3171], | 99.99th=[ 3171] bw ( KiB/s): min= 8078, max= 8078, per=100.00%, avg=8078.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=1570KiB/s (1607kB/s)(8192KiB/5219msec); 0 zone resets clat (msec): min=975, max=1063, avg=1019.59, stdev=62.25 lat (msec): min=978, max=1064, avg=1021.59, stdev=61.36 clat percentiles (msec): | 1.00th=[ 978], 5.00th=[ 978], 10.00th=[ 978], 20.00th=[ 978], | 30.00th=[ 978], 40.00th=[ 978], 50.00th=[ 978], 60.00th=[ 1062], | 70.00th=[ 1062], 80.00th=[ 1062], 90.00th=[ 1062], 95.00th=[ 1062], | 99.00th=[ 1062], 99.50th=[ 1062], 99.90th=[ 1062], 99.95th=[ 1062], | 99.99th=[ 1062] bw ( KiB/s): min= 8143, max= 8143, per=100.00%, avg=8143.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 1000=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=2.26%, ctx=38, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144706: Tue Aug 25 22:17:47 2026 write: IOPS=0, BW=2640KiB/s (2703kB/s)(12.0MiB/4655msec); 0 zone resets clat (msec): min=450, max=2923, avg=1550.47, stdev=1259.14 lat (msec): min=450, max=2924, avg=1550.93, stdev=1259.09 clat percentiles (msec): | 1.00th=[ 451], 5.00th=[ 451], 10.00th=[ 451], 20.00th=[ 451], | 30.00th=[ 451], 40.00th=[ 1284], 50.00th=[ 1284], 60.00th=[ 1284], | 70.00th=[ 2937], 80.00th=[ 2937], 90.00th=[ 2937], 95.00th=[ 2937], | 99.00th=[ 2937], 99.50th=[ 2937], 99.90th=[ 2937], 99.95th=[ 2937], | 99.99th=[ 2937] bw ( KiB/s): min= 8062, max= 8078, per=100.00%, avg=8070.00, stdev=11.31, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.02%, sys=3.93%, ctx=58, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144707: Tue Aug 25 22:17:47 2026 write: IOPS=0, BW=2633KiB/s (2696kB/s)(12.0MiB/4667msec); 0 zone resets clat (msec): min=541, max=3186, avg=1553.80, stdev=1427.76 lat (msec): min=541, max=3187, avg=1554.38, stdev=1428.18 clat percentiles (msec): | 1.00th=[ 542], 5.00th=[ 542], 10.00th=[ 542], 20.00th=[ 542], | 30.00th=[ 542], 40.00th=[ 936], 50.00th=[ 936], 60.00th=[ 936], | 70.00th=[ 3171], 80.00th=[ 3171], 90.00th=[ 3171], 95.00th=[ 3171], | 99.00th=[ 3171], 99.50th=[ 3171], 99.90th=[ 3171], 99.95th=[ 3171], | 99.99th=[ 3171] bw ( KiB/s): min= 8078, max= 8159, per=100.00%, avg=8118.50, stdev=57.28, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 1000=33.33%, >=2000=33.33% cpu : usr=0.04%, sys=4.39%, ctx=66, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3139KiB/s (3215kB/s), 785KiB/s-2515KiB/s (804kB/s-2575kB/s), io=16.0MiB (16.8MB), run=4886-5219msec WRITE: bw=6279KiB/s (6429kB/s), 1570KiB/s-2640KiB/s (1607kB/s-2703kB/s), io=32.0MiB (33.6MB), run=4655-5219msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144699: Tue Aug 25 22:17:48 2026 read: IOPS=0, BW=4035KiB/s (4132kB/s)(12.0MiB/3045msec) clat (msec): min=573, max=1776, avg=991.85, stdev=679.63 lat (msec): min=573, max=1776, avg=991.86, stdev=679.63 clat percentiles (msec): | 1.00th=[ 575], 5.00th=[ 575], 10.00th=[ 575], 20.00th=[ 575], | 30.00th=[ 575], 40.00th=[ 625], 50.00th=[ 625], 60.00th=[ 625], | 70.00th=[ 1770], 80.00th=[ 1770], 90.00th=[ 1770], 95.00th=[ 1770], | 99.00th=[ 1770], 99.50th=[ 1770], 99.90th=[ 1770], 99.95th=[ 1770], | 99.99th=[ 1770] bw ( KiB/s): min= 8175, max= 8192, per=100.00%, avg=8183.50, stdev=12.02, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 750=66.67%, 2000=33.33% cpu : usr=0.00%, sys=13.47%, ctx=399, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144700: Tue Aug 25 22:17:48 2026 read: IOPS=0, BW=888KiB/s (909kB/s)(4096KiB/4615msec) clat (nsec): min=3064.9M, max=3064.9M, avg=3064900856.00, stdev= 0.00 lat (nsec): min=3064.9M, max=3064.9M, avg=3064903181.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 3071], 5.00th=[ 3071], 10.00th=[ 3071], 20.00th=[ 3071], | 30.00th=[ 3071], 40.00th=[ 3071], 50.00th=[ 3071], 60.00th=[ 3071], | 70.00th=[ 3071], 80.00th=[ 3071], 90.00th=[ 3071], 95.00th=[ 3071], | 99.00th=[ 3071], 99.50th=[ 3071], 99.90th=[ 3071], 99.95th=[ 3071], | 99.99th=[ 3071] bw ( KiB/s): min= 8094, max= 8094, per=100.00%, avg=8094.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=1775KiB/s (1818kB/s)(8192KiB/4615msec); 0 zone resets clat (msec): min=722, max=758, avg=740.24, stdev=25.65 lat (msec): min=722, max=758, avg=740.51, stdev=25.50 clat percentiles (msec): | 1.00th=[ 726], 5.00th=[ 726], 10.00th=[ 726], 20.00th=[ 726], | 30.00th=[ 726], 40.00th=[ 726], 50.00th=[ 726], 60.00th=[ 760], | 70.00th=[ 760], 80.00th=[ 760], 90.00th=[ 760], 95.00th=[ 760], | 99.00th=[ 760], 99.50th=[ 760], 99.90th=[ 760], 99.95th=[ 760], | 99.99th=[ 760] bw ( KiB/s): min= 8192, max= 8192, per=100.00%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, 1000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=6.18%, ctx=461, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144701: Tue Aug 25 22:17:48 2026 write: IOPS=0, BW=2158KiB/s (2209kB/s)(12.0MiB/5695msec); 0 zone resets clat (msec): min=408, max=4235, avg=1856.96, stdev=2075.75 lat (msec): min=409, max=4235, avg=1857.27, stdev=2075.73 clat percentiles (msec): | 1.00th=[ 409], 5.00th=[ 409], 10.00th=[ 409], 20.00th=[ 409], | 30.00th=[ 409], 40.00th=[ 927], 50.00th=[ 927], 60.00th=[ 927], | 70.00th=[ 4245], 80.00th=[ 4245], 90.00th=[ 4245], 95.00th=[ 4245], | 99.00th=[ 4245], 99.50th=[ 4245], 99.90th=[ 4245], 99.95th=[ 4245], | 99.99th=[ 4245] bw ( KiB/s): min= 8062, max= 8078, per=100.00%, avg=8070.00, stdev=11.31, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 1000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=3.37%, ctx=64, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144702: Tue Aug 25 22:17:48 2026 write: IOPS=0, BW=2726KiB/s (2791kB/s)(12.0MiB/4508msec); 0 zone resets clat (msec): min=671, max=2288, avg=1501.60, stdev=809.26 lat (msec): min=671, max=2288, avg=1502.27, stdev=809.23 clat percentiles (msec): | 1.00th=[ 676], 5.00th=[ 676], 10.00th=[ 676], 20.00th=[ 676], | 30.00th=[ 676], 40.00th=[ 1552], 50.00th=[ 1552], 60.00th=[ 1552], | 70.00th=[ 2299], 80.00th=[ 2299], 90.00th=[ 2299], 95.00th=[ 2299], | 99.00th=[ 2299], 99.50th=[ 2299], 99.90th=[ 2299], 99.95th=[ 2299], | 99.99th=[ 2299] bw ( KiB/s): min= 7953, max= 8192, per=100.00%, avg=8072.50, stdev=169.00, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 750=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=2.77%, ctx=44, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3550KiB/s (3635kB/s), 888KiB/s-4035KiB/s (909kB/s-4132kB/s), io=16.0MiB (16.8MB), run=3045-4615msec WRITE: bw=5754KiB/s (5892kB/s), 1775KiB/s-2726KiB/s (1818kB/s-2791kB/s), io=32.0MiB (33.6MB), run=4508-5695msec