== sanity test 398b: DIO and buffer IO race ============== 15:04:10 (1788807850) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 4.37825 s, 11.5 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179832: Mon Sep 7 15:05:50 2026 read: IOPS=17, BW=70.3KiB/s (71.0kB/s)(5992KiB/85233msec) clat (usec): min=33, max=694087, avg=31807.78, stdev=26644.41 lat (usec): min=34, max=694088, avg=31810.78, stdev=26644.92 clat percentiles (usec): | 1.00th=[ 56], 5.00th=[ 8586], 10.00th=[ 12911], 20.00th=[ 16450], | 30.00th=[ 19530], 40.00th=[ 23200], 50.00th=[ 27132], 60.00th=[ 32113], | 70.00th=[ 36963], 80.00th=[ 43779], 90.00th=[ 55313], 95.00th=[ 66323], | 99.00th=[110625], 99.50th=[125305], 99.90th=[217056], 99.95th=[692061], | 99.99th=[692061] bw ( KiB/s): min= 15, max= 143, per=25.21%, avg=69.83, stdev=23.44, samples=169 iops : min= 3, max= 35, avg=16.83, stdev= 5.90, samples=169 write: IOPS=18, BW=73.9KiB/s (75.6kB/s)(6296KiB/85233msec); 0 zone resets clat (usec): min=673, max=144352, avg=23641.42, stdev=23522.38 lat (usec): min=674, max=144354, avg=23643.89, stdev=23522.31 clat percentiles (usec): | 1.00th=[ 1074], 5.00th=[ 1303], 10.00th=[ 1631], 20.00th=[ 3032], | 30.00th=[ 5145], 40.00th=[ 11731], 50.00th=[ 17695], 60.00th=[ 22938], | 70.00th=[ 30278], 80.00th=[ 41157], 90.00th=[ 57934], 95.00th=[ 70779], | 99.00th=[ 96994], 99.50th=[127402], 99.90th=[141558], 99.95th=[143655], | 99.99th=[143655] bw ( KiB/s): min= 7, max= 136, per=25.32%, avg=73.68, stdev=25.42, samples=168 iops : min= 1, max= 34, avg=17.81, stdev= 6.42, samples=168 lat (usec) : 50=0.13%, 100=1.50%, 250=0.13%, 500=0.03%, 750=0.10% lat (usec) : 1000=0.23% lat (msec) : 2=6.48%, 4=6.38%, 10=7.32%, 20=21.16%, 50=42.42% lat (msec) : 100=13.05%, 250=1.04%, 750=0.03% cpu : usr=0.10%, sys=8.51%, ctx=6861, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179834: Mon Sep 7 15:05:50 2026 read: IOPS=17, BW=69.8KiB/s (71.5kB/s)(5940KiB/85123msec) clat (usec): min=42, max=712795, avg=31379.15, stdev=25605.49 lat (usec): min=43, max=712798, avg=31384.28, stdev=25605.25 clat percentiles (usec): | 1.00th=[ 53], 5.00th=[ 9896], 10.00th=[ 12780], 20.00th=[ 16057], | 30.00th=[ 19530], 40.00th=[ 23462], 50.00th=[ 26870], 60.00th=[ 31327], | 70.00th=[ 36963], 80.00th=[ 44303], 90.00th=[ 55313], 95.00th=[ 63701], | 99.00th=[ 93848], 99.50th=[116917], 99.90th=[166724], 99.95th=[708838], | 99.99th=[708838] bw ( KiB/s): min= 7, max= 119, per=25.15%, avg=69.66, stdev=21.83, samples=167 iops : min= 1, max= 29, avg=16.79, stdev= 5.48, samples=167 write: IOPS=18, BW=74.6KiB/s (76.4kB/s)(6348KiB/85123msec); 0 zone resets clat (usec): min=824, max=166055, avg=24032.89, stdev=23476.00 lat (usec): min=826, max=166056, avg=24035.68, stdev=23476.06 clat percentiles (usec): | 1.00th=[ 1090], 5.00th=[ 1336], 10.00th=[ 1811], 20.00th=[ 3163], | 30.00th=[ 5669], 40.00th=[ 12256], 50.00th=[ 18220], 60.00th=[ 23987], | 70.00th=[ 30802], 80.00th=[ 42206], 90.00th=[ 57410], 95.00th=[ 69731], | 99.00th=[100140], 99.50th=[115868], 99.90th=[154141], 99.95th=[166724], | 99.99th=[166724] bw ( KiB/s): min= 7, max= 174, per=25.52%, avg=74.26, stdev=27.30, samples=167 iops : min= 1, max= 43, avg=17.95, stdev= 6.88, samples=167 lat (usec) : 50=0.26%, 100=0.91%, 250=0.23%, 500=0.07%, 1000=0.26% lat (msec) : 2=5.86%, 4=6.38%, 10=7.49%, 20=21.35%, 50=42.84% lat (msec) : 100=13.54%, 250=0.78%, 750=0.03% cpu : usr=0.12%, sys=8.43%, ctx=6982, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179835: Mon Sep 7 15:05:50 2026 read: IOPS=17, BW=71.2KiB/s (72.9kB/s)(6028KiB/84637msec) clat (usec): min=32, max=156272, avg=30599.51, stdev=19121.53 lat (usec): min=33, max=156273, avg=30602.26, stdev=19122.18 clat percentiles (usec): | 1.00th=[ 56], 5.00th=[ 7373], 10.00th=[ 12911], 20.00th=[ 16057], | 30.00th=[ 19530], 40.00th=[ 22938], 50.00th=[ 26870], 60.00th=[ 31589], | 70.00th=[ 36439], 80.00th=[ 43254], 90.00th=[ 53740], 95.00th=[ 66847], | 99.00th=[ 96994], 99.50th=[107480], 99.90th=[133694], 99.95th=[156238], | 99.99th=[156238] bw ( KiB/s): min= 23, max= 126, per=25.78%, avg=71.41, stdev=20.85, samples=165 iops : min= 5, max= 31, avg=17.24, stdev= 5.23, samples=165 write: IOPS=18, BW=73.0KiB/s (75.7kB/s)(6260KiB/84637msec); 0 zone resets clat (usec): min=852, max=729376, avg=24391.70, stdev=29587.78 lat (usec): min=854, max=729378, avg=24396.68, stdev=29587.32 clat percentiles (usec): | 1.00th=[ 1106], 5.00th=[ 1385], 10.00th=[ 1860], 20.00th=[ 3392], | 30.00th=[ 5735], 40.00th=[ 11994], 50.00th=[ 18220], 60.00th=[ 23200], | 70.00th=[ 30016], 80.00th=[ 40109], 90.00th=[ 58459], 95.00th=[ 71828], | 99.00th=[ 99091], 99.50th=[113771], 99.90th=[202376], 99.95th=[725615], | 99.99th=[725615] bw ( KiB/s): min= 15, max= 165, per=25.30%, avg=73.63, stdev=27.23, samples=166 iops : min= 3, max= 41, avg=17.79, stdev= 6.86, samples=166 lat (usec) : 50=0.26%, 100=1.56%, 250=0.33%, 500=0.13%, 1000=0.20% lat (msec) : 2=5.50%, 4=6.25%, 10=8.01%, 20=20.70%, 50=43.75% lat (msec) : 100=12.47%, 250=0.81%, 750=0.03% cpu : usr=0.13%, sys=8.46%, ctx=6839, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179837: Mon Sep 7 15:05:50 2026 read: IOPS=17, BW=70.1KiB/s (71.7kB/s)(6052KiB/86390msec) clat (usec): min=21, max=159519, avg=30949.88, stdev=20243.92 lat (usec): min=21, max=159521, avg=30963.75, stdev=20247.59 clat percentiles (usec): | 1.00th=[ 55], 5.00th=[ 7570], 10.00th=[ 12387], 20.00th=[ 16057], | 30.00th=[ 19530], 40.00th=[ 23200], 50.00th=[ 26870], 60.00th=[ 31065], | 70.00th=[ 36963], 80.00th=[ 42730], 90.00th=[ 53740], 95.00th=[ 67634], | 99.00th=[108528], 99.50th=[123208], 99.90th=[154141], 99.95th=[160433], | 99.99th=[160433] bw ( KiB/s): min= 23, max= 167, per=25.17%, avg=69.72, stdev=21.47, samples=169 iops : min= 5, max= 41, avg=16.82, stdev= 5.40, samples=169 write: IOPS=18, BW=72.2KiB/s (73.9kB/s)(6236KiB/86390msec); 0 zone resets clat (usec): min=808, max=697868, avg=25141.02, stdev=29266.46 lat (usec): min=809, max=697870, avg=25146.40, stdev=29268.18 clat percentiles (usec): | 1.00th=[ 1057], 5.00th=[ 1336], 10.00th=[ 1729], 20.00th=[ 3326], | 30.00th=[ 6521], 40.00th=[ 13173], 50.00th=[ 18744], 60.00th=[ 24773], | 70.00th=[ 32375], 80.00th=[ 42730], 90.00th=[ 57410], 95.00th=[ 70779], | 99.00th=[101188], 99.50th=[109577], 99.90th=[214959], 99.95th=[700449], | 99.99th=[700449] bw ( KiB/s): min= 10, max= 167, per=24.60%, avg=71.58, stdev=26.11, samples=170 iops : min= 2, max= 41, avg=17.28, stdev= 6.55, samples=170 lat (usec) : 50=0.36%, 100=1.46%, 250=0.26%, 500=0.07%, 1000=0.29% lat (msec) : 2=5.76%, 4=5.79%, 10=7.49%, 20=20.41%, 50=44.50% lat (msec) : 100=12.34%, 250=1.24%, 750=0.03% cpu : usr=0.13%, sys=8.52%, ctx=7037, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=278KiB/s (285kB/s), 69.8KiB/s-71.2KiB/s (71.5kB/s-72.9kB/s), io=23.4MiB (24.6MB), run=84637-86390msec WRITE: bw=291KiB/s (298kB/s), 72.2KiB/s-74.6KiB/s (73.9kB/s-76.4kB/s), io=24.6MiB (25.7MB), run=84637-86390msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179831: Mon Sep 7 15:06:14 2026 read: IOPS=13, BW=54.5KiB/s (55.8kB/s)(5992KiB/109868msec) clat (msec): min=4, max=719, avg=28.69, stdev=30.38 lat (msec): min=4, max=719, avg=28.69, stdev=30.38 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 11], | 30.00th=[ 14], 40.00th=[ 16], 50.00th=[ 19], 60.00th=[ 24], | 70.00th=[ 31], 80.00th=[ 42], 90.00th=[ 65], 95.00th=[ 85], | 99.00th=[ 114], 99.50th=[ 122], 99.90th=[ 176], 99.95th=[ 718], | 99.99th=[ 718] bw ( KiB/s): min= 7, max= 175, per=25.13%, avg=54.54, stdev=36.34, samples=216 iops : min= 1, max= 43, avg=13.05, stdev= 9.13, samples=216 write: IOPS=14, BW=57.3KiB/s (58.7kB/s)(6296KiB/109868msec); 0 zone resets clat (msec): min=7, max=229, avg=42.29, stdev=30.90 lat (msec): min=7, max=229, avg=42.30, stdev=30.90 clat percentiles (msec): | 1.00th=[ 12], 5.00th=[ 14], 10.00th=[ 16], 20.00th=[ 19], | 30.00th=[ 22], 40.00th=[ 27], 50.00th=[ 32], 60.00th=[ 39], | 70.00th=[ 51], 80.00th=[ 64], 90.00th=[ 84], 95.00th=[ 101], | 99.00th=[ 159], 99.50th=[ 186], 99.90th=[ 228], 99.95th=[ 230], | 99.99th=[ 230] bw ( KiB/s): min= 7, max= 175, per=25.23%, avg=57.26, stdev=35.69, samples=216 iops : min= 1, max= 43, avg=13.73, stdev= 8.98, samples=216 lat (msec) : 10=7.85%, 20=30.60%, 50=38.38%, 100=19.63%, 250=3.52% lat (msec) : 750=0.03% cpu : usr=0.09%, sys=3.12%, ctx=4888, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179833: Mon Sep 7 15:06:14 2026 read: IOPS=13, BW=53.7KiB/s (54.0kB/s)(5940KiB/110633msec) clat (msec): min=4, max=710, avg=28.88, stdev=30.31 lat (msec): min=4, max=710, avg=28.88, stdev=30.31 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 12], | 30.00th=[ 14], 40.00th=[ 16], 50.00th=[ 20], 60.00th=[ 24], | 70.00th=[ 31], 80.00th=[ 42], 90.00th=[ 64], 95.00th=[ 83], | 99.00th=[ 118], 99.50th=[ 142], 99.90th=[ 178], 99.95th=[ 709], | 99.99th=[ 709] bw ( KiB/s): min= 7, max= 181, per=24.65%, avg=53.48, stdev=37.60, samples=217 iops : min= 1, max= 45, avg=12.78, stdev= 9.45, samples=217 write: IOPS=14, BW=57.4KiB/s (58.8kB/s)(6348KiB/110633msec); 0 zone resets clat (msec): min=8, max=281, avg=42.49, stdev=30.36 lat (msec): min=8, max=281, avg=42.49, stdev=30.36 clat percentiles (msec): | 1.00th=[ 12], 5.00th=[ 14], 10.00th=[ 16], 20.00th=[ 19], | 30.00th=[ 23], 40.00th=[ 27], 50.00th=[ 32], 60.00th=[ 41], | 70.00th=[ 51], 80.00th=[ 65], 90.00th=[ 84], 95.00th=[ 105], | 99.00th=[ 146], 99.50th=[ 167], 99.90th=[ 218], 99.95th=[ 284], | 99.99th=[ 284] bw ( KiB/s): min= 7, max= 159, per=25.04%, avg=56.85, stdev=35.20, samples=218 iops : min= 1, max= 39, avg=13.62, stdev= 8.83, samples=218 lat (msec) : 10=7.39%, 20=29.62%, 50=40.01%, 100=18.85%, 250=4.07% lat (msec) : 500=0.03%, 750=0.03% cpu : usr=0.10%, sys=3.09%, ctx=4889, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179836: Mon Sep 7 15:06:14 2026 read: IOPS=13, BW=55.3KiB/s (56.7kB/s)(6028KiB/108960msec) clat (msec): min=4, max=200, avg=28.14, stdev=25.03 lat (msec): min=4, max=200, avg=28.14, stdev=25.03 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 12], | 30.00th=[ 14], 40.00th=[ 16], 50.00th=[ 20], 60.00th=[ 24], | 70.00th=[ 29], 80.00th=[ 41], 90.00th=[ 62], 95.00th=[ 83], | 99.00th=[ 125], 99.50th=[ 140], 99.90th=[ 186], 99.95th=[ 201], | 99.99th=[ 201] bw ( KiB/s): min= 7, max= 206, per=25.58%, avg=55.51, stdev=35.84, samples=213 iops : min= 1, max= 51, avg=13.29, stdev= 9.03, samples=213 write: IOPS=14, BW=57.5KiB/s (58.8kB/s)(6260KiB/108960msec); 0 zone resets clat (msec): min=6, max=719, avg=42.32, stdev=34.67 lat (msec): min=6, max=719, avg=42.33, stdev=34.67 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 14], 10.00th=[ 16], 20.00th=[ 19], | 30.00th=[ 22], 40.00th=[ 26], 50.00th=[ 31], 60.00th=[ 39], | 70.00th=[ 50], 80.00th=[ 64], 90.00th=[ 85], 95.00th=[ 104], | 99.00th=[ 157], 99.50th=[ 178], 99.90th=[ 230], 99.95th=[ 718], | 99.99th=[ 718] bw ( KiB/s): min= 7, max= 191, per=25.17%, avg=57.13, stdev=36.54, samples=215 iops : min= 1, max= 47, avg=13.69, stdev= 9.18, samples=215 lat (msec) : 10=7.65%, 20=30.34%, 50=40.14%, 100=17.58%, 250=4.26% lat (msec) : 750=0.03% cpu : usr=0.10%, sys=3.09%, ctx=4969, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179838: Mon Sep 7 15:06:14 2026 read: IOPS=13, BW=54.8KiB/s (56.1kB/s)(6052KiB/110490msec) clat (msec): min=4, max=165, avg=28.23, stdev=24.94 lat (msec): min=4, max=165, avg=28.23, stdev=24.94 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 12], | 30.00th=[ 14], 40.00th=[ 17], 50.00th=[ 19], 60.00th=[ 23], | 70.00th=[ 30], 80.00th=[ 42], 90.00th=[ 65], 95.00th=[ 82], | 99.00th=[ 124], 99.50th=[ 140], 99.90th=[ 165], 99.95th=[ 167], | 99.99th=[ 167] bw ( KiB/s): min= 7, max= 183, per=25.54%, avg=55.41, stdev=36.71, samples=214 iops : min= 1, max= 45, avg=13.27, stdev= 9.22, samples=214 write: IOPS=14, BW=56.4KiB/s (57.8kB/s)(6236KiB/110490msec); 0 zone resets clat (msec): min=7, max=720, avg=43.26, stdev=36.34 lat (msec): min=7, max=720, avg=43.27, stdev=36.33 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 14], 10.00th=[ 16], 20.00th=[ 19], | 30.00th=[ 22], 40.00th=[ 26], 50.00th=[ 32], 60.00th=[ 41], | 70.00th=[ 52], 80.00th=[ 65], 90.00th=[ 85], 95.00th=[ 106], | 99.00th=[ 161], 99.50th=[ 194], 99.90th=[ 275], 99.95th=[ 718], | 99.99th=[ 718] bw ( KiB/s): min= 7, max= 166, per=24.65%, avg=55.96, stdev=35.50, samples=218 iops : min= 1, max= 41, avg=13.40, stdev= 8.94, samples=218 lat (msec) : 10=7.65%, 20=31.51%, 50=37.89%, 100=18.95%, 250=3.94% lat (msec) : 500=0.03%, 750=0.03% cpu : usr=0.10%, sys=3.07%, ctx=5030, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=217KiB/s (222kB/s), 53.7KiB/s-55.3KiB/s (54.0kB/s-56.7kB/s), io=23.4MiB (24.6MB), run=108960-110633msec WRITE: bw=227KiB/s (233kB/s), 56.4KiB/s-57.5KiB/s (57.8kB/s-58.8kB/s), io=24.6MiB (25.7MB), run=108960-110633msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179876: Mon Sep 7 15:06:44 2026 read: IOPS=16, BW=271KiB/s (278kB/s)(5920KiB/21807msec) clat (usec): min=45, max=172012, avg=30256.33, stdev=20498.20 lat (usec): min=46, max=172013, avg=30258.06, stdev=20498.18 clat percentiles (usec): | 1.00th=[ 67], 5.00th=[ 93], 10.00th=[ 11600], 20.00th=[ 16057], | 30.00th=[ 19530], 40.00th=[ 22414], 50.00th=[ 26346], 60.00th=[ 30802], | 70.00th=[ 35914], 80.00th=[ 42206], 90.00th=[ 54789], 95.00th=[ 66323], | 99.00th=[ 98042], 99.50th=[137364], 99.90th=[173016], 99.95th=[173016], | 99.99th=[173016] bw ( KiB/s): min= 127, max= 571, per=25.54%, avg=270.44, stdev=91.39, samples=43 iops : min= 7, max= 35, avg=16.19, stdev= 5.72, samples=43 write: IOPS=18, BW=292KiB/s (299kB/s)(6368KiB/21807msec); 0 zone resets clat (usec): min=1365, max=149377, avg=26586.28, stdev=25833.38 lat (usec): min=1367, max=149379, avg=26598.84, stdev=25852.56 clat percentiles (usec): | 1.00th=[ 1663], 5.00th=[ 2278], 10.00th=[ 3032], 20.00th=[ 5997], | 30.00th=[ 8717], 40.00th=[ 12911], 50.00th=[ 18744], 60.00th=[ 25560], | 70.00th=[ 32900], 80.00th=[ 43779], 90.00th=[ 60031], 95.00th=[ 74974], | 99.00th=[121111], 99.50th=[143655], 99.90th=[149947], 99.95th=[149947], | 99.99th=[149947] bw ( KiB/s): min= 127, max= 541, per=26.15%, avg=291.35, stdev=88.63, samples=43 iops : min= 7, max= 33, avg=17.51, stdev= 5.54, samples=43 lat (usec) : 50=0.13%, 100=2.86%, 250=0.52%, 500=0.13% lat (msec) : 2=1.69%, 4=5.21%, 10=10.94%, 20=20.05%, 50=43.88% lat (msec) : 100=12.89%, 250=1.69% cpu : usr=0.13%, sys=9.68%, ctx=1892, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179877: Mon Sep 7 15:06:44 2026 read: IOPS=16, BW=266KiB/s (273kB/s)(5744KiB/21584msec) clat (usec): min=43, max=140947, avg=32117.81, stdev=20336.69 lat (usec): min=43, max=140948, avg=32119.44, stdev=20336.72 clat percentiles (usec): | 1.00th=[ 50], 5.00th=[ 91], 10.00th=[ 10814], 20.00th=[ 17695], | 30.00th=[ 21365], 40.00th=[ 24511], 50.00th=[ 28443], 60.00th=[ 33817], | 70.00th=[ 40109], 80.00th=[ 45876], 90.00th=[ 54264], 95.00th=[ 66323], | 99.00th=[109577], 99.50th=[129500], 99.90th=[141558], 99.95th=[141558], | 99.99th=[141558] bw ( KiB/s): min= 95, max= 382, per=24.81%, avg=262.76, stdev=73.07, samples=42 iops : min= 5, max= 23, avg=15.74, stdev= 4.50, samples=42 write: IOPS=18, BW=303KiB/s (310kB/s)(6544KiB/21584msec); 0 zone resets clat (usec): min=1284, max=158685, avg=24513.19, stdev=22038.94 lat (usec): min=1285, max=158689, avg=24522.75, stdev=22034.43 clat percentiles (usec): | 1.00th=[ 1598], 5.00th=[ 2114], 10.00th=[ 2999], 20.00th=[ 5407], | 30.00th=[ 8717], 40.00th=[ 14484], 50.00th=[ 18744], 60.00th=[ 22938], | 70.00th=[ 29492], 80.00th=[ 42206], 90.00th=[ 56886], 95.00th=[ 63701], | 99.00th=[ 91751], 99.50th=[100140], 99.90th=[158335], 99.95th=[158335], | 99.99th=[158335] bw ( KiB/s): min= 127, max= 509, per=26.36%, avg=293.69, stdev=94.74, samples=42 iops : min= 7, max= 31, avg=17.67, stdev= 5.96, samples=42 lat (usec) : 50=0.52%, 100=2.08%, 250=0.52%, 500=0.26% lat (msec) : 2=1.95%, 4=5.34%, 10=11.07%, 20=18.62%, 50=45.05% lat (msec) : 100=13.54%, 250=1.04% cpu : usr=0.10%, sys=10.48%, ctx=1894, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179878: Mon Sep 7 15:06:44 2026 read: IOPS=17, BW=277KiB/s (283kB/s)(6256KiB/22612msec) clat (usec): min=54, max=112312, avg=32273.56, stdev=19431.13 lat (usec): min=55, max=112314, avg=32275.00, stdev=19431.17 clat percentiles (usec): | 1.00th=[ 61], 5.00th=[ 90], 10.00th=[ 12387], 20.00th=[ 17957], | 30.00th=[ 21365], 40.00th=[ 25297], 50.00th=[ 30016], 60.00th=[ 34341], | 70.00th=[ 39060], 80.00th=[ 45876], 90.00th=[ 57410], 95.00th=[ 67634], | 99.00th=[103285], 99.50th=[104334], 99.90th=[112722], 99.95th=[112722], | 99.99th=[112722] bw ( KiB/s): min= 95, max= 507, per=25.99%, avg=275.18, stdev=93.64, samples=44 iops : min= 5, max= 31, avg=16.52, stdev= 5.87, samples=44 write: IOPS=16, BW=267KiB/s (273kB/s)(6032KiB/22612msec); 0 zone resets clat (usec): min=1665, max=177303, avg=26410.77, stdev=23636.14 lat (usec): min=1668, max=177305, avg=26421.93, stdev=23647.68 clat percentiles (usec): | 1.00th=[ 1860], 5.00th=[ 2507], 10.00th=[ 3359], 20.00th=[ 5735], | 30.00th=[ 10028], 40.00th=[ 15270], 50.00th=[ 20317], 60.00th=[ 26608], | 70.00th=[ 33162], 80.00th=[ 42730], 90.00th=[ 57934], 95.00th=[ 76022], | 99.00th=[102237], 99.50th=[106431], 99.90th=[177210], 99.95th=[177210], | 99.99th=[177210] bw ( KiB/s): min= 32, max= 480, per=23.52%, avg=262.00, stdev=91.17, samples=44 iops : min= 2, max= 30, avg=15.68, stdev= 5.77, samples=44 lat (usec) : 100=2.60%, 250=0.91%, 500=0.13%, 750=0.13% lat (msec) : 2=1.17%, 4=5.60%, 10=8.59%, 20=18.62%, 50=47.27% lat (msec) : 100=13.93%, 250=1.04% cpu : usr=0.11%, sys=10.18%, ctx=2014, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179879: Mon Sep 7 15:06:44 2026 read: IOPS=17, BW=288KiB/s (295kB/s)(6032KiB/20954msec) clat (usec): min=49, max=124710, avg=30401.07, stdev=20615.57 lat (usec): min=49, max=124712, avg=30402.84, stdev=20615.20 clat percentiles (usec): | 1.00th=[ 54], 5.00th=[ 77], 10.00th=[ 7898], 20.00th=[ 15795], | 30.00th=[ 19006], 40.00th=[ 22152], 50.00th=[ 26346], 60.00th=[ 30802], | 70.00th=[ 38536], 80.00th=[ 45876], 90.00th=[ 55837], 95.00th=[ 70779], | 99.00th=[ 96994], 99.50th=[114820], 99.90th=[124257], 99.95th=[124257], | 99.99th=[124257] bw ( KiB/s): min= 127, max= 571, per=27.06%, avg=286.61, stdev=88.38, samples=41 iops : min= 7, max= 35, avg=17.22, stdev= 5.57, samples=41 write: IOPS=18, BW=299KiB/s (306kB/s)(6256KiB/20954msec); 0 zone resets clat (usec): min=1055, max=142956, avg=24141.06, stdev=21646.80 lat (usec): min=1057, max=142958, avg=24154.27, stdev=21663.50 clat percentiles (usec): | 1.00th=[ 1516], 5.00th=[ 2376], 10.00th=[ 3458], 20.00th=[ 5735], | 30.00th=[ 8717], 40.00th=[ 13042], 50.00th=[ 17171], 60.00th=[ 23200], | 70.00th=[ 30016], 80.00th=[ 41157], 90.00th=[ 57410], 95.00th=[ 64750], | 99.00th=[ 87557], 99.50th=[100140], 99.90th=[143655], 99.95th=[143655], | 99.99th=[143655] bw ( KiB/s): min= 127, max= 570, per=26.82%, avg=298.80, stdev=107.47, samples=41 iops : min= 7, max= 35, avg=18.00, stdev= 6.72, samples=41 lat (usec) : 50=0.13%, 100=3.52%, 250=0.78%, 1000=0.13% lat (msec) : 2=1.95%, 4=4.30%, 10=12.11%, 20=21.35%, 50=41.80% lat (msec) : 100=13.41%, 250=0.52% cpu : usr=0.12%, sys=10.48%, ctx=1884, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1059KiB/s (1085kB/s), 266KiB/s-288KiB/s (273kB/s-295kB/s), io=23.4MiB (24.5MB), run=20954-22612msec WRITE: bw=1114KiB/s (1141kB/s), 267KiB/s-303KiB/s (273kB/s-310kB/s), io=24.6MiB (25.8MB), run=20954-22612msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179871: Mon Sep 7 15:06:50 2026 read: IOPS=12, BW=205KiB/s (210kB/s)(5920KiB/28919msec) clat (msec): min=5, max=175, avg=28.22, stdev=22.87 lat (msec): min=5, max=175, avg=28.23, stdev=22.87 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 11], 20.00th=[ 13], | 30.00th=[ 15], 40.00th=[ 18], 50.00th=[ 20], 60.00th=[ 23], | 70.00th=[ 31], 80.00th=[ 40], 90.00th=[ 59], 95.00th=[ 75], | 99.00th=[ 121], 99.50th=[ 142], 99.90th=[ 176], 99.95th=[ 176], | 99.99th=[ 176] bw ( KiB/s): min= 31, max= 572, per=24.27%, avg=200.93, stdev=113.50, samples=57 iops : min= 1, max= 35, avg=11.81, stdev= 7.17, samples=57 write: IOPS=13, BW=220KiB/s (225kB/s)(6368KiB/28919msec); 0 zone resets clat (msec): min=12, max=228, avg=46.05, stdev=32.30 lat (msec): min=12, max=228, avg=46.06, stdev=32.30 clat percentiles (msec): | 1.00th=[ 14], 5.00th=[ 16], 10.00th=[ 19], 20.00th=[ 22], | 30.00th=[ 26], 40.00th=[ 29], 50.00th=[ 34], 60.00th=[ 43], | 70.00th=[ 55], 80.00th=[ 68], 90.00th=[ 91], 95.00th=[ 109], | 99.00th=[ 150], 99.50th=[ 190], 99.90th=[ 228], 99.95th=[ 228], | 99.99th=[ 228] bw ( KiB/s): min= 31, max= 510, per=25.05%, avg=218.23, stdev=115.70, samples=57 iops : min= 1, max= 31, avg=12.89, stdev= 7.32, samples=57 lat (msec) : 10=3.91%, 20=27.73%, 50=43.88%, 100=20.18%, 250=4.30% cpu : usr=0.08%, sys=3.26%, ctx=1294, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179872: Mon Sep 7 15:06:50 2026 read: IOPS=12, BW=199KiB/s (204kB/s)(5744KiB/28868msec) clat (msec): min=6, max=139, avg=29.47, stdev=24.09 lat (msec): min=6, max=139, avg=29.47, stdev=24.09 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 10], 20.00th=[ 13], | 30.00th=[ 15], 40.00th=[ 18], 50.00th=[ 21], 60.00th=[ 25], | 70.00th=[ 33], 80.00th=[ 42], 90.00th=[ 65], 95.00th=[ 88], | 99.00th=[ 115], 99.50th=[ 138], 99.90th=[ 140], 99.95th=[ 140], | 99.99th=[ 140] bw ( KiB/s): min= 62, max= 512, per=24.29%, avg=201.14, stdev=118.52, samples=56 iops : min= 3, max= 32, avg=11.82, stdev= 7.51, samples=56 write: IOPS=14, BW=227KiB/s (232kB/s)(6544KiB/28868msec); 0 zone resets clat (msec): min=13, max=192, avg=44.40, stdev=27.42 lat (msec): min=13, max=192, avg=44.40, stdev=27.42 clat percentiles (msec): | 1.00th=[ 15], 5.00th=[ 18], 10.00th=[ 19], 20.00th=[ 23], | 30.00th=[ 27], 40.00th=[ 30], 50.00th=[ 35], 60.00th=[ 44], | 70.00th=[ 54], 80.00th=[ 65], 90.00th=[ 84], 95.00th=[ 92], | 99.00th=[ 140], 99.50th=[ 153], 99.90th=[ 192], 99.95th=[ 192], | 99.99th=[ 192] bw ( KiB/s): min= 94, max= 576, per=25.83%, avg=224.96, stdev=116.38, samples=57 iops : min= 5, max= 36, avg=13.32, stdev= 7.33, samples=57 lat (msec) : 10=4.95%, 20=25.13%, 50=44.27%, 100=22.79%, 250=2.86% cpu : usr=0.09%, sys=3.31%, ctx=1261, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179873: Mon Sep 7 15:06:50 2026 read: IOPS=13, BW=222KiB/s (227kB/s)(6256KiB/28170msec) clat (msec): min=6, max=125, avg=29.61, stdev=23.42 lat (msec): min=6, max=125, avg=29.61, stdev=23.42 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 10], 10.00th=[ 11], 20.00th=[ 13], | 30.00th=[ 15], 40.00th=[ 18], 50.00th=[ 21], 60.00th=[ 25], | 70.00th=[ 32], 80.00th=[ 42], 90.00th=[ 67], 95.00th=[ 86], | 99.00th=[ 109], 99.50th=[ 126], 99.90th=[ 126], 99.95th=[ 126], | 99.99th=[ 126] bw ( KiB/s): min= 62, max= 638, per=26.83%, avg=222.18, stdev=133.81, samples=56 iops : min= 3, max= 39, avg=13.14, stdev= 8.45, samples=56 write: IOPS=13, BW=214KiB/s (219kB/s)(6032KiB/28170msec); 0 zone resets clat (msec): min=10, max=190, avg=43.90, stdev=30.43 lat (msec): min=10, max=190, avg=43.90, stdev=30.43 clat percentiles (msec): | 1.00th=[ 13], 5.00th=[ 16], 10.00th=[ 19], 20.00th=[ 22], | 30.00th=[ 26], 40.00th=[ 28], 50.00th=[ 33], 60.00th=[ 40], | 70.00th=[ 49], 80.00th=[ 64], 90.00th=[ 86], 95.00th=[ 104], | 99.00th=[ 153], 99.50th=[ 184], 99.90th=[ 190], 99.95th=[ 190], | 99.99th=[ 190] bw ( KiB/s): min= 31, max= 572, per=24.53%, avg=213.62, stdev=119.76, samples=56 iops : min= 1, max= 35, avg=12.61, stdev= 7.56, samples=56 lat (msec) : 10=3.65%, 20=28.91%, 50=45.18%, 100=18.62%, 250=3.65% cpu : usr=0.07%, sys=3.34%, ctx=1227, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179874: Mon Sep 7 15:06:50 2026 read: IOPS=13, BW=212KiB/s (217kB/s)(6032KiB/28514msec) clat (msec): min=6, max=119, avg=28.98, stdev=24.05 lat (msec): min=6, max=119, avg=28.98, stdev=24.05 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 9], 10.00th=[ 10], 20.00th=[ 13], | 30.00th=[ 15], 40.00th=[ 17], 50.00th=[ 20], 60.00th=[ 24], | 70.00th=[ 29], 80.00th=[ 43], 90.00th=[ 68], 95.00th=[ 85], | 99.00th=[ 110], 99.50th=[ 118], 99.90th=[ 120], 99.95th=[ 120], | 99.99th=[ 120] bw ( KiB/s): min= 63, max= 576, per=25.33%, avg=209.75, stdev=119.48, samples=56 iops : min= 3, max= 36, avg=12.37, stdev= 7.59, samples=56 write: IOPS=13, BW=219KiB/s (225kB/s)(6256KiB/28514msec); 0 zone resets clat (msec): min=9, max=223, avg=44.70, stdev=29.26 lat (msec): min=9, max=223, avg=44.70, stdev=29.26 clat percentiles (msec): | 1.00th=[ 15], 5.00th=[ 16], 10.00th=[ 20], 20.00th=[ 23], | 30.00th=[ 26], 40.00th=[ 30], 50.00th=[ 35], 60.00th=[ 42], | 70.00th=[ 53], 80.00th=[ 65], 90.00th=[ 86], 95.00th=[ 95], | 99.00th=[ 150], 99.50th=[ 197], 99.90th=[ 224], 99.95th=[ 224], | 99.99th=[ 224] bw ( KiB/s): min= 31, max= 572, per=25.14%, avg=219.00, stdev=120.58, samples=56 iops : min= 1, max= 35, avg=12.95, stdev= 7.61, samples=56 lat (msec) : 10=6.25%, 20=25.39%, 50=44.79%, 100=20.57%, 250=2.99% cpu : usr=0.08%, sys=3.45%, ctx=1267, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=828KiB/s (848kB/s), 199KiB/s-222KiB/s (204kB/s-227kB/s), io=23.4MiB (24.5MB), run=28170-28919msec WRITE: bw=871KiB/s (892kB/s), 214KiB/s-227KiB/s (219kB/s-232kB/s), io=24.6MiB (25.8MB), run=28170-28919msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179891: Mon Sep 7 15:07:00 2026 read: IOPS=2, BW=2989KiB/s (3061kB/s)(7168KiB/2398msec) clat (usec): min=690, max=554221, avg=191964.44, stdev=172564.87 lat (usec): min=691, max=554222, avg=191965.74, stdev=172564.81 clat percentiles (usec): | 1.00th=[ 693], 5.00th=[ 693], 10.00th=[ 693], 20.00th=[122160], | 30.00th=[131597], 40.00th=[131597], 50.00th=[154141], 60.00th=[168821], | 70.00th=[168821], 80.00th=[212861], 90.00th=[557843], 95.00th=[557843], | 99.00th=[557843], 99.50th=[557843], 99.90th=[557843], 99.95th=[557843], | 99.99th=[557843] bw ( KiB/s): min= 2035, max= 5742, per=50.78%, avg=2964.75, stdev=1851.50, samples=4 iops : min= 1, max= 5, avg= 2.00, stdev= 2.00, samples=4 write: IOPS=2, BW=2135KiB/s (2186kB/s)(5120KiB/2398msec); 0 zone resets clat (msec): min=98, max=412, avg=203.77, stdev=124.58 lat (msec): min=98, max=412, avg=203.88, stdev=124.59 clat percentiles (msec): | 1.00th=[ 99], 5.00th=[ 99], 10.00th=[ 99], 20.00th=[ 99], | 30.00th=[ 142], 40.00th=[ 142], 50.00th=[ 148], 60.00th=[ 148], | 70.00th=[ 220], 80.00th=[ 220], 90.00th=[ 414], 95.00th=[ 414], | 99.00th=[ 414], 99.50th=[ 414], 99.90th=[ 414], 99.95th=[ 414], | 99.99th=[ 414] bw ( KiB/s): min= 2039, max= 6131, per=49.98%, avg=4085.00, stdev=2893.48, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 lat (usec) : 750=8.33% lat (msec) : 100=8.33%, 250=66.67%, 500=8.33%, 750=8.33% cpu : usr=0.00%, sys=34.92%, ctx=278, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179894: Mon Sep 7 15:07:00 2026 read: IOPS=0, BW=584KiB/s (598kB/s)(2048KiB/3508msec) clat (usec): min=696, max=368110, avg=184403.73, stdev=259800.61 lat (usec): min=698, max=368112, avg=184405.41, stdev=259801.24 clat percentiles (usec): | 1.00th=[ 701], 5.00th=[ 701], 10.00th=[ 701], 20.00th=[ 701], | 30.00th=[ 701], 40.00th=[ 701], 50.00th=[ 701], 60.00th=[367002], | 70.00th=[367002], 80.00th=[367002], 90.00th=[367002], 95.00th=[367002], | 99.00th=[367002], 99.50th=[367002], 99.90th=[367002], 99.95th=[367002], | 99.99th=[367002] bw ( KiB/s): min= 1980, max= 2048, per=34.50%, avg=2014.00, stdev=48.08, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 write: IOPS=2, BW=2919KiB/s (2989kB/s)(10.0MiB/3508msec); 0 zone resets clat (msec): min=73, max=693, avg=307.56, stdev=201.89 lat (msec): min=73, max=693, avg=307.75, stdev=201.95 clat percentiles (msec): | 1.00th=[ 74], 5.00th=[ 74], 10.00th=[ 74], 20.00th=[ 99], | 30.00th=[ 121], 40.00th=[ 169], 50.00th=[ 279], 60.00th=[ 296], | 70.00th=[ 418], 80.00th=[ 430], 90.00th=[ 502], 95.00th=[ 693], | 99.00th=[ 693], 99.50th=[ 693], 99.90th=[ 693], 99.95th=[ 693], | 99.99th=[ 693] bw ( KiB/s): min= 2039, max= 4079, per=34.94%, avg=2856.00, stdev=1112.80, samples=5 iops : min= 1, max= 3, avg= 2.00, stdev= 1.00, samples=5 lat (usec) : 750=8.33% lat (msec) : 100=16.67%, 250=16.67%, 500=41.67%, 750=16.67% cpu : usr=0.03%, sys=25.41%, ctx=214, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179895: Mon Sep 7 15:07:00 2026 read: IOPS=2, BW=2182KiB/s (2234kB/s)(6144KiB/2816msec) clat (usec): min=522, max=320321, avg=131673.96, stdev=147975.30 lat (usec): min=523, max=320322, avg=131674.84, stdev=147974.97 clat percentiles (usec): | 1.00th=[ 523], 5.00th=[ 523], 10.00th=[ 523], 20.00th=[ 553], | 30.00th=[ 553], 40.00th=[ 685], 50.00th=[ 685], 60.00th=[206570], | 70.00th=[261096], 80.00th=[261096], 90.00th=[320865], 95.00th=[320865], | 99.00th=[320865], 99.50th=[320865], 99.90th=[320865], 99.95th=[320865], | 99.99th=[320865] bw ( KiB/s): min= 2039, max= 4071, per=43.68%, avg=2550.25, stdev=1013.84, samples=4 iops : min= 1, max= 3, avg= 1.75, stdev= 0.96, samples=4 write: IOPS=2, BW=2182KiB/s (2234kB/s)(6144KiB/2816msec); 0 zone resets clat (msec): min=160, max=574, avg=332.61, stdev=181.66 lat (msec): min=160, max=574, avg=332.70, stdev=181.65 clat percentiles (msec): | 1.00th=[ 161], 5.00th=[ 161], 10.00th=[ 161], 20.00th=[ 199], | 30.00th=[ 199], 40.00th=[ 201], 50.00th=[ 201], 60.00th=[ 330], | 70.00th=[ 535], 80.00th=[ 535], 90.00th=[ 575], 95.00th=[ 575], | 99.00th=[ 575], 99.50th=[ 575], 99.90th=[ 575], 99.95th=[ 575], | 99.99th=[ 575] bw ( KiB/s): min= 2035, max= 4096, per=35.52%, avg=2903.00, stdev=1035.00, samples=4 iops : min= 1, max= 4, avg= 2.25, stdev= 1.50, samples=4 lat (usec) : 750=25.00% lat (msec) : 250=33.33%, 500=25.00%, 750=16.67% cpu : usr=0.00%, sys=28.31%, ctx=201, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179897: Mon Sep 7 15:07:00 2026 read: IOPS=1, BW=1770KiB/s (1813kB/s)(5120KiB/2892msec) clat (usec): min=525, max=280457, avg=91366.28, stdev=127349.11 lat (usec): min=526, max=280458, avg=91367.56, stdev=127348.96 clat percentiles (usec): | 1.00th=[ 529], 5.00th=[ 529], 10.00th=[ 529], 20.00th=[ 529], | 30.00th=[ 611], 40.00th=[ 611], 50.00th=[ 8225], 60.00th=[ 8225], | 70.00th=[166724], 80.00th=[166724], 90.00th=[278922], 95.00th=[278922], | 99.00th=[278922], 99.50th=[278922], 99.90th=[278922], 99.95th=[278922], | 99.99th=[278922] bw ( KiB/s): min= 4071, max= 4096, per=69.95%, avg=4083.50, stdev=17.68, samples=2 iops : min= 3, max= 4, avg= 3.50, stdev= 0.71, samples=2 write: IOPS=2, BW=2479KiB/s (2538kB/s)(7168KiB/2892msec); 0 zone resets clat (msec): min=175, max=620, avg=332.56, stdev=148.51 lat (msec): min=175, max=620, avg=332.64, stdev=148.53 clat percentiles (msec): | 1.00th=[ 176], 5.00th=[ 176], 10.00th=[ 176], 20.00th=[ 249], | 30.00th=[ 262], 40.00th=[ 262], 50.00th=[ 288], 60.00th=[ 309], | 70.00th=[ 309], 80.00th=[ 430], 90.00th=[ 617], 95.00th=[ 617], | 99.00th=[ 617], 99.50th=[ 617], 99.90th=[ 617], 99.95th=[ 617], | 99.99th=[ 617] bw ( KiB/s): min= 2035, max= 4087, per=31.23%, avg=2552.25, stdev=1023.18, samples=4 iops : min= 1, max= 3, avg= 1.75, stdev= 0.96, samples=4 lat (usec) : 750=16.67% lat (msec) : 10=8.33%, 250=25.00%, 500=41.67%, 750=8.33% cpu : usr=0.00%, sys=27.64%, ctx=259, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5838KiB/s (5978kB/s), 584KiB/s-2989KiB/s (598kB/s-3061kB/s), io=20.0MiB (20.0MB), run=2398-3508msec WRITE: bw=8173KiB/s (8369kB/s), 2135KiB/s-2919KiB/s (2186kB/s-2989kB/s), io=28.0MiB (29.4MB), run=2398-3508msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179892: Mon Sep 7 15:07:00 2026 read: IOPS=2, BW=2432KiB/s (2491kB/s)(7168KiB/2947msec) clat (msec): min=42, max=476, avg=190.81, stdev=141.64 lat (msec): min=42, max=476, avg=190.82, stdev=141.64 clat percentiles (msec): | 1.00th=[ 43], 5.00th=[ 43], 10.00th=[ 43], 20.00th=[ 102], | 30.00th=[ 134], 40.00th=[ 134], 50.00th=[ 148], 60.00th=[ 184], | 70.00th=[ 184], 80.00th=[ 251], 90.00th=[ 477], 95.00th=[ 477], | 99.00th=[ 477], 99.50th=[ 477], 99.90th=[ 477], 99.95th=[ 477], | 99.99th=[ 477] bw ( KiB/s): min= 2019, max= 4015, per=42.56%, avg=2529.25, stdev=990.57, samples=4 iops : min= 1, max= 3, avg= 1.75, stdev= 0.96, samples=4 write: IOPS=1, BW=1737KiB/s (1779kB/s)(5120KiB/2947msec); 0 zone resets clat (msec): min=163, max=597, avg=315.88, stdev=181.76 lat (msec): min=163, max=597, avg=315.99, stdev=181.79 clat percentiles (msec): | 1.00th=[ 165], 5.00th=[ 165], 10.00th=[ 165], 20.00th=[ 165], | 30.00th=[ 186], 40.00th=[ 186], 50.00th=[ 236], 60.00th=[ 236], | 70.00th=[ 397], 80.00th=[ 397], 90.00th=[ 600], 95.00th=[ 600], | 99.00th=[ 600], 99.50th=[ 600], 99.90th=[ 600], 99.95th=[ 600], | 99.99th=[ 600] bw ( KiB/s): min= 2019, max= 6144, per=49.06%, avg=4081.50, stdev=2916.82, samples=2 iops : min= 1, max= 6, avg= 3.50, stdev= 3.54, samples=2 lat (msec) : 50=8.33%, 250=66.67%, 500=16.67%, 750=8.33% cpu : usr=0.00%, sys=13.68%, ctx=122, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179893: Mon Sep 7 15:07:00 2026 read: IOPS=0, BW=594KiB/s (609kB/s)(2048KiB/3446msec) clat (msec): min=88, max=383, avg=235.94, stdev=208.14 lat (msec): min=88, max=383, avg=235.94, stdev=208.15 clat percentiles (msec): | 1.00th=[ 89], 5.00th=[ 89], 10.00th=[ 89], 20.00th=[ 89], | 30.00th=[ 89], 40.00th=[ 89], 50.00th=[ 89], 60.00th=[ 384], | 70.00th=[ 384], 80.00th=[ 384], 90.00th=[ 384], 95.00th=[ 384], | 99.00th=[ 384], 99.50th=[ 384], 99.90th=[ 384], 99.95th=[ 384], | 99.99th=[ 384] bw ( KiB/s): min= 1831, max= 2048, per=32.64%, avg=1939.50, stdev=153.44, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 write: IOPS=2, BW=2972KiB/s (3043kB/s)(10.0MiB/3446msec); 0 zone resets clat (msec): min=77, max=898, avg=293.69, stdev=235.41 lat (msec): min=78, max=898, avg=293.83, stdev=235.35 clat percentiles (msec): | 1.00th=[ 79], 5.00th=[ 79], 10.00th=[ 79], 20.00th=[ 97], | 30.00th=[ 171], 40.00th=[ 205], 50.00th=[ 215], 60.00th=[ 268], | 70.00th=[ 288], 80.00th=[ 296], 90.00th=[ 426], 95.00th=[ 902], | 99.00th=[ 902], 99.50th=[ 902], 99.90th=[ 902], 99.95th=[ 902], | 99.99th=[ 902] bw ( KiB/s): min= 2048, max= 4096, per=42.81%, avg=3561.50, stdev=1009.27, samples=4 iops : min= 2, max= 4, avg= 3.00, stdev= 0.82, samples=4 lat (msec) : 100=25.00%, 250=25.00%, 500=41.67%, 1000=8.33% cpu : usr=0.00%, sys=8.80%, ctx=93, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179896: Mon Sep 7 15:07:00 2026 read: IOPS=1, BW=1788KiB/s (1831kB/s)(6144KiB/3437msec) clat (msec): min=42, max=366, avg=184.33, stdev=130.14 lat (msec): min=42, max=366, avg=184.33, stdev=130.14 clat percentiles (msec): | 1.00th=[ 43], 5.00th=[ 43], 10.00th=[ 43], 20.00th=[ 69], | 30.00th=[ 69], 40.00th=[ 134], 50.00th=[ 134], 60.00th=[ 186], | 70.00th=[ 309], 80.00th=[ 309], 90.00th=[ 368], 95.00th=[ 368], | 99.00th=[ 368], 99.50th=[ 368], 99.90th=[ 368], 99.95th=[ 368], | 99.99th=[ 368] bw ( KiB/s): min= 2035, max= 4063, per=45.69%, avg=2715.33, stdev=1167.13, samples=3 iops : min= 1, max= 3, avg= 2.00, stdev= 1.00, samples=3 write: IOPS=1, BW=1788KiB/s (1831kB/s)(6144KiB/3437msec); 0 zone resets clat (msec): min=65, max=894, avg=380.89, stdev=281.55 lat (msec): min=65, max=894, avg=381.00, stdev=281.54 clat percentiles (msec): | 1.00th=[ 66], 5.00th=[ 66], 10.00th=[ 66], 20.00th=[ 262], | 30.00th=[ 262], 40.00th=[ 279], 50.00th=[ 279], 60.00th=[ 330], | 70.00th=[ 456], 80.00th=[ 456], 90.00th=[ 894], 95.00th=[ 894], | 99.00th=[ 894], 99.50th=[ 894], 99.90th=[ 894], 99.95th=[ 894], | 99.99th=[ 894] bw ( KiB/s): min= 1973, max= 2035, per=24.21%, avg=2014.50, stdev=28.49, samples=4 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=4 lat (msec) : 50=8.33%, 100=16.67%, 250=16.67%, 500=50.00%, 1000=8.33% cpu : usr=0.00%, sys=8.29%, ctx=97, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179898: Mon Sep 7 15:07:00 2026 read: IOPS=1, BW=1513KiB/s (1549kB/s)(5120KiB/3384msec) clat (msec): min=96, max=402, avg=201.41, stdev=119.50 lat (msec): min=96, max=402, avg=201.41, stdev=119.50 clat percentiles (msec): | 1.00th=[ 96], 5.00th=[ 96], 10.00th=[ 96], 20.00th=[ 96], | 30.00th=[ 144], 40.00th=[ 144], 50.00th=[ 155], 60.00th=[ 155], | 70.00th=[ 209], 80.00th=[ 209], 90.00th=[ 405], 95.00th=[ 405], | 99.00th=[ 405], 99.50th=[ 405], 99.90th=[ 405], 99.95th=[ 405], | 99.99th=[ 405] bw ( KiB/s): min= 4071, max= 4071, per=68.50%, avg=4071.00, stdev= 0.00, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2118KiB/s (2169kB/s)(7168KiB/3384msec); 0 zone resets clat (msec): min=173, max=434, avg=325.85, stdev=115.54 lat (msec): min=173, max=434, avg=325.94, stdev=115.54 clat percentiles (msec): | 1.00th=[ 174], 5.00th=[ 174], 10.00th=[ 174], 20.00th=[ 182], | 30.00th=[ 268], 40.00th=[ 268], 50.00th=[ 393], 60.00th=[ 414], | 70.00th=[ 414], 80.00th=[ 418], 90.00th=[ 435], 95.00th=[ 435], | 99.00th=[ 435], 99.50th=[ 435], 99.90th=[ 435], 99.95th=[ 435], | 99.99th=[ 435] bw ( KiB/s): min= 2048, max= 4079, per=32.73%, avg=2722.75, stdev=957.43, samples=4 iops : min= 2, max= 3, avg= 2.25, stdev= 0.50, samples=4 lat (msec) : 100=8.33%, 250=41.67%, 500=50.00% cpu : usr=0.00%, sys=13.21%, ctx=103, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5943KiB/s (6086kB/s), 594KiB/s-2432KiB/s (609kB/s-2491kB/s), io=20.0MiB (20.0MB), run=2947-3446msec WRITE: bw=8320KiB/s (8520kB/s), 1737KiB/s-2972KiB/s (1779kB/s-3043kB/s), io=28.0MiB (29.4MB), run=2947-3446msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179904: Mon Sep 7 15:07:10 2026 read: IOPS=2, BW=10.0MiB/s (11.5MB/s)(12.0MiB/1092msec) clat (msec): min=190, max=485, avg=309.85, stdev=155.50 lat (msec): min=190, max=485, avg=309.85, stdev=155.50 clat percentiles (msec): | 1.00th=[ 190], 5.00th=[ 190], 10.00th=[ 190], 20.00th=[ 190], | 30.00th=[ 190], 40.00th=[ 253], 50.00th=[ 253], 60.00th=[ 253], | 70.00th=[ 485], 80.00th=[ 485], 90.00th=[ 485], 95.00th=[ 485], | 99.00th=[ 485], 99.50th=[ 485], 99.90th=[ 485], 99.95th=[ 485], | 99.99th=[ 485] bw ( KiB/s): min=11425, max=11425, per=100.00%, avg=11425.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 500=66.67% cpu : usr=0.00%, sys=20.16%, ctx=85, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179905: Mon Sep 7 15:07:10 2026 read: IOPS=0, BW=1555KiB/s (1592kB/s)(4096KiB/2634msec) clat (nsec): min=890937k, max=890937k, avg=890936574.00, stdev= 0.00 lat (nsec): min=890939k, max=890939k, avg=890938686.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 894], 5.00th=[ 894], 10.00th=[ 894], 20.00th=[ 894], | 30.00th=[ 894], 40.00th=[ 894], 50.00th=[ 894], 60.00th=[ 894], | 70.00th=[ 894], 80.00th=[ 894], 90.00th=[ 894], 95.00th=[ 894], | 99.00th=[ 894], 99.50th=[ 894], 99.90th=[ 894], 99.95th=[ 894], | 99.99th=[ 894] bw ( KiB/s): min= 8062, max= 8062, per=100.00%, avg=8062.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=3110KiB/s (3185kB/s)(8192KiB/2634msec); 0 zone resets clat (msec): min=178, max=1402, avg=790.66, stdev=865.05 lat (msec): min=179, max=1402, avg=791.17, stdev=865.04 clat percentiles (msec): | 1.00th=[ 180], 5.00th=[ 180], 10.00th=[ 180], 20.00th=[ 180], | 30.00th=[ 180], 40.00th=[ 180], 50.00th=[ 180], 60.00th=[ 1401], | 70.00th=[ 1401], 80.00th=[ 1401], 90.00th=[ 1401], 95.00th=[ 1401], | 99.00th=[ 1401], 99.50th=[ 1401], 99.90th=[ 1401], 99.95th=[ 1401], | 99.99th=[ 1401] bw ( KiB/s): min= 8175, max= 8175, per=68.11%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=9.08%, ctx=66, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179907: Mon Sep 7 15:07:10 2026 write: IOPS=1, BW=4501KiB/s (4609kB/s)(12.0MiB/2730msec); 0 zone resets clat (msec): min=189, max=1995, avg=852.65, stdev=993.73 lat (msec): min=189, max=1995, avg=853.10, stdev=993.78 clat percentiles (msec): | 1.00th=[ 190], 5.00th=[ 190], 10.00th=[ 190], 20.00th=[ 190], | 30.00th=[ 190], 40.00th=[ 372], 50.00th=[ 372], 60.00th=[ 372], | 70.00th=[ 1989], 80.00th=[ 1989], 90.00th=[ 1989], 95.00th=[ 1989], | 99.00th=[ 1989], 99.50th=[ 1989], 99.90th=[ 1989], 99.95th=[ 1989], | 99.99th=[ 1989] bw ( KiB/s): min= 8175, max= 8175, per=68.11%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 500=33.33%, 2000=33.33% cpu : usr=0.00%, sys=6.45%, ctx=61, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179909: Mon Sep 7 15:07:10 2026 write: IOPS=1, BW=4594KiB/s (4704kB/s)(12.0MiB/2675msec); 0 zone resets clat (msec): min=221, max=1589, avg=789.72, stdev=713.01 lat (msec): min=222, max=1590, avg=790.44, stdev=712.80 clat percentiles (msec): | 1.00th=[ 222], 5.00th=[ 222], 10.00th=[ 222], 20.00th=[ 222], | 30.00th=[ 222], 40.00th=[ 558], 50.00th=[ 558], 60.00th=[ 558], | 70.00th=[ 1586], 80.00th=[ 1586], 90.00th=[ 1586], 95.00th=[ 1586], | 99.00th=[ 1586], 99.50th=[ 1586], 99.90th=[ 1586], 99.95th=[ 1586], | 99.99th=[ 1586] bw ( KiB/s): min=16125, max=16125, per=100.00%, avg=16125.00, stdev= 0.00, samples=1 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.00%, sys=4.82%, ctx=57, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=6220KiB/s (6369kB/s), 1555KiB/s-10.0MiB/s (1592kB/s-11.5MB/s), io=16.0MiB (16.8MB), run=1092-2634msec WRITE: bw=11.7MiB/s (12.3MB/s), 3110KiB/s-4594KiB/s (3185kB/s-4704kB/s), io=32.0MiB (33.6MB), run=2634-2730msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179906: Mon Sep 7 15:07:10 2026 read: IOPS=1, BW=5191KiB/s (5316kB/s)(12.0MiB/2367msec) clat (msec): min=565, max=830, avg=700.64, stdev=132.38 lat (msec): min=565, max=830, avg=700.64, stdev=132.38 clat percentiles (msec): | 1.00th=[ 567], 5.00th=[ 567], 10.00th=[ 567], 20.00th=[ 567], | 30.00th=[ 567], 40.00th=[ 709], 50.00th=[ 709], 60.00th=[ 709], | 70.00th=[ 827], 80.00th=[ 827], 90.00th=[ 827], 95.00th=[ 827], | 99.00th=[ 827], 99.50th=[ 827], 99.90th=[ 827], 99.95th=[ 827], | 99.99th=[ 827] bw ( KiB/s): min= 8192, max= 8192, per=100.00%, avg=8192.00, stdev= 0.00, samples=2 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=2 lat (msec) : 750=66.67%, 1000=33.33% cpu : usr=0.00%, sys=23.92%, ctx=643, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179908: Mon Sep 7 15:07:10 2026 read: IOPS=0, BW=1996KiB/s (2044kB/s)(4096KiB/2052msec) clat (nsec): min=805023k, max=805023k, avg=805023216.00, stdev= 0.00 lat (nsec): min=805026k, max=805026k, avg=805026021.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 802], 5.00th=[ 802], 10.00th=[ 802], 20.00th=[ 802], | 30.00th=[ 802], 40.00th=[ 802], 50.00th=[ 802], 60.00th=[ 802], | 70.00th=[ 802], 80.00th=[ 802], 90.00th=[ 802], 95.00th=[ 802], | 99.00th=[ 802], 99.50th=[ 802], 99.90th=[ 802], 99.95th=[ 802], | 99.99th=[ 802] bw ( KiB/s): min= 8192, max= 8192, per=100.00%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 write: IOPS=0, BW=3992KiB/s (4088kB/s)(8192KiB/2052msec); 0 zone resets clat (msec): min=363, max=675, avg=519.37, stdev=220.55 lat (msec): min=364, max=678, avg=521.28, stdev=221.90 clat percentiles (msec): | 1.00th=[ 363], 5.00th=[ 363], 10.00th=[ 363], 20.00th=[ 363], | 30.00th=[ 363], 40.00th=[ 363], 50.00th=[ 363], 60.00th=[ 676], | 70.00th=[ 676], 80.00th=[ 676], 90.00th=[ 676], 95.00th=[ 676], | 99.00th=[ 676], 99.50th=[ 676], 99.90th=[ 676], 99.95th=[ 676], | 99.99th=[ 676] lat (msec) : 500=33.33%, 750=33.33%, 1000=33.33% cpu : usr=0.00%, sys=10.53%, ctx=358, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179910: Mon Sep 7 15:07:10 2026 write: IOPS=0, BW=4051KiB/s (4149kB/s)(12.0MiB/3033msec); 0 zone resets clat (msec): min=146, max=2561, avg=953.42, stdev=1392.33 lat (msec): min=146, max=2561, avg=954.03, stdev=1392.01 clat percentiles (msec): | 1.00th=[ 146], 5.00th=[ 146], 10.00th=[ 146], 20.00th=[ 146], | 30.00th=[ 146], 40.00th=[ 153], 50.00th=[ 153], 60.00th=[ 153], | 70.00th=[ 2567], 80.00th=[ 2567], 90.00th=[ 2567], 95.00th=[ 2567], | 99.00th=[ 2567], 99.50th=[ 2567], 99.90th=[ 2567], 99.95th=[ 2567], | 99.99th=[ 2567] lat (msec) : 250=66.67%, >=2000=33.33% cpu : usr=0.03%, sys=5.51%, ctx=60, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179911: Mon Sep 7 15:07:10 2026 write: IOPS=1, BW=4951KiB/s (5070kB/s)(12.0MiB/2482msec); 0 zone resets clat (msec): min=311, max=1657, avg=794.44, stdev=749.03 lat (msec): min=313, max=1657, avg=795.51, stdev=748.46 clat percentiles (msec): | 1.00th=[ 313], 5.00th=[ 313], 10.00th=[ 313], 20.00th=[ 313], | 30.00th=[ 313], 40.00th=[ 414], 50.00th=[ 414], 60.00th=[ 414], | 70.00th=[ 1653], 80.00th=[ 1653], 90.00th=[ 1653], 95.00th=[ 1653], | 99.00th=[ 1653], 99.50th=[ 1653], 99.90th=[ 1653], 99.95th=[ 1653], | 99.99th=[ 1653] bw ( KiB/s): min= 6159, max= 8192, per=66.42%, avg=7175.50, stdev=1437.55, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 500=66.67%, 2000=33.33% cpu : usr=0.00%, sys=9.27%, ctx=102, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=6922KiB/s (7088kB/s), 1996KiB/s-5191KiB/s (2044kB/s-5316kB/s), io=16.0MiB (16.8MB), run=2052-2367msec WRITE: bw=10.5MiB/s (11.1MB/s), 3992KiB/s-4951KiB/s (4088kB/s-5070kB/s), io=32.0MiB (33.6MB), run=2052-3033msec