== sanity test 398b: DIO and buffer IO race ============== 23:47:27 (1788839247) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 6.28682 s, 8.0 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=180024: Mon Sep 7 23:49:42 2026 read: IOPS=13, BW=52.1KiB/s (53.4kB/s)(5992KiB/114913msec) clat (usec): min=40, max=325253, avg=41496.90, stdev=28591.74 lat (usec): min=41, max=325254, avg=41498.09, stdev=28591.79 clat percentiles (usec): | 1.00th=[ 51], 5.00th=[ 11600], 10.00th=[ 15926], 20.00th=[ 21103], | 30.00th=[ 25560], 40.00th=[ 30802], 50.00th=[ 35914], 60.00th=[ 41681], | 70.00th=[ 49021], 80.00th=[ 58459], 90.00th=[ 71828], 95.00th=[ 86508], | 99.00th=[141558], 99.50th=[175113], 99.90th=[312476], 99.95th=[325059], | 99.99th=[325059] bw ( KiB/s): min= 7, max= 128, per=24.92%, avg=51.84, stdev=19.65, samples=226 iops : min= 1, max= 32, avg=12.32, stdev= 4.95, samples=226 write: IOPS=13, BW=54.8KiB/s (56.1kB/s)(6296KiB/114913msec); 0 zone resets clat (usec): min=922, max=1155.0k, avg=33221.38, stdev=44240.96 lat (usec): min=922, max=1155.0k, avg=33226.97, stdev=44238.58 clat percentiles (usec): | 1.00th=[ 1057], 5.00th=[ 1188], 10.00th=[ 1434], | 20.00th=[ 3130], 30.00th=[ 5932], 40.00th=[ 13960], | 50.00th=[ 23200], 60.00th=[ 31851], 70.00th=[ 43254], | 80.00th=[ 56886], 90.00th=[ 80217], 95.00th=[ 99091], | 99.00th=[ 149947], 99.50th=[ 175113], 99.90th=[ 212861], | 99.95th=[1149240], 99.99th=[1149240] bw ( KiB/s): min= 7, max= 176, per=25.08%, avg=54.68, stdev=24.08, samples=225 iops : min= 1, max= 44, avg=13.04, stdev= 6.07, samples=225 lat (usec) : 50=0.29%, 100=1.30%, 250=0.10%, 500=0.07%, 1000=0.03% lat (msec) : 2=7.23%, 4=5.11%, 10=6.67%, 20=11.65%, 50=40.72% lat (msec) : 100=22.88%, 250=3.84%, 500=0.07%, 2000=0.03% cpu : usr=0.07%, sys=4.90%, ctx=6258, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180025: Mon Sep 7 23:49:42 2026 read: IOPS=13, BW=52.1KiB/s (53.3kB/s)(5940KiB/114100msec) clat (usec): min=48, max=239223, avg=41790.73, stdev=27373.59 lat (usec): min=48, max=239224, avg=41794.28, stdev=27373.94 clat percentiles (usec): | 1.00th=[ 53], 5.00th=[ 11994], 10.00th=[ 16188], 20.00th=[ 21365], | 30.00th=[ 26346], 40.00th=[ 30802], 50.00th=[ 35914], 60.00th=[ 41681], | 70.00th=[ 49021], 80.00th=[ 57934], 90.00th=[ 73925], 95.00th=[ 95945], | 99.00th=[139461], 99.50th=[154141], 99.90th=[227541], 99.95th=[240124], | 99.99th=[240124] bw ( KiB/s): min= 7, max= 120, per=24.89%, avg=51.78, stdev=21.79, samples=224 iops : min= 1, max= 30, avg=12.31, stdev= 5.47, samples=224 write: IOPS=13, BW=55.6KiB/s (56.0kB/s)(6348KiB/114100msec); 0 zone resets clat (usec): min=990, max=1153.0k, avg=32465.57, stdev=43275.59 lat (usec): min=991, max=1153.0k, avg=32468.54, stdev=43275.53 clat percentiles (usec): | 1.00th=[ 1045], 5.00th=[ 1188], 10.00th=[ 1614], | 20.00th=[ 3392], 30.00th=[ 6587], 40.00th=[ 15139], | 50.00th=[ 23462], 60.00th=[ 30540], 70.00th=[ 41157], | 80.00th=[ 55837], 90.00th=[ 76022], 95.00th=[ 98042], | 99.00th=[ 137364], 99.50th=[ 160433], 99.90th=[ 308282], | 99.95th=[1149240], 99.99th=[1149240] bw ( KiB/s): min= 7, max= 144, per=25.31%, avg=55.18, stdev=22.71, samples=224 iops : min= 1, max= 36, avg=13.17, stdev= 5.73, samples=224 lat (usec) : 50=0.20%, 100=1.20%, 250=0.16%, 1000=0.07% lat (msec) : 2=6.45%, 4=5.18%, 10=6.84%, 20=11.95%, 50=41.89% lat (msec) : 100=21.65%, 250=4.36%, 500=0.03%, 2000=0.03% cpu : usr=0.06%, sys=5.05%, ctx=6390, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180026: Mon Sep 7 23:49:42 2026 read: IOPS=13, BW=53.0KiB/s (54.3kB/s)(6028KiB/113637msec) clat (usec): min=37, max=265413, avg=41902.85, stdev=28095.30 lat (usec): min=37, max=265415, avg=41909.68, stdev=28095.43 clat percentiles (usec): | 1.00th=[ 52], 5.00th=[ 2638], 10.00th=[ 15533], 20.00th=[ 21103], | 30.00th=[ 25822], 40.00th=[ 30802], 50.00th=[ 35914], 60.00th=[ 42206], | 70.00th=[ 50594], 80.00th=[ 61080], 90.00th=[ 74974], 95.00th=[ 89654], | 99.00th=[147850], 99.50th=[175113], 99.90th=[242222], 99.95th=[265290], | 99.99th=[265290] bw ( KiB/s): min= 7, max= 119, per=25.38%, avg=52.80, stdev=19.36, samples=223 iops : min= 1, max= 29, avg=12.55, stdev= 4.87, samples=223 write: IOPS=13, BW=55.1KiB/s (56.4kB/s)(6260KiB/113637msec); 0 zone resets clat (usec): min=958, max=1117.9k, avg=31967.02, stdev=42272.85 lat (usec): min=959, max=1117.9k, avg=31970.54, stdev=42272.37 clat percentiles (usec): | 1.00th=[ 1074], 5.00th=[ 1188], 10.00th=[ 1549], | 20.00th=[ 3425], 30.00th=[ 5997], 40.00th=[ 13698], | 50.00th=[ 23200], 60.00th=[ 31065], 70.00th=[ 41157], | 80.00th=[ 55837], 90.00th=[ 77071], 95.00th=[ 93848], | 99.00th=[ 135267], 99.50th=[ 164627], 99.90th=[ 231736], | 99.95th=[1115685], 99.99th=[1115685] bw ( KiB/s): min= 7, max= 127, per=25.24%, avg=55.01, stdev=23.85, samples=222 iops : min= 1, max= 31, avg=13.12, stdev= 5.96, samples=222 lat (usec) : 50=0.29%, 100=1.82%, 250=0.16%, 500=0.03%, 750=0.07% lat (usec) : 1000=0.07% lat (msec) : 2=6.54%, 4=5.11%, 10=7.52%, 20=10.68%, 50=40.89% lat (msec) : 100=23.18%, 250=3.58%, 500=0.03%, 2000=0.03% cpu : usr=0.08%, sys=5.02%, ctx=6400, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180027: Mon Sep 7 23:49:42 2026 read: IOPS=13, BW=52.5KiB/s (53.8kB/s)(6052KiB/115209msec) clat (usec): min=35, max=966003, avg=41671.78, stdev=36086.76 lat (usec): min=36, max=966003, avg=41678.95, stdev=36087.26 clat percentiles (usec): | 1.00th=[ 51], 5.00th=[ 7570], 10.00th=[ 15139], 20.00th=[ 20579], | 30.00th=[ 25035], 40.00th=[ 29754], 50.00th=[ 35914], 60.00th=[ 43254], | 70.00th=[ 49021], 80.00th=[ 58983], 90.00th=[ 74974], 95.00th=[ 87557], | 99.00th=[130548], 99.50th=[170918], 99.90th=[325059], 99.95th=[968885], | 99.99th=[968885] bw ( KiB/s): min= 7, max= 111, per=24.99%, avg=51.97, stdev=19.85, samples=226 iops : min= 1, max= 27, avg=12.35, stdev= 4.99, samples=226 write: IOPS=13, BW=54.1KiB/s (55.4kB/s)(6236KiB/115209msec); 0 zone resets clat (usec): min=900, max=244755, avg=33164.49, stdev=34149.82 lat (usec): min=902, max=244756, avg=33168.04, stdev=34149.72 clat percentiles (usec): | 1.00th=[ 1057], 5.00th=[ 1205], 10.00th=[ 1663], 20.00th=[ 3425], | 30.00th=[ 6390], 40.00th=[ 14615], 50.00th=[ 22938], 60.00th=[ 32113], | 70.00th=[ 43779], 80.00th=[ 60556], 90.00th=[ 81265], 95.00th=[101188], | 99.00th=[141558], 99.50th=[154141], 99.90th=[210764], 99.95th=[244319], | 99.99th=[244319] bw ( KiB/s): min= 7, max= 119, per=24.62%, avg=53.67, stdev=23.63, samples=226 iops : min= 1, max= 29, avg=12.78, stdev= 5.91, samples=226 lat (usec) : 50=0.39%, 100=1.50%, 250=0.23%, 500=0.10%, 1000=0.16% lat (msec) : 2=6.15%, 4=5.27%, 10=7.06%, 20=11.91%, 50=39.91% lat (msec) : 100=23.11%, 250=4.13%, 500=0.03%, 1000=0.03% cpu : usr=0.08%, sys=4.92%, ctx=6337, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=208KiB/s (213kB/s), 52.1KiB/s-53.0KiB/s (53.3kB/s-54.3kB/s), io=23.4MiB (24.6MB), run=113637-115209msec WRITE: bw=218KiB/s (223kB/s), 54.1KiB/s-55.6KiB/s (55.4kB/s-56.0kB/s), io=24.6MiB (25.7MB), run=113637-115209msec rand-rw: (groupid=0, jobs=1): err= 0: pid=180029: Mon Sep 7 23:50:12 2026 read: IOPS=10, BW=41.5KiB/s (42.5kB/s)(5992KiB/144393msec) clat (msec): min=5, max=1212, avg=37.85, stdev=46.75 lat (msec): min=5, max=1212, avg=37.85, stdev=46.75 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 13], | 30.00th=[ 16], 40.00th=[ 20], 50.00th=[ 24], 60.00th=[ 30], | 70.00th=[ 40], 80.00th=[ 54], 90.00th=[ 88], 95.00th=[ 116], | 99.00th=[ 169], 99.50th=[ 190], 99.90th=[ 300], 99.95th=[ 1217], | 99.99th=[ 1217] bw ( KiB/s): min= 7, max= 191, per=25.47%, avg=42.03, stdev=32.10, samples=279 iops : min= 1, max= 47, avg= 9.86, stdev= 8.06, samples=279 write: IOPS=10, BW=43.6KiB/s (44.6kB/s)(6296KiB/144393msec); 0 zone resets clat (msec): min=8, max=285, avg=55.64, stdev=41.12 lat (msec): min=8, max=285, avg=55.65, stdev=41.11 clat percentiles (msec): | 1.00th=[ 14], 5.00th=[ 17], 10.00th=[ 20], 20.00th=[ 24], | 30.00th=[ 28], 40.00th=[ 33], 50.00th=[ 41], 60.00th=[ 52], | 70.00th=[ 68], 80.00th=[ 86], 90.00th=[ 112], 95.00th=[ 142], | 99.00th=[ 199], 99.50th=[ 218], 99.90th=[ 284], 99.95th=[ 288], | 99.99th=[ 288] bw ( KiB/s): min= 7, max= 136, per=25.26%, avg=43.70, stdev=30.26, samples=282 iops : min= 1, max= 34, avg=10.28, stdev= 7.60, samples=282 lat (msec) : 10=4.69%, 20=22.40%, 50=40.95%, 100=21.16%, 250=10.55% lat (msec) : 500=0.23%, 2000=0.03% cpu : usr=0.06%, sys=1.76%, ctx=4771, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180030: Mon Sep 7 23:50:12 2026 read: IOPS=10, BW=40.0KiB/s (41.0kB/s)(5940KiB/144947msec) clat (msec): min=4, max=1022, avg=37.23, stdev=43.57 lat (msec): min=4, max=1022, avg=37.23, stdev=43.57 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 13], | 30.00th=[ 16], 40.00th=[ 19], 50.00th=[ 23], 60.00th=[ 28], | 70.00th=[ 39], 80.00th=[ 55], 90.00th=[ 88], 95.00th=[ 118], | 99.00th=[ 169], 99.50th=[ 188], 99.90th=[ 257], 99.95th=[ 1020], | 99.99th=[ 1020] bw ( KiB/s): min= 7, max= 148, per=25.30%, avg=41.74, stdev=31.46, samples=278 iops : min= 1, max= 37, avg= 9.80, stdev= 7.90, samples=278 write: IOPS=10, BW=43.8KiB/s (44.8kB/s)(6348KiB/144947msec); 0 zone resets clat (msec): min=7, max=368, avg=56.44, stdev=43.19 lat (msec): min=7, max=368, avg=56.45, stdev=43.19 clat percentiles (msec): | 1.00th=[ 14], 5.00th=[ 17], 10.00th=[ 20], 20.00th=[ 24], | 30.00th=[ 28], 40.00th=[ 33], 50.00th=[ 40], 60.00th=[ 51], | 70.00th=[ 67], 80.00th=[ 87], 90.00th=[ 115], 95.00th=[ 142], | 99.00th=[ 203], 99.50th=[ 245], 99.90th=[ 334], 99.95th=[ 368], | 99.99th=[ 368] bw ( KiB/s): min= 7, max= 151, per=25.25%, avg=43.68, stdev=30.88, samples=284 iops : min= 1, max= 37, avg=10.28, stdev= 7.76, samples=284 lat (msec) : 10=4.85%, 20=21.81%, 50=41.93%, 100=20.25%, 250=10.97% lat (msec) : 500=0.16%, 2000=0.03% cpu : usr=0.06%, sys=1.72%, ctx=4724, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180031: Mon Sep 7 23:50:12 2026 read: IOPS=10, BW=41.8KiB/s (42.9kB/s)(6028KiB/144048msec) clat (msec): min=4, max=299, avg=37.35, stdev=36.11 lat (msec): min=4, max=299, avg=37.35, stdev=36.11 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 10], 20.00th=[ 13], | 30.00th=[ 16], 40.00th=[ 20], 50.00th=[ 24], 60.00th=[ 30], | 70.00th=[ 40], 80.00th=[ 55], 90.00th=[ 90], 95.00th=[ 117], | 99.00th=[ 165], 99.50th=[ 184], 99.90th=[ 253], 99.95th=[ 300], | 99.99th=[ 300] bw ( KiB/s): min= 7, max= 167, per=25.46%, avg=42.01, stdev=31.62, samples=280 iops : min= 1, max= 41, avg= 9.86, stdev= 7.93, samples=280 write: IOPS=10, BW=43.5KiB/s (44.5kB/s)(6260KiB/144048msec); 0 zone resets clat (msec): min=9, max=1041, avg=56.02, stdev=50.09 lat (msec): min=9, max=1041, avg=56.02, stdev=50.09 clat percentiles (msec): | 1.00th=[ 14], 5.00th=[ 17], 10.00th=[ 19], 20.00th=[ 23], | 30.00th=[ 27], 40.00th=[ 32], 50.00th=[ 39], 60.00th=[ 50], | 70.00th=[ 65], 80.00th=[ 86], 90.00th=[ 115], 95.00th=[ 142], | 99.00th=[ 218], 99.50th=[ 247], 99.90th=[ 376], 99.95th=[ 1045], | 99.99th=[ 1045] bw ( KiB/s): min= 7, max= 136, per=25.06%, avg=43.36, stdev=31.57, samples=282 iops : min= 1, max= 34, avg=10.20, stdev= 7.94, samples=282 lat (msec) : 10=5.50%, 20=22.01%, 50=41.21%, 100=20.31%, 250=10.74% lat (msec) : 500=0.20%, 2000=0.03% cpu : usr=0.05%, sys=1.72%, ctx=4796, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180032: Mon Sep 7 23:50:12 2026 read: IOPS=10, BW=41.7KiB/s (42.7kB/s)(6052KiB/144994msec) clat (msec): min=5, max=255, avg=38.33, stdev=37.23 lat (msec): min=5, max=255, avg=38.33, stdev=37.23 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 10], 20.00th=[ 13], | 30.00th=[ 16], 40.00th=[ 19], 50.00th=[ 23], 60.00th=[ 30], | 70.00th=[ 42], 80.00th=[ 60], 90.00th=[ 91], 95.00th=[ 118], | 99.00th=[ 176], 99.50th=[ 209], 99.90th=[ 249], 99.95th=[ 255], | 99.99th=[ 255] bw ( KiB/s): min= 7, max= 160, per=25.97%, avg=42.85, stdev=32.36, samples=276 iops : min= 1, max= 40, avg=10.07, stdev= 8.13, samples=276 write: IOPS=10, BW=43.0KiB/s (44.0kB/s)(6236KiB/144994msec); 0 zone resets clat (msec): min=10, max=1030, avg=55.75, stdev=48.56 lat (msec): min=10, max=1030, avg=55.75, stdev=48.56 clat percentiles (msec): | 1.00th=[ 14], 5.00th=[ 18], 10.00th=[ 20], 20.00th=[ 23], | 30.00th=[ 27], 40.00th=[ 33], 50.00th=[ 40], 60.00th=[ 51], | 70.00th=[ 68], 80.00th=[ 85], 90.00th=[ 114], 95.00th=[ 140], | 99.00th=[ 205], 99.50th=[ 239], 99.90th=[ 326], 99.95th=[ 1028], | 99.99th=[ 1028] bw ( KiB/s): min= 7, max= 135, per=24.79%, avg=42.88, stdev=30.95, samples=284 iops : min= 1, max= 33, avg=10.08, stdev= 7.76, samples=284 lat (msec) : 10=5.40%, 20=22.17%, 50=40.14%, 100=21.52%, 250=10.58% lat (msec) : 500=0.16%, 2000=0.03% cpu : usr=0.05%, sys=1.71%, ctx=4764, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=166KiB/s (170kB/s), 40.0KiB/s-41.8KiB/s (41.0kB/s-42.9kB/s), io=23.4MiB (24.6MB), run=144048-144994msec WRITE: bw=173KiB/s (178kB/s), 43.0KiB/s-43.8KiB/s (44.0kB/s-44.8kB/s), io=24.6MiB (25.7MB), run=144048-144994msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=180078: Mon Sep 7 23:50:49 2026 read: IOPS=14, BW=227KiB/s (232kB/s)(5920KiB/26127msec) clat (usec): min=36, max=197242, avg=39223.16, stdev=26336.93 lat (usec): min=36, max=197243, avg=39224.32, stdev=26336.92 clat percentiles (usec): | 1.00th=[ 49], 5.00th=[ 62], 10.00th=[ 13829], 20.00th=[ 20055], | 30.00th=[ 26346], 40.00th=[ 30802], 50.00th=[ 34866], 60.00th=[ 39060], | 70.00th=[ 44827], 80.00th=[ 52691], 90.00th=[ 69731], 95.00th=[ 87557], | 99.00th=[141558], 99.50th=[154141], 99.90th=[198181], 99.95th=[198181], | 99.99th=[198181] bw ( KiB/s): min= 94, max= 416, per=25.99%, avg=224.53, stdev=68.68, samples=51 iops : min= 5, max= 26, avg=13.33, stdev= 4.34, samples=51 write: IOPS=15, BW=244KiB/s (250kB/s)(6368KiB/26127msec); 0 zone resets clat (usec): min=1316, max=179019, avg=28995.92, stdev=31093.61 lat (usec): min=1317, max=179021, avg=28997.87, stdev=31093.64 clat percentiles (usec): | 1.00th=[ 1663], 5.00th=[ 1975], 10.00th=[ 2409], 20.00th=[ 4047], | 30.00th=[ 6587], 40.00th=[ 11076], 50.00th=[ 19530], 60.00th=[ 27657], | 70.00th=[ 38536], 80.00th=[ 50070], 90.00th=[ 67634], 95.00th=[ 91751], | 99.00th=[154141], 99.50th=[175113], 99.90th=[179307], 99.95th=[179307], | 99.99th=[179307] bw ( KiB/s): min= 30, max= 447, per=26.81%, avg=243.73, stdev=87.29, samples=51 iops : min= 1, max= 27, avg=14.53, stdev= 5.41, samples=51 lat (usec) : 50=0.52%, 100=2.86%, 250=0.39% lat (msec) : 2=2.73%, 4=7.55%, 10=9.90%, 20=11.46%, 50=42.71% lat (msec) : 100=18.10%, 250=3.78% cpu : usr=0.05%, sys=5.98%, ctx=1640, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180079: Mon Sep 7 23:50:49 2026 read: IOPS=13, BW=210KiB/s (215kB/s)(5744KiB/27385msec) clat (usec): min=34, max=229394, avg=39375.52, stdev=26806.40 lat (usec): min=34, max=229395, avg=39376.64, stdev=26806.51 clat percentiles (usec): | 1.00th=[ 51], 5.00th=[ 60], 10.00th=[ 176], 20.00th=[ 21365], | 30.00th=[ 26608], 40.00th=[ 31065], 50.00th=[ 36963], 60.00th=[ 41157], | 70.00th=[ 48497], 80.00th=[ 55837], 90.00th=[ 67634], 95.00th=[ 88605], | 99.00th=[111674], 99.50th=[160433], 99.90th=[229639], 99.95th=[229639], | 99.99th=[229639] bw ( KiB/s): min= 64, max= 445, per=24.38%, avg=210.67, stdev=77.41, samples=54 iops : min= 4, max= 27, avg=12.44, stdev= 4.84, samples=54 write: IOPS=14, BW=239KiB/s (245kB/s)(6544KiB/27385msec); 0 zone resets clat (usec): min=1323, max=144961, avg=32022.46, stdev=30077.64 lat (usec): min=1324, max=144963, avg=32025.42, stdev=30078.23 clat percentiles (usec): | 1.00th=[ 1647], 5.00th=[ 2089], 10.00th=[ 3064], 20.00th=[ 5735], | 30.00th=[ 9503], 40.00th=[ 16057], 50.00th=[ 22938], 60.00th=[ 31589], | 70.00th=[ 41157], 80.00th=[ 54789], 90.00th=[ 77071], 95.00th=[ 95945], | 99.00th=[131597], 99.50th=[137364], 99.90th=[145753], 99.95th=[145753], | 99.99th=[145753] bw ( KiB/s): min= 63, max= 414, per=26.25%, avg=238.65, stdev=79.04, samples=54 iops : min= 3, max= 25, avg=14.20, stdev= 4.94, samples=54 lat (usec) : 50=0.39%, 100=3.91%, 250=0.39%, 500=0.13% lat (msec) : 2=2.34%, 4=4.95%, 10=9.24%, 20=11.20%, 50=42.19% lat (msec) : 100=21.74%, 250=3.52% cpu : usr=0.07%, sys=5.95%, ctx=1654, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180080: Mon Sep 7 23:50:49 2026 read: IOPS=14, BW=232KiB/s (238kB/s)(6256KiB/26936msec) clat (usec): min=40, max=130122, avg=38206.64, stdev=23330.85 lat (usec): min=40, max=130123, avg=38207.81, stdev=23330.84 clat percentiles (usec): | 1.00th=[ 51], 5.00th=[ 59], 10.00th=[ 1012], 20.00th=[ 20579], | 30.00th=[ 26608], 40.00th=[ 30540], 50.00th=[ 35914], 60.00th=[ 42206], | 70.00th=[ 47449], 80.00th=[ 56886], 90.00th=[ 66323], 95.00th=[ 78119], | 99.00th=[115868], 99.50th=[127402], 99.90th=[130548], 99.95th=[130548], | 99.99th=[130548] bw ( KiB/s): min= 63, max= 469, per=26.90%, avg=232.42, stdev=85.80, samples=53 iops : min= 3, max= 29, avg=13.83, stdev= 5.36, samples=53 write: IOPS=13, BW=224KiB/s (229kB/s)(6032KiB/26936msec); 0 zone resets clat (usec): min=1374, max=158574, avg=31412.56, stdev=32047.02 lat (usec): min=1376, max=158576, avg=31429.09, stdev=32042.91 clat percentiles (usec): | 1.00th=[ 1549], 5.00th=[ 1860], 10.00th=[ 2606], 20.00th=[ 5014], | 30.00th=[ 7177], 40.00th=[ 12911], 50.00th=[ 20841], 60.00th=[ 30278], | 70.00th=[ 40109], 80.00th=[ 53740], 90.00th=[ 76022], 95.00th=[ 94897], | 99.00th=[137364], 99.50th=[154141], 99.90th=[158335], 99.95th=[158335], | 99.99th=[158335] bw ( KiB/s): min= 63, max= 381, per=24.26%, avg=220.49, stdev=75.40, samples=53 iops : min= 3, max= 23, avg=13.08, stdev= 4.80, samples=53 lat (usec) : 50=0.26%, 100=4.17%, 250=0.26%, 750=0.39% lat (msec) : 2=2.73%, 4=5.86%, 10=9.64%, 20=10.81%, 50=40.36% lat (msec) : 100=22.79%, 250=2.73% cpu : usr=0.05%, sys=5.79%, ctx=1678, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180081: Mon Sep 7 23:50:49 2026 read: IOPS=13, BW=218KiB/s (223kB/s)(6032KiB/27709msec) clat (usec): min=40, max=187351, avg=38734.88, stdev=27386.29 lat (usec): min=40, max=187352, avg=38736.07, stdev=27386.12 clat percentiles (usec): | 1.00th=[ 52], 5.00th=[ 64], 10.00th=[ 314], 20.00th=[ 20055], | 30.00th=[ 26084], 40.00th=[ 31065], 50.00th=[ 35390], 60.00th=[ 40109], | 70.00th=[ 45876], 80.00th=[ 54264], 90.00th=[ 68682], 95.00th=[ 88605], | 99.00th=[149947], 99.50th=[181404], 99.90th=[187696], 99.95th=[187696], | 99.99th=[187696] bw ( KiB/s): min= 31, max= 381, per=24.91%, avg=215.24, stdev=76.20, samples=54 iops : min= 1, max= 23, avg=12.72, stdev= 4.76, samples=54 write: IOPS=14, BW=226KiB/s (231kB/s)(6256KiB/27709msec); 0 zone resets clat (usec): min=1461, max=184706, avg=33142.40, stdev=32259.90 lat (usec): min=1463, max=184708, avg=33147.19, stdev=32259.88 clat percentiles (usec): | 1.00th=[ 1532], 5.00th=[ 1778], 10.00th=[ 2671], 20.00th=[ 5145], | 30.00th=[ 9241], 40.00th=[ 16319], 50.00th=[ 24249], 60.00th=[ 31851], | 70.00th=[ 43254], 80.00th=[ 55837], 90.00th=[ 79168], 95.00th=[ 99091], | 99.00th=[139461], 99.50th=[164627], 99.90th=[185598], 99.95th=[185598], | 99.99th=[185598] bw ( KiB/s): min= 63, max= 414, per=24.65%, avg=224.11, stdev=81.53, samples=54 iops : min= 3, max= 25, avg=13.28, stdev= 5.15, samples=54 lat (usec) : 50=0.39%, 100=3.91%, 250=0.26%, 500=0.39%, 750=0.26% lat (msec) : 2=3.39%, 4=5.08%, 10=8.20%, 20=11.33%, 50=42.58% lat (msec) : 100=20.18%, 250=4.04% cpu : usr=0.05%, sys=5.67%, ctx=1728, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=864KiB/s (885kB/s), 210KiB/s-232KiB/s (215kB/s-238kB/s), io=23.4MiB (24.5MB), run=26127-27709msec WRITE: bw=909KiB/s (931kB/s), 224KiB/s-244KiB/s (229kB/s-250kB/s), io=24.6MiB (25.8MB), run=26127-27709msec rand-rw: (groupid=0, jobs=1): err= 0: pid=180083: Mon Sep 7 23:51:02 2026 read: IOPS=9, BW=148KiB/s (151kB/s)(5920KiB/40050msec) clat (msec): min=8, max=204, avg=43.50, stdev=35.82 lat (msec): min=8, max=204, avg=43.50, stdev=35.82 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 14], 10.00th=[ 16], 20.00th=[ 20], | 30.00th=[ 23], 40.00th=[ 26], 50.00th=[ 31], 60.00th=[ 37], | 70.00th=[ 47], 80.00th=[ 61], 90.00th=[ 93], 95.00th=[ 122], | 99.00th=[ 188], 99.50th=[ 197], 99.90th=[ 205], 99.95th=[ 205], | 99.99th=[ 205] bw ( KiB/s): min= 31, max= 415, per=24.79%, avg=148.22, stdev=79.47, samples=78 iops : min= 1, max= 25, avg= 8.47, stdev= 5.00, samples=78 write: IOPS=9, BW=159KiB/s (163kB/s)(6368KiB/40050msec); 0 zone resets clat (msec): min=13, max=224, avg=60.10, stdev=36.92 lat (msec): min=13, max=224, avg=60.10, stdev=36.92 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 23], 10.00th=[ 27], 20.00th=[ 32], | 30.00th=[ 36], 40.00th=[ 42], 50.00th=[ 49], 60.00th=[ 59], | 70.00th=[ 69], 80.00th=[ 85], 90.00th=[ 112], 95.00th=[ 136], | 99.00th=[ 192], 99.50th=[ 201], 99.90th=[ 226], 99.95th=[ 226], | 99.99th=[ 226] bw ( KiB/s): min= 31, max= 382, per=25.17%, avg=158.34, stdev=80.51, samples=79 iops : min= 1, max= 23, avg= 9.11, stdev= 5.05, samples=79 lat (msec) : 10=0.26%, 20=11.98%, 50=49.48%, 100=27.47%, 250=10.81% cpu : usr=0.05%, sys=1.69%, ctx=1121, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180084: Mon Sep 7 23:51:02 2026 read: IOPS=8, BW=144KiB/s (147kB/s)(5744KiB/39959msec) clat (msec): min=7, max=195, avg=41.55, stdev=34.48 lat (msec): min=7, max=195, avg=41.55, stdev=34.48 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 13], 10.00th=[ 15], 20.00th=[ 18], | 30.00th=[ 22], 40.00th=[ 26], 50.00th=[ 30], 60.00th=[ 36], | 70.00th=[ 43], 80.00th=[ 58], 90.00th=[ 91], 95.00th=[ 127], | 99.00th=[ 163], 99.50th=[ 188], 99.90th=[ 197], 99.95th=[ 197], | 99.99th=[ 197] bw ( KiB/s): min= 31, max= 479, per=24.23%, avg=144.91, stdev=95.37, samples=78 iops : min= 1, max= 29, avg= 8.27, stdev= 5.97, samples=78 write: IOPS=10, BW=164KiB/s (168kB/s)(6544KiB/39959msec); 0 zone resets clat (msec): min=13, max=213, avg=61.08, stdev=37.70 lat (msec): min=13, max=213, avg=61.08, stdev=37.70 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 22], 10.00th=[ 27], 20.00th=[ 33], | 30.00th=[ 37], 40.00th=[ 43], 50.00th=[ 49], 60.00th=[ 56], | 70.00th=[ 69], 80.00th=[ 91], 90.00th=[ 114], 95.00th=[ 138], | 99.00th=[ 188], 99.50th=[ 194], 99.90th=[ 213], 99.95th=[ 213], | 99.99th=[ 213] bw ( KiB/s): min= 31, max= 448, per=25.94%, avg=163.18, stdev=86.07, samples=79 iops : min= 1, max= 28, avg= 9.42, stdev= 5.42, samples=79 lat (msec) : 10=0.91%, 20=13.15%, 50=48.57%, 100=25.39%, 250=11.98% cpu : usr=0.05%, sys=1.79%, ctx=1104, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180085: Mon Sep 7 23:51:02 2026 read: IOPS=9, BW=159KiB/s (162kB/s)(6256KiB/39450msec) clat (msec): min=6, max=201, avg=42.98, stdev=35.22 lat (msec): min=6, max=201, avg=42.98, stdev=35.22 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 13], 10.00th=[ 15], 20.00th=[ 20], | 30.00th=[ 23], 40.00th=[ 27], 50.00th=[ 31], 60.00th=[ 35], | 70.00th=[ 44], 80.00th=[ 62], 90.00th=[ 95], 95.00th=[ 127], | 99.00th=[ 161], 99.50th=[ 197], 99.90th=[ 201], 99.95th=[ 201], | 99.99th=[ 201] bw ( KiB/s): min= 31, max= 440, per=26.54%, avg=158.73, stdev=93.14, samples=78 iops : min= 1, max= 27, avg= 9.14, stdev= 5.92, samples=78 write: IOPS=9, BW=153KiB/s (157kB/s)(6032KiB/39450msec); 0 zone resets clat (msec): min=15, max=224, avg=59.92, stdev=36.12 lat (msec): min=15, max=224, avg=59.92, stdev=36.12 clat percentiles (msec): | 1.00th=[ 21], 5.00th=[ 23], 10.00th=[ 27], 20.00th=[ 31], | 30.00th=[ 37], 40.00th=[ 42], 50.00th=[ 50], 60.00th=[ 57], | 70.00th=[ 70], 80.00th=[ 83], 90.00th=[ 110], 95.00th=[ 138], | 99.00th=[ 176], 99.50th=[ 218], 99.90th=[ 226], 99.95th=[ 226], | 99.99th=[ 226] bw ( KiB/s): min= 31, max= 415, per=24.20%, avg=152.24, stdev=82.23, samples=78 iops : min= 1, max= 25, avg= 8.73, stdev= 5.15, samples=78 lat (msec) : 10=0.91%, 20=11.72%, 50=50.13%, 100=26.43%, 250=10.81% cpu : usr=0.05%, sys=1.86%, ctx=1121, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180086: Mon Sep 7 23:51:02 2026 read: IOPS=9, BW=151KiB/s (155kB/s)(6032KiB/39889msec) clat (msec): min=7, max=173, avg=42.51, stdev=35.74 lat (msec): min=7, max=173, avg=42.52, stdev=35.73 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 19], | 30.00th=[ 22], 40.00th=[ 25], 50.00th=[ 31], 60.00th=[ 35], | 70.00th=[ 42], 80.00th=[ 59], 90.00th=[ 101], 95.00th=[ 128], | 99.00th=[ 163], 99.50th=[ 171], 99.90th=[ 174], 99.95th=[ 174], | 99.99th=[ 174] bw ( KiB/s): min= 30, max= 448, per=25.34%, avg=151.52, stdev=85.13, samples=77 iops : min= 1, max= 28, avg= 8.69, stdev= 5.41, samples=77 write: IOPS=9, BW=157KiB/s (161kB/s)(6256KiB/39889msec); 0 zone resets clat (msec): min=14, max=261, avg=60.90, stdev=37.63 lat (msec): min=14, max=261, avg=60.90, stdev=37.63 clat percentiles (msec): | 1.00th=[ 19], 5.00th=[ 23], 10.00th=[ 28], 20.00th=[ 33], | 30.00th=[ 37], 40.00th=[ 43], 50.00th=[ 48], 60.00th=[ 56], | 70.00th=[ 70], 80.00th=[ 90], 90.00th=[ 116], 95.00th=[ 140], | 99.00th=[ 192], 99.50th=[ 207], 99.90th=[ 262], 99.95th=[ 262], | 99.99th=[ 262] bw ( KiB/s): min= 31, max= 383, per=24.79%, avg=155.94, stdev=85.81, samples=78 iops : min= 1, max= 23, avg= 8.96, stdev= 5.44, samples=78 lat (msec) : 10=0.78%, 20=12.37%, 50=51.82%, 100=23.70%, 250=11.20% lat (msec) : 500=0.13% cpu : usr=0.05%, sys=1.81%, ctx=1167, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=598KiB/s (612kB/s), 144KiB/s-159KiB/s (147kB/s-162kB/s), io=23.4MiB (24.5MB), run=39450-40050msec WRITE: bw=629KiB/s (644kB/s), 153KiB/s-164KiB/s (157kB/s-168kB/s), io=24.6MiB (25.8MB), run=39450-40050msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=180102: Mon Sep 7 23:51:18 2026 read: IOPS=1, BW=1229KiB/s (1258kB/s)(7168KiB/5833msec) clat (usec): min=511, max=3925.4k, avg=658303.74, stdev=1442954.28 lat (usec): min=513, max=3925.4k, avg=658305.44, stdev=1442954.74 clat percentiles (usec): | 1.00th=[ 510], 5.00th=[ 510], 10.00th=[ 510], | 20.00th=[ 2114], 30.00th=[ 135267], 40.00th=[ 135267], | 50.00th=[ 177210], 60.00th=[ 179307], 70.00th=[ 179307], | 80.00th=[ 187696], 90.00th=[3909092], 95.00th=[3909092], | 99.00th=[3909092], 99.50th=[3909092], 99.90th=[3909092], | 99.95th=[3909092], 99.99th=[3909092] bw ( KiB/s): min= 1903, max= 4096, per=76.46%, avg=2418.40, stdev=939.46, samples=5 iops : min= 1, max= 4, avg= 1.60, stdev= 1.34, samples=5 write: IOPS=0, BW=878KiB/s (899kB/s)(5120KiB/5833msec); 0 zone resets clat (msec): min=130, max=291, avg=195.41, stdev=63.55 lat (msec): min=130, max=293, avg=195.81, stdev=63.97 clat percentiles (msec): | 1.00th=[ 131], 5.00th=[ 131], 10.00th=[ 131], 20.00th=[ 131], | 30.00th=[ 146], 40.00th=[ 146], 50.00th=[ 205], 60.00th=[ 205], | 70.00th=[ 205], 80.00th=[ 205], 90.00th=[ 292], 95.00th=[ 292], | 99.00th=[ 292], 99.50th=[ 292], 99.90th=[ 292], 99.95th=[ 292], | 99.99th=[ 292] bw ( KiB/s): min= 3806, max= 4096, per=89.23%, avg=3951.00, stdev=205.06, samples=2 iops : min= 3, max= 4, avg= 3.50, stdev= 0.71, samples=2 lat (usec) : 750=8.33% lat (msec) : 4=8.33%, 250=66.67%, 500=8.33%, >=2000=8.33% cpu : usr=0.02%, sys=8.93%, ctx=454, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180103: Mon Sep 7 23:51:18 2026 read: IOPS=0, BW=316KiB/s (324kB/s)(2048KiB/6474msec) clat (msec): min=72, max=248, avg=160.43, stdev=124.80 lat (msec): min=72, max=248, avg=160.44, stdev=124.81 clat percentiles (msec): | 1.00th=[ 72], 5.00th=[ 72], 10.00th=[ 72], 20.00th=[ 72], | 30.00th=[ 72], 40.00th=[ 72], 50.00th=[ 72], 60.00th=[ 249], | 70.00th=[ 249], 80.00th=[ 249], 90.00th=[ 249], 95.00th=[ 249], | 99.00th=[ 249], 99.50th=[ 249], 99.90th=[ 249], 99.95th=[ 249], | 99.99th=[ 249] bw ( KiB/s): min= 1954, max= 1984, per=62.25%, avg=1969.00, stdev=21.21, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1582KiB/s (1620kB/s)(10.0MiB/6474msec); 0 zone resets clat (msec): min=99, max=2872, avg=588.78, stdev=821.88 lat (msec): min=99, max=2872, avg=588.88, stdev=821.88 clat percentiles (msec): | 1.00th=[ 101], 5.00th=[ 101], 10.00th=[ 101], 20.00th=[ 186], | 30.00th=[ 275], 40.00th=[ 275], 50.00th=[ 296], 60.00th=[ 296], | 70.00th=[ 300], 80.00th=[ 634], 90.00th=[ 659], 95.00th=[ 2869], | 99.00th=[ 2869], 99.50th=[ 2869], 99.90th=[ 2869], 99.95th=[ 2869], | 99.99th=[ 2869] bw ( KiB/s): min= 3968, max= 4087, per=91.09%, avg=4033.25, stdev=52.80, samples=4 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=4 lat (msec) : 100=16.67%, 250=16.67%, 500=41.67%, 750=16.67%, >=2000=8.33% cpu : usr=0.02%, sys=11.48%, ctx=171, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180104: Mon Sep 7 23:51:18 2026 read: IOPS=1, BW=1179KiB/s (1207kB/s)(6144KiB/5211msec) clat (usec): min=481, max=312722, avg=173980.32, stdev=107243.12 lat (usec): min=482, max=312723, avg=173981.53, stdev=107243.07 clat percentiles (usec): | 1.00th=[ 482], 5.00th=[ 482], 10.00th=[ 482], 20.00th=[106431], | 30.00th=[106431], 40.00th=[200279], 50.00th=[200279], 60.00th=[210764], | 70.00th=[212861], 80.00th=[212861], 90.00th=[312476], 95.00th=[312476], | 99.00th=[312476], 99.50th=[312476], 99.90th=[312476], 99.95th=[312476], | 99.99th=[312476] bw ( KiB/s): min= 2003, max= 4015, per=79.81%, avg=2524.25, stdev=994.01, samples=4 iops : min= 1, max= 3, avg= 1.75, stdev= 0.96, samples=4 write: IOPS=1, BW=1179KiB/s (1207kB/s)(6144KiB/5211msec); 0 zone resets clat (msec): min=153, max=2338, avg=686.47, stdev=844.13 lat (msec): min=153, max=2338, avg=686.57, stdev=844.09 clat percentiles (msec): | 1.00th=[ 155], 5.00th=[ 155], 10.00th=[ 155], 20.00th=[ 176], | 30.00th=[ 176], 40.00th=[ 296], 50.00th=[ 296], 60.00th=[ 342], | 70.00th=[ 810], 80.00th=[ 810], 90.00th=[ 2333], 95.00th=[ 2333], | 99.00th=[ 2333], 99.50th=[ 2333], 99.90th=[ 2333], 99.95th=[ 2333], | 99.99th=[ 2333] bw ( KiB/s): min= 2003, max= 4055, per=57.23%, avg=2534.25, stdev=1014.00, samples=4 iops : min= 1, max= 3, avg= 1.75, stdev= 0.96, samples=4 lat (usec) : 500=8.33% lat (msec) : 250=50.00%, 500=25.00%, 1000=8.33%, >=2000=8.33% cpu : usr=0.02%, sys=12.08%, ctx=177, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180105: Mon Sep 7 23:51:18 2026 read: IOPS=0, BW=806KiB/s (826kB/s)(5120KiB/6350msec) clat (usec): min=570, max=220222, avg=138596.01, stdev=94376.80 lat (usec): min=572, max=220223, avg=138597.20, stdev=94376.67 clat percentiles (usec): | 1.00th=[ 570], 5.00th=[ 570], 10.00th=[ 570], 20.00th=[ 570], | 30.00th=[ 80217], 40.00th=[ 80217], 50.00th=[193987], 60.00th=[193987], | 70.00th=[198181], 80.00th=[198181], 90.00th=[221250], 95.00th=[221250], | 99.00th=[221250], 99.50th=[221250], 99.90th=[221250], 99.95th=[221250], | 99.99th=[221250] bw ( KiB/s): min= 1954, max= 6144, per=100.00%, avg=4049.00, stdev=2962.78, samples=2 iops : min= 1, max= 6, avg= 3.50, stdev= 3.54, samples=2 write: IOPS=1, BW=1129KiB/s (1156kB/s)(7168KiB/6350msec); 0 zone resets clat (msec): min=218, max=2571, avg=776.04, stdev=819.30 lat (msec): min=218, max=2571, avg=776.12, stdev=819.28 clat percentiles (msec): | 1.00th=[ 220], 5.00th=[ 220], 10.00th=[ 220], 20.00th=[ 300], | 30.00th=[ 380], 40.00th=[ 380], 50.00th=[ 451], 60.00th=[ 726], | 70.00th=[ 726], 80.00th=[ 785], 90.00th=[ 2567], 95.00th=[ 2567], | 99.00th=[ 2567], 99.50th=[ 2567], 99.90th=[ 2567], 99.95th=[ 2567], | 99.99th=[ 2567] bw ( KiB/s): min= 1910, max= 4087, per=52.76%, avg=2336.17, stdev=859.09, samples=6 iops : min= 1, max= 3, avg= 1.33, stdev= 0.82, samples=6 lat (usec) : 750=8.33% lat (msec) : 100=8.33%, 250=33.33%, 500=25.00%, 750=8.33%, 1000=8.33% lat (msec) : >=2000=8.33% cpu : usr=0.00%, sys=10.30%, ctx=228, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3163KiB/s (3239kB/s), 316KiB/s-1229KiB/s (324kB/s-1258kB/s), io=20.0MiB (20.0MB), run=5211-6474msec WRITE: bw=4429KiB/s (4535kB/s), 878KiB/s-1582KiB/s (899kB/s-1620kB/s), io=28.0MiB (29.4MB), run=5211-6474msec rand-rw: (groupid=0, jobs=1): err= 0: pid=180098: Mon Sep 7 23:51:19 2026 read: IOPS=2, BW=2445KiB/s (2503kB/s)(7168KiB/2932msec) clat (msec): min=80, max=588, avg=173.38, stdev=184.04 lat (msec): min=80, max=588, avg=173.38, stdev=184.04 clat percentiles (msec): | 1.00th=[ 81], 5.00th=[ 81], 10.00th=[ 81], 20.00th=[ 89], | 30.00th=[ 95], 40.00th=[ 95], 50.00th=[ 99], 60.00th=[ 127], | 70.00th=[ 127], 80.00th=[ 136], 90.00th=[ 592], 95.00th=[ 592], | 99.00th=[ 592], 99.50th=[ 592], 99.90th=[ 592], 99.95th=[ 592], | 99.99th=[ 592] bw ( KiB/s): min= 2035, max= 5840, per=100.00%, avg=3304.67, stdev=2195.66, samples=3 iops : min= 1, max= 5, avg= 2.33, stdev= 2.31, samples=3 write: IOPS=1, BW=1746KiB/s (1788kB/s)(5120KiB/2932msec); 0 zone resets clat (msec): min=179, max=539, avg=331.70, stdev=159.33 lat (msec): min=179, max=539, avg=331.78, stdev=159.34 clat percentiles (msec): | 1.00th=[ 180], 5.00th=[ 180], 10.00th=[ 180], 20.00th=[ 180], | 30.00th=[ 209], 40.00th=[ 209], 50.00th=[ 271], 60.00th=[ 271], | 70.00th=[ 460], 80.00th=[ 460], 90.00th=[ 542], 95.00th=[ 542], | 99.00th=[ 542], 99.50th=[ 542], 99.90th=[ 542], 99.95th=[ 542], | 99.99th=[ 542] bw ( KiB/s): min= 2035, max= 4071, per=65.01%, avg=2715.00, stdev=1174.33, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (msec) : 100=33.33%, 250=33.33%, 500=16.67%, 750=16.67% cpu : usr=0.03%, sys=7.06%, ctx=104, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180099: Mon Sep 7 23:51:19 2026 read: IOPS=0, BW=298KiB/s (305kB/s)(2048KiB/6865msec) clat (msec): min=71, max=598, avg=334.74, stdev=372.87 lat (msec): min=71, max=598, avg=334.74, stdev=372.88 clat percentiles (msec): | 1.00th=[ 71], 5.00th=[ 71], 10.00th=[ 71], 20.00th=[ 71], | 30.00th=[ 71], 40.00th=[ 71], 50.00th=[ 71], 60.00th=[ 600], | 70.00th=[ 600], 80.00th=[ 600], 90.00th=[ 600], 95.00th=[ 600], | 99.00th=[ 600], 99.50th=[ 600], 99.90th=[ 600], 99.95th=[ 600], | 99.99th=[ 600] bw ( KiB/s): min= 2023, max= 2039, per=68.09%, avg=2031.00, stdev=11.31, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1492KiB/s (1527kB/s)(10.0MiB/6865msec); 0 zone resets clat (msec): min=75, max=2667, avg=599.84, stdev=767.57 lat (msec): min=75, max=2668, avg=599.92, stdev=767.56 clat percentiles (msec): | 1.00th=[ 75], 5.00th=[ 75], 10.00th=[ 75], 20.00th=[ 136], | 30.00th=[ 194], 40.00th=[ 305], 50.00th=[ 321], 60.00th=[ 330], | 70.00th=[ 397], 80.00th=[ 709], 90.00th=[ 877], 95.00th=[ 2668], | 99.00th=[ 2668], 99.50th=[ 2668], 99.90th=[ 2668], 99.95th=[ 2668], | 99.99th=[ 2668] bw ( KiB/s): min= 1996, max= 6119, per=72.92%, avg=3045.17, stdev=1711.06, samples=6 iops : min= 1, max= 5, avg= 2.00, stdev= 1.67, samples=6 lat (msec) : 100=16.67%, 250=16.67%, 500=33.33%, 750=16.67%, 1000=8.33% lat (msec) : >=2000=8.33% cpu : usr=0.03%, sys=4.82%, ctx=112, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180100: Mon Sep 7 23:51:19 2026 read: IOPS=0, BW=930KiB/s (952kB/s)(6144KiB/6608msec) clat (msec): min=51, max=280, avg=170.22, stdev=87.13 lat (msec): min=51, max=280, avg=170.22, stdev=87.13 clat percentiles (msec): | 1.00th=[ 53], 5.00th=[ 53], 10.00th=[ 53], 20.00th=[ 99], | 30.00th=[ 99], 40.00th=[ 146], 50.00th=[ 146], 60.00th=[ 207], | 70.00th=[ 239], 80.00th=[ 239], 90.00th=[ 279], 95.00th=[ 279], | 99.00th=[ 279], 99.50th=[ 279], 99.90th=[ 279], 99.95th=[ 279], | 99.99th=[ 279] bw ( KiB/s): min= 2043, max= 4047, per=100.00%, avg=3360.67, stdev=1141.46, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 write: IOPS=0, BW=930KiB/s (952kB/s)(6144KiB/6608msec); 0 zone resets clat (msec): min=215, max=2781, avg=884.99, stdev=964.01 lat (msec): min=215, max=2782, avg=885.22, stdev=964.38 clat percentiles (msec): | 1.00th=[ 215], 5.00th=[ 215], 10.00th=[ 215], 20.00th=[ 292], | 30.00th=[ 292], 40.00th=[ 531], 50.00th=[ 531], 60.00th=[ 542], | 70.00th=[ 953], 80.00th=[ 953], 90.00th=[ 2769], 95.00th=[ 2769], | 99.00th=[ 2769], 99.50th=[ 2769], 99.90th=[ 2769], 99.95th=[ 2769], | 99.99th=[ 2769] bw ( KiB/s): min= 1996, max= 2043, per=48.58%, avg=2028.50, stdev=16.90, samples=6 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=6 lat (msec) : 100=16.67%, 250=33.33%, 500=16.67%, 750=16.67%, 1000=8.33% lat (msec) : >=2000=8.33% cpu : usr=0.02%, sys=2.86%, ctx=89, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180101: Mon Sep 7 23:51:19 2026 read: IOPS=0, BW=844KiB/s (864kB/s)(5120KiB/6067msec) clat (msec): min=73, max=300, avg=166.71, stdev=83.79 lat (msec): min=73, max=300, avg=166.71, stdev=83.79 clat percentiles (msec): | 1.00th=[ 74], 5.00th=[ 74], 10.00th=[ 74], 20.00th=[ 74], | 30.00th=[ 138], 40.00th=[ 138], 50.00th=[ 142], 60.00th=[ 142], | 70.00th=[ 180], 80.00th=[ 180], 90.00th=[ 300], 95.00th=[ 300], | 99.00th=[ 300], 99.50th=[ 300], 99.90th=[ 300], 99.95th=[ 300], | 99.99th=[ 300] bw ( KiB/s): min= 1996, max= 6083, per=100.00%, avg=4039.50, stdev=2889.95, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 write: IOPS=1, BW=1181KiB/s (1210kB/s)(7168KiB/6067msec); 0 zone resets clat (msec): min=109, max=2488, avg=723.25, stdev=819.65 lat (msec): min=109, max=2488, avg=723.32, stdev=819.65 clat percentiles (msec): | 1.00th=[ 110], 5.00th=[ 110], 10.00th=[ 110], 20.00th=[ 129], | 30.00th=[ 326], 40.00th=[ 326], 50.00th=[ 584], 60.00th=[ 659], | 70.00th=[ 659], 80.00th=[ 768], 90.00th=[ 2500], 95.00th=[ 2500], | 99.00th=[ 2500], 99.50th=[ 2500], 99.90th=[ 2500], 99.95th=[ 2500], | 99.99th=[ 2500] bw ( KiB/s): min= 1996, max= 4071, per=60.64%, avg=2532.25, stdev=1025.99, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (msec) : 100=8.33%, 250=41.67%, 500=16.67%, 750=16.67%, 1000=8.33% lat (msec) : >=2000=8.33% cpu : usr=0.03%, sys=3.69%, ctx=89, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2983KiB/s (3055kB/s), 298KiB/s-2445KiB/s (305kB/s-2503kB/s), io=20.0MiB (20.0MB), run=2932-6865msec WRITE: bw=4177KiB/s (4277kB/s), 930KiB/s-1746KiB/s (952kB/s-1788kB/s), io=28.0MiB (29.4MB), run=2932-6865msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=180111: Mon Sep 7 23:51:31 2026 read: IOPS=0, BW=3965KiB/s (4060kB/s)(12.0MiB/3099msec) clat (msec): min=794, max=1330, avg=994.23, stdev=293.13 lat (msec): min=794, max=1330, avg=994.23, stdev=293.13 clat percentiles (msec): | 1.00th=[ 793], 5.00th=[ 793], 10.00th=[ 793], 20.00th=[ 793], | 30.00th=[ 793], 40.00th=[ 860], 50.00th=[ 860], 60.00th=[ 860], | 70.00th=[ 1334], 80.00th=[ 1334], 90.00th=[ 1334], 95.00th=[ 1334], | 99.00th=[ 1334], 99.50th=[ 1334], 99.90th=[ 1334], 99.95th=[ 1334], | 99.99th=[ 1334] bw ( KiB/s): min= 7968, max= 7984, per=100.00%, avg=7976.00, stdev=11.31, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=66.67%, 2000=33.33% cpu : usr=0.00%, sys=4.23%, ctx=53, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180112: Mon Sep 7 23:51:31 2026 read: IOPS=0, BW=2658KiB/s (2722kB/s)(4096KiB/1541msec) clat (nsec): min=194463k, max=194463k, avg=194463329.00, stdev= 0.00 lat (nsec): min=194466k, max=194466k, avg=194466269.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 194], 5.00th=[ 194], 10.00th=[ 194], 20.00th=[ 194], | 30.00th=[ 194], 40.00th=[ 194], 50.00th=[ 194], 60.00th=[ 194], | 70.00th=[ 194], 80.00th=[ 194], 90.00th=[ 194], 95.00th=[ 194], | 99.00th=[ 194], 99.50th=[ 194], 99.90th=[ 194], 99.95th=[ 194], | 99.99th=[ 194] bw ( KiB/s): min= 6895, max= 6895, per=100.00%, avg=6895.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=1, BW=5316KiB/s (5444kB/s)(8192KiB/1541msec); 0 zone resets clat (msec): min=461, max=743, avg=602.56, stdev=199.16 lat (msec): min=462, max=745, avg=603.64, stdev=200.20 clat percentiles (msec): | 1.00th=[ 464], 5.00th=[ 464], 10.00th=[ 464], 20.00th=[ 464], | 30.00th=[ 464], 40.00th=[ 464], 50.00th=[ 464], 60.00th=[ 743], | 70.00th=[ 743], 80.00th=[ 743], 90.00th=[ 743], 95.00th=[ 743], | 99.00th=[ 743], 99.50th=[ 743], 99.90th=[ 743], 99.95th=[ 743], | 99.99th=[ 743] bw ( KiB/s): min= 8126, max= 8126, per=55.85%, avg=8126.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 500=33.33%, 750=33.33% cpu : usr=0.00%, sys=11.10%, ctx=51, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180113: Mon Sep 7 23:51:31 2026 write: IOPS=1, BW=6367KiB/s (6520kB/s)(12.0MiB/1930msec); 0 zone resets clat (msec): min=517, max=760, avg=604.47, stdev=135.46 lat (msec): min=517, max=762, avg=605.54, stdev=135.95 clat percentiles (msec): | 1.00th=[ 518], 5.00th=[ 518], 10.00th=[ 518], 20.00th=[ 518], | 30.00th=[ 518], 40.00th=[ 535], 50.00th=[ 535], 60.00th=[ 535], | 70.00th=[ 760], 80.00th=[ 760], 90.00th=[ 760], 95.00th=[ 760], | 99.00th=[ 760], 99.50th=[ 760], 99.90th=[ 760], 99.95th=[ 760], | 99.99th=[ 760] bw ( KiB/s): min= 7968, max= 8126, per=55.31%, avg=8047.00, stdev=111.72, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=66.67%, 1000=33.33% cpu : usr=0.00%, sys=7.98%, ctx=66, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180114: Mon Sep 7 23:51:31 2026 write: IOPS=1, BW=5456KiB/s (5587kB/s)(12.0MiB/2252msec); 0 zone resets clat (msec): min=214, max=1369, avg=722.87, stdev=589.77 lat (msec): min=215, max=1370, avg=723.34, stdev=589.69 clat percentiles (msec): | 1.00th=[ 215], 5.00th=[ 215], 10.00th=[ 215], 20.00th=[ 215], | 30.00th=[ 215], 40.00th=[ 584], 50.00th=[ 584], 60.00th=[ 584], | 70.00th=[ 1368], 80.00th=[ 1368], 90.00th=[ 1368], 95.00th=[ 1368], | 99.00th=[ 1368], 99.50th=[ 1368], 99.90th=[ 1368], 99.95th=[ 1368], | 99.99th=[ 1368] bw ( KiB/s): min= 7641, max= 8126, per=54.18%, avg=7883.50, stdev=342.95, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 250=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.00%, sys=7.02%, ctx=63, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5287KiB/s (5414kB/s), 2658KiB/s-3965KiB/s (2722kB/s-4060kB/s), io=16.0MiB (16.8MB), run=1541-3099msec WRITE: bw=14.2MiB/s (14.9MB/s), 5316KiB/s-6367KiB/s (5444kB/s-6520kB/s), io=32.0MiB (33.6MB), run=1541-2252msec rand-rw: (groupid=0, jobs=1): err= 0: pid=180116: Mon Sep 7 23:51:31 2026 read: IOPS=1, BW=5283KiB/s (5410kB/s)(12.0MiB/2326msec) clat (msec): min=751, max=789, avg=775.00, stdev=20.36 lat (msec): min=751, max=789, avg=775.00, stdev=20.36 clat percentiles (msec): | 1.00th=[ 751], 5.00th=[ 751], 10.00th=[ 751], 20.00th=[ 751], | 30.00th=[ 751], 40.00th=[ 785], 50.00th=[ 785], 60.00th=[ 785], | 70.00th=[ 793], 80.00th=[ 793], 90.00th=[ 793], 95.00th=[ 793], | 99.00th=[ 793], 99.50th=[ 793], 99.90th=[ 793], 99.95th=[ 793], | 99.99th=[ 793] bw ( KiB/s): min= 8062, max= 8143, per=100.00%, avg=8102.50, stdev=57.28, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=100.00% cpu : usr=0.00%, sys=18.75%, ctx=459, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180117: Mon Sep 7 23:51:31 2026 read: IOPS=0, BW=1464KiB/s (1500kB/s)(4096KiB/2797msec) clat (nsec): min=769819k, max=769819k, avg=769818803.00, stdev= 0.00 lat (nsec): min=769821k, max=769821k, avg=769821274.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 768], 5.00th=[ 768], 10.00th=[ 768], 20.00th=[ 768], | 30.00th=[ 768], 40.00th=[ 768], 50.00th=[ 768], 60.00th=[ 768], | 70.00th=[ 768], 80.00th=[ 768], 90.00th=[ 768], 95.00th=[ 768], | 99.00th=[ 768], 99.50th=[ 768], 99.90th=[ 768], 99.95th=[ 768], | 99.99th=[ 768] bw ( KiB/s): min= 8143, max= 8143, per=100.00%, avg=8143.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2929KiB/s (2999kB/s)(8192KiB/2797msec); 0 zone resets clat (msec): min=661, max=1363, avg=1012.15, stdev=496.34 lat (msec): min=661, max=1363, avg=1012.64, stdev=496.23 clat percentiles (msec): | 1.00th=[ 659], 5.00th=[ 659], 10.00th=[ 659], 20.00th=[ 659], | 30.00th=[ 659], 40.00th=[ 659], 50.00th=[ 659], 60.00th=[ 1368], | 70.00th=[ 1368], 80.00th=[ 1368], 90.00th=[ 1368], 95.00th=[ 1368], | 99.00th=[ 1368], 99.50th=[ 1368], 99.90th=[ 1368], 99.95th=[ 1368], | 99.99th=[ 1368] bw ( KiB/s): min= 8078, max= 8078, per=69.33%, avg=8078.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=6.40%, ctx=140, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180118: Mon Sep 7 23:51:31 2026 write: IOPS=1, BW=4370KiB/s (4475kB/s)(12.0MiB/2812msec); 0 zone resets clat (msec): min=248, max=1272, avg=927.18, stdev=587.84 lat (msec): min=249, max=1273, avg=928.07, stdev=588.01 clat percentiles (msec): | 1.00th=[ 249], 5.00th=[ 249], 10.00th=[ 249], 20.00th=[ 249], | 30.00th=[ 249], 40.00th=[ 1267], 50.00th=[ 1267], 60.00th=[ 1267], | 70.00th=[ 1267], 80.00th=[ 1267], 90.00th=[ 1267], 95.00th=[ 1267], | 99.00th=[ 1267], 99.50th=[ 1267], 99.90th=[ 1267], 99.95th=[ 1267], | 99.99th=[ 1267] bw ( KiB/s): min= 7968, max= 8062, per=68.79%, avg=8015.00, stdev=66.47, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 250=33.33%, 2000=66.67% cpu : usr=0.04%, sys=6.30%, ctx=58, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180119: Mon Sep 7 23:51:31 2026 write: IOPS=1, BW=4746KiB/s (4860kB/s)(12.0MiB/2589msec); 0 zone resets clat (msec): min=454, max=1277, avg=862.05, stdev=411.71 lat (msec): min=455, max=1278, avg=862.52, stdev=411.73 clat percentiles (msec): | 1.00th=[ 456], 5.00th=[ 456], 10.00th=[ 456], 20.00th=[ 456], | 30.00th=[ 456], 40.00th=[ 852], 50.00th=[ 852], 60.00th=[ 852], | 70.00th=[ 1284], 80.00th=[ 1284], 90.00th=[ 1284], 95.00th=[ 1284], | 99.00th=[ 1284], 99.50th=[ 1284], 99.90th=[ 1284], 99.95th=[ 1284], | 99.99th=[ 1284] bw ( KiB/s): min= 8078, max= 8143, per=69.61%, avg=8110.50, stdev=45.96, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=5.26%, ctx=53, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5858KiB/s (5998kB/s), 1464KiB/s-5283KiB/s (1500kB/s-5410kB/s), io=16.0MiB (16.8MB), run=2326-2797msec WRITE: bw=11.4MiB/s (11.9MB/s), 2929KiB/s-4746KiB/s (2999kB/s-4860kB/s), io=32.0MiB (33.6MB), run=2589-2812msec