== sanity test 398b: DIO and buffer IO race ============== 03:33:36 (1788766416) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 5.26585 s, 9.6 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=145009: Mon Sep 7 03:35:44 2026 read: IOPS=13, BW=54.6KiB/s (55.9kB/s)(5992KiB/109790msec) clat (usec): min=33, max=817448, avg=35431.38, stdev=33413.75 lat (usec): min=33, max=817450, avg=35432.55, stdev=33413.76 clat percentiles (usec): | 1.00th=[ 46], 5.00th=[ 57], 10.00th=[ 74], 20.00th=[ 16450], | 30.00th=[ 20579], 40.00th=[ 25297], 50.00th=[ 30278], 60.00th=[ 36439], | 70.00th=[ 44303], 80.00th=[ 53216], 90.00th=[ 67634], 95.00th=[ 81265], | 99.00th=[112722], 99.50th=[130548], 99.90th=[333448], 99.95th=[817890], | 99.99th=[817890] bw ( KiB/s): min= 7, max= 111, per=25.33%, avg=54.71, stdev=21.41, samples=214 iops : min= 1, max= 27, avg=13.04, stdev= 5.40, samples=214 write: IOPS=14, BW=57.3KiB/s (58.7kB/s)(6296KiB/109790msec); 0 zone resets clat (usec): min=640, max=430746, avg=35803.39, stdev=37448.18 lat (usec): min=640, max=430748, avg=35804.92, stdev=37448.20 clat percentiles (usec): | 1.00th=[ 1020], 5.00th=[ 1156], 10.00th=[ 1270], 20.00th=[ 3130], | 30.00th=[ 7635], 40.00th=[ 16581], 50.00th=[ 27132], 60.00th=[ 35914], | 70.00th=[ 47449], 80.00th=[ 62653], 90.00th=[ 83362], 95.00th=[105382], | 99.00th=[156238], 99.50th=[183501], 99.90th=[252707], 99.95th=[429917], | 99.99th=[429917] bw ( KiB/s): min= 7, max= 118, per=25.29%, avg=57.16, stdev=21.05, samples=215 iops : min= 1, max= 29, avg=13.67, stdev= 5.31, samples=215 lat (usec) : 50=0.75%, 100=4.75%, 250=0.29%, 500=0.07%, 750=0.07% lat (usec) : 1000=0.36% lat (msec) : 2=7.81%, 4=3.42%, 10=6.09%, 20=12.30%, 50=38.48% lat (msec) : 100=21.48%, 250=3.97%, 500=0.13%, 1000=0.03% cpu : usr=0.08%, sys=5.67%, ctx=6143, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145011: Mon Sep 7 03:35:44 2026 read: IOPS=13, BW=53.8KiB/s (55.1kB/s)(5940KiB/110359msec) clat (usec): min=27, max=798303, avg=35743.47, stdev=32833.48 lat (usec): min=28, max=798304, avg=35745.19, stdev=32832.91 clat percentiles (usec): | 1.00th=[ 43], 5.00th=[ 58], 10.00th=[ 88], 20.00th=[ 15926], | 30.00th=[ 21365], 40.00th=[ 25297], 50.00th=[ 29754], 60.00th=[ 35390], | 70.00th=[ 44303], 80.00th=[ 53740], 90.00th=[ 69731], 95.00th=[ 83362], | 99.00th=[121111], 99.50th=[147850], 99.90th=[193987], 99.95th=[801113], | 99.99th=[801113] bw ( KiB/s): min= 5, max= 111, per=24.71%, avg=53.37, stdev=21.40, samples=216 iops : min= 1, max= 27, avg=12.71, stdev= 5.35, samples=216 write: IOPS=14, BW=57.5KiB/s (58.9kB/s)(6348KiB/110359msec); 0 zone resets clat (usec): min=746, max=575150, avg=35837.77, stdev=38946.92 lat (usec): min=747, max=575152, avg=35839.68, stdev=38946.49 clat percentiles (usec): | 1.00th=[ 1029], 5.00th=[ 1156], 10.00th=[ 1254], 20.00th=[ 2999], | 30.00th=[ 6915], 40.00th=[ 16581], 50.00th=[ 26346], 60.00th=[ 36439], | 70.00th=[ 47973], 80.00th=[ 62129], 90.00th=[ 82314], 95.00th=[104334], | 99.00th=[160433], 99.50th=[187696], 99.90th=[341836], 99.95th=[574620], | 99.99th=[574620] bw ( KiB/s): min= 7, max= 142, per=25.16%, avg=56.85, stdev=23.27, samples=216 iops : min= 1, max= 35, avg=13.58, stdev= 5.86, samples=216 lat (usec) : 50=0.75%, 100=4.17%, 250=0.42%, 500=0.23%, 750=0.07% lat (usec) : 1000=0.42% lat (msec) : 2=7.91%, 4=3.87%, 10=6.45%, 20=11.17%, 50=38.31% lat (msec) : 100=22.36%, 250=3.71%, 500=0.10%, 750=0.03%, 1000=0.03% cpu : usr=0.08%, sys=5.67%, ctx=6214, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145013: Mon Sep 7 03:35:44 2026 read: IOPS=13, BW=55.7KiB/s (57.0kB/s)(6028KiB/108284msec) clat (usec): min=29, max=182104, avg=33063.48, stdev=25315.71 lat (usec): min=30, max=182106, avg=33069.56, stdev=25317.43 clat percentiles (usec): | 1.00th=[ 40], 5.00th=[ 55], 10.00th=[ 66], 20.00th=[ 13829], | 30.00th=[ 19792], 40.00th=[ 24249], 50.00th=[ 28181], 60.00th=[ 34341], | 70.00th=[ 40633], 80.00th=[ 51119], 90.00th=[ 65799], 95.00th=[ 79168], | 99.00th=[112722], 99.50th=[129500], 99.90th=[175113], 99.95th=[181404], | 99.99th=[181404] bw ( KiB/s): min= 7, max= 126, per=26.05%, avg=56.26, stdev=23.03, samples=209 iops : min= 1, max= 31, avg=13.44, stdev= 5.81, samples=209 write: IOPS=14, BW=57.8KiB/s (59.2kB/s)(6260KiB/108284msec); 0 zone resets clat (usec): min=606, max=1135.6k, avg=37087.44, stdev=47589.42 lat (usec): min=607, max=1135.7k, avg=37101.57, stdev=47591.88 clat percentiles (usec): | 1.00th=[ 1004], 5.00th=[ 1123], 10.00th=[ 1254], | 20.00th=[ 3064], 30.00th=[ 7570], 40.00th=[ 17433], | 50.00th=[ 27657], 60.00th=[ 37487], 70.00th=[ 47449], | 80.00th=[ 61080], 90.00th=[ 83362], 95.00th=[ 108528], | 99.00th=[ 162530], 99.50th=[ 191890], 99.90th=[ 404751], | 99.95th=[1132463], 99.99th=[1132463] bw ( KiB/s): min= 7, max= 120, per=25.68%, avg=58.04, stdev=22.70, samples=210 iops : min= 1, max= 30, avg=13.89, stdev= 5.72, samples=210 lat (usec) : 50=1.40%, 100=4.82%, 250=0.33%, 500=0.03%, 750=0.13% lat (usec) : 1000=0.39% lat (msec) : 2=7.42%, 4=3.91%, 10=6.25%, 20=11.78%, 50=39.23% lat (msec) : 100=20.21%, 250=3.94%, 500=0.13%, 2000=0.03% cpu : usr=0.08%, sys=5.49%, ctx=6143, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145015: Mon Sep 7 03:35:44 2026 read: IOPS=13, BW=54.5KiB/s (55.9kB/s)(6052KiB/110951msec) clat (usec): min=33, max=319721, avg=35039.32, stdev=29311.99 lat (usec): min=33, max=319723, avg=35040.57, stdev=29311.97 clat percentiles (usec): | 1.00th=[ 46], 5.00th=[ 57], 10.00th=[ 72], 20.00th=[ 15008], | 30.00th=[ 20055], 40.00th=[ 24249], 50.00th=[ 28967], 60.00th=[ 34866], | 70.00th=[ 41681], 80.00th=[ 53216], 90.00th=[ 68682], 95.00th=[ 84411], | 99.00th=[135267], 99.50th=[168821], 99.90th=[240124], 99.95th=[320865], | 99.99th=[320865] bw ( KiB/s): min= 7, max= 118, per=25.20%, avg=54.43, stdev=22.22, samples=215 iops : min= 1, max= 29, avg=12.97, stdev= 5.59, samples=215 write: IOPS=14, BW=56.2KiB/s (57.6kB/s)(6236KiB/110951msec); 0 zone resets clat (usec): min=771, max=1039.8k, avg=36887.81, stdev=44192.73 lat (usec): min=773, max=1039.8k, avg=36894.83, stdev=44189.05 clat percentiles (usec): | 1.00th=[ 1045], 5.00th=[ 1139], 10.00th=[ 1287], | 20.00th=[ 3261], 30.00th=[ 7308], 40.00th=[ 16909], | 50.00th=[ 28181], 60.00th=[ 38011], 70.00th=[ 49021], | 80.00th=[ 63701], 90.00th=[ 85459], 95.00th=[ 107480], | 99.00th=[ 149947], 99.50th=[ 187696], 99.90th=[ 254804], | 99.95th=[1035994], 99.99th=[1035994] bw ( KiB/s): min= 7, max= 134, per=24.79%, avg=56.03, stdev=23.02, samples=216 iops : min= 1, max= 33, avg=13.38, stdev= 5.81, samples=216 lat (usec) : 50=0.68%, 100=4.82%, 250=0.23%, 500=0.03%, 750=0.20% lat (usec) : 1000=0.20% lat (msec) : 2=7.81%, 4=3.52%, 10=6.32%, 20=12.92%, 50=37.01% lat (msec) : 100=21.81%, 250=4.36%, 500=0.07%, 2000=0.03% cpu : usr=0.09%, sys=5.70%, ctx=6280, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=216KiB/s (222kB/s), 53.8KiB/s-55.7KiB/s (55.1kB/s-57.0kB/s), io=23.4MiB (24.6MB), run=108284-110951msec WRITE: bw=227KiB/s (232kB/s), 56.2KiB/s-57.8KiB/s (57.6kB/s-59.2kB/s), io=24.6MiB (25.7MB), run=108284-110951msec rand-rw: (groupid=0, jobs=1): err= 0: pid=145008: Mon Sep 7 03:38:12 2026 read: IOPS=5, BW=23.1KiB/s (23.7kB/s)(5992KiB/259002msec) clat (msec): min=4, max=835, avg=34.97, stdev=38.39 lat (msec): min=4, max=835, avg=34.98, stdev=38.39 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 10], 10.00th=[ 11], 20.00th=[ 14], | 30.00th=[ 17], 40.00th=[ 21], 50.00th=[ 25], 60.00th=[ 30], | 70.00th=[ 37], 80.00th=[ 50], 90.00th=[ 68], 95.00th=[ 94], | 99.00th=[ 157], 99.50th=[ 218], 99.90th=[ 456], 99.95th=[ 835], | 99.99th=[ 835] bw ( KiB/s): min= 7, max= 87, per=27.85%, avg=25.63, stdev=16.90, samples=452 iops : min= 1, max= 21, avg= 5.77, stdev= 4.26, samples=452 write: IOPS=6, BW=24.3KiB/s (24.9kB/s)(6296KiB/259002msec); 0 zone resets clat (msec): min=36, max=696, avg=131.02, stdev=55.65 lat (msec): min=36, max=696, avg=131.02, stdev=55.65 clat percentiles (msec): | 1.00th=[ 48], 5.00th=[ 63], 10.00th=[ 72], 20.00th=[ 86], | 30.00th=[ 99], 40.00th=[ 110], 50.00th=[ 121], 60.00th=[ 136], | 70.00th=[ 150], 80.00th=[ 171], 90.00th=[ 203], 95.00th=[ 232], | 99.00th=[ 300], 99.50th=[ 330], 99.90th=[ 535], 99.95th=[ 701], | 99.99th=[ 701] bw ( KiB/s): min= 7, max= 64, per=24.59%, avg=23.85, stdev= 9.70, samples=508 iops : min= 1, max= 16, avg= 5.32, stdev= 2.46, samples=508 lat (msec) : 10=3.55%, 20=15.20%, 50=21.42%, 100=22.46%, 250=35.61% lat (msec) : 500=1.66%, 750=0.07%, 1000=0.03% cpu : usr=0.05%, sys=1.19%, ctx=5248, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145010: Mon Sep 7 03:38:12 2026 read: IOPS=5, BW=22.0KiB/s (23.5kB/s)(5940KiB/258296msec) clat (msec): min=4, max=934, avg=33.88, stdev=38.35 lat (msec): min=4, max=934, avg=33.88, stdev=38.35 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 9], 10.00th=[ 12], 20.00th=[ 15], | 30.00th=[ 17], 40.00th=[ 21], 50.00th=[ 25], 60.00th=[ 30], | 70.00th=[ 36], 80.00th=[ 47], 90.00th=[ 67], 95.00th=[ 88], | 99.00th=[ 144], 99.50th=[ 167], 99.90th=[ 468], 99.95th=[ 936], | 99.99th=[ 936] bw ( KiB/s): min= 7, max= 79, per=27.65%, avg=25.44, stdev=16.21, samples=451 iops : min= 1, max= 19, avg= 5.71, stdev= 4.08, samples=451 write: IOPS=6, BW=24.6KiB/s (25.2kB/s)(6348KiB/258296msec); 0 zone resets clat (msec): min=38, max=446, avg=130.78, stdev=54.65 lat (msec): min=38, max=446, avg=130.78, stdev=54.65 clat percentiles (msec): | 1.00th=[ 49], 5.00th=[ 63], 10.00th=[ 71], 20.00th=[ 85], | 30.00th=[ 99], 40.00th=[ 109], 50.00th=[ 121], 60.00th=[ 134], | 70.00th=[ 150], 80.00th=[ 169], 90.00th=[ 205], 95.00th=[ 232], | 99.00th=[ 305], 99.50th=[ 338], 99.90th=[ 414], 99.95th=[ 447], | 99.99th=[ 447] bw ( KiB/s): min= 7, max= 55, per=24.83%, avg=24.09, stdev= 9.75, samples=508 iops : min= 1, max= 13, avg= 5.38, stdev= 2.47, samples=508 lat (msec) : 10=3.55%, 20=15.27%, 50=21.35%, 100=22.75%, 250=35.25% lat (msec) : 500=1.79%, 1000=0.03% cpu : usr=0.05%, sys=1.18%, ctx=5140, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145012: Mon Sep 7 03:38:12 2026 read: IOPS=5, BW=23.4KiB/s (24.0kB/s)(6028KiB/257079msec) clat (msec): min=5, max=529, avg=35.97, stdev=37.47 lat (msec): min=5, max=529, avg=35.97, stdev=37.47 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 10], 10.00th=[ 11], 20.00th=[ 14], | 30.00th=[ 17], 40.00th=[ 21], 50.00th=[ 26], 60.00th=[ 32], | 70.00th=[ 40], 80.00th=[ 52], 90.00th=[ 71], 95.00th=[ 89], | 99.00th=[ 153], 99.50th=[ 296], 99.90th=[ 451], 99.95th=[ 531], | 99.99th=[ 531] bw ( KiB/s): min= 7, max= 110, per=27.49%, avg=25.29, stdev=16.90, samples=460 iops : min= 1, max= 27, avg= 5.67, stdev= 4.25, samples=460 write: IOPS=6, BW=24.3KiB/s (24.9kB/s)(6260KiB/257079msec); 0 zone resets clat (msec): min=39, max=1122, avg=129.38, stdev=59.64 lat (msec): min=39, max=1122, avg=129.39, stdev=59.64 clat percentiles (msec): | 1.00th=[ 48], 5.00th=[ 62], 10.00th=[ 72], 20.00th=[ 85], | 30.00th=[ 94], 40.00th=[ 108], 50.00th=[ 121], 60.00th=[ 131], | 70.00th=[ 146], 80.00th=[ 169], 90.00th=[ 201], 95.00th=[ 234], | 99.00th=[ 296], 99.50th=[ 317], 99.90th=[ 625], 99.95th=[ 1116], | 99.99th=[ 1116] bw ( KiB/s): min= 7, max= 64, per=24.75%, avg=24.01, stdev=10.20, samples=502 iops : min= 1, max= 16, avg= 5.36, stdev= 2.58, samples=502 lat (msec) : 10=3.87%, 20=15.33%, 50=20.18%, 100=25.88%, 250=32.78% lat (msec) : 500=1.86%, 750=0.07%, 2000=0.03% cpu : usr=0.04%, sys=1.25%, ctx=5325, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145014: Mon Sep 7 03:38:12 2026 read: IOPS=5, BW=23.5KiB/s (24.1kB/s)(6052KiB/257183msec) clat (msec): min=4, max=524, avg=33.86, stdev=33.44 lat (msec): min=4, max=524, avg=33.87, stdev=33.44 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 14], | 30.00th=[ 17], 40.00th=[ 20], 50.00th=[ 24], 60.00th=[ 31], | 70.00th=[ 37], 80.00th=[ 48], 90.00th=[ 69], 95.00th=[ 87], | 99.00th=[ 150], 99.50th=[ 188], 99.90th=[ 405], 99.95th=[ 527], | 99.99th=[ 527] bw ( KiB/s): min= 7, max= 103, per=28.50%, avg=26.22, stdev=16.83, samples=446 iops : min= 1, max= 25, avg= 5.91, stdev= 4.22, samples=446 write: IOPS=6, BW=24.2KiB/s (24.8kB/s)(6236KiB/257183msec); 0 zone resets clat (msec): min=37, max=1070, avg=131.86, stdev=61.26 lat (msec): min=37, max=1070, avg=131.86, stdev=61.26 clat percentiles (msec): | 1.00th=[ 50], 5.00th=[ 62], 10.00th=[ 71], 20.00th=[ 85], | 30.00th=[ 97], 40.00th=[ 109], 50.00th=[ 121], 60.00th=[ 136], | 70.00th=[ 153], 80.00th=[ 174], 90.00th=[ 201], 95.00th=[ 234], | 99.00th=[ 305], 99.50th=[ 330], 99.90th=[ 634], 99.95th=[ 1070], | 99.99th=[ 1070] bw ( KiB/s): min= 7, max= 56, per=24.63%, avg=23.89, stdev= 9.77, samples=502 iops : min= 1, max= 14, avg= 5.33, stdev= 2.49, samples=502 lat (msec) : 10=4.46%, 20=15.82%, 50=20.54%, 100=23.50%, 250=33.72% lat (msec) : 500=1.79%, 750=0.13%, 2000=0.03% cpu : usr=0.05%, sys=1.18%, ctx=5395, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=92.7KiB/s (94.9kB/s), 22.0KiB/s-23.5KiB/s (23.5kB/s-24.1kB/s), io=23.4MiB (24.6MB), run=257079-259002msec WRITE: bw=97.1KiB/s (99.4kB/s), 24.2KiB/s-24.6KiB/s (24.8kB/s-25.2kB/s), io=24.6MiB (25.7MB), run=257079-259002msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=145069: Mon Sep 7 03:38:56 2026 read: IOPS=11, BW=190KiB/s (194kB/s)(5920KiB/31170msec) clat (usec): min=38, max=377969, avg=45315.98, stdev=45585.91 lat (usec): min=38, max=377971, avg=45327.40, stdev=45647.70 clat percentiles (usec): | 1.00th=[ 42], 5.00th=[ 56], 10.00th=[ 64], 20.00th=[ 79], | 30.00th=[ 19792], 40.00th=[ 32900], 50.00th=[ 41157], 60.00th=[ 48497], | 70.00th=[ 57410], 80.00th=[ 69731], 90.00th=[ 93848], 95.00th=[113771], | 99.00th=[240124], 99.50th=[329253], 99.90th=[379585], 99.95th=[379585], | 99.99th=[379585] bw ( KiB/s): min= 63, max= 430, per=25.76%, avg=190.08, stdev=85.80, samples=61 iops : min= 3, max= 26, avg=11.11, stdev= 5.44, samples=61 write: IOPS=12, BW=204KiB/s (209kB/s)(6368KiB/31170msec); 0 zone resets clat (usec): min=1310, max=195173, avg=35093.40, stdev=35091.85 lat (usec): min=1310, max=195175, avg=35098.99, stdev=35096.86 clat percentiles (usec): | 1.00th=[ 1467], 5.00th=[ 1696], 10.00th=[ 1926], 20.00th=[ 4817], | 30.00th=[ 8717], 40.00th=[ 13173], 50.00th=[ 22676], 60.00th=[ 36963], | 70.00th=[ 48497], 80.00th=[ 63701], 90.00th=[ 85459], 95.00th=[103285], | 99.00th=[141558], 99.50th=[187696], 99.90th=[196084], 99.95th=[196084], | 99.99th=[196084] bw ( KiB/s): min= 24, max= 473, per=26.40%, avg=204.90, stdev=94.30, samples=61 iops : min= 1, max= 29, avg=12.05, stdev= 5.95, samples=61 lat (usec) : 50=1.69%, 100=10.03%, 250=0.52%, 500=0.13%, 750=0.13% lat (msec) : 2=5.73%, 4=3.39%, 10=8.85%, 20=8.72%, 50=27.60% lat (msec) : 100=26.30%, 250=6.64%, 500=0.26% cpu : usr=0.08%, sys=5.41%, ctx=1311, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145071: Mon Sep 7 03:38:56 2026 read: IOPS=11, BW=177KiB/s (181kB/s)(5744KiB/32434msec) clat (usec): min=37, max=216792, avg=43404.78, stdev=37006.66 lat (usec): min=38, max=216794, avg=43406.07, stdev=37006.64 clat percentiles (usec): | 1.00th=[ 41], 5.00th=[ 57], 10.00th=[ 64], 20.00th=[ 81], | 30.00th=[ 19530], 40.00th=[ 30540], 50.00th=[ 41681], 60.00th=[ 51643], | 70.00th=[ 60031], 80.00th=[ 72877], 90.00th=[ 91751], 95.00th=[104334], | 99.00th=[145753], 99.50th=[200279], 99.90th=[217056], 99.95th=[217056], | 99.99th=[217056] bw ( KiB/s): min= 24, max= 430, per=24.76%, avg=182.75, stdev=90.75, samples=61 iops : min= 1, max= 26, avg=10.66, stdev= 5.77, samples=61 write: IOPS=12, BW=202KiB/s (207kB/s)(6544KiB/32434msec); 0 zone resets clat (usec): min=1322, max=338543, avg=39996.90, stdev=47210.38 lat (usec): min=1324, max=338545, avg=39999.18, stdev=47210.28 clat percentiles (usec): | 1.00th=[ 1516], 5.00th=[ 1696], 10.00th=[ 2040], 20.00th=[ 5407], | 30.00th=[ 10028], 40.00th=[ 14877], 50.00th=[ 21627], 60.00th=[ 34866], | 70.00th=[ 51643], 80.00th=[ 69731], 90.00th=[ 95945], 95.00th=[121111], | 99.00th=[208667], 99.50th=[263193], 99.90th=[337642], 99.95th=[337642], | 99.99th=[337642] bw ( KiB/s): min= 24, max= 416, per=25.98%, avg=201.62, stdev=96.74, samples=63 iops : min= 1, max= 26, avg=11.86, stdev= 6.17, samples=63 lat (usec) : 50=1.43%, 100=9.11%, 250=0.65%, 500=0.26%, 1000=0.13% lat (msec) : 2=5.21%, 4=3.78%, 10=7.55%, 20=11.72%, 50=25.13% lat (msec) : 100=27.21%, 250=7.29%, 500=0.52% cpu : usr=0.10%, sys=5.45%, ctx=1332, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145073: Mon Sep 7 03:38:56 2026 read: IOPS=12, BW=197KiB/s (202kB/s)(6256KiB/31777msec) clat (usec): min=35, max=485058, avg=42909.79, stdev=41713.26 lat (usec): min=36, max=485060, avg=42911.13, stdev=41713.34 clat percentiles (usec): | 1.00th=[ 42], 5.00th=[ 55], 10.00th=[ 61], 20.00th=[ 77], | 30.00th=[ 20055], 40.00th=[ 32375], 50.00th=[ 42206], 60.00th=[ 49021], | 70.00th=[ 58983], 80.00th=[ 67634], 90.00th=[ 86508], 95.00th=[105382], | 99.00th=[158335], 99.50th=[173016], 99.90th=[484443], 99.95th=[484443], | 99.99th=[484443] bw ( KiB/s): min= 30, max= 502, per=27.26%, avg=201.18, stdev=92.26, samples=61 iops : min= 1, max= 31, avg=11.80, stdev= 5.89, samples=61 write: IOPS=11, BW=190KiB/s (194kB/s)(6032KiB/31777msec); 0 zone resets clat (usec): min=1302, max=421893, avg=38473.99, stdev=45789.51 lat (usec): min=1304, max=421894, avg=38481.03, stdev=45786.38 clat percentiles (usec): | 1.00th=[ 1500], 5.00th=[ 1696], 10.00th=[ 2040], 20.00th=[ 5145], | 30.00th=[ 8717], 40.00th=[ 15139], 50.00th=[ 25035], 60.00th=[ 35390], | 70.00th=[ 49021], 80.00th=[ 65799], 90.00th=[ 87557], 95.00th=[114820], | 99.00th=[158335], 99.50th=[408945], 99.90th=[421528], 99.95th=[421528], | 99.99th=[421528] bw ( KiB/s): min= 31, max= 416, per=24.36%, avg=189.02, stdev=92.02, samples=62 iops : min= 1, max= 26, avg=11.05, stdev= 5.85, samples=62 lat (usec) : 50=1.95%, 100=9.64%, 250=0.78%, 500=0.13%, 750=0.39% lat (usec) : 1000=0.13% lat (msec) : 2=4.95%, 4=4.04%, 10=8.33%, 20=7.29%, 50=28.39% lat (msec) : 100=26.95%, 250=6.64%, 500=0.39% cpu : usr=0.08%, sys=5.04%, ctx=1325, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145074: Mon Sep 7 03:38:56 2026 read: IOPS=11, BW=190KiB/s (195kB/s)(6032KiB/31740msec) clat (usec): min=36, max=317858, avg=43549.66, stdev=38793.96 lat (usec): min=36, max=317859, avg=43551.21, stdev=38794.02 clat percentiles (usec): | 1.00th=[ 40], 5.00th=[ 59], 10.00th=[ 62], 20.00th=[ 78], | 30.00th=[ 22938], 40.00th=[ 32900], 50.00th=[ 40633], 60.00th=[ 49546], | 70.00th=[ 57934], 80.00th=[ 71828], 90.00th=[ 92799], 95.00th=[102237], | 99.00th=[160433], 99.50th=[227541], 99.90th=[316670], 99.95th=[316670], | 99.99th=[316670] bw ( KiB/s): min= 31, max= 472, per=25.63%, avg=189.18, stdev=95.91, samples=62 iops : min= 1, max= 29, avg=11.05, stdev= 6.05, samples=62 write: IOPS=12, BW=197KiB/s (202kB/s)(6256KiB/31740msec); 0 zone resets clat (usec): min=1374, max=357126, avg=38668.84, stdev=44985.22 lat (usec): min=1375, max=357128, avg=38671.18, stdev=44985.22 clat percentiles (usec): | 1.00th=[ 1450], 5.00th=[ 1713], 10.00th=[ 1991], 20.00th=[ 4883], | 30.00th=[ 8455], 40.00th=[ 12649], 50.00th=[ 23462], 60.00th=[ 36439], | 70.00th=[ 49021], 80.00th=[ 65799], 90.00th=[ 93848], 95.00th=[122160], | 99.00th=[170918], 99.50th=[312476], 99.90th=[358613], 99.95th=[358613], | 99.99th=[358613] bw ( KiB/s): min= 30, max= 384, per=25.95%, avg=201.38, stdev=88.57, samples=61 iops : min= 1, max= 24, avg=11.84, stdev= 5.63, samples=61 lat (usec) : 50=0.91%, 100=10.42%, 250=0.65%, 500=0.26% lat (msec) : 2=5.47%, 4=3.12%, 10=8.72%, 20=8.07%, 50=29.43% lat (msec) : 100=26.17%, 250=6.25%, 500=0.52% cpu : usr=0.10%, sys=5.52%, ctx=1391, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=738KiB/s (756kB/s), 177KiB/s-197KiB/s (181kB/s-202kB/s), io=23.4MiB (24.5MB), run=31170-32434msec WRITE: bw=777KiB/s (796kB/s), 190KiB/s-204KiB/s (194kB/s-209kB/s), io=24.6MiB (25.8MB), run=31170-32434msec rand-rw: (groupid=0, jobs=1): err= 0: pid=145070: Mon Sep 7 03:39:37 2026 read: IOPS=5, BW=82.3KiB/s (84.3kB/s)(5920KiB/71923msec) clat (msec): min=7, max=271, avg=38.28, stdev=39.04 lat (msec): min=7, max=271, avg=38.28, stdev=39.04 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 16], | 30.00th=[ 19], 40.00th=[ 22], 50.00th=[ 26], 60.00th=[ 31], | 70.00th=[ 36], 80.00th=[ 47], 90.00th=[ 78], 95.00th=[ 136], | 99.00th=[ 213], 99.50th=[ 251], 99.90th=[ 271], 99.95th=[ 271], | 99.99th=[ 271] bw ( KiB/s): min= 29, max= 318, per=28.44%, avg=92.73, stdev=65.18, samples=124 iops : min= 1, max= 19, avg= 5.02, stdev= 4.20, samples=124 write: IOPS=5, BW=88.5KiB/s (90.7kB/s)(6368KiB/71923msec); 0 zone resets clat (msec): min=39, max=498, avg=144.06, stdev=75.07 lat (msec): min=39, max=498, avg=144.08, stdev=75.07 clat percentiles (msec): | 1.00th=[ 55], 5.00th=[ 67], 10.00th=[ 77], 20.00th=[ 89], | 30.00th=[ 97], 40.00th=[ 108], 50.00th=[ 122], 60.00th=[ 134], | 70.00th=[ 157], 80.00th=[ 197], 90.00th=[ 251], 95.00th=[ 300], | 99.00th=[ 401], 99.50th=[ 435], 99.90th=[ 498], 99.95th=[ 498], | 99.99th=[ 498] bw ( KiB/s): min= 30, max= 191, per=26.33%, avg=90.33, stdev=43.72, samples=138 iops : min= 1, max= 11, avg= 4.86, stdev= 2.83, samples=138 lat (msec) : 10=1.56%, 20=15.36%, 50=22.27%, 100=23.18%, 250=31.90% lat (msec) : 500=5.73% cpu : usr=0.05%, sys=1.23%, ctx=1326, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145072: Mon Sep 7 03:39:37 2026 read: IOPS=4, BW=78.3KiB/s (80.2kB/s)(5744KiB/73343msec) clat (msec): min=5, max=308, avg=37.57, stdev=38.95 lat (msec): min=5, max=308, avg=37.57, stdev=38.95 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 12], 20.00th=[ 16], | 30.00th=[ 18], 40.00th=[ 21], 50.00th=[ 24], 60.00th=[ 29], | 70.00th=[ 34], 80.00th=[ 51], 90.00th=[ 81], 95.00th=[ 130], | 99.00th=[ 222], 99.50th=[ 236], 99.90th=[ 309], 99.95th=[ 309], | 99.99th=[ 309] bw ( KiB/s): min= 22, max= 288, per=28.83%, avg=93.98, stdev=64.70, samples=119 iops : min= 1, max= 18, avg= 5.11, stdev= 4.11, samples=119 write: IOPS=5, BW=89.2KiB/s (91.4kB/s)(6544KiB/73343msec); 0 zone resets clat (msec): min=45, max=520, avg=145.51, stdev=79.18 lat (msec): min=45, max=520, avg=145.51, stdev=79.18 clat percentiles (msec): | 1.00th=[ 53], 5.00th=[ 61], 10.00th=[ 71], 20.00th=[ 84], | 30.00th=[ 97], 40.00th=[ 113], 50.00th=[ 133], 60.00th=[ 144], | 70.00th=[ 161], 80.00th=[ 184], 90.00th=[ 249], 95.00th=[ 309], | 99.00th=[ 426], 99.50th=[ 477], 99.90th=[ 523], 99.95th=[ 523], | 99.99th=[ 523] bw ( KiB/s): min= 22, max= 256, per=26.22%, avg=89.93, stdev=43.90, samples=142 iops : min= 1, max= 16, avg= 4.85, stdev= 2.85, samples=142 lat (msec) : 10=2.21%, 20=16.02%, 50=19.40%, 100=23.57%, 250=33.59% lat (msec) : 500=5.08%, 750=0.13% cpu : usr=0.04%, sys=1.30%, ctx=1319, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145075: Mon Sep 7 03:39:37 2026 read: IOPS=5, BW=89.3KiB/s (91.4kB/s)(6256KiB/70058msec) clat (msec): min=6, max=246, avg=35.63, stdev=35.07 lat (msec): min=6, max=246, avg=35.63, stdev=35.07 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 16], | 30.00th=[ 19], 40.00th=[ 21], 50.00th=[ 25], 60.00th=[ 28], | 70.00th=[ 36], 80.00th=[ 44], 90.00th=[ 70], 95.00th=[ 107], | 99.00th=[ 205], 99.50th=[ 247], 99.90th=[ 247], 99.95th=[ 247], | 99.99th=[ 247] bw ( KiB/s): min= 23, max= 352, per=31.52%, avg=102.76, stdev=71.84, samples=120 iops : min= 1, max= 22, avg= 5.66, stdev= 4.58, samples=120 write: IOPS=5, BW=86.1KiB/s (88.2kB/s)(6032KiB/70058msec); 0 zone resets clat (msec): min=47, max=462, avg=148.65, stdev=80.20 lat (msec): min=47, max=462, avg=148.66, stdev=80.20 clat percentiles (msec): | 1.00th=[ 57], 5.00th=[ 66], 10.00th=[ 75], 20.00th=[ 89], | 30.00th=[ 101], 40.00th=[ 113], 50.00th=[ 126], 60.00th=[ 142], | 70.00th=[ 159], 80.00th=[ 199], 90.00th=[ 262], 95.00th=[ 321], | 99.00th=[ 447], 99.50th=[ 460], 99.90th=[ 464], 99.95th=[ 464], | 99.99th=[ 464] bw ( KiB/s): min= 30, max= 192, per=25.35%, avg=86.96, stdev=40.42, samples=136 iops : min= 1, max= 12, avg= 4.65, stdev= 2.61, samples=136 lat (msec) : 10=1.95%, 20=16.80%, 50=23.70%, 100=20.05%, 250=31.90% lat (msec) : 500=5.60% cpu : usr=0.05%, sys=1.19%, ctx=1374, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145076: Mon Sep 7 03:39:37 2026 read: IOPS=5, BW=83.8KiB/s (85.9kB/s)(6032KiB/71944msec) clat (msec): min=5, max=247, avg=39.32, stdev=39.36 lat (msec): min=5, max=247, avg=39.33, stdev=39.36 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 14], 20.00th=[ 17], | 30.00th=[ 20], 40.00th=[ 22], 50.00th=[ 26], 60.00th=[ 30], | 70.00th=[ 36], 80.00th=[ 48], 90.00th=[ 83], 95.00th=[ 133], | 99.00th=[ 199], 99.50th=[ 243], 99.90th=[ 247], 99.95th=[ 247], | 99.99th=[ 247] bw ( KiB/s): min= 30, max= 316, per=29.68%, avg=96.77, stdev=65.66, samples=121 iops : min= 1, max= 19, avg= 5.28, stdev= 4.16, samples=121 write: IOPS=5, BW=86.0KiB/s (89.0kB/s)(6256KiB/71944msec); 0 zone resets clat (msec): min=41, max=540, avg=145.05, stdev=79.64 lat (msec): min=41, max=540, avg=145.05, stdev=79.64 clat percentiles (msec): | 1.00th=[ 50], 5.00th=[ 64], 10.00th=[ 75], 20.00th=[ 90], | 30.00th=[ 104], 40.00th=[ 112], 50.00th=[ 123], 60.00th=[ 136], | 70.00th=[ 155], 80.00th=[ 186], 90.00th=[ 247], 95.00th=[ 321], | 99.00th=[ 456], 99.50th=[ 506], 99.90th=[ 542], 99.95th=[ 542], | 99.99th=[ 542] bw ( KiB/s): min= 22, max= 220, per=26.41%, avg=90.57, stdev=42.91, samples=135 iops : min= 1, max= 13, avg= 4.88, stdev= 2.76, samples=135 lat (msec) : 10=1.43%, 20=15.10%, 50=23.96%, 100=18.23%, 250=36.20% lat (msec) : 500=4.82%, 750=0.26% cpu : usr=0.03%, sys=1.19%, ctx=1294, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=327KiB/s (334kB/s), 78.3KiB/s-89.3KiB/s (80.2kB/s-91.4kB/s), io=23.4MiB (24.5MB), run=70058-73343msec WRITE: bw=344KiB/s (352kB/s), 86.1KiB/s-89.2KiB/s (88.2kB/s-91.4kB/s), io=24.6MiB (25.8MB), run=70058-73343msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=145097: Mon Sep 7 03:39:52 2026 read: IOPS=2, BW=2243KiB/s (2297kB/s)(7168KiB/3196msec) clat (usec): min=591, max=460049, avg=243427.94, stdev=145803.94 lat (usec): min=593, max=460050, avg=243429.70, stdev=145804.01 clat percentiles (usec): | 1.00th=[ 594], 5.00th=[ 594], 10.00th=[ 594], 20.00th=[128451], | 30.00th=[235930], 40.00th=[235930], 50.00th=[270533], 60.00th=[291505], | 70.00th=[291505], 80.00th=[316670], 90.00th=[459277], 95.00th=[459277], | 99.00th=[459277], 99.50th=[459277], 99.90th=[459277], 99.95th=[459277], | 99.99th=[459277] bw ( KiB/s): min= 2035, max= 3856, per=58.05%, avg=2886.00, stdev=916.31, samples=3 iops : min= 1, max= 3, avg= 2.00, stdev= 1.00, samples=3 write: IOPS=1, BW=1602KiB/s (1640kB/s)(5120KiB/3196msec); 0 zone resets clat (msec): min=103, max=589, avg=296.77, stdev=179.55 lat (msec): min=103, max=590, avg=297.27, stdev=179.53 clat percentiles (msec): | 1.00th=[ 104], 5.00th=[ 104], 10.00th=[ 104], 20.00th=[ 104], | 30.00th=[ 228], 40.00th=[ 228], 50.00th=[ 271], 60.00th=[ 271], | 70.00th=[ 292], 80.00th=[ 292], 90.00th=[ 592], 95.00th=[ 592], | 99.00th=[ 592], 99.50th=[ 592], 99.90th=[ 592], 99.95th=[ 592], | 99.99th=[ 592] bw ( KiB/s): min= 2035, max= 3915, per=38.26%, avg=2663.00, stdev=1084.27, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (usec) : 750=8.33% lat (msec) : 250=33.33%, 500=50.00%, 750=8.33% cpu : usr=0.03%, sys=13.65%, ctx=255, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145098: Mon Sep 7 03:39:52 2026 read: IOPS=0, BW=497KiB/s (509kB/s)(2048KiB/4119msec) clat (msec): min=2, max=625, avg=314.14, stdev=441.03 lat (msec): min=2, max=625, avg=314.14, stdev=441.03 clat percentiles (msec): | 1.00th=[ 3], 5.00th=[ 3], 10.00th=[ 3], 20.00th=[ 3], | 30.00th=[ 3], 40.00th=[ 3], 50.00th=[ 3], 60.00th=[ 625], | 70.00th=[ 625], 80.00th=[ 625], 90.00th=[ 625], 95.00th=[ 625], | 99.00th=[ 625], 99.50th=[ 625], 99.90th=[ 625], 99.95th=[ 625], | 99.99th=[ 625] bw ( KiB/s): min= 1383, max= 1957, per=33.59%, avg=1670.00, stdev=405.88, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2486KiB/s (2546kB/s)(10.0MiB/4119msec); 0 zone resets clat (msec): min=193, max=654, avg=348.64, stdev=161.61 lat (msec): min=194, max=654, avg=348.87, stdev=161.61 clat percentiles (msec): | 1.00th=[ 194], 5.00th=[ 194], 10.00th=[ 194], 20.00th=[ 215], | 30.00th=[ 215], 40.00th=[ 222], 50.00th=[ 239], 60.00th=[ 368], | 70.00th=[ 388], 80.00th=[ 435], 90.00th=[ 558], 95.00th=[ 659], | 99.00th=[ 659], 99.50th=[ 659], 99.90th=[ 659], 99.95th=[ 659], | 99.99th=[ 659] bw ( KiB/s): min= 1957, max= 4087, per=43.23%, avg=3008.83, stdev=1097.33, samples=6 iops : min= 1, max= 3, avg= 2.00, stdev= 1.10, samples=6 lat (msec) : 4=8.33%, 250=41.67%, 500=25.00%, 750=25.00% cpu : usr=0.10%, sys=12.02%, ctx=122, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145099: Mon Sep 7 03:39:52 2026 read: IOPS=1, BW=1966KiB/s (2013kB/s)(6144KiB/3125msec) clat (usec): min=409, max=230851, avg=101424.83, stdev=113939.12 lat (usec): min=410, max=230853, avg=101426.30, stdev=113939.37 clat percentiles (usec): | 1.00th=[ 412], 5.00th=[ 412], 10.00th=[ 412], 20.00th=[ 519], | 30.00th=[ 519], 40.00th=[ 709], 50.00th=[ 709], 60.00th=[152044], | 70.00th=[223347], 80.00th=[223347], 90.00th=[231736], 95.00th=[231736], | 99.00th=[231736], 99.50th=[231736], 99.90th=[231736], 99.95th=[231736], | 99.99th=[231736] bw ( KiB/s): min= 1957, max= 4079, per=66.32%, avg=3297.33, stdev=1166.11, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 write: IOPS=1, BW=1966KiB/s (2013kB/s)(6144KiB/3125msec); 0 zone resets clat (msec): min=175, max=1014, avg=418.97, stdev=309.96 lat (msec): min=175, max=1014, avg=419.05, stdev=309.94 clat percentiles (msec): | 1.00th=[ 176], 5.00th=[ 176], 10.00th=[ 176], 20.00th=[ 201], | 30.00th=[ 201], 40.00th=[ 296], 50.00th=[ 296], 60.00th=[ 368], | 70.00th=[ 460], 80.00th=[ 460], 90.00th=[ 1011], 95.00th=[ 1011], | 99.00th=[ 1011], 99.50th=[ 1011], 99.90th=[ 1011], 99.95th=[ 1011], | 99.99th=[ 1011] bw ( KiB/s): min= 1928, max= 2745, per=31.14%, avg=2167.25, stdev=388.02, samples=4 iops : min= 1, max= 2, avg= 1.25, stdev= 0.50, samples=4 lat (usec) : 500=8.33%, 750=16.67% lat (msec) : 250=41.67%, 500=25.00%, 2000=8.33% cpu : usr=0.00%, sys=11.01%, ctx=135, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145101: Mon Sep 7 03:39:52 2026 read: IOPS=1, BW=1270KiB/s (1300kB/s)(5120KiB/4033msec) clat (usec): min=537, max=284375, avg=106646.26, stdev=145783.42 lat (usec): min=538, max=284377, avg=106647.98, stdev=145782.77 clat percentiles (usec): | 1.00th=[ 537], 5.00th=[ 537], 10.00th=[ 537], 20.00th=[ 537], | 30.00th=[ 619], 40.00th=[ 619], 50.00th=[ 709], 60.00th=[ 709], | 70.00th=[246416], 80.00th=[246416], 90.00th=[283116], 95.00th=[283116], | 99.00th=[283116], 99.50th=[283116], 99.90th=[283116], 99.95th=[283116], | 99.99th=[283116] bw ( KiB/s): min= 3968, max= 4007, per=80.20%, avg=3987.50, stdev=27.58, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1777KiB/s (1820kB/s)(7168KiB/4033msec); 0 zone resets clat (msec): min=186, max=907, avg=499.11, stdev=284.61 lat (msec): min=186, max=907, avg=499.26, stdev=284.65 clat percentiles (msec): | 1.00th=[ 186], 5.00th=[ 186], 10.00th=[ 186], 20.00th=[ 197], | 30.00th=[ 257], 40.00th=[ 257], 50.00th=[ 609], 60.00th=[ 659], | 70.00th=[ 659], 80.00th=[ 684], 90.00th=[ 911], 95.00th=[ 911], | 99.00th=[ 911], 99.50th=[ 911], 99.90th=[ 911], 99.95th=[ 911], | 99.99th=[ 911] bw ( KiB/s): min= 2000, max= 3856, per=35.70%, avg=2484.75, stdev=914.39, samples=4 iops : min= 1, max= 3, avg= 1.75, stdev= 0.96, samples=4 lat (usec) : 750=25.00% lat (msec) : 250=25.00%, 500=16.67%, 750=25.00%, 1000=8.33% cpu : usr=0.00%, sys=10.27%, ctx=99, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4972KiB/s (5091kB/s), 497KiB/s-2243KiB/s (509kB/s-2297kB/s), io=20.0MiB (20.0MB), run=3125-4119msec WRITE: bw=6961KiB/s (7128kB/s), 1602KiB/s-2486KiB/s (1640kB/s-2546kB/s), io=28.0MiB (29.4MB), run=3125-4119msec rand-rw: (groupid=0, jobs=1): err= 0: pid=145092: Mon Sep 7 03:39:52 2026 read: IOPS=1, BW=1898KiB/s (1943kB/s)(7168KiB/3777msec) clat (msec): min=64, max=358, avg=193.94, stdev=115.18 lat (msec): min=64, max=358, avg=193.94, stdev=115.18 clat percentiles (msec): | 1.00th=[ 65], 5.00th=[ 65], 10.00th=[ 65], 20.00th=[ 79], | 30.00th=[ 114], 40.00th=[ 114], 50.00th=[ 188], 60.00th=[ 249], | 70.00th=[ 249], 80.00th=[ 309], 90.00th=[ 359], 95.00th=[ 359], | 99.00th=[ 359], 99.50th=[ 359], 99.90th=[ 359], 99.95th=[ 359], | 99.99th=[ 359] bw ( KiB/s): min= 2007, max= 4314, per=66.00%, avg=2601.00, stdev=1142.13, samples=4 iops : min= 1, max= 4, avg= 2.00, stdev= 1.41, samples=4 write: IOPS=1, BW=1356KiB/s (1388kB/s)(5120KiB/3777msec); 0 zone resets clat (msec): min=218, max=892, avg=462.01, stdev=267.73 lat (msec): min=218, max=892, avg=462.17, stdev=267.73 clat percentiles (msec): | 1.00th=[ 220], 5.00th=[ 220], 10.00th=[ 220], 20.00th=[ 220], | 30.00th=[ 296], 40.00th=[ 296], 50.00th=[ 368], 60.00th=[ 368], | 70.00th=[ 535], 80.00th=[ 535], 90.00th=[ 894], 95.00th=[ 894], | 99.00th=[ 894], 99.50th=[ 894], 99.90th=[ 894], 99.95th=[ 894], | 99.99th=[ 894] bw ( KiB/s): min= 1954, max= 2048, per=36.55%, avg=2016.80, stdev=39.02, samples=5 iops : min= 1, max= 2, avg= 1.40, stdev= 0.55, samples=5 lat (msec) : 100=16.67%, 250=33.33%, 500=33.33%, 750=8.33%, 1000=8.33% cpu : usr=0.00%, sys=3.07%, ctx=52, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145093: Mon Sep 7 03:39:52 2026 read: IOPS=0, BW=394KiB/s (404kB/s)(2048KiB/5196msec) clat (msec): min=136, max=309, avg=222.73, stdev=122.11 lat (msec): min=136, max=309, avg=222.73, stdev=122.11 clat percentiles (msec): | 1.00th=[ 138], 5.00th=[ 138], 10.00th=[ 138], 20.00th=[ 138], | 30.00th=[ 138], 40.00th=[ 138], 50.00th=[ 138], 60.00th=[ 309], | 70.00th=[ 309], 80.00th=[ 309], 90.00th=[ 309], 95.00th=[ 309], | 99.00th=[ 309], 99.50th=[ 309], 99.90th=[ 309], 99.95th=[ 309], | 99.99th=[ 309] bw ( KiB/s): min= 1448, max= 2035, per=44.19%, avg=1741.50, stdev=415.07, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1971KiB/s (2018kB/s)(10.0MiB/5196msec); 0 zone resets clat (msec): min=166, max=1405, avg=459.54, stdev=362.89 lat (msec): min=166, max=1405, avg=459.94, stdev=363.01 clat percentiles (msec): | 1.00th=[ 167], 5.00th=[ 167], 10.00th=[ 167], 20.00th=[ 247], | 30.00th=[ 259], 40.00th=[ 262], 50.00th=[ 288], 60.00th=[ 405], | 70.00th=[ 405], 80.00th=[ 489], 90.00th=[ 667], 95.00th=[ 1401], | 99.00th=[ 1401], 99.50th=[ 1401], 99.90th=[ 1401], 99.95th=[ 1401], | 99.99th=[ 1401] bw ( KiB/s): min= 1448, max= 2048, per=35.33%, avg=1949.71, stdev=221.68, samples=7 iops : min= 1, max= 2, avg= 1.29, stdev= 0.49, samples=7 lat (msec) : 250=25.00%, 500=58.33%, 750=8.33%, 2000=8.33% cpu : usr=0.04%, sys=3.89%, ctx=77, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145094: Mon Sep 7 03:39:52 2026 read: IOPS=1, BW=1798KiB/s (1841kB/s)(6144KiB/3417msec) clat (msec): min=121, max=512, avg=236.30, stdev=143.16 lat (msec): min=121, max=512, avg=236.30, stdev=143.16 clat percentiles (msec): | 1.00th=[ 122], 5.00th=[ 122], 10.00th=[ 122], 20.00th=[ 133], | 30.00th=[ 133], 40.00th=[ 190], 50.00th=[ 190], 60.00th=[ 230], | 70.00th=[ 232], 80.00th=[ 232], 90.00th=[ 514], 95.00th=[ 514], | 99.00th=[ 514], 99.50th=[ 514], 99.90th=[ 514], 99.95th=[ 514], | 99.99th=[ 514] bw ( KiB/s): min= 1954, max= 2048, per=51.11%, avg=2014.20, stdev=36.79, samples=5 iops : min= 1, max= 2, avg= 1.20, stdev= 0.45, samples=5 write: IOPS=1, BW=1798KiB/s (1841kB/s)(6144KiB/3417msec); 0 zone resets clat (msec): min=255, max=445, avg=323.82, stdev=78.05 lat (msec): min=255, max=446, avg=324.03, stdev=78.05 clat percentiles (msec): | 1.00th=[ 255], 5.00th=[ 255], 10.00th=[ 255], 20.00th=[ 264], | 30.00th=[ 264], 40.00th=[ 271], 50.00th=[ 271], 60.00th=[ 313], | 70.00th=[ 393], 80.00th=[ 393], 90.00th=[ 447], 95.00th=[ 447], | 99.00th=[ 447], 99.50th=[ 447], 99.90th=[ 447], 99.95th=[ 447], | 99.99th=[ 447] bw ( KiB/s): min= 1954, max= 2828, per=39.41%, avg=2174.40, stdev=367.15, samples=5 iops : min= 1, max= 2, avg= 1.40, stdev= 0.55, samples=5 lat (msec) : 250=41.67%, 500=50.00%, 750=8.33% cpu : usr=0.03%, sys=3.83%, ctx=65, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145095: Mon Sep 7 03:39:52 2026 read: IOPS=1, BW=1152KiB/s (1180kB/s)(5120KiB/4445msec) clat (msec): min=118, max=575, avg=324.08, stdev=187.54 lat (msec): min=118, max=575, avg=324.09, stdev=187.54 clat percentiles (msec): | 1.00th=[ 118], 5.00th=[ 118], 10.00th=[ 118], 20.00th=[ 118], | 30.00th=[ 174], 40.00th=[ 174], 50.00th=[ 317], 60.00th=[ 317], | 70.00th=[ 435], 80.00th=[ 435], 90.00th=[ 575], 95.00th=[ 575], | 99.00th=[ 575], 99.50th=[ 575], 99.90th=[ 575], 99.95th=[ 575], | 99.99th=[ 575] bw ( KiB/s): min= 2007, max= 3908, per=67.17%, avg=2647.33, stdev=1091.82, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 write: IOPS=1, BW=1613KiB/s (1651kB/s)(7168KiB/4445msec); 0 zone resets clat (msec): min=237, max=607, avg=384.00, stdev=125.40 lat (msec): min=237, max=608, avg=384.63, stdev=125.16 clat percentiles (msec): | 1.00th=[ 239], 5.00th=[ 239], 10.00th=[ 239], 20.00th=[ 288], | 30.00th=[ 305], 40.00th=[ 305], 50.00th=[ 376], 60.00th=[ 435], | 70.00th=[ 435], 80.00th=[ 443], 90.00th=[ 609], 95.00th=[ 609], | 99.00th=[ 609], 99.50th=[ 609], 99.90th=[ 609], 99.95th=[ 609], | 99.99th=[ 609] bw ( KiB/s): min= 2035, max= 2998, per=40.46%, avg=2232.80, stdev=427.81, samples=5 iops : min= 1, max= 2, avg= 1.60, stdev= 0.55, samples=5 lat (msec) : 250=25.00%, 500=58.33%, 750=16.67% cpu : usr=0.00%, sys=3.83%, ctx=60, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3941KiB/s (4036kB/s), 394KiB/s-1898KiB/s (404kB/s-1943kB/s), io=20.0MiB (20.0MB), run=3417-5196msec WRITE: bw=5518KiB/s (5651kB/s), 1356KiB/s-1971KiB/s (1388kB/s-2018kB/s), io=28.0MiB (29.4MB), run=3417-5196msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=145110: Mon Sep 7 03:40:08 2026 read: IOPS=0, BW=2623KiB/s (2686kB/s)(12.0MiB/4685msec) clat (msec): min=560, max=3018, avg=1534.40, stdev=1305.99 lat (msec): min=560, max=3018, avg=1534.41, stdev=1305.99 clat percentiles (msec): | 1.00th=[ 558], 5.00th=[ 558], 10.00th=[ 558], 20.00th=[ 558], | 30.00th=[ 558], 40.00th=[ 1028], 50.00th=[ 1028], 60.00th=[ 1028], | 70.00th=[ 3004], 80.00th=[ 3004], 90.00th=[ 3004], 95.00th=[ 3004], | 99.00th=[ 3004], 99.50th=[ 3004], 99.90th=[ 3004], 99.95th=[ 3004], | 99.99th=[ 3004] bw ( KiB/s): min= 7907, max= 8031, per=100.00%, avg=7969.00, stdev=87.68, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=5.32%, ctx=347, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145111: Mon Sep 7 03:40:09 2026 read: IOPS=0, BW=842KiB/s (862kB/s)(4096KiB/4864msec) clat (nsec): min=3076.2M, max=3076.2M, avg=3076211961.00, stdev= 0.00 lat (nsec): min=3076.2M, max=3076.2M, avg=3076216156.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 3071], 5.00th=[ 3071], 10.00th=[ 3071], 20.00th=[ 3071], | 30.00th=[ 3071], 40.00th=[ 3071], 50.00th=[ 3071], 60.00th=[ 3071], | 70.00th=[ 3071], 80.00th=[ 3071], 90.00th=[ 3071], 95.00th=[ 3071], | 99.00th=[ 3071], 99.50th=[ 3071], 99.90th=[ 3071], 99.95th=[ 3071], | 99.99th=[ 3071] bw ( KiB/s): min= 8031, max= 8031, per=100.00%, avg=8031.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=1684KiB/s (1725kB/s)(8192KiB/4864msec); 0 zone resets clat (msec): min=575, max=1061, avg=818.43, stdev=343.13 lat (msec): min=576, max=1061, avg=819.12, stdev=342.62 clat percentiles (msec): | 1.00th=[ 575], 5.00th=[ 575], 10.00th=[ 575], 20.00th=[ 575], | 30.00th=[ 575], 40.00th=[ 575], 50.00th=[ 575], 60.00th=[ 1062], | 70.00th=[ 1062], 80.00th=[ 1062], 90.00th=[ 1062], 95.00th=[ 1062], | 99.00th=[ 1062], 99.50th=[ 1062], 99.90th=[ 1062], 99.95th=[ 1062], | 99.99th=[ 1062] bw ( KiB/s): min= 7907, max= 7907, per=100.00%, avg=7907.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=4.89%, ctx=413, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145112: Mon Sep 7 03:40:09 2026 write: IOPS=0, BW=2880KiB/s (2950kB/s)(12.0MiB/4266msec); 0 zone resets clat (msec): min=574, max=2828, avg=1399.49, stdev=1242.33 lat (msec): min=576, max=2830, avg=1401.19, stdev=1242.42 clat percentiles (msec): | 1.00th=[ 575], 5.00th=[ 575], 10.00th=[ 575], 20.00th=[ 575], | 30.00th=[ 575], 40.00th=[ 793], 50.00th=[ 793], 60.00th=[ 793], | 70.00th=[ 2836], 80.00th=[ 2836], 90.00th=[ 2836], 95.00th=[ 2836], | 99.00th=[ 2836], 99.50th=[ 2836], 99.90th=[ 2836], 99.95th=[ 2836], | 99.99th=[ 2836] bw ( KiB/s): min= 8031, max= 8159, per=100.00%, avg=8095.00, stdev=90.51, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 1000=33.33%, >=2000=33.33% cpu : usr=0.05%, sys=2.74%, ctx=41, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145113: Mon Sep 7 03:40:09 2026 write: IOPS=0, BW=2761KiB/s (2827kB/s)(12.0MiB/4451msec); 0 zone resets clat (msec): min=293, max=3493, avg=1396.58, stdev=1816.93 lat (msec): min=294, max=3494, avg=1397.25, stdev=1816.89 clat percentiles (msec): | 1.00th=[ 296], 5.00th=[ 296], 10.00th=[ 296], 20.00th=[ 296], | 30.00th=[ 296], 40.00th=[ 401], 50.00th=[ 401], 60.00th=[ 401], | 70.00th=[ 3507], 80.00th=[ 3507], 90.00th=[ 3507], 95.00th=[ 3507], | 99.00th=[ 3507], 99.50th=[ 3507], 99.90th=[ 3507], 99.95th=[ 3507], | 99.99th=[ 3507] bw ( KiB/s): min=16351, max=16351, per=100.00%, avg=16351.00, stdev= 0.00, samples=1 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=1 lat (msec) : 500=66.67%, >=2000=33.33% cpu : usr=0.00%, sys=2.47%, ctx=44, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3368KiB/s (3449kB/s), 842KiB/s-2623KiB/s (862kB/s-2686kB/s), io=16.0MiB (16.8MB), run=4685-4864msec WRITE: bw=6737KiB/s (6899kB/s), 1684KiB/s-2880KiB/s (1725kB/s-2950kB/s), io=32.0MiB (33.6MB), run=4266-4864msec rand-rw: (groupid=0, jobs=1): err= 0: pid=145114: Mon Sep 7 03:40:09 2026 read: IOPS=0, BW=2532KiB/s (2592kB/s)(12.0MiB/4854msec) clat (msec): min=163, max=3505, avg=1540.83, stdev=1746.64 lat (msec): min=163, max=3505, avg=1540.84, stdev=1746.64 clat percentiles (msec): | 1.00th=[ 163], 5.00th=[ 163], 10.00th=[ 163], 20.00th=[ 163], | 30.00th=[ 163], 40.00th=[ 953], 50.00th=[ 953], 60.00th=[ 953], | 70.00th=[ 3507], 80.00th=[ 3507], 90.00th=[ 3507], 95.00th=[ 3507], | 99.00th=[ 3507], 99.50th=[ 3507], 99.90th=[ 3507], 99.95th=[ 3507], | 99.99th=[ 3507] bw ( KiB/s): min= 8031, max= 8031, per=100.00%, avg=8031.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 1000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=1.96%, ctx=44, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145115: Mon Sep 7 03:40:09 2026 read: IOPS=0, BW=822KiB/s (842kB/s)(4096KiB/4980msec) clat (nsec): min=3093.7M, max=3093.7M, avg=3093734818.00, stdev= 0.00 lat (nsec): min=3093.7M, max=3093.7M, avg=3093747497.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 3104], 5.00th=[ 3104], 10.00th=[ 3104], 20.00th=[ 3104], | 30.00th=[ 3104], 40.00th=[ 3104], 50.00th=[ 3104], 60.00th=[ 3104], | 70.00th=[ 3104], 80.00th=[ 3104], 90.00th=[ 3104], 95.00th=[ 3104], | 99.00th=[ 3104], 99.50th=[ 3104], 99.90th=[ 3104], 99.95th=[ 3104], | 99.99th=[ 3104] bw ( KiB/s): min= 8175, max= 8175, per=100.00%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=1645KiB/s (1684kB/s)(8192KiB/4980msec); 0 zone resets clat (msec): min=615, max=1189, avg=902.48, stdev=405.85 lat (msec): min=616, max=1189, avg=903.01, stdev=405.76 clat percentiles (msec): | 1.00th=[ 617], 5.00th=[ 617], 10.00th=[ 617], 20.00th=[ 617], | 30.00th=[ 617], 40.00th=[ 617], 50.00th=[ 617], 60.00th=[ 1183], | 70.00th=[ 1183], 80.00th=[ 1183], 90.00th=[ 1183], 95.00th=[ 1183], | 99.00th=[ 1183], 99.50th=[ 1183], 99.90th=[ 1183], 99.95th=[ 1183], | 99.99th=[ 1183] bw ( KiB/s): min= 8031, max= 8031, per=100.00%, avg=8031.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=1.91%, ctx=29, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145116: Mon Sep 7 03:40:09 2026 write: IOPS=0, BW=2656KiB/s (2720kB/s)(12.0MiB/4626msec); 0 zone resets clat (msec): min=421, max=3277, avg=1474.86, stdev=1568.32 lat (msec): min=422, max=3278, avg=1475.65, stdev=1568.46 clat percentiles (msec): | 1.00th=[ 422], 5.00th=[ 422], 10.00th=[ 422], 20.00th=[ 422], | 30.00th=[ 422], 40.00th=[ 726], 50.00th=[ 726], 60.00th=[ 726], | 70.00th=[ 3272], 80.00th=[ 3272], 90.00th=[ 3272], 95.00th=[ 3272], | 99.00th=[ 3272], 99.50th=[ 3272], 99.90th=[ 3272], 99.95th=[ 3272], | 99.99th=[ 3272] bw ( KiB/s): min= 8175, max= 8175, per=100.00%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 750=33.33%, >=2000=33.33% cpu : usr=0.04%, sys=4.11%, ctx=62, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145117: Mon Sep 7 03:40:09 2026 write: IOPS=0, BW=2824KiB/s (2891kB/s)(12.0MiB/4352msec); 0 zone resets clat (msec): min=202, max=3605, avg=1376.30, stdev=1931.62 lat (msec): min=202, max=3606, avg=1377.23, stdev=1931.19 clat percentiles (msec): | 1.00th=[ 203], 5.00th=[ 203], 10.00th=[ 203], 20.00th=[ 203], | 30.00th=[ 203], 40.00th=[ 321], 50.00th=[ 321], 60.00th=[ 321], | 70.00th=[ 3608], 80.00th=[ 3608], 90.00th=[ 3608], 95.00th=[ 3608], | 99.00th=[ 3608], 99.50th=[ 3608], 99.90th=[ 3608], 99.95th=[ 3608], | 99.99th=[ 3608] bw ( KiB/s): min= 6491, max= 8110, per=100.00%, avg=7300.50, stdev=1144.81, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 250=33.33%, 500=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=2.18%, ctx=55, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3290KiB/s (3369kB/s), 822KiB/s-2532KiB/s (842kB/s-2592kB/s), io=16.0MiB (16.8MB), run=4854-4980msec WRITE: bw=6580KiB/s (6738kB/s), 1645KiB/s-2824KiB/s (1684kB/s-2891kB/s), io=32.0MiB (33.6MB), run=4352-4980msec