== sanity test 398b: DIO and buffer IO race ============== 16:45:28 (1790714728) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 6.20925 s, 8.1 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=146842: Tue Sep 29 16:47:37 2026 read: IOPS=13, BW=54.9KiB/s (56.2kB/s)(5992KiB/109183msec) clat (usec): min=32, max=701781, avg=35818.64, stdev=32477.87 lat (usec): min=33, max=701783, avg=35821.69, stdev=32477.51 clat percentiles (usec): | 1.00th=[ 48], 5.00th=[ 55], 10.00th=[ 77], 20.00th=[ 15664], | 30.00th=[ 20579], 40.00th=[ 25560], 50.00th=[ 29754], 60.00th=[ 35914], | 70.00th=[ 43779], 80.00th=[ 53740], 90.00th=[ 70779], 95.00th=[ 85459], | 99.00th=[124257], 99.50th=[152044], 99.90th=[320865], 99.95th=[700449], | 99.99th=[700449] bw ( KiB/s): min= 7, max= 127, per=25.23%, avg=54.49, stdev=21.52, samples=215 iops : min= 1, max= 31, avg=13.00, stdev= 5.42, samples=215 write: IOPS=14, BW=57.7KiB/s (59.0kB/s)(6296KiB/109183msec); 0 zone resets clat (usec): min=930, max=393955, avg=35042.07, stdev=36533.61 lat (usec): min=931, max=393956, avg=35045.84, stdev=36532.90 clat percentiles (usec): | 1.00th=[ 1037], 5.00th=[ 1188], 10.00th=[ 1450], 20.00th=[ 3785], | 30.00th=[ 6980], 40.00th=[ 15926], 50.00th=[ 25822], 60.00th=[ 34341], | 70.00th=[ 46400], 80.00th=[ 60556], 90.00th=[ 83362], 95.00th=[104334], | 99.00th=[156238], 99.50th=[170918], 99.90th=[252707], 99.95th=[392168], | 99.99th=[392168] bw ( KiB/s): min= 7, max= 151, per=25.34%, avg=57.27, stdev=21.12, samples=215 iops : min= 1, max= 37, avg=13.69, stdev= 5.33, samples=215 lat (usec) : 50=0.75%, 100=4.46%, 250=0.36%, 500=0.16%, 750=0.10% lat (usec) : 1000=0.20% lat (msec) : 2=6.67%, 4=3.78%, 10=7.85%, 20=11.78%, 50=39.00% lat (msec) : 100=20.57%, 250=4.17%, 500=0.13%, 750=0.03% cpu : usr=0.09%, sys=5.77%, ctx=6426, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146843: Tue Sep 29 16:47:37 2026 read: IOPS=13, BW=54.2KiB/s (55.6kB/s)(5940KiB/109495msec) clat (usec): min=25, max=717201, avg=35168.86, stdev=32878.50 lat (usec): min=25, max=717202, avg=35172.62, stdev=32894.06 clat percentiles (usec): | 1.00th=[ 45], 5.00th=[ 56], 10.00th=[ 120], 20.00th=[ 16188], | 30.00th=[ 21103], 40.00th=[ 25035], 50.00th=[ 30016], 60.00th=[ 35914], | 70.00th=[ 42730], 80.00th=[ 51643], 90.00th=[ 65274], 95.00th=[ 78119], | 99.00th=[115868], 99.50th=[154141], 99.90th=[438305], 99.95th=[717226], | 99.99th=[717226] bw ( KiB/s): min= 15, max= 111, per=24.94%, avg=53.88, stdev=20.69, samples=215 iops : min= 3, max= 27, avg=12.85, stdev= 5.19, samples=215 write: IOPS=14, BW=57.0KiB/s (59.4kB/s)(6348KiB/109495msec); 0 zone resets clat (usec): min=985, max=233325, avg=35833.31, stdev=36086.20 lat (usec): min=986, max=233327, avg=35838.60, stdev=36085.29 clat percentiles (usec): | 1.00th=[ 1074], 5.00th=[ 1205], 10.00th=[ 1696], 20.00th=[ 3752], | 30.00th=[ 7832], 40.00th=[ 17171], 50.00th=[ 26870], 60.00th=[ 35914], | 70.00th=[ 46924], 80.00th=[ 63177], 90.00th=[ 86508], 95.00th=[108528], | 99.00th=[160433], 99.50th=[183501], 99.90th=[214959], 99.95th=[233833], | 99.99th=[233833] bw ( KiB/s): min= 7, max= 127, per=25.45%, avg=57.51, stdev=22.07, samples=215 iops : min= 1, max= 31, avg=13.76, stdev= 5.58, samples=215 lat (usec) : 50=0.98%, 100=3.65%, 250=0.42%, 500=0.10%, 750=0.10% lat (usec) : 1000=0.03% lat (msec) : 2=6.15%, 4=4.59%, 10=7.13%, 20=12.40%, 50=39.58% lat (msec) : 100=20.83%, 250=3.94%, 500=0.07%, 750=0.03% cpu : usr=0.08%, sys=5.72%, ctx=6403, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146844: Tue Sep 29 16:47:37 2026 read: IOPS=13, BW=55.2KiB/s (56.6kB/s)(6028KiB/109108msec) clat (usec): min=32, max=724253, avg=34349.18, stdev=31072.97 lat (usec): min=32, max=724254, avg=34350.36, stdev=31072.99 clat percentiles (usec): | 1.00th=[ 44], 5.00th=[ 55], 10.00th=[ 85], 20.00th=[ 15795], | 30.00th=[ 19792], 40.00th=[ 23987], 50.00th=[ 28705], 60.00th=[ 34341], | 70.00th=[ 41681], 80.00th=[ 53216], 90.00th=[ 66323], 95.00th=[ 79168], | 99.00th=[109577], 99.50th=[135267], 99.90th=[223347], 99.95th=[725615], | 99.99th=[725615] bw ( KiB/s): min= 7, max= 118, per=25.48%, avg=55.03, stdev=21.43, samples=215 iops : min= 1, max= 29, avg=13.13, stdev= 5.41, samples=215 write: IOPS=14, BW=57.4KiB/s (58.8kB/s)(6260KiB/109108msec); 0 zone resets clat (usec): min=950, max=307510, avg=36385.83, stdev=37710.54 lat (usec): min=951, max=307511, avg=36396.15, stdev=37721.08 clat percentiles (usec): | 1.00th=[ 1057], 5.00th=[ 1188], 10.00th=[ 1795], 20.00th=[ 3687], | 30.00th=[ 7832], 40.00th=[ 17433], 50.00th=[ 27395], 60.00th=[ 36439], | 70.00th=[ 47449], 80.00th=[ 61604], 90.00th=[ 85459], 95.00th=[104334], | 99.00th=[170918], 99.50th=[202376], 99.90th=[283116], 99.95th=[308282], | 99.99th=[308282] bw ( KiB/s): min= 15, max= 128, per=25.26%, avg=57.08, stdev=20.44, samples=215 iops : min= 3, max= 32, avg=13.65, stdev= 5.12, samples=215 lat (usec) : 50=1.33%, 100=3.74%, 250=0.39%, 500=0.13%, 750=0.03% lat (usec) : 1000=0.20% lat (msec) : 2=5.76%, 4=4.98%, 10=6.87%, 20=13.09%, 50=38.31% lat (msec) : 100=21.39%, 250=3.68%, 500=0.07%, 750=0.03% cpu : usr=0.08%, sys=5.83%, ctx=6413, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146845: Tue Sep 29 16:47:37 2026 read: IOPS=13, BW=54.6KiB/s (55.9kB/s)(6052KiB/110819msec) clat (usec): min=29, max=425226, avg=34783.86, stdev=29451.04 lat (usec): min=30, max=425226, avg=34785.25, stdev=29451.05 clat percentiles (usec): | 1.00th=[ 47], 5.00th=[ 55], 10.00th=[ 81], 20.00th=[ 15139], | 30.00th=[ 19792], 40.00th=[ 24249], 50.00th=[ 28705], 60.00th=[ 34866], | 70.00th=[ 43254], 80.00th=[ 52691], 90.00th=[ 67634], 95.00th=[ 80217], | 99.00th=[127402], 99.50th=[160433], 99.90th=[316670], 99.95th=[425722], | 99.99th=[425722] bw ( KiB/s): min= 7, max= 144, per=25.18%, avg=54.38, stdev=23.45, samples=217 iops : min= 1, max= 36, avg=12.97, stdev= 5.91, samples=217 write: IOPS=14, BW=56.3KiB/s (57.6kB/s)(6236KiB/110819msec); 0 zone resets clat (usec): min=914, max=657797, avg=37042.08, stdev=40677.40 lat (usec): min=915, max=657798, avg=37061.16, stdev=40678.10 clat percentiles (usec): | 1.00th=[ 1074], 5.00th=[ 1156], 10.00th=[ 1532], 20.00th=[ 3621], | 30.00th=[ 7701], 40.00th=[ 18482], 50.00th=[ 28181], 60.00th=[ 36439], | 70.00th=[ 46924], 80.00th=[ 64226], 90.00th=[ 86508], 95.00th=[108528], | 99.00th=[164627], 99.50th=[202376], 99.90th=[337642], 99.95th=[658506], | 99.99th=[658506] bw ( KiB/s): min= 7, max= 135, per=24.68%, avg=55.77, stdev=21.18, samples=218 iops : min= 1, max= 33, avg=13.32, stdev= 5.31, samples=218 lat (usec) : 50=1.04%, 100=4.23%, 250=0.16%, 500=0.10%, 750=0.07% lat (usec) : 1000=0.23% lat (msec) : 2=6.58%, 4=4.20%, 10=6.48%, 20=12.89%, 50=38.70% lat (msec) : 100=21.00%, 250=4.13%, 500=0.16%, 750=0.03% cpu : usr=0.11%, sys=5.85%, ctx=6460, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=217KiB/s (222kB/s), 54.2KiB/s-55.2KiB/s (55.6kB/s-56.6kB/s), io=23.4MiB (24.6MB), run=109108-110819msec WRITE: bw=227KiB/s (232kB/s), 56.3KiB/s-57.0KiB/s (57.6kB/s-59.4kB/s), io=24.6MiB (25.7MB), run=109108-110819msec rand-rw: (groupid=0, jobs=1): err= 0: pid=146848: Tue Sep 29 16:49:45 2026 read: IOPS=6, BW=25.2KiB/s (25.8kB/s)(5992KiB/237740msec) clat (msec): min=4, max=731, avg=29.72, stdev=34.33 lat (msec): min=4, max=731, avg=29.72, stdev=34.33 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 10], 20.00th=[ 12], | 30.00th=[ 14], 40.00th=[ 17], 50.00th=[ 19], 60.00th=[ 23], | 70.00th=[ 29], 80.00th=[ 42], 90.00th=[ 64], 95.00th=[ 87], | 99.00th=[ 142], 99.50th=[ 171], 99.90th=[ 359], 99.95th=[ 735], | 99.99th=[ 735] bw ( KiB/s): min= 7, max= 95, per=27.29%, avg=27.29, stdev=18.15, samples=427 iops : min= 1, max= 23, avg= 6.25, stdev= 4.57, samples=427 write: IOPS=6, BW=26.5KiB/s (27.1kB/s)(6296KiB/237740msec); 0 zone resets clat (msec): min=33, max=508, avg=122.68, stdev=56.10 lat (msec): min=33, max=508, avg=122.69, stdev=56.10 clat percentiles (msec): | 1.00th=[ 46], 5.00th=[ 57], 10.00th=[ 65], 20.00th=[ 77], | 30.00th=[ 87], 40.00th=[ 99], 50.00th=[ 112], 60.00th=[ 126], | 70.00th=[ 142], 80.00th=[ 165], 90.00th=[ 199], 95.00th=[ 226], | 99.00th=[ 296], 99.50th=[ 342], 99.90th=[ 460], 99.95th=[ 510], | 99.99th=[ 510] bw ( KiB/s): min= 7, max= 72, per=24.86%, avg=26.11, stdev=11.48, samples=468 iops : min= 1, max= 18, avg= 5.94, stdev= 2.95, samples=468 lat (msec) : 10=6.71%, 20=19.53%, 50=15.69%, 100=26.50%, 250=30.05% lat (msec) : 500=1.46%, 750=0.07% cpu : usr=0.05%, sys=1.19%, ctx=5151, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146849: Tue Sep 29 16:49:45 2026 read: IOPS=6, BW=24.9KiB/s (25.5kB/s)(5940KiB/238323msec) clat (msec): min=4, max=907, avg=29.00, stdev=37.89 lat (msec): min=4, max=907, avg=29.00, stdev=37.89 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 11], | 30.00th=[ 14], 40.00th=[ 16], 50.00th=[ 19], 60.00th=[ 22], | 70.00th=[ 28], 80.00th=[ 39], 90.00th=[ 65], 95.00th=[ 88], | 99.00th=[ 131], 99.50th=[ 211], 99.90th=[ 388], 99.95th=[ 911], | 99.99th=[ 911] bw ( KiB/s): min= 7, max= 103, per=27.42%, avg=27.42, stdev=18.37, samples=421 iops : min= 1, max= 25, avg= 6.28, stdev= 4.64, samples=421 write: IOPS=6, BW=26.6KiB/s (27.3kB/s)(6348KiB/238323msec); 0 zone resets clat (msec): min=38, max=493, avg=122.95, stdev=55.51 lat (msec): min=38, max=493, avg=122.95, stdev=55.51 clat percentiles (msec): | 1.00th=[ 48], 5.00th=[ 58], 10.00th=[ 66], 20.00th=[ 78], | 30.00th=[ 89], 40.00th=[ 100], 50.00th=[ 111], 60.00th=[ 125], | 70.00th=[ 140], 80.00th=[ 161], 90.00th=[ 197], 95.00th=[ 228], | 99.00th=[ 305], 99.50th=[ 338], 99.90th=[ 443], 99.95th=[ 493], | 99.99th=[ 493] bw ( KiB/s): min= 7, max= 56, per=25.06%, avg=26.32, stdev=11.16, samples=468 iops : min= 1, max= 14, avg= 6.00, stdev= 2.85, samples=468 lat (msec) : 10=7.32%, 20=19.73%, 50=15.14%, 100=25.55%, 250=30.73% lat (msec) : 500=1.50%, 1000=0.03% cpu : usr=0.03%, sys=1.18%, ctx=5178, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146850: Tue Sep 29 16:49:45 2026 read: IOPS=6, BW=25.3KiB/s (25.9kB/s)(6028KiB/238297msec) clat (msec): min=5, max=362, avg=30.34, stdev=31.64 lat (msec): min=5, max=362, avg=30.34, stdev=31.64 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 10], 20.00th=[ 12], | 30.00th=[ 14], 40.00th=[ 16], 50.00th=[ 20], 60.00th=[ 24], | 70.00th=[ 30], 80.00th=[ 44], 90.00th=[ 68], 95.00th=[ 92], | 99.00th=[ 159], 99.50th=[ 197], 99.90th=[ 309], 99.95th=[ 363], | 99.99th=[ 363] bw ( KiB/s): min= 7, max= 112, per=26.80%, avg=26.80, stdev=18.52, samples=437 iops : min= 1, max= 28, avg= 6.12, stdev= 4.68, samples=437 write: IOPS=6, BW=26.3KiB/s (26.9kB/s)(6260KiB/238297msec); 0 zone resets clat (msec): min=29, max=1095, avg=122.98, stdev=60.91 lat (msec): min=29, max=1095, avg=122.98, stdev=60.91 clat percentiles (msec): | 1.00th=[ 45], 5.00th=[ 58], 10.00th=[ 65], 20.00th=[ 78], | 30.00th=[ 88], 40.00th=[ 100], 50.00th=[ 110], 60.00th=[ 124], | 70.00th=[ 140], 80.00th=[ 163], 90.00th=[ 197], 95.00th=[ 230], | 99.00th=[ 309], 99.50th=[ 359], 99.90th=[ 456], 99.95th=[ 1099], | 99.99th=[ 1099] bw ( KiB/s): min= 7, max= 64, per=24.70%, avg=25.94, stdev=11.61, samples=468 iops : min= 1, max= 16, avg= 5.90, stdev= 2.97, samples=468 lat (msec) : 10=7.00%, 20=18.75%, 50=16.15%, 100=26.43%, 250=29.98% lat (msec) : 500=1.66%, 2000=0.03% cpu : usr=0.04%, sys=1.15%, ctx=5077, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146851: Tue Sep 29 16:49:45 2026 read: IOPS=6, BW=25.5KiB/s (26.1kB/s)(6052KiB/237560msec) clat (msec): min=4, max=402, avg=29.32, stdev=32.42 lat (msec): min=4, max=402, avg=29.32, stdev=32.42 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 10], 20.00th=[ 11], | 30.00th=[ 13], 40.00th=[ 15], 50.00th=[ 18], 60.00th=[ 22], | 70.00th=[ 27], 80.00th=[ 39], 90.00th=[ 67], 95.00th=[ 91], | 99.00th=[ 150], 99.50th=[ 184], 99.90th=[ 388], 99.95th=[ 405], | 99.99th=[ 405] bw ( KiB/s): min= 7, max= 112, per=28.37%, avg=28.37, stdev=19.79, samples=415 iops : min= 1, max= 28, avg= 6.52, stdev= 4.99, samples=415 write: IOPS=6, BW=26.2KiB/s (26.9kB/s)(6236KiB/237560msec); 0 zone resets clat (msec): min=30, max=1110, avg=123.86, stdev=60.49 lat (msec): min=30, max=1110, avg=123.86, stdev=60.49 clat percentiles (msec): | 1.00th=[ 45], 5.00th=[ 58], 10.00th=[ 65], 20.00th=[ 79], | 30.00th=[ 90], 40.00th=[ 101], 50.00th=[ 112], 60.00th=[ 127], | 70.00th=[ 142], 80.00th=[ 163], 90.00th=[ 197], 95.00th=[ 230], | 99.00th=[ 296], 99.50th=[ 338], 99.90th=[ 456], 99.95th=[ 1116], | 99.99th=[ 1116] bw ( KiB/s): min= 7, max= 72, per=24.70%, avg=25.93, stdev=11.50, samples=466 iops : min= 1, max= 18, avg= 5.90, stdev= 2.94, samples=466 lat (msec) : 10=6.84%, 20=21.09%, 50=15.10%, 100=24.64%, 250=30.60% lat (msec) : 500=1.69%, 2000=0.03% cpu : usr=0.04%, sys=1.19%, ctx=5253, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=101KiB/s (103kB/s), 24.9KiB/s-25.5KiB/s (25.5kB/s-26.1kB/s), io=23.4MiB (24.6MB), run=237560-238323msec WRITE: bw=105KiB/s (108kB/s), 26.2KiB/s-26.6KiB/s (26.9kB/s-27.3kB/s), io=24.6MiB (25.7MB), run=237560-238323msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=146912: Tue Sep 29 16:50:15 2026 read: IOPS=18, BW=291KiB/s (298kB/s)(5920KiB/20328msec) clat (usec): min=35, max=153550, avg=28005.41, stdev=23650.76 lat (usec): min=35, max=153551, avg=28007.57, stdev=23650.58 clat percentiles (usec): | 1.00th=[ 41], 5.00th=[ 55], 10.00th=[ 57], 20.00th=[ 94], | 30.00th=[ 16319], 40.00th=[ 21890], 50.00th=[ 25297], 60.00th=[ 29230], | 70.00th=[ 36439], 80.00th=[ 46400], 90.00th=[ 55837], 95.00th=[ 69731], | 99.00th=[ 93848], 99.50th=[154141], 99.90th=[154141], 99.95th=[154141], | 99.99th=[154141] bw ( KiB/s): min= 95, max= 494, per=25.24%, avg=290.47, stdev=101.88, samples=40 iops : min= 5, max= 30, avg=17.43, stdev= 6.43, samples=40 write: IOPS=19, BW=313KiB/s (321kB/s)(6368KiB/20328msec); 0 zone resets clat (usec): min=1458, max=268378, avg=24964.74, stdev=29997.98 lat (usec): min=1461, max=268381, avg=24967.39, stdev=29997.95 clat percentiles (usec): | 1.00th=[ 1516], 5.00th=[ 1745], 10.00th=[ 2180], 20.00th=[ 4146], | 30.00th=[ 5800], 40.00th=[ 8455], 50.00th=[ 14353], 60.00th=[ 22676], | 70.00th=[ 31327], 80.00th=[ 42206], 90.00th=[ 60031], 95.00th=[ 72877], | 99.00th=[175113], 99.50th=[221250], 99.90th=[267387], 99.95th=[267387], | 99.99th=[267387] bw ( KiB/s): min= 124, max= 571, per=25.93%, avg=314.05, stdev=106.00, samples=40 iops : min= 7, max= 35, avg=18.88, stdev= 6.67, samples=40 lat (usec) : 50=1.30%, 100=8.46%, 250=0.65%, 500=0.39% lat (msec) : 2=5.21%, 4=5.21%, 10=13.02%, 20=11.98%, 50=39.06% lat (msec) : 100=13.41%, 250=1.17%, 500=0.13% cpu : usr=0.10%, sys=7.70%, ctx=1406, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146913: Tue Sep 29 16:50:15 2026 read: IOPS=17, BW=278KiB/s (285kB/s)(5744KiB/20628msec) clat (usec): min=35, max=120924, avg=29003.22, stdev=23170.65 lat (usec): min=35, max=120925, avg=29004.35, stdev=23170.62 clat percentiles (usec): | 1.00th=[ 42], 5.00th=[ 55], 10.00th=[ 59], 20.00th=[ 77], | 30.00th=[ 17171], 40.00th=[ 22676], 50.00th=[ 28443], 60.00th=[ 32637], | 70.00th=[ 39060], 80.00th=[ 47449], 90.00th=[ 57934], 95.00th=[ 67634], | 99.00th=[103285], 99.50th=[109577], 99.90th=[121111], 99.95th=[121111], | 99.99th=[121111] bw ( KiB/s): min= 55, max= 512, per=24.04%, avg=276.75, stdev=88.54, samples=40 iops : min= 3, max= 32, avg=16.55, stdev= 5.58, samples=40 write: IOPS=19, BW=317KiB/s (325kB/s)(6544KiB/20628msec); 0 zone resets clat (usec): min=1406, max=197561, avg=24884.98, stdev=26529.56 lat (usec): min=1407, max=197563, avg=24887.26, stdev=26529.33 clat percentiles (usec): | 1.00th=[ 1532], 5.00th=[ 1778], 10.00th=[ 2835], 20.00th=[ 4948], | 30.00th=[ 7177], 40.00th=[ 10683], 50.00th=[ 16319], 60.00th=[ 23725], | 70.00th=[ 30016], 80.00th=[ 41157], 90.00th=[ 57934], 95.00th=[ 71828], | 99.00th=[125305], 99.50th=[147850], 99.90th=[198181], 99.95th=[198181], | 99.99th=[198181] bw ( KiB/s): min= 126, max= 606, per=25.63%, avg=310.35, stdev=107.24, samples=40 iops : min= 7, max= 37, avg=18.67, stdev= 6.75, samples=40 lat (usec) : 50=1.17%, 100=9.11%, 250=0.39%, 500=0.13% lat (msec) : 2=3.26%, 4=5.08%, 10=12.76%, 20=13.80%, 50=39.45% lat (msec) : 100=13.41%, 250=1.43% cpu : usr=0.09%, sys=7.72%, ctx=1426, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146914: Tue Sep 29 16:50:15 2026 read: IOPS=18, BW=301KiB/s (308kB/s)(6256KiB/20796msec) clat (usec): min=33, max=322683, avg=27611.00, stdev=29184.89 lat (usec): min=34, max=322685, avg=27612.07, stdev=29184.88 clat percentiles (usec): | 1.00th=[ 39], 5.00th=[ 52], 10.00th=[ 58], 20.00th=[ 73], | 30.00th=[ 14353], 40.00th=[ 19006], 50.00th=[ 25035], 60.00th=[ 30016], | 70.00th=[ 36963], 80.00th=[ 44303], 90.00th=[ 55837], 95.00th=[ 66323], | 99.00th=[116917], 99.50th=[248513], 99.90th=[320865], 99.95th=[320865], | 99.99th=[320865] bw ( KiB/s): min= 127, max= 605, per=26.19%, avg=301.44, stdev=99.08, samples=41 iops : min= 7, max= 37, avg=18.12, stdev= 6.19, samples=41 write: IOPS=18, BW=290KiB/s (297kB/s)(6032KiB/20796msec); 0 zone resets clat (usec): min=1330, max=134292, avg=26447.87, stdev=24316.83 lat (usec): min=1332, max=134294, avg=26450.59, stdev=24316.50 clat percentiles (usec): | 1.00th=[ 1500], 5.00th=[ 1729], 10.00th=[ 2278], 20.00th=[ 4752], | 30.00th=[ 7308], 40.00th=[ 13435], 50.00th=[ 19792], 60.00th=[ 26084], | 70.00th=[ 36439], 80.00th=[ 44303], 90.00th=[ 61604], 95.00th=[ 73925], | 99.00th=[100140], 99.50th=[116917], 99.90th=[135267], 99.95th=[135267], | 99.99th=[135267] bw ( KiB/s): min= 127, max= 606, per=23.94%, avg=289.88, stdev=102.02, samples=41 iops : min= 7, max= 37, avg=17.39, stdev= 6.41, samples=41 lat (usec) : 50=1.82%, 100=9.77%, 250=1.04%, 500=0.26%, 750=0.39% lat (usec) : 1000=0.26% lat (msec) : 2=4.43%, 4=4.17%, 10=9.24%, 20=14.58%, 50=38.02% lat (msec) : 100=14.97%, 250=0.91%, 500=0.13% cpu : usr=0.07%, sys=7.49%, ctx=1419, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146915: Tue Sep 29 16:50:15 2026 read: IOPS=18, BW=298KiB/s (305kB/s)(6032KiB/20249msec) clat (usec): min=31, max=303455, avg=26022.65, stdev=26366.02 lat (usec): min=31, max=303456, avg=26023.59, stdev=26366.01 clat percentiles (usec): | 1.00th=[ 40], 5.00th=[ 53], 10.00th=[ 57], 20.00th=[ 66], | 30.00th=[ 12387], 40.00th=[ 20055], 50.00th=[ 24249], 60.00th=[ 28705], | 70.00th=[ 34866], 80.00th=[ 41681], 90.00th=[ 54789], 95.00th=[ 63701], | 99.00th=[100140], 99.50th=[132645], 99.90th=[304088], 99.95th=[304088], | 99.99th=[304088] bw ( KiB/s): min= 31, max= 736, per=25.37%, avg=292.03, stdev=132.49, samples=39 iops : min= 1, max= 46, avg=17.51, stdev= 8.45, samples=39 write: IOPS=19, BW=309KiB/s (316kB/s)(6256KiB/20249msec); 0 zone resets clat (usec): min=1336, max=241805, avg=26647.81, stdev=30813.93 lat (usec): min=1337, max=241807, avg=26650.02, stdev=30814.26 clat percentiles (usec): | 1.00th=[ 1450], 5.00th=[ 1696], 10.00th=[ 2180], 20.00th=[ 3785], | 30.00th=[ 5473], 40.00th=[ 8455], 50.00th=[ 13960], 60.00th=[ 24249], | 70.00th=[ 34341], 80.00th=[ 49021], 90.00th=[ 64226], 95.00th=[ 90702], | 99.00th=[147850], 99.50th=[189793], 99.90th=[242222], 99.95th=[242222], | 99.99th=[242222] bw ( KiB/s): min= 124, max= 640, per=25.17%, avg=304.85, stdev=103.01, samples=39 iops : min= 7, max= 40, avg=18.33, stdev= 6.57, samples=39 lat (usec) : 50=1.82%, 100=10.68%, 250=1.04%, 500=0.26%, 1000=0.13% lat (msec) : 2=4.56%, 4=6.90%, 10=11.85%, 20=11.33%, 50=35.29% lat (msec) : 100=14.45%, 250=1.56%, 500=0.13% cpu : usr=0.13%, sys=7.48%, ctx=1366, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1152KiB/s (1179kB/s), 278KiB/s-301KiB/s (285kB/s-308kB/s), io=23.4MiB (24.5MB), run=20249-20796msec WRITE: bw=1212KiB/s (1241kB/s), 290KiB/s-317KiB/s (297kB/s-325kB/s), io=24.6MiB (25.8MB), run=20249-20796msec rand-rw: (groupid=0, jobs=1): err= 0: pid=146907: Tue Sep 29 16:50:50 2026 read: IOPS=6, BW=103KiB/s (106kB/s)(5920KiB/57401msec) clat (msec): min=6, max=163, avg=27.70, stdev=22.46 lat (msec): min=6, max=163, avg=27.70, stdev=22.46 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 10], 10.00th=[ 11], 20.00th=[ 14], | 30.00th=[ 16], 40.00th=[ 18], 50.00th=[ 20], 60.00th=[ 24], | 70.00th=[ 30], 80.00th=[ 40], 90.00th=[ 54], 95.00th=[ 65], | 99.00th=[ 133], 99.50th=[ 161], 99.90th=[ 163], 99.95th=[ 163], | 99.99th=[ 163] bw ( KiB/s): min= 31, max= 352, per=26.72%, avg=110.88, stdev=61.85, samples=104 iops : min= 1, max= 22, avg= 6.21, stdev= 3.96, samples=104 write: IOPS=6, BW=111KiB/s (114kB/s)(6368KiB/57401msec); 0 zone resets clat (msec): min=40, max=287, avg=117.83, stdev=42.38 lat (msec): min=40, max=287, avg=117.84, stdev=42.37 clat percentiles (msec): | 1.00th=[ 52], 5.00th=[ 66], 10.00th=[ 73], 20.00th=[ 85], | 30.00th=[ 93], 40.00th=[ 103], 50.00th=[ 110], 60.00th=[ 117], | 70.00th=[ 129], 80.00th=[ 146], 90.00th=[ 176], 95.00th=[ 209], | 99.00th=[ 253], 99.50th=[ 275], 99.90th=[ 288], 99.95th=[ 288], | 99.99th=[ 288] bw ( KiB/s): min= 31, max= 190, per=25.22%, avg=110.21, stdev=35.93, samples=113 iops : min= 1, max= 11, avg= 6.16, stdev= 2.28, samples=113 lat (msec) : 10=3.78%, 20=20.44%, 50=17.84%, 100=25.26%, 250=31.90% lat (msec) : 500=0.78% cpu : usr=0.03%, sys=1.41%, ctx=1280, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146908: Tue Sep 29 16:50:50 2026 read: IOPS=6, BW=99.7KiB/s (102kB/s)(5744KiB/57614msec) clat (msec): min=5, max=198, avg=30.01, stdev=28.00 lat (msec): min=5, max=198, avg=30.01, stdev=28.00 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 11], 20.00th=[ 14], | 30.00th=[ 16], 40.00th=[ 18], 50.00th=[ 21], 60.00th=[ 24], | 70.00th=[ 28], 80.00th=[ 39], 90.00th=[ 67], 95.00th=[ 91], | 99.00th=[ 144], 99.50th=[ 180], 99.90th=[ 199], 99.95th=[ 199], | 99.99th=[ 199] bw ( KiB/s): min= 31, max= 352, per=26.31%, avg=109.17, stdev=68.70, samples=103 iops : min= 1, max= 22, avg= 6.08, stdev= 4.35, samples=103 write: IOPS=7, BW=114KiB/s (116kB/s)(6544KiB/57614msec); 0 zone resets clat (msec): min=45, max=392, avg=114.32, stdev=46.80 lat (msec): min=45, max=392, avg=114.32, stdev=46.80 clat percentiles (msec): | 1.00th=[ 53], 5.00th=[ 61], 10.00th=[ 68], 20.00th=[ 79], | 30.00th=[ 88], 40.00th=[ 97], 50.00th=[ 107], 60.00th=[ 116], | 70.00th=[ 129], 80.00th=[ 142], 90.00th=[ 163], 95.00th=[ 192], | 99.00th=[ 309], 99.50th=[ 355], 99.90th=[ 393], 99.95th=[ 393], | 99.99th=[ 393] bw ( KiB/s): min= 31, max= 190, per=25.83%, avg=112.89, stdev=41.02, samples=114 iops : min= 1, max= 11, avg= 6.32, stdev= 2.64, samples=114 lat (msec) : 10=3.39%, 20=19.92%, 50=16.93%, 100=28.13%, 250=30.73% lat (msec) : 500=0.91% cpu : usr=0.03%, sys=1.38%, ctx=1306, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146909: Tue Sep 29 16:50:50 2026 read: IOPS=7, BW=114KiB/s (117kB/s)(6256KiB/54662msec) clat (msec): min=5, max=154, avg=27.92, stdev=23.09 lat (msec): min=5, max=154, avg=27.92, stdev=23.09 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 13], | 30.00th=[ 16], 40.00th=[ 18], 50.00th=[ 21], 60.00th=[ 24], | 70.00th=[ 29], 80.00th=[ 38], 90.00th=[ 57], 95.00th=[ 80], | 99.00th=[ 126], 99.50th=[ 155], 99.90th=[ 155], 99.95th=[ 155], | 99.99th=[ 155] bw ( KiB/s): min= 31, max= 352, per=29.56%, avg=122.69, stdev=78.36, samples=101 iops : min= 1, max= 22, avg= 6.93, stdev= 4.95, samples=101 write: IOPS=6, BW=110KiB/s (113kB/s)(6032KiB/54662msec); 0 zone resets clat (msec): min=48, max=377, avg=115.47, stdev=49.95 lat (msec): min=48, max=377, avg=115.48, stdev=49.95 clat percentiles (msec): | 1.00th=[ 51], 5.00th=[ 59], 10.00th=[ 67], 20.00th=[ 79], | 30.00th=[ 88], 40.00th=[ 95], 50.00th=[ 104], 60.00th=[ 113], | 70.00th=[ 129], 80.00th=[ 144], 90.00th=[ 178], 95.00th=[ 218], | 99.00th=[ 317], 99.50th=[ 334], 99.90th=[ 376], 99.95th=[ 376], | 99.99th=[ 376] bw ( KiB/s): min= 31, max= 191, per=25.04%, avg=109.41, stdev=37.69, samples=108 iops : min= 1, max= 11, avg= 6.09, stdev= 2.43, samples=108 lat (msec) : 10=3.39%, 20=21.74%, 50=20.70%, 100=26.17%, 250=26.69% lat (msec) : 500=1.30% cpu : usr=0.04%, sys=1.48%, ctx=1360, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146910: Tue Sep 29 16:50:50 2026 read: IOPS=6, BW=108KiB/s (110kB/s)(6032KiB/56027msec) clat (msec): min=6, max=157, avg=28.62, stdev=24.81 lat (msec): min=6, max=157, avg=28.62, stdev=24.81 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 13], | 30.00th=[ 15], 40.00th=[ 18], 50.00th=[ 21], 60.00th=[ 24], | 70.00th=[ 29], 80.00th=[ 37], 90.00th=[ 60], 95.00th=[ 85], | 99.00th=[ 121], 99.50th=[ 157], 99.90th=[ 159], 99.95th=[ 159], | 99.99th=[ 159] bw ( KiB/s): min= 31, max= 320, per=26.86%, avg=111.46, stdev=72.44, samples=106 iops : min= 1, max= 20, avg= 6.24, stdev= 4.56, samples=106 write: IOPS=6, BW=112KiB/s (114kB/s)(6256KiB/56027msec); 0 zone resets clat (msec): min=39, max=508, avg=115.24, stdev=49.55 lat (msec): min=39, max=508, avg=115.24, stdev=49.55 clat percentiles (msec): | 1.00th=[ 46], 5.00th=[ 57], 10.00th=[ 69], 20.00th=[ 79], | 30.00th=[ 89], 40.00th=[ 97], 50.00th=[ 106], 60.00th=[ 116], | 70.00th=[ 127], 80.00th=[ 146], 90.00th=[ 174], 95.00th=[ 205], | 99.00th=[ 288], 99.50th=[ 338], 99.90th=[ 510], 99.95th=[ 510], | 99.99th=[ 510] bw ( KiB/s): min= 31, max= 221, per=25.47%, avg=111.32, stdev=41.22, samples=111 iops : min= 1, max= 13, avg= 6.23, stdev= 2.63, samples=111 lat (msec) : 10=4.95%, 20=19.27%, 50=19.40%, 100=26.04%, 250=29.43% lat (msec) : 500=0.78%, 750=0.13% cpu : usr=0.04%, sys=1.37%, ctx=1338, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=416KiB/s (426kB/s), 99.7KiB/s-114KiB/s (102kB/s-117kB/s), io=23.4MiB (24.5MB), run=54662-57614msec WRITE: bw=437KiB/s (448kB/s), 110KiB/s-114KiB/s (113kB/s-116kB/s), io=24.6MiB (25.8MB), run=54662-57614msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=146936: Tue Sep 29 16:51:07 2026 read: IOPS=1, BW=1742KiB/s (1784kB/s)(7168KiB/4114msec) clat (msec): min=7, max=563, avg=232.19, stdev=172.76 lat (msec): min=7, max=563, avg=232.19, stdev=172.76 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 8], 10.00th=[ 8], 20.00th=[ 148], | 30.00th=[ 176], 40.00th=[ 176], 50.00th=[ 205], 60.00th=[ 213], | 70.00th=[ 213], 80.00th=[ 317], 90.00th=[ 567], 95.00th=[ 567], | 99.00th=[ 567], 99.50th=[ 567], 99.90th=[ 567], 99.95th=[ 567], | 99.99th=[ 567] bw ( KiB/s): min= 1917, max= 4063, per=68.20%, avg=2409.40, stdev=925.77, samples=5 iops : min= 1, max= 3, avg= 1.60, stdev= 0.89, samples=5 write: IOPS=1, BW=1245KiB/s (1274kB/s)(5120KiB/4114msec); 0 zone resets clat (msec): min=186, max=841, avg=455.32, stdev=247.15 lat (msec): min=186, max=841, avg=455.62, stdev=247.17 clat percentiles (msec): | 1.00th=[ 188], 5.00th=[ 188], 10.00th=[ 188], 20.00th=[ 188], | 30.00th=[ 305], 40.00th=[ 305], 50.00th=[ 460], 60.00th=[ 460], | 70.00th=[ 485], 80.00th=[ 485], 90.00th=[ 844], 95.00th=[ 844], | 99.00th=[ 844], 99.50th=[ 844], 99.90th=[ 844], 99.95th=[ 844], | 99.99th=[ 844] bw ( KiB/s): min= 2019, max= 2048, per=41.15%, avg=2035.25, stdev=12.97, samples=4 iops : min= 1, max= 2, avg= 1.25, stdev= 0.50, samples=4 lat (msec) : 10=8.33%, 250=41.67%, 500=33.33%, 750=8.33%, 1000=8.33% cpu : usr=0.00%, sys=11.52%, ctx=262, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146937: Tue Sep 29 16:51:07 2026 read: IOPS=0, BW=353KiB/s (362kB/s)(2048KiB/5796msec) clat (msec): min=245, max=1073, avg=659.88, stdev=585.41 lat (msec): min=245, max=1073, avg=659.88, stdev=585.41 clat percentiles (msec): | 1.00th=[ 247], 5.00th=[ 247], 10.00th=[ 247], 20.00th=[ 247], | 30.00th=[ 247], 40.00th=[ 247], 50.00th=[ 247], 60.00th=[ 1083], | 70.00th=[ 1083], 80.00th=[ 1083], 90.00th=[ 1083], 95.00th=[ 1083], | 99.00th=[ 1083], 99.50th=[ 1083], 99.90th=[ 1083], 99.95th=[ 1083], | 99.99th=[ 1083] bw ( KiB/s): min= 1917, max= 1996, per=55.38%, avg=1956.50, stdev=55.86, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1767KiB/s (1809kB/s)(10.0MiB/5796msec); 0 zone resets clat (msec): min=100, max=1092, avg=443.37, stdev=303.26 lat (msec): min=100, max=1092, avg=443.47, stdev=303.26 clat percentiles (msec): | 1.00th=[ 101], 5.00th=[ 101], 10.00th=[ 101], 20.00th=[ 203], | 30.00th=[ 203], 40.00th=[ 275], 50.00th=[ 376], 60.00th=[ 418], | 70.00th=[ 472], 80.00th=[ 481], 90.00th=[ 810], 95.00th=[ 1099], | 99.00th=[ 1099], 99.50th=[ 1099], 99.90th=[ 1099], 99.95th=[ 1099], | 99.99th=[ 1099] bw ( KiB/s): min= 1996, max= 4087, per=61.63%, avg=3048.00, stdev=1120.80, samples=6 iops : min= 1, max= 3, avg= 2.17, stdev= 0.98, samples=6 lat (msec) : 250=33.33%, 500=41.67%, 1000=8.33%, 2000=16.67% cpu : usr=0.00%, sys=9.37%, ctx=197, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146938: Tue Sep 29 16:51:07 2026 read: IOPS=1, BW=1512KiB/s (1548kB/s)(6144KiB/4063msec) clat (msec): min=223, max=630, avg=317.74, stdev=155.02 lat (msec): min=223, max=630, avg=317.74, stdev=155.02 clat percentiles (msec): | 1.00th=[ 224], 5.00th=[ 224], 10.00th=[ 224], 20.00th=[ 241], | 30.00th=[ 241], 40.00th=[ 253], 50.00th=[ 253], 60.00th=[ 268], | 70.00th=[ 292], 80.00th=[ 292], 90.00th=[ 634], 95.00th=[ 634], | 99.00th=[ 634], 99.50th=[ 634], 99.90th=[ 634], 99.95th=[ 634], | 99.99th=[ 634] bw ( KiB/s): min= 1961, max= 4079, per=94.79%, avg=3349.00, stdev=1202.58, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 write: IOPS=1, BW=1512KiB/s (1548kB/s)(6144KiB/4063msec); 0 zone resets clat (msec): min=202, max=657, avg=349.93, stdev=161.99 lat (msec): min=203, max=657, avg=350.02, stdev=161.99 clat percentiles (msec): | 1.00th=[ 203], 5.00th=[ 203], 10.00th=[ 203], 20.00th=[ 253], | 30.00th=[ 253], 40.00th=[ 275], 50.00th=[ 275], 60.00th=[ 351], | 70.00th=[ 359], 80.00th=[ 359], 90.00th=[ 659], 95.00th=[ 659], | 99.00th=[ 659], 99.50th=[ 659], 99.90th=[ 659], 99.95th=[ 659], | 99.99th=[ 659] bw ( KiB/s): min= 2023, max= 2752, per=44.65%, avg=2208.25, stdev=362.51, samples=4 iops : min= 1, max= 2, avg= 1.25, stdev= 0.50, samples=4 lat (msec) : 250=25.00%, 500=58.33%, 750=16.67% cpu : usr=0.00%, sys=13.12%, ctx=191, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146939: Tue Sep 29 16:51:07 2026 read: IOPS=0, BW=884KiB/s (905kB/s)(5120KiB/5795msec) clat (usec): min=483, max=869456, avg=271402.89, stdev=344181.99 lat (usec): min=484, max=869457, avg=271404.02, stdev=344182.02 clat percentiles (usec): | 1.00th=[ 482], 5.00th=[ 482], 10.00th=[ 482], 20.00th=[ 482], | 30.00th=[ 94897], 40.00th=[ 94897], 50.00th=[183501], 60.00th=[183501], | 70.00th=[208667], 80.00th=[208667], 90.00th=[868221], 95.00th=[868221], | 99.00th=[868221], 99.50th=[868221], 99.90th=[868221], 99.95th=[868221], | 99.99th=[868221] bw ( KiB/s): min= 1917, max= 4096, per=75.89%, avg=2681.33, stdev=1226.46, samples=3 iops : min= 1, max= 4, avg= 2.00, stdev= 1.73, samples=3 write: IOPS=1, BW=1237KiB/s (1267kB/s)(7168KiB/5795msec); 0 zone resets clat (msec): min=180, max=1676, avg=608.71, stdev=530.01 lat (msec): min=180, max=1677, avg=608.80, stdev=530.01 clat percentiles (msec): | 1.00th=[ 180], 5.00th=[ 180], 10.00th=[ 180], 20.00th=[ 197], | 30.00th=[ 209], 40.00th=[ 209], 50.00th=[ 567], 60.00th=[ 667], | 70.00th=[ 667], 80.00th=[ 768], 90.00th=[ 1670], 95.00th=[ 1670], | 99.00th=[ 1670], 99.50th=[ 1670], 99.90th=[ 1670], 99.95th=[ 1670], | 99.99th=[ 1670] bw ( KiB/s): min= 1996, max= 4063, per=49.12%, avg=2429.60, stdev=913.26, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 lat (usec) : 500=8.33% lat (msec) : 100=8.33%, 250=41.67%, 750=16.67%, 1000=16.67%, 2000=8.33% cpu : usr=0.02%, sys=7.16%, ctx=185, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3533KiB/s (3618kB/s), 353KiB/s-1742KiB/s (362kB/s-1784kB/s), io=20.0MiB (20.0MB), run=4063-5796msec WRITE: bw=4947KiB/s (5066kB/s), 1237KiB/s-1767KiB/s (1267kB/s-1809kB/s), io=28.0MiB (29.4MB), run=4063-5796msec rand-rw: (groupid=0, jobs=1): err= 0: pid=146931: Tue Sep 29 16:51:07 2026 read: IOPS=1, BW=1364KiB/s (1397kB/s)(7168KiB/5255msec) clat (msec): min=89, max=661, avg=231.55, stdev=196.23 lat (msec): min=89, max=661, avg=231.55, stdev=196.23 clat percentiles (msec): | 1.00th=[ 90], 5.00th=[ 90], 10.00th=[ 90], 20.00th=[ 124], | 30.00th=[ 127], 40.00th=[ 127], 50.00th=[ 184], 60.00th=[ 205], | 70.00th=[ 205], 80.00th=[ 232], 90.00th=[ 659], 95.00th=[ 659], | 99.00th=[ 659], 99.50th=[ 659], 99.90th=[ 659], 99.95th=[ 659], | 99.99th=[ 659] bw ( KiB/s): min= 1957, max= 3968, per=72.60%, avg=2400.00, stdev=877.23, samples=5 iops : min= 1, max= 3, avg= 1.60, stdev= 0.89, samples=5 write: IOPS=0, BW=974KiB/s (998kB/s)(5120KiB/5255msec); 0 zone resets clat (msec): min=316, max=1088, avg=697.58, stdev=333.46 lat (msec): min=316, max=1088, avg=697.66, stdev=333.46 clat percentiles (msec): | 1.00th=[ 317], 5.00th=[ 317], 10.00th=[ 317], 20.00th=[ 317], | 30.00th=[ 380], 40.00th=[ 380], 50.00th=[ 844], 60.00th=[ 844], | 70.00th=[ 860], 80.00th=[ 860], 90.00th=[ 1083], 95.00th=[ 1083], | 99.00th=[ 1083], 99.50th=[ 1083], 99.90th=[ 1083], 99.95th=[ 1083], | 99.99th=[ 1083] bw ( KiB/s): min= 1939, max= 2031, per=42.96%, avg=1988.50, stdev=37.92, samples=4 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=4 lat (msec) : 100=8.33%, 250=41.67%, 500=16.67%, 750=8.33%, 1000=16.67% lat (msec) : 2000=8.33% cpu : usr=0.04%, sys=2.85%, ctx=57, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146932: Tue Sep 29 16:51:07 2026 read: IOPS=0, BW=331KiB/s (339kB/s)(2048KiB/6193msec) clat (msec): min=127, max=1155, avg=641.92, stdev=726.85 lat (msec): min=127, max=1155, avg=641.92, stdev=726.85 clat percentiles (msec): | 1.00th=[ 129], 5.00th=[ 129], 10.00th=[ 129], 20.00th=[ 129], | 30.00th=[ 129], 40.00th=[ 129], 50.00th=[ 129], 60.00th=[ 1150], | 70.00th=[ 1150], 80.00th=[ 1150], 90.00th=[ 1150], 95.00th=[ 1150], | 99.00th=[ 1150], 99.50th=[ 1150], 99.90th=[ 1150], 99.95th=[ 1150], | 99.99th=[ 1150] bw ( KiB/s): min= 2031, max= 2039, per=61.55%, avg=2035.00, stdev= 5.66, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1653KiB/s (1693kB/s)(10.0MiB/6193msec); 0 zone resets clat (msec): min=230, max=937, avg=476.13, stdev=223.20 lat (msec): min=231, max=937, avg=476.37, stdev=223.04 clat percentiles (msec): | 1.00th=[ 230], 5.00th=[ 230], 10.00th=[ 230], 20.00th=[ 253], | 30.00th=[ 305], 40.00th=[ 313], 50.00th=[ 447], 60.00th=[ 481], | 70.00th=[ 506], 80.00th=[ 592], 90.00th=[ 709], 95.00th=[ 936], | 99.00th=[ 936], 99.50th=[ 936], 99.90th=[ 936], 99.95th=[ 936], | 99.99th=[ 936] bw ( KiB/s): min= 1939, max= 3992, per=48.51%, avg=2245.38, stdev=707.16, samples=8 iops : min= 1, max= 3, avg= 1.25, stdev= 0.71, samples=8 lat (msec) : 250=16.67%, 500=41.67%, 750=25.00%, 1000=8.33%, 2000=8.33% cpu : usr=0.00%, sys=3.28%, ctx=99, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146933: Tue Sep 29 16:51:07 2026 read: IOPS=1, BW=1085KiB/s (1111kB/s)(6144KiB/5661msec) clat (msec): min=84, max=1048, avg=486.81, stdev=414.21 lat (msec): min=84, max=1048, avg=486.81, stdev=414.21 clat percentiles (msec): | 1.00th=[ 86], 5.00th=[ 86], 10.00th=[ 86], 20.00th=[ 100], | 30.00th=[ 100], 40.00th=[ 330], 50.00th=[ 330], 60.00th=[ 422], | 70.00th=[ 936], 80.00th=[ 936], 90.00th=[ 1053], 95.00th=[ 1053], | 99.00th=[ 1053], 99.50th=[ 1053], 99.90th=[ 1053], 99.95th=[ 1053], | 99.99th=[ 1053] bw ( KiB/s): min= 1928, max= 2039, per=60.53%, avg=2001.00, stdev=43.79, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 write: IOPS=1, BW=1085KiB/s (1111kB/s)(6144KiB/5661msec); 0 zone resets clat (msec): min=234, max=645, avg=425.23, stdev=166.12 lat (msec): min=235, max=645, avg=425.33, stdev=166.14 clat percentiles (msec): | 1.00th=[ 236], 5.00th=[ 236], 10.00th=[ 236], 20.00th=[ 245], | 30.00th=[ 245], 40.00th=[ 422], 50.00th=[ 422], 60.00th=[ 439], | 70.00th=[ 567], 80.00th=[ 567], 90.00th=[ 642], 95.00th=[ 642], | 99.00th=[ 642], 99.50th=[ 642], 99.90th=[ 642], 99.95th=[ 642], | 99.99th=[ 642] bw ( KiB/s): min= 1980, max= 4079, per=54.54%, avg=2524.50, stdev=1036.68, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (msec) : 100=16.67%, 250=16.67%, 500=33.33%, 750=16.67%, 1000=8.33% lat (msec) : 2000=8.33% cpu : usr=0.02%, sys=2.77%, ctx=89, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146935: Tue Sep 29 16:51:07 2026 read: IOPS=0, BW=932KiB/s (955kB/s)(5120KiB/5492msec) clat (msec): min=108, max=301, avg=179.45, stdev=76.18 lat (msec): min=108, max=301, avg=179.45, stdev=76.18 clat percentiles (msec): | 1.00th=[ 109], 5.00th=[ 109], 10.00th=[ 109], 20.00th=[ 109], | 30.00th=[ 142], 40.00th=[ 142], 50.00th=[ 144], 60.00th=[ 144], | 70.00th=[ 203], 80.00th=[ 203], 90.00th=[ 300], 95.00th=[ 300], | 99.00th=[ 300], 99.50th=[ 300], 99.90th=[ 300], 99.95th=[ 300], | 99.99th=[ 300] bw ( KiB/s): min= 7953, max= 7953, per=100.00%, avg=7953.00, stdev= 0.00, samples=1 iops : min= 7, max= 7, avg= 7.00, stdev= 0.00, samples=1 write: IOPS=1, BW=1305KiB/s (1336kB/s)(7168KiB/5492msec); 0 zone resets clat (msec): min=250, max=1182, avg=652.85, stdev=340.38 lat (msec): min=250, max=1182, avg=652.94, stdev=340.38 clat percentiles (msec): | 1.00th=[ 251], 5.00th=[ 251], 10.00th=[ 251], 20.00th=[ 368], | 30.00th=[ 451], 40.00th=[ 451], 50.00th=[ 567], 60.00th=[ 768], | 70.00th=[ 768], 80.00th=[ 986], 90.00th=[ 1183], 95.00th=[ 1183], | 99.00th=[ 1183], 99.50th=[ 1183], 99.90th=[ 1183], 99.95th=[ 1183], | 99.99th=[ 1183] bw ( KiB/s): min= 1939, max= 2031, per=43.02%, avg=1991.17, stdev=42.50, samples=6 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=6 lat (msec) : 250=33.33%, 500=33.33%, 750=8.33%, 1000=16.67%, 2000=8.33% cpu : usr=0.04%, sys=3.42%, ctx=93, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3307KiB/s (3386kB/s), 331KiB/s-1364KiB/s (339kB/s-1397kB/s), io=20.0MiB (20.0MB), run=5255-6193msec WRITE: bw=4630KiB/s (4741kB/s), 974KiB/s-1653KiB/s (998kB/s-1693kB/s), io=28.0MiB (29.4MB), run=5255-6193msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=146950: Tue Sep 29 16:51:22 2026 read: IOPS=1, BW=4228KiB/s (4330kB/s)(12.0MiB/2906msec) clat (msec): min=778, max=1041, avg=951.96, stdev=150.21 lat (msec): min=778, max=1041, avg=951.96, stdev=150.21 clat percentiles (msec): | 1.00th=[ 776], 5.00th=[ 776], 10.00th=[ 776], 20.00th=[ 776], | 30.00th=[ 776], 40.00th=[ 1036], 50.00th=[ 1036], 60.00th=[ 1036], | 70.00th=[ 1045], 80.00th=[ 1045], 90.00th=[ 1045], 95.00th=[ 1045], | 99.00th=[ 1045], 99.50th=[ 1045], 99.90th=[ 1045], 99.95th=[ 1045], | 99.99th=[ 1045] bw ( KiB/s): min= 7953, max= 8110, per=100.00%, avg=8031.50, stdev=111.02, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=33.33%, 2000=66.67% cpu : usr=0.00%, sys=11.84%, ctx=297, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146951: Tue Sep 29 16:51:22 2026 read: IOPS=0, BW=1192KiB/s (1221kB/s)(4096KiB/3435msec) clat (nsec): min=754328k, max=754328k, avg=754328183.00, stdev= 0.00 lat (nsec): min=754330k, max=754330k, avg=754329826.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 751], 5.00th=[ 751], 10.00th=[ 751], 20.00th=[ 751], | 30.00th=[ 751], 40.00th=[ 751], 50.00th=[ 751], 60.00th=[ 751], | 70.00th=[ 751], 80.00th=[ 751], 90.00th=[ 751], 95.00th=[ 751], | 99.00th=[ 751], 99.50th=[ 751], 99.90th=[ 751], 99.95th=[ 751], | 99.99th=[ 751] bw ( KiB/s): min= 8110, max= 8110, per=100.00%, avg=8110.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2385KiB/s (2442kB/s)(8192KiB/3435msec); 0 zone resets clat (msec): min=910, max=1768, avg=1339.47, stdev=606.57 lat (msec): min=910, max=1768, avg=1339.72, stdev=606.66 clat percentiles (msec): | 1.00th=[ 911], 5.00th=[ 911], 10.00th=[ 911], 20.00th=[ 911], | 30.00th=[ 911], 40.00th=[ 911], 50.00th=[ 911], 60.00th=[ 1770], | 70.00th=[ 1770], 80.00th=[ 1770], 90.00th=[ 1770], 95.00th=[ 1770], | 99.00th=[ 1770], 99.50th=[ 1770], 99.90th=[ 1770], 99.95th=[ 1770], | 99.99th=[ 1770] bw ( KiB/s): min= 8159, max= 8159, per=85.53%, avg=8159.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 1000=66.67%, 2000=33.33% cpu : usr=0.00%, sys=3.20%, ctx=76, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146952: Tue Sep 29 16:51:22 2026 write: IOPS=0, BW=3864KiB/s (3957kB/s)(12.0MiB/3180msec); 0 zone resets clat (msec): min=1018, max=1079, avg=1059.19, stdev=35.07 lat (msec): min=1019, max=1079, avg=1059.54, stdev=35.11 clat percentiles (msec): | 1.00th=[ 1020], 5.00th=[ 1020], 10.00th=[ 1020], 20.00th=[ 1020], | 30.00th=[ 1020], 40.00th=[ 1083], 50.00th=[ 1083], 60.00th=[ 1083], | 70.00th=[ 1083], 80.00th=[ 1083], 90.00th=[ 1083], 95.00th=[ 1083], | 99.00th=[ 1083], 99.50th=[ 1083], 99.90th=[ 1083], 99.95th=[ 1083], | 99.99th=[ 1083] bw ( KiB/s): min= 7953, max= 7984, per=83.54%, avg=7968.50, stdev=21.92, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 2000=100.00% cpu : usr=0.03%, sys=6.64%, ctx=87, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146953: Tue Sep 29 16:51:22 2026 write: IOPS=0, BW=3960KiB/s (4055kB/s)(12.0MiB/3103msec); 0 zone resets clat (msec): min=406, max=2065, avg=1031.24, stdev=902.02 lat (msec): min=407, max=2065, avg=1032.79, stdev=901.17 clat percentiles (msec): | 1.00th=[ 409], 5.00th=[ 409], 10.00th=[ 409], 20.00th=[ 409], | 30.00th=[ 409], 40.00th=[ 625], 50.00th=[ 625], 60.00th=[ 625], | 70.00th=[ 2072], 80.00th=[ 2072], 90.00th=[ 2072], 95.00th=[ 2072], | 99.00th=[ 2072], 99.50th=[ 2072], 99.90th=[ 2072], 99.95th=[ 2072], | 99.99th=[ 2072] bw ( KiB/s): min= 5550, max= 7984, per=70.94%, avg=6767.00, stdev=1721.10, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 750=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=3.93%, ctx=50, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4770KiB/s (4884kB/s), 1192KiB/s-4228KiB/s (1221kB/s-4330kB/s), io=16.0MiB (16.8MB), run=2906-3435msec WRITE: bw=9539KiB/s (9768kB/s), 2385KiB/s-3960KiB/s (2442kB/s-4055kB/s), io=32.0MiB (33.6MB), run=3103-3435msec rand-rw: (groupid=0, jobs=1): err= 0: pid=146945: Tue Sep 29 16:51:22 2026 read: IOPS=1, BW=5731KiB/s (5869kB/s)(12.0MiB/2144msec) clat (msec): min=224, max=1368, avg=688.78, stdev=601.96 lat (msec): min=224, max=1368, avg=688.78, stdev=601.96 clat percentiles (msec): | 1.00th=[ 226], 5.00th=[ 226], 10.00th=[ 226], 20.00th=[ 226], | 30.00th=[ 226], 40.00th=[ 472], 50.00th=[ 472], 60.00th=[ 472], | 70.00th=[ 1368], 80.00th=[ 1368], 90.00th=[ 1368], 95.00th=[ 1368], | 99.00th=[ 1368], 99.50th=[ 1368], 99.90th=[ 1368], 99.95th=[ 1368], | 99.99th=[ 1368] bw ( KiB/s): min= 6168, max= 8159, per=100.00%, avg=7163.50, stdev=1407.85, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 250=33.33%, 500=33.33%, 2000=33.33% cpu : usr=0.00%, sys=3.69%, ctx=54, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146947: Tue Sep 29 16:51:22 2026 read: IOPS=0, BW=1327KiB/s (1359kB/s)(4096KiB/3086msec) clat (nsec): min=596518k, max=596518k, avg=596518277.00, stdev= 0.00 lat (nsec): min=596520k, max=596520k, avg=596520163.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 600], 5.00th=[ 600], 10.00th=[ 600], 20.00th=[ 600], | 30.00th=[ 600], 40.00th=[ 600], 50.00th=[ 600], 60.00th=[ 600], | 70.00th=[ 600], 80.00th=[ 600], 90.00th=[ 600], 95.00th=[ 600], | 99.00th=[ 600], 99.50th=[ 600], 99.90th=[ 600], 99.95th=[ 600], | 99.99th=[ 600] bw ( KiB/s): min= 8159, max= 8159, per=100.00%, avg=8159.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2655KiB/s (2718kB/s)(8192KiB/3086msec); 0 zone resets clat (msec): min=925, max=1438, avg=1182.03, stdev=362.67 lat (msec): min=925, max=1438, avg=1182.37, stdev=362.67 clat percentiles (msec): | 1.00th=[ 927], 5.00th=[ 927], 10.00th=[ 927], 20.00th=[ 927], | 30.00th=[ 927], 40.00th=[ 927], 50.00th=[ 927], 60.00th=[ 1435], | 70.00th=[ 1435], 80.00th=[ 1435], 90.00th=[ 1435], 95.00th=[ 1435], | 99.00th=[ 1435], 99.50th=[ 1435], 99.90th=[ 1435], 99.95th=[ 1435], | 99.99th=[ 1435] bw ( KiB/s): min= 8175, max= 8175, per=100.00%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.03%, sys=4.89%, ctx=61, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146948: Tue Sep 29 16:51:22 2026 write: IOPS=0, BW=3024KiB/s (3097kB/s)(12.0MiB/4063msec); 0 zone resets clat (msec): min=287, max=2794, avg=1306.46, stdev=1317.53 lat (msec): min=287, max=2794, avg=1306.78, stdev=1317.51 clat percentiles (msec): | 1.00th=[ 288], 5.00th=[ 288], 10.00th=[ 288], 20.00th=[ 288], | 30.00th=[ 288], 40.00th=[ 835], 50.00th=[ 835], 60.00th=[ 835], | 70.00th=[ 2802], 80.00th=[ 2802], 90.00th=[ 2802], 95.00th=[ 2802], | 99.00th=[ 2802], 99.50th=[ 2802], 99.90th=[ 2802], 99.95th=[ 2802], | 99.99th=[ 2802] bw ( KiB/s): min= 7772, max= 8047, per=98.08%, avg=7909.50, stdev=194.45, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 1000=33.33%, >=2000=33.33% cpu : usr=0.02%, sys=3.25%, ctx=70, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146949: Tue Sep 29 16:51:22 2026 write: IOPS=0, BW=3573KiB/s (3659kB/s)(12.0MiB/3439msec); 0 zone resets clat (msec): min=534, max=2182, avg=1093.59, stdev=943.00 lat (msec): min=534, max=2182, avg=1093.92, stdev=943.03 clat percentiles (msec): | 1.00th=[ 535], 5.00th=[ 535], 10.00th=[ 535], 20.00th=[ 535], | 30.00th=[ 535], 40.00th=[ 567], 50.00th=[ 567], 60.00th=[ 567], | 70.00th=[ 2198], 80.00th=[ 2198], 90.00th=[ 2198], 95.00th=[ 2198], | 99.00th=[ 2198], 99.50th=[ 2198], 99.90th=[ 2198], 99.95th=[ 2198], | 99.99th=[ 2198] bw ( KiB/s): min= 5712, max= 8175, per=86.10%, avg=6943.50, stdev=1741.60, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=66.67%, >=2000=33.33% cpu : usr=0.03%, sys=3.49%, ctx=70, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5309KiB/s (5437kB/s), 1327KiB/s-5731KiB/s (1359kB/s-5869kB/s), io=16.0MiB (16.8MB), run=2144-3086msec WRITE: bw=8065KiB/s (8259kB/s), 2655KiB/s-3573KiB/s (2718kB/s-3659kB/s), io=32.0MiB (33.6MB), run=3086-4063msec