== sanity test 398b: DIO and buffer IO race ============== 06:22:11 (1789122131) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 7.89982 s, 6.4 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179300: Fri Sep 11 06:24:43 2026 read: IOPS=11, BW=47.9KiB/s (49.1kB/s)(5992KiB/125051msec) clat (usec): min=39, max=679939, avg=46768.47, stdev=33079.23 lat (usec): min=40, max=679940, avg=46773.28, stdev=33077.27 clat percentiles (usec): | 1.00th=[ 62], 5.00th=[ 12780], 10.00th=[ 17433], 20.00th=[ 23462], | 30.00th=[ 28705], 40.00th=[ 35390], 50.00th=[ 40633], 60.00th=[ 47449], | 70.00th=[ 55313], 80.00th=[ 66847], 90.00th=[ 83362], 95.00th=[ 95945], | 99.00th=[141558], 99.50th=[168821], 99.90th=[261096], 99.95th=[683672], | 99.99th=[683672] bw ( KiB/s): min= 7, max= 96, per=25.89%, avg=47.64, stdev=17.92, samples=246 iops : min= 1, max= 24, avg=11.28, stdev= 4.53, samples=246 write: IOPS=12, BW=50.3KiB/s (51.6kB/s)(6296KiB/125051msec); 0 zone resets clat (usec): min=1047, max=197870, avg=34792.76, stdev=34115.99 lat (usec): min=1048, max=197871, avg=34800.94, stdev=34126.35 clat percentiles (usec): | 1.00th=[ 1156], 5.00th=[ 1401], 10.00th=[ 1991], 20.00th=[ 4293], | 30.00th=[ 8225], 40.00th=[ 16712], 50.00th=[ 25560], 60.00th=[ 34866], | 70.00th=[ 46400], 80.00th=[ 60556], 90.00th=[ 83362], 95.00th=[105382], | 99.00th=[143655], 99.50th=[162530], 99.90th=[185598], 99.95th=[198181], | 99.99th=[198181] bw ( KiB/s): min= 7, max= 108, per=26.05%, avg=50.02, stdev=21.07, samples=246 iops : min= 1, max= 27, avg=11.89, stdev= 5.32, samples=246 lat (usec) : 50=0.07%, 100=1.37%, 250=0.36%, 500=0.07%, 1000=0.03% lat (msec) : 2=5.21%, 4=4.59%, 10=7.36%, 20=9.47%, 50=39.49% lat (msec) : 100=26.95%, 250=4.98%, 500=0.03%, 750=0.03% cpu : usr=0.08%, sys=5.27%, ctx=6850, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179301: Fri Sep 11 06:24:43 2026 read: IOPS=11, BW=45.5KiB/s (46.6kB/s)(5940KiB/130412msec) clat (usec): min=36, max=688878, avg=47849.24, stdev=34686.26 lat (usec): min=37, max=688880, avg=47856.99, stdev=34683.78 clat percentiles (usec): | 1.00th=[ 62], 5.00th=[ 12780], 10.00th=[ 17957], 20.00th=[ 24249], | 30.00th=[ 29492], 40.00th=[ 35390], 50.00th=[ 42730], 60.00th=[ 49546], | 70.00th=[ 56886], 80.00th=[ 65274], 90.00th=[ 80217], 95.00th=[103285], | 99.00th=[173016], 99.50th=[191890], 99.90th=[240124], 99.95th=[692061], | 99.99th=[692061] bw ( KiB/s): min= 7, max= 110, per=24.54%, avg=45.15, stdev=16.55, samples=255 iops : min= 1, max= 27, avg=10.65, stdev= 4.18, samples=255 write: IOPS=12, BW=48.7KiB/s (49.8kB/s)(6348KiB/130412msec); 0 zone resets clat (usec): min=956, max=254545, avg=37297.41, stdev=36307.50 lat (usec): min=967, max=254547, avg=37300.56, stdev=36307.09 clat percentiles (usec): | 1.00th=[ 1172], 5.00th=[ 1483], 10.00th=[ 2180], 20.00th=[ 4621], | 30.00th=[ 9110], 40.00th=[ 19268], 50.00th=[ 28181], 60.00th=[ 36963], | 70.00th=[ 48497], 80.00th=[ 64750], 90.00th=[ 87557], 95.00th=[109577], | 99.00th=[147850], 99.50th=[185598], 99.90th=[225444], 99.95th=[254804], | 99.99th=[254804] bw ( KiB/s): min= 7, max= 151, per=24.96%, avg=47.92, stdev=21.79, samples=256 iops : min= 1, max= 37, avg=11.35, stdev= 5.50, samples=256 lat (usec) : 50=0.03%, 100=1.33%, 250=0.23%, 500=0.03%, 1000=0.10% lat (msec) : 2=4.52%, 4=4.88%, 10=6.97%, 20=9.15%, 50=38.67% lat (msec) : 100=27.73%, 250=6.28%, 500=0.03%, 750=0.03% cpu : usr=0.08%, sys=5.20%, ctx=7056, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179302: Fri Sep 11 06:24:43 2026 read: IOPS=11, BW=46.7KiB/s (47.8kB/s)(6028KiB/129015msec) clat (usec): min=40, max=243464, avg=47231.17, stdev=29030.45 lat (usec): min=41, max=243466, avg=47233.87, stdev=29031.42 clat percentiles (usec): | 1.00th=[ 60], 5.00th=[ 12256], 10.00th=[ 17957], 20.00th=[ 24249], | 30.00th=[ 29230], 40.00th=[ 35390], 50.00th=[ 41681], 60.00th=[ 49021], | 70.00th=[ 56886], 80.00th=[ 66847], 90.00th=[ 84411], 95.00th=[101188], | 99.00th=[137364], 99.50th=[154141], 99.90th=[238027], 99.95th=[244319], | 99.99th=[244319] bw ( KiB/s): min= 14, max= 111, per=25.22%, avg=46.40, stdev=17.98, samples=254 iops : min= 3, max= 27, avg=10.96, stdev= 4.51, samples=254 write: IOPS=12, BW=48.5KiB/s (49.7kB/s)(6260KiB/129015msec); 0 zone resets clat (usec): min=1062, max=750063, avg=36833.17, stdev=41022.26 lat (usec): min=1063, max=750066, avg=36837.26, stdev=41021.46 clat percentiles (usec): | 1.00th=[ 1188], 5.00th=[ 1532], 10.00th=[ 2343], 20.00th=[ 4686], | 30.00th=[ 8717], 40.00th=[ 17695], 50.00th=[ 26346], 60.00th=[ 34866], | 70.00th=[ 45876], 80.00th=[ 62653], 90.00th=[ 88605], 95.00th=[109577], | 99.00th=[152044], 99.50th=[179307], 99.90th=[291505], 99.95th=[750781], | 99.99th=[750781] bw ( KiB/s): min= 7, max= 127, per=25.07%, avg=48.14, stdev=21.35, samples=254 iops : min= 1, max= 31, avg=11.41, stdev= 5.38, samples=254 lat (usec) : 50=0.07%, 100=1.40%, 250=0.36%, 500=0.03% lat (msec) : 2=4.17%, 4=4.72%, 10=7.71%, 20=9.18%, 50=39.36% lat (msec) : 100=26.89%, 250=6.02%, 500=0.07%, 1000=0.03% cpu : usr=0.09%, sys=5.10%, ctx=6835, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179303: Fri Sep 11 06:24:43 2026 read: IOPS=11, BW=47.0KiB/s (48.2kB/s)(6052KiB/128630msec) clat (usec): min=42, max=286054, avg=46851.80, stdev=29714.29 lat (usec): min=43, max=286055, avg=46853.69, stdev=29714.33 clat percentiles (usec): | 1.00th=[ 59], 5.00th=[ 11994], 10.00th=[ 17957], 20.00th=[ 24249], | 30.00th=[ 29754], 40.00th=[ 34866], 50.00th=[ 41157], 60.00th=[ 47973], | 70.00th=[ 55837], 80.00th=[ 66323], 90.00th=[ 84411], 95.00th=[ 98042], | 99.00th=[143655], 99.50th=[181404], 99.90th=[250610], 99.95th=[287310], | 99.99th=[287310] bw ( KiB/s): min= 7, max= 101, per=25.42%, avg=46.77, stdev=17.15, samples=253 iops : min= 1, max= 25, avg=11.06, stdev= 4.32, samples=253 write: IOPS=12, BW=48.5KiB/s (49.6kB/s)(6236KiB/128630msec); 0 zone resets clat (usec): min=934, max=753858, avg=36906.44, stdev=41194.60 lat (usec): min=935, max=753860, avg=36922.35, stdev=41187.74 clat percentiles (usec): | 1.00th=[ 1156], 5.00th=[ 1434], 10.00th=[ 2114], 20.00th=[ 4424], | 30.00th=[ 7832], 40.00th=[ 16057], 50.00th=[ 25560], 60.00th=[ 34866], | 70.00th=[ 46400], 80.00th=[ 64750], 90.00th=[ 90702], 95.00th=[111674], | 99.00th=[154141], 99.50th=[175113], 99.90th=[233833], 99.95th=[750781], | 99.99th=[750781] bw ( KiB/s): min= 7, max= 95, per=25.09%, avg=48.18, stdev=18.52, samples=253 iops : min= 1, max= 23, avg=11.42, stdev= 4.67, samples=253 lat (usec) : 50=0.10%, 100=1.56%, 250=0.16%, 500=0.07%, 750=0.03% lat (usec) : 1000=0.03% lat (msec) : 2=4.69%, 4=4.79%, 10=7.49%, 20=9.64%, 50=39.00% lat (msec) : 100=26.46%, 250=5.89%, 500=0.07%, 1000=0.03% cpu : usr=0.08%, sys=5.11%, ctx=6724, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=184KiB/s (189kB/s), 45.5KiB/s-47.9KiB/s (46.6kB/s-49.1kB/s), io=23.4MiB (24.6MB), run=125051-130412msec WRITE: bw=193KiB/s (197kB/s), 48.5KiB/s-50.3KiB/s (49.6kB/s-51.6kB/s), io=24.6MiB (25.7MB), run=125051-130412msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179295: Fri Sep 11 06:25:24 2026 read: IOPS=8, BW=35.0KiB/s (35.8kB/s)(5992KiB/171164msec) clat (msec): min=5, max=762, avg=45.92, stdev=43.38 lat (msec): min=5, max=762, avg=45.92, stdev=43.38 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 12], 10.00th=[ 15], 20.00th=[ 18], | 30.00th=[ 23], 40.00th=[ 27], 50.00th=[ 33], 60.00th=[ 39], | 70.00th=[ 49], 80.00th=[ 65], 90.00th=[ 101], 95.00th=[ 128], | 99.00th=[ 190], 99.50th=[ 211], 99.90th=[ 393], 99.95th=[ 760], | 99.99th=[ 760] bw ( KiB/s): min= 7, max= 159, per=25.36%, avg=35.25, stdev=22.46, samples=330 iops : min= 1, max= 39, avg= 8.18, stdev= 5.64, samples=330 write: IOPS=9, BW=36.8KiB/s (37.7kB/s)(6296KiB/171164msec); 0 zone resets clat (msec): min=11, max=321, avg=64.75, stdev=44.47 lat (msec): min=11, max=321, avg=64.75, stdev=44.47 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 23], 10.00th=[ 25], 20.00th=[ 32], | 30.00th=[ 37], 40.00th=[ 44], 50.00th=[ 51], 60.00th=[ 61], | 70.00th=[ 77], 80.00th=[ 91], 90.00th=[ 122], 95.00th=[ 153], | 99.00th=[ 239], 99.50th=[ 259], 99.90th=[ 300], 99.95th=[ 321], | 99.99th=[ 321] bw ( KiB/s): min= 7, max= 127, per=24.99%, avg=36.49, stdev=21.07, samples=335 iops : min= 1, max= 31, avg= 8.48, stdev= 5.30, samples=335 lat (msec) : 10=1.17%, 20=11.82%, 50=47.40%, 100=26.46%, 250=12.66% lat (msec) : 500=0.46%, 1000=0.03% cpu : usr=0.06%, sys=1.80%, ctx=4634, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179296: Fri Sep 11 06:25:24 2026 read: IOPS=8, BW=34.6KiB/s (35.5kB/s)(5940KiB/171532msec) clat (msec): min=4, max=769, avg=45.27, stdev=42.54 lat (msec): min=4, max=769, avg=45.27, stdev=42.54 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 19], | 30.00th=[ 23], 40.00th=[ 27], 50.00th=[ 32], 60.00th=[ 40], | 70.00th=[ 49], 80.00th=[ 64], 90.00th=[ 94], 95.00th=[ 130], | 99.00th=[ 184], 99.50th=[ 209], 99.90th=[ 321], 99.95th=[ 768], | 99.99th=[ 768] bw ( KiB/s): min= 7, max= 119, per=25.14%, avg=34.94, stdev=23.17, samples=330 iops : min= 1, max= 29, avg= 8.10, stdev= 5.84, samples=330 write: IOPS=9, BW=37.0KiB/s (37.9kB/s)(6348KiB/171532msec); 0 zone resets clat (msec): min=11, max=402, avg=65.46, stdev=45.01 lat (msec): min=11, max=402, avg=65.46, stdev=45.01 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 22], 10.00th=[ 25], 20.00th=[ 32], | 30.00th=[ 37], 40.00th=[ 43], 50.00th=[ 51], 60.00th=[ 62], | 70.00th=[ 75], 80.00th=[ 99], 90.00th=[ 128], 95.00th=[ 150], | 99.00th=[ 230], 99.50th=[ 266], 99.90th=[ 309], 99.95th=[ 401], | 99.99th=[ 401] bw ( KiB/s): min= 7, max= 111, per=25.15%, avg=36.72, stdev=21.06, samples=335 iops : min= 1, max= 27, avg= 8.54, stdev= 5.29, samples=335 lat (msec) : 10=1.43%, 20=12.50%, 50=46.29%, 100=25.52%, 250=13.80% lat (msec) : 500=0.42%, 1000=0.03% cpu : usr=0.06%, sys=1.84%, ctx=4842, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179297: Fri Sep 11 06:25:24 2026 read: IOPS=8, BW=35.1KiB/s (35.9kB/s)(6028KiB/171772msec) clat (msec): min=6, max=279, avg=44.00, stdev=37.42 lat (msec): min=6, max=279, avg=44.01, stdev=37.42 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 18], | 30.00th=[ 23], 40.00th=[ 27], 50.00th=[ 32], 60.00th=[ 38], | 70.00th=[ 47], 80.00th=[ 62], 90.00th=[ 93], 95.00th=[ 123], | 99.00th=[ 188], 99.50th=[ 211], 99.90th=[ 249], 99.95th=[ 279], | 99.99th=[ 279] bw ( KiB/s): min= 7, max= 149, per=25.60%, avg=35.59, stdev=22.34, samples=330 iops : min= 1, max= 37, avg= 8.26, stdev= 5.62, samples=330 write: IOPS=9, BW=36.4KiB/s (37.3kB/s)(6260KiB/171772msec); 0 zone resets clat (msec): min=11, max=789, avg=67.09, stdev=48.60 lat (msec): min=11, max=789, avg=67.10, stdev=48.60 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 22], 10.00th=[ 26], 20.00th=[ 32], | 30.00th=[ 38], 40.00th=[ 44], 50.00th=[ 53], 60.00th=[ 65], | 70.00th=[ 80], 80.00th=[ 96], 90.00th=[ 126], 95.00th=[ 155], | 99.00th=[ 236], 99.50th=[ 266], 99.90th=[ 355], 99.95th=[ 793], | 99.99th=[ 793] bw ( KiB/s): min= 7, max= 119, per=24.93%, avg=36.39, stdev=21.57, samples=335 iops : min= 1, max= 29, avg= 8.46, stdev= 5.43, samples=335 lat (msec) : 10=1.07%, 20=12.99%, 50=46.06%, 100=26.27%, 250=13.22% lat (msec) : 500=0.36%, 1000=0.03% cpu : usr=0.07%, sys=1.86%, ctx=4769, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179298: Fri Sep 11 06:25:24 2026 read: IOPS=8, BW=35.4KiB/s (36.2kB/s)(6052KiB/171143msec) clat (msec): min=6, max=317, avg=44.57, stdev=36.60 lat (msec): min=6, max=317, avg=44.57, stdev=36.60 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 15], 20.00th=[ 19], | 30.00th=[ 22], 40.00th=[ 27], 50.00th=[ 33], 60.00th=[ 40], | 70.00th=[ 49], 80.00th=[ 64], 90.00th=[ 94], 95.00th=[ 120], | 99.00th=[ 180], 99.50th=[ 194], 99.90th=[ 245], 99.95th=[ 317], | 99.99th=[ 317] bw ( KiB/s): min= 7, max= 151, per=25.77%, avg=35.83, stdev=23.34, samples=328 iops : min= 1, max= 37, avg= 8.31, stdev= 5.87, samples=328 write: IOPS=9, BW=36.4KiB/s (37.3kB/s)(6236KiB/171143msec); 0 zone resets clat (msec): min=11, max=791, avg=66.24, stdev=49.11 lat (msec): min=11, max=791, avg=66.24, stdev=49.11 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 22], 10.00th=[ 26], 20.00th=[ 31], | 30.00th=[ 37], 40.00th=[ 44], 50.00th=[ 51], 60.00th=[ 63], | 70.00th=[ 78], 80.00th=[ 96], 90.00th=[ 126], 95.00th=[ 157], | 99.00th=[ 228], 99.50th=[ 264], 99.90th=[ 405], 99.95th=[ 793], | 99.99th=[ 793] bw ( KiB/s): min= 7, max= 111, per=24.71%, avg=36.08, stdev=21.20, samples=335 iops : min= 1, max= 27, avg= 8.38, stdev= 5.34, samples=335 lat (msec) : 10=1.14%, 20=12.79%, 50=46.16%, 100=26.27%, 250=13.22% lat (msec) : 500=0.39%, 1000=0.03% cpu : usr=0.06%, sys=1.78%, ctx=4664, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=140KiB/s (143kB/s), 34.6KiB/s-35.4KiB/s (35.5kB/s-36.2kB/s), io=23.4MiB (24.6MB), run=171143-171772msec WRITE: bw=146KiB/s (150kB/s), 36.4KiB/s-37.0KiB/s (37.3kB/s-37.9kB/s), io=24.6MiB (25.7MB), run=171143-171772msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179351: Fri Sep 11 06:26:14 2026 read: IOPS=8, BW=143KiB/s (146kB/s)(5920KiB/41435msec) clat (usec): min=39, max=276010, avg=59115.74, stdev=38660.89 lat (usec): min=40, max=276011, avg=59129.62, stdev=38647.49 clat percentiles (usec): | 1.00th=[ 59], 5.00th=[ 90], 10.00th=[ 21103], 20.00th=[ 30278], | 30.00th=[ 38011], 40.00th=[ 45876], 50.00th=[ 52691], 60.00th=[ 61604], | 70.00th=[ 69731], 80.00th=[ 85459], 90.00th=[105382], 95.00th=[126354], | 99.00th=[206570], 99.50th=[221250], 99.90th=[274727], 99.95th=[274727], | 99.99th=[274727] bw ( KiB/s): min= 29, max= 414, per=24.70%, avg=142.78, stdev=62.11, samples=81 iops : min= 1, max= 25, avg= 8.11, stdev= 3.93, samples=81 write: IOPS=9, BW=154KiB/s (157kB/s)(6368KiB/41435msec); 0 zone resets clat (usec): min=1530, max=308900, avg=48966.49, stdev=50082.43 lat (usec): min=1533, max=308901, avg=48978.81, stdev=50075.45 clat percentiles (usec): | 1.00th=[ 1713], 5.00th=[ 3195], 10.00th=[ 5014], 20.00th=[ 9372], | 30.00th=[ 14353], 40.00th=[ 24511], 50.00th=[ 31851], 60.00th=[ 41681], | 70.00th=[ 57934], 80.00th=[ 84411], 90.00th=[113771], 95.00th=[156238], | 99.00th=[225444], 99.50th=[250610], 99.90th=[308282], 99.95th=[308282], | 99.99th=[308282] bw ( KiB/s): min= 31, max= 382, per=25.59%, avg=155.59, stdev=70.41, samples=80 iops : min= 1, max= 23, avg= 8.91, stdev= 4.48, samples=80 lat (usec) : 50=0.26%, 100=2.34%, 250=0.52%, 750=0.13%, 1000=0.39% lat (msec) : 2=0.91%, 4=2.60%, 10=7.68%, 20=8.46%, 50=32.68% lat (msec) : 100=31.38%, 250=12.24%, 500=0.39% cpu : usr=0.05%, sys=4.50%, ctx=1781, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179352: Fri Sep 11 06:26:14 2026 read: IOPS=8, BW=140KiB/s (144kB/s)(5744KiB/40942msec) clat (usec): min=51, max=241472, avg=60549.78, stdev=38491.33 lat (usec): min=52, max=241475, avg=60553.78, stdev=38495.81 clat percentiles (usec): | 1.00th=[ 65], 5.00th=[ 196], 10.00th=[ 23462], 20.00th=[ 30802], | 30.00th=[ 38536], 40.00th=[ 45876], 50.00th=[ 53216], 60.00th=[ 62129], | 70.00th=[ 70779], 80.00th=[ 86508], 90.00th=[110625], 95.00th=[128451], | 99.00th=[191890], 99.50th=[229639], 99.90th=[242222], 99.95th=[242222], | 99.99th=[242222] bw ( KiB/s): min= 31, max= 317, per=24.12%, avg=139.39, stdev=57.32, samples=80 iops : min= 1, max= 19, avg= 7.90, stdev= 3.63, samples=80 write: IOPS=9, BW=160KiB/s (164kB/s)(6544KiB/40942msec); 0 zone resets clat (usec): min=1660, max=216036, avg=46833.24, stdev=44076.68 lat (usec): min=1663, max=216038, avg=46839.99, stdev=44076.17 clat percentiles (usec): | 1.00th=[ 1860], 5.00th=[ 2638], 10.00th=[ 4228], 20.00th=[ 8455], | 30.00th=[ 15401], 40.00th=[ 26084], 50.00th=[ 34866], 60.00th=[ 43779], | 70.00th=[ 56886], 80.00th=[ 78119], 90.00th=[110625], 95.00th=[137364], | 99.00th=[196084], 99.50th=[200279], 99.90th=[217056], 99.95th=[217056], | 99.99th=[217056] bw ( KiB/s): min= 30, max= 350, per=26.08%, avg=158.57, stdev=73.65, samples=80 iops : min= 1, max= 21, avg= 9.11, stdev= 4.70, samples=80 lat (usec) : 100=1.95%, 250=0.39% lat (msec) : 2=1.30%, 4=3.78%, 10=7.42%, 20=7.16%, 50=33.46% lat (msec) : 100=31.64%, 250=12.89% cpu : usr=0.07%, sys=4.62%, ctx=1738, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179353: Fri Sep 11 06:26:14 2026 read: IOPS=9, BW=152KiB/s (156kB/s)(6256KiB/41023msec) clat (usec): min=34, max=265938, avg=58217.85, stdev=44680.52 lat (usec): min=35, max=265938, avg=58219.46, stdev=44680.50 clat percentiles (usec): | 1.00th=[ 43], 5.00th=[ 68], 10.00th=[ 99], 20.00th=[ 27395], | 30.00th=[ 36439], 40.00th=[ 43779], 50.00th=[ 50070], 60.00th=[ 57934], | 70.00th=[ 69731], 80.00th=[ 85459], 90.00th=[109577], 95.00th=[132645], | 99.00th=[250610], 99.50th=[258999], 99.90th=[265290], 99.95th=[265290], | 99.99th=[265290] bw ( KiB/s): min= 31, max= 345, per=26.19%, avg=151.36, stdev=76.92, samples=80 iops : min= 1, max= 21, avg= 8.66, stdev= 4.89, samples=80 write: IOPS=9, BW=147KiB/s (151kB/s)(6032KiB/41023msec); 0 zone resets clat (usec): min=1526, max=236264, avg=48259.64, stdev=45792.44 lat (usec): min=1529, max=236267, avg=48262.43, stdev=45792.62 clat percentiles (usec): | 1.00th=[ 1729], 5.00th=[ 2311], 10.00th=[ 4359], 20.00th=[ 8160], | 30.00th=[ 13435], 40.00th=[ 25560], 50.00th=[ 34341], 60.00th=[ 47449], | 70.00th=[ 60556], 80.00th=[ 84411], 90.00th=[113771], 95.00th=[145753], | 99.00th=[191890], 99.50th=[198181], 99.90th=[235930], 99.95th=[235930], | 99.99th=[235930] bw ( KiB/s): min= 31, max= 377, per=23.75%, avg=144.41, stdev=65.30, samples=80 iops : min= 1, max= 23, avg= 8.21, stdev= 4.11, samples=80 lat (usec) : 50=0.78%, 100=4.43%, 250=0.91%, 500=0.13% lat (msec) : 2=1.17%, 4=3.52%, 10=7.29%, 20=6.51%, 50=31.38% lat (msec) : 100=29.69%, 250=13.67%, 500=0.52% cpu : usr=0.06%, sys=4.59%, ctx=1739, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179354: Fri Sep 11 06:26:14 2026 read: IOPS=9, BW=150KiB/s (154kB/s)(6032KiB/40212msec) clat (usec): min=48, max=314671, avg=61316.33, stdev=45077.27 lat (usec): min=50, max=314672, avg=61318.12, stdev=45077.12 clat percentiles (usec): | 1.00th=[ 62], 5.00th=[ 78], 10.00th=[ 1188], 20.00th=[ 30802], | 30.00th=[ 39584], 40.00th=[ 46924], 50.00th=[ 53216], 60.00th=[ 63177], | 70.00th=[ 74974], 80.00th=[ 86508], 90.00th=[110625], 95.00th=[135267], | 99.00th=[254804], 99.50th=[308282], 99.90th=[316670], 99.95th=[316670], | 99.99th=[316670] bw ( KiB/s): min= 31, max= 287, per=25.79%, avg=149.09, stdev=62.21, samples=79 iops : min= 1, max= 17, avg= 8.51, stdev= 3.93, samples=79 write: IOPS=9, BW=156KiB/s (159kB/s)(6256KiB/40212msec); 0 zone resets clat (usec): min=1577, max=256887, avg=43540.96, stdev=44917.55 lat (usec): min=1580, max=256891, avg=43544.66, stdev=44918.29 clat percentiles (usec): | 1.00th=[ 1713], 5.00th=[ 2089], 10.00th=[ 2933], 20.00th=[ 6849], | 30.00th=[ 11600], 40.00th=[ 20055], 50.00th=[ 29754], 60.00th=[ 39584], | 70.00th=[ 52167], 80.00th=[ 72877], 90.00th=[105382], 95.00th=[141558], | 99.00th=[200279], 99.50th=[214959], 99.90th=[256902], 99.95th=[256902], | 99.99th=[256902] bw ( KiB/s): min= 30, max= 411, per=25.93%, avg=157.68, stdev=73.67, samples=78 iops : min= 1, max= 25, avg= 9.06, stdev= 4.65, samples=78 lat (usec) : 50=0.13%, 100=3.26%, 250=1.04%, 500=0.26%, 1000=0.13% lat (msec) : 2=1.95%, 4=5.08%, 10=7.42%, 20=6.90%, 50=30.86% lat (msec) : 100=30.34%, 250=11.98%, 500=0.65% cpu : usr=0.07%, sys=4.46%, ctx=1731, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=578KiB/s (592kB/s), 140KiB/s-152KiB/s (144kB/s-156kB/s), io=23.4MiB (24.5MB), run=40212-41435msec WRITE: bw=608KiB/s (623kB/s), 147KiB/s-160KiB/s (151kB/s-164kB/s), io=24.6MiB (25.8MB), run=40212-41435msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179346: Fri Sep 11 06:26:26 2026 read: IOPS=6, BW=109KiB/s (111kB/s)(5920KiB/54477msec) clat (msec): min=7, max=387, avg=59.11, stdev=52.49 lat (msec): min=7, max=387, avg=59.11, stdev=52.49 clat percentiles (msec): | 1.00th=[ 12], 5.00th=[ 15], 10.00th=[ 19], 20.00th=[ 24], | 30.00th=[ 28], 40.00th=[ 33], 50.00th=[ 39], 60.00th=[ 50], | 70.00th=[ 64], 80.00th=[ 86], 90.00th=[ 127], 95.00th=[ 165], | 99.00th=[ 257], 99.50th=[ 342], 99.90th=[ 388], 99.95th=[ 388], | 99.99th=[ 388] bw ( KiB/s): min= 29, max= 380, per=25.68%, avg=112.47, stdev=76.61, samples=103 iops : min= 1, max= 23, avg= 6.22, stdev= 4.90, samples=103 write: IOPS=7, BW=117KiB/s (120kB/s)(6368KiB/54477msec); 0 zone resets clat (msec): min=16, max=319, avg=81.78, stdev=55.22 lat (msec): min=16, max=319, avg=81.78, stdev=55.22 clat percentiles (msec): | 1.00th=[ 22], 5.00th=[ 28], 10.00th=[ 33], 20.00th=[ 39], | 30.00th=[ 46], 40.00th=[ 53], 50.00th=[ 63], 60.00th=[ 79], | 70.00th=[ 94], 80.00th=[ 118], 90.00th=[ 161], 95.00th=[ 201], | 99.00th=[ 275], 99.50th=[ 317], 99.90th=[ 321], 99.95th=[ 321], | 99.99th=[ 321] bw ( KiB/s): min= 30, max= 288, per=25.76%, avg=118.74, stdev=68.85, samples=105 iops : min= 1, max= 18, avg= 6.62, stdev= 4.40, samples=105 lat (msec) : 10=0.26%, 20=6.38%, 50=41.41%, 100=29.95%, 250=20.44% lat (msec) : 500=1.56% cpu : usr=0.04%, sys=1.51%, ctx=1285, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179347: Fri Sep 11 06:26:26 2026 read: IOPS=6, BW=105KiB/s (108kB/s)(5744KiB/54479msec) clat (msec): min=6, max=251, avg=56.67, stdev=48.77 lat (msec): min=6, max=251, avg=56.68, stdev=48.77 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 15], 10.00th=[ 18], 20.00th=[ 23], | 30.00th=[ 27], 40.00th=[ 32], 50.00th=[ 39], 60.00th=[ 48], | 70.00th=[ 61], 80.00th=[ 81], 90.00th=[ 136], 95.00th=[ 176], | 99.00th=[ 224], 99.50th=[ 239], 99.90th=[ 251], 99.95th=[ 251], | 99.99th=[ 251] bw ( KiB/s): min= 31, max= 348, per=26.14%, avg=114.49, stdev=73.41, samples=98 iops : min= 1, max= 21, avg= 6.36, stdev= 4.71, samples=98 write: IOPS=7, BW=120KiB/s (123kB/s)(6544KiB/54479msec); 0 zone resets clat (msec): min=15, max=511, avg=82.96, stdev=63.52 lat (msec): min=15, max=511, avg=82.96, stdev=63.52 clat percentiles (msec): | 1.00th=[ 22], 5.00th=[ 27], 10.00th=[ 30], 20.00th=[ 36], | 30.00th=[ 43], 40.00th=[ 51], 50.00th=[ 61], 60.00th=[ 75], | 70.00th=[ 94], 80.00th=[ 122], 90.00th=[ 182], 95.00th=[ 211], | 99.00th=[ 296], 99.50th=[ 313], 99.90th=[ 514], 99.95th=[ 514], | 99.99th=[ 514] bw ( KiB/s): min= 29, max= 341, per=26.48%, avg=122.06, stdev=76.25, samples=105 iops : min= 1, max= 21, avg= 6.83, stdev= 4.85, samples=105 lat (msec) : 10=0.52%, 20=7.42%, 50=41.80%, 100=29.17%, 250=19.66% lat (msec) : 500=1.30%, 750=0.13% cpu : usr=0.06%, sys=1.52%, ctx=1192, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179348: Fri Sep 11 06:26:26 2026 read: IOPS=7, BW=115KiB/s (117kB/s)(6256KiB/54613msec) clat (msec): min=9, max=283, avg=58.30, stdev=48.64 lat (msec): min=9, max=283, avg=58.31, stdev=48.64 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 15], 10.00th=[ 17], 20.00th=[ 24], | 30.00th=[ 29], 40.00th=[ 35], 50.00th=[ 43], 60.00th=[ 50], | 70.00th=[ 63], 80.00th=[ 84], 90.00th=[ 129], 95.00th=[ 169], | 99.00th=[ 243], 99.50th=[ 264], 99.90th=[ 284], 99.95th=[ 284], | 99.99th=[ 284] bw ( KiB/s): min= 31, max= 445, per=27.24%, avg=119.29, stdev=85.01, samples=103 iops : min= 1, max= 27, avg= 6.65, stdev= 5.40, samples=103 write: IOPS=6, BW=110KiB/s (113kB/s)(6032KiB/54613msec); 0 zone resets clat (msec): min=13, max=354, avg=83.87, stdev=56.24 lat (msec): min=13, max=354, avg=83.87, stdev=56.24 clat percentiles (msec): | 1.00th=[ 20], 5.00th=[ 27], 10.00th=[ 33], 20.00th=[ 40], | 30.00th=[ 46], 40.00th=[ 54], 50.00th=[ 68], 60.00th=[ 79], | 70.00th=[ 99], 80.00th=[ 124], 90.00th=[ 163], 95.00th=[ 201], | 99.00th=[ 292], 99.50th=[ 321], 99.90th=[ 355], 99.95th=[ 355], | 99.99th=[ 355] bw ( KiB/s): min= 31, max= 317, per=24.11%, avg=111.15, stdev=65.24, samples=105 iops : min= 1, max= 19, avg= 6.14, stdev= 4.15, samples=105 lat (msec) : 10=0.13%, 20=8.85%, 50=39.32%, 100=28.78%, 250=21.74% lat (msec) : 500=1.17% cpu : usr=0.04%, sys=1.51%, ctx=1247, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179349: Fri Sep 11 06:26:26 2026 read: IOPS=6, BW=110KiB/s (113kB/s)(6032KiB/54650msec) clat (msec): min=9, max=341, avg=58.43, stdev=51.07 lat (msec): min=9, max=341, avg=58.43, stdev=51.07 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 16], 10.00th=[ 18], 20.00th=[ 23], | 30.00th=[ 29], 40.00th=[ 33], 50.00th=[ 40], 60.00th=[ 48], | 70.00th=[ 64], 80.00th=[ 86], 90.00th=[ 123], 95.00th=[ 174], | 99.00th=[ 275], 99.50th=[ 300], 99.90th=[ 342], 99.95th=[ 342], | 99.99th=[ 342] bw ( KiB/s): min= 30, max= 382, per=25.58%, avg=112.05, stdev=76.81, samples=104 iops : min= 1, max= 23, avg= 6.19, stdev= 4.89, samples=104 write: IOPS=7, BW=114KiB/s (117kB/s)(6256KiB/54650msec); 0 zone resets clat (msec): min=18, max=517, avg=82.96, stdev=59.10 lat (msec): min=18, max=517, avg=82.98, stdev=59.10 clat percentiles (msec): | 1.00th=[ 23], 5.00th=[ 29], 10.00th=[ 33], 20.00th=[ 40], | 30.00th=[ 45], 40.00th=[ 55], 50.00th=[ 63], 60.00th=[ 78], | 70.00th=[ 93], 80.00th=[ 118], 90.00th=[ 167], 95.00th=[ 199], | 99.00th=[ 271], 99.50th=[ 317], 99.90th=[ 518], 99.95th=[ 518], | 99.99th=[ 518] bw ( KiB/s): min= 31, max= 316, per=25.68%, avg=118.39, stdev=70.01, samples=103 iops : min= 1, max= 19, avg= 6.59, stdev= 4.46, samples=103 lat (msec) : 10=0.52%, 20=7.16%, 50=40.10%, 100=30.86%, 250=20.05% lat (msec) : 500=1.17%, 750=0.13% cpu : usr=0.03%, sys=1.53%, ctx=1214, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=438KiB/s (449kB/s), 105KiB/s-115KiB/s (108kB/s-117kB/s), io=23.4MiB (24.5MB), run=54477-54650msec WRITE: bw=461KiB/s (472kB/s), 110KiB/s-120KiB/s (113kB/s-123kB/s), io=24.6MiB (25.8MB), run=54477-54650msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179373: Fri Sep 11 06:26:41 2026 read: IOPS=1, BW=1582KiB/s (1620kB/s)(7168KiB/4531msec) clat (usec): min=631, max=2325.9k, avg=468274.23, stdev=832352.50 lat (usec): min=632, max=2325.9k, avg=468275.85, stdev=832352.55 clat percentiles (usec): | 1.00th=[ 635], 5.00th=[ 635], 10.00th=[ 635], | 20.00th=[ 62653], 30.00th=[ 77071], 40.00th=[ 77071], | 50.00th=[ 173016], 60.00th=[ 181404], 70.00th=[ 181404], | 80.00th=[ 459277], 90.00th=[2332034], 95.00th=[2332034], | 99.00th=[2332034], 99.50th=[2332034], 99.90th=[2332034], | 99.95th=[2332034], 99.99th=[2332034] bw ( KiB/s): min= 1648, max= 6131, per=64.31%, avg=2906.00, stdev=2156.14, samples=4 iops : min= 1, max= 5, avg= 2.00, stdev= 2.00, samples=4 write: IOPS=1, BW=1130KiB/s (1157kB/s)(5120KiB/4531msec); 0 zone resets clat (msec): min=169, max=308, avg=249.60, stdev=56.31 lat (msec): min=169, max=308, avg=250.30, stdev=56.23 clat percentiles (msec): | 1.00th=[ 169], 5.00th=[ 169], 10.00th=[ 169], 20.00th=[ 169], | 30.00th=[ 230], 40.00th=[ 230], 50.00th=[ 243], 60.00th=[ 243], | 70.00th=[ 296], 80.00th=[ 296], 90.00th=[ 309], 95.00th=[ 309], | 99.00th=[ 309], 99.50th=[ 309], 99.90th=[ 309], 99.95th=[ 309], | 99.99th=[ 309] bw ( KiB/s): min= 2043, max= 4096, per=43.11%, avg=2727.33, stdev=1185.30, samples=3 iops : min= 1, max= 4, avg= 2.00, stdev= 1.73, samples=3 lat (usec) : 750=8.33% lat (msec) : 100=16.67%, 250=41.67%, 500=25.00%, >=2000=8.33% cpu : usr=0.00%, sys=14.55%, ctx=210, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179374: Fri Sep 11 06:26:41 2026 read: IOPS=0, BW=482KiB/s (493kB/s)(2048KiB/4252msec) clat (usec): min=874, max=176807, avg=88840.93, stdev=124403.20 lat (usec): min=876, max=176809, avg=88842.76, stdev=124403.70 clat percentiles (usec): | 1.00th=[ 873], 5.00th=[ 873], 10.00th=[ 873], 20.00th=[ 873], | 30.00th=[ 873], 40.00th=[ 873], 50.00th=[ 873], 60.00th=[177210], | 70.00th=[177210], 80.00th=[177210], 90.00th=[177210], 95.00th=[177210], | 99.00th=[177210], 99.50th=[177210], 99.90th=[177210], 99.95th=[177210], | 99.99th=[177210] bw ( KiB/s): min= 1568, max= 2043, per=39.95%, avg=1805.50, stdev=335.88, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2408KiB/s (2466kB/s)(10.0MiB/4252msec); 0 zone resets clat (msec): min=116, max=1037, avg=407.01, stdev=288.11 lat (msec): min=116, max=1038, avg=407.12, stdev=288.11 clat percentiles (msec): | 1.00th=[ 117], 5.00th=[ 117], 10.00th=[ 117], 20.00th=[ 129], | 30.00th=[ 257], 40.00th=[ 284], 50.00th=[ 288], 60.00th=[ 296], | 70.00th=[ 451], 80.00th=[ 468], 90.00th=[ 751], 95.00th=[ 1036], | 99.00th=[ 1036], 99.50th=[ 1036], 99.90th=[ 1036], 99.95th=[ 1036], | 99.99th=[ 1036] bw ( KiB/s): min= 1802, max= 4087, per=43.19%, avg=2732.60, stdev=1092.78, samples=5 iops : min= 1, max= 3, avg= 2.00, stdev= 1.00, samples=5 lat (usec) : 1000=8.33% lat (msec) : 250=25.00%, 500=50.00%, 750=8.33%, 2000=8.33% cpu : usr=0.00%, sys=17.03%, ctx=138, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179375: Fri Sep 11 06:26:41 2026 read: IOPS=1, BW=1360KiB/s (1393kB/s)(6144KiB/4517msec) clat (usec): min=611, max=256168, avg=114960.14, stdev=126800.98 lat (usec): min=612, max=256171, avg=114961.80, stdev=126801.26 clat percentiles (usec): | 1.00th=[ 611], 5.00th=[ 611], 10.00th=[ 611], 20.00th=[ 807], | 30.00th=[ 807], 40.00th=[ 3720], 50.00th=[ 3720], 60.00th=[181404], | 70.00th=[248513], 80.00th=[248513], 90.00th=[256902], 95.00th=[256902], | 99.00th=[256902], 99.50th=[256902], 99.90th=[256902], 99.95th=[256902], | 99.99th=[256902] bw ( KiB/s): min= 2043, max= 4096, per=75.43%, avg=3408.67, stdev=1182.71, samples=3 iops : min= 1, max= 4, avg= 2.67, stdev= 1.53, samples=3 write: IOPS=1, BW=1360KiB/s (1393kB/s)(6144KiB/4517msec); 0 zone resets clat (msec): min=194, max=1745, avg=635.17, stdev=567.43 lat (msec): min=194, max=1745, avg=635.22, stdev=567.43 clat percentiles (msec): | 1.00th=[ 194], 5.00th=[ 194], 10.00th=[ 194], 20.00th=[ 253], | 30.00th=[ 253], 40.00th=[ 468], 50.00th=[ 468], 60.00th=[ 550], | 70.00th=[ 600], 80.00th=[ 600], 90.00th=[ 1754], 95.00th=[ 1754], | 99.00th=[ 1754], 99.50th=[ 1754], 99.90th=[ 1754], 99.95th=[ 1754], | 99.99th=[ 1754] bw ( KiB/s): min= 1659, max= 2048, per=30.28%, avg=1915.80, stdev=176.72, samples=5 iops : min= 1, max= 2, avg= 1.20, stdev= 0.45, samples=5 lat (usec) : 750=8.33%, 1000=8.33% lat (msec) : 4=8.33%, 250=25.00%, 500=25.00%, 750=16.67%, 2000=8.33% cpu : usr=0.00%, sys=11.29%, ctx=174, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179376: Fri Sep 11 06:26:41 2026 read: IOPS=1, BW=1190KiB/s (1218kB/s)(5120KiB/4304msec) clat (usec): min=661, max=257385, avg=143030.02, stdev=130770.79 lat (usec): min=663, max=257387, avg=143031.63, stdev=130770.68 clat percentiles (usec): | 1.00th=[ 660], 5.00th=[ 660], 10.00th=[ 660], 20.00th=[ 660], | 30.00th=[ 857], 40.00th=[ 857], 50.00th=[214959], 60.00th=[214959], | 70.00th=[242222], 80.00th=[242222], 90.00th=[256902], 95.00th=[256902], | 99.00th=[256902], 99.50th=[256902], 99.90th=[256902], 99.95th=[256902], | 99.99th=[256902] bw ( KiB/s): min= 4055, max= 4087, per=90.09%, avg=4071.00, stdev=22.63, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1665KiB/s (1705kB/s)(7168KiB/4304msec); 0 zone resets clat (msec): min=191, max=906, avg=511.99, stdev=272.25 lat (msec): min=191, max=906, avg=512.07, stdev=272.22 clat percentiles (msec): | 1.00th=[ 192], 5.00th=[ 192], 10.00th=[ 192], 20.00th=[ 275], | 30.00th=[ 426], 40.00th=[ 426], 50.00th=[ 460], 60.00th=[ 468], | 70.00th=[ 468], 80.00th=[ 860], 90.00th=[ 911], 95.00th=[ 911], | 99.00th=[ 911], 99.50th=[ 911], 99.90th=[ 911], 99.95th=[ 911], | 99.99th=[ 911] bw ( KiB/s): min= 1796, max= 3750, per=36.71%, avg=2322.60, stdev=804.44, samples=5 iops : min= 1, max= 3, avg= 1.60, stdev= 0.89, samples=5 lat (usec) : 750=8.33%, 1000=8.33% lat (msec) : 250=25.00%, 500=41.67%, 1000=16.67% cpu : usr=0.00%, sys=12.85%, ctx=195, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4520KiB/s (4628kB/s), 482KiB/s-1582KiB/s (493kB/s-1620kB/s), io=20.0MiB (20.0MB), run=4252-4531msec WRITE: bw=6328KiB/s (6480kB/s), 1130KiB/s-2408KiB/s (1157kB/s-2466kB/s), io=28.0MiB (29.4MB), run=4252-4531msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179368: Fri Sep 11 06:26:42 2026 read: IOPS=1, BW=1999KiB/s (2047kB/s)(7168KiB/3585msec) clat (msec): min=93, max=510, avg=269.72, stdev=150.65 lat (msec): min=93, max=510, avg=269.72, stdev=150.65 clat percentiles (msec): | 1.00th=[ 93], 5.00th=[ 93], 10.00th=[ 93], 20.00th=[ 159], | 30.00th=[ 197], 40.00th=[ 197], 50.00th=[ 207], 60.00th=[ 296], | 70.00th=[ 296], 80.00th=[ 426], 90.00th=[ 510], 95.00th=[ 510], | 99.00th=[ 510], 99.50th=[ 510], 99.90th=[ 510], 99.95th=[ 510], | 99.99th=[ 510] bw ( KiB/s): min= 1980, max= 4112, per=65.55%, avg=2529.75, stdev=1055.05, samples=4 iops : min= 1, max= 4, avg= 1.75, stdev= 1.50, samples=4 write: IOPS=1, BW=1428KiB/s (1462kB/s)(5120KiB/3585msec); 0 zone resets clat (msec): min=171, max=438, avg=321.63, stdev=113.80 lat (msec): min=171, max=438, avg=321.73, stdev=113.79 clat percentiles (msec): | 1.00th=[ 171], 5.00th=[ 171], 10.00th=[ 171], 20.00th=[ 171], | 30.00th=[ 243], 40.00th=[ 243], 50.00th=[ 338], 60.00th=[ 338], | 70.00th=[ 418], 80.00th=[ 418], 90.00th=[ 439], 95.00th=[ 439], | 99.00th=[ 439], 99.50th=[ 439], 99.90th=[ 439], 99.95th=[ 439], | 99.99th=[ 439] bw ( KiB/s): min= 1996, max= 4007, per=49.40%, avg=2668.67, stdev=1159.04, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (msec) : 100=8.33%, 250=41.67%, 500=41.67%, 750=8.33% cpu : usr=0.03%, sys=4.35%, ctx=62, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179369: Fri Sep 11 06:26:42 2026 read: IOPS=0, BW=433KiB/s (443kB/s)(2048KiB/4730msec) clat (msec): min=154, max=173, avg=164.22, stdev=13.79 lat (msec): min=154, max=173, avg=164.22, stdev=13.79 clat percentiles (msec): | 1.00th=[ 155], 5.00th=[ 155], 10.00th=[ 155], 20.00th=[ 155], | 30.00th=[ 155], 40.00th=[ 155], 50.00th=[ 155], 60.00th=[ 174], | 70.00th=[ 174], 80.00th=[ 174], 90.00th=[ 174], 95.00th=[ 174], | 99.00th=[ 174], 99.50th=[ 174], 99.90th=[ 174], 99.95th=[ 174], | 99.99th=[ 174] bw ( KiB/s): min= 1395, max= 2003, per=44.03%, avg=1699.00, stdev=429.92, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2165KiB/s (2217kB/s)(10.0MiB/4730msec); 0 zone resets clat (msec): min=158, max=1184, avg=433.06, stdev=364.81 lat (msec): min=158, max=1184, avg=433.17, stdev=364.80 clat percentiles (msec): | 1.00th=[ 159], 5.00th=[ 159], 10.00th=[ 159], 20.00th=[ 161], | 30.00th=[ 169], 40.00th=[ 186], 50.00th=[ 213], 60.00th=[ 255], | 70.00th=[ 506], 80.00th=[ 567], 90.00th=[ 936], 95.00th=[ 1183], | 99.00th=[ 1183], 99.50th=[ 1183], 99.90th=[ 1183], 99.95th=[ 1183], | 99.99th=[ 1183] bw ( KiB/s): min= 1980, max= 6095, per=52.15%, avg=2817.00, stdev=1636.43, samples=6 iops : min= 1, max= 5, avg= 1.83, stdev= 1.60, samples=6 lat (msec) : 250=58.33%, 500=8.33%, 750=16.67%, 1000=8.33%, 2000=8.33% cpu : usr=0.00%, sys=4.33%, ctx=82, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179370: Fri Sep 11 06:26:42 2026 read: IOPS=1, BW=1158KiB/s (1186kB/s)(6144KiB/5307msec) clat (msec): min=112, max=483, avg=275.59, stdev=159.73 lat (msec): min=112, max=483, avg=275.59, stdev=159.73 clat percentiles (msec): | 1.00th=[ 113], 5.00th=[ 113], 10.00th=[ 113], 20.00th=[ 130], | 30.00th=[ 130], 40.00th=[ 165], 50.00th=[ 165], 60.00th=[ 351], | 70.00th=[ 414], 80.00th=[ 414], 90.00th=[ 485], 95.00th=[ 485], | 99.00th=[ 485], 99.50th=[ 485], 99.90th=[ 485], 99.95th=[ 485], | 99.99th=[ 485] bw ( KiB/s): min= 1980, max= 2031, per=51.89%, avg=2002.60, stdev=18.45, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 write: IOPS=1, BW=1158KiB/s (1186kB/s)(6144KiB/5307msec); 0 zone resets clat (msec): min=149, max=1449, avg=597.52, stdev=523.26 lat (msec): min=149, max=1449, avg=597.62, stdev=523.29 clat percentiles (msec): | 1.00th=[ 150], 5.00th=[ 150], 10.00th=[ 150], 20.00th=[ 209], | 30.00th=[ 209], 40.00th=[ 334], 50.00th=[ 334], 60.00th=[ 414], | 70.00th=[ 1028], 80.00th=[ 1028], 90.00th=[ 1452], 95.00th=[ 1452], | 99.00th=[ 1452], 99.50th=[ 1452], 99.90th=[ 1452], 99.95th=[ 1452], | 99.99th=[ 1452] bw ( KiB/s): min= 1980, max= 2782, per=40.58%, avg=2192.00, stdev=393.48, samples=4 iops : min= 1, max= 2, avg= 1.25, stdev= 0.50, samples=4 lat (msec) : 250=41.67%, 500=41.67%, 2000=16.67% cpu : usr=0.04%, sys=5.47%, ctx=83, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179371: Fri Sep 11 06:26:42 2026 read: IOPS=1, BW=1034KiB/s (1059kB/s)(5120KiB/4952msec) clat (msec): min=96, max=584, avg=405.97, stdev=182.92 lat (msec): min=96, max=584, avg=405.97, stdev=182.92 clat percentiles (msec): | 1.00th=[ 96], 5.00th=[ 96], 10.00th=[ 96], 20.00th=[ 96], | 30.00th=[ 435], 40.00th=[ 435], 50.00th=[ 456], 60.00th=[ 456], | 70.00th=[ 464], 80.00th=[ 464], 90.00th=[ 584], 95.00th=[ 584], | 99.00th=[ 584], 99.50th=[ 584], 99.90th=[ 584], 99.95th=[ 584], | 99.99th=[ 584] bw ( KiB/s): min= 1932, max= 2035, per=51.70%, avg=1995.25, stdev=44.30, samples=4 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=4 write: IOPS=1, BW=1447KiB/s (1482kB/s)(7168KiB/4952msec); 0 zone resets clat (msec): min=132, max=1603, avg=411.18, stdev=527.29 lat (msec): min=132, max=1603, avg=411.52, stdev=527.19 clat percentiles (msec): | 1.00th=[ 133], 5.00th=[ 133], 10.00th=[ 133], 20.00th=[ 197], | 30.00th=[ 211], 40.00th=[ 211], 50.00th=[ 226], 60.00th=[ 249], | 70.00th=[ 249], 80.00th=[ 264], 90.00th=[ 1603], 95.00th=[ 1603], | 99.00th=[ 1603], 99.50th=[ 1603], 99.90th=[ 1603], 99.95th=[ 1603], | 99.99th=[ 1603] bw ( KiB/s): min= 2000, max= 4096, per=65.56%, avg=3541.75, stdev=1028.64, samples=4 iops : min= 1, max= 4, avg= 2.75, stdev= 1.26, samples=4 lat (msec) : 100=8.33%, 250=41.67%, 500=33.33%, 750=8.33%, 2000=8.33% cpu : usr=0.02%, sys=3.19%, ctx=46, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3859KiB/s (3952kB/s), 433KiB/s-1999KiB/s (443kB/s-2047kB/s), io=20.0MiB (20.0MB), run=3585-5307msec WRITE: bw=5403KiB/s (5532kB/s), 1158KiB/s-2165KiB/s (1186kB/s-2217kB/s), io=28.0MiB (29.4MB), run=3585-5307msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179382: Fri Sep 11 06:26:54 2026 read: IOPS=1, BW=5135KiB/s (5258kB/s)(12.0MiB/2393msec) clat (msec): min=302, max=1422, avg=695.34, stdev=630.38 lat (msec): min=303, max=1422, avg=695.60, stdev=630.13 clat percentiles (msec): | 1.00th=[ 305], 5.00th=[ 305], 10.00th=[ 305], 20.00th=[ 305], | 30.00th=[ 305], 40.00th=[ 363], 50.00th=[ 363], 60.00th=[ 363], | 70.00th=[ 1418], 80.00th=[ 1418], 90.00th=[ 1418], 95.00th=[ 1418], | 99.00th=[ 1418], 99.50th=[ 1418], 99.90th=[ 1418], 99.95th=[ 1418], | 99.99th=[ 1418] bw ( KiB/s): min= 6140, max= 8078, per=100.00%, avg=7109.00, stdev=1370.37, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=66.67%, 2000=33.33% cpu : usr=0.00%, sys=6.06%, ctx=85, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179383: Fri Sep 11 06:26:54 2026 read: IOPS=0, BW=1417KiB/s (1451kB/s)(4096KiB/2891msec) clat (nsec): min=541458k, max=541458k, avg=541457502.00, stdev= 0.00 lat (nsec): min=541460k, max=541460k, avg=541459902.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 542], 5.00th=[ 542], 10.00th=[ 542], 20.00th=[ 542], | 30.00th=[ 542], 40.00th=[ 542], 50.00th=[ 542], 60.00th=[ 542], | 70.00th=[ 542], 80.00th=[ 542], 90.00th=[ 542], 95.00th=[ 542], | 99.00th=[ 542], 99.50th=[ 542], 99.90th=[ 542], 99.95th=[ 542], | 99.99th=[ 542] bw ( KiB/s): min= 8078, max= 8078, per=100.00%, avg=8078.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2834KiB/s (2902kB/s)(8192KiB/2891msec); 0 zone resets clat (msec): min=482, max=1570, avg=1026.43, stdev=769.83 lat (msec): min=483, max=1575, avg=1029.34, stdev=772.34 clat percentiles (msec): | 1.00th=[ 481], 5.00th=[ 481], 10.00th=[ 481], 20.00th=[ 481], | 30.00th=[ 481], 40.00th=[ 481], 50.00th=[ 481], 60.00th=[ 1569], | 70.00th=[ 1569], 80.00th=[ 1569], 90.00th=[ 1569], 95.00th=[ 1569], | 99.00th=[ 1569], 99.50th=[ 1569], 99.90th=[ 1569], 99.95th=[ 1569], | 99.99th=[ 1569] bw ( KiB/s): min= 8175, max= 8175, per=93.95%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.00%, sys=4.88%, ctx=66, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179384: Fri Sep 11 06:26:54 2026 write: IOPS=0, BW=3263KiB/s (3341kB/s)(12.0MiB/3766msec); 0 zone resets clat (msec): min=553, max=1936, avg=1146.80, stdev=712.06 lat (msec): min=553, max=1936, avg=1147.65, stdev=711.84 clat percentiles (msec): | 1.00th=[ 550], 5.00th=[ 550], 10.00th=[ 550], 20.00th=[ 550], | 30.00th=[ 550], 40.00th=[ 953], 50.00th=[ 953], 60.00th=[ 953], | 70.00th=[ 1938], 80.00th=[ 1938], 90.00th=[ 1938], 95.00th=[ 1938], | 99.00th=[ 1938], 99.50th=[ 1938], 99.90th=[ 1938], 99.95th=[ 1938], | 99.99th=[ 1938] bw ( KiB/s): min= 8175, max= 8175, per=93.95%, avg=8175.00, stdev= 0.00, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=4.89%, ctx=69, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179385: Fri Sep 11 06:26:54 2026 write: IOPS=1, BW=4259KiB/s (4361kB/s)(12.0MiB/2885msec); 0 zone resets clat (msec): min=377, max=1533, avg=872.17, stdev=595.69 lat (msec): min=379, max=1533, avg=872.91, stdev=595.22 clat percentiles (msec): | 1.00th=[ 380], 5.00th=[ 380], 10.00th=[ 380], 20.00th=[ 380], | 30.00th=[ 380], 40.00th=[ 709], 50.00th=[ 709], 60.00th=[ 709], | 70.00th=[ 1536], 80.00th=[ 1536], 90.00th=[ 1536], 95.00th=[ 1536], | 99.00th=[ 1536], 99.50th=[ 1536], 99.90th=[ 1536], 99.95th=[ 1536], | 99.99th=[ 1536] bw ( KiB/s): min= 8078, max= 8175, per=93.40%, avg=8126.50, stdev=68.59, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.00%, sys=4.85%, ctx=60, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5667KiB/s (5803kB/s), 1417KiB/s-5135KiB/s (1451kB/s-5258kB/s), io=16.0MiB (16.8MB), run=2393-2891msec WRITE: bw=8701KiB/s (8910kB/s), 2834KiB/s-4259KiB/s (2902kB/s-4361kB/s), io=32.0MiB (33.6MB), run=2885-3766msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179387: Fri Sep 11 06:26:55 2026 read: IOPS=1, BW=4315KiB/s (4418kB/s)(12.0MiB/2848msec) clat (msec): min=915, max=969, avg=948.80, stdev=29.00 lat (msec): min=915, max=969, avg=948.80, stdev=29.00 clat percentiles (msec): | 1.00th=[ 919], 5.00th=[ 919], 10.00th=[ 919], 20.00th=[ 919], | 30.00th=[ 919], 40.00th=[ 961], 50.00th=[ 961], 60.00th=[ 961], | 70.00th=[ 969], 80.00th=[ 969], 90.00th=[ 969], 95.00th=[ 969], | 99.00th=[ 969], 99.50th=[ 969], 99.90th=[ 969], 99.95th=[ 969], | 99.99th=[ 969] bw ( KiB/s): min= 7684, max= 8078, per=100.00%, avg=7881.00, stdev=278.60, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=100.00% cpu : usr=0.00%, sys=11.35%, ctx=360, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179388: Fri Sep 11 06:26:55 2026 read: IOPS=0, BW=1126KiB/s (1153kB/s)(4096KiB/3638msec) clat (nsec): min=1119.4M, max=1119.4M, avg=1119398548.00, stdev= 0.00 lat (nsec): min=1119.4M, max=1119.4M, avg=1119400856.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1116], 5.00th=[ 1116], 10.00th=[ 1116], 20.00th=[ 1116], | 30.00th=[ 1116], 40.00th=[ 1116], 50.00th=[ 1116], 60.00th=[ 1116], | 70.00th=[ 1116], 80.00th=[ 1116], 90.00th=[ 1116], 95.00th=[ 1116], | 99.00th=[ 1116], 99.50th=[ 1116], 99.90th=[ 1116], 99.95th=[ 1116], | 99.99th=[ 1116] bw ( KiB/s): min= 8175, max= 8175, per=100.00%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2252KiB/s (2306kB/s)(8192KiB/3638msec); 0 zone resets clat (msec): min=407, max=2107, avg=1257.10, stdev=1202.17 lat (msec): min=407, max=2108, avg=1257.92, stdev=1202.63 clat percentiles (msec): | 1.00th=[ 409], 5.00th=[ 409], 10.00th=[ 409], 20.00th=[ 409], | 30.00th=[ 409], 40.00th=[ 409], 50.00th=[ 409], 60.00th=[ 2106], | 70.00th=[ 2106], 80.00th=[ 2106], 90.00th=[ 2106], 95.00th=[ 2106], | 99.00th=[ 2106], 99.50th=[ 2106], 99.90th=[ 2106], 99.95th=[ 2106], | 99.99th=[ 2106] bw ( KiB/s): min= 8175, max= 8175, per=90.76%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.03%, sys=5.61%, ctx=136, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179389: Fri Sep 11 06:26:55 2026 write: IOPS=0, BW=3436KiB/s (3519kB/s)(12.0MiB/3576msec); 0 zone resets clat (msec): min=465, max=2191, avg=1190.63, stdev=895.25 lat (msec): min=467, max=2191, avg=1191.54, stdev=894.52 clat percentiles (msec): | 1.00th=[ 468], 5.00th=[ 468], 10.00th=[ 468], 20.00th=[ 468], | 30.00th=[ 468], 40.00th=[ 919], 50.00th=[ 919], 60.00th=[ 919], | 70.00th=[ 2198], 80.00th=[ 2198], 90.00th=[ 2198], 95.00th=[ 2198], | 99.00th=[ 2198], 99.50th=[ 2198], 99.90th=[ 2198], 99.95th=[ 2198], | 99.99th=[ 2198] bw ( KiB/s): min= 7684, max= 8143, per=87.86%, avg=7913.50, stdev=324.56, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 1000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=3.89%, ctx=68, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179390: Fri Sep 11 06:26:55 2026 write: IOPS=1, BW=4319KiB/s (4423kB/s)(12.0MiB/2845msec); 0 zone resets clat (msec): min=468, max=1585, avg=947.52, stdev=575.01 lat (msec): min=468, max=1585, avg=947.95, stdev=574.87 clat percentiles (msec): | 1.00th=[ 468], 5.00th=[ 468], 10.00th=[ 468], 20.00th=[ 468], | 30.00th=[ 468], 40.00th=[ 793], 50.00th=[ 793], 60.00th=[ 793], | 70.00th=[ 1586], 80.00th=[ 1586], 90.00th=[ 1586], 95.00th=[ 1586], | 99.00th=[ 1586], 99.50th=[ 1586], 99.90th=[ 1586], 99.95th=[ 1586], | 99.99th=[ 1586] bw ( KiB/s): min= 7684, max= 8078, per=87.50%, avg=7881.00, stdev=278.60, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=3.66%, ctx=31, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4504KiB/s (4612kB/s), 1126KiB/s-4315KiB/s (1153kB/s-4418kB/s), io=16.0MiB (16.8MB), run=2848-3638msec WRITE: bw=9007KiB/s (9223kB/s), 2252KiB/s-4319KiB/s (2306kB/s-4423kB/s), io=32.0MiB (33.6MB), run=2845-3638msec