== sanity test 398b: DIO and buffer IO race ============== 17:41:15 (1787866875) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 4.18148 s, 12.0 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144545: Thu Aug 27 17:43:37 2026 read: IOPS=12, BW=48.6KiB/s (49.7kB/s)(5992KiB/123376msec) clat (usec): min=32, max=389271, avg=37841.74, stdev=33982.78 lat (usec): min=32, max=389273, avg=37851.67, stdev=33975.08 clat percentiles (usec): | 1.00th=[ 40], 5.00th=[ 55], 10.00th=[ 63], 20.00th=[ 15008], | 30.00th=[ 20317], 40.00th=[ 25560], 50.00th=[ 30278], 60.00th=[ 36439], | 70.00th=[ 45876], 80.00th=[ 58459], 90.00th=[ 78119], 95.00th=[ 96994], | 99.00th=[158335], 99.50th=[177210], 99.90th=[383779], 99.95th=[387974], | 99.99th=[387974] bw ( KiB/s): min= 7, max= 141, per=25.52%, avg=48.24, stdev=23.51, samples=242 iops : min= 1, max= 35, avg=11.40, stdev= 5.92, samples=242 write: IOPS=12, BW=51.0KiB/s (52.3kB/s)(6296KiB/123376msec); 0 zone resets clat (usec): min=710, max=371867, avg=42231.00, stdev=46069.70 lat (usec): min=711, max=371869, avg=42233.72, stdev=46070.06 clat percentiles (usec): | 1.00th=[ 988], 5.00th=[ 1106], 10.00th=[ 1221], 20.00th=[ 3392], | 30.00th=[ 7046], 40.00th=[ 17695], 50.00th=[ 29492], 60.00th=[ 42206], | 70.00th=[ 56361], 80.00th=[ 71828], 90.00th=[101188], 95.00th=[129500], | 99.00th=[200279], 99.50th=[246416], 99.90th=[350225], 99.95th=[371196], | 99.99th=[371196] bw ( KiB/s): min= 7, max= 135, per=25.60%, avg=50.68, stdev=22.96, samples=242 iops : min= 1, max= 33, avg=12.02, stdev= 5.80, samples=242 lat (usec) : 50=1.30%, 100=5.21%, 250=0.33%, 500=0.10%, 750=0.10% lat (usec) : 1000=0.55% lat (msec) : 2=7.42%, 4=3.32%, 10=6.48%, 20=11.04%, 50=34.31% lat (msec) : 100=22.33%, 250=7.19%, 500=0.33% cpu : usr=0.08%, sys=5.12%, ctx=6193, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144546: Thu Aug 27 17:43:37 2026 read: IOPS=11, BW=47.7KiB/s (48.8kB/s)(5940KiB/124563msec) clat (usec): min=28, max=517793, avg=39329.12, stdev=34896.40 lat (usec): min=28, max=517796, avg=39330.25, stdev=34896.40 clat percentiles (usec): | 1.00th=[ 44], 5.00th=[ 56], 10.00th=[ 63], 20.00th=[ 15795], | 30.00th=[ 20841], 40.00th=[ 26346], 50.00th=[ 32637], 60.00th=[ 38536], | 70.00th=[ 47449], 80.00th=[ 60556], 90.00th=[ 81265], 95.00th=[ 99091], | 99.00th=[152044], 99.50th=[181404], 99.90th=[278922], 99.95th=[517997], | 99.99th=[517997] bw ( KiB/s): min= 7, max= 109, per=25.25%, avg=47.72, stdev=22.02, samples=243 iops : min= 1, max= 27, avg=11.27, stdev= 5.55, samples=243 write: IOPS=12, BW=50.0KiB/s (52.2kB/s)(6348KiB/124563msec); 0 zone resets clat (usec): min=831, max=543662, avg=41595.13, stdev=45061.21 lat (usec): min=832, max=543663, avg=41598.57, stdev=45062.66 clat percentiles (usec): | 1.00th=[ 1029], 5.00th=[ 1156], 10.00th=[ 1237], 20.00th=[ 3163], | 30.00th=[ 7308], 40.00th=[ 17695], 50.00th=[ 30540], 60.00th=[ 42206], | 70.00th=[ 54264], 80.00th=[ 71828], 90.00th=[101188], 95.00th=[128451], | 99.00th=[185598], 99.50th=[225444], 99.90th=[287310], 99.95th=[541066], | 99.99th=[541066] bw ( KiB/s): min= 7, max= 135, per=25.43%, avg=50.35, stdev=23.40, samples=246 iops : min= 1, max= 33, avg=11.94, stdev= 5.91, samples=246 lat (usec) : 50=0.98%, 100=5.08%, 250=0.36%, 500=0.07%, 750=0.03% lat (usec) : 1000=0.33% lat (msec) : 2=8.14%, 4=3.65%, 10=6.05%, 20=10.61%, 50=33.79% lat (msec) : 100=23.47%, 250=7.19%, 500=0.20%, 750=0.07% cpu : usr=0.07%, sys=5.38%, ctx=6261, majf=0, minf=19 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144547: Thu Aug 27 17:43:37 2026 read: IOPS=12, BW=48.1KiB/s (49.2kB/s)(6028KiB/125398msec) clat (usec): min=20, max=401128, avg=39585.41, stdev=33953.47 lat (usec): min=20, max=401129, avg=39586.81, stdev=33953.36 clat percentiles (usec): | 1.00th=[ 41], 5.00th=[ 57], 10.00th=[ 69], 20.00th=[ 16450], | 30.00th=[ 21627], 40.00th=[ 26608], 50.00th=[ 32113], 60.00th=[ 38011], | 70.00th=[ 47973], 80.00th=[ 59507], 90.00th=[ 81265], 95.00th=[105382], | 99.00th=[145753], 99.50th=[164627], 99.90th=[350225], 99.95th=[400557], | 99.99th=[400557] bw ( KiB/s): min= 7, max= 135, per=25.24%, avg=47.70, stdev=24.75, samples=245 iops : min= 1, max= 33, avg=11.28, stdev= 6.24, samples=245 write: IOPS=12, BW=49.9KiB/s (51.1kB/s)(6260KiB/125398msec); 0 zone resets clat (usec): min=760, max=581377, avg=41917.05, stdev=47293.95 lat (usec): min=761, max=581380, avg=41919.07, stdev=47295.24 clat percentiles (usec): | 1.00th=[ 1029], 5.00th=[ 1123], 10.00th=[ 1237], 20.00th=[ 3294], | 30.00th=[ 8029], 40.00th=[ 17957], 50.00th=[ 27919], 60.00th=[ 39584], | 70.00th=[ 52691], 80.00th=[ 72877], 90.00th=[106431], 95.00th=[127402], | 99.00th=[191890], 99.50th=[223347], 99.90th=[476054], 99.95th=[583009], | 99.99th=[583009] bw ( KiB/s): min= 7, max= 134, per=24.92%, avg=49.34, stdev=22.24, samples=246 iops : min= 1, max= 33, avg=11.68, stdev= 5.61, samples=246 lat (usec) : 50=0.98%, 100=4.49%, 250=0.26%, 500=0.13%, 750=0.10% lat (usec) : 1000=0.29% lat (msec) : 2=7.36%, 4=3.68%, 10=6.02%, 20=10.87%, 50=35.84% lat (msec) : 100=21.55%, 250=8.27%, 500=0.13%, 750=0.03% cpu : usr=0.08%, sys=5.28%, ctx=6245, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144548: Thu Aug 27 17:43:38 2026 read: IOPS=11, BW=47.7KiB/s (48.8kB/s)(6052KiB/126900msec) clat (usec): min=32, max=377055, avg=39052.70, stdev=33981.35 lat (usec): min=32, max=377057, avg=39053.85, stdev=33981.33 clat percentiles (usec): | 1.00th=[ 41], 5.00th=[ 55], 10.00th=[ 64], 20.00th=[ 15270], | 30.00th=[ 20841], 40.00th=[ 26084], 50.00th=[ 31589], 60.00th=[ 38011], | 70.00th=[ 47449], 80.00th=[ 60556], 90.00th=[ 81265], 95.00th=[ 98042], | 99.00th=[147850], 99.50th=[187696], 99.90th=[283116], 99.95th=[375391], | 99.99th=[375391] bw ( KiB/s): min= 7, max= 119, per=25.27%, avg=47.76, stdev=22.91, samples=246 iops : min= 1, max= 29, avg=11.29, stdev= 5.77, samples=246 write: IOPS=12, BW=49.1KiB/s (50.3kB/s)(6236KiB/126900msec); 0 zone resets clat (usec): min=773, max=546285, avg=43394.60, stdev=48430.88 lat (usec): min=774, max=546287, avg=43398.82, stdev=48429.72 clat percentiles (usec): | 1.00th=[ 1020], 5.00th=[ 1139], 10.00th=[ 1303], 20.00th=[ 3752], | 30.00th=[ 9110], 40.00th=[ 19792], 50.00th=[ 30278], 60.00th=[ 42730], | 70.00th=[ 54264], 80.00th=[ 72877], 90.00th=[103285], 95.00th=[129500], | 99.00th=[212861], 99.50th=[256902], 99.90th=[488637], 99.95th=[549454], | 99.99th=[549454] bw ( KiB/s): min= 7, max= 144, per=24.58%, avg=48.66, stdev=23.31, samples=249 iops : min= 1, max= 36, avg=11.51, stdev= 5.93, samples=249 lat (usec) : 50=1.40%, 100=4.56%, 250=0.39%, 500=0.07%, 750=0.07% lat (usec) : 1000=0.39% lat (msec) : 2=6.90%, 4=3.35%, 10=5.70%, 20=11.26%, 50=35.42% lat (msec) : 100=22.59%, 250=7.55%, 500=0.33%, 750=0.03% cpu : usr=0.06%, sys=5.13%, ctx=6238, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=189KiB/s (194kB/s), 47.7KiB/s-48.6KiB/s (48.8kB/s-49.7kB/s), io=23.4MiB (24.6MB), run=123376-126900msec WRITE: bw=198KiB/s (203kB/s), 49.1KiB/s-51.0KiB/s (50.3kB/s-52.3kB/s), io=24.6MiB (25.7MB), run=123376-126900msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144540: Thu Aug 27 17:45:33 2026 read: IOPS=6, BW=24.8KiB/s (25.4kB/s)(5992KiB/241566msec) clat (msec): min=4, max=923, avg=32.89, stdev=44.38 lat (msec): min=4, max=923, avg=32.90, stdev=44.38 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 12], | 30.00th=[ 14], 40.00th=[ 16], 50.00th=[ 19], 60.00th=[ 23], | 70.00th=[ 29], 80.00th=[ 45], 90.00th=[ 79], 95.00th=[ 111], | 99.00th=[ 174], 99.50th=[ 218], 99.90th=[ 409], 99.95th=[ 927], | 99.99th=[ 927] bw ( KiB/s): min= 7, max= 95, per=27.77%, avg=27.21, stdev=18.95, samples=427 iops : min= 1, max= 23, avg= 6.20, stdev= 4.81, samples=427 write: IOPS=6, BW=26.1KiB/s (26.7kB/s)(6296KiB/241566msec); 0 zone resets clat (msec): min=32, max=603, avg=121.81, stdev=67.21 lat (msec): min=32, max=603, avg=121.81, stdev=67.21 clat percentiles (msec): | 1.00th=[ 45], 5.00th=[ 55], 10.00th=[ 63], 20.00th=[ 72], | 30.00th=[ 82], 40.00th=[ 92], 50.00th=[ 104], 60.00th=[ 114], | 70.00th=[ 133], 80.00th=[ 163], 90.00th=[ 207], 95.00th=[ 255], | 99.00th=[ 342], 99.50th=[ 409], 99.90th=[ 575], 99.95th=[ 600], | 99.99th=[ 600] bw ( KiB/s): min= 7, max= 64, per=25.37%, avg=26.13, stdev=12.85, samples=466 iops : min= 1, max= 16, avg= 5.92, stdev= 3.27, samples=466 lat (msec) : 10=7.13%, 20=20.08%, 50=14.68%, 100=28.19%, 250=26.95% lat (msec) : 500=2.77%, 750=0.16%, 1000=0.03% cpu : usr=0.04%, sys=1.17%, ctx=5180, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144541: Thu Aug 27 17:45:33 2026 read: IOPS=6, BW=24.4KiB/s (25.0kB/s)(5940KiB/243245msec) clat (msec): min=4, max=965, avg=31.89, stdev=42.08 lat (msec): min=4, max=965, avg=31.90, stdev=42.08 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 12], | 30.00th=[ 14], 40.00th=[ 16], 50.00th=[ 19], 60.00th=[ 23], | 70.00th=[ 30], 80.00th=[ 44], 90.00th=[ 77], 95.00th=[ 102], | 99.00th=[ 157], 99.50th=[ 188], 99.90th=[ 460], 99.95th=[ 969], | 99.99th=[ 969] bw ( KiB/s): min= 7, max= 96, per=28.07%, avg=27.51, stdev=19.37, samples=418 iops : min= 1, max= 24, avg= 6.28, stdev= 4.90, samples=418 write: IOPS=6, BW=26.1KiB/s (26.7kB/s)(6348KiB/243245msec); 0 zone resets clat (msec): min=30, max=668, avg=123.07, stdev=66.57 lat (msec): min=30, max=668, avg=123.07, stdev=66.57 clat percentiles (msec): | 1.00th=[ 45], 5.00th=[ 57], 10.00th=[ 64], 20.00th=[ 74], | 30.00th=[ 84], 40.00th=[ 93], 50.00th=[ 104], 60.00th=[ 117], | 70.00th=[ 136], 80.00th=[ 161], 90.00th=[ 215], 95.00th=[ 259], | 99.00th=[ 351], 99.50th=[ 401], 99.90th=[ 523], 99.95th=[ 667], | 99.99th=[ 667] bw ( KiB/s): min= 7, max= 63, per=25.20%, avg=25.96, stdev=12.58, samples=473 iops : min= 1, max= 15, avg= 5.88, stdev= 3.21, samples=473 lat (msec) : 10=7.32%, 20=18.98%, 50=14.94%, 100=28.91%, 250=26.76% lat (msec) : 500=2.96%, 750=0.10%, 1000=0.03% cpu : usr=0.05%, sys=1.10%, ctx=5131, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144542: Thu Aug 27 17:45:33 2026 read: IOPS=6, BW=24.8KiB/s (25.4kB/s)(6028KiB/243171msec) clat (msec): min=4, max=450, avg=32.69, stdev=36.19 lat (msec): min=4, max=450, avg=32.70, stdev=36.19 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 12], | 30.00th=[ 14], 40.00th=[ 17], 50.00th=[ 20], 60.00th=[ 24], | 70.00th=[ 31], 80.00th=[ 47], 90.00th=[ 77], 95.00th=[ 105], | 99.00th=[ 165], 99.50th=[ 220], 99.90th=[ 334], 99.95th=[ 451], | 99.99th=[ 451] bw ( KiB/s): min= 7, max= 120, per=27.66%, avg=27.11, stdev=18.75, samples=431 iops : min= 1, max= 30, avg= 6.17, stdev= 4.77, samples=431 write: IOPS=6, BW=25.7KiB/s (26.4kB/s)(6260KiB/243171msec); 0 zone resets clat (msec): min=27, max=1067, avg=123.52, stdev=72.62 lat (msec): min=27, max=1067, avg=123.53, stdev=72.62 clat percentiles (msec): | 1.00th=[ 43], 5.00th=[ 55], 10.00th=[ 63], 20.00th=[ 73], | 30.00th=[ 83], 40.00th=[ 92], 50.00th=[ 104], 60.00th=[ 117], | 70.00th=[ 134], 80.00th=[ 165], 90.00th=[ 209], 95.00th=[ 249], | 99.00th=[ 380], 99.50th=[ 472], 99.90th=[ 667], 99.95th=[ 1070], | 99.99th=[ 1070] bw ( KiB/s): min= 7, max= 56, per=25.06%, avg=25.81, stdev=12.71, samples=469 iops : min= 1, max= 14, avg= 5.85, stdev= 3.24, samples=469 lat (msec) : 10=6.77%, 20=18.52%, 50=16.08%, 100=28.91%, 250=27.02% lat (msec) : 500=2.51%, 750=0.16%, 2000=0.03% cpu : usr=0.05%, sys=1.12%, ctx=5006, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144543: Thu Aug 27 17:45:33 2026 read: IOPS=6, BW=25.1KiB/s (25.7kB/s)(6052KiB/241057msec) clat (msec): min=4, max=382, avg=31.47, stdev=35.89 lat (msec): min=4, max=382, avg=31.48, stdev=35.89 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 12], | 30.00th=[ 13], 40.00th=[ 15], 50.00th=[ 18], 60.00th=[ 22], | 70.00th=[ 28], 80.00th=[ 44], 90.00th=[ 77], 95.00th=[ 105], | 99.00th=[ 153], 99.50th=[ 207], 99.90th=[ 363], 99.95th=[ 384], | 99.99th=[ 384] bw ( KiB/s): min= 7, max= 104, per=28.38%, avg=27.82, stdev=19.04, samples=422 iops : min= 1, max= 26, avg= 6.35, stdev= 4.83, samples=422 write: IOPS=6, BW=25.9KiB/s (26.5kB/s)(6236KiB/241057msec); 0 zone resets clat (msec): min=31, max=1059, avg=123.72, stdev=72.78 lat (msec): min=31, max=1059, avg=123.72, stdev=72.78 clat percentiles (msec): | 1.00th=[ 43], 5.00th=[ 55], 10.00th=[ 62], 20.00th=[ 73], | 30.00th=[ 85], 40.00th=[ 93], 50.00th=[ 104], 60.00th=[ 116], | 70.00th=[ 134], 80.00th=[ 163], 90.00th=[ 213], 95.00th=[ 262], | 99.00th=[ 388], 99.50th=[ 456], 99.90th=[ 600], 99.95th=[ 1062], | 99.99th=[ 1062] bw ( KiB/s): min= 7, max= 63, per=25.02%, avg=25.78, stdev=12.92, samples=468 iops : min= 1, max= 15, avg= 5.84, stdev= 3.30, samples=468 lat (msec) : 10=7.26%, 20=20.35%, 50=14.65%, 100=27.93%, 250=26.63% lat (msec) : 500=2.99%, 750=0.16%, 2000=0.03% cpu : usr=0.05%, sys=1.12%, ctx=5132, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=98.7KiB/s (101kB/s), 24.4KiB/s-25.1KiB/s (25.0kB/s-25.7kB/s), io=23.4MiB (24.6MB), run=241057-243245msec WRITE: bw=103KiB/s (106kB/s), 25.7KiB/s-26.1KiB/s (26.4kB/s-26.7kB/s), io=24.6MiB (25.7MB), run=241057-243245msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144598: Thu Aug 27 17:46:05 2026 read: IOPS=18, BW=292KiB/s (299kB/s)(5920KiB/20252msec) clat (usec): min=32, max=149014, avg=26808.89, stdev=22266.89 lat (usec): min=32, max=149015, avg=26809.81, stdev=22266.92 clat percentiles (usec): | 1.00th=[ 38], 5.00th=[ 52], 10.00th=[ 56], 20.00th=[ 76], | 30.00th=[ 16057], 40.00th=[ 21627], 50.00th=[ 25035], 60.00th=[ 30278], | 70.00th=[ 35914], 80.00th=[ 42206], 90.00th=[ 53216], 95.00th=[ 63177], | 99.00th=[108528], 99.50th=[124257], 99.90th=[149947], 99.95th=[149947], | 99.99th=[149947] bw ( KiB/s): min= 127, max= 702, per=26.49%, avg=289.79, stdev=103.80, samples=39 iops : min= 7, max= 43, avg=17.36, stdev= 6.47, samples=39 write: IOPS=19, BW=314KiB/s (322kB/s)(6368KiB/20252msec); 0 zone resets clat (usec): min=1060, max=372373, avg=25920.41, stdev=33034.07 lat (usec): min=1062, max=372375, avg=25922.33, stdev=33034.79 clat percentiles (usec): | 1.00th=[ 1352], 5.00th=[ 1614], 10.00th=[ 1811], 20.00th=[ 3326], | 30.00th=[ 5538], 40.00th=[ 7963], 50.00th=[ 13435], 60.00th=[ 22414], | 70.00th=[ 33424], 80.00th=[ 43779], 90.00th=[ 64226], 95.00th=[ 78119], | 99.00th=[133694], 99.50th=[196084], 99.90th=[371196], 99.95th=[371196], | 99.99th=[371196] bw ( KiB/s): min= 108, max= 585, per=27.26%, avg=313.77, stdev=116.74, samples=39 iops : min= 6, max= 36, avg=18.79, stdev= 7.28, samples=39 lat (usec) : 50=1.82%, 100=8.72%, 250=0.78%, 500=0.13%, 1000=0.13% lat (msec) : 2=6.51%, 4=6.12%, 10=11.46%, 20=11.46%, 50=38.54% lat (msec) : 100=12.50%, 250=1.69%, 500=0.13% cpu : usr=0.10%, sys=7.11%, ctx=1294, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144599: Thu Aug 27 17:46:05 2026 read: IOPS=16, BW=262KiB/s (269kB/s)(5744KiB/21890msec) clat (usec): min=33, max=137469, avg=30010.11, stdev=25742.68 lat (usec): min=33, max=137470, avg=30011.02, stdev=25742.71 clat percentiles (usec): | 1.00th=[ 40], 5.00th=[ 50], 10.00th=[ 57], 20.00th=[ 87], | 30.00th=[ 16057], 40.00th=[ 23200], 50.00th=[ 27395], 60.00th=[ 31589], | 70.00th=[ 39584], 80.00th=[ 47449], 90.00th=[ 64750], 95.00th=[ 82314], | 99.00th=[109577], 99.50th=[116917], 99.90th=[137364], 99.95th=[137364], | 99.99th=[137364] bw ( KiB/s): min= 54, max= 542, per=24.62%, avg=269.38, stdev=110.46, samples=42 iops : min= 3, max= 33, avg=16.07, stdev= 6.94, samples=42 write: IOPS=18, BW=299KiB/s (306kB/s)(6544KiB/21890msec); 0 zone resets clat (usec): min=1078, max=258543, avg=27087.94, stdev=31273.12 lat (usec): min=1079, max=258545, avg=27102.29, stdev=31268.08 clat percentiles (usec): | 1.00th=[ 1270], 5.00th=[ 1532], 10.00th=[ 1893], 20.00th=[ 3949], | 30.00th=[ 5997], 40.00th=[ 10683], 50.00th=[ 15664], 60.00th=[ 23987], | 70.00th=[ 32637], 80.00th=[ 45876], 90.00th=[ 65274], 95.00th=[ 84411], | 99.00th=[139461], 99.50th=[154141], 99.90th=[258999], 99.95th=[258999], | 99.99th=[258999] bw ( KiB/s): min= 94, max= 730, per=25.97%, avg=298.88, stdev=130.43, samples=43 iops : min= 5, max= 45, avg=17.91, stdev= 8.19, samples=43 lat (usec) : 50=2.34%, 100=7.42%, 250=1.04%, 500=0.13%, 750=0.39% lat (usec) : 1000=0.13% lat (msec) : 2=5.60%, 4=5.34%, 10=9.77%, 20=14.32%, 50=35.29% lat (msec) : 100=15.89%, 250=2.21%, 500=0.13% cpu : usr=0.05%, sys=6.79%, ctx=1355, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144600: Thu Aug 27 17:46:05 2026 read: IOPS=18, BW=297KiB/s (304kB/s)(6256KiB/21058msec) clat (usec): min=38, max=186075, avg=28985.25, stdev=24227.30 lat (usec): min=38, max=186076, avg=28986.20, stdev=24227.28 clat percentiles (usec): | 1.00th=[ 41], 5.00th=[ 55], 10.00th=[ 60], 20.00th=[ 128], | 30.00th=[ 16909], 40.00th=[ 21890], 50.00th=[ 28705], 60.00th=[ 33424], | 70.00th=[ 37487], 80.00th=[ 44303], 90.00th=[ 55837], 95.00th=[ 67634], | 99.00th=[107480], 99.50th=[156238], 99.90th=[185598], 99.95th=[185598], | 99.99th=[185598] bw ( KiB/s): min= 81, max= 478, per=27.32%, avg=298.85, stdev=90.71, samples=41 iops : min= 5, max= 29, avg=17.95, stdev= 5.69, samples=41 write: IOPS=17, BW=286KiB/s (293kB/s)(6032KiB/21058msec); 0 zone resets clat (usec): min=1008, max=204133, avg=25741.31, stdev=27809.10 lat (usec): min=1009, max=204135, avg=25743.48, stdev=27811.05 clat percentiles (usec): | 1.00th=[ 1434], 5.00th=[ 1663], 10.00th=[ 1844], 20.00th=[ 3884], | 30.00th=[ 6063], 40.00th=[ 9765], 50.00th=[ 16581], 60.00th=[ 24511], | 70.00th=[ 32900], 80.00th=[ 43254], 90.00th=[ 62129], 95.00th=[ 78119], | 99.00th=[123208], 99.50th=[160433], 99.90th=[204473], 99.95th=[204473], | 99.99th=[204473] bw ( KiB/s): min= 108, max= 554, per=24.53%, avg=282.32, stdev=105.76, samples=41 iops : min= 6, max= 34, avg=16.85, stdev= 6.63, samples=41 lat (usec) : 50=0.91%, 100=8.72%, 250=0.65%, 500=0.26%, 750=0.13% lat (usec) : 1000=0.13% lat (msec) : 2=5.99%, 4=4.56%, 10=10.29%, 20=13.80%, 50=39.32% lat (msec) : 100=13.54%, 250=1.69% cpu : usr=0.07%, sys=6.95%, ctx=1434, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144601: Thu Aug 27 17:46:05 2026 read: IOPS=19, BW=305KiB/s (312kB/s)(6032KiB/19767msec) clat (usec): min=32, max=139130, avg=26876.94, stdev=22088.25 lat (usec): min=32, max=139132, avg=26905.83, stdev=22180.48 clat percentiles (usec): | 1.00th=[ 42], 5.00th=[ 53], 10.00th=[ 57], 20.00th=[ 97], | 30.00th=[ 15008], 40.00th=[ 20317], 50.00th=[ 24511], 60.00th=[ 30540], | 70.00th=[ 36439], 80.00th=[ 43779], 90.00th=[ 55313], 95.00th=[ 63177], | 99.00th=[ 88605], 99.50th=[133694], 99.90th=[139461], 99.95th=[139461], | 99.99th=[139461] bw ( KiB/s): min= 109, max= 538, per=28.00%, avg=306.32, stdev=103.79, samples=38 iops : min= 6, max= 33, avg=18.39, stdev= 6.54, samples=38 write: IOPS=19, BW=316KiB/s (324kB/s)(6256KiB/19767msec); 0 zone resets clat (usec): min=1251, max=180331, avg=24509.76, stdev=27263.16 lat (usec): min=1252, max=180333, avg=24516.64, stdev=27260.42 clat percentiles (usec): | 1.00th=[ 1467], 5.00th=[ 1680], 10.00th=[ 2024], 20.00th=[ 3589], | 30.00th=[ 5800], 40.00th=[ 9372], 50.00th=[ 13960], 60.00th=[ 21103], | 70.00th=[ 30016], 80.00th=[ 41681], 90.00th=[ 61604], 95.00th=[ 83362], | 99.00th=[120062], 99.50th=[141558], 99.90th=[179307], 99.95th=[179307], | 99.99th=[179307] bw ( KiB/s): min= 159, max= 479, per=27.81%, avg=320.13, stdev=90.28, samples=38 iops : min= 9, max= 29, avg=19.26, stdev= 5.65, samples=38 lat (usec) : 50=1.17%, 100=8.98%, 250=1.04%, 500=0.13% lat (msec) : 2=5.08%, 4=6.51%, 10=11.07%, 20=14.45%, 50=36.46% lat (msec) : 100=13.80%, 250=1.30% cpu : usr=0.12%, sys=7.30%, ctx=1357, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1094KiB/s (1120kB/s), 262KiB/s-305KiB/s (269kB/s-312kB/s), io=23.4MiB (24.5MB), run=19767-21890msec WRITE: bw=1151KiB/s (1179kB/s), 286KiB/s-316KiB/s (293kB/s-324kB/s), io=24.6MiB (25.8MB), run=19767-21890msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144593: Thu Aug 27 17:46:37 2026 read: IOPS=6, BW=107KiB/s (110kB/s)(5920KiB/55234msec) clat (msec): min=6, max=244, avg=30.66, stdev=29.32 lat (msec): min=6, max=244, avg=30.66, stdev=29.32 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 13], | 30.00th=[ 15], 40.00th=[ 18], 50.00th=[ 21], 60.00th=[ 25], | 70.00th=[ 31], 80.00th=[ 41], 90.00th=[ 68], 95.00th=[ 84], | 99.00th=[ 136], 99.50th=[ 226], 99.90th=[ 245], 99.95th=[ 245], | 99.99th=[ 245] bw ( KiB/s): min= 31, max= 380, per=25.78%, avg=111.64, stdev=66.31, samples=104 iops : min= 1, max= 23, avg= 6.26, stdev= 4.21, samples=104 write: IOPS=7, BW=115KiB/s (118kB/s)(6368KiB/55234msec); 0 zone resets clat (msec): min=38, max=339, avg=109.71, stdev=45.20 lat (msec): min=38, max=339, avg=109.71, stdev=45.20 clat percentiles (msec): | 1.00th=[ 47], 5.00th=[ 56], 10.00th=[ 62], 20.00th=[ 73], | 30.00th=[ 83], 40.00th=[ 92], 50.00th=[ 102], 60.00th=[ 110], | 70.00th=[ 122], 80.00th=[ 144], 90.00th=[ 167], 95.00th=[ 201], | 99.00th=[ 259], 99.50th=[ 271], 99.90th=[ 338], 99.95th=[ 338], | 99.99th=[ 338] bw ( KiB/s): min= 31, max= 223, per=25.51%, avg=116.31, stdev=44.15, samples=108 iops : min= 1, max= 13, avg= 6.54, stdev= 2.87, samples=108 lat (msec) : 10=4.69%, 20=18.62%, 50=18.10%, 100=30.34%, 250=27.60% lat (msec) : 500=0.65% cpu : usr=0.04%, sys=1.45%, ctx=1376, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144594: Thu Aug 27 17:46:37 2026 read: IOPS=6, BW=104KiB/s (106kB/s)(5744KiB/55252msec) clat (msec): min=6, max=264, avg=30.90, stdev=31.40 lat (msec): min=6, max=264, avg=30.90, stdev=31.40 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 10], 10.00th=[ 11], 20.00th=[ 13], | 30.00th=[ 15], 40.00th=[ 18], 50.00th=[ 20], 60.00th=[ 23], | 70.00th=[ 28], 80.00th=[ 42], 90.00th=[ 69], 95.00th=[ 92], | 99.00th=[ 163], 99.50th=[ 194], 99.90th=[ 266], 99.95th=[ 266], | 99.99th=[ 266] bw ( KiB/s): min= 22, max= 351, per=25.84%, avg=111.88, stdev=73.25, samples=101 iops : min= 1, max= 21, avg= 6.26, stdev= 4.62, samples=101 write: IOPS=7, BW=118KiB/s (121kB/s)(6544KiB/55252msec); 0 zone resets clat (msec): min=38, max=295, avg=107.32, stdev=47.06 lat (msec): min=38, max=295, avg=107.33, stdev=47.06 clat percentiles (msec): | 1.00th=[ 45], 5.00th=[ 52], 10.00th=[ 59], 20.00th=[ 72], | 30.00th=[ 80], 40.00th=[ 87], 50.00th=[ 96], 60.00th=[ 105], | 70.00th=[ 117], 80.00th=[ 140], 90.00th=[ 178], 95.00th=[ 209], | 99.00th=[ 255], 99.50th=[ 292], 99.90th=[ 296], 99.95th=[ 296], | 99.99th=[ 296] bw ( KiB/s): min= 31, max= 222, per=26.14%, avg=119.19, stdev=45.77, samples=108 iops : min= 1, max= 13, avg= 6.72, stdev= 2.99, samples=108 lat (msec) : 10=3.39%, 20=20.70%, 50=16.93%, 100=33.20%, 250=25.00% lat (msec) : 500=0.78% cpu : usr=0.05%, sys=1.45%, ctx=1286, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144595: Thu Aug 27 17:46:37 2026 read: IOPS=7, BW=118KiB/s (121kB/s)(6256KiB/52842msec) clat (msec): min=6, max=257, avg=27.45, stdev=24.30 lat (msec): min=6, max=257, avg=27.45, stdev=24.30 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 13], | 30.00th=[ 15], 40.00th=[ 17], 50.00th=[ 21], 60.00th=[ 24], | 70.00th=[ 27], 80.00th=[ 35], 90.00th=[ 60], 95.00th=[ 80], | 99.00th=[ 112], 99.50th=[ 136], 99.90th=[ 257], 99.95th=[ 257], | 99.99th=[ 257] bw ( KiB/s): min= 31, max= 383, per=28.62%, avg=123.91, stdev=81.79, samples=100 iops : min= 1, max= 23, avg= 7.02, stdev= 5.19, samples=100 write: IOPS=7, BW=114KiB/s (117kB/s)(6032KiB/52842msec); 0 zone resets clat (msec): min=37, max=341, avg=111.49, stdev=48.65 lat (msec): min=37, max=341, avg=111.49, stdev=48.65 clat percentiles (msec): | 1.00th=[ 44], 5.00th=[ 54], 10.00th=[ 61], 20.00th=[ 71], | 30.00th=[ 82], 40.00th=[ 89], 50.00th=[ 101], 60.00th=[ 115], | 70.00th=[ 129], 80.00th=[ 146], 90.00th=[ 174], 95.00th=[ 207], | 99.00th=[ 264], 99.50th=[ 334], 99.90th=[ 342], 99.95th=[ 342], | 99.99th=[ 342] bw ( KiB/s): min= 31, max= 256, per=25.17%, avg=114.80, stdev=42.95, samples=103 iops : min= 1, max= 16, avg= 6.45, stdev= 2.80, samples=103 lat (msec) : 10=4.56%, 20=20.44%, 50=20.96%, 100=28.39%, 250=24.74% lat (msec) : 500=0.91% cpu : usr=0.04%, sys=1.43%, ctx=1335, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144596: Thu Aug 27 17:46:37 2026 read: IOPS=6, BW=110KiB/s (113kB/s)(6032KiB/54813msec) clat (msec): min=5, max=270, avg=29.44, stdev=30.90 lat (msec): min=5, max=270, avg=29.44, stdev=30.90 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 10], 20.00th=[ 13], | 30.00th=[ 15], 40.00th=[ 17], 50.00th=[ 19], 60.00th=[ 22], | 70.00th=[ 28], 80.00th=[ 34], 90.00th=[ 64], 95.00th=[ 95], | 99.00th=[ 161], 99.50th=[ 192], 99.90th=[ 271], 99.95th=[ 271], | 99.99th=[ 271] bw ( KiB/s): min= 31, max= 350, per=27.57%, avg=119.37, stdev=72.51, samples=99 iops : min= 1, max= 21, avg= 6.72, stdev= 4.65, samples=99 write: IOPS=7, BW=114KiB/s (117kB/s)(6256KiB/54813msec); 0 zone resets clat (msec): min=40, max=319, avg=111.39, stdev=46.53 lat (msec): min=40, max=319, avg=111.39, stdev=46.53 clat percentiles (msec): | 1.00th=[ 51], 5.00th=[ 57], 10.00th=[ 64], 20.00th=[ 72], | 30.00th=[ 83], 40.00th=[ 94], 50.00th=[ 106], 60.00th=[ 114], | 70.00th=[ 125], 80.00th=[ 138], 90.00th=[ 171], 95.00th=[ 213], | 99.00th=[ 288], 99.50th=[ 305], 99.90th=[ 321], 99.95th=[ 321], | 99.99th=[ 321] bw ( KiB/s): min= 31, max= 192, per=25.18%, avg=114.83, stdev=41.95, samples=107 iops : min= 1, max= 12, avg= 6.44, stdev= 2.71, samples=107 lat (msec) : 10=5.73%, 20=20.18%, 50=16.93%, 100=27.86%, 250=28.65% lat (msec) : 500=0.65% cpu : usr=0.05%, sys=1.37%, ctx=1266, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=434KiB/s (444kB/s), 104KiB/s-118KiB/s (106kB/s-121kB/s), io=23.4MiB (24.5MB), run=52842-55252msec WRITE: bw=456KiB/s (467kB/s), 114KiB/s-118KiB/s (117kB/s-121kB/s), io=24.6MiB (25.8MB), run=52842-55252msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144625: Thu Aug 27 17:46:53 2026 read: IOPS=2, BW=2305KiB/s (2360kB/s)(7168KiB/3110msec) clat (usec): min=544, max=646170, avg=260896.97, stdev=197070.35 lat (usec): min=545, max=646171, avg=260898.55, stdev=197070.40 clat percentiles (usec): | 1.00th=[ 545], 5.00th=[ 545], 10.00th=[ 545], 20.00th=[156238], | 30.00th=[217056], 40.00th=[217056], 50.00th=[235930], 60.00th=[254804], | 70.00th=[254804], 80.00th=[316670], 90.00th=[650118], 95.00th=[650118], | 99.00th=[650118], 99.50th=[650118], 99.90th=[650118], 99.95th=[650118], | 99.99th=[650118] bw ( KiB/s): min= 1365, max= 4023, per=52.94%, avg=2325.25, stdev=1166.29, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 write: IOPS=1, BW=1646KiB/s (1686kB/s)(5120KiB/3110msec); 0 zone resets clat (msec): min=190, max=326, avg=249.12, stdev=54.22 lat (msec): min=190, max=326, avg=249.20, stdev=54.21 clat percentiles (msec): | 1.00th=[ 190], 5.00th=[ 190], 10.00th=[ 190], 20.00th=[ 190], | 30.00th=[ 207], 40.00th=[ 207], 50.00th=[ 255], 60.00th=[ 255], | 70.00th=[ 271], 80.00th=[ 271], 90.00th=[ 326], 95.00th=[ 326], | 99.00th=[ 326], 99.50th=[ 326], 99.90th=[ 326], 99.95th=[ 326], | 99.99th=[ 326] bw ( KiB/s): min= 1910, max= 4087, per=43.37%, avg=2666.67, stdev=1230.92, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (usec) : 750=8.33% lat (msec) : 250=41.67%, 500=41.67%, 750=8.33% cpu : usr=0.06%, sys=12.99%, ctx=335, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144626: Thu Aug 27 17:46:53 2026 read: IOPS=0, BW=439KiB/s (450kB/s)(2048KiB/4663msec) clat (msec): min=146, max=255, avg=201.12, stdev=77.50 lat (msec): min=146, max=255, avg=201.12, stdev=77.50 clat percentiles (msec): | 1.00th=[ 146], 5.00th=[ 146], 10.00th=[ 146], 20.00th=[ 146], | 30.00th=[ 146], 40.00th=[ 146], 50.00th=[ 146], 60.00th=[ 257], | 70.00th=[ 257], 80.00th=[ 257], 90.00th=[ 257], 95.00th=[ 257], | 99.00th=[ 257], 99.50th=[ 257], 99.90th=[ 257], 99.95th=[ 257], | 99.99th=[ 257] bw ( KiB/s): min= 1378, max= 1954, per=37.93%, avg=1666.00, stdev=407.29, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2196KiB/s (2249kB/s)(10.0MiB/4663msec); 0 zone resets clat (msec): min=163, max=1133, avg=410.87, stdev=295.53 lat (msec): min=163, max=1133, avg=410.95, stdev=295.53 clat percentiles (msec): | 1.00th=[ 165], 5.00th=[ 165], 10.00th=[ 165], 20.00th=[ 192], | 30.00th=[ 207], 40.00th=[ 230], 50.00th=[ 236], 60.00th=[ 409], | 70.00th=[ 447], 80.00th=[ 477], 90.00th=[ 617], 95.00th=[ 1133], | 99.00th=[ 1133], 99.50th=[ 1133], 99.90th=[ 1133], 99.95th=[ 1133], | 99.99th=[ 1133] bw ( KiB/s): min= 2003, max= 4087, per=51.95%, avg=3193.60, stdev=1084.26, samples=5 iops : min= 1, max= 3, avg= 2.20, stdev= 1.10, samples=5 lat (msec) : 250=50.00%, 500=33.33%, 750=8.33%, 2000=8.33% cpu : usr=0.00%, sys=11.63%, ctx=159, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144627: Thu Aug 27 17:46:53 2026 read: IOPS=1, BW=1528KiB/s (1565kB/s)(6144KiB/4021msec) clat (usec): min=1230, max=297610, avg=174941.13, stdev=136838.92 lat (usec): min=1232, max=297612, avg=174942.57, stdev=136838.86 clat percentiles (usec): | 1.00th=[ 1237], 5.00th=[ 1237], 10.00th=[ 1237], 20.00th=[ 6587], | 30.00th=[ 6587], 40.00th=[196084], 50.00th=[196084], 60.00th=[270533], | 70.00th=[278922], 80.00th=[278922], 90.00th=[295699], 95.00th=[295699], | 99.00th=[295699], 99.50th=[295699], 99.90th=[295699], 99.95th=[295699], | 99.99th=[295699] bw ( KiB/s): min= 1954, max= 6011, per=75.96%, avg=3336.00, stdev=2317.05, samples=3 iops : min= 1, max= 5, avg= 2.33, stdev= 2.31, samples=3 write: IOPS=1, BW=1528KiB/s (1565kB/s)(6144KiB/4021msec); 0 zone resets clat (msec): min=133, max=888, avg=458.95, stdev=329.05 lat (msec): min=133, max=888, avg=459.05, stdev=329.08 clat percentiles (msec): | 1.00th=[ 134], 5.00th=[ 134], 10.00th=[ 134], 20.00th=[ 253], | 30.00th=[ 253], 40.00th=[ 279], 50.00th=[ 279], 60.00th=[ 342], | 70.00th=[ 860], 80.00th=[ 860], 90.00th=[ 885], 95.00th=[ 885], | 99.00th=[ 885], 99.50th=[ 885], 99.90th=[ 885], 99.95th=[ 885], | 99.99th=[ 885] bw ( KiB/s): min= 1910, max= 2723, per=34.80%, avg=2139.60, stdev=330.00, samples=5 iops : min= 1, max= 2, avg= 1.20, stdev= 0.45, samples=5 lat (msec) : 2=8.33%, 10=8.33%, 250=16.67%, 500=50.00%, 1000=16.67% cpu : usr=0.00%, sys=11.32%, ctx=149, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144628: Thu Aug 27 17:46:53 2026 read: IOPS=1, BW=1443KiB/s (1478kB/s)(5120KiB/3547msec) clat (usec): min=406, max=285558, avg=143491.51, stdev=133385.07 lat (usec): min=407, max=285559, avg=143492.51, stdev=133385.00 clat percentiles (usec): | 1.00th=[ 408], 5.00th=[ 408], 10.00th=[ 408], 20.00th=[ 408], | 30.00th=[ 1696], 40.00th=[ 1696], 50.00th=[204473], 60.00th=[204473], | 70.00th=[225444], 80.00th=[225444], 90.00th=[287310], 95.00th=[287310], | 99.00th=[287310], 99.50th=[287310], 99.90th=[287310], 99.95th=[287310], | 99.99th=[287310] bw ( KiB/s): min= 4023, max= 4087, per=92.33%, avg=4055.00, stdev=45.25, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 write: IOPS=1, BW=2021KiB/s (2069kB/s)(7168KiB/3547msec); 0 zone resets clat (msec): min=101, max=818, avg=374.64, stdev=306.53 lat (msec): min=101, max=818, avg=374.72, stdev=306.53 clat percentiles (msec): | 1.00th=[ 102], 5.00th=[ 102], 10.00th=[ 102], 20.00th=[ 124], | 30.00th=[ 150], 40.00th=[ 150], 50.00th=[ 264], 60.00th=[ 384], | 70.00th=[ 384], 80.00th=[ 785], 90.00th=[ 818], 95.00th=[ 818], | 99.00th=[ 818], 99.50th=[ 818], 99.90th=[ 818], 99.95th=[ 818], | 99.99th=[ 818] bw ( KiB/s): min= 1980, max= 4087, per=49.16%, avg=3022.50, stdev=1192.54, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 1.15, samples=4 lat (usec) : 500=8.33% lat (msec) : 2=8.33%, 250=41.67%, 500=25.00%, 1000=16.67% cpu : usr=0.00%, sys=10.91%, ctx=101, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4392KiB/s (4497kB/s), 439KiB/s-2305KiB/s (450kB/s-2360kB/s), io=20.0MiB (20.0MB), run=3110-4663msec WRITE: bw=6149KiB/s (6296kB/s), 1528KiB/s-2196KiB/s (1565kB/s-2249kB/s), io=28.0MiB (29.4MB), run=3110-4663msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144630: Thu Aug 27 17:46:53 2026 read: IOPS=1, BW=1693KiB/s (1734kB/s)(7168KiB/4234msec) clat (msec): min=83, max=646, avg=292.20, stdev=227.10 lat (msec): min=83, max=646, avg=292.20, stdev=227.10 clat percentiles (msec): | 1.00th=[ 84], 5.00th=[ 84], 10.00th=[ 84], 20.00th=[ 140], | 30.00th=[ 157], 40.00th=[ 157], 50.00th=[ 201], 60.00th=[ 236], | 70.00th=[ 236], 80.00th=[ 584], 90.00th=[ 651], 95.00th=[ 651], | 99.00th=[ 651], 99.50th=[ 651], 99.90th=[ 651], 99.95th=[ 651], | 99.99th=[ 651] bw ( KiB/s): min= 1988, max= 2048, per=48.64%, avg=2018.00, stdev=22.43, samples=6 iops : min= 1, max= 2, avg= 1.17, stdev= 0.41, samples=6 write: IOPS=1, BW=1209KiB/s (1238kB/s)(5120KiB/4234msec); 0 zone resets clat (msec): min=292, max=757, avg=421.34, stdev=192.37 lat (msec): min=292, max=757, avg=421.53, stdev=192.29 clat percentiles (msec): | 1.00th=[ 292], 5.00th=[ 292], 10.00th=[ 292], 20.00th=[ 292], | 30.00th=[ 317], 40.00th=[ 317], 50.00th=[ 334], 60.00th=[ 334], | 70.00th=[ 405], 80.00th=[ 405], 90.00th=[ 760], 95.00th=[ 760], | 99.00th=[ 760], 99.50th=[ 760], 99.90th=[ 760], 99.95th=[ 760], | 99.99th=[ 760] bw ( KiB/s): min= 1996, max= 2039, per=34.83%, avg=2023.25, stdev=20.47, samples=4 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=4 lat (msec) : 100=8.33%, 250=33.33%, 500=33.33%, 750=16.67%, 1000=8.33% cpu : usr=0.00%, sys=3.80%, ctx=65, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144631: Thu Aug 27 17:46:53 2026 read: IOPS=0, BW=415KiB/s (425kB/s)(2048KiB/4935msec) clat (msec): min=242, max=319, avg=280.95, stdev=54.88 lat (msec): min=242, max=319, avg=280.95, stdev=54.88 clat percentiles (msec): | 1.00th=[ 243], 5.00th=[ 243], 10.00th=[ 243], 20.00th=[ 243], | 30.00th=[ 243], 40.00th=[ 243], 50.00th=[ 243], 60.00th=[ 321], | 70.00th=[ 321], 80.00th=[ 321], 90.00th=[ 321], 95.00th=[ 321], | 99.00th=[ 321], 99.50th=[ 321], 99.90th=[ 321], 99.95th=[ 321], | 99.99th=[ 321] bw ( KiB/s): min= 1367, max= 2048, per=41.15%, avg=1707.50, stdev=481.54, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 write: IOPS=2, BW=2075KiB/s (2125kB/s)(10.0MiB/4935msec); 0 zone resets clat (msec): min=143, max=1426, avg=404.89, stdev=399.63 lat (msec): min=145, max=1426, avg=405.18, stdev=399.52 clat percentiles (msec): | 1.00th=[ 144], 5.00th=[ 144], 10.00th=[ 144], 20.00th=[ 153], | 30.00th=[ 163], 40.00th=[ 220], 50.00th=[ 232], 60.00th=[ 243], | 70.00th=[ 351], 80.00th=[ 388], 90.00th=[ 735], 95.00th=[ 1435], | 99.00th=[ 1435], 99.50th=[ 1435], 99.90th=[ 1435], 99.95th=[ 1435], | 99.99th=[ 1435] bw ( KiB/s): min= 2043, max= 6059, per=62.68%, avg=3640.80, stdev=1676.03, samples=5 iops : min= 1, max= 5, avg= 2.80, stdev= 1.48, samples=5 lat (msec) : 250=58.33%, 500=25.00%, 750=8.33%, 2000=8.33% cpu : usr=0.02%, sys=4.22%, ctx=85, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144632: Thu Aug 27 17:46:53 2026 read: IOPS=1, BW=1409KiB/s (1442kB/s)(6144KiB/4362msec) clat (msec): min=88, max=368, avg=155.69, stdev=106.00 lat (msec): min=88, max=368, avg=155.69, stdev=106.00 clat percentiles (msec): | 1.00th=[ 89], 5.00th=[ 89], 10.00th=[ 89], 20.00th=[ 101], | 30.00th=[ 101], 40.00th=[ 106], 50.00th=[ 106], 60.00th=[ 128], | 70.00th=[ 144], 80.00th=[ 144], 90.00th=[ 368], 95.00th=[ 368], | 99.00th=[ 368], 99.50th=[ 368], 99.90th=[ 368], 99.95th=[ 368], | 99.99th=[ 368] bw ( KiB/s): min= 2048, max= 4015, per=80.78%, avg=3351.67, stdev=1129.07, samples=3 iops : min= 2, max= 3, avg= 2.67, stdev= 0.58, samples=3 write: IOPS=1, BW=1409KiB/s (1442kB/s)(6144KiB/4362msec); 0 zone resets clat (msec): min=191, max=1269, avg=517.90, stdev=398.46 lat (msec): min=191, max=1270, avg=518.09, stdev=398.44 clat percentiles (msec): | 1.00th=[ 192], 5.00th=[ 192], 10.00th=[ 192], 20.00th=[ 262], | 30.00th=[ 262], 40.00th=[ 317], 50.00th=[ 317], 60.00th=[ 447], | 70.00th=[ 617], 80.00th=[ 617], 90.00th=[ 1267], 95.00th=[ 1267], | 99.00th=[ 1267], 99.50th=[ 1267], 99.90th=[ 1267], 99.95th=[ 1267], | 99.99th=[ 1267] bw ( KiB/s): min= 2019, max= 4096, per=52.74%, avg=3063.50, stdev=1192.27, samples=4 iops : min= 1, max= 4, avg= 2.50, stdev= 1.73, samples=4 lat (msec) : 100=8.33%, 250=41.67%, 500=33.33%, 750=8.33%, 2000=8.33% cpu : usr=0.02%, sys=3.94%, ctx=97, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144633: Thu Aug 27 17:46:53 2026 read: IOPS=1, BW=1073KiB/s (1099kB/s)(5120KiB/4771msec) clat (msec): min=85, max=218, avg=130.76, stdev=52.18 lat (msec): min=85, max=218, avg=130.76, stdev=52.18 clat percentiles (msec): | 1.00th=[ 86], 5.00th=[ 86], 10.00th=[ 86], 20.00th=[ 86], | 30.00th=[ 101], 40.00th=[ 101], 50.00th=[ 118], 60.00th=[ 118], | 70.00th=[ 132], 80.00th=[ 132], 90.00th=[ 220], 95.00th=[ 220], | 99.00th=[ 220], 99.50th=[ 220], 99.90th=[ 220], 99.95th=[ 220], | 99.99th=[ 220] bw ( KiB/s): min= 3992, max= 4079, per=97.26%, avg=4035.50, stdev=61.52, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1502KiB/s (1538kB/s)(7168KiB/4771msec); 0 zone resets clat (msec): min=194, max=1147, avg=549.27, stdev=311.78 lat (msec): min=194, max=1147, avg=549.38, stdev=311.76 clat percentiles (msec): | 1.00th=[ 194], 5.00th=[ 194], 10.00th=[ 194], 20.00th=[ 317], | 30.00th=[ 397], 40.00th=[ 397], 50.00th=[ 502], 60.00th=[ 642], | 70.00th=[ 642], 80.00th=[ 651], 90.00th=[ 1150], 95.00th=[ 1150], | 99.00th=[ 1150], 99.50th=[ 1150], 99.90th=[ 1150], 99.95th=[ 1150], | 99.99th=[ 1150] bw ( KiB/s): min= 1996, max= 2048, per=34.89%, avg=2026.83, stdev=21.48, samples=6 iops : min= 1, max= 2, avg= 1.33, stdev= 0.52, samples=6 lat (msec) : 100=8.33%, 250=41.67%, 500=16.67%, 750=25.00%, 2000=8.33% cpu : usr=0.00%, sys=4.07%, ctx=105, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4150KiB/s (4250kB/s), 415KiB/s-1693KiB/s (425kB/s-1734kB/s), io=20.0MiB (20.0MB), run=4234-4935msec WRITE: bw=5810KiB/s (5949kB/s), 1209KiB/s-2075KiB/s (1238kB/s-2125kB/s), io=28.0MiB (29.4MB), run=4234-4935msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144640: Thu Aug 27 17:47:08 2026 read: IOPS=1, BW=4699KiB/s (4812kB/s)(12.0MiB/2615msec) clat (msec): min=833, max=880, avg=858.15, stdev=23.74 lat (msec): min=833, max=880, avg=858.15, stdev=23.74 clat percentiles (msec): | 1.00th=[ 835], 5.00th=[ 835], 10.00th=[ 835], 20.00th=[ 835], | 30.00th=[ 835], 40.00th=[ 860], 50.00th=[ 860], 60.00th=[ 860], | 70.00th=[ 877], 80.00th=[ 877], 90.00th=[ 877], 95.00th=[ 877], | 99.00th=[ 877], 99.50th=[ 877], 99.90th=[ 877], 99.95th=[ 877], | 99.99th=[ 877] bw ( KiB/s): min= 7801, max= 8126, per=100.00%, avg=7963.50, stdev=229.81, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=100.00% cpu : usr=0.00%, sys=3.29%, ctx=43, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144641: Thu Aug 27 17:47:08 2026 read: IOPS=0, BW=1644KiB/s (1684kB/s)(4096KiB/2491msec) clat (nsec): min=248369k, max=248369k, avg=248368654.00, stdev= 0.00 lat (nsec): min=248371k, max=248371k, avg=248371314.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 249], 5.00th=[ 249], 10.00th=[ 249], 20.00th=[ 249], | 30.00th=[ 249], 40.00th=[ 249], 50.00th=[ 249], 60.00th=[ 249], | 70.00th=[ 249], 80.00th=[ 249], 90.00th=[ 249], 95.00th=[ 249], | 99.00th=[ 249], 99.50th=[ 249], 99.90th=[ 249], 99.95th=[ 249], | 99.99th=[ 249] bw ( KiB/s): min= 7474, max= 7474, per=100.00%, avg=7474.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=3289KiB/s (3368kB/s)(8192KiB/2491msec); 0 zone resets clat (msec): min=869, max=1303, avg=1086.36, stdev=307.30 lat (msec): min=869, max=1303, avg=1086.89, stdev=306.77 clat percentiles (msec): | 1.00th=[ 869], 5.00th=[ 869], 10.00th=[ 869], 20.00th=[ 869], | 30.00th=[ 869], 40.00th=[ 869], 50.00th=[ 869], 60.00th=[ 1301], | 70.00th=[ 1301], 80.00th=[ 1301], 90.00th=[ 1301], 95.00th=[ 1301], | 99.00th=[ 1301], 99.50th=[ 1301], 99.90th=[ 1301], 99.95th=[ 1301], | 99.99th=[ 1301] bw ( KiB/s): min= 8126, max= 8126, per=77.99%, avg=8126.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=6.67%, ctx=52, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144642: Thu Aug 27 17:47:08 2026 write: IOPS=0, BW=3907KiB/s (4001kB/s)(12.0MiB/3145msec); 0 zone resets clat (msec): min=461, max=1489, avg=1022.76, stdev=520.74 lat (msec): min=468, max=1489, avg=1030.38, stdev=518.03 clat percentiles (msec): | 1.00th=[ 460], 5.00th=[ 460], 10.00th=[ 460], 20.00th=[ 460], | 30.00th=[ 460], 40.00th=[ 1116], 50.00th=[ 1116], 60.00th=[ 1116], | 70.00th=[ 1485], 80.00th=[ 1485], 90.00th=[ 1485], 95.00th=[ 1485], | 99.00th=[ 1485], 99.50th=[ 1485], 99.90th=[ 1485], 99.95th=[ 1485], | 99.99th=[ 1485] bw ( KiB/s): min= 7801, max= 8159, per=76.59%, avg=7980.00, stdev=253.14, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.00%, sys=4.64%, ctx=51, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144644: Thu Aug 27 17:47:08 2026 write: IOPS=1, BW=7190KiB/s (7363kB/s)(12.0MiB/1709msec); 0 zone resets clat (msec): min=308, max=671, avg=544.78, stdev=204.61 lat (msec): min=309, max=671, avg=545.16, stdev=204.56 clat percentiles (msec): | 1.00th=[ 309], 5.00th=[ 309], 10.00th=[ 309], 20.00th=[ 309], | 30.00th=[ 309], 40.00th=[ 659], 50.00th=[ 659], 60.00th=[ 659], | 70.00th=[ 676], 80.00th=[ 676], 90.00th=[ 676], 95.00th=[ 676], | 99.00th=[ 676], 99.50th=[ 676], 99.90th=[ 676], 99.95th=[ 676], | 99.99th=[ 676] bw ( KiB/s): min=15603, max=15603, per=100.00%, avg=15603.00, stdev= 0.00, samples=1 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 750=66.67% cpu : usr=0.00%, sys=7.03%, ctx=42, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=6265KiB/s (6416kB/s), 1644KiB/s-4699KiB/s (1684kB/s-4812kB/s), io=16.0MiB (16.8MB), run=2491-2615msec WRITE: bw=10.2MiB/s (10.7MB/s), 3289KiB/s-7190KiB/s (3368kB/s-7363kB/s), io=32.0MiB (33.6MB), run=1709-3145msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144643: Thu Aug 27 17:47:09 2026 read: IOPS=1, BW=5063KiB/s (5185kB/s)(12.0MiB/2427msec) clat (msec): min=565, max=925, avg=735.17, stdev=180.88 lat (msec): min=565, max=925, avg=735.17, stdev=180.88 clat percentiles (msec): | 1.00th=[ 567], 5.00th=[ 567], 10.00th=[ 567], 20.00th=[ 567], | 30.00th=[ 567], 40.00th=[ 718], 50.00th=[ 718], 60.00th=[ 718], | 70.00th=[ 927], 80.00th=[ 927], 90.00th=[ 927], 95.00th=[ 927], | 99.00th=[ 927], 99.50th=[ 927], 99.90th=[ 927], 99.95th=[ 927], | 99.99th=[ 927] bw ( KiB/s): min= 8094, max= 8192, per=100.00%, avg=8143.00, stdev=69.30, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 750=66.67%, 1000=33.33% cpu : usr=0.00%, sys=16.08%, ctx=247, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144645: Thu Aug 27 17:47:09 2026 read: IOPS=0, BW=1034KiB/s (1058kB/s)(4096KiB/3963msec) clat (nsec): min=673489k, max=673489k, avg=673488636.00, stdev= 0.00 lat (nsec): min=673491k, max=673491k, avg=673491035.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 676], 5.00th=[ 676], 10.00th=[ 676], 20.00th=[ 676], | 30.00th=[ 676], 40.00th=[ 676], 50.00th=[ 676], 60.00th=[ 676], | 70.00th=[ 676], 80.00th=[ 676], 90.00th=[ 676], 95.00th=[ 676], | 99.00th=[ 676], 99.50th=[ 676], 99.90th=[ 676], 99.95th=[ 676], | 99.99th=[ 676] bw ( KiB/s): min= 8192, max= 8192, per=100.00%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2067KiB/s (2117kB/s)(8192KiB/3963msec); 0 zone resets clat (msec): min=890, max=2311, avg=1600.88, stdev=1005.05 lat (msec): min=890, max=2311, avg=1601.29, stdev=1004.98 clat percentiles (msec): | 1.00th=[ 894], 5.00th=[ 894], 10.00th=[ 894], 20.00th=[ 894], | 30.00th=[ 894], 40.00th=[ 894], 50.00th=[ 894], 60.00th=[ 2299], | 70.00th=[ 2299], 80.00th=[ 2299], 90.00th=[ 2299], 95.00th=[ 2299], | 99.00th=[ 2299], 99.50th=[ 2299], 99.90th=[ 2299], 99.95th=[ 2299], | 99.99th=[ 2299] bw ( KiB/s): min= 8094, max= 8094, per=97.90%, avg=8094.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, 1000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=2.40%, ctx=111, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144646: Thu Aug 27 17:47:09 2026 write: IOPS=0, BW=3131KiB/s (3206kB/s)(12.0MiB/3925msec); 0 zone resets clat (msec): min=514, max=2056, avg=1271.75, stdev=771.09 lat (msec): min=515, max=2056, avg=1272.27, stdev=770.85 clat percentiles (msec): | 1.00th=[ 514], 5.00th=[ 514], 10.00th=[ 514], 20.00th=[ 514], | 30.00th=[ 514], 40.00th=[ 1250], 50.00th=[ 1250], 60.00th=[ 1250], | 70.00th=[ 2056], 80.00th=[ 2056], 90.00th=[ 2056], 95.00th=[ 2056], | 99.00th=[ 2056], 99.50th=[ 2056], 99.90th=[ 2056], 99.95th=[ 2056], | 99.99th=[ 2056] bw ( KiB/s): min= 7953, max= 8094, per=97.04%, avg=8023.50, stdev=99.70, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=3.06%, ctx=51, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144647: Thu Aug 27 17:47:09 2026 write: IOPS=0, BW=3666KiB/s (3754kB/s)(12.0MiB/3352msec); 0 zone resets clat (msec): min=442, max=1596, avg=1047.40, stdev=579.22 lat (msec): min=442, max=1597, avg=1047.80, stdev=579.26 clat percentiles (msec): | 1.00th=[ 443], 5.00th=[ 443], 10.00th=[ 443], 20.00th=[ 443], | 30.00th=[ 443], 40.00th=[ 1099], 50.00th=[ 1099], 60.00th=[ 1099], | 70.00th=[ 1603], 80.00th=[ 1603], 90.00th=[ 1603], 95.00th=[ 1603], | 99.00th=[ 1603], 99.50th=[ 1603], 99.90th=[ 1603], 99.95th=[ 1603], | 99.99th=[ 1603] bw ( KiB/s): min= 8094, max= 8175, per=98.39%, avg=8134.50, stdev=57.28, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.00%, sys=4.18%, ctx=51, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4134KiB/s (4233kB/s), 1034KiB/s-5063KiB/s (1058kB/s-5185kB/s), io=16.0MiB (16.8MB), run=2427-3963msec WRITE: bw=8268KiB/s (8467kB/s), 2067KiB/s-3666KiB/s (2117kB/s-3754kB/s), io=32.0MiB (33.6MB), run=3352-3963msec