== sanity test 398b: DIO and buffer IO race ============== 13:30:04 (1772908204) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 3.46752 s, 14.5 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=152286: Sat Mar 7 13:31:17 2026 read: IOPS=24, BW=97.4KiB/s (99.8kB/s)(5992KiB/61493msec) clat (usec): min=139, max=736683, avg=21274.07, stdev=22190.18 lat (usec): min=139, max=736685, avg=21275.90, stdev=22190.18 clat percentiles (usec): | 1.00th=[ 529], 5.00th=[ 3032], 10.00th=[ 9503], 20.00th=[ 12125], | 30.00th=[ 14091], 40.00th=[ 15926], 50.00th=[ 18482], 60.00th=[ 21103], | 70.00th=[ 24511], 80.00th=[ 28705], 90.00th=[ 35390], 95.00th=[ 42206], | 99.00th=[ 63177], 99.50th=[ 74974], 99.90th=[105382], 99.95th=[734004], | 99.99th=[734004] bw ( KiB/s): min= 55, max= 160, per=25.54%, avg=98.35, stdev=24.83, samples=121 iops : min= 13, max= 40, avg=24.19, stdev= 6.24, samples=121 write: IOPS=25, BW=102KiB/s (105kB/s)(6296KiB/61493msec); 0 zone resets clat (usec): min=941, max=175104, avg=18776.93, stdev=15619.30 lat (usec): min=942, max=175106, avg=18782.17, stdev=15616.73 clat percentiles (usec): | 1.00th=[ 1614], 5.00th=[ 2999], 10.00th=[ 3720], 20.00th=[ 5014], | 30.00th=[ 7635], 40.00th=[ 11994], 50.00th=[ 15401], 60.00th=[ 19006], | 70.00th=[ 23725], 80.00th=[ 29492], 90.00th=[ 37487], 95.00th=[ 46400], | 99.00th=[ 70779], 99.50th=[ 84411], 99.90th=[117965], 99.95th=[175113], | 99.99th=[175113] bw ( KiB/s): min= 23, max= 183, per=25.61%, avg=103.22, stdev=31.65, samples=121 iops : min= 5, max= 45, avg=25.41, stdev= 8.01, samples=121 lat (usec) : 250=0.10%, 500=0.26%, 750=0.88%, 1000=0.85% lat (msec) : 2=1.11%, 4=5.60%, 10=14.58%, 20=36.20%, 50=37.21% lat (msec) : 100=3.03%, 250=0.16%, 750=0.03% cpu : usr=0.13%, sys=26.96%, ctx=9578, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=152287: Sat Mar 7 13:31:17 2026 read: IOPS=23, BW=95.3KiB/s (97.6kB/s)(5940KiB/62329msec) clat (usec): min=207, max=745110, avg=21850.38, stdev=22457.64 lat (usec): min=207, max=745110, avg=21851.25, stdev=22457.66 clat percentiles (usec): | 1.00th=[ 474], 5.00th=[ 6521], 10.00th=[ 10159], 20.00th=[ 12649], | 30.00th=[ 14615], 40.00th=[ 16712], 50.00th=[ 19006], 60.00th=[ 21890], | 70.00th=[ 25035], 80.00th=[ 28705], 90.00th=[ 35914], 95.00th=[ 43254], | 99.00th=[ 67634], 99.50th=[ 83362], 99.90th=[116917], 99.95th=[742392], | 99.99th=[742392] bw ( KiB/s): min= 16, max= 192, per=24.81%, avg=95.51, stdev=28.85, samples=122 iops : min= 4, max= 48, avg=23.48, stdev= 7.27, samples=122 write: IOPS=25, BW=102KiB/s (104kB/s)(6348KiB/62329msec); 0 zone resets clat (usec): min=819, max=141776, avg=18789.74, stdev=16023.93 lat (usec): min=820, max=141778, avg=18790.87, stdev=16023.96 clat percentiles (usec): | 1.00th=[ 1336], 5.00th=[ 2704], 10.00th=[ 3720], 20.00th=[ 4817], | 30.00th=[ 7111], 40.00th=[ 11469], 50.00th=[ 15270], 60.00th=[ 19268], | 70.00th=[ 23725], 80.00th=[ 29492], 90.00th=[ 40109], 95.00th=[ 46924], | 99.00th=[ 71828], 99.50th=[ 85459], 99.90th=[129500], 99.95th=[141558], | 99.99th=[141558] bw ( KiB/s): min= 40, max= 272, per=25.23%, avg=101.66, stdev=33.88, samples=122 iops : min= 10, max= 68, avg=25.02, stdev= 8.50, samples=122 lat (usec) : 250=0.07%, 500=0.46%, 750=0.75%, 1000=0.65% lat (msec) : 2=1.76%, 4=5.21%, 10=14.45%, 20=35.16%, 50=37.92% lat (msec) : 100=3.35%, 250=0.20%, 750=0.03% cpu : usr=0.11%, sys=26.62%, ctx=9439, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=152288: Sat Mar 7 13:31:17 2026 read: IOPS=24, BW=98.1KiB/s (100kB/s)(6028KiB/61440msec) clat (usec): min=256, max=189927, avg=20766.51, stdev=13340.53 lat (usec): min=257, max=189928, avg=20767.51, stdev=13340.60 clat percentiles (usec): | 1.00th=[ 510], 5.00th=[ 1172], 10.00th=[ 9765], 20.00th=[ 11994], | 30.00th=[ 13829], 40.00th=[ 16057], 50.00th=[ 18482], 60.00th=[ 21103], | 70.00th=[ 24249], 80.00th=[ 28181], 90.00th=[ 35390], 95.00th=[ 41157], | 99.00th=[ 65274], 99.50th=[ 81265], 99.90th=[160433], 99.95th=[189793], | 99.99th=[189793] bw ( KiB/s): min= 32, max= 168, per=25.62%, avg=98.63, stdev=28.73, samples=120 iops : min= 8, max= 42, avg=24.27, stdev= 7.25, samples=120 write: IOPS=25, BW=102KiB/s (104kB/s)(6260KiB/61440msec); 0 zone resets clat (usec): min=1007, max=765422, avg=19210.24, stdev=24838.62 lat (usec): min=1008, max=765423, avg=19212.07, stdev=24838.57 clat percentiles (usec): | 1.00th=[ 1680], 5.00th=[ 3032], 10.00th=[ 3818], 20.00th=[ 5145], | 30.00th=[ 7898], 40.00th=[ 11731], 50.00th=[ 15008], 60.00th=[ 18744], | 70.00th=[ 23200], 80.00th=[ 28967], 90.00th=[ 39060], 95.00th=[ 47449], | 99.00th=[ 72877], 99.50th=[ 83362], 99.90th=[181404], 99.95th=[767558], | 99.99th=[767558] bw ( KiB/s): min= 47, max= 174, per=25.33%, avg=102.08, stdev=31.18, samples=120 iops : min= 11, max= 43, avg=25.13, stdev= 7.85, samples=120 lat (usec) : 500=0.46%, 750=1.17%, 1000=0.72% lat (msec) : 2=1.27%, 4=5.27%, 10=14.36%, 20=36.13%, 50=37.60% lat (msec) : 100=2.70%, 250=0.29%, 1000=0.03% cpu : usr=0.10%, sys=26.69%, ctx=9608, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=152289: Sat Mar 7 13:31:17 2026 read: IOPS=24, BW=98.3KiB/s (101kB/s)(6052KiB/61553msec) clat (usec): min=183, max=110841, avg=20608.36, stdev=12205.41 lat (usec): min=183, max=110842, avg=20609.50, stdev=12205.46 clat percentiles (usec): | 1.00th=[ 519], 5.00th=[ 2769], 10.00th=[ 9503], 20.00th=[ 11731], | 30.00th=[ 13698], 40.00th=[ 15795], 50.00th=[ 18220], 60.00th=[ 21103], | 70.00th=[ 24511], 80.00th=[ 28705], 90.00th=[ 34866], 95.00th=[ 41157], | 99.00th=[ 60031], 99.50th=[ 80217], 99.90th=[110625], 99.95th=[110625], | 99.99th=[110625] bw ( KiB/s): min= 40, max= 180, per=25.75%, avg=99.13, stdev=27.43, samples=121 iops : min= 10, max= 45, avg=24.39, stdev= 6.87, samples=121 write: IOPS=25, BW=101KiB/s (104kB/s)(6236KiB/61553msec); 0 zone resets clat (usec): min=872, max=764287, avg=19435.99, stdev=24243.25 lat (usec): min=872, max=764289, avg=19437.70, stdev=24243.20 clat percentiles (usec): | 1.00th=[ 1582], 5.00th=[ 2933], 10.00th=[ 3687], 20.00th=[ 5080], | 30.00th=[ 8455], 40.00th=[ 12911], 50.00th=[ 16319], 60.00th=[ 19792], | 70.00th=[ 23987], 80.00th=[ 29492], 90.00th=[ 38536], 95.00th=[ 45876], | 99.00th=[ 65799], 99.50th=[ 87557], 99.90th=[173016], 99.95th=[767558], | 99.99th=[767558] bw ( KiB/s): min= 39, max= 160, per=25.34%, avg=102.12, stdev=29.96, samples=121 iops : min= 9, max= 40, avg=25.13, stdev= 7.53, samples=121 lat (usec) : 250=0.13%, 500=0.29%, 750=0.59%, 1000=0.94% lat (msec) : 2=1.56%, 4=5.31%, 10=14.00%, 20=35.64%, 50=38.57% lat (msec) : 100=2.83%, 250=0.10%, 1000=0.03% cpu : usr=0.14%, sys=26.81%, ctx=9654, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=385KiB/s (394kB/s), 95.3KiB/s-98.3KiB/s (97.6kB/s-101kB/s), io=23.4MiB (24.6MB), run=61440-62329msec WRITE: bw=403KiB/s (413kB/s), 101KiB/s-102KiB/s (104kB/s-105kB/s), io=24.6MiB (25.7MB), run=61440-62329msec rand-rw: (groupid=0, jobs=1): err= 0: pid=152281: Sat Mar 7 13:31:47 2026 read: IOPS=16, BW=65.4KiB/s (66.0kB/s)(5992KiB/91615msec) clat (msec): min=3, max=814, avg=17.26, stdev=26.38 lat (msec): min=3, max=814, avg=17.26, stdev=26.38 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 5], 10.00th=[ 5], 20.00th=[ 6], | 30.00th=[ 7], 40.00th=[ 8], 50.00th=[ 10], 60.00th=[ 14], | 70.00th=[ 19], 80.00th=[ 27], 90.00th=[ 37], 95.00th=[ 50], | 99.00th=[ 83], 99.50th=[ 100], 99.90th=[ 131], 99.95th=[ 818], | 99.99th=[ 818] bw ( KiB/s): min= 8, max= 192, per=25.49%, avg=66.27, stdev=39.60, samples=179 iops : min= 2, max= 48, avg=16.26, stdev=10.04, samples=179 write: IOPS=17, BW=68.7KiB/s (70.4kB/s)(6296KiB/91615msec); 0 zone resets clat (msec): min=15, max=188, avg=41.64, stdev=21.92 lat (msec): min=15, max=188, avg=41.64, stdev=21.92 clat percentiles (msec): | 1.00th=[ 19], 5.00th=[ 21], 10.00th=[ 23], 20.00th=[ 25], | 30.00th=[ 28], 40.00th=[ 31], 50.00th=[ 35], 60.00th=[ 41], | 70.00th=[ 48], 80.00th=[ 57], 90.00th=[ 71], 95.00th=[ 83], | 99.00th=[ 118], 99.50th=[ 144], 99.90th=[ 184], 99.95th=[ 188], | 99.99th=[ 188] bw ( KiB/s): min= 7, max= 144, per=25.29%, avg=68.80, stdev=35.62, samples=181 iops : min= 1, max= 36, avg=16.88, stdev= 9.09, samples=181 lat (msec) : 4=1.14%, 10=24.12%, 20=11.72%, 50=46.39%, 100=15.33% lat (msec) : 250=1.27%, 1000=0.03% cpu : usr=0.10%, sys=9.40%, ctx=6192, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=152282: Sat Mar 7 13:31:47 2026 read: IOPS=16, BW=64.4KiB/s (65.9kB/s)(5940KiB/92244msec) clat (msec): min=2, max=824, avg=17.29, stdev=27.15 lat (msec): min=2, max=824, avg=17.29, stdev=27.15 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 5], 10.00th=[ 5], 20.00th=[ 6], | 30.00th=[ 7], 40.00th=[ 8], 50.00th=[ 10], 60.00th=[ 14], | 70.00th=[ 20], 80.00th=[ 26], 90.00th=[ 39], 95.00th=[ 52], | 99.00th=[ 79], 99.50th=[ 113], 99.90th=[ 159], 99.95th=[ 827], | 99.99th=[ 827] bw ( KiB/s): min= 7, max= 200, per=24.71%, avg=64.24, stdev=41.11, samples=182 iops : min= 1, max= 50, avg=15.75, stdev=10.43, samples=182 write: IOPS=17, BW=68.8KiB/s (70.5kB/s)(6348KiB/92244msec); 0 zone resets clat (msec): min=13, max=189, avg=41.81, stdev=21.78 lat (msec): min=13, max=189, avg=41.81, stdev=21.78 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 20], 10.00th=[ 22], 20.00th=[ 25], | 30.00th=[ 28], 40.00th=[ 31], 50.00th=[ 35], 60.00th=[ 40], | 70.00th=[ 50], 80.00th=[ 59], 90.00th=[ 72], 95.00th=[ 84], | 99.00th=[ 114], 99.50th=[ 129], 99.90th=[ 182], 99.95th=[ 190], | 99.99th=[ 190] bw ( KiB/s): min= 15, max= 152, per=25.15%, avg=68.41, stdev=35.35, samples=182 iops : min= 3, max= 38, avg=16.79, stdev= 9.02, samples=182 lat (msec) : 4=1.20%, 10=23.89%, 20=12.17%, 50=45.18%, 100=16.37% lat (msec) : 250=1.14%, 1000=0.03% cpu : usr=0.12%, sys=9.33%, ctx=6192, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=152283: Sat Mar 7 13:31:47 2026 read: IOPS=16, BW=65.8KiB/s (67.4kB/s)(6028KiB/91561msec) clat (msec): min=2, max=130, avg=16.77, stdev=16.06 lat (msec): min=2, max=130, avg=16.77, stdev=16.06 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 5], 10.00th=[ 5], 20.00th=[ 6], | 30.00th=[ 7], 40.00th=[ 8], 50.00th=[ 10], 60.00th=[ 15], | 70.00th=[ 20], 80.00th=[ 27], 90.00th=[ 36], 95.00th=[ 48], | 99.00th=[ 83], 99.50th=[ 101], 99.90th=[ 122], 99.95th=[ 131], | 99.99th=[ 131] bw ( KiB/s): min= 7, max= 184, per=25.50%, avg=66.29, stdev=39.44, samples=180 iops : min= 1, max= 46, avg=16.26, stdev=10.00, samples=180 write: IOPS=17, BW=68.4KiB/s (70.0kB/s)(6260KiB/91561msec); 0 zone resets clat (msec): min=15, max=844, avg=42.22, stdev=29.38 lat (msec): min=15, max=844, avg=42.22, stdev=29.38 clat percentiles (msec): | 1.00th=[ 19], 5.00th=[ 21], 10.00th=[ 22], 20.00th=[ 25], | 30.00th=[ 28], 40.00th=[ 31], 50.00th=[ 35], 60.00th=[ 41], | 70.00th=[ 49], 80.00th=[ 58], 90.00th=[ 71], 95.00th=[ 85], | 99.00th=[ 111], 99.50th=[ 133], 99.90th=[ 188], 99.95th=[ 844], | 99.99th=[ 844] bw ( KiB/s): min= 16, max= 144, per=25.16%, avg=68.44, stdev=35.76, samples=181 iops : min= 4, max= 36, avg=16.80, stdev= 9.12, samples=181 lat (msec) : 4=0.91%, 10=23.73%, 20=11.62%, 50=47.43%, 100=15.14% lat (msec) : 250=1.14%, 1000=0.03% cpu : usr=0.09%, sys=9.48%, ctx=6180, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=152284: Sat Mar 7 13:31:47 2026 read: IOPS=16, BW=65.9KiB/s (67.5kB/s)(6052KiB/91833msec) clat (msec): min=3, max=165, avg=17.25, stdev=18.34 lat (msec): min=3, max=165, avg=17.25, stdev=18.34 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 5], 10.00th=[ 5], 20.00th=[ 6], | 30.00th=[ 7], 40.00th=[ 8], 50.00th=[ 10], 60.00th=[ 14], | 70.00th=[ 19], 80.00th=[ 26], 90.00th=[ 40], 95.00th=[ 51], | 99.00th=[ 86], 99.50th=[ 126], 99.90th=[ 159], 99.95th=[ 167], | 99.99th=[ 167] bw ( KiB/s): min= 7, max= 215, per=25.36%, avg=65.93, stdev=41.09, samples=180 iops : min= 1, max= 53, avg=16.17, stdev=10.40, samples=180 write: IOPS=16, BW=67.9KiB/s (69.5kB/s)(6236KiB/91833msec); 0 zone resets clat (msec): min=15, max=841, avg=42.03, stdev=28.99 lat (msec): min=15, max=841, avg=42.03, stdev=28.99 clat percentiles (msec): | 1.00th=[ 18], 5.00th=[ 21], 10.00th=[ 23], 20.00th=[ 25], | 30.00th=[ 28], 40.00th=[ 32], 50.00th=[ 35], 60.00th=[ 41], | 70.00th=[ 47], 80.00th=[ 58], 90.00th=[ 71], 95.00th=[ 84], | 99.00th=[ 111], 99.50th=[ 124], 99.90th=[ 201], 99.95th=[ 844], | 99.99th=[ 844] bw ( KiB/s): min= 15, max= 136, per=24.92%, avg=67.78, stdev=35.43, samples=181 iops : min= 3, max= 34, avg=16.63, stdev= 9.04, samples=181 lat (msec) : 4=0.78%, 10=24.97%, 20=11.62%, 50=46.22%, 100=15.01% lat (msec) : 250=1.37%, 1000=0.03% cpu : usr=0.07%, sys=9.43%, ctx=6285, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=260KiB/s (267kB/s), 64.4KiB/s-65.9KiB/s (65.9kB/s-67.5kB/s), io=23.4MiB (24.6MB), run=91561-92244msec WRITE: bw=273KiB/s (279kB/s), 67.9KiB/s-68.8KiB/s (69.5kB/s-70.5kB/s), io=24.6MiB (25.7MB), run=91561-92244msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=152318: Sat Mar 7 13:32:09 2026 read: IOPS=24, BW=385KiB/s (394kB/s)(5920KiB/15383msec) clat (usec): min=274, max=87583, avg=21615.16, stdev=13207.00 lat (usec): min=275, max=87584, avg=21616.03, stdev=13207.03 clat percentiles (usec): | 1.00th=[ 482], 5.00th=[ 685], 10.00th=[ 963], 20.00th=[13042], | 30.00th=[15270], 40.00th=[17695], 50.00th=[19792], 60.00th=[23462], | 70.00th=[26346], 80.00th=[30802], 90.00th=[38011], 95.00th=[44827], | 99.00th=[63177], 99.50th=[74974], 99.90th=[87557], 99.95th=[87557], | 99.99th=[87557] bw ( KiB/s): min= 190, max= 704, per=24.96%, avg=381.93, stdev=107.03, samples=30 iops : min= 11, max= 44, avg=23.40, stdev= 6.79, samples=30 write: IOPS=25, BW=414KiB/s (424kB/s)(6368KiB/15383msec); 0 zone resets clat (usec): min=2749, max=83531, avg=18333.39, stdev=13595.27 lat (usec): min=2750, max=83534, avg=18335.86, stdev=13595.72 clat percentiles (usec): | 1.00th=[ 3294], 5.00th=[ 4686], 10.00th=[ 5604], 20.00th=[ 6718], | 30.00th=[ 9241], 40.00th=[12387], 50.00th=[14484], 60.00th=[17695], | 70.00th=[21890], 80.00th=[27919], 90.00th=[35914], 95.00th=[46924], | 99.00th=[70779], 99.50th=[72877], 99.90th=[83362], 99.95th=[83362], | 99.99th=[83362] bw ( KiB/s): min= 31, max= 672, per=25.74%, avg=414.43, stdev=141.64, samples=30 iops : min= 1, max= 42, avg=25.43, stdev= 8.97, samples=30 lat (usec) : 500=0.52%, 750=2.47%, 1000=2.08% lat (msec) : 2=0.78%, 4=1.56%, 10=16.28%, 20=35.16%, 50=37.89% lat (msec) : 100=3.26% cpu : usr=0.10%, sys=31.59%, ctx=2959, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=152319: Sat Mar 7 13:32:09 2026 read: IOPS=23, BW=370KiB/s (379kB/s)(5744KiB/15515msec) clat (usec): min=446, max=95105, avg=22045.41, stdev=12811.10 lat (usec): min=447, max=95106, avg=22046.24, stdev=12811.13 clat percentiles (usec): | 1.00th=[ 553], 5.00th=[ 791], 10.00th=[ 8979], 20.00th=[14091], | 30.00th=[16188], 40.00th=[18220], 50.00th=[20055], 60.00th=[23200], | 70.00th=[26084], 80.00th=[30540], 90.00th=[35914], 95.00th=[43779], | 99.00th=[68682], 99.50th=[89654], 99.90th=[94897], 99.95th=[94897], | 99.99th=[94897] bw ( KiB/s): min= 160, max= 576, per=24.02%, avg=367.57, stdev=107.85, samples=30 iops : min= 10, max= 36, avg=22.50, stdev= 6.83, samples=30 write: IOPS=26, BW=422KiB/s (432kB/s)(6544KiB/15515msec); 0 zone resets clat (usec): min=1238, max=137582, avg=18404.97, stdev=14714.53 lat (usec): min=1239, max=137584, avg=18406.78, stdev=14714.52 clat percentiles (msec): | 1.00th=[ 3], 5.00th=[ 5], 10.00th=[ 6], 20.00th=[ 7], | 30.00th=[ 9], 40.00th=[ 12], 50.00th=[ 16], 60.00th=[ 18], | 70.00th=[ 22], 80.00th=[ 28], 90.00th=[ 36], 95.00th=[ 45], | 99.00th=[ 65], 99.50th=[ 84], 99.90th=[ 138], 99.95th=[ 138], | 99.99th=[ 138] bw ( KiB/s): min= 189, max= 704, per=25.66%, avg=413.17, stdev=107.73, samples=30 iops : min= 11, max= 44, avg=25.37, stdev= 6.78, samples=30 lat (usec) : 500=0.26%, 750=1.69%, 1000=1.43% lat (msec) : 2=1.30%, 4=1.82%, 10=16.80%, 20=34.38%, 50=39.32% lat (msec) : 100=2.86%, 250=0.13% cpu : usr=0.14%, sys=32.43%, ctx=2813, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=152320: Sat Mar 7 13:32:09 2026 read: IOPS=24, BW=400KiB/s (409kB/s)(6256KiB/15648msec) clat (usec): min=213, max=76854, avg=21418.60, stdev=12784.76 lat (usec): min=214, max=76854, avg=21419.44, stdev=12784.81 clat percentiles (usec): | 1.00th=[ 494], 5.00th=[ 660], 10.00th=[ 1336], 20.00th=[13304], | 30.00th=[15533], 40.00th=[17695], 50.00th=[19268], 60.00th=[21627], | 70.00th=[25297], 80.00th=[30540], 90.00th=[36963], 95.00th=[46924], | 99.00th=[59507], 99.50th=[77071], 99.90th=[77071], 99.95th=[77071], | 99.99th=[77071] bw ( KiB/s): min= 192, max= 640, per=26.14%, avg=399.87, stdev=103.44, samples=30 iops : min= 12, max= 40, avg=24.53, stdev= 6.55, samples=30 write: IOPS=24, BW=385KiB/s (395kB/s)(6032KiB/15648msec); 0 zone resets clat (usec): min=1466, max=119391, avg=19087.43, stdev=14340.21 lat (usec): min=1467, max=119403, avg=19089.23, stdev=14340.30 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 6], 10.00th=[ 6], 20.00th=[ 7], | 30.00th=[ 9], 40.00th=[ 12], 50.00th=[ 15], 60.00th=[ 20], | 70.00th=[ 25], 80.00th=[ 29], 90.00th=[ 36], 95.00th=[ 48], | 99.00th=[ 68], 99.50th=[ 72], 99.90th=[ 120], 99.95th=[ 120], | 99.99th=[ 120] bw ( KiB/s): min= 95, max= 608, per=23.31%, avg=375.23, stdev=138.33, samples=30 iops : min= 5, max= 38, avg=23.00, stdev= 8.77, samples=30 lat (usec) : 250=0.13%, 500=0.52%, 750=2.34%, 1000=1.69% lat (msec) : 2=0.91%, 4=0.52%, 10=16.67%, 20=33.59%, 50=40.10% lat (msec) : 100=3.39%, 250=0.13% cpu : usr=0.10%, sys=31.13%, ctx=2957, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=152321: Sat Mar 7 13:32:09 2026 read: IOPS=24, BW=397KiB/s (407kB/s)(6032KiB/15182msec) clat (usec): min=220, max=106460, avg=21310.07, stdev=14172.24 lat (usec): min=220, max=106461, avg=21312.13, stdev=14172.29 clat percentiles (usec): | 1.00th=[ 465], 5.00th=[ 660], 10.00th=[ 996], 20.00th=[ 12256], | 30.00th=[ 14746], 40.00th=[ 16909], 50.00th=[ 19792], 60.00th=[ 22938], | 70.00th=[ 26346], 80.00th=[ 31065], 90.00th=[ 38536], 95.00th=[ 46400], | 99.00th=[ 63177], 99.50th=[ 68682], 99.90th=[106431], 99.95th=[106431], | 99.99th=[106431] bw ( KiB/s): min= 224, max= 670, per=26.00%, avg=397.83, stdev=97.31, samples=30 iops : min= 14, max= 41, avg=24.40, stdev= 6.11, samples=30 write: IOPS=25, BW=412KiB/s (422kB/s)(6256KiB/15182msec); 0 zone resets clat (usec): min=2265, max=75077, avg=18197.93, stdev=12755.31 lat (usec): min=2267, max=75078, avg=18199.95, stdev=12755.48 clat percentiles (usec): | 1.00th=[ 2737], 5.00th=[ 4883], 10.00th=[ 5735], 20.00th=[ 6849], | 30.00th=[ 9241], 40.00th=[11994], 50.00th=[14746], 60.00th=[17957], | 70.00th=[22152], 80.00th=[27395], 90.00th=[35914], 95.00th=[44827], | 99.00th=[57934], 99.50th=[64750], 99.90th=[74974], 99.95th=[74974], | 99.99th=[74974] bw ( KiB/s): min= 127, max= 670, per=25.69%, avg=413.53, stdev=120.14, samples=30 iops : min= 7, max= 41, avg=25.40, stdev= 7.64, samples=30 lat (usec) : 250=0.13%, 500=0.39%, 750=2.47%, 1000=1.95% lat (msec) : 2=1.82%, 4=1.82%, 10=16.54%, 20=33.07%, 50=38.54% lat (msec) : 100=3.12%, 250=0.13% cpu : usr=0.13%, sys=31.81%, ctx=2845, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1531KiB/s (1567kB/s), 370KiB/s-400KiB/s (379kB/s-409kB/s), io=23.4MiB (24.5MB), run=15182-15648msec WRITE: bw=1610KiB/s (1649kB/s), 385KiB/s-422KiB/s (395kB/s-432kB/s), io=24.6MiB (25.8MB), run=15182-15648msec rand-rw: (groupid=0, jobs=1): err= 0: pid=152323: Sat Mar 7 13:32:16 2026 read: IOPS=16, BW=259KiB/s (265kB/s)(5920KiB/22867msec) clat (msec): min=3, max=102, avg=18.36, stdev=17.80 lat (msec): min=3, max=102, avg=18.36, stdev=17.80 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 5], 10.00th=[ 6], 20.00th=[ 7], | 30.00th=[ 8], 40.00th=[ 9], 50.00th=[ 12], 60.00th=[ 15], | 70.00th=[ 19], 80.00th=[ 29], 90.00th=[ 43], 95.00th=[ 58], | 99.00th=[ 86], 99.50th=[ 91], 99.90th=[ 103], 99.95th=[ 103], | 99.99th=[ 103] bw ( KiB/s): min= 64, max= 672, per=24.25%, avg=253.89, stdev=139.14, samples=45 iops : min= 4, max= 42, avg=15.53, stdev= 8.84, samples=45 write: IOPS=17, BW=278KiB/s (285kB/s)(6368KiB/22867msec); 0 zone resets clat (msec): min=14, max=139, avg=40.29, stdev=21.36 lat (msec): min=14, max=139, avg=40.29, stdev=21.36 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 21], 10.00th=[ 22], 20.00th=[ 25], | 30.00th=[ 28], 40.00th=[ 30], 50.00th=[ 33], 60.00th=[ 39], | 70.00th=[ 44], 80.00th=[ 55], 90.00th=[ 69], 95.00th=[ 83], | 99.00th=[ 118], 99.50th=[ 132], 99.90th=[ 140], 99.95th=[ 140], | 99.99th=[ 140] bw ( KiB/s): min= 94, max= 544, per=25.06%, avg=276.18, stdev=140.14, samples=45 iops : min= 5, max= 34, avg=16.93, stdev= 8.99, samples=45 lat (msec) : 4=0.52%, 10=20.96%, 20=15.89%, 50=47.92%, 100=12.89% lat (msec) : 250=1.82% cpu : usr=0.09%, sys=11.39%, ctx=1833, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=152324: Sat Mar 7 13:32:16 2026 read: IOPS=15, BW=251KiB/s (257kB/s)(5744KiB/22850msec) clat (msec): min=3, max=143, avg=18.07, stdev=18.37 lat (msec): min=3, max=143, avg=18.07, stdev=18.37 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 5], 10.00th=[ 6], 20.00th=[ 7], | 30.00th=[ 8], 40.00th=[ 9], 50.00th=[ 12], 60.00th=[ 15], | 70.00th=[ 18], 80.00th=[ 25], 90.00th=[ 43], 95.00th=[ 63], | 99.00th=[ 90], 99.50th=[ 97], 99.90th=[ 144], 99.95th=[ 144], | 99.99th=[ 144] bw ( KiB/s): min= 54, max= 672, per=24.45%, avg=255.95, stdev=158.76, samples=44 iops : min= 3, max= 42, avg=15.68, stdev=10.12, samples=44 write: IOPS=17, BW=286KiB/s (293kB/s)(6544KiB/22850msec); 0 zone resets clat (msec): min=16, max=155, avg=39.76, stdev=20.93 lat (msec): min=16, max=155, avg=39.76, stdev=20.93 clat percentiles (msec): | 1.00th=[ 19], 5.00th=[ 21], 10.00th=[ 22], 20.00th=[ 25], | 30.00th=[ 27], 40.00th=[ 30], 50.00th=[ 33], 60.00th=[ 39], | 70.00th=[ 44], 80.00th=[ 53], 90.00th=[ 68], 95.00th=[ 82], | 99.00th=[ 121], 99.50th=[ 134], 99.90th=[ 157], 99.95th=[ 157], | 99.99th=[ 157] bw ( KiB/s): min= 127, max= 544, per=25.88%, avg=285.18, stdev=135.83, samples=45 iops : min= 7, max= 34, avg=17.49, stdev= 8.70, samples=45 lat (msec) : 4=0.39%, 10=20.18%, 20=15.63%, 50=48.70%, 100=14.06% lat (msec) : 250=1.04% cpu : usr=0.04%, sys=11.20%, ctx=1784, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=152325: Sat Mar 7 13:32:16 2026 read: IOPS=17, BW=277KiB/s (284kB/s)(6256KiB/22551msec) clat (msec): min=3, max=109, avg=17.35, stdev=15.99 lat (msec): min=3, max=109, avg=17.35, stdev=15.99 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 5], 10.00th=[ 6], 20.00th=[ 7], | 30.00th=[ 8], 40.00th=[ 9], 50.00th=[ 12], 60.00th=[ 16], | 70.00th=[ 19], 80.00th=[ 26], 90.00th=[ 37], 95.00th=[ 49], | 99.00th=[ 91], 99.50th=[ 102], 99.90th=[ 110], 99.95th=[ 110], | 99.99th=[ 110] bw ( KiB/s): min= 63, max= 704, per=26.49%, avg=277.32, stdev=171.57, samples=44 iops : min= 3, max= 44, avg=17.00, stdev=10.92, samples=44 write: IOPS=16, BW=267KiB/s (274kB/s)(6032KiB/22551msec); 0 zone resets clat (msec): min=17, max=154, avg=41.47, stdev=22.04 lat (msec): min=17, max=154, avg=41.47, stdev=22.04 clat percentiles (msec): | 1.00th=[ 19], 5.00th=[ 21], 10.00th=[ 23], 20.00th=[ 25], | 30.00th=[ 28], 40.00th=[ 31], 50.00th=[ 33], 60.00th=[ 41], | 70.00th=[ 46], 80.00th=[ 57], 90.00th=[ 73], 95.00th=[ 89], | 99.00th=[ 112], 99.50th=[ 128], 99.90th=[ 155], 99.95th=[ 155], | 99.99th=[ 155] bw ( KiB/s): min= 95, max= 544, per=23.98%, avg=264.27, stdev=132.41, samples=44 iops : min= 5, max= 34, avg=16.18, stdev= 8.47, samples=44 lat (msec) : 4=0.26%, 10=23.44%, 20=15.76%, 50=45.70%, 100=13.15% lat (msec) : 250=1.69% cpu : usr=0.11%, sys=11.57%, ctx=1882, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=152326: Sat Mar 7 13:32:16 2026 read: IOPS=16, BW=264KiB/s (270kB/s)(6032KiB/22849msec) clat (msec): min=4, max=125, avg=18.88, stdev=17.31 lat (msec): min=4, max=125, avg=18.88, stdev=17.31 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 6], 10.00th=[ 6], 20.00th=[ 7], | 30.00th=[ 8], 40.00th=[ 10], 50.00th=[ 13], 60.00th=[ 16], | 70.00th=[ 21], 80.00th=[ 29], 90.00th=[ 45], 95.00th=[ 56], | 99.00th=[ 87], 99.50th=[ 102], 99.90th=[ 126], 99.95th=[ 126], | 99.99th=[ 126] bw ( KiB/s): min= 64, max= 640, per=24.96%, avg=261.38, stdev=137.33, samples=45 iops : min= 4, max= 40, avg=16.00, stdev= 8.72, samples=45 write: IOPS=17, BW=274KiB/s (280kB/s)(6256KiB/22849msec); 0 zone resets clat (msec): min=16, max=153, avg=39.85, stdev=19.91 lat (msec): min=16, max=153, avg=39.85, stdev=19.91 clat percentiles (msec): | 1.00th=[ 18], 5.00th=[ 21], 10.00th=[ 23], 20.00th=[ 26], | 30.00th=[ 27], 40.00th=[ 30], 50.00th=[ 33], 60.00th=[ 39], | 70.00th=[ 46], 80.00th=[ 53], 90.00th=[ 67], 95.00th=[ 84], | 99.00th=[ 106], 99.50th=[ 113], 99.90th=[ 155], 99.95th=[ 155], | 99.99th=[ 155] bw ( KiB/s): min= 95, max= 576, per=24.74%, avg=272.60, stdev=137.52, samples=45 iops : min= 5, max= 36, avg=16.71, stdev= 8.80, samples=45 lat (msec) : 10=21.74%, 20=14.58%, 50=48.83%, 100=13.54%, 250=1.30% cpu : usr=0.09%, sys=11.55%, ctx=1830, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1047KiB/s (1073kB/s), 251KiB/s-277KiB/s (257kB/s-284kB/s), io=23.4MiB (24.5MB), run=22551-22867msec WRITE: bw=1102KiB/s (1128kB/s), 267KiB/s-286KiB/s (274kB/s-293kB/s), io=24.6MiB (25.8MB), run=22551-22867msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=152336: Sat Mar 7 13:32:26 2026 read: IOPS=2, BW=2536KiB/s (2596kB/s)(7168KiB/2827msec) clat (msec): min=49, max=815, avg=221.68, stdev=275.15 lat (msec): min=49, max=815, avg=221.69, stdev=275.15 clat percentiles (msec): | 1.00th=[ 50], 5.00th=[ 50], 10.00th=[ 50], 20.00th=[ 59], | 30.00th=[ 84], 40.00th=[ 84], 50.00th=[ 90], 60.00th=[ 161], | 70.00th=[ 161], 80.00th=[ 296], 90.00th=[ 818], 95.00th=[ 818], | 99.00th=[ 818], 99.50th=[ 818], 99.90th=[ 818], 99.95th=[ 818], | 99.99th=[ 818] bw ( KiB/s): min= 1928, max= 6954, per=63.45%, avg=3641.67, stdev=2869.14, samples=3 iops : min= 1, max= 6, avg= 2.67, stdev= 2.89, samples=3 write: IOPS=1, BW=1811KiB/s (1855kB/s)(5120KiB/2827msec); 0 zone resets clat (msec): min=46, max=698, avg=250.45, stdev=262.04 lat (msec): min=46, max=698, avg=250.54, stdev=262.03 clat percentiles (msec): | 1.00th=[ 47], 5.00th=[ 47], 10.00th=[ 47], 20.00th=[ 47], | 30.00th=[ 92], 40.00th=[ 92], 50.00th=[ 163], 60.00th=[ 163], | 70.00th=[ 253], 80.00th=[ 253], 90.00th=[ 701], 95.00th=[ 701], | 99.00th=[ 701], 99.50th=[ 701], 99.90th=[ 701], 99.95th=[ 701], | 99.99th=[ 701] bw ( KiB/s): min= 1738, max= 3984, per=39.73%, avg=3192.67, stdev=1261.40, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 lat (msec) : 50=16.67%, 100=33.33%, 250=16.67%, 500=16.67%, 750=8.33% lat (msec) : 1000=8.33% cpu : usr=0.04%, sys=13.84%, ctx=304, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=152337: Sat Mar 7 13:32:26 2026 read: IOPS=0, BW=574KiB/s (588kB/s)(2048KiB/3568msec) clat (msec): min=78, max=314, avg=196.64, stdev=166.38 lat (msec): min=78, max=314, avg=196.64, stdev=166.37 clat percentiles (msec): | 1.00th=[ 80], 5.00th=[ 80], 10.00th=[ 80], 20.00th=[ 80], | 30.00th=[ 80], 40.00th=[ 80], 50.00th=[ 80], 60.00th=[ 313], | 70.00th=[ 313], 80.00th=[ 313], 90.00th=[ 313], 95.00th=[ 313], | 99.00th=[ 313], 99.50th=[ 313], 99.90th=[ 313], 99.95th=[ 313], | 99.99th=[ 313] bw ( KiB/s): min= 1706, max= 1992, per=32.22%, avg=1849.00, stdev=202.23, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2870KiB/s (2939kB/s)(10.0MiB/3568msec); 0 zone resets clat (msec): min=78, max=822, avg=314.57, stdev=236.33 lat (msec): min=78, max=822, avg=314.67, stdev=236.35 clat percentiles (msec): | 1.00th=[ 79], 5.00th=[ 79], 10.00th=[ 79], 20.00th=[ 87], | 30.00th=[ 128], 40.00th=[ 157], 50.00th=[ 275], 60.00th=[ 275], | 70.00th=[ 313], 80.00th=[ 502], 90.00th=[ 510], 95.00th=[ 827], | 99.00th=[ 827], 99.50th=[ 827], 99.90th=[ 827], 99.95th=[ 827], | 99.99th=[ 827] bw ( KiB/s): min= 1928, max= 5120, per=37.66%, avg=3026.00, stdev=1474.83, samples=5 iops : min= 1, max= 5, avg= 2.20, stdev= 1.79, samples=5 lat (msec) : 100=25.00%, 250=16.67%, 500=33.33%, 750=16.67%, 1000=8.33% cpu : usr=0.06%, sys=16.90%, ctx=115, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=152338: Sat Mar 7 13:32:26 2026 read: IOPS=1, BW=2001KiB/s (2049kB/s)(6144KiB/3070msec) clat (msec): min=140, max=565, avg=290.00, stdev=178.78 lat (msec): min=140, max=565, avg=290.00, stdev=178.78 clat percentiles (msec): | 1.00th=[ 142], 5.00th=[ 142], 10.00th=[ 142], 20.00th=[ 155], | 30.00th=[ 155], 40.00th=[ 188], 50.00th=[ 188], 60.00th=[ 234], | 70.00th=[ 460], 80.00th=[ 460], 90.00th=[ 567], 95.00th=[ 567], | 99.00th=[ 567], 99.50th=[ 567], 99.90th=[ 567], 99.95th=[ 567], | 99.99th=[ 567] bw ( KiB/s): min= 1928, max= 4071, per=57.98%, avg=3327.67, stdev=1212.93, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 write: IOPS=1, BW=2001KiB/s (2049kB/s)(6144KiB/3070msec); 0 zone resets clat (msec): min=64, max=446, avg=219.73, stdev=147.30 lat (msec): min=64, max=446, avg=219.82, stdev=147.30 clat percentiles (msec): | 1.00th=[ 65], 5.00th=[ 65], 10.00th=[ 65], 20.00th=[ 72], | 30.00th=[ 72], 40.00th=[ 169], 50.00th=[ 169], 60.00th=[ 279], | 70.00th=[ 288], 80.00th=[ 288], 90.00th=[ 447], 95.00th=[ 447], | 99.00th=[ 447], 99.50th=[ 447], 99.90th=[ 447], 99.95th=[ 447], | 99.99th=[ 447] bw ( KiB/s): min= 1928, max= 5128, per=37.75%, avg=3033.00, stdev=1815.23, samples=3 iops : min= 1, max= 5, avg= 2.33, stdev= 2.31, samples=3 lat (msec) : 100=16.67%, 250=41.67%, 500=33.33%, 750=8.33% cpu : usr=0.10%, sys=11.31%, ctx=147, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=152339: Sat Mar 7 13:32:26 2026 read: IOPS=1, BW=1933KiB/s (1979kB/s)(5120KiB/2649msec) clat (msec): min=87, max=408, avg=199.50, stdev=126.08 lat (msec): min=88, max=408, avg=199.50, stdev=126.08 clat percentiles (msec): | 1.00th=[ 88], 5.00th=[ 88], 10.00th=[ 88], 20.00th=[ 88], | 30.00th=[ 129], 40.00th=[ 129], 50.00th=[ 155], 60.00th=[ 155], | 70.00th=[ 218], 80.00th=[ 218], 90.00th=[ 409], 95.00th=[ 409], | 99.00th=[ 409], 99.50th=[ 409], 99.90th=[ 409], 99.95th=[ 409], | 99.99th=[ 409] bw ( KiB/s): min= 2043, max= 6107, per=71.01%, avg=4075.00, stdev=2873.68, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 write: IOPS=2, BW=2706KiB/s (2771kB/s)(7168KiB/2649msec); 0 zone resets clat (msec): min=83, max=446, avg=230.66, stdev=134.49 lat (msec): min=83, max=447, avg=230.76, stdev=134.50 clat percentiles (msec): | 1.00th=[ 84], 5.00th=[ 84], 10.00th=[ 84], 20.00th=[ 101], | 30.00th=[ 125], 40.00th=[ 125], 50.00th=[ 247], 60.00th=[ 300], | 70.00th=[ 300], 80.00th=[ 313], 90.00th=[ 447], 95.00th=[ 447], | 99.00th=[ 447], 99.50th=[ 447], 99.90th=[ 447], 99.95th=[ 447], | 99.99th=[ 447] bw ( KiB/s): min= 1928, max= 5180, per=32.80%, avg=2635.60, stdev=1423.09, samples=5 iops : min= 1, max= 5, avg= 1.80, stdev= 1.79, samples=5 lat (msec) : 100=16.67%, 250=50.00%, 500=33.33% cpu : usr=0.04%, sys=16.69%, ctx=236, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5740KiB/s (5878kB/s), 574KiB/s-2536KiB/s (588kB/s-2596kB/s), io=20.0MiB (20.0MB), run=2649-3568msec WRITE: bw=8036KiB/s (8229kB/s), 1811KiB/s-2870KiB/s (1855kB/s-2939kB/s), io=28.0MiB (29.4MB), run=2649-3568msec rand-rw: (groupid=0, jobs=1): err= 0: pid=152341: Sat Mar 7 13:32:26 2026 read: IOPS=2, BW=2482KiB/s (2542kB/s)(7168KiB/2888msec) clat (usec): min=1173, max=462522, avg=190902.60, stdev=172929.62 lat (usec): min=1174, max=462523, avg=190903.52, stdev=172929.68 clat percentiles (usec): | 1.00th=[ 1172], 5.00th=[ 1172], 10.00th=[ 1172], 20.00th=[ 1450], | 30.00th=[123208], 40.00th=[123208], 50.00th=[164627], 60.00th=[227541], | 70.00th=[227541], 80.00th=[354419], 90.00th=[463471], 95.00th=[463471], | 99.00th=[463471], 99.50th=[463471], 99.90th=[463471], 99.95th=[463471], | 99.99th=[463471] bw ( KiB/s): min= 1954, max= 4079, per=43.88%, avg=2727.75, stdev=1006.76, samples=4 iops : min= 1, max= 3, avg= 1.75, stdev= 0.96, samples=4 write: IOPS=1, BW=1773KiB/s (1815kB/s)(5120KiB/2888msec); 0 zone resets clat (msec): min=173, max=623, avg=310.05, stdev=178.60 lat (msec): min=173, max=623, avg=310.11, stdev=178.59 clat percentiles (msec): | 1.00th=[ 174], 5.00th=[ 174], 10.00th=[ 174], 20.00th=[ 174], | 30.00th=[ 234], 40.00th=[ 234], 50.00th=[ 255], 60.00th=[ 255], | 70.00th=[ 266], 80.00th=[ 266], 90.00th=[ 625], 95.00th=[ 625], | 99.00th=[ 625], 99.50th=[ 625], 99.90th=[ 625], 99.95th=[ 625], | 99.99th=[ 625] bw ( KiB/s): min= 1841, max= 3930, per=29.58%, avg=2575.00, stdev=1174.82, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (msec) : 2=16.67%, 250=41.67%, 500=33.33%, 750=8.33% cpu : usr=0.07%, sys=39.80%, ctx=781, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=152342: Sat Mar 7 13:32:26 2026 read: IOPS=0, BW=622KiB/s (637kB/s)(2048KiB/3294msec) clat (msec): min=172, max=339, avg=255.80, stdev=118.31 lat (msec): min=172, max=339, avg=255.80, stdev=118.31 clat percentiles (msec): | 1.00th=[ 174], 5.00th=[ 174], 10.00th=[ 174], 20.00th=[ 174], | 30.00th=[ 174], 40.00th=[ 174], 50.00th=[ 174], 60.00th=[ 338], | 70.00th=[ 338], 80.00th=[ 338], 90.00th=[ 338], 95.00th=[ 338], | 99.00th=[ 338], 99.50th=[ 338], 99.90th=[ 338], 99.95th=[ 338], | 99.99th=[ 338] bw ( KiB/s): min= 1473, max= 1965, per=27.65%, avg=1719.00, stdev=347.90, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=3, BW=3109KiB/s (3183kB/s)(10.0MiB/3294msec); 0 zone resets clat (msec): min=116, max=475, avg=277.98, stdev=127.68 lat (msec): min=116, max=475, avg=278.07, stdev=127.65 clat percentiles (msec): | 1.00th=[ 116], 5.00th=[ 116], 10.00th=[ 116], 20.00th=[ 150], | 30.00th=[ 171], 40.00th=[ 215], 50.00th=[ 230], 60.00th=[ 241], | 70.00th=[ 351], 80.00th=[ 384], 90.00th=[ 451], 95.00th=[ 477], | 99.00th=[ 477], 99.50th=[ 477], 99.90th=[ 477], 99.95th=[ 477], | 99.99th=[ 477] bw ( KiB/s): min= 1473, max= 4079, per=30.51%, avg=2655.40, stdev=1245.44, samples=5 iops : min= 1, max= 3, avg= 1.80, stdev= 1.10, samples=5 lat (msec) : 250=58.33%, 500=41.67% cpu : usr=0.00%, sys=46.98%, ctx=621, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=152343: Sat Mar 7 13:32:26 2026 read: IOPS=1, BW=1990KiB/s (2037kB/s)(6144KiB/3088msec) clat (usec): min=988, max=349910, avg=146832.58, stdev=131858.64 lat (usec): min=989, max=349911, avg=146833.67, stdev=131858.75 clat percentiles (usec): | 1.00th=[ 988], 5.00th=[ 988], 10.00th=[ 988], 20.00th=[ 2278], | 30.00th=[ 2278], 40.00th=[158335], 50.00th=[158335], 60.00th=[168821], | 70.00th=[200279], 80.00th=[200279], 90.00th=[350225], 95.00th=[350225], | 99.00th=[350225], 99.50th=[350225], 99.90th=[350225], 99.95th=[350225], | 99.99th=[350225] bw ( KiB/s): min= 1965, max= 4079, per=52.15%, avg=3242.33, stdev=1123.78, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 write: IOPS=1, BW=1990KiB/s (2037kB/s)(6144KiB/3088msec); 0 zone resets clat (msec): min=173, max=690, avg=367.19, stdev=224.66 lat (msec): min=173, max=690, avg=367.26, stdev=224.66 clat percentiles (msec): | 1.00th=[ 174], 5.00th=[ 174], 10.00th=[ 174], 20.00th=[ 207], | 30.00th=[ 207], 40.00th=[ 215], 50.00th=[ 215], 60.00th=[ 313], | 70.00th=[ 609], 80.00th=[ 609], 90.00th=[ 693], 95.00th=[ 693], | 99.00th=[ 693], 99.50th=[ 693], 99.90th=[ 693], 99.95th=[ 693], | 99.99th=[ 693] bw ( KiB/s): min= 1841, max= 2951, per=25.02%, avg=2177.75, stdev=518.54, samples=4 iops : min= 1, max= 2, avg= 1.25, stdev= 0.50, samples=4 lat (usec) : 1000=8.33% lat (msec) : 4=8.33%, 250=50.00%, 500=16.67%, 750=16.67% cpu : usr=0.03%, sys=37.19%, ctx=499, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=152344: Sat Mar 7 13:32:26 2026 read: IOPS=1, BW=1884KiB/s (1930kB/s)(5120KiB/2717msec) clat (usec): min=1279, max=219689, avg=146464.94, stdev=87394.94 lat (usec): min=1280, max=219690, avg=146466.15, stdev=87394.87 clat percentiles (usec): | 1.00th=[ 1287], 5.00th=[ 1287], 10.00th=[ 1287], 20.00th=[ 1287], | 30.00th=[131597], 40.00th=[131597], 50.00th=[183501], 60.00th=[183501], | 70.00th=[196084], 80.00th=[196084], 90.00th=[219153], 95.00th=[219153], | 99.00th=[219153], 99.50th=[219153], 99.90th=[219153], 99.95th=[219153], | 99.99th=[219153] bw ( KiB/s): min= 3683, max= 4079, per=62.43%, avg=3881.00, stdev=280.01, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2638KiB/s (2702kB/s)(7168KiB/2717msec); 0 zone resets clat (msec): min=179, max=426, avg=283.18, stdev=90.94 lat (msec): min=179, max=426, avg=283.28, stdev=90.94 clat percentiles (msec): | 1.00th=[ 180], 5.00th=[ 180], 10.00th=[ 180], 20.00th=[ 211], | 30.00th=[ 245], 40.00th=[ 245], 50.00th=[ 247], 60.00th=[ 288], | 70.00th=[ 288], 80.00th=[ 384], 90.00th=[ 426], 95.00th=[ 426], | 99.00th=[ 426], 99.50th=[ 426], 99.90th=[ 426], 99.95th=[ 426], | 99.99th=[ 426] bw ( KiB/s): min= 1841, max= 3908, per=33.14%, avg=2884.33, stdev=1033.64, samples=3 iops : min= 1, max= 3, avg= 2.00, stdev= 1.00, samples=3 lat (msec) : 2=8.33%, 250=66.67%, 500=25.00% cpu : usr=0.00%, sys=45.47%, ctx=517, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=6217KiB/s (6367kB/s), 622KiB/s-2482KiB/s (637kB/s-2542kB/s), io=20.0MiB (20.0MB), run=2717-3294msec WRITE: bw=8704KiB/s (8913kB/s), 1773KiB/s-3109KiB/s (1815kB/s-3183kB/s), io=28.0MiB (29.4MB), run=2717-3294msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=152355: Sat Mar 7 13:32:36 2026 read: IOPS=1, BW=7822KiB/s (8009kB/s)(12.0MiB/1571msec) clat (msec): min=473, max=520, avg=498.26, stdev=23.67 lat (msec): min=473, max=520, avg=498.26, stdev=23.67 clat percentiles (msec): | 1.00th=[ 472], 5.00th=[ 472], 10.00th=[ 472], 20.00th=[ 472], | 30.00th=[ 472], 40.00th=[ 502], 50.00th=[ 502], 60.00th=[ 502], | 70.00th=[ 523], 80.00th=[ 523], 90.00th=[ 523], 95.00th=[ 523], | 99.00th=[ 523], 99.50th=[ 523], 99.90th=[ 523], 99.95th=[ 523], | 99.99th=[ 523] bw ( KiB/s): min= 6543, max= 8159, per=99.30%, avg=7351.00, stdev=1142.68, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 750=66.67% cpu : usr=0.00%, sys=45.67%, ctx=2960, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=152356: Sat Mar 7 13:32:36 2026 read: IOPS=0, BW=1851KiB/s (1895kB/s)(4096KiB/2213msec) clat (nsec): min=584090k, max=584090k, avg=584090324.00, stdev= 0.00 lat (nsec): min=584093k, max=584093k, avg=584092961.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 584], 5.00th=[ 584], 10.00th=[ 584], 20.00th=[ 584], | 30.00th=[ 584], 40.00th=[ 584], 50.00th=[ 584], 60.00th=[ 584], | 70.00th=[ 584], 80.00th=[ 584], 90.00th=[ 584], 95.00th=[ 584], | 99.00th=[ 584], 99.50th=[ 584], 99.90th=[ 584], 99.95th=[ 584], | 99.99th=[ 584] bw ( KiB/s): min= 6041, max= 6041, per=81.60%, avg=6041.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=3702KiB/s (3791kB/s)(8192KiB/2213msec); 0 zone resets clat (msec): min=712, max=897, avg=804.88, stdev=130.51 lat (msec): min=712, max=897, avg=805.30, stdev=130.58 clat percentiles (msec): | 1.00th=[ 709], 5.00th=[ 709], 10.00th=[ 709], 20.00th=[ 709], | 30.00th=[ 709], 40.00th=[ 709], 50.00th=[ 709], 60.00th=[ 894], | 70.00th=[ 894], 80.00th=[ 894], 90.00th=[ 894], 95.00th=[ 894], | 99.00th=[ 894], 99.50th=[ 894], 99.90th=[ 894], 99.95th=[ 894], | 99.99th=[ 894] bw ( KiB/s): min= 8192, max= 8192, per=55.33%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 750=66.67%, 1000=33.33% cpu : usr=0.00%, sys=22.42%, ctx=999, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=152357: Sat Mar 7 13:32:36 2026 write: IOPS=1, BW=5660KiB/s (5796kB/s)(12.0MiB/2171msec); 0 zone resets clat (msec): min=237, max=1428, avg=711.78, stdev=631.51 lat (msec): min=238, max=1428, avg=712.14, stdev=631.45 clat percentiles (msec): | 1.00th=[ 239], 5.00th=[ 239], 10.00th=[ 239], 20.00th=[ 239], | 30.00th=[ 239], 40.00th=[ 468], 50.00th=[ 468], 60.00th=[ 468], | 70.00th=[ 1435], 80.00th=[ 1435], 90.00th=[ 1435], 95.00th=[ 1435], | 99.00th=[ 1435], 99.50th=[ 1435], 99.90th=[ 1435], 99.95th=[ 1435], | 99.99th=[ 1435] bw ( KiB/s): min= 8192, max= 8192, per=55.33%, avg=8192.00, stdev= 0.00, samples=2 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=2 lat (msec) : 250=33.33%, 500=33.33%, 2000=33.33% cpu : usr=0.00%, sys=14.65%, ctx=68, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=152358: Sat Mar 7 13:32:36 2026 write: IOPS=1, BW=6197KiB/s (6345kB/s)(12.0MiB/1983msec); 0 zone resets clat (msec): min=389, max=969, avg=621.35, stdev=306.60 lat (msec): min=389, max=969, avg=621.62, stdev=306.53 clat percentiles (msec): | 1.00th=[ 388], 5.00th=[ 388], 10.00th=[ 388], 20.00th=[ 388], | 30.00th=[ 388], 40.00th=[ 506], 50.00th=[ 506], 60.00th=[ 506], | 70.00th=[ 969], 80.00th=[ 969], 90.00th=[ 969], 95.00th=[ 969], | 99.00th=[ 969], 99.50th=[ 969], 99.90th=[ 969], 99.95th=[ 969], | 99.99th=[ 969] bw ( KiB/s): min= 6077, max= 8159, per=48.07%, avg=7118.00, stdev=1472.20, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 750=33.33%, 1000=33.33% cpu : usr=0.00%, sys=16.75%, ctx=82, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=7404KiB/s (7581kB/s), 1851KiB/s-7822KiB/s (1895kB/s-8009kB/s), io=16.0MiB (16.8MB), run=1571-2213msec WRITE: bw=14.5MiB/s (15.2MB/s), 3702KiB/s-6197KiB/s (3791kB/s-6345kB/s), io=32.0MiB (33.6MB), run=1983-2213msec rand-rw: (groupid=0, jobs=1): err= 0: pid=152350: Sat Mar 7 13:32:36 2026 read: IOPS=1, BW=6370KiB/s (6523kB/s)(12.0MiB/1929msec) clat (msec): min=315, max=764, avg=587.94, stdev=239.16 lat (msec): min=315, max=764, avg=587.94, stdev=239.16 clat percentiles (msec): | 1.00th=[ 317], 5.00th=[ 317], 10.00th=[ 317], 20.00th=[ 317], | 30.00th=[ 317], 40.00th=[ 684], 50.00th=[ 684], 60.00th=[ 684], | 70.00th=[ 768], 80.00th=[ 768], 90.00th=[ 768], 95.00th=[ 768], | 99.00th=[ 768], 99.50th=[ 768], 99.90th=[ 768], 99.95th=[ 768], | 99.99th=[ 768] bw ( KiB/s): min= 8192, max= 8192, per=99.61%, avg=8192.00, stdev= 0.00, samples=2 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 750=33.33%, 1000=33.33% cpu : usr=0.00%, sys=22.56%, ctx=92, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=152351: Sat Mar 7 13:32:36 2026 read: IOPS=0, BW=2056KiB/s (2106kB/s)(4096KiB/1992msec) clat (nsec): min=148399k, max=148399k, avg=148398844.00, stdev= 0.00 lat (nsec): min=148401k, max=148401k, avg=148401353.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 148], 5.00th=[ 148], 10.00th=[ 148], 20.00th=[ 148], | 30.00th=[ 148], 40.00th=[ 148], 50.00th=[ 148], 60.00th=[ 148], | 70.00th=[ 148], 80.00th=[ 148], 90.00th=[ 148], 95.00th=[ 148], | 99.00th=[ 148], 99.50th=[ 148], 99.90th=[ 148], 99.95th=[ 148], | 99.99th=[ 148] bw ( KiB/s): min= 5557, max= 5557, per=67.57%, avg=5557.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=1, BW=4112KiB/s (4211kB/s)(8192KiB/1992msec); 0 zone resets clat (msec): min=833, max=846, avg=840.01, stdev= 8.85 lat (msec): min=834, max=846, avg=840.32, stdev= 8.80 clat percentiles (msec): | 1.00th=[ 835], 5.00th=[ 835], 10.00th=[ 835], 20.00th=[ 835], | 30.00th=[ 835], 40.00th=[ 835], 50.00th=[ 835], 60.00th=[ 844], | 70.00th=[ 844], 80.00th=[ 844], 90.00th=[ 844], 95.00th=[ 844], | 99.00th=[ 844], 99.50th=[ 844], 99.90th=[ 844], 99.95th=[ 844], | 99.99th=[ 844] bw ( KiB/s): min= 8192, max= 8192, per=64.05%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 1000=66.67% cpu : usr=0.00%, sys=19.74%, ctx=100, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=152352: Sat Mar 7 13:32:36 2026 write: IOPS=1, BW=4796KiB/s (4911kB/s)(12.0MiB/2562msec); 0 zone resets clat (msec): min=89, max=2163, avg=798.79, stdev=1182.05 lat (msec): min=89, max=2163, avg=799.13, stdev=1182.03 clat percentiles (msec): | 1.00th=[ 89], 5.00th=[ 89], 10.00th=[ 89], 20.00th=[ 89], | 30.00th=[ 89], 40.00th=[ 144], 50.00th=[ 144], 60.00th=[ 144], | 70.00th=[ 2165], 80.00th=[ 2165], 90.00th=[ 2165], 95.00th=[ 2165], | 99.00th=[ 2165], 99.50th=[ 2165], 99.90th=[ 2165], 99.95th=[ 2165], | 99.99th=[ 2165] lat (msec) : 100=33.33%, 250=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=13.55%, ctx=73, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=152353: Sat Mar 7 13:32:36 2026 write: IOPS=1, BW=6172KiB/s (6320kB/s)(12.0MiB/1991msec); 0 zone resets clat (msec): min=172, max=1303, avg=609.53, stdev=608.05 lat (msec): min=173, max=1304, avg=609.88, stdev=608.03 clat percentiles (msec): | 1.00th=[ 174], 5.00th=[ 174], 10.00th=[ 174], 20.00th=[ 174], | 30.00th=[ 174], 40.00th=[ 351], 50.00th=[ 351], 60.00th=[ 351], | 70.00th=[ 1301], 80.00th=[ 1301], 90.00th=[ 1301], 95.00th=[ 1301], | 99.00th=[ 1301], 99.50th=[ 1301], 99.90th=[ 1301], 99.95th=[ 1301], | 99.99th=[ 1301] bw ( KiB/s): min=11130, max=11130, per=87.02%, avg=11130.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 500=33.33%, 2000=33.33% cpu : usr=0.05%, sys=18.99%, ctx=103, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=8225KiB/s (8422kB/s), 2056KiB/s-6370KiB/s (2106kB/s-6523kB/s), io=16.0MiB (16.8MB), run=1929-1992msec WRITE: bw=12.5MiB/s (13.1MB/s), 4112KiB/s-6172KiB/s (4211kB/s-6320kB/s), io=32.0MiB (33.6MB), run=1991-2562msec