== sanity test 398b: DIO and buffer IO race ============== 08:55:00 (1787748900) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 7.644 s, 6.6 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=178978: Wed Aug 26 08:57:40 2026 read: IOPS=11, BW=44.4KiB/s (45.5kB/s)(5992KiB/134904msec) clat (usec): min=36, max=461154, avg=49726.07, stdev=33810.73 lat (usec): min=36, max=461156, avg=49735.36, stdev=33820.92 clat percentiles (usec): | 1.00th=[ 55], 5.00th=[ 5538], 10.00th=[ 17695], 20.00th=[ 25035], | 30.00th=[ 30802], 40.00th=[ 36439], 50.00th=[ 42730], 60.00th=[ 50594], | 70.00th=[ 60031], 80.00th=[ 70779], 90.00th=[ 89654], 95.00th=[106431], | 99.00th=[162530], 99.50th=[173016], 99.90th=[291505], 99.95th=[459277], | 99.99th=[459277] bw ( KiB/s): min= 7, max= 95, per=25.07%, avg=43.86, stdev=18.26, samples=266 iops : min= 1, max= 23, avg=10.30, stdev= 4.57, samples=266 write: IOPS=11, BW=46.7KiB/s (47.8kB/s)(6296KiB/134904msec); 0 zone resets clat (usec): min=997, max=263371, avg=38247.17, stdev=38998.90 lat (usec): min=999, max=263373, avg=38249.24, stdev=38998.66 clat percentiles (usec): | 1.00th=[ 1090], 5.00th=[ 1254], 10.00th=[ 1795], 20.00th=[ 4293], | 30.00th=[ 8029], 40.00th=[ 17957], 50.00th=[ 28181], 60.00th=[ 36439], | 70.00th=[ 49546], 80.00th=[ 66847], 90.00th=[ 92799], 95.00th=[114820], | 99.00th=[168821], 99.50th=[200279], 99.90th=[229639], 99.95th=[263193], | 99.99th=[263193] bw ( KiB/s): min= 7, max= 118, per=25.23%, avg=46.43, stdev=19.30, samples=264 iops : min= 1, max= 29, avg=10.95, stdev= 4.87, samples=264 lat (usec) : 50=0.10%, 100=2.02%, 250=0.13%, 500=0.03%, 750=0.03% lat (usec) : 1000=0.03% lat (msec) : 2=5.70%, 4=3.81%, 10=7.39%, 20=8.24%, 50=37.24% lat (msec) : 100=27.54%, 250=7.62%, 500=0.13% cpu : usr=0.08%, sys=4.93%, ctx=6455, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178979: Wed Aug 26 08:57:40 2026 read: IOPS=10, BW=43.5KiB/s (44.5kB/s)(5940KiB/136593msec) clat (usec): min=47, max=508798, avg=50660.97, stdev=34347.14 lat (usec): min=48, max=508803, avg=50667.79, stdev=34351.34 clat percentiles (usec): | 1.00th=[ 59], 5.00th=[ 13960], 10.00th=[ 18744], 20.00th=[ 26084], | 30.00th=[ 32637], 40.00th=[ 37487], 50.00th=[ 43254], 60.00th=[ 51119], | 70.00th=[ 58459], 80.00th=[ 71828], 90.00th=[ 90702], 95.00th=[108528], | 99.00th=[166724], 99.50th=[200279], 99.90th=[312476], 99.95th=[509608], | 99.99th=[509608] bw ( KiB/s): min= 5, max= 94, per=24.62%, avg=43.08, stdev=16.65, samples=268 iops : min= 1, max= 23, avg=10.11, stdev= 4.20, samples=268 write: IOPS=11, BW=46.5KiB/s (47.6kB/s)(6348KiB/136593msec); 0 zone resets clat (usec): min=955, max=282001, avg=38533.20, stdev=40088.25 lat (usec): min=958, max=282003, avg=38543.91, stdev=40086.57 clat percentiles (usec): | 1.00th=[ 1123], 5.00th=[ 1287], 10.00th=[ 1631], 20.00th=[ 3818], | 30.00th=[ 7767], 40.00th=[ 17433], 50.00th=[ 27919], 60.00th=[ 37487], | 70.00th=[ 49021], 80.00th=[ 67634], 90.00th=[ 94897], 95.00th=[120062], | 99.00th=[175113], 99.50th=[198181], 99.90th=[231736], 99.95th=[283116], | 99.99th=[283116] bw ( KiB/s): min= 7, max= 126, per=24.87%, avg=45.75, stdev=21.10, samples=269 iops : min= 1, max= 31, avg=10.78, stdev= 5.32, samples=269 lat (usec) : 50=0.07%, 100=1.50%, 250=0.13%, 750=0.03%, 1000=0.03% lat (msec) : 2=6.28%, 4=4.43%, 10=6.61%, 20=8.40%, 50=37.53% lat (msec) : 100=27.18%, 250=7.68%, 500=0.10%, 750=0.03% cpu : usr=0.06%, sys=4.82%, ctx=6414, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178980: Wed Aug 26 08:57:40 2026 read: IOPS=11, BW=44.5KiB/s (45.6kB/s)(6028KiB/135411msec) clat (usec): min=32, max=289996, avg=50037.72, stdev=34038.17 lat (usec): min=32, max=289997, avg=50040.70, stdev=34038.00 clat percentiles (usec): | 1.00th=[ 55], 5.00th=[ 627], 10.00th=[ 16909], 20.00th=[ 24773], | 30.00th=[ 30278], 40.00th=[ 36439], 50.00th=[ 43254], 60.00th=[ 51119], | 70.00th=[ 60556], 80.00th=[ 71828], 90.00th=[ 89654], 95.00th=[110625], | 99.00th=[175113], 99.50th=[193987], 99.90th=[265290], 99.95th=[291505], | 99.99th=[291505] bw ( KiB/s): min= 7, max= 87, per=25.27%, avg=44.23, stdev=17.13, samples=266 iops : min= 1, max= 21, avg=10.40, stdev= 4.31, samples=266 write: IOPS=11, BW=46.2KiB/s (47.3kB/s)(6260KiB/135411msec); 0 zone resets clat (usec): min=990, max=559275, avg=38228.31, stdev=41239.13 lat (usec): min=991, max=559278, avg=38231.03, stdev=41238.81 clat percentiles (usec): | 1.00th=[ 1156], 5.00th=[ 1270], 10.00th=[ 1876], 20.00th=[ 4621], | 30.00th=[ 7963], 40.00th=[ 15533], 50.00th=[ 26870], 60.00th=[ 36963], | 70.00th=[ 50070], 80.00th=[ 66323], 90.00th=[ 92799], 95.00th=[116917], | 99.00th=[168821], 99.50th=[189793], 99.90th=[274727], 99.95th=[557843], | 99.99th=[557843] bw ( KiB/s): min= 7, max= 103, per=25.04%, avg=46.07, stdev=20.49, samples=265 iops : min= 1, max= 25, avg=10.86, stdev= 5.18, samples=265 lat (usec) : 50=0.13%, 100=2.15%, 250=0.13%, 500=0.03%, 750=0.07% lat (usec) : 1000=0.07% lat (msec) : 2=5.57%, 4=3.68%, 10=8.14%, 20=8.50%, 50=36.04% lat (msec) : 100=27.83%, 250=7.55%, 500=0.10%, 750=0.03% cpu : usr=0.09%, sys=4.76%, ctx=6371, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178981: Wed Aug 26 08:57:40 2026 read: IOPS=11, BW=44.5KiB/s (45.6kB/s)(6052KiB/135994msec) clat (usec): min=35, max=319352, avg=48712.69, stdev=32989.23 lat (usec): min=36, max=319354, avg=48714.19, stdev=32989.24 clat percentiles (usec): | 1.00th=[ 54], 5.00th=[ 92], 10.00th=[ 17695], 20.00th=[ 24773], | 30.00th=[ 30540], 40.00th=[ 35914], 50.00th=[ 42206], 60.00th=[ 49021], | 70.00th=[ 57410], 80.00th=[ 68682], 90.00th=[ 90702], 95.00th=[106431], | 99.00th=[164627], 99.50th=[200279], 99.90th=[267387], 99.95th=[320865], | 99.99th=[320865] bw ( KiB/s): min= 7, max= 118, per=25.23%, avg=44.15, stdev=18.74, samples=267 iops : min= 1, max= 29, avg=10.37, stdev= 4.73, samples=267 write: IOPS=11, BW=45.9KiB/s (46.0kB/s)(6236KiB/135994msec); 0 zone resets clat (usec): min=1026, max=556573, avg=39846.53, stdev=43542.62 lat (usec): min=1027, max=556575, avg=39853.42, stdev=43543.79 clat percentiles (usec): | 1.00th=[ 1139], 5.00th=[ 1303], 10.00th=[ 2008], 20.00th=[ 4686], | 30.00th=[ 8848], 40.00th=[ 18220], 50.00th=[ 28181], 60.00th=[ 38011], | 70.00th=[ 51119], 80.00th=[ 69731], 90.00th=[ 92799], 95.00th=[122160], | 99.00th=[179307], 99.50th=[231736], 99.90th=[333448], 99.95th=[557843], | 99.99th=[557843] bw ( KiB/s): min= 7, max= 104, per=24.62%, avg=45.30, stdev=18.85, samples=268 iops : min= 1, max= 26, avg=10.66, stdev= 4.75, samples=268 lat (usec) : 50=0.16%, 100=2.34%, 250=0.07%, 500=0.03%, 750=0.03% lat (msec) : 2=5.05%, 4=4.04%, 10=7.36%, 20=8.56%, 50=37.99% lat (msec) : 100=26.86%, 250=7.29%, 500=0.20%, 750=0.03% cpu : usr=0.08%, sys=4.79%, ctx=6410, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=176KiB/s (180kB/s), 43.5KiB/s-44.5KiB/s (44.5kB/s-45.6kB/s), io=23.4MiB (24.6MB), run=134904-136593msec WRITE: bw=184KiB/s (188kB/s), 45.9KiB/s-46.7KiB/s (46.0kB/s-47.8kB/s), io=24.6MiB (25.7MB), run=134904-136593msec rand-rw: (groupid=0, jobs=1): err= 0: pid=178973: Wed Aug 26 08:58:22 2026 read: IOPS=8, BW=33.6KiB/s (34.4kB/s)(5992KiB/178185msec) clat (msec): min=6, max=754, avg=46.58, stdev=47.00 lat (msec): min=6, max=754, avg=46.58, stdev=47.00 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 18], | 30.00th=[ 22], 40.00th=[ 25], 50.00th=[ 30], 60.00th=[ 37], | 70.00th=[ 50], 80.00th=[ 67], 90.00th=[ 105], 95.00th=[ 142], | 99.00th=[ 211], 99.50th=[ 241], 99.90th=[ 405], 99.95th=[ 751], | 99.99th=[ 751] bw ( KiB/s): min= 7, max= 135, per=25.70%, avg=34.18, stdev=23.83, samples=338 iops : min= 1, max= 33, avg= 7.88, stdev= 6.03, samples=338 write: IOPS=8, BW=35.3KiB/s (36.2kB/s)(6296KiB/178185msec); 0 zone resets clat (msec): min=12, max=315, avg=68.59, stdev=47.72 lat (msec): min=12, max=315, avg=68.59, stdev=47.72 clat percentiles (msec): | 1.00th=[ 18], 5.00th=[ 23], 10.00th=[ 26], 20.00th=[ 32], | 30.00th=[ 37], 40.00th=[ 43], 50.00th=[ 52], 60.00th=[ 64], | 70.00th=[ 81], 80.00th=[ 104], 90.00th=[ 133], 95.00th=[ 163], | 99.00th=[ 249], 99.50th=[ 275], 99.90th=[ 313], 99.95th=[ 317], | 99.99th=[ 317] bw ( KiB/s): min= 7, max= 111, per=25.06%, avg=35.08, stdev=22.86, samples=347 iops : min= 1, max= 27, avg= 8.10, stdev= 5.77, samples=347 lat (msec) : 10=1.53%, 20=13.22%, 50=44.53%, 100=24.61%, 250=15.40% lat (msec) : 500=0.68%, 1000=0.03% cpu : usr=0.05%, sys=1.61%, ctx=4646, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178974: Wed Aug 26 08:58:22 2026 read: IOPS=8, BW=33.1KiB/s (33.9kB/s)(5940KiB/179330msec) clat (msec): min=5, max=822, avg=47.18, stdev=49.05 lat (msec): min=5, max=822, avg=47.18, stdev=49.05 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 14], 20.00th=[ 17], | 30.00th=[ 21], 40.00th=[ 26], 50.00th=[ 31], 60.00th=[ 37], | 70.00th=[ 49], 80.00th=[ 68], 90.00th=[ 108], 95.00th=[ 142], | 99.00th=[ 213], 99.50th=[ 253], 99.90th=[ 401], 99.95th=[ 827], | 99.99th=[ 827] bw ( KiB/s): min= 7, max= 128, per=25.80%, avg=34.32, stdev=24.44, samples=336 iops : min= 1, max= 32, avg= 7.91, stdev= 6.16, samples=336 write: IOPS=8, BW=35.4KiB/s (36.2kB/s)(6348KiB/179330msec); 0 zone resets clat (msec): min=12, max=361, avg=68.56, stdev=49.13 lat (msec): min=12, max=361, avg=68.56, stdev=49.13 clat percentiles (msec): | 1.00th=[ 18], 5.00th=[ 22], 10.00th=[ 26], 20.00th=[ 32], | 30.00th=[ 37], 40.00th=[ 43], 50.00th=[ 51], 60.00th=[ 63], | 70.00th=[ 80], 80.00th=[ 103], 90.00th=[ 134], 95.00th=[ 169], | 99.00th=[ 232], 99.50th=[ 296], 99.90th=[ 342], 99.95th=[ 363], | 99.99th=[ 363] bw ( KiB/s): min= 7, max= 119, per=25.23%, avg=35.32, stdev=23.33, samples=349 iops : min= 1, max= 29, avg= 8.16, stdev= 5.89, samples=349 lat (msec) : 10=1.50%, 20=13.96%, 50=44.34%, 100=24.15%, 250=15.33% lat (msec) : 500=0.68%, 1000=0.03% cpu : usr=0.07%, sys=1.56%, ctx=4680, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178975: Wed Aug 26 08:58:22 2026 read: IOPS=8, BW=33.8KiB/s (34.6kB/s)(6028KiB/178471msec) clat (msec): min=5, max=319, avg=46.17, stdev=43.89 lat (msec): min=5, max=319, avg=46.17, stdev=43.89 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 17], | 30.00th=[ 21], 40.00th=[ 25], 50.00th=[ 30], 60.00th=[ 38], | 70.00th=[ 49], 80.00th=[ 67], 90.00th=[ 105], 95.00th=[ 140], | 99.00th=[ 211], 99.50th=[ 257], 99.90th=[ 313], 99.95th=[ 321], | 99.99th=[ 321] bw ( KiB/s): min= 7, max= 136, per=25.84%, avg=34.36, stdev=24.80, samples=340 iops : min= 1, max= 34, avg= 7.92, stdev= 6.25, samples=340 write: IOPS=8, BW=35.1KiB/s (35.9kB/s)(6260KiB/178471msec); 0 zone resets clat (msec): min=12, max=846, avg=69.28, stdev=53.20 lat (msec): min=12, max=846, avg=69.28, stdev=53.20 clat percentiles (msec): | 1.00th=[ 18], 5.00th=[ 23], 10.00th=[ 26], 20.00th=[ 32], | 30.00th=[ 37], 40.00th=[ 43], 50.00th=[ 52], 60.00th=[ 63], | 70.00th=[ 81], 80.00th=[ 102], 90.00th=[ 136], 95.00th=[ 165], | 99.00th=[ 259], 99.50th=[ 288], 99.90th=[ 334], 99.95th=[ 844], | 99.99th=[ 844] bw ( KiB/s): min= 7, max= 110, per=25.10%, avg=35.14, stdev=23.30, samples=345 iops : min= 1, max= 27, avg= 8.12, stdev= 5.89, samples=345 lat (msec) : 10=1.69%, 20=13.61%, 50=44.53%, 100=24.41%, 250=14.84% lat (msec) : 500=0.88%, 1000=0.03% cpu : usr=0.06%, sys=1.60%, ctx=4715, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178976: Wed Aug 26 08:58:22 2026 read: IOPS=8, BW=34.0KiB/s (34.8kB/s)(6052KiB/177898msec) clat (msec): min=5, max=398, avg=46.67, stdev=43.47 lat (msec): min=5, max=398, avg=46.67, stdev=43.47 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 18], | 30.00th=[ 22], 40.00th=[ 26], 50.00th=[ 31], 60.00th=[ 37], | 70.00th=[ 49], 80.00th=[ 70], 90.00th=[ 105], 95.00th=[ 140], | 99.00th=[ 199], 99.50th=[ 247], 99.90th=[ 305], 99.95th=[ 401], | 99.99th=[ 401] bw ( KiB/s): min= 7, max= 125, per=26.51%, avg=35.26, stdev=23.96, samples=333 iops : min= 1, max= 31, avg= 8.15, stdev= 6.05, samples=333 write: IOPS=8, BW=35.1KiB/s (35.9kB/s)(6236KiB/177898msec); 0 zone resets clat (msec): min=10, max=844, avg=68.51, stdev=52.23 lat (msec): min=10, max=844, avg=68.51, stdev=52.23 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 23], 10.00th=[ 27], 20.00th=[ 32], | 30.00th=[ 37], 40.00th=[ 43], 50.00th=[ 52], 60.00th=[ 63], | 70.00th=[ 80], 80.00th=[ 102], 90.00th=[ 134], 95.00th=[ 165], | 99.00th=[ 239], 99.50th=[ 288], 99.90th=[ 347], 99.95th=[ 844], | 99.99th=[ 844] bw ( KiB/s): min= 7, max= 120, per=25.17%, avg=35.24, stdev=22.75, samples=343 iops : min= 1, max= 30, avg= 8.15, stdev= 5.76, samples=343 lat (msec) : 10=1.53%, 20=12.89%, 50=45.31%, 100=24.54%, 250=15.04% lat (msec) : 500=0.65%, 1000=0.03% cpu : usr=0.05%, sys=1.54%, ctx=4702, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=134KiB/s (137kB/s), 33.1KiB/s-34.0KiB/s (33.9kB/s-34.8kB/s), io=23.4MiB (24.6MB), run=177898-179330msec WRITE: bw=140KiB/s (144kB/s), 35.1KiB/s-35.4KiB/s (35.9kB/s-36.2kB/s), io=24.6MiB (25.7MB), run=177898-179330msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179026: Wed Aug 26 08:59:14 2026 read: IOPS=9, BW=152KiB/s (155kB/s)(5920KiB/39000msec) clat (usec): min=37, max=255964, avg=53808.24, stdev=35979.83 lat (usec): min=37, max=255966, avg=53809.57, stdev=35979.89 clat percentiles (usec): | 1.00th=[ 55], 5.00th=[ 69], 10.00th=[ 10290], 20.00th=[ 26870], | 30.00th=[ 35390], 40.00th=[ 42206], 50.00th=[ 49021], 60.00th=[ 55837], | 70.00th=[ 64750], 80.00th=[ 79168], 90.00th=[ 99091], 95.00th=[120062], | 99.00th=[170918], 99.50th=[198181], 99.90th=[256902], 99.95th=[256902], | 99.99th=[256902] bw ( KiB/s): min= 31, max= 254, per=24.40%, avg=149.79, stdev=56.23, samples=76 iops : min= 1, max= 15, avg= 8.57, stdev= 3.55, samples=76 write: IOPS=10, BW=163KiB/s (167kB/s)(6368KiB/39000msec); 0 zone resets clat (usec): min=1380, max=257913, avg=47061.19, stdev=43632.28 lat (usec): min=1382, max=257918, avg=47063.73, stdev=43632.36 clat percentiles (usec): | 1.00th=[ 1729], 5.00th=[ 2409], 10.00th=[ 4359], 20.00th=[ 8979], | 30.00th=[ 15795], 40.00th=[ 23725], 50.00th=[ 34866], 60.00th=[ 46400], | 70.00th=[ 60556], 80.00th=[ 78119], 90.00th=[112722], 95.00th=[133694], | 99.00th=[196084], 99.50th=[202376], 99.90th=[256902], 99.95th=[256902], | 99.99th=[256902] bw ( KiB/s): min= 22, max= 380, per=25.18%, avg=162.63, stdev=66.32, samples=76 iops : min= 1, max= 23, avg= 9.37, stdev= 4.20, samples=76 lat (usec) : 50=0.26%, 100=3.26%, 250=0.91%, 500=0.13%, 750=0.13% lat (msec) : 2=2.21%, 4=2.60%, 10=6.51%, 20=9.24%, 50=31.64% lat (msec) : 100=31.38%, 250=11.46%, 500=0.26% cpu : usr=0.06%, sys=4.95%, ctx=1762, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179027: Wed Aug 26 08:59:14 2026 read: IOPS=9, BW=148KiB/s (152kB/s)(5744KiB/38814msec) clat (usec): min=52, max=250843, avg=56192.86, stdev=38125.91 lat (usec): min=53, max=250844, avg=56198.00, stdev=38124.70 clat percentiles (usec): | 1.00th=[ 58], 5.00th=[ 65], 10.00th=[ 14746], 20.00th=[ 29230], | 30.00th=[ 34341], 40.00th=[ 43779], 50.00th=[ 51119], 60.00th=[ 58983], | 70.00th=[ 69731], 80.00th=[ 80217], 90.00th=[ 99091], 95.00th=[124257], | 99.00th=[177210], 99.50th=[250610], 99.90th=[250610], 99.95th=[250610], | 99.99th=[250610] bw ( KiB/s): min= 31, max= 285, per=24.05%, avg=147.64, stdev=59.96, samples=76 iops : min= 1, max= 17, avg= 8.43, stdev= 3.79, samples=76 write: IOPS=10, BW=169KiB/s (173kB/s)(6544KiB/38814msec); 0 zone resets clat (usec): min=1522, max=218944, avg=45250.74, stdev=41579.31 lat (usec): min=1522, max=218948, avg=45254.99, stdev=41578.68 clat percentiles (usec): | 1.00th=[ 1811], 5.00th=[ 3523], 10.00th=[ 5080], 20.00th=[ 9110], | 30.00th=[ 15401], 40.00th=[ 24773], 50.00th=[ 34866], 60.00th=[ 43254], | 70.00th=[ 55837], 80.00th=[ 77071], 90.00th=[104334], 95.00th=[130548], | 99.00th=[191890], 99.50th=[198181], 99.90th=[219153], 99.95th=[219153], | 99.99th=[219153] bw ( KiB/s): min= 63, max= 380, per=25.93%, avg=167.51, stdev=72.00, samples=76 iops : min= 3, max= 23, avg= 9.68, stdev= 4.57, samples=76 lat (usec) : 100=3.78%, 250=0.13%, 500=0.13% lat (msec) : 2=1.43%, 4=2.08%, 10=8.46%, 20=7.81%, 50=33.98% lat (msec) : 100=31.51%, 250=10.55%, 500=0.13% cpu : usr=0.07%, sys=4.92%, ctx=1755, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179028: Wed Aug 26 08:59:14 2026 read: IOPS=10, BW=166KiB/s (170kB/s)(6256KiB/37616msec) clat (usec): min=41, max=256066, avg=54021.01, stdev=35419.34 lat (usec): min=41, max=256068, avg=54047.53, stdev=35405.07 clat percentiles (usec): | 1.00th=[ 55], 5.00th=[ 69], 10.00th=[ 19530], 20.00th=[ 29492], | 30.00th=[ 36439], 40.00th=[ 42730], 50.00th=[ 49021], 60.00th=[ 55837], | 70.00th=[ 64750], 80.00th=[ 76022], 90.00th=[ 92799], 95.00th=[109577], | 99.00th=[198181], 99.50th=[252707], 99.90th=[256902], 99.95th=[256902], | 99.99th=[256902] bw ( KiB/s): min= 22, max= 320, per=27.28%, avg=167.52, stdev=59.32, samples=73 iops : min= 1, max= 20, avg= 9.68, stdev= 3.74, samples=73 write: IOPS=10, BW=160KiB/s (164kB/s)(6032KiB/37616msec); 0 zone resets clat (usec): min=1706, max=190209, avg=42951.92, stdev=39353.79 lat (usec): min=1708, max=190211, avg=42954.82, stdev=39354.51 clat percentiles (usec): | 1.00th=[ 1811], 5.00th=[ 2868], 10.00th=[ 4686], 20.00th=[ 8291], | 30.00th=[ 13829], 40.00th=[ 21890], 50.00th=[ 31589], 60.00th=[ 39584], | 70.00th=[ 56886], 80.00th=[ 74974], 90.00th=[102237], 95.00th=[123208], | 99.00th=[158335], 99.50th=[168821], 99.90th=[189793], 99.95th=[189793], | 99.99th=[189793] bw ( KiB/s): min= 31, max= 345, per=24.47%, avg=158.08, stdev=64.34, samples=73 iops : min= 1, max= 21, avg= 9.10, stdev= 4.06, samples=73 lat (usec) : 50=0.39%, 100=2.99%, 250=0.39%, 750=0.26% lat (msec) : 2=1.30%, 4=2.34%, 10=8.33%, 20=8.20%, 50=34.38% lat (msec) : 100=32.03%, 250=9.11%, 500=0.26% cpu : usr=0.06%, sys=5.17%, ctx=1705, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179029: Wed Aug 26 08:59:14 2026 read: IOPS=9, BW=159KiB/s (163kB/s)(6032KiB/37830msec) clat (usec): min=40, max=245807, avg=53411.42, stdev=36213.72 lat (usec): min=40, max=245808, avg=53416.49, stdev=36215.21 clat percentiles (usec): | 1.00th=[ 50], 5.00th=[ 64], 10.00th=[ 101], 20.00th=[ 27919], | 30.00th=[ 38011], 40.00th=[ 42206], 50.00th=[ 50070], 60.00th=[ 57410], | 70.00th=[ 65799], 80.00th=[ 77071], 90.00th=[ 92799], 95.00th=[117965], | 99.00th=[181404], 99.50th=[212861], 99.90th=[246416], 99.95th=[246416], | 99.99th=[246416] bw ( KiB/s): min= 31, max= 350, per=25.75%, avg=158.09, stdev=69.63, samples=74 iops : min= 1, max= 21, avg= 9.08, stdev= 4.42, samples=74 write: IOPS=10, BW=165KiB/s (169kB/s)(6256KiB/37830msec); 0 zone resets clat (usec): min=1578, max=225857, avg=44627.73, stdev=43226.40 lat (usec): min=1580, max=225859, avg=44634.86, stdev=43226.59 clat percentiles (usec): | 1.00th=[ 1663], 5.00th=[ 2212], 10.00th=[ 4178], 20.00th=[ 7308], | 30.00th=[ 13304], 40.00th=[ 20841], 50.00th=[ 33162], 60.00th=[ 43779], | 70.00th=[ 56886], 80.00th=[ 74974], 90.00th=[107480], 95.00th=[129500], | 99.00th=[196084], 99.50th=[221250], 99.90th=[225444], 99.95th=[225444], | 99.99th=[225444] bw ( KiB/s): min= 62, max= 476, per=25.58%, avg=165.26, stdev=77.87, samples=74 iops : min= 3, max= 29, avg= 9.54, stdev= 4.92, samples=74 lat (usec) : 50=0.52%, 100=4.30%, 250=0.78%, 500=0.39% lat (msec) : 2=2.47%, 4=2.34%, 10=8.20%, 20=7.42%, 50=31.12% lat (msec) : 100=32.81%, 250=9.64% cpu : usr=0.06%, sys=5.04%, ctx=1707, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=614KiB/s (629kB/s), 148KiB/s-166KiB/s (152kB/s-170kB/s), io=23.4MiB (24.5MB), run=37616-39000msec WRITE: bw=646KiB/s (662kB/s), 160KiB/s-169KiB/s (164kB/s-173kB/s), io=24.6MiB (25.8MB), run=37616-39000msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179022: Wed Aug 26 08:59:28 2026 read: IOPS=7, BW=113KiB/s (116kB/s)(5920KiB/52417msec) clat (msec): min=9, max=304, avg=56.31, stdev=45.63 lat (msec): min=9, max=304, avg=56.31, stdev=45.63 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 16], 10.00th=[ 20], 20.00th=[ 24], | 30.00th=[ 30], 40.00th=[ 35], 50.00th=[ 42], 60.00th=[ 50], | 70.00th=[ 60], 80.00th=[ 80], 90.00th=[ 124], 95.00th=[ 153], | 99.00th=[ 241], 99.50th=[ 284], 99.90th=[ 305], 99.95th=[ 305], | 99.99th=[ 305] bw ( KiB/s): min= 30, max= 349, per=25.50%, avg=114.73, stdev=67.26, samples=101 iops : min= 1, max= 21, avg= 6.35, stdev= 4.26, samples=101 write: IOPS=7, BW=121KiB/s (124kB/s)(6368KiB/52417msec); 0 zone resets clat (msec): min=15, max=354, avg=78.39, stdev=50.92 lat (msec): min=15, max=354, avg=78.42, stdev=50.91 clat percentiles (msec): | 1.00th=[ 22], 5.00th=[ 28], 10.00th=[ 32], 20.00th=[ 41], | 30.00th=[ 47], 40.00th=[ 54], 50.00th=[ 63], 60.00th=[ 75], | 70.00th=[ 89], 80.00th=[ 105], 90.00th=[ 153], 95.00th=[ 182], | 99.00th=[ 275], 99.50th=[ 305], 99.90th=[ 355], 99.95th=[ 355], | 99.99th=[ 355] bw ( KiB/s): min= 22, max= 317, per=25.78%, avg=122.22, stdev=67.15, samples=102 iops : min= 1, max= 19, avg= 6.81, stdev= 4.23, samples=102 lat (msec) : 10=0.26%, 20=5.21%, 50=41.93%, 100=34.64%, 250=17.06% lat (msec) : 500=0.91% cpu : usr=0.05%, sys=1.52%, ctx=1211, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179023: Wed Aug 26 08:59:28 2026 read: IOPS=6, BW=108KiB/s (111kB/s)(5744KiB/53112msec) clat (msec): min=9, max=316, avg=56.31, stdev=46.17 lat (msec): min=9, max=316, avg=56.31, stdev=46.17 clat percentiles (msec): | 1.00th=[ 13], 5.00th=[ 16], 10.00th=[ 18], 20.00th=[ 24], | 30.00th=[ 31], 40.00th=[ 36], 50.00th=[ 42], 60.00th=[ 50], | 70.00th=[ 63], 80.00th=[ 78], 90.00th=[ 116], 95.00th=[ 159], | 99.00th=[ 245], 99.50th=[ 259], 99.90th=[ 317], 99.95th=[ 317], | 99.99th=[ 317] bw ( KiB/s): min= 22, max= 348, per=25.83%, avg=116.25, stdev=71.05, samples=96 iops : min= 1, max= 21, avg= 6.45, stdev= 4.46, samples=96 write: IOPS=7, BW=123KiB/s (126kB/s)(6544KiB/53112msec); 0 zone resets clat (msec): min=14, max=323, avg=79.92, stdev=47.89 lat (msec): min=14, max=323, avg=79.92, stdev=47.89 clat percentiles (msec): | 1.00th=[ 25], 5.00th=[ 29], 10.00th=[ 34], 20.00th=[ 43], | 30.00th=[ 50], 40.00th=[ 58], 50.00th=[ 67], 60.00th=[ 78], | 70.00th=[ 91], 80.00th=[ 113], 90.00th=[ 142], 95.00th=[ 178], | 99.00th=[ 271], 99.50th=[ 279], 99.90th=[ 326], 99.95th=[ 326], | 99.99th=[ 326] bw ( KiB/s): min= 31, max= 352, per=26.25%, avg=124.43, stdev=64.23, samples=102 iops : min= 1, max= 22, avg= 6.95, stdev= 4.09, samples=102 lat (msec) : 10=0.13%, 20=6.90%, 50=38.15%, 100=34.51%, 250=19.27% lat (msec) : 500=1.04% cpu : usr=0.08%, sys=1.51%, ctx=1213, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179024: Wed Aug 26 08:59:28 2026 read: IOPS=7, BW=119KiB/s (121kB/s)(6256KiB/52730msec) clat (msec): min=10, max=314, avg=55.76, stdev=43.64 lat (msec): min=10, max=314, avg=55.76, stdev=43.64 clat percentiles (msec): | 1.00th=[ 12], 5.00th=[ 17], 10.00th=[ 20], 20.00th=[ 25], | 30.00th=[ 29], 40.00th=[ 34], 50.00th=[ 40], 60.00th=[ 48], | 70.00th=[ 59], 80.00th=[ 84], 90.00th=[ 121], 95.00th=[ 150], | 99.00th=[ 218], 99.50th=[ 247], 99.90th=[ 317], 99.95th=[ 317], | 99.99th=[ 317] bw ( KiB/s): min= 30, max= 382, per=27.58%, avg=124.11, stdev=76.41, samples=99 iops : min= 1, max= 23, avg= 6.92, stdev= 4.83, samples=99 write: IOPS=7, BW=114KiB/s (117kB/s)(6032KiB/52730msec); 0 zone resets clat (msec): min=19, max=356, avg=81.24, stdev=51.98 lat (msec): min=19, max=356, avg=81.24, stdev=51.98 clat percentiles (msec): | 1.00th=[ 23], 5.00th=[ 29], 10.00th=[ 33], 20.00th=[ 41], | 30.00th=[ 48], 40.00th=[ 57], 50.00th=[ 67], 60.00th=[ 78], | 70.00th=[ 90], 80.00th=[ 114], 90.00th=[ 150], 95.00th=[ 192], | 99.00th=[ 249], 99.50th=[ 330], 99.90th=[ 359], 99.95th=[ 359], | 99.99th=[ 359] bw ( KiB/s): min= 31, max= 256, per=23.85%, avg=113.04, stdev=59.99, samples=103 iops : min= 1, max= 16, avg= 6.24, stdev= 3.81, samples=103 lat (msec) : 20=5.47%, 50=42.45%, 100=32.16%, 250=19.40%, 500=0.52% cpu : usr=0.05%, sys=1.61%, ctx=1208, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179025: Wed Aug 26 08:59:28 2026 read: IOPS=7, BW=114KiB/s (116kB/s)(6032KiB/53119msec) clat (msec): min=10, max=308, avg=57.72, stdev=50.52 lat (msec): min=10, max=308, avg=57.72, stdev=50.52 clat percentiles (msec): | 1.00th=[ 13], 5.00th=[ 16], 10.00th=[ 18], 20.00th=[ 23], | 30.00th=[ 28], 40.00th=[ 33], 50.00th=[ 39], 60.00th=[ 47], | 70.00th=[ 62], 80.00th=[ 85], 90.00th=[ 136], 95.00th=[ 171], | 99.00th=[ 268], 99.50th=[ 300], 99.90th=[ 309], 99.95th=[ 309], | 99.99th=[ 309] bw ( KiB/s): min= 31, max= 352, per=25.43%, avg=114.44, stdev=69.67, samples=102 iops : min= 1, max= 22, avg= 6.32, stdev= 4.44, samples=102 write: IOPS=7, BW=118KiB/s (121kB/s)(6256KiB/53119msec); 0 zone resets clat (msec): min=20, max=246, avg=80.01, stdev=48.32 lat (msec): min=20, max=246, avg=80.01, stdev=48.32 clat percentiles (msec): | 1.00th=[ 24], 5.00th=[ 29], 10.00th=[ 34], 20.00th=[ 42], | 30.00th=[ 50], 40.00th=[ 56], 50.00th=[ 68], 60.00th=[ 77], | 70.00th=[ 92], 80.00th=[ 114], 90.00th=[ 155], 95.00th=[ 188], | 99.00th=[ 234], 99.50th=[ 245], 99.90th=[ 247], 99.95th=[ 247], | 99.99th=[ 247] bw ( KiB/s): min= 30, max= 284, per=25.44%, avg=120.57, stdev=61.87, samples=101 iops : min= 1, max= 17, avg= 6.70, stdev= 3.93, samples=101 lat (msec) : 20=6.51%, 50=41.28%, 100=32.42%, 250=19.14%, 500=0.65% cpu : usr=0.04%, sys=1.47%, ctx=1203, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=451KiB/s (462kB/s), 108KiB/s-119KiB/s (111kB/s-121kB/s), io=23.4MiB (24.5MB), run=52417-53119msec WRITE: bw=474KiB/s (486kB/s), 114KiB/s-123KiB/s (117kB/s-126kB/s), io=24.6MiB (25.8MB), run=52417-53119msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179044: Wed Aug 26 08:59:48 2026 read: IOPS=1, BW=1066KiB/s (1091kB/s)(7168KiB/6725msec) clat (usec): min=793, max=2702.0k, avg=541321.37, stdev=957422.75 lat (usec): min=795, max=2702.0k, avg=541323.09, stdev=957422.71 clat percentiles (usec): | 1.00th=[ 791], 5.00th=[ 791], 10.00th=[ 791], | 20.00th=[ 154141], 30.00th=[ 200279], 40.00th=[ 200279], | 50.00th=[ 200279], 60.00th=[ 254804], 70.00th=[ 254804], | 80.00th=[ 274727], 90.00th=[2701132], 95.00th=[2701132], | 99.00th=[2701132], 99.50th=[2701132], 99.90th=[2701132], | 99.95th=[2701132], 99.99th=[2701132] bw ( KiB/s): min= 2003, max= 4031, per=100.00%, avg=2886.50, stdev=1027.00, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 1.15, samples=4 write: IOPS=0, BW=761KiB/s (780kB/s)(5120KiB/6725msec); 0 zone resets clat (msec): min=199, max=933, avg=575.87, stdev=326.59 lat (msec): min=200, max=933, avg=576.21, stdev=326.26 clat percentiles (msec): | 1.00th=[ 201], 5.00th=[ 201], 10.00th=[ 201], 20.00th=[ 201], | 30.00th=[ 317], 40.00th=[ 317], 50.00th=[ 558], 60.00th=[ 558], | 70.00th=[ 877], 80.00th=[ 877], 90.00th=[ 936], 95.00th=[ 936], | 99.00th=[ 936], 99.50th=[ 936], 99.90th=[ 936], 99.95th=[ 936], | 99.99th=[ 936] bw ( KiB/s): min= 1872, max= 2035, per=50.34%, avg=1986.25, stdev=76.61, samples=4 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=4 lat (usec) : 1000=8.33% lat (msec) : 250=33.33%, 500=25.00%, 750=8.33%, 1000=16.67%, >=2000=8.33% cpu : usr=0.00%, sys=7.72%, ctx=607, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179045: Wed Aug 26 08:59:48 2026 read: IOPS=0, BW=282KiB/s (289kB/s)(2048KiB/7265msec) clat (msec): min=203, max=489, avg=346.31, stdev=202.05 lat (msec): min=203, max=489, avg=346.31, stdev=202.05 clat percentiles (msec): | 1.00th=[ 205], 5.00th=[ 205], 10.00th=[ 205], 20.00th=[ 205], | 30.00th=[ 205], 40.00th=[ 205], 50.00th=[ 205], 60.00th=[ 489], | 70.00th=[ 489], 80.00th=[ 489], 90.00th=[ 489], 95.00th=[ 489], | 99.00th=[ 489], 99.50th=[ 489], 99.90th=[ 489], 99.95th=[ 489], | 99.99th=[ 489] bw ( KiB/s): min= 1855, max= 2035, per=69.02%, avg=1945.00, stdev=127.28, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1409KiB/s (1443kB/s)(10.0MiB/7265msec); 0 zone resets clat (msec): min=159, max=3142, avg=648.16, stdev=914.47 lat (msec): min=159, max=3142, avg=648.46, stdev=914.35 clat percentiles (msec): | 1.00th=[ 159], 5.00th=[ 159], 10.00th=[ 159], 20.00th=[ 205], | 30.00th=[ 239], 40.00th=[ 243], 50.00th=[ 284], 60.00th=[ 309], | 70.00th=[ 338], 80.00th=[ 502], 90.00th=[ 1062], 95.00th=[ 3138], | 99.00th=[ 3138], 99.50th=[ 3138], 99.90th=[ 3138], 99.95th=[ 3138], | 99.99th=[ 3138] bw ( KiB/s): min= 1872, max= 6131, per=76.43%, avg=3015.83, stdev=1727.47, samples=6 iops : min= 1, max= 5, avg= 2.00, stdev= 1.67, samples=6 lat (msec) : 250=41.67%, 500=33.33%, 750=8.33%, 2000=8.33%, >=2000=8.33% cpu : usr=0.01%, sys=8.70%, ctx=165, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179046: Wed Aug 26 08:59:48 2026 read: IOPS=0, BW=946KiB/s (968kB/s)(6144KiB/6497msec) clat (usec): min=504, max=301595, avg=61137.91, stdev=118683.94 lat (usec): min=505, max=301597, avg=61139.33, stdev=118684.06 clat percentiles (usec): | 1.00th=[ 506], 5.00th=[ 506], 10.00th=[ 506], 20.00th=[ 1123], | 30.00th=[ 1123], 40.00th=[ 2737], 50.00th=[ 2737], 60.00th=[ 26346], | 70.00th=[ 34866], 80.00th=[ 34866], 90.00th=[299893], 95.00th=[299893], | 99.00th=[299893], 99.50th=[299893], 99.90th=[299893], 99.95th=[299893], | 99.99th=[299893] bw ( KiB/s): min= 2035, max= 4047, per=100.00%, avg=3363.00, stdev=1150.26, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 write: IOPS=0, BW=946KiB/s (968kB/s)(6144KiB/6497msec); 0 zone resets clat (msec): min=167, max=3040, avg=1004.23, stdev=1045.08 lat (msec): min=168, max=3041, avg=1004.32, stdev=1045.08 clat percentiles (msec): | 1.00th=[ 169], 5.00th=[ 169], 10.00th=[ 169], 20.00th=[ 334], | 30.00th=[ 334], 40.00th=[ 659], 50.00th=[ 659], 60.00th=[ 785], | 70.00th=[ 1036], 80.00th=[ 1036], 90.00th=[ 3037], 95.00th=[ 3037], | 99.00th=[ 3037], 99.50th=[ 3037], 99.90th=[ 3037], 99.95th=[ 3037], | 99.99th=[ 3037] bw ( KiB/s): min= 2003, max= 4087, per=64.29%, avg=2537.00, stdev=1033.42, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (usec) : 750=8.33% lat (msec) : 2=8.33%, 4=8.33%, 50=16.67%, 250=8.33%, 500=16.67% lat (msec) : 750=8.33%, 1000=8.33%, 2000=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=5.96%, ctx=108, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179047: Wed Aug 26 08:59:48 2026 read: IOPS=0, BW=834KiB/s (854kB/s)(5120KiB/6139msec) clat (msec): min=3, max=330, avg=228.17, stdev=130.30 lat (msec): min=3, max=330, avg=228.17, stdev=130.30 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 4], 10.00th=[ 4], 20.00th=[ 4], | 30.00th=[ 234], 40.00th=[ 234], 50.00th=[ 284], 60.00th=[ 284], | 70.00th=[ 292], 80.00th=[ 292], 90.00th=[ 330], 95.00th=[ 330], | 99.00th=[ 330], 99.50th=[ 330], 99.90th=[ 330], 99.95th=[ 330], | 99.99th=[ 330] bw ( KiB/s): min= 4047, max= 4063, per=100.00%, avg=4055.00, stdev=11.31, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1168KiB/s (1196kB/s)(7168KiB/6139msec); 0 zone resets clat (msec): min=233, max=2743, avg=703.74, stdev=909.54 lat (msec): min=234, max=2743, avg=704.25, stdev=909.34 clat percentiles (msec): | 1.00th=[ 234], 5.00th=[ 234], 10.00th=[ 234], 20.00th=[ 247], | 30.00th=[ 321], 40.00th=[ 321], 50.00th=[ 338], 60.00th=[ 401], | 70.00th=[ 401], 80.00th=[ 642], 90.00th=[ 2735], 95.00th=[ 2735], | 99.00th=[ 2735], 99.50th=[ 2735], 99.90th=[ 2735], 99.95th=[ 2735], | 99.99th=[ 2735] bw ( KiB/s): min= 1872, max= 4007, per=60.62%, avg=2392.00, stdev=905.36, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 lat (msec) : 4=8.33%, 250=25.00%, 500=50.00%, 750=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=9.32%, ctx=223, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2819KiB/s (2887kB/s), 282KiB/s-1066KiB/s (289kB/s-1091kB/s), io=20.0MiB (20.0MB), run=6139-7265msec WRITE: bw=3947KiB/s (4041kB/s), 761KiB/s-1409KiB/s (780kB/s-1443kB/s), io=28.0MiB (29.4MB), run=6139-7265msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179049: Wed Aug 26 08:59:50 2026 read: IOPS=0, BW=897KiB/s (919kB/s)(7168KiB/7989msec) clat (msec): min=169, max=2440, avg=995.11, stdev=824.72 lat (msec): min=169, max=2440, avg=995.11, stdev=824.72 clat percentiles (msec): | 1.00th=[ 169], 5.00th=[ 169], 10.00th=[ 169], 20.00th=[ 171], | 30.00th=[ 558], 40.00th=[ 558], 50.00th=[ 936], 60.00th=[ 1036], | 70.00th=[ 1036], 80.00th=[ 1653], 90.00th=[ 2433], 95.00th=[ 2433], | 99.00th=[ 2433], 99.50th=[ 2433], 99.90th=[ 2433], 99.95th=[ 2433], | 99.99th=[ 2433] bw ( KiB/s): min= 2011, max= 2043, per=79.28%, avg=2029.67, stdev=12.31, samples=6 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=6 write: IOPS=0, BW=641KiB/s (656kB/s)(5120KiB/7989msec); 0 zone resets clat (msec): min=137, max=200, avg=164.77, stdev=24.23 lat (msec): min=137, max=200, avg=164.88, stdev=24.23 clat percentiles (msec): | 1.00th=[ 138], 5.00th=[ 138], 10.00th=[ 138], 20.00th=[ 138], | 30.00th=[ 150], 40.00th=[ 150], 50.00th=[ 163], 60.00th=[ 163], | 70.00th=[ 174], 80.00th=[ 174], 90.00th=[ 201], 95.00th=[ 201], | 99.00th=[ 201], 99.50th=[ 201], 99.90th=[ 201], 99.95th=[ 201], | 99.99th=[ 201] bw ( KiB/s): min= 2035, max= 4079, per=75.86%, avg=2719.00, stdev=1177.80, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (msec) : 250=58.33%, 750=8.33%, 1000=8.33%, 2000=16.67%, >=2000=8.33% cpu : usr=0.00%, sys=2.58%, ctx=88, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179050: Wed Aug 26 08:59:50 2026 read: IOPS=0, BW=262KiB/s (268kB/s)(2048KiB/7818msec) clat (msec): min=144, max=336, avg=240.72, stdev=135.57 lat (msec): min=144, max=336, avg=240.72, stdev=135.58 clat percentiles (msec): | 1.00th=[ 146], 5.00th=[ 146], 10.00th=[ 146], 20.00th=[ 146], | 30.00th=[ 146], 40.00th=[ 146], 50.00th=[ 146], 60.00th=[ 338], | 70.00th=[ 338], 80.00th=[ 338], 90.00th=[ 338], 95.00th=[ 338], | 99.00th=[ 338], 99.50th=[ 338], 99.90th=[ 338], 99.95th=[ 338], | 99.99th=[ 338] bw ( KiB/s): min= 2011, max= 2048, per=79.28%, avg=2029.50, stdev=26.16, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 write: IOPS=1, BW=1310KiB/s (1341kB/s)(10.0MiB/7818msec); 0 zone resets clat (msec): min=100, max=3594, avg=724.41, stdev=1049.36 lat (msec): min=100, max=3594, avg=724.72, stdev=1049.28 clat percentiles (msec): | 1.00th=[ 102], 5.00th=[ 102], 10.00th=[ 102], 20.00th=[ 108], | 30.00th=[ 133], 40.00th=[ 359], 50.00th=[ 363], 60.00th=[ 397], | 70.00th=[ 397], 80.00th=[ 818], 90.00th=[ 978], 95.00th=[ 3608], | 99.00th=[ 3608], 99.50th=[ 3608], 99.90th=[ 3608], 99.95th=[ 3608], | 99.99th=[ 3608] bw ( KiB/s): min= 1969, max= 4071, per=75.38%, avg=2701.50, stdev=1054.99, samples=6 iops : min= 1, max= 3, avg= 1.83, stdev= 0.98, samples=6 lat (msec) : 250=33.33%, 500=41.67%, 1000=16.67%, >=2000=8.33% cpu : usr=0.03%, sys=2.96%, ctx=88, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179051: Wed Aug 26 08:59:50 2026 read: IOPS=0, BW=864KiB/s (885kB/s)(6144KiB/7110msec) clat (msec): min=216, max=504, avg=313.18, stdev=114.73 lat (msec): min=216, max=504, avg=313.18, stdev=114.73 clat percentiles (msec): | 1.00th=[ 218], 5.00th=[ 218], 10.00th=[ 218], 20.00th=[ 222], | 30.00th=[ 222], 40.00th=[ 236], 50.00th=[ 236], 60.00th=[ 313], | 70.00th=[ 388], 80.00th=[ 388], 90.00th=[ 506], 95.00th=[ 506], | 99.00th=[ 506], 99.50th=[ 506], 99.90th=[ 506], 99.95th=[ 506], | 99.99th=[ 506] bw ( KiB/s): min= 1969, max= 2043, per=78.82%, avg=2017.80, stdev=29.72, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 write: IOPS=0, BW=864KiB/s (885kB/s)(6144KiB/7110msec); 0 zone resets clat (msec): min=118, max=3583, avg=868.84, stdev=1340.41 lat (msec): min=118, max=3583, avg=868.97, stdev=1340.41 clat percentiles (msec): | 1.00th=[ 118], 5.00th=[ 118], 10.00th=[ 118], 20.00th=[ 161], | 30.00th=[ 161], 40.00th=[ 384], 50.00th=[ 384], 60.00th=[ 393], | 70.00th=[ 575], 80.00th=[ 575], 90.00th=[ 3574], 95.00th=[ 3574], | 99.00th=[ 3574], 99.50th=[ 3574], 99.90th=[ 3574], 99.95th=[ 3574], | 99.99th=[ 3574] bw ( KiB/s): min= 2031, max= 2959, per=61.94%, avg=2219.80, stdev=413.25, samples=5 iops : min= 1, max= 2, avg= 1.20, stdev= 0.45, samples=5 lat (msec) : 250=41.67%, 500=33.33%, 750=16.67%, >=2000=8.33% cpu : usr=0.00%, sys=3.05%, ctx=151, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179052: Wed Aug 26 08:59:50 2026 read: IOPS=0, BW=640KiB/s (655kB/s)(5120KiB/7999msec) clat (msec): min=141, max=907, avg=390.62, stdev=342.93 lat (msec): min=141, max=907, avg=390.62, stdev=342.93 clat percentiles (msec): | 1.00th=[ 142], 5.00th=[ 142], 10.00th=[ 142], 20.00th=[ 142], | 30.00th=[ 148], 40.00th=[ 148], 50.00th=[ 178], 60.00th=[ 178], | 70.00th=[ 584], 80.00th=[ 584], 90.00th=[ 911], 95.00th=[ 911], | 99.00th=[ 911], 99.50th=[ 911], 99.90th=[ 911], 99.95th=[ 911], | 99.99th=[ 911] bw ( KiB/s): min= 2035, max= 4096, per=100.00%, avg=2723.33, stdev=1188.77, samples=3 iops : min= 1, max= 4, avg= 2.00, stdev= 1.73, samples=3 write: IOPS=0, BW=896KiB/s (918kB/s)(7168KiB/7999msec); 0 zone resets clat (msec): min=155, max=3456, avg=852.54, stdev=1175.02 lat (msec): min=156, max=3457, avg=852.81, stdev=1175.42 clat percentiles (msec): | 1.00th=[ 157], 5.00th=[ 157], 10.00th=[ 157], 20.00th=[ 182], | 30.00th=[ 292], 40.00th=[ 292], 50.00th=[ 493], 60.00th=[ 502], | 70.00th=[ 502], 80.00th=[ 894], 90.00th=[ 3440], 95.00th=[ 3440], | 99.00th=[ 3440], 99.50th=[ 3440], 99.90th=[ 3440], 99.95th=[ 3440], | 99.99th=[ 3440] bw ( KiB/s): min= 1969, max= 2043, per=56.30%, avg=2017.80, stdev=29.99, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 lat (msec) : 250=41.67%, 500=16.67%, 750=16.67%, 1000=16.67%, >=2000=8.33% cpu : usr=0.00%, sys=3.33%, ctx=116, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2560KiB/s (2622kB/s), 262KiB/s-897KiB/s (268kB/s-919kB/s), io=20.0MiB (20.0MB), run=7110-7999msec WRITE: bw=3584KiB/s (3670kB/s), 641KiB/s-1310KiB/s (656kB/s-1341kB/s), io=28.0MiB (29.4MB), run=7110-7999msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179064: Wed Aug 26 09:00:08 2026 read: IOPS=0, BW=3969KiB/s (4064kB/s)(12.0MiB/3096msec) clat (msec): min=669, max=1437, avg=1014.50, stdev=389.82 lat (msec): min=669, max=1437, avg=1014.50, stdev=389.82 clat percentiles (msec): | 1.00th=[ 667], 5.00th=[ 667], 10.00th=[ 667], 20.00th=[ 667], | 30.00th=[ 667], 40.00th=[ 936], 50.00th=[ 936], 60.00th=[ 936], | 70.00th=[ 1435], 80.00th=[ 1435], 90.00th=[ 1435], 95.00th=[ 1435], | 99.00th=[ 1435], 99.50th=[ 1435], 99.90th=[ 1435], 99.95th=[ 1435], | 99.99th=[ 1435] bw ( KiB/s): min= 7984, max= 8094, per=100.00%, avg=8039.00, stdev=77.78, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=3.17%, ctx=52, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179065: Wed Aug 26 09:00:08 2026 read: IOPS=0, BW=1002KiB/s (1026kB/s)(4096KiB/4089msec) clat (nsec): min=2044.5M, max=2044.5M, avg=2044461658.00, stdev= 0.00 lat (nsec): min=2044.5M, max=2044.5M, avg=2044464831.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 2039], 5.00th=[ 2039], 10.00th=[ 2039], 20.00th=[ 2039], | 30.00th=[ 2039], 40.00th=[ 2039], 50.00th=[ 2039], 60.00th=[ 2039], | 70.00th=[ 2039], 80.00th=[ 2039], 90.00th=[ 2039], 95.00th=[ 2039], | 99.00th=[ 2039], 99.50th=[ 2039], 99.90th=[ 2039], 99.95th=[ 2039], | 99.99th=[ 2039] bw ( KiB/s): min= 8094, max= 8094, per=100.00%, avg=8094.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2003KiB/s (2052kB/s)(8192KiB/4089msec); 0 zone resets clat (msec): min=662, max=1315, avg=988.97, stdev=462.21 lat (msec): min=662, max=1316, avg=989.53, stdev=462.26 clat percentiles (msec): | 1.00th=[ 659], 5.00th=[ 659], 10.00th=[ 659], 20.00th=[ 659], | 30.00th=[ 659], 40.00th=[ 659], 50.00th=[ 659], 60.00th=[ 1318], | 70.00th=[ 1318], 80.00th=[ 1318], 90.00th=[ 1318], 95.00th=[ 1318], | 99.00th=[ 1318], 99.50th=[ 1318], 99.90th=[ 1318], 99.95th=[ 1318], | 99.99th=[ 1318] bw ( KiB/s): min= 8078, max= 8078, per=100.00%, avg=8078.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=2.05%, ctx=53, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179066: Wed Aug 26 09:00:08 2026 write: IOPS=0, BW=3180KiB/s (3256kB/s)(12.0MiB/3864msec); 0 zone resets clat (msec): min=324, max=2742, avg=1245.88, stdev=1307.97 lat (msec): min=324, max=2743, avg=1246.39, stdev=1307.96 clat percentiles (msec): | 1.00th=[ 326], 5.00th=[ 326], 10.00th=[ 326], 20.00th=[ 326], | 30.00th=[ 326], 40.00th=[ 667], 50.00th=[ 667], 60.00th=[ 667], | 70.00th=[ 2735], 80.00th=[ 2735], 90.00th=[ 2735], 95.00th=[ 2735], | 99.00th=[ 2735], 99.50th=[ 2735], 99.90th=[ 2735], 99.95th=[ 2735], | 99.99th=[ 2735] bw ( KiB/s): min= 7846, max= 8078, per=99.36%, avg=7962.00, stdev=164.05, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 750=33.33%, >=2000=33.33% cpu : usr=0.05%, sys=2.95%, ctx=55, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179067: Wed Aug 26 09:00:08 2026 write: IOPS=0, BW=3253KiB/s (3331kB/s)(12.0MiB/3778msec); 0 zone resets clat (msec): min=951, max=1446, avg=1237.88, stdev=256.77 lat (msec): min=951, max=1447, avg=1238.45, stdev=257.11 clat percentiles (msec): | 1.00th=[ 953], 5.00th=[ 953], 10.00th=[ 953], 20.00th=[ 953], | 30.00th=[ 953], 40.00th=[ 1318], 50.00th=[ 1318], 60.00th=[ 1318], | 70.00th=[ 1452], 80.00th=[ 1452], 90.00th=[ 1452], 95.00th=[ 1452], | 99.00th=[ 1452], 99.50th=[ 1452], 99.90th=[ 1452], 99.95th=[ 1452], | 99.99th=[ 1452] bw ( KiB/s): min= 7846, max= 7984, per=98.78%, avg=7915.00, stdev=97.58, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=33.33%, 2000=66.67% cpu : usr=0.00%, sys=2.67%, ctx=39, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4007KiB/s (4103kB/s), 1002KiB/s-3969KiB/s (1026kB/s-4064kB/s), io=16.0MiB (16.8MB), run=3096-4089msec WRITE: bw=8014KiB/s (8206kB/s), 2003KiB/s-3253KiB/s (2052kB/s-3331kB/s), io=32.0MiB (33.6MB), run=3778-4089msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179059: Wed Aug 26 09:00:08 2026 read: IOPS=1, BW=4130KiB/s (4230kB/s)(12.0MiB/2975msec) clat (msec): min=822, max=1174, avg=971.20, stdev=182.58 lat (msec): min=822, max=1174, avg=971.20, stdev=182.58 clat percentiles (msec): | 1.00th=[ 827], 5.00th=[ 827], 10.00th=[ 827], 20.00th=[ 827], | 30.00th=[ 827], 40.00th=[ 919], 50.00th=[ 919], 60.00th=[ 919], | 70.00th=[ 1183], 80.00th=[ 1183], 90.00th=[ 1183], 95.00th=[ 1183], | 99.00th=[ 1183], 99.50th=[ 1183], 99.90th=[ 1183], 99.95th=[ 1183], | 99.99th=[ 1183] bw ( KiB/s): min= 8175, max= 8175, per=100.00%, avg=8175.00, stdev= 0.00, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=66.67%, 2000=33.33% cpu : usr=0.00%, sys=11.60%, ctx=342, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179060: Wed Aug 26 09:00:08 2026 read: IOPS=0, BW=1200KiB/s (1229kB/s)(4096KiB/3413msec) clat (nsec): min=1035.5M, max=1035.5M, avg=1035535567.00, stdev= 0.00 lat (nsec): min=1035.5M, max=1035.5M, avg=1035538801.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1036], 5.00th=[ 1036], 10.00th=[ 1036], 20.00th=[ 1036], | 30.00th=[ 1036], 40.00th=[ 1036], 50.00th=[ 1036], 60.00th=[ 1036], | 70.00th=[ 1036], 80.00th=[ 1036], 90.00th=[ 1036], 95.00th=[ 1036], | 99.00th=[ 1036], 99.50th=[ 1036], 99.90th=[ 1036], 99.95th=[ 1036], | 99.99th=[ 1036] bw ( KiB/s): min= 8175, max= 8175, per=100.00%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2400KiB/s (2458kB/s)(8192KiB/3413msec); 0 zone resets clat (msec): min=999, max=1332, avg=1166.09, stdev=236.04 lat (msec): min=999, max=1333, avg=1166.71, stdev=236.24 clat percentiles (msec): | 1.00th=[ 1003], 5.00th=[ 1003], 10.00th=[ 1003], 20.00th=[ 1003], | 30.00th=[ 1003], 40.00th=[ 1003], 50.00th=[ 1003], 60.00th=[ 1334], | 70.00th=[ 1334], 80.00th=[ 1334], 90.00th=[ 1334], 95.00th=[ 1334], | 99.00th=[ 1334], 99.50th=[ 1334], 99.90th=[ 1334], 99.95th=[ 1334], | 99.99th=[ 1334] bw ( KiB/s): min= 8175, max= 8175, per=100.00%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 1000=33.33%, 2000=66.67% cpu : usr=0.00%, sys=4.34%, ctx=114, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179061: Wed Aug 26 09:00:08 2026 write: IOPS=0, BW=2890KiB/s (2959kB/s)(12.0MiB/4252msec); 0 zone resets clat (msec): min=267, max=3238, avg=1400.70, stdev=1606.07 lat (msec): min=267, max=3239, avg=1401.31, stdev=1606.41 clat percentiles (msec): | 1.00th=[ 268], 5.00th=[ 268], 10.00th=[ 268], 20.00th=[ 268], | 30.00th=[ 268], 40.00th=[ 693], 50.00th=[ 693], 60.00th=[ 693], | 70.00th=[ 3239], 80.00th=[ 3239], 90.00th=[ 3239], 95.00th=[ 3239], | 99.00th=[ 3239], 99.50th=[ 3239], 99.90th=[ 3239], 99.95th=[ 3239], | 99.99th=[ 3239] bw ( KiB/s): min= 7907, max= 8143, per=100.00%, avg=8025.00, stdev=166.88, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 750=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=3.34%, ctx=54, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179062: Wed Aug 26 09:00:08 2026 write: IOPS=0, BW=3399KiB/s (3481kB/s)(12.0MiB/3615msec); 0 zone resets clat (msec): min=619, max=1938, avg=1178.83, stdev=682.03 lat (msec): min=619, max=1939, avg=1180.11, stdev=681.71 clat percentiles (msec): | 1.00th=[ 617], 5.00th=[ 617], 10.00th=[ 617], 20.00th=[ 617], | 30.00th=[ 617], 40.00th=[ 978], 50.00th=[ 978], 60.00th=[ 978], | 70.00th=[ 1938], 80.00th=[ 1938], 90.00th=[ 1938], 95.00th=[ 1938], | 99.00th=[ 1938], 99.50th=[ 1938], 99.90th=[ 1938], 99.95th=[ 1938], | 99.99th=[ 1938] bw ( KiB/s): min= 8175, max= 8175, per=100.00%, avg=8175.00, stdev= 0.00, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=2.77%, ctx=49, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4800KiB/s (4916kB/s), 1200KiB/s-4130KiB/s (1229kB/s-4230kB/s), io=16.0MiB (16.8MB), run=2975-3413msec WRITE: bw=7706KiB/s (7891kB/s), 2400KiB/s-3399KiB/s (2458kB/s-3481kB/s), io=32.0MiB (33.6MB), run=3413-4252msec