== sanity test 398b: DIO and buffer IO race ============== 14:58:16 (1783969096) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 7.61684 s, 6.6 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179604: Mon Jul 13 15:01:11 2026 read: IOPS=9, BW=39.5KiB/s (40.5kB/s)(5992KiB/151611msec) clat (usec): min=45, max=1090.7k, avg=55846.97, stdev=45895.11 lat (usec): min=47, max=1090.7k, avg=55878.77, stdev=45891.93 clat percentiles (usec): | 1.00th=[ 52], 5.00th=[ 14091], 10.00th=[ 20317], | 20.00th=[ 27395], 30.00th=[ 34341], 40.00th=[ 41157], | 50.00th=[ 46924], 60.00th=[ 54789], 70.00th=[ 63701], | 80.00th=[ 76022], 90.00th=[ 101188], 95.00th=[ 128451], | 99.00th=[ 196084], 99.50th=[ 233833], 99.90th=[ 295699], | 99.95th=[1098908], 99.99th=[1098908] bw ( KiB/s): min= 7, max= 101, per=25.03%, avg=39.30, stdev=17.56, samples=295 iops : min= 1, max= 25, avg= 9.14, stdev= 4.42, samples=295 write: IOPS=10, BW=41.5KiB/s (42.5kB/s)(6296KiB/151611msec); 0 zone resets clat (usec): min=898, max=350899, avg=42784.84, stdev=44970.93 lat (usec): min=900, max=350901, avg=42792.83, stdev=44968.39 clat percentiles (usec): | 1.00th=[ 1221], 5.00th=[ 1352], 10.00th=[ 1631], 20.00th=[ 4621], | 30.00th=[ 10421], 40.00th=[ 19006], 50.00th=[ 28705], 60.00th=[ 40633], | 70.00th=[ 55313], 80.00th=[ 76022], 90.00th=[103285], 95.00th=[126354], | 99.00th=[212861], 99.50th=[242222], 99.90th=[278922], 99.95th=[350225], | 99.99th=[350225] bw ( KiB/s): min= 7, max= 111, per=25.31%, avg=41.75, stdev=20.63, samples=292 iops : min= 1, max= 27, avg= 9.77, stdev= 5.18, samples=292 lat (usec) : 50=0.10%, 100=1.40%, 250=0.10%, 1000=0.07% lat (msec) : 2=5.79%, 4=3.55%, 10=5.76%, 20=8.98%, 50=34.77% lat (msec) : 100=28.71%, 250=10.45%, 500=0.29%, 2000=0.03% cpu : usr=0.06%, sys=3.99%, ctx=6504, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179605: Mon Jul 13 15:01:11 2026 read: IOPS=9, BW=39.1KiB/s (40.0kB/s)(5940KiB/152036msec) clat (usec): min=42, max=1479.9k, avg=56788.68, stdev=53016.84 lat (usec): min=43, max=1479.9k, avg=56797.64, stdev=53014.41 clat percentiles (usec): | 1.00th=[ 56], 5.00th=[ 13698], 10.00th=[ 19792], | 20.00th=[ 27919], 30.00th=[ 33817], 40.00th=[ 40109], | 50.00th=[ 46924], 60.00th=[ 55837], 70.00th=[ 66847], | 80.00th=[ 80217], 90.00th=[ 101188], 95.00th=[ 124257], | 99.00th=[ 196084], 99.50th=[ 231736], 99.90th=[ 337642], | 99.95th=[1484784], 99.99th=[1484784] bw ( KiB/s): min= 7, max= 95, per=25.03%, avg=39.30, stdev=17.33, samples=293 iops : min= 1, max= 23, avg= 9.16, stdev= 4.38, samples=293 write: IOPS=10, BW=41.8KiB/s (42.8kB/s)(6348KiB/152036msec); 0 zone resets clat (usec): min=866, max=395757, avg=42323.39, stdev=44902.25 lat (usec): min=867, max=395759, avg=42326.55, stdev=44904.14 clat percentiles (usec): | 1.00th=[ 1237], 5.00th=[ 1352], 10.00th=[ 1795], 20.00th=[ 4015], | 30.00th=[ 8586], 40.00th=[ 19530], 50.00th=[ 29754], 60.00th=[ 40109], | 70.00th=[ 54264], 80.00th=[ 74974], 90.00th=[103285], 95.00th=[127402], | 99.00th=[179307], 99.50th=[229639], 99.90th=[371196], 99.95th=[396362], | 99.99th=[396362] bw ( KiB/s): min= 7, max= 127, per=25.33%, avg=41.80, stdev=20.87, samples=294 iops : min= 1, max= 31, avg= 9.80, stdev= 5.26, samples=294 lat (usec) : 50=0.13%, 100=1.27%, 250=0.07%, 1000=0.13% lat (msec) : 2=5.70%, 4=4.52%, 10=6.09%, 20=8.04%, 50=34.51% lat (msec) : 100=28.81%, 250=10.35%, 500=0.36%, 2000=0.03% cpu : usr=0.07%, sys=4.02%, ctx=6400, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179606: Mon Jul 13 15:01:11 2026 read: IOPS=9, BW=39.7KiB/s (40.7kB/s)(6028KiB/151758msec) clat (usec): min=40, max=313707, avg=55994.83, stdev=38752.28 lat (usec): min=40, max=313709, avg=56004.12, stdev=38748.61 clat percentiles (usec): | 1.00th=[ 57], 5.00th=[ 15533], 10.00th=[ 20841], 20.00th=[ 26870], | 30.00th=[ 32900], 40.00th=[ 40109], 50.00th=[ 47449], 60.00th=[ 55837], | 70.00th=[ 65274], 80.00th=[ 78119], 90.00th=[102237], 95.00th=[125305], | 99.00th=[204473], 99.50th=[252707], 99.90th=[308282], 99.95th=[312476], | 99.99th=[312476] bw ( KiB/s): min= 7, max= 104, per=25.38%, avg=39.84, stdev=16.69, samples=293 iops : min= 1, max= 26, avg= 9.30, stdev= 4.22, samples=293 write: IOPS=10, BW=41.2KiB/s (42.2kB/s)(6260KiB/151758msec); 0 zone resets clat (usec): min=1020, max=1488.1k, avg=42721.94, stdev=56924.54 lat (usec): min=1021, max=1488.1k, avg=42726.36, stdev=56924.80 clat percentiles (usec): | 1.00th=[ 1205], 5.00th=[ 1369], 10.00th=[ 1876], | 20.00th=[ 4883], 30.00th=[ 10290], 40.00th=[ 20055], | 50.00th=[ 29754], 60.00th=[ 40109], 70.00th=[ 52691], | 80.00th=[ 70779], 90.00th=[ 102237], 95.00th=[ 132645], | 99.00th=[ 183501], 99.50th=[ 223347], 99.90th=[ 316670], | 99.95th=[1484784], 99.99th=[1484784] bw ( KiB/s): min= 7, max= 103, per=24.96%, avg=41.19, stdev=20.10, samples=294 iops : min= 1, max= 25, avg= 9.64, stdev= 5.06, samples=294 lat (usec) : 50=0.10%, 100=1.17%, 250=0.10% lat (msec) : 2=5.50%, 4=3.61%, 10=5.83%, 20=8.59%, 50=36.10% lat (msec) : 100=28.35%, 250=10.16%, 500=0.46%, 2000=0.03% cpu : usr=0.06%, sys=4.04%, ctx=6453, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179607: Mon Jul 13 15:01:11 2026 read: IOPS=9, BW=39.0KiB/s (40.9kB/s)(6052KiB/151463msec) clat (usec): min=43, max=1404.6k, avg=56552.95, stdev=50511.17 lat (usec): min=44, max=1404.6k, avg=56560.32, stdev=50510.71 clat percentiles (usec): | 1.00th=[ 57], 5.00th=[ 15926], 10.00th=[ 21103], | 20.00th=[ 27919], 30.00th=[ 34866], 40.00th=[ 40633], | 50.00th=[ 47973], 60.00th=[ 55837], 70.00th=[ 65274], | 80.00th=[ 77071], 90.00th=[ 100140], 95.00th=[ 125305], | 99.00th=[ 187696], 99.50th=[ 210764], 99.90th=[ 362808], | 99.95th=[1400898], 99.99th=[1400898] bw ( KiB/s): min= 5, max= 88, per=25.58%, avg=40.17, stdev=17.06, samples=293 iops : min= 1, max= 22, avg= 9.39, stdev= 4.32, samples=293 write: IOPS=10, BW=41.2KiB/s (42.2kB/s)(6236KiB/151463msec); 0 zone resets clat (usec): min=923, max=396570, avg=41916.19, stdev=45150.95 lat (usec): min=924, max=396572, avg=41924.79, stdev=45150.27 clat percentiles (usec): | 1.00th=[ 1254], 5.00th=[ 1385], 10.00th=[ 1942], 20.00th=[ 4621], | 30.00th=[ 8455], 40.00th=[ 17433], 50.00th=[ 29230], 60.00th=[ 40109], | 70.00th=[ 53740], 80.00th=[ 71828], 90.00th=[101188], 95.00th=[129500], | 99.00th=[196084], 99.50th=[233833], 99.90th=[278922], 99.95th=[396362], | 99.99th=[396362] bw ( KiB/s): min= 7, max= 126, per=24.95%, avg=41.17, stdev=20.91, samples=294 iops : min= 1, max= 31, avg= 9.64, stdev= 5.28, samples=294 lat (usec) : 50=0.13%, 100=1.14%, 250=0.07%, 500=0.03%, 750=0.03% lat (usec) : 1000=0.07% lat (msec) : 2=5.14%, 4=4.10%, 10=7.29%, 20=7.45%, 50=35.51% lat (msec) : 100=28.65%, 250=10.12%, 500=0.23%, 2000=0.03% cpu : usr=0.06%, sys=3.99%, ctx=6541, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=158KiB/s (162kB/s), 39.1KiB/s-39.0KiB/s (40.0kB/s-40.9kB/s), io=23.4MiB (24.6MB), run=151463-152036msec WRITE: bw=165KiB/s (169kB/s), 41.2KiB/s-41.8KiB/s (42.2kB/s-42.8kB/s), io=24.6MiB (25.7MB), run=151463-152036msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179600: Mon Jul 13 15:02:00 2026 read: IOPS=7, BW=29.8KiB/s (30.5kB/s)(5992KiB/200936msec) clat (msec): min=6, max=1142, avg=53.29, stdev=57.03 lat (msec): min=6, max=1142, avg=53.29, stdev=57.03 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 12], 10.00th=[ 16], 20.00th=[ 20], | 30.00th=[ 25], 40.00th=[ 30], 50.00th=[ 36], 60.00th=[ 43], | 70.00th=[ 55], 80.00th=[ 72], 90.00th=[ 117], 95.00th=[ 159], | 99.00th=[ 259], 99.50th=[ 305], 99.90th=[ 372], 99.95th=[ 1150], | 99.99th=[ 1150] bw ( KiB/s): min= 7, max= 119, per=25.94%, avg=30.87, stdev=21.46, samples=374 iops : min= 1, max= 29, avg= 7.05, stdev= 5.42, samples=374 write: IOPS=7, BW=31.3KiB/s (32.1kB/s)(6296KiB/200936msec); 0 zone resets clat (msec): min=12, max=508, avg=76.60, stdev=57.38 lat (msec): min=12, max=508, avg=76.60, stdev=57.38 clat percentiles (msec): | 1.00th=[ 18], 5.00th=[ 23], 10.00th=[ 27], 20.00th=[ 35], | 30.00th=[ 42], 40.00th=[ 50], 50.00th=[ 58], 60.00th=[ 71], | 70.00th=[ 88], 80.00th=[ 111], 90.00th=[ 148], 95.00th=[ 192], | 99.00th=[ 279], 99.50th=[ 351], 99.90th=[ 477], 99.95th=[ 510], | 99.99th=[ 510] bw ( KiB/s): min= 7, max= 119, per=25.27%, avg=31.59, stdev=20.17, samples=384 iops : min= 1, max= 29, avg= 7.22, stdev= 5.08, samples=384 lat (msec) : 10=0.72%, 20=10.90%, 50=42.06%, 100=27.41%, 250=17.42% lat (msec) : 500=1.43%, 750=0.03%, 2000=0.03% cpu : usr=0.04%, sys=1.69%, ctx=4945, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179601: Mon Jul 13 15:02:00 2026 read: IOPS=7, BW=29.7KiB/s (30.5kB/s)(5940KiB/199722msec) clat (msec): min=5, max=1437, avg=53.76, stdev=60.99 lat (msec): min=5, max=1437, avg=53.77, stdev=60.99 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 13], 10.00th=[ 15], 20.00th=[ 20], | 30.00th=[ 24], 40.00th=[ 29], 50.00th=[ 35], 60.00th=[ 42], | 70.00th=[ 54], 80.00th=[ 78], 90.00th=[ 124], 95.00th=[ 159], | 99.00th=[ 236], 99.50th=[ 284], 99.90th=[ 430], 99.95th=[ 1435], | 99.99th=[ 1435] bw ( KiB/s): min= 7, max= 119, per=26.01%, avg=30.96, stdev=22.37, samples=371 iops : min= 1, max= 29, avg= 7.06, stdev= 5.64, samples=371 write: IOPS=7, BW=31.8KiB/s (32.5kB/s)(6348KiB/199722msec); 0 zone resets clat (msec): min=12, max=524, avg=75.18, stdev=57.68 lat (msec): min=12, max=524, avg=75.18, stdev=57.68 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 24], 10.00th=[ 28], 20.00th=[ 34], | 30.00th=[ 40], 40.00th=[ 48], 50.00th=[ 55], 60.00th=[ 69], | 70.00th=[ 85], 80.00th=[ 108], 90.00th=[ 150], 95.00th=[ 194], | 99.00th=[ 288], 99.50th=[ 347], 99.90th=[ 481], 99.95th=[ 527], | 99.99th=[ 527] bw ( KiB/s): min= 7, max= 111, per=25.95%, avg=32.43, stdev=20.49, samples=379 iops : min= 1, max= 27, avg= 7.43, stdev= 5.16, samples=379 lat (msec) : 10=0.78%, 20=10.68%, 50=43.65%, 100=26.50%, 250=17.09% lat (msec) : 500=1.24%, 750=0.03%, 2000=0.03% cpu : usr=0.05%, sys=1.65%, ctx=4916, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179602: Mon Jul 13 15:02:00 2026 read: IOPS=7, BW=30.1KiB/s (30.8kB/s)(6028KiB/200465msec) clat (msec): min=6, max=327, avg=53.07, stdev=47.60 lat (msec): min=6, max=327, avg=53.07, stdev=47.60 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 13], 10.00th=[ 16], 20.00th=[ 21], | 30.00th=[ 24], 40.00th=[ 30], 50.00th=[ 37], 60.00th=[ 45], | 70.00th=[ 58], 80.00th=[ 78], 90.00th=[ 115], 95.00th=[ 153], | 99.00th=[ 234], 99.50th=[ 288], 99.90th=[ 313], 99.95th=[ 330], | 99.99th=[ 330] bw ( KiB/s): min= 7, max= 124, per=25.83%, avg=30.74, stdev=21.13, samples=378 iops : min= 1, max= 31, avg= 7.01, stdev= 5.32, samples=378 write: IOPS=7, BW=31.2KiB/s (31.0kB/s)(6260KiB/200465msec); 0 zone resets clat (msec): min=10, max=1463, avg=76.65, stdev=66.93 lat (msec): min=10, max=1463, avg=76.65, stdev=66.93 clat percentiles (msec): | 1.00th=[ 18], 5.00th=[ 23], 10.00th=[ 27], 20.00th=[ 34], | 30.00th=[ 42], 40.00th=[ 48], 50.00th=[ 57], 60.00th=[ 70], | 70.00th=[ 87], 80.00th=[ 110], 90.00th=[ 150], 95.00th=[ 186], | 99.00th=[ 305], 99.50th=[ 338], 99.90th=[ 506], 99.95th=[ 1469], | 99.99th=[ 1469] bw ( KiB/s): min= 7, max= 111, per=25.58%, avg=31.98, stdev=20.05, samples=378 iops : min= 1, max= 27, avg= 7.32, stdev= 5.06, samples=378 lat (msec) : 10=0.72%, 20=10.48%, 50=42.22%, 100=28.32%, 250=16.89% lat (msec) : 500=1.30%, 750=0.03%, 2000=0.03% cpu : usr=0.04%, sys=1.65%, ctx=4787, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179603: Mon Jul 13 15:02:00 2026 read: IOPS=7, BW=30.2KiB/s (30.9kB/s)(6052KiB/200419msec) clat (msec): min=5, max=415, avg=53.25, stdev=48.33 lat (msec): min=5, max=415, avg=53.26, stdev=48.33 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 12], 10.00th=[ 15], 20.00th=[ 20], | 30.00th=[ 24], 40.00th=[ 29], 50.00th=[ 37], 60.00th=[ 45], | 70.00th=[ 58], 80.00th=[ 79], 90.00th=[ 121], 95.00th=[ 155], | 99.00th=[ 232], 99.50th=[ 266], 99.90th=[ 355], 99.95th=[ 418], | 99.99th=[ 418] bw ( KiB/s): min= 7, max= 140, per=26.43%, avg=31.45, stdev=21.82, samples=372 iops : min= 1, max= 35, avg= 7.19, stdev= 5.51, samples=372 write: IOPS=7, BW=31.1KiB/s (31.9kB/s)(6236KiB/200419msec); 0 zone resets clat (msec): min=9, max=1462, avg=76.52, stdev=67.12 lat (msec): min=9, max=1462, avg=76.52, stdev=67.12 clat percentiles (msec): | 1.00th=[ 18], 5.00th=[ 24], 10.00th=[ 28], 20.00th=[ 35], | 30.00th=[ 41], 40.00th=[ 48], 50.00th=[ 57], 60.00th=[ 68], | 70.00th=[ 86], 80.00th=[ 111], 90.00th=[ 148], 95.00th=[ 190], | 99.00th=[ 284], 99.50th=[ 334], 99.90th=[ 531], 99.95th=[ 1469], | 99.99th=[ 1469] bw ( KiB/s): min= 7, max= 103, per=25.14%, avg=31.43, stdev=19.98, samples=383 iops : min= 1, max= 25, avg= 7.18, stdev= 5.03, samples=383 lat (msec) : 10=1.11%, 20=10.38%, 50=41.96%, 100=27.67%, 250=17.61% lat (msec) : 500=1.17%, 750=0.07%, 2000=0.03% cpu : usr=0.05%, sys=1.66%, ctx=4932, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=120KiB/s (122kB/s), 29.7KiB/s-30.2KiB/s (30.5kB/s-30.9kB/s), io=23.4MiB (24.6MB), run=199722-200936msec WRITE: bw=125KiB/s (128kB/s), 31.1KiB/s-31.8KiB/s (31.9kB/s-32.5kB/s), io=24.6MiB (25.7MB), run=199722-200936msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179668: Mon Jul 13 15:02:51 2026 read: IOPS=10, BW=170KiB/s (174kB/s)(5920KiB/34921msec) clat (usec): min=44, max=283451, avg=52932.24, stdev=41815.99 lat (usec): min=45, max=283452, avg=52933.69, stdev=41815.79 clat percentiles (usec): | 1.00th=[ 52], 5.00th=[ 65], 10.00th=[ 586], 20.00th=[ 24249], | 30.00th=[ 31327], 40.00th=[ 38536], 50.00th=[ 45351], 60.00th=[ 53216], | 70.00th=[ 64750], 80.00th=[ 73925], 90.00th=[ 95945], 95.00th=[120062], | 99.00th=[233833], 99.50th=[274727], 99.90th=[283116], 99.95th=[283116], | 99.99th=[283116] bw ( KiB/s): min= 31, max= 349, per=26.79%, avg=168.53, stdev=75.17, samples=68 iops : min= 1, max= 21, avg= 9.75, stdev= 4.74, samples=68 write: IOPS=11, BW=182KiB/s (187kB/s)(6368KiB/34921msec); 0 zone resets clat (usec): min=1439, max=176330, avg=38192.61, stdev=38427.23 lat (usec): min=1441, max=176332, avg=38201.52, stdev=38424.84 clat percentiles (usec): | 1.00th=[ 1663], 5.00th=[ 2089], 10.00th=[ 2900], 20.00th=[ 5669], | 30.00th=[ 8717], 40.00th=[ 15401], 50.00th=[ 25035], 60.00th=[ 36963], | 70.00th=[ 49021], 80.00th=[ 65799], 90.00th=[ 94897], 95.00th=[126354], | 99.00th=[147850], 99.50th=[170918], 99.90th=[177210], 99.95th=[177210], | 99.99th=[177210] bw ( KiB/s): min= 31, max= 348, per=27.57%, avg=182.49, stdev=75.36, samples=68 iops : min= 1, max= 21, avg=10.63, stdev= 4.74, samples=68 lat (usec) : 50=0.39%, 100=4.04%, 250=0.26%, 750=0.13% lat (msec) : 2=2.08%, 4=5.60%, 10=9.38%, 20=7.94%, 50=33.85% lat (msec) : 100=27.47%, 250=8.46%, 500=0.39% cpu : usr=0.06%, sys=4.44%, ctx=1603, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179669: Mon Jul 13 15:02:51 2026 read: IOPS=9, BW=151KiB/s (155kB/s)(5744KiB/38052msec) clat (usec): min=43, max=260066, avg=55145.98, stdev=36557.83 lat (usec): min=43, max=260068, avg=55147.23, stdev=36557.97 clat percentiles (usec): | 1.00th=[ 49], 5.00th=[ 68], 10.00th=[ 17957], 20.00th=[ 28705], | 30.00th=[ 36963], 40.00th=[ 42730], 50.00th=[ 47973], 60.00th=[ 56361], | 70.00th=[ 65799], 80.00th=[ 80217], 90.00th=[100140], 95.00th=[121111], | 99.00th=[183501], 99.50th=[198181], 99.90th=[261096], 99.95th=[261096], | 99.99th=[261096] bw ( KiB/s): min= 21, max= 381, per=24.70%, avg=155.38, stdev=77.97, samples=72 iops : min= 1, max= 23, avg= 8.89, stdev= 4.88, samples=72 write: IOPS=10, BW=172KiB/s (176kB/s)(6544KiB/38052msec); 0 zone resets clat (usec): min=1736, max=264042, avg=43326.22, stdev=42670.27 lat (usec): min=1739, max=264046, avg=43346.61, stdev=42654.51 clat percentiles (usec): | 1.00th=[ 1893], 5.00th=[ 2606], 10.00th=[ 3982], 20.00th=[ 7177], | 30.00th=[ 10683], 40.00th=[ 20055], 50.00th=[ 30540], 60.00th=[ 42730], | 70.00th=[ 57934], 80.00th=[ 74974], 90.00th=[102237], 95.00th=[126354], | 99.00th=[175113], 99.50th=[204473], 99.90th=[263193], 99.95th=[263193], | 99.99th=[263193] bw ( KiB/s): min= 21, max= 349, per=25.98%, avg=171.96, stdev=69.60, samples=74 iops : min= 1, max= 21, avg= 9.93, stdev= 4.36, samples=74 lat (usec) : 50=0.52%, 100=2.86%, 250=0.39% lat (msec) : 2=1.43%, 4=4.17%, 10=10.16%, 20=7.03%, 50=33.20% lat (msec) : 100=29.69%, 250=10.29%, 500=0.26% cpu : usr=0.07%, sys=4.70%, ctx=1777, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179670: Mon Jul 13 15:02:51 2026 read: IOPS=10, BW=166KiB/s (170kB/s)(6256KiB/37664msec) clat (usec): min=39, max=199408, avg=54809.37, stdev=34776.32 lat (usec): min=39, max=199409, avg=54814.30, stdev=34777.11 clat percentiles (usec): | 1.00th=[ 55], 5.00th=[ 68], 10.00th=[ 16909], 20.00th=[ 28705], | 30.00th=[ 35914], 40.00th=[ 42730], 50.00th=[ 50070], 60.00th=[ 57934], | 70.00th=[ 65799], 80.00th=[ 80217], 90.00th=[ 99091], 95.00th=[121111], | 99.00th=[170918], 99.50th=[183501], 99.90th=[200279], 99.95th=[200279], | 99.99th=[200279] bw ( KiB/s): min= 31, max= 380, per=26.68%, avg=167.82, stdev=75.31, samples=73 iops : min= 1, max= 23, avg= 9.67, stdev= 4.73, samples=73 write: IOPS=10, BW=160KiB/s (164kB/s)(6032KiB/37664msec); 0 zone resets clat (usec): min=1778, max=205197, avg=41861.37, stdev=42430.91 lat (usec): min=1782, max=205199, avg=41872.28, stdev=42432.53 clat percentiles (usec): | 1.00th=[ 1876], 5.00th=[ 2089], 10.00th=[ 2933], 20.00th=[ 6259], | 30.00th=[ 10159], 40.00th=[ 18744], 50.00th=[ 26084], 60.00th=[ 37487], | 70.00th=[ 53740], 80.00th=[ 74974], 90.00th=[107480], 95.00th=[137364], | 99.00th=[181404], 99.50th=[193987], 99.90th=[204473], 99.95th=[204473], | 99.99th=[204473] bw ( KiB/s): min= 31, max= 347, per=24.36%, avg=161.24, stdev=71.06, samples=72 iops : min= 1, max= 21, avg= 9.26, stdev= 4.44, samples=72 lat (usec) : 50=0.26%, 100=3.52%, 250=0.26%, 500=0.13% lat (msec) : 2=1.56%, 4=4.69%, 10=8.59%, 20=7.68%, 50=32.03% lat (msec) : 100=30.21%, 250=11.07% cpu : usr=0.06%, sys=4.75%, ctx=1724, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179671: Mon Jul 13 15:02:51 2026 read: IOPS=9, BW=159KiB/s (163kB/s)(6032KiB/37954msec) clat (usec): min=48, max=217945, avg=54133.29, stdev=34838.96 lat (usec): min=49, max=217945, avg=54137.07, stdev=34841.60 clat percentiles (usec): | 1.00th=[ 54], 5.00th=[ 67], 10.00th=[ 174], 20.00th=[ 27919], | 30.00th=[ 35390], 40.00th=[ 42730], 50.00th=[ 50594], 60.00th=[ 59507], | 70.00th=[ 68682], 80.00th=[ 79168], 90.00th=[ 95945], 95.00th=[114820], | 99.00th=[166724], 99.50th=[185598], 99.90th=[217056], 99.95th=[217056], | 99.99th=[217056] bw ( KiB/s): min= 31, max= 318, per=25.52%, avg=160.55, stdev=63.46, samples=73 iops : min= 1, max= 19, avg= 9.21, stdev= 3.99, samples=73 write: IOPS=10, BW=165KiB/s (169kB/s)(6256KiB/37954msec); 0 zone resets clat (usec): min=1528, max=250966, avg=44067.84, stdev=46862.24 lat (usec): min=1530, max=250968, avg=44070.07, stdev=46862.17 clat percentiles (usec): | 1.00th=[ 1795], 5.00th=[ 2245], 10.00th=[ 3425], 20.00th=[ 5735], | 30.00th=[ 10683], 40.00th=[ 17433], 50.00th=[ 28705], 60.00th=[ 39060], | 70.00th=[ 56886], 80.00th=[ 74974], 90.00th=[108528], 95.00th=[143655], | 99.00th=[208667], 99.50th=[235930], 99.90th=[250610], 99.95th=[250610], | 99.99th=[250610] bw ( KiB/s): min= 31, max= 441, per=24.93%, avg=165.07, stdev=82.86, samples=74 iops : min= 1, max= 27, avg= 9.50, stdev= 5.25, samples=74 lat (usec) : 50=0.13%, 100=4.56%, 250=0.26% lat (msec) : 2=1.43%, 4=5.47%, 10=8.20%, 20=7.94%, 50=29.95% lat (msec) : 100=32.16%, 250=9.77%, 500=0.13% cpu : usr=0.06%, sys=4.78%, ctx=1726, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=629KiB/s (645kB/s), 151KiB/s-170KiB/s (155kB/s-174kB/s), io=23.4MiB (24.5MB), run=34921-38052msec WRITE: bw=662KiB/s (678kB/s), 160KiB/s-182KiB/s (164kB/s-187kB/s), io=24.6MiB (25.8MB), run=34921-38052msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179663: Mon Jul 13 15:03:07 2026 read: IOPS=6, BW=109KiB/s (112kB/s)(5920KiB/54259msec) clat (msec): min=6, max=325, avg=58.38, stdev=48.37 lat (msec): min=6, max=325, avg=58.38, stdev=48.37 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 16], 10.00th=[ 19], 20.00th=[ 24], | 30.00th=[ 29], 40.00th=[ 36], 50.00th=[ 43], 60.00th=[ 53], | 70.00th=[ 63], 80.00th=[ 84], 90.00th=[ 117], 95.00th=[ 167], | 99.00th=[ 251], 99.50th=[ 275], 99.90th=[ 326], 99.95th=[ 326], | 99.99th=[ 326] bw ( KiB/s): min= 30, max= 318, per=25.54%, avg=112.61, stdev=63.29, samples=100 iops : min= 1, max= 19, avg= 6.26, stdev= 4.03, samples=100 write: IOPS=7, BW=117KiB/s (120kB/s)(6368KiB/54259msec); 0 zone resets clat (msec): min=14, max=340, avg=81.18, stdev=56.23 lat (msec): min=14, max=340, avg=81.18, stdev=56.23 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 25], 10.00th=[ 29], 20.00th=[ 40], | 30.00th=[ 46], 40.00th=[ 55], 50.00th=[ 64], 60.00th=[ 78], | 70.00th=[ 91], 80.00th=[ 116], 90.00th=[ 161], 95.00th=[ 201], | 99.00th=[ 284], 99.50th=[ 334], 99.90th=[ 342], 99.95th=[ 342], | 99.99th=[ 342] bw ( KiB/s): min= 22, max= 320, per=25.66%, avg=119.05, stdev=62.79, samples=103 iops : min= 1, max= 20, avg= 6.66, stdev= 4.01, samples=103 lat (msec) : 10=0.13%, 20=7.03%, 50=39.06%, 100=34.38%, 250=17.97% lat (msec) : 500=1.43% cpu : usr=0.04%, sys=1.75%, ctx=1220, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179664: Mon Jul 13 15:03:07 2026 read: IOPS=6, BW=107KiB/s (109kB/s)(5744KiB/53843msec) clat (msec): min=7, max=291, avg=53.54, stdev=43.59 lat (msec): min=7, max=291, avg=53.54, stdev=43.59 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 16], 10.00th=[ 19], 20.00th=[ 24], | 30.00th=[ 28], 40.00th=[ 32], 50.00th=[ 39], 60.00th=[ 47], | 70.00th=[ 56], 80.00th=[ 72], 90.00th=[ 118], 95.00th=[ 146], | 99.00th=[ 215], 99.50th=[ 251], 99.90th=[ 292], 99.95th=[ 292], | 99.99th=[ 292] bw ( KiB/s): min= 23, max= 444, per=24.64%, avg=108.65, stdev=72.57, samples=102 iops : min= 1, max= 27, avg= 6.00, stdev= 4.57, samples=102 write: IOPS=7, BW=122KiB/s (124kB/s)(6544KiB/53843msec); 0 zone resets clat (msec): min=14, max=329, avg=84.13, stdev=52.30 lat (msec): min=14, max=329, avg=84.13, stdev=52.30 clat percentiles (msec): | 1.00th=[ 22], 5.00th=[ 28], 10.00th=[ 33], 20.00th=[ 44], | 30.00th=[ 50], 40.00th=[ 61], 50.00th=[ 68], 60.00th=[ 81], | 70.00th=[ 100], 80.00th=[ 124], 90.00th=[ 157], 95.00th=[ 182], | 99.00th=[ 275], 99.50th=[ 279], 99.90th=[ 330], 99.95th=[ 330], | 99.99th=[ 330] bw ( KiB/s): min= 30, max= 318, per=26.18%, avg=121.48, stdev=63.36, samples=104 iops : min= 1, max= 19, avg= 6.81, stdev= 4.05, samples=104 lat (msec) : 10=0.26%, 20=5.86%, 50=39.32%, 100=32.81%, 250=20.57% lat (msec) : 500=1.17% cpu : usr=0.05%, sys=1.83%, ctx=1234, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179665: Mon Jul 13 15:03:07 2026 read: IOPS=7, BW=118KiB/s (121kB/s)(6256KiB/53151msec) clat (msec): min=9, max=329, avg=55.29, stdev=43.55 lat (msec): min=9, max=329, avg=55.29, stdev=43.55 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 16], 10.00th=[ 21], 20.00th=[ 26], | 30.00th=[ 32], 40.00th=[ 37], 50.00th=[ 43], 60.00th=[ 51], | 70.00th=[ 59], 80.00th=[ 74], 90.00th=[ 107], 95.00th=[ 157], | 99.00th=[ 218], 99.50th=[ 241], 99.90th=[ 330], 99.95th=[ 330], | 99.99th=[ 330] bw ( KiB/s): min= 31, max= 351, per=26.75%, avg=117.98, stdev=70.67, samples=104 iops : min= 1, max= 21, avg= 6.58, stdev= 4.46, samples=104 write: IOPS=7, BW=113KiB/s (116kB/s)(6032KiB/53151msec); 0 zone resets clat (msec): min=18, max=347, avg=83.07, stdev=50.69 lat (msec): min=18, max=347, avg=83.09, stdev=50.69 clat percentiles (msec): | 1.00th=[ 22], 5.00th=[ 30], 10.00th=[ 35], 20.00th=[ 43], | 30.00th=[ 50], 40.00th=[ 57], 50.00th=[ 68], 60.00th=[ 84], | 70.00th=[ 101], 80.00th=[ 122], 90.00th=[ 150], 95.00th=[ 184], | 99.00th=[ 262], 99.50th=[ 279], 99.90th=[ 347], 99.95th=[ 347], | 99.99th=[ 347] bw ( KiB/s): min= 31, max= 349, per=24.47%, avg=113.54, stdev=57.78, samples=103 iops : min= 1, max= 21, avg= 6.30, stdev= 3.64, samples=103 lat (msec) : 10=0.39%, 20=4.82%, 50=39.58%, 100=34.77%, 250=19.53% lat (msec) : 500=0.91% cpu : usr=0.03%, sys=1.77%, ctx=1204, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179667: Mon Jul 13 15:03:07 2026 read: IOPS=7, BW=113KiB/s (115kB/s)(6032KiB/53543msec) clat (msec): min=5, max=316, avg=58.47, stdev=48.03 lat (msec): min=5, max=316, avg=58.48, stdev=48.02 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 14], 10.00th=[ 18], 20.00th=[ 24], | 30.00th=[ 30], 40.00th=[ 37], 50.00th=[ 44], 60.00th=[ 53], | 70.00th=[ 63], 80.00th=[ 82], 90.00th=[ 123], 95.00th=[ 169], | 99.00th=[ 218], 99.50th=[ 292], 99.90th=[ 317], 99.95th=[ 317], | 99.99th=[ 317] bw ( KiB/s): min= 23, max= 444, per=25.61%, avg=112.92, stdev=66.49, samples=104 iops : min= 1, max= 27, avg= 6.27, stdev= 4.22, samples=104 write: IOPS=7, BW=117KiB/s (120kB/s)(6256KiB/53543msec); 0 zone resets clat (msec): min=18, max=352, avg=80.39, stdev=49.95 lat (msec): min=18, max=352, avg=80.39, stdev=49.95 clat percentiles (msec): | 1.00th=[ 19], 5.00th=[ 28], 10.00th=[ 35], 20.00th=[ 43], | 30.00th=[ 50], 40.00th=[ 56], 50.00th=[ 64], 60.00th=[ 77], | 70.00th=[ 93], 80.00th=[ 114], 90.00th=[ 150], 95.00th=[ 184], | 99.00th=[ 247], 99.50th=[ 288], 99.90th=[ 355], 99.95th=[ 355], | 99.99th=[ 355] bw ( KiB/s): min= 31, max= 320, per=26.11%, avg=121.13, stdev=63.31, samples=101 iops : min= 1, max= 20, avg= 6.78, stdev= 4.01, samples=101 lat (msec) : 10=0.65%, 20=5.73%, 50=37.24%, 100=36.07%, 250=19.79% lat (msec) : 500=0.52% cpu : usr=0.04%, sys=1.69%, ctx=1232, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=441KiB/s (452kB/s), 107KiB/s-118KiB/s (109kB/s-121kB/s), io=23.4MiB (24.5MB), run=53151-54259msec WRITE: bw=464KiB/s (476kB/s), 113KiB/s-122KiB/s (116kB/s-124kB/s), io=24.6MiB (25.8MB), run=53151-54259msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179684: Mon Jul 13 15:03:22 2026 read: IOPS=2, BW=2097KiB/s (2147kB/s)(7168KiB/3419msec) clat (usec): min=607, max=779121, avg=228702.18, stdev=280462.61 lat (usec): min=608, max=779123, avg=228703.68, stdev=280462.81 clat percentiles (usec): | 1.00th=[ 611], 5.00th=[ 611], 10.00th=[ 611], 20.00th=[ 1582], | 30.00th=[ 27395], 40.00th=[ 27395], 50.00th=[160433], 60.00th=[267387], | 70.00th=[267387], 80.00th=[367002], 90.00th=[775947], 95.00th=[775947], | 99.00th=[775947], 99.50th=[775947], 99.90th=[775947], 99.95th=[775947], | 99.99th=[775947] bw ( KiB/s): min= 1828, max= 3849, per=54.45%, avg=2316.40, stdev=860.75, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 write: IOPS=1, BW=1498KiB/s (1533kB/s)(5120KiB/3419msec); 0 zone resets clat (msec): min=234, max=461, avg=320.27, stdev=88.48 lat (msec): min=234, max=461, avg=320.34, stdev=88.47 clat percentiles (msec): | 1.00th=[ 236], 5.00th=[ 236], 10.00th=[ 236], 20.00th=[ 236], | 30.00th=[ 262], 40.00th=[ 262], 50.00th=[ 309], 60.00th=[ 309], | 70.00th=[ 338], 80.00th=[ 338], 90.00th=[ 464], 95.00th=[ 464], | 99.00th=[ 464], 99.50th=[ 464], 99.90th=[ 464], 99.95th=[ 464], | 99.99th=[ 464] bw ( KiB/s): min= 1828, max= 4079, per=43.60%, avg=2596.33, stdev=1284.31, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (usec) : 750=8.33% lat (msec) : 2=8.33%, 50=8.33%, 250=16.67%, 500=50.00%, 1000=8.33% cpu : usr=0.00%, sys=9.57%, ctx=177, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179685: Mon Jul 13 15:03:22 2026 read: IOPS=0, BW=425KiB/s (436kB/s)(2048KiB/4814msec) clat (usec): min=974, max=179650, avg=90312.52, stdev=126342.35 lat (usec): min=976, max=179652, avg=90314.46, stdev=126343.32 clat percentiles (usec): | 1.00th=[ 979], 5.00th=[ 979], 10.00th=[ 979], 20.00th=[ 979], | 30.00th=[ 979], 40.00th=[ 979], 50.00th=[ 979], 60.00th=[179307], | 70.00th=[179307], 80.00th=[179307], 90.00th=[179307], 95.00th=[179307], | 99.00th=[179307], 99.50th=[179307], 99.90th=[179307], 99.95th=[179307], | 99.99th=[179307] bw ( KiB/s): min= 1841, max= 2039, per=45.60%, avg=1940.00, stdev=140.01, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2127KiB/s (2178kB/s)(10.0MiB/4814msec); 0 zone resets clat (msec): min=120, max=984, avg=459.16, stdev=259.31 lat (msec): min=120, max=985, avg=459.37, stdev=259.23 clat percentiles (msec): | 1.00th=[ 121], 5.00th=[ 121], 10.00th=[ 121], 20.00th=[ 150], | 30.00th=[ 292], 40.00th=[ 376], 50.00th=[ 384], 60.00th=[ 477], | 70.00th=[ 535], 80.00th=[ 575], 90.00th=[ 701], 95.00th=[ 986], | 99.00th=[ 986], 99.50th=[ 986], 99.90th=[ 986], 99.95th=[ 986], | 99.99th=[ 986] bw ( KiB/s): min= 1882, max= 4047, per=43.03%, avg=2562.14, stdev=989.57, samples=7 iops : min= 1, max= 3, avg= 1.71, stdev= 0.95, samples=7 lat (usec) : 1000=8.33% lat (msec) : 250=25.00%, 500=33.33%, 750=25.00%, 1000=8.33% cpu : usr=0.00%, sys=11.24%, ctx=136, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179686: Mon Jul 13 15:03:22 2026 read: IOPS=1, BW=1755KiB/s (1797kB/s)(6144KiB/3501msec) clat (usec): min=521, max=560096, avg=170560.18, stdev=222128.71 lat (usec): min=522, max=560096, avg=170561.11, stdev=222128.56 clat percentiles (usec): | 1.00th=[ 523], 5.00th=[ 523], 10.00th=[ 523], 20.00th=[ 807], | 30.00th=[ 807], 40.00th=[ 840], 50.00th=[ 840], 60.00th=[206570], | 70.00th=[254804], 80.00th=[254804], 90.00th=[557843], 95.00th=[557843], | 99.00th=[557843], 99.50th=[557843], 99.90th=[557843], 99.95th=[557843], | 99.99th=[557843] bw ( KiB/s): min= 2039, max= 7529, per=100.00%, avg=4784.00, stdev=3882.02, samples=2 iops : min= 1, max= 7, avg= 4.00, stdev= 4.24, samples=2 write: IOPS=1, BW=1755KiB/s (1797kB/s)(6144KiB/3501msec); 0 zone resets clat (msec): min=245, max=579, avg=376.06, stdev=126.43 lat (msec): min=247, max=579, avg=376.50, stdev=126.02 clat percentiles (msec): | 1.00th=[ 247], 5.00th=[ 247], 10.00th=[ 247], 20.00th=[ 288], | 30.00th=[ 288], 40.00th=[ 330], 50.00th=[ 330], 60.00th=[ 342], | 70.00th=[ 477], 80.00th=[ 477], 90.00th=[ 584], 95.00th=[ 584], | 99.00th=[ 584], 99.50th=[ 584], 99.90th=[ 584], 99.95th=[ 584], | 99.99th=[ 584] bw ( KiB/s): min= 1828, max= 3968, per=40.31%, avg=2400.50, stdev=1045.74, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (usec) : 750=8.33%, 1000=16.67% lat (msec) : 250=16.67%, 500=41.67%, 750=16.67% cpu : usr=0.00%, sys=9.91%, ctx=166, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179687: Mon Jul 13 15:03:22 2026 read: IOPS=1, BW=1610KiB/s (1648kB/s)(5120KiB/3181msec) clat (usec): min=424, max=346243, avg=69775.67, stdev=154550.80 lat (usec): min=425, max=346245, avg=69776.78, stdev=154551.23 clat percentiles (usec): | 1.00th=[ 424], 5.00th=[ 424], 10.00th=[ 424], 20.00th=[ 424], | 30.00th=[ 478], 40.00th=[ 478], 50.00th=[ 545], 60.00th=[ 545], | 70.00th=[ 1188], 80.00th=[ 1188], 90.00th=[346031], 95.00th=[346031], | 99.00th=[346031], 99.50th=[346031], 99.90th=[346031], 99.95th=[346031], | 99.99th=[346031] bw ( KiB/s): min= 7314, max= 7314, per=100.00%, avg=7314.00, stdev= 0.00, samples=1 iops : min= 7, max= 7, avg= 7.00, stdev= 0.00, samples=1 write: IOPS=2, BW=2253KiB/s (2307kB/s)(7168KiB/3181msec); 0 zone resets clat (msec): min=252, max=563, avg=383.70, stdev=120.74 lat (msec): min=253, max=563, avg=383.95, stdev=120.56 clat percentiles (msec): | 1.00th=[ 253], 5.00th=[ 253], 10.00th=[ 253], 20.00th=[ 264], | 30.00th=[ 330], 40.00th=[ 330], 50.00th=[ 372], 60.00th=[ 380], | 70.00th=[ 380], 80.00th=[ 527], 90.00th=[ 567], 95.00th=[ 567], | 99.00th=[ 567], 99.50th=[ 567], 99.90th=[ 567], 99.95th=[ 567], | 99.99th=[ 567] bw ( KiB/s): min= 1828, max= 1984, per=31.95%, avg=1902.80, stdev=57.26, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 lat (usec) : 500=16.67%, 750=8.33% lat (msec) : 2=8.33%, 500=50.00%, 750=16.67% cpu : usr=0.00%, sys=11.13%, ctx=107, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4254KiB/s (4356kB/s), 425KiB/s-2097KiB/s (436kB/s-2147kB/s), io=20.0MiB (20.0MB), run=3181-4814msec WRITE: bw=5956KiB/s (6099kB/s), 1498KiB/s-2253KiB/s (1533kB/s-2307kB/s), io=28.0MiB (29.4MB), run=3181-4814msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179689: Mon Jul 13 15:03:23 2026 read: IOPS=1, BW=1379KiB/s (1412kB/s)(7168KiB/5199msec) clat (msec): min=110, max=882, avg=334.40, stdev=302.48 lat (msec): min=110, max=882, avg=334.40, stdev=302.48 clat percentiles (msec): | 1.00th=[ 111], 5.00th=[ 111], 10.00th=[ 111], 20.00th=[ 128], | 30.00th=[ 129], 40.00th=[ 129], 50.00th=[ 130], 60.00th=[ 363], | 70.00th=[ 363], 80.00th=[ 600], 90.00th=[ 885], 95.00th=[ 885], | 99.00th=[ 885], 99.50th=[ 885], 99.90th=[ 885], 99.95th=[ 885], | 99.99th=[ 885] bw ( KiB/s): min= 1865, max= 4096, per=63.68%, avg=2406.00, stdev=947.27, samples=5 iops : min= 1, max= 4, avg= 1.60, stdev= 1.34, samples=5 write: IOPS=0, BW=985KiB/s (1008kB/s)(5120KiB/5199msec); 0 zone resets clat (msec): min=272, max=662, avg=475.54, stdev=166.99 lat (msec): min=272, max=662, avg=475.76, stdev=166.96 clat percentiles (msec): | 1.00th=[ 271], 5.00th=[ 271], 10.00th=[ 271], 20.00th=[ 271], | 30.00th=[ 393], 40.00th=[ 393], 50.00th=[ 418], 60.00th=[ 418], | 70.00th=[ 634], 80.00th=[ 634], 90.00th=[ 667], 95.00th=[ 667], | 99.00th=[ 667], 99.50th=[ 667], 99.90th=[ 667], 99.95th=[ 667], | 99.99th=[ 667] bw ( KiB/s): min= 2000, max= 3953, per=47.31%, avg=2502.75, stdev=966.96, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (msec) : 250=33.33%, 500=33.33%, 750=25.00%, 1000=8.33% cpu : usr=0.02%, sys=3.02%, ctx=98, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179690: Mon Jul 13 15:03:23 2026 read: IOPS=0, BW=398KiB/s (408kB/s)(2048KiB/5146msec) clat (msec): min=162, max=664, avg=413.41, stdev=355.08 lat (msec): min=162, max=664, avg=413.41, stdev=355.08 clat percentiles (msec): | 1.00th=[ 163], 5.00th=[ 163], 10.00th=[ 163], 20.00th=[ 163], | 30.00th=[ 163], 40.00th=[ 163], 50.00th=[ 163], 60.00th=[ 667], | 70.00th=[ 667], 80.00th=[ 667], 90.00th=[ 667], 95.00th=[ 667], | 99.00th=[ 667], 99.50th=[ 667], 99.90th=[ 667], 99.95th=[ 667], | 99.99th=[ 667] bw ( KiB/s): min= 1976, max= 2031, per=53.03%, avg=2003.50, stdev=38.89, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1990KiB/s (2038kB/s)(10.0MiB/5146msec); 0 zone resets clat (msec): min=101, max=773, avg=423.86, stdev=231.99 lat (msec): min=101, max=773, avg=424.28, stdev=232.22 clat percentiles (msec): | 1.00th=[ 103], 5.00th=[ 103], 10.00th=[ 103], 20.00th=[ 125], | 30.00th=[ 144], 40.00th=[ 342], 50.00th=[ 518], 60.00th=[ 531], | 70.00th=[ 550], 80.00th=[ 575], 90.00th=[ 584], 95.00th=[ 776], | 99.00th=[ 776], 99.50th=[ 776], 99.90th=[ 776], 99.95th=[ 776], | 99.99th=[ 776] bw ( KiB/s): min= 1865, max= 2048, per=37.75%, avg=1996.86, stdev=63.51, samples=7 iops : min= 1, max= 2, avg= 1.14, stdev= 0.38, samples=7 lat (msec) : 250=33.33%, 500=8.33%, 750=50.00%, 1000=8.33% cpu : usr=0.04%, sys=4.35%, ctx=97, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179691: Mon Jul 13 15:03:23 2026 read: IOPS=1, BW=1229KiB/s (1259kB/s)(6144KiB/4998msec) clat (msec): min=138, max=536, avg=288.07, stdev=135.69 lat (msec): min=138, max=536, avg=288.07, stdev=135.69 clat percentiles (msec): | 1.00th=[ 138], 5.00th=[ 138], 10.00th=[ 138], 20.00th=[ 220], | 30.00th=[ 220], 40.00th=[ 257], 50.00th=[ 257], 60.00th=[ 259], | 70.00th=[ 321], 80.00th=[ 321], 90.00th=[ 535], 95.00th=[ 535], | 99.00th=[ 535], 99.50th=[ 535], 99.90th=[ 535], 99.95th=[ 535], | 99.99th=[ 535] bw ( KiB/s): min= 2048, max= 3953, per=85.86%, avg=3243.67, stdev=1041.46, samples=3 iops : min= 2, max= 3, avg= 2.67, stdev= 0.58, samples=3 write: IOPS=1, BW=1229KiB/s (1259kB/s)(6144KiB/4998msec); 0 zone resets clat (msec): min=117, max=880, avg=502.64, stdev=269.71 lat (msec): min=117, max=880, avg=502.93, stdev=269.84 clat percentiles (msec): | 1.00th=[ 118], 5.00th=[ 118], 10.00th=[ 118], 20.00th=[ 359], | 30.00th=[ 359], 40.00th=[ 393], 50.00th=[ 393], 60.00th=[ 584], | 70.00th=[ 684], 80.00th=[ 684], 90.00th=[ 877], 95.00th=[ 877], | 99.00th=[ 877], 99.50th=[ 877], 99.90th=[ 877], 99.95th=[ 877], | 99.99th=[ 877] bw ( KiB/s): min= 1865, max= 2039, per=37.51%, avg=1984.40, stdev=71.04, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 lat (msec) : 250=25.00%, 500=41.67%, 750=25.00%, 1000=8.33% cpu : usr=0.02%, sys=4.24%, ctx=101, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179692: Mon Jul 13 15:03:23 2026 read: IOPS=0, BW=945KiB/s (967kB/s)(5120KiB/5420msec) clat (msec): min=102, max=170, avg=128.41, stdev=26.38 lat (msec): min=102, max=170, avg=128.41, stdev=26.38 clat percentiles (msec): | 1.00th=[ 104], 5.00th=[ 104], 10.00th=[ 104], 20.00th=[ 104], | 30.00th=[ 113], 40.00th=[ 113], 50.00th=[ 121], 60.00th=[ 121], | 70.00th=[ 138], 80.00th=[ 138], 90.00th=[ 171], 95.00th=[ 171], | 99.00th=[ 171], 99.50th=[ 171], 99.90th=[ 171], 99.95th=[ 171], | 99.99th=[ 171] bw ( KiB/s): min= 3953, max= 4000, per=100.00%, avg=3976.50, stdev=33.23, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1323KiB/s (1354kB/s)(7168KiB/5420msec); 0 zone resets clat (msec): min=215, max=1240, avg=612.99, stdev=331.88 lat (msec): min=215, max=1240, avg=613.10, stdev=331.88 clat percentiles (msec): | 1.00th=[ 215], 5.00th=[ 215], 10.00th=[ 215], 20.00th=[ 338], | 30.00th=[ 472], 40.00th=[ 472], 50.00th=[ 642], 60.00th=[ 667], | 70.00th=[ 667], 80.00th=[ 718], 90.00th=[ 1234], 95.00th=[ 1234], | 99.00th=[ 1234], 99.50th=[ 1234], 99.90th=[ 1234], 99.95th=[ 1234], | 99.99th=[ 1234] bw ( KiB/s): min= 1865, max= 2039, per=37.52%, avg=1985.00, stdev=62.38, samples=6 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=6 lat (msec) : 250=50.00%, 500=16.67%, 750=25.00%, 2000=8.33% cpu : usr=0.00%, sys=3.10%, ctx=120, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3779KiB/s (3869kB/s), 398KiB/s-1379KiB/s (408kB/s-1412kB/s), io=20.0MiB (20.0MB), run=4998-5420msec WRITE: bw=5290KiB/s (5417kB/s), 985KiB/s-1990KiB/s (1008kB/s-2038kB/s), io=28.0MiB (29.4MB), run=4998-5420msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179699: Mon Jul 13 15:03:38 2026 read: IOPS=1, BW=6150KiB/s (6298kB/s)(12.0MiB/1998msec) clat (msec): min=522, max=813, avg=662.32, stdev=145.63 lat (msec): min=522, max=813, avg=662.33, stdev=145.63 clat percentiles (msec): | 1.00th=[ 523], 5.00th=[ 523], 10.00th=[ 523], 20.00th=[ 523], | 30.00th=[ 523], 40.00th=[ 651], 50.00th=[ 651], 60.00th=[ 651], | 70.00th=[ 810], 80.00th=[ 810], 90.00th=[ 810], 95.00th=[ 810], | 99.00th=[ 810], 99.50th=[ 810], 99.90th=[ 810], 99.95th=[ 810], | 99.99th=[ 810] bw ( KiB/s): min= 6272, max= 8143, per=87.90%, avg=7207.50, stdev=1323.00, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=66.67%, 1000=33.33% cpu : usr=0.00%, sys=3.41%, ctx=39, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179700: Mon Jul 13 15:03:38 2026 read: IOPS=0, BW=2490KiB/s (2550kB/s)(4096KiB/1645msec) clat (nsec): min=247055k, max=247055k, avg=247055269.00, stdev= 0.00 lat (nsec): min=247059k, max=247059k, avg=247059245.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 247], 5.00th=[ 247], 10.00th=[ 247], 20.00th=[ 247], | 30.00th=[ 247], 40.00th=[ 247], 50.00th=[ 247], 60.00th=[ 247], | 70.00th=[ 247], 80.00th=[ 247], 90.00th=[ 247], 95.00th=[ 247], | 99.00th=[ 247], 99.50th=[ 247], 99.90th=[ 247], 99.95th=[ 247], | 99.99th=[ 247] bw ( KiB/s): min= 7656, max= 7656, per=93.37%, avg=7656.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=1, BW=4980KiB/s (5099kB/s)(8192KiB/1645msec); 0 zone resets clat (msec): min=447, max=845, avg=646.61, stdev=281.92 lat (msec): min=449, max=846, avg=647.88, stdev=280.90 clat percentiles (msec): | 1.00th=[ 447], 5.00th=[ 447], 10.00th=[ 447], 20.00th=[ 447], | 30.00th=[ 447], 40.00th=[ 447], 50.00th=[ 447], 60.00th=[ 844], | 70.00th=[ 844], 80.00th=[ 844], 90.00th=[ 844], 95.00th=[ 844], | 99.00th=[ 844], 99.50th=[ 844], 99.90th=[ 844], 99.95th=[ 844], | 99.99th=[ 844] bw ( KiB/s): min= 7953, max= 7953, per=64.49%, avg=7953.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 500=33.33%, 1000=33.33% cpu : usr=0.00%, sys=8.15%, ctx=46, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179701: Mon Jul 13 15:03:38 2026 write: IOPS=1, BW=4625KiB/s (4736kB/s)(12.0MiB/2657msec); 0 zone resets clat (msec): min=774, max=891, avg=847.27, stdev=63.58 lat (msec): min=783, max=892, avg=851.42, stdev=59.17 clat percentiles (msec): | 1.00th=[ 776], 5.00th=[ 776], 10.00th=[ 776], 20.00th=[ 776], | 30.00th=[ 776], 40.00th=[ 877], 50.00th=[ 877], 60.00th=[ 877], | 70.00th=[ 894], 80.00th=[ 894], 90.00th=[ 894], 95.00th=[ 894], | 99.00th=[ 894], 99.50th=[ 894], 99.90th=[ 894], 99.95th=[ 894], | 99.99th=[ 894] bw ( KiB/s): min= 8031, max= 8110, per=65.44%, avg=8070.50, stdev=55.86, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=100.00% cpu : usr=0.00%, sys=3.95%, ctx=49, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179702: Mon Jul 13 15:03:38 2026 write: IOPS=2, BW=9974KiB/s (10.2MB/s)(12.0MiB/1232msec); 0 zone resets clat (msec): min=298, max=511, avg=407.56, stdev=106.50 lat (msec): min=299, max=512, avg=409.95, stdev=106.76 clat percentiles (msec): | 1.00th=[ 300], 5.00th=[ 300], 10.00th=[ 300], 20.00th=[ 300], | 30.00th=[ 300], 40.00th=[ 414], 50.00th=[ 414], 60.00th=[ 414], | 70.00th=[ 510], 80.00th=[ 510], 90.00th=[ 510], 95.00th=[ 510], | 99.00th=[ 510], 99.50th=[ 510], 99.90th=[ 510], 99.95th=[ 510], | 99.99th=[ 510] bw ( KiB/s): min= 6420, max= 8031, per=58.59%, avg=7225.50, stdev=1139.15, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=66.67%, 750=33.33% cpu : usr=0.00%, sys=8.45%, ctx=58, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=8200KiB/s (8397kB/s), 2490KiB/s-6150KiB/s (2550kB/s-6298kB/s), io=16.0MiB (16.8MB), run=1645-1998msec WRITE: bw=12.0MiB/s (12.6MB/s), 4625KiB/s-9974KiB/s (4736kB/s-10.2MB/s), io=32.0MiB (33.6MB), run=1232-2657msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179704: Mon Jul 13 15:03:40 2026 read: IOPS=0, BW=3667KiB/s (3755kB/s)(12.0MiB/3351msec) clat (msec): min=1052, max=1177, avg=1116.63, stdev=62.17 lat (msec): min=1052, max=1177, avg=1116.63, stdev=62.17 clat percentiles (msec): | 1.00th=[ 1053], 5.00th=[ 1053], 10.00th=[ 1053], 20.00th=[ 1053], | 30.00th=[ 1053], 40.00th=[ 1116], 50.00th=[ 1116], 60.00th=[ 1116], | 70.00th=[ 1183], 80.00th=[ 1183], 90.00th=[ 1183], 95.00th=[ 1183], | 99.00th=[ 1183], 99.50th=[ 1183], 99.90th=[ 1183], 99.95th=[ 1183], | 99.99th=[ 1183] bw ( KiB/s): min= 8000, max= 8159, per=100.00%, avg=8079.50, stdev=112.43, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 2000=100.00% cpu : usr=0.15%, sys=10.60%, ctx=309, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179705: Mon Jul 13 15:03:40 2026 read: IOPS=0, BW=1160KiB/s (1188kB/s)(4096KiB/3532msec) clat (nsec): min=1232.3M, max=1232.3M, avg=1232327700.00, stdev= 0.00 lat (nsec): min=1232.3M, max=1232.3M, avg=1232329276.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1234], 5.00th=[ 1234], 10.00th=[ 1234], 20.00th=[ 1234], | 30.00th=[ 1234], 40.00th=[ 1234], 50.00th=[ 1234], 60.00th=[ 1234], | 70.00th=[ 1234], 80.00th=[ 1234], 90.00th=[ 1234], 95.00th=[ 1234], | 99.00th=[ 1234], 99.50th=[ 1234], 99.90th=[ 1234], 99.95th=[ 1234], | 99.99th=[ 1234] bw ( KiB/s): min= 8000, max= 8000, per=100.00%, avg=8000.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2319KiB/s (2375kB/s)(8192KiB/3532msec); 0 zone resets clat (msec): min=680, max=1616, avg=1148.82, stdev=662.06 lat (msec): min=680, max=1617, avg=1149.21, stdev=662.27 clat percentiles (msec): | 1.00th=[ 684], 5.00th=[ 684], 10.00th=[ 684], 20.00th=[ 684], | 30.00th=[ 684], 40.00th=[ 684], 50.00th=[ 684], 60.00th=[ 1620], | 70.00th=[ 1620], 80.00th=[ 1620], 90.00th=[ 1620], 95.00th=[ 1620], | 99.00th=[ 1620], 99.50th=[ 1620], 99.90th=[ 1620], 99.95th=[ 1620], | 99.99th=[ 1620] bw ( KiB/s): min= 8062, max= 8062, per=87.03%, avg=8062.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, 2000=66.67% cpu : usr=0.00%, sys=5.61%, ctx=154, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179706: Mon Jul 13 15:03:40 2026 write: IOPS=0, BW=3474KiB/s (3558kB/s)(12.0MiB/3537msec); 0 zone resets clat (msec): min=937, max=1545, avg=1175.92, stdev=324.87 lat (msec): min=939, max=1546, avg=1178.44, stdev=323.63 clat percentiles (msec): | 1.00th=[ 936], 5.00th=[ 936], 10.00th=[ 936], 20.00th=[ 936], | 30.00th=[ 936], 40.00th=[ 1045], 50.00th=[ 1045], 60.00th=[ 1045], | 70.00th=[ 1552], 80.00th=[ 1552], 90.00th=[ 1552], 95.00th=[ 1552], | 99.00th=[ 1552], 99.50th=[ 1552], 99.90th=[ 1552], 99.95th=[ 1552], | 99.99th=[ 1552] bw ( KiB/s): min= 8000, max= 8159, per=87.21%, avg=8079.50, stdev=112.43, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=33.33%, 2000=66.67% cpu : usr=0.00%, sys=5.51%, ctx=121, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179707: Mon Jul 13 15:03:40 2026 write: IOPS=1, BW=6564KiB/s (6722kB/s)(12.0MiB/1872msec); 0 zone resets clat (msec): min=363, max=1078, avg=622.25, stdev=395.99 lat (msec): min=364, max=1079, avg=623.43, stdev=396.54 clat percentiles (msec): | 1.00th=[ 363], 5.00th=[ 363], 10.00th=[ 363], 20.00th=[ 363], | 30.00th=[ 363], 40.00th=[ 426], 50.00th=[ 426], 60.00th=[ 426], | 70.00th=[ 1083], 80.00th=[ 1083], 90.00th=[ 1083], 95.00th=[ 1083], | 99.00th=[ 1083], 99.50th=[ 1083], 99.90th=[ 1083], 99.95th=[ 1083], | 99.99th=[ 1083] bw ( KiB/s): min= 7301, max= 8000, per=82.58%, avg=7650.50, stdev=494.27, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=66.67%, 2000=33.33% cpu : usr=0.00%, sys=5.13%, ctx=56, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4639KiB/s (4750kB/s), 1160KiB/s-3667KiB/s (1188kB/s-3755kB/s), io=16.0MiB (16.8MB), run=3351-3532msec WRITE: bw=9264KiB/s (9487kB/s), 2319KiB/s-6564KiB/s (2375kB/s-6722kB/s), io=32.0MiB (33.6MB), run=1872-3537msec