== sanity test 398b: DIO and buffer IO race ============== 22:57:53 (1780455473) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 5.63326 s, 8.9 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=181887: Tue Jun 2 23:00:16 2026 read: IOPS=11, BW=46.9KiB/s (48.1kB/s)(5992KiB/127685msec) clat (usec): min=47, max=963796, avg=46971.75, stdev=38091.67 lat (usec): min=48, max=963798, avg=46973.34, stdev=38091.75 clat percentiles (usec): | 1.00th=[ 58], 5.00th=[ 13566], 10.00th=[ 18220], 20.00th=[ 23725], | 30.00th=[ 28705], 40.00th=[ 34341], 50.00th=[ 39584], 60.00th=[ 46924], | 70.00th=[ 55313], 80.00th=[ 65274], 90.00th=[ 82314], 95.00th=[105382], | 99.00th=[152044], 99.50th=[170918], 99.90th=[248513], 99.95th=[960496], | 99.99th=[960496] bw ( KiB/s): min= 7, max= 95, per=24.95%, avg=46.66, stdev=18.41, samples=250 iops : min= 1, max= 23, avg=11.02, stdev= 4.66, samples=250 write: IOPS=12, BW=49.3KiB/s (50.5kB/s)(6296KiB/127685msec); 0 zone resets clat (usec): min=1196, max=340798, avg=36037.37, stdev=37001.92 lat (usec): min=1197, max=340800, avg=36041.50, stdev=37002.21 clat percentiles (usec): | 1.00th=[ 1319], 5.00th=[ 1582], 10.00th=[ 2442], 20.00th=[ 4817], | 30.00th=[ 8848], 40.00th=[ 18220], 50.00th=[ 25560], 60.00th=[ 33817], | 70.00th=[ 43779], 80.00th=[ 60031], 90.00th=[ 86508], 95.00th=[112722], | 99.00th=[154141], 99.50th=[177210], 99.90th=[254804], 99.95th=[341836], | 99.99th=[341836] bw ( KiB/s): min= 7, max= 126, per=25.15%, avg=49.29, stdev=23.69, samples=249 iops : min= 1, max= 31, avg=11.67, stdev= 5.99, samples=249 lat (usec) : 50=0.07%, 100=1.24%, 250=0.23% lat (msec) : 2=3.84%, 4=4.82%, 10=7.65%, 20=10.38%, 50=40.98% lat (msec) : 100=24.32%, 250=6.38%, 500=0.07%, 1000=0.03% cpu : usr=0.08%, sys=5.35%, ctx=7119, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181888: Tue Jun 2 23:00:16 2026 read: IOPS=11, BW=46.8KiB/s (47.0kB/s)(5940KiB/126790msec) clat (usec): min=45, max=893092, avg=47874.28, stdev=40222.34 lat (usec): min=46, max=893094, avg=47876.88, stdev=40223.27 clat percentiles (usec): | 1.00th=[ 62], 5.00th=[ 14222], 10.00th=[ 17957], 20.00th=[ 23987], | 30.00th=[ 29492], 40.00th=[ 34866], 50.00th=[ 40109], 60.00th=[ 46400], | 70.00th=[ 54789], 80.00th=[ 65799], 90.00th=[ 83362], 95.00th=[102237], | 99.00th=[177210], 99.50th=[210764], 99.90th=[530580], 99.95th=[893387], | 99.99th=[893387] bw ( KiB/s): min= 7, max= 103, per=24.76%, avg=46.30, stdev=19.64, samples=250 iops : min= 1, max= 25, avg=10.92, stdev= 4.96, samples=250 write: IOPS=12, BW=50.1KiB/s (51.3kB/s)(6348KiB/126790msec); 0 zone resets clat (usec): min=1144, max=243547, avg=34720.06, stdev=35913.82 lat (usec): min=1145, max=243549, avg=34729.46, stdev=35914.09 clat percentiles (usec): | 1.00th=[ 1287], 5.00th=[ 1500], 10.00th=[ 2180], 20.00th=[ 4293], | 30.00th=[ 8094], 40.00th=[ 15533], 50.00th=[ 24249], 60.00th=[ 33424], | 70.00th=[ 44303], 80.00th=[ 58983], 90.00th=[ 82314], 95.00th=[107480], | 99.00th=[162530], 99.50th=[170918], 99.90th=[227541], 99.95th=[244319], | 99.99th=[244319] bw ( KiB/s): min= 7, max= 151, per=25.50%, avg=49.98, stdev=22.49, samples=247 iops : min= 1, max= 37, avg=11.85, stdev= 5.68, samples=247 lat (usec) : 50=0.10%, 100=0.85%, 250=0.16% lat (msec) : 2=4.62%, 4=4.92%, 10=7.85%, 20=10.97%, 50=39.71% lat (msec) : 100=24.90%, 250=5.76%, 500=0.10%, 750=0.03%, 1000=0.03% cpu : usr=0.08%, sys=5.34%, ctx=7070, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181889: Tue Jun 2 23:00:16 2026 read: IOPS=12, BW=48.4KiB/s (49.6kB/s)(6028KiB/124534msec) clat (usec): min=43, max=962023, avg=45643.45, stdev=38829.40 lat (usec): min=43, max=962025, avg=45645.31, stdev=38829.20 clat percentiles (usec): | 1.00th=[ 63], 5.00th=[ 13960], 10.00th=[ 17171], 20.00th=[ 22414], | 30.00th=[ 28181], 40.00th=[ 32900], 50.00th=[ 38011], 60.00th=[ 43779], | 70.00th=[ 51643], 80.00th=[ 63177], 90.00th=[ 81265], 95.00th=[105382], | 99.00th=[145753], 99.50th=[183501], 99.90th=[329253], 99.95th=[960496], | 99.99th=[960496] bw ( KiB/s): min= 7, max= 104, per=25.77%, avg=48.20, stdev=19.89, samples=244 iops : min= 1, max= 26, avg=11.40, stdev= 5.01, samples=244 write: IOPS=12, BW=50.3KiB/s (51.5kB/s)(6260KiB/124534msec); 0 zone resets clat (usec): min=1102, max=261972, avg=35289.74, stdev=35545.95 lat (usec): min=1103, max=261973, avg=35292.04, stdev=35546.03 clat percentiles (usec): | 1.00th=[ 1287], 5.00th=[ 1582], 10.00th=[ 2343], 20.00th=[ 4817], | 30.00th=[ 8848], 40.00th=[ 17433], 50.00th=[ 25560], 60.00th=[ 34866], | 70.00th=[ 45351], 80.00th=[ 58983], 90.00th=[ 83362], 95.00th=[104334], | 99.00th=[162530], 99.50th=[177210], 99.90th=[225444], 99.95th=[261096], | 99.99th=[261096] bw ( KiB/s): min= 7, max= 135, per=25.54%, avg=50.06, stdev=21.43, samples=244 iops : min= 1, max= 33, avg=11.87, stdev= 5.43, samples=244 lat (usec) : 50=0.10%, 100=1.20%, 250=0.16%, 500=0.16%, 750=0.07% lat (usec) : 1000=0.03% lat (msec) : 2=4.04%, 4=4.92%, 10=7.32%, 20=10.94%, 50=41.96% lat (msec) : 100=23.34%, 250=5.60%, 500=0.13%, 1000=0.03% cpu : usr=0.08%, sys=5.35%, ctx=6971, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181890: Tue Jun 2 23:00:16 2026 read: IOPS=11, BW=47.4KiB/s (48.5kB/s)(6052KiB/127743msec) clat (usec): min=48, max=367265, avg=47266.36, stdev=33214.43 lat (usec): min=50, max=367266, avg=47272.78, stdev=33210.73 clat percentiles (usec): | 1.00th=[ 60], 5.00th=[ 13042], 10.00th=[ 17171], 20.00th=[ 22938], | 30.00th=[ 28967], 40.00th=[ 34341], 50.00th=[ 39584], 60.00th=[ 46400], | 70.00th=[ 54264], 80.00th=[ 66323], 90.00th=[ 86508], 95.00th=[107480], | 99.00th=[162530], 99.50th=[193987], 99.90th=[291505], 99.95th=[367002], | 99.99th=[367002] bw ( KiB/s): min= 7, max= 103, per=25.16%, avg=47.04, stdev=20.26, samples=251 iops : min= 1, max= 25, avg=11.10, stdev= 5.12, samples=251 write: IOPS=12, BW=48.8KiB/s (49.0kB/s)(6236KiB/127743msec); 0 zone resets clat (usec): min=1187, max=898790, avg=35712.49, stdev=42112.56 lat (usec): min=1188, max=898792, avg=35727.02, stdev=42140.05 clat percentiles (usec): | 1.00th=[ 1270], 5.00th=[ 1549], 10.00th=[ 2507], 20.00th=[ 4555], | 30.00th=[ 8094], 40.00th=[ 15795], 50.00th=[ 25035], 60.00th=[ 33817], | 70.00th=[ 45876], 80.00th=[ 61080], 90.00th=[ 84411], 95.00th=[106431], | 99.00th=[152044], 99.50th=[179307], 99.90th=[308282], 99.95th=[901776], | 99.99th=[901776] bw ( KiB/s): min= 7, max= 111, per=24.88%, avg=48.76, stdev=22.34, samples=249 iops : min= 1, max= 27, avg=11.54, stdev= 5.62, samples=249 lat (usec) : 50=0.03%, 100=1.20%, 250=0.26%, 500=0.03%, 750=0.03% lat (msec) : 2=3.71%, 4=5.37%, 10=8.20%, 20=10.77%, 50=39.62% lat (msec) : 100=24.48%, 250=6.09%, 500=0.16%, 1000=0.03% cpu : usr=0.07%, sys=5.23%, ctx=7114, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=188KiB/s (192kB/s), 46.8KiB/s-48.4KiB/s (47.0kB/s-49.6kB/s), io=23.4MiB (24.6MB), run=124534-127743msec WRITE: bw=197KiB/s (202kB/s), 48.8KiB/s-50.3KiB/s (49.0kB/s-51.5kB/s), io=24.6MiB (25.7MB), run=124534-127743msec rand-rw: (groupid=0, jobs=1): err= 0: pid=181892: Tue Jun 2 23:00:57 2026 read: IOPS=9, BW=36.1KiB/s (36.0kB/s)(5992KiB/166018msec) clat (msec): min=5, max=993, avg=43.99, stdev=46.03 lat (msec): min=5, max=993, avg=43.99, stdev=46.03 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 14], 20.00th=[ 17], | 30.00th=[ 21], 40.00th=[ 25], 50.00th=[ 29], 60.00th=[ 36], | 70.00th=[ 44], 80.00th=[ 63], 90.00th=[ 101], 95.00th=[ 130], | 99.00th=[ 184], 99.50th=[ 199], 99.90th=[ 326], 99.95th=[ 995], | 99.99th=[ 995] bw ( KiB/s): min= 7, max= 151, per=25.75%, avg=36.57, stdev=25.61, samples=319 iops : min= 1, max= 37, avg= 8.49, stdev= 6.44, samples=319 write: IOPS=9, BW=37.9KiB/s (38.8kB/s)(6296KiB/166018msec); 0 zone resets clat (msec): min=12, max=463, avg=63.50, stdev=45.51 lat (msec): min=12, max=463, avg=63.50, stdev=45.51 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 22], 10.00th=[ 26], 20.00th=[ 31], | 30.00th=[ 36], 40.00th=[ 43], 50.00th=[ 50], 60.00th=[ 59], | 70.00th=[ 70], 80.00th=[ 89], 90.00th=[ 123], 95.00th=[ 153], | 99.00th=[ 232], 99.50th=[ 284], 99.90th=[ 384], 99.95th=[ 464], | 99.99th=[ 464] bw ( KiB/s): min= 7, max= 103, per=25.38%, avg=37.82, stdev=22.11, samples=324 iops : min= 1, max= 25, avg= 8.79, stdev= 5.57, samples=324 lat (msec) : 10=1.89%, 20=13.74%, 50=46.68%, 100=24.41%, 250=12.76% lat (msec) : 500=0.49%, 1000=0.03% cpu : usr=0.06%, sys=2.23%, ctx=5000, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181893: Tue Jun 2 23:00:57 2026 read: IOPS=8, BW=35.7KiB/s (36.5kB/s)(5940KiB/166548msec) clat (msec): min=5, max=1020, avg=42.80, stdev=45.18 lat (msec): min=5, max=1020, avg=42.80, stdev=45.18 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 17], | 30.00th=[ 21], 40.00th=[ 25], 50.00th=[ 29], 60.00th=[ 36], | 70.00th=[ 45], 80.00th=[ 60], 90.00th=[ 91], 95.00th=[ 124], | 99.00th=[ 186], 99.50th=[ 211], 99.90th=[ 326], 99.95th=[ 1020], | 99.99th=[ 1020] bw ( KiB/s): min= 7, max= 134, per=25.88%, avg=36.75, stdev=24.38, samples=314 iops : min= 1, max= 33, avg= 8.54, stdev= 6.14, samples=314 write: IOPS=9, BW=38.1KiB/s (39.0kB/s)(6348KiB/166548msec); 0 zone resets clat (msec): min=12, max=442, avg=64.79, stdev=46.48 lat (msec): min=12, max=442, avg=64.79, stdev=46.48 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 22], 10.00th=[ 26], 20.00th=[ 31], | 30.00th=[ 36], 40.00th=[ 42], 50.00th=[ 50], 60.00th=[ 60], | 70.00th=[ 74], 80.00th=[ 95], 90.00th=[ 124], 95.00th=[ 153], | 99.00th=[ 230], 99.50th=[ 279], 99.90th=[ 380], 99.95th=[ 443], | 99.99th=[ 443] bw ( KiB/s): min= 7, max= 119, per=25.49%, avg=37.98, stdev=22.81, samples=324 iops : min= 1, max= 29, avg= 8.85, stdev= 5.74, samples=324 lat (msec) : 10=1.46%, 20=14.23%, 50=46.26%, 100=24.90%, 250=12.53% lat (msec) : 500=0.59%, 2000=0.03% cpu : usr=0.06%, sys=2.21%, ctx=4929, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181894: Tue Jun 2 23:00:57 2026 read: IOPS=8, BW=35.9KiB/s (36.7kB/s)(6028KiB/168047msec) clat (msec): min=5, max=314, avg=44.96, stdev=42.10 lat (msec): min=5, max=314, avg=44.96, stdev=42.10 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 14], 20.00th=[ 17], | 30.00th=[ 21], 40.00th=[ 25], 50.00th=[ 30], 60.00th=[ 36], | 70.00th=[ 47], 80.00th=[ 66], 90.00th=[ 103], 95.00th=[ 134], | 99.00th=[ 205], 99.50th=[ 232], 99.90th=[ 313], 99.95th=[ 317], | 99.99th=[ 317] bw ( KiB/s): min= 7, max= 127, per=25.72%, avg=36.52, stdev=23.43, samples=321 iops : min= 1, max= 31, avg= 8.47, stdev= 5.90, samples=321 write: IOPS=9, BW=37.3KiB/s (38.1kB/s)(6260KiB/168047msec); 0 zone resets clat (msec): min=9, max=1016, avg=63.96, stdev=52.57 lat (msec): min=9, max=1016, avg=63.97, stdev=52.57 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 21], 10.00th=[ 24], 20.00th=[ 29], | 30.00th=[ 35], 40.00th=[ 41], 50.00th=[ 48], 60.00th=[ 59], | 70.00th=[ 73], 80.00th=[ 93], 90.00th=[ 123], 95.00th=[ 159], | 99.00th=[ 241], 99.50th=[ 292], 99.90th=[ 397], 99.95th=[ 1020], | 99.99th=[ 1020] bw ( KiB/s): min= 7, max= 126, per=25.04%, avg=37.31, stdev=23.95, samples=326 iops : min= 1, max= 31, avg= 8.67, stdev= 6.02, samples=326 lat (msec) : 10=1.92%, 20=14.65%, 50=45.70%, 100=23.96%, 250=13.18% lat (msec) : 500=0.55%, 2000=0.03% cpu : usr=0.06%, sys=2.20%, ctx=5028, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181895: Tue Jun 2 23:00:57 2026 read: IOPS=9, BW=36.0KiB/s (36.9kB/s)(6052KiB/168011msec) clat (msec): min=6, max=293, avg=44.24, stdev=40.59 lat (msec): min=6, max=293, avg=44.24, stdev=40.59 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 17], | 30.00th=[ 21], 40.00th=[ 25], 50.00th=[ 29], 60.00th=[ 36], | 70.00th=[ 47], 80.00th=[ 65], 90.00th=[ 100], 95.00th=[ 131], | 99.00th=[ 199], 99.50th=[ 230], 99.90th=[ 288], 99.95th=[ 296], | 99.99th=[ 296] bw ( KiB/s): min= 7, max= 119, per=26.18%, avg=37.18, stdev=23.96, samples=316 iops : min= 1, max= 29, avg= 8.65, stdev= 6.01, samples=316 write: IOPS=9, BW=37.1KiB/s (38.0kB/s)(6236KiB/168011msec); 0 zone resets clat (msec): min=11, max=1025, avg=64.73, stdev=50.39 lat (msec): min=11, max=1025, avg=64.74, stdev=50.39 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 22], 10.00th=[ 25], 20.00th=[ 30], | 30.00th=[ 36], 40.00th=[ 43], 50.00th=[ 50], 60.00th=[ 62], | 70.00th=[ 75], 80.00th=[ 94], 90.00th=[ 123], 95.00th=[ 155], | 99.00th=[ 220], 99.50th=[ 253], 99.90th=[ 388], 99.95th=[ 1028], | 99.99th=[ 1028] bw ( KiB/s): min= 7, max= 127, per=24.80%, avg=36.96, stdev=22.93, samples=327 iops : min= 1, max= 31, avg= 8.59, stdev= 5.78, samples=327 lat (msec) : 10=1.73%, 20=14.00%, 50=45.57%, 100=25.16%, 250=13.12% lat (msec) : 500=0.39%, 2000=0.03% cpu : usr=0.07%, sys=2.26%, ctx=4988, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=143KiB/s (146kB/s), 35.7KiB/s-36.1KiB/s (36.5kB/s-36.0kB/s), io=23.4MiB (24.6MB), run=166018-168047msec WRITE: bw=150KiB/s (153kB/s), 37.1KiB/s-38.1KiB/s (38.0kB/s-39.0kB/s), io=24.6MiB (25.7MB), run=166018-168047msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=181945: Tue Jun 2 23:01:36 2026 read: IOPS=12, BW=204KiB/s (209kB/s)(5920KiB/29070msec) clat (usec): min=38, max=186194, avg=42763.50, stdev=27312.87 lat (usec): min=38, max=186196, avg=42764.87, stdev=27312.83 clat percentiles (usec): | 1.00th=[ 56], 5.00th=[ 71], 10.00th=[ 10814], 20.00th=[ 21365], | 30.00th=[ 27395], 40.00th=[ 33162], 50.00th=[ 39584], 60.00th=[ 46924], | 70.00th=[ 52167], 80.00th=[ 63701], 90.00th=[ 77071], 95.00th=[ 91751], | 99.00th=[116917], 99.50th=[149947], 99.90th=[185598], 99.95th=[185598], | 99.99th=[185598] bw ( KiB/s): min= 61, max= 415, per=26.67%, avg=202.95, stdev=74.76, samples=57 iops : min= 3, max= 25, avg=11.95, stdev= 4.68, samples=57 write: IOPS=13, BW=219KiB/s (224kB/s)(6368KiB/29070msec); 0 zone resets clat (usec): min=1687, max=189160, avg=32950.23, stdev=32354.33 lat (usec): min=1689, max=189162, avg=32960.56, stdev=32350.31 clat percentiles (usec): | 1.00th=[ 1876], 5.00th=[ 2638], 10.00th=[ 3490], 20.00th=[ 5538], | 30.00th=[ 9765], 40.00th=[ 16057], 50.00th=[ 22938], 60.00th=[ 30802], | 70.00th=[ 41157], 80.00th=[ 58983], 90.00th=[ 81265], 95.00th=[ 95945], | 99.00th=[137364], 99.50th=[179307], 99.90th=[189793], 99.95th=[189793], | 99.99th=[189793] bw ( KiB/s): min= 31, max= 440, per=27.28%, avg=218.53, stdev=87.13, samples=57 iops : min= 1, max= 27, avg=12.93, stdev= 5.55, samples=57 lat (usec) : 50=0.13%, 100=3.26%, 250=0.26%, 500=0.39% lat (msec) : 2=1.30%, 4=5.86%, 10=9.38%, 20=11.46%, 50=39.58% lat (msec) : 100=24.61%, 250=3.78% cpu : usr=0.08%, sys=6.79%, ctx=1790, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181946: Tue Jun 2 23:01:36 2026 read: IOPS=11, BW=183KiB/s (187kB/s)(5744KiB/31453msec) clat (usec): min=38, max=190694, avg=47300.93, stdev=31482.31 lat (usec): min=39, max=190695, avg=47306.32, stdev=31486.19 clat percentiles (usec): | 1.00th=[ 59], 5.00th=[ 108], 10.00th=[ 15533], 20.00th=[ 23200], | 30.00th=[ 30540], 40.00th=[ 35914], 50.00th=[ 41157], 60.00th=[ 49546], | 70.00th=[ 57410], 80.00th=[ 69731], 90.00th=[ 83362], 95.00th=[112722], | 99.00th=[149947], 99.50th=[177210], 99.90th=[189793], 99.95th=[189793], | 99.99th=[189793] bw ( KiB/s): min= 31, max= 350, per=23.75%, avg=180.71, stdev=66.66, samples=62 iops : min= 1, max= 21, avg=10.56, stdev= 4.24, samples=62 write: IOPS=13, BW=208KiB/s (213kB/s)(6544KiB/31453msec); 0 zone resets clat (usec): min=1767, max=194992, avg=35082.88, stdev=35085.97 lat (usec): min=1770, max=194996, avg=35092.22, stdev=35083.26 clat percentiles (usec): | 1.00th=[ 1827], 5.00th=[ 2507], 10.00th=[ 3326], 20.00th=[ 5866], | 30.00th=[ 8979], 40.00th=[ 16909], 50.00th=[ 23987], 60.00th=[ 33162], | 70.00th=[ 42206], 80.00th=[ 63177], 90.00th=[ 81265], 95.00th=[107480], | 99.00th=[147850], 99.50th=[154141], 99.90th=[193987], 99.95th=[193987], | 99.99th=[193987] bw ( KiB/s): min= 31, max= 512, per=25.81%, avg=206.74, stdev=97.99, samples=62 iops : min= 1, max= 32, avg=12.21, stdev= 6.22, samples=62 lat (usec) : 50=0.13%, 100=2.08%, 250=0.91%, 500=0.13%, 1000=0.26% lat (msec) : 2=0.91%, 4=5.73%, 10=10.16%, 20=8.98%, 50=38.41% lat (msec) : 100=25.65%, 250=6.64% cpu : usr=0.07%, sys=6.10%, ctx=1826, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181947: Tue Jun 2 23:01:36 2026 read: IOPS=12, BW=204KiB/s (209kB/s)(6256KiB/30661msec) clat (usec): min=49, max=223845, avg=47450.23, stdev=33961.36 lat (usec): min=49, max=223846, avg=47451.65, stdev=33961.35 clat percentiles (usec): | 1.00th=[ 56], 5.00th=[ 73], 10.00th=[ 10683], 20.00th=[ 23987], | 30.00th=[ 29230], 40.00th=[ 34341], 50.00th=[ 41157], 60.00th=[ 48497], | 70.00th=[ 58459], 80.00th=[ 69731], 90.00th=[ 86508], 95.00th=[109577], | 99.00th=[164627], 99.50th=[210764], 99.90th=[223347], 99.95th=[223347], | 99.99th=[223347] bw ( KiB/s): min= 62, max= 386, per=26.78%, avg=203.77, stdev=65.66, samples=60 iops : min= 3, max= 24, avg=12.02, stdev= 4.24, samples=60 write: IOPS=12, BW=197KiB/s (201kB/s)(6032KiB/30661msec); 0 zone resets clat (usec): min=1725, max=209609, avg=31757.23, stdev=31973.65 lat (usec): min=1727, max=209611, avg=31760.31, stdev=31973.64 clat percentiles (usec): | 1.00th=[ 1844], 5.00th=[ 2376], 10.00th=[ 3326], 20.00th=[ 6194], | 30.00th=[ 9765], 40.00th=[ 14353], 50.00th=[ 21365], 60.00th=[ 29230], | 70.00th=[ 41157], 80.00th=[ 53216], 90.00th=[ 71828], 95.00th=[ 95945], | 99.00th=[145753], 99.50th=[181404], 99.90th=[208667], 99.95th=[208667], | 99.99th=[208667] bw ( KiB/s): min= 62, max= 525, per=24.10%, avg=193.07, stdev=101.11, samples=60 iops : min= 3, max= 32, avg=11.32, stdev= 6.37, samples=60 lat (usec) : 50=0.13%, 100=3.26%, 250=0.65%, 500=0.26%, 750=0.13% lat (usec) : 1000=0.26% lat (msec) : 2=1.17%, 4=5.73%, 10=8.59%, 20=11.46%, 50=38.67% lat (msec) : 100=24.22%, 250=5.47% cpu : usr=0.05%, sys=6.50%, ctx=1847, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181948: Tue Jun 2 23:01:36 2026 read: IOPS=12, BW=201KiB/s (206kB/s)(6032KiB/30027msec) clat (usec): min=46, max=199512, avg=43262.68, stdev=28154.63 lat (usec): min=47, max=199513, avg=43264.09, stdev=28154.60 clat percentiles (usec): | 1.00th=[ 53], 5.00th=[ 64], 10.00th=[ 318], 20.00th=[ 23725], | 30.00th=[ 28443], 40.00th=[ 33162], 50.00th=[ 40109], 60.00th=[ 46924], | 70.00th=[ 52167], 80.00th=[ 63177], 90.00th=[ 78119], 95.00th=[ 94897], | 99.00th=[133694], 99.50th=[154141], 99.90th=[200279], 99.95th=[200279], | 99.99th=[200279] bw ( KiB/s): min= 63, max= 386, per=26.18%, avg=199.24, stdev=68.55, samples=59 iops : min= 3, max= 24, avg=11.71, stdev= 4.31, samples=59 write: IOPS=13, BW=208KiB/s (213kB/s)(6256KiB/30027msec); 0 zone resets clat (usec): min=1641, max=190758, avg=34922.29, stdev=35750.31 lat (usec): min=1643, max=190761, avg=34928.51, stdev=35749.70 clat percentiles (usec): | 1.00th=[ 1795], 5.00th=[ 2245], 10.00th=[ 3458], 20.00th=[ 6390], | 30.00th=[ 10028], 40.00th=[ 15401], 50.00th=[ 23725], 60.00th=[ 31327], | 70.00th=[ 42206], 80.00th=[ 56886], 90.00th=[ 88605], 95.00th=[112722], | 99.00th=[164627], 99.50th=[179307], 99.90th=[189793], 99.95th=[189793], | 99.99th=[189793] bw ( KiB/s): min= 63, max= 524, per=26.03%, avg=208.49, stdev=86.45, samples=59 iops : min= 3, max= 32, avg=12.29, stdev= 5.52, samples=59 lat (usec) : 50=0.26%, 100=3.78%, 250=0.78%, 500=0.26% lat (msec) : 2=2.08%, 4=4.17%, 10=9.24%, 20=11.20%, 50=38.80% lat (msec) : 100=24.22%, 250=5.21% cpu : usr=0.09%, sys=6.53%, ctx=1792, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=762KiB/s (780kB/s), 183KiB/s-204KiB/s (187kB/s-209kB/s), io=23.4MiB (24.5MB), run=29070-31453msec WRITE: bw=801KiB/s (820kB/s), 197KiB/s-219KiB/s (201kB/s-224kB/s), io=24.6MiB (25.8MB), run=29070-31453msec rand-rw: (groupid=0, jobs=1): err= 0: pid=181950: Tue Jun 2 23:01:47 2026 read: IOPS=9, BW=145KiB/s (149kB/s)(5920KiB/40780msec) clat (msec): min=6, max=225, avg=45.03, stdev=36.40 lat (msec): min=6, max=225, avg=45.03, stdev=36.40 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 19], | 30.00th=[ 22], 40.00th=[ 26], 50.00th=[ 31], 60.00th=[ 39], | 70.00th=[ 50], 80.00th=[ 70], 90.00th=[ 100], 95.00th=[ 128], | 99.00th=[ 165], 99.50th=[ 199], 99.90th=[ 226], 99.95th=[ 226], | 99.99th=[ 226] bw ( KiB/s): min= 31, max= 478, per=24.72%, avg=141.88, stdev=86.99, samples=80 iops : min= 1, max= 29, avg= 8.14, stdev= 5.53, samples=80 write: IOPS=9, BW=156KiB/s (160kB/s)(6368KiB/40780msec); 0 zone resets clat (msec): min=12, max=227, avg=60.35, stdev=39.13 lat (msec): min=12, max=227, avg=60.36, stdev=39.13 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 22], 10.00th=[ 25], 20.00th=[ 31], | 30.00th=[ 35], 40.00th=[ 42], 50.00th=[ 49], 60.00th=[ 55], | 70.00th=[ 69], 80.00th=[ 89], 90.00th=[ 116], 95.00th=[ 148], | 99.00th=[ 201], 99.50th=[ 218], 99.90th=[ 228], 99.95th=[ 228], | 99.99th=[ 228] bw ( KiB/s): min= 29, max= 380, per=25.55%, avg=154.30, stdev=88.55, samples=80 iops : min= 1, max= 23, avg= 8.91, stdev= 5.61, samples=80 lat (msec) : 10=1.56%, 20=12.63%, 50=46.74%, 100=26.95%, 250=12.11% cpu : usr=0.06%, sys=2.45%, ctx=1239, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181951: Tue Jun 2 23:01:47 2026 read: IOPS=8, BW=138KiB/s (141kB/s)(5744KiB/41682msec) clat (msec): min=6, max=249, avg=43.21, stdev=37.63 lat (msec): min=6, max=249, avg=43.21, stdev=37.63 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 14], 20.00th=[ 18], | 30.00th=[ 22], 40.00th=[ 26], 50.00th=[ 30], 60.00th=[ 37], | 70.00th=[ 46], 80.00th=[ 64], 90.00th=[ 94], 95.00th=[ 126], | 99.00th=[ 180], 99.50th=[ 222], 99.90th=[ 251], 99.95th=[ 251], | 99.99th=[ 251] bw ( KiB/s): min= 29, max= 384, per=24.28%, avg=139.35, stdev=84.67, samples=80 iops : min= 1, max= 24, avg= 7.96, stdev= 5.40, samples=80 write: IOPS=9, BW=157KiB/s (161kB/s)(6544KiB/41682msec); 0 zone resets clat (msec): min=13, max=263, avg=63.76, stdev=45.80 lat (msec): min=13, max=263, avg=63.77, stdev=45.80 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 20], 10.00th=[ 24], 20.00th=[ 31], | 30.00th=[ 35], 40.00th=[ 41], 50.00th=[ 48], 60.00th=[ 56], | 70.00th=[ 71], 80.00th=[ 90], 90.00th=[ 138], 95.00th=[ 159], | 99.00th=[ 215], 99.50th=[ 236], 99.90th=[ 264], 99.95th=[ 264], | 99.99th=[ 264] bw ( KiB/s): min= 31, max= 447, per=25.56%, avg=154.35, stdev=94.24, samples=82 iops : min= 1, max= 27, avg= 8.91, stdev= 5.93, samples=82 lat (msec) : 10=1.56%, 20=13.15%, 50=47.14%, 100=24.61%, 250=13.41% lat (msec) : 500=0.13% cpu : usr=0.06%, sys=2.24%, ctx=1244, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181952: Tue Jun 2 23:01:47 2026 read: IOPS=9, BW=151KiB/s (155kB/s)(6256KiB/41420msec) clat (msec): min=6, max=246, avg=44.17, stdev=37.62 lat (msec): min=6, max=246, avg=44.18, stdev=37.62 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 18], | 30.00th=[ 21], 40.00th=[ 25], 50.00th=[ 30], 60.00th=[ 38], | 70.00th=[ 47], 80.00th=[ 66], 90.00th=[ 100], 95.00th=[ 128], | 99.00th=[ 169], 99.50th=[ 184], 99.90th=[ 247], 99.95th=[ 247], | 99.99th=[ 247] bw ( KiB/s): min= 31, max= 570, per=26.27%, avg=150.77, stdev=103.61, samples=82 iops : min= 1, max= 35, avg= 8.70, stdev= 6.56, samples=82 write: IOPS=9, BW=146KiB/s (149kB/s)(6032KiB/41420msec); 0 zone resets clat (msec): min=15, max=296, avg=63.80, stdev=41.95 lat (msec): min=15, max=296, avg=63.81, stdev=41.96 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 22], 10.00th=[ 25], 20.00th=[ 31], | 30.00th=[ 37], 40.00th=[ 43], 50.00th=[ 51], 60.00th=[ 62], | 70.00th=[ 73], 80.00th=[ 95], 90.00th=[ 124], 95.00th=[ 148], | 99.00th=[ 197], 99.50th=[ 207], 99.90th=[ 296], 99.95th=[ 296], | 99.99th=[ 296] bw ( KiB/s): min= 30, max= 445, per=24.05%, avg=145.26, stdev=91.66, samples=82 iops : min= 1, max= 27, avg= 8.33, stdev= 5.80, samples=82 lat (msec) : 10=1.43%, 20=13.28%, 50=46.88%, 100=24.74%, 250=13.54% lat (msec) : 500=0.13% cpu : usr=0.05%, sys=2.29%, ctx=1242, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181953: Tue Jun 2 23:01:47 2026 read: IOPS=9, BW=147KiB/s (150kB/s)(6032KiB/41108msec) clat (msec): min=7, max=287, avg=45.55, stdev=40.80 lat (msec): min=7, max=287, avg=45.55, stdev=40.80 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 13], 10.00th=[ 15], 20.00th=[ 19], | 30.00th=[ 23], 40.00th=[ 26], 50.00th=[ 31], 60.00th=[ 37], | 70.00th=[ 47], 80.00th=[ 68], 90.00th=[ 101], 95.00th=[ 133], | 99.00th=[ 192], 99.50th=[ 271], 99.90th=[ 288], 99.95th=[ 288], | 99.99th=[ 288] bw ( KiB/s): min= 30, max= 446, per=25.49%, avg=146.30, stdev=94.72, samples=80 iops : min= 1, max= 27, avg= 8.41, stdev= 5.96, samples=80 write: IOPS=9, BW=152KiB/s (156kB/s)(6256KiB/41108msec); 0 zone resets clat (msec): min=15, max=275, avg=61.03, stdev=42.79 lat (msec): min=15, max=275, avg=61.04, stdev=42.80 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 22], 10.00th=[ 25], 20.00th=[ 29], | 30.00th=[ 33], 40.00th=[ 41], 50.00th=[ 47], 60.00th=[ 55], | 70.00th=[ 71], 80.00th=[ 88], 90.00th=[ 118], 95.00th=[ 148], | 99.00th=[ 220], 99.50th=[ 239], 99.90th=[ 275], 99.95th=[ 275], | 99.99th=[ 275] bw ( KiB/s): min= 29, max= 416, per=25.27%, avg=152.64, stdev=89.27, samples=80 iops : min= 1, max= 26, avg= 8.80, stdev= 5.69, samples=80 lat (msec) : 10=0.39%, 20=13.41%, 50=49.35%, 100=24.35%, 250=12.11% lat (msec) : 500=0.39% cpu : usr=0.06%, sys=2.44%, ctx=1293, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=575KiB/s (588kB/s), 138KiB/s-151KiB/s (141kB/s-155kB/s), io=23.4MiB (24.5MB), run=40780-41682msec WRITE: bw=605KiB/s (619kB/s), 146KiB/s-157KiB/s (149kB/s-161kB/s), io=24.6MiB (25.8MB), run=40780-41682msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=181967: Tue Jun 2 23:01:57 2026 read: IOPS=2, BW=2494KiB/s (2554kB/s)(7168KiB/2874msec) clat (msec): min=76, max=238, avg=152.98, stdev=66.57 lat (msec): min=76, max=238, avg=152.98, stdev=66.57 clat percentiles (msec): | 1.00th=[ 77], 5.00th=[ 77], 10.00th=[ 77], 20.00th=[ 84], | 30.00th=[ 105], 40.00th=[ 105], 50.00th=[ 167], 60.00th=[ 176], | 70.00th=[ 176], 80.00th=[ 228], 90.00th=[ 239], 95.00th=[ 239], | 99.00th=[ 239], 99.50th=[ 239], 99.90th=[ 239], 99.95th=[ 239], | 99.99th=[ 239] bw ( KiB/s): min= 1917, max= 5575, per=67.91%, avg=3843.67, stdev=1836.81, samples=3 iops : min= 1, max= 5, avg= 3.00, stdev= 2.00, samples=3 write: IOPS=1, BW=1781KiB/s (1824kB/s)(5120KiB/2874msec); 0 zone resets clat (msec): min=189, max=784, avg=354.93, stdev=245.53 lat (msec): min=189, max=784, avg=355.06, stdev=245.53 clat percentiles (msec): | 1.00th=[ 190], 5.00th=[ 190], 10.00th=[ 190], 20.00th=[ 190], | 30.00th=[ 224], 40.00th=[ 224], 50.00th=[ 249], 60.00th=[ 249], | 70.00th=[ 330], 80.00th=[ 330], 90.00th=[ 785], 95.00th=[ 785], | 99.00th=[ 785], 99.50th=[ 785], 99.90th=[ 785], 99.95th=[ 785], | 99.99th=[ 785] bw ( KiB/s): min= 1858, max= 2031, per=24.58%, avg=1947.50, stdev=75.82, samples=4 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=4 lat (msec) : 100=16.67%, 250=66.67%, 500=8.33%, 1000=8.33% cpu : usr=0.03%, sys=28.58%, ctx=462, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181968: Tue Jun 2 23:01:57 2026 read: IOPS=0, BW=566KiB/s (580kB/s)(2048KiB/3618msec) clat (msec): min=55, max=182, avg=119.07, stdev=89.77 lat (msec): min=55, max=182, avg=119.08, stdev=89.77 clat percentiles (msec): | 1.00th=[ 56], 5.00th=[ 56], 10.00th=[ 56], 20.00th=[ 56], | 30.00th=[ 56], 40.00th=[ 56], 50.00th=[ 56], 60.00th=[ 184], | 70.00th=[ 184], 80.00th=[ 184], 90.00th=[ 184], 95.00th=[ 184], | 99.00th=[ 184], 99.50th=[ 184], 99.90th=[ 184], 99.95th=[ 184], | 99.99th=[ 184] bw ( KiB/s): min= 2000, max= 2048, per=35.76%, avg=2024.00, stdev=33.94, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 write: IOPS=2, BW=2830KiB/s (2898kB/s)(10.0MiB/3618msec); 0 zone resets clat (msec): min=53, max=878, avg=335.67, stdev=281.41 lat (msec): min=53, max=878, avg=335.82, stdev=281.47 clat percentiles (msec): | 1.00th=[ 54], 5.00th=[ 54], 10.00th=[ 54], 20.00th=[ 82], | 30.00th=[ 132], 40.00th=[ 167], 50.00th=[ 197], 60.00th=[ 284], | 70.00th=[ 401], 80.00th=[ 409], 90.00th=[ 751], 95.00th=[ 877], | 99.00th=[ 877], 99.50th=[ 877], 99.90th=[ 877], 99.95th=[ 877], | 99.99th=[ 877] bw ( KiB/s): min= 1984, max= 6144, per=46.15%, avg=3657.00, stdev=2253.53, samples=5 iops : min= 1, max= 6, avg= 2.80, stdev= 2.49, samples=5 lat (msec) : 100=25.00%, 250=33.33%, 500=25.00%, 1000=16.67% cpu : usr=0.06%, sys=26.13%, ctx=226, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181969: Tue Jun 2 23:01:57 2026 read: IOPS=2, BW=2176KiB/s (2228kB/s)(6144KiB/2824msec) clat (usec): min=710, max=262241, avg=109339.84, stdev=121451.88 lat (usec): min=712, max=262242, avg=109377.50, stdev=121412.87 clat percentiles (usec): | 1.00th=[ 709], 5.00th=[ 709], 10.00th=[ 709], 20.00th=[ 742], | 30.00th=[ 742], 40.00th=[ 857], 50.00th=[ 857], 60.00th=[189793], | 70.00th=[202376], 80.00th=[202376], 90.00th=[263193], 95.00th=[263193], | 99.00th=[263193], 99.50th=[263193], 99.90th=[263193], 99.95th=[263193], | 99.99th=[263193] bw ( KiB/s): min= 1984, max= 5752, per=57.52%, avg=3255.67, stdev=2162.02, samples=3 iops : min= 1, max= 5, avg= 2.33, stdev= 2.31, samples=3 write: IOPS=2, BW=2176KiB/s (2228kB/s)(6144KiB/2824msec); 0 zone resets clat (msec): min=97, max=619, avg=351.85, stdev=179.40 lat (msec): min=97, max=620, avg=352.12, stdev=179.42 clat percentiles (msec): | 1.00th=[ 97], 5.00th=[ 97], 10.00th=[ 97], 20.00th=[ 230], | 30.00th=[ 230], 40.00th=[ 334], 50.00th=[ 334], 60.00th=[ 401], | 70.00th=[ 435], 80.00th=[ 435], 90.00th=[ 617], 95.00th=[ 617], | 99.00th=[ 617], 99.50th=[ 617], 99.90th=[ 617], 99.95th=[ 617], | 99.99th=[ 617] bw ( KiB/s): min= 1917, max= 4039, per=31.46%, avg=2492.75, stdev=1031.89, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (usec) : 750=16.67%, 1000=8.33% lat (msec) : 100=8.33%, 250=25.00%, 500=33.33%, 750=8.33% cpu : usr=0.00%, sys=29.92%, ctx=271, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181970: Tue Jun 2 23:01:57 2026 read: IOPS=1, BW=1963KiB/s (2010kB/s)(5120KiB/2608msec) clat (usec): min=987, max=234688, avg=112645.03, stdev=109182.07 lat (usec): min=988, max=234690, avg=112646.58, stdev=109182.11 clat percentiles (usec): | 1.00th=[ 988], 5.00th=[ 988], 10.00th=[ 988], 20.00th=[ 988], | 30.00th=[ 1631], 40.00th=[ 1631], 50.00th=[124257], 60.00th=[124257], | 70.00th=[200279], 80.00th=[200279], 90.00th=[233833], 95.00th=[233833], | 99.00th=[233833], 99.50th=[233833], 99.90th=[233833], 99.95th=[233833], | 99.99th=[233833] bw ( KiB/s): min= 1984, max= 6095, per=71.37%, avg=4039.50, stdev=2906.92, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 write: IOPS=2, BW=2748KiB/s (2814kB/s)(7168KiB/2608msec); 0 zone resets clat (msec): min=87, max=594, avg=284.46, stdev=181.19 lat (msec): min=88, max=594, avg=284.66, stdev=181.10 clat percentiles (msec): | 1.00th=[ 88], 5.00th=[ 88], 10.00th=[ 88], 20.00th=[ 159], | 30.00th=[ 203], 40.00th=[ 203], 50.00th=[ 228], 60.00th=[ 247], | 70.00th=[ 247], 80.00th=[ 472], 90.00th=[ 592], 95.00th=[ 592], | 99.00th=[ 592], 99.50th=[ 592], 99.90th=[ 592], 99.95th=[ 592], | 99.99th=[ 592] bw ( KiB/s): min= 3968, max= 5752, per=57.88%, avg=4586.33, stdev=1010.12, samples=3 iops : min= 3, max= 5, avg= 3.67, stdev= 1.15, samples=3 lat (usec) : 1000=8.33% lat (msec) : 2=8.33%, 100=8.33%, 250=58.33%, 500=8.33%, 750=8.33% cpu : usr=0.08%, sys=28.15%, ctx=179, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5661KiB/s (5796kB/s), 566KiB/s-2494KiB/s (580kB/s-2554kB/s), io=20.0MiB (20.0MB), run=2608-3618msec WRITE: bw=7925KiB/s (8115kB/s), 1781KiB/s-2830KiB/s (1824kB/s-2898kB/s), io=28.0MiB (29.4MB), run=2608-3618msec rand-rw: (groupid=0, jobs=1): err= 0: pid=181972: Tue Jun 2 23:01:58 2026 read: IOPS=1, BW=1997KiB/s (2045kB/s)(7168KiB/3589msec) clat (msec): min=68, max=698, avg=284.18, stdev=246.78 lat (msec): min=68, max=698, avg=284.19, stdev=246.78 clat percentiles (msec): | 1.00th=[ 69], 5.00th=[ 69], 10.00th=[ 69], 20.00th=[ 93], | 30.00th=[ 121], 40.00th=[ 121], 50.00th=[ 159], 60.00th=[ 309], | 70.00th=[ 309], 80.00th=[ 542], 90.00th=[ 701], 95.00th=[ 701], | 99.00th=[ 701], 99.50th=[ 701], 99.90th=[ 701], 99.95th=[ 701], | 99.99th=[ 701] bw ( KiB/s): min= 1954, max= 3871, per=46.80%, avg=2466.75, stdev=936.70, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 write: IOPS=1, BW=1427KiB/s (1461kB/s)(5120KiB/3589msec); 0 zone resets clat (msec): min=94, max=499, avg=307.28, stdev=157.35 lat (msec): min=94, max=499, avg=307.38, stdev=157.35 clat percentiles (msec): | 1.00th=[ 94], 5.00th=[ 94], 10.00th=[ 94], 20.00th=[ 94], | 30.00th=[ 224], 40.00th=[ 224], 50.00th=[ 313], 60.00th=[ 313], | 70.00th=[ 405], 80.00th=[ 405], 90.00th=[ 502], 95.00th=[ 502], | 99.00th=[ 502], 99.50th=[ 502], 99.90th=[ 502], 99.95th=[ 502], | 99.99th=[ 502] bw ( KiB/s): min= 1954, max= 3976, per=40.18%, avg=2965.00, stdev=1429.77, samples=2 iops : min= 1, max= 3, avg= 2.00, stdev= 1.41, samples=2 lat (msec) : 100=25.00%, 250=25.00%, 500=33.33%, 750=16.67% cpu : usr=0.00%, sys=11.87%, ctx=113, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181973: Tue Jun 2 23:01:58 2026 read: IOPS=0, BW=550KiB/s (563kB/s)(2048KiB/3727msec) clat (msec): min=63, max=644, avg=353.91, stdev=411.09 lat (msec): min=63, max=644, avg=353.91, stdev=411.09 clat percentiles (msec): | 1.00th=[ 64], 5.00th=[ 64], 10.00th=[ 64], 20.00th=[ 64], | 30.00th=[ 64], 40.00th=[ 64], 50.00th=[ 64], 60.00th=[ 642], | 70.00th=[ 642], 80.00th=[ 642], 90.00th=[ 642], 95.00th=[ 642], | 99.00th=[ 642], 99.50th=[ 642], 99.90th=[ 642], 99.95th=[ 642], | 99.99th=[ 642] bw ( KiB/s): min= 1988, max= 2023, per=38.05%, avg=2005.50, stdev=24.75, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2748KiB/s (2813kB/s)(10.0MiB/3727msec); 0 zone resets clat (msec): min=74, max=903, avg=295.86, stdev=284.48 lat (msec): min=74, max=903, avg=295.98, stdev=284.50 clat percentiles (msec): | 1.00th=[ 74], 5.00th=[ 74], 10.00th=[ 74], 20.00th=[ 75], | 30.00th=[ 91], 40.00th=[ 93], 50.00th=[ 110], 60.00th=[ 249], | 70.00th=[ 288], 80.00th=[ 430], 90.00th=[ 651], 95.00th=[ 902], | 99.00th=[ 902], 99.50th=[ 902], 99.90th=[ 902], 99.95th=[ 902], | 99.99th=[ 902] bw ( KiB/s): min= 1935, max= 5965, per=40.23%, avg=2969.25, stdev=1997.52, samples=4 iops : min= 1, max= 5, avg= 2.00, stdev= 2.00, samples=4 lat (msec) : 100=41.67%, 250=16.67%, 500=16.67%, 750=16.67%, 1000=8.33% cpu : usr=0.00%, sys=11.73%, ctx=155, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181974: Tue Jun 2 23:01:58 2026 read: IOPS=1, BW=1685KiB/s (1725kB/s)(6144KiB/3647msec) clat (msec): min=65, max=547, avg=213.84, stdev=177.51 lat (msec): min=65, max=547, avg=213.85, stdev=177.51 clat percentiles (msec): | 1.00th=[ 66], 5.00th=[ 66], 10.00th=[ 66], 20.00th=[ 77], | 30.00th=[ 77], 40.00th=[ 150], 50.00th=[ 150], 60.00th=[ 201], | 70.00th=[ 245], 80.00th=[ 245], 90.00th=[ 550], 95.00th=[ 550], | 99.00th=[ 550], 99.50th=[ 550], 99.90th=[ 550], 99.95th=[ 550], | 99.99th=[ 550] bw ( KiB/s): min= 3908, max= 3976, per=74.79%, avg=3942.00, stdev=48.08, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1685KiB/s (1725kB/s)(6144KiB/3647msec); 0 zone resets clat (msec): min=84, max=678, avg=385.29, stdev=200.82 lat (msec): min=84, max=678, avg=385.44, stdev=200.81 clat percentiles (msec): | 1.00th=[ 85], 5.00th=[ 85], 10.00th=[ 85], 20.00th=[ 321], | 30.00th=[ 321], 40.00th=[ 338], 50.00th=[ 338], 60.00th=[ 363], | 70.00th=[ 523], 80.00th=[ 523], 90.00th=[ 676], 95.00th=[ 676], | 99.00th=[ 676], 99.50th=[ 676], 99.90th=[ 676], 99.95th=[ 676], | 99.99th=[ 676] bw ( KiB/s): min= 2019, max= 3871, per=35.74%, avg=2637.67, stdev=1068.10, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (msec) : 100=25.00%, 250=25.00%, 500=25.00%, 750=25.00% cpu : usr=0.03%, sys=9.38%, ctx=129, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181975: Tue Jun 2 23:01:58 2026 read: IOPS=1, BW=1318KiB/s (1350kB/s)(5120KiB/3885msec) clat (msec): min=53, max=598, avg=297.93, stdev=195.83 lat (msec): min=53, max=598, avg=297.93, stdev=195.83 clat percentiles (msec): | 1.00th=[ 54], 5.00th=[ 54], 10.00th=[ 54], 20.00th=[ 54], | 30.00th=[ 253], 40.00th=[ 253], 50.00th=[ 275], 60.00th=[ 275], | 70.00th=[ 313], 80.00th=[ 313], 90.00th=[ 600], 95.00th=[ 600], | 99.00th=[ 600], 99.50th=[ 600], 99.90th=[ 600], 99.95th=[ 600], | 99.99th=[ 600] bw ( KiB/s): min= 1988, max= 4087, per=51.19%, avg=2698.00, stdev=1203.01, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 write: IOPS=1, BW=1845KiB/s (1889kB/s)(7168KiB/3885msec); 0 zone resets clat (msec): min=62, max=890, avg=333.84, stdev=310.79 lat (msec): min=62, max=890, avg=333.94, stdev=310.81 clat percentiles (msec): | 1.00th=[ 63], 5.00th=[ 63], 10.00th=[ 63], 20.00th=[ 82], | 30.00th=[ 116], 40.00th=[ 116], 50.00th=[ 176], 60.00th=[ 477], | 70.00th=[ 477], 80.00th=[ 531], 90.00th=[ 894], 95.00th=[ 894], | 99.00th=[ 894], 99.50th=[ 894], 99.90th=[ 894], 99.95th=[ 894], | 99.99th=[ 894] bw ( KiB/s): min= 1935, max= 4087, per=40.49%, avg=2988.25, stdev=1168.22, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 1.15, samples=4 lat (msec) : 100=25.00%, 250=16.67%, 500=33.33%, 750=16.67%, 1000=8.33% cpu : usr=0.00%, sys=6.77%, ctx=119, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5272KiB/s (5398kB/s), 550KiB/s-1997KiB/s (563kB/s-2045kB/s), io=20.0MiB (20.0MB), run=3589-3885msec WRITE: bw=7380KiB/s (7557kB/s), 1427KiB/s-2748KiB/s (1461kB/s-2813kB/s), io=28.0MiB (29.4MB), run=3589-3885msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=181982: Tue Jun 2 23:02:09 2026 read: IOPS=1, BW=4496KiB/s (4604kB/s)(12.0MiB/2733msec) clat (msec): min=465, max=1137, avg=882.43, stdev=364.09 lat (msec): min=465, max=1137, avg=882.43, stdev=364.09 clat percentiles (msec): | 1.00th=[ 464], 5.00th=[ 464], 10.00th=[ 464], 20.00th=[ 464], | 30.00th=[ 464], 40.00th=[ 1045], 50.00th=[ 1045], 60.00th=[ 1045], | 70.00th=[ 1133], 80.00th=[ 1133], 90.00th=[ 1133], 95.00th=[ 1133], | 99.00th=[ 1133], 99.50th=[ 1133], 99.90th=[ 1133], 99.95th=[ 1133], | 99.99th=[ 1133] bw ( KiB/s): min= 8143, max= 8143, per=100.00%, avg=8143.00, stdev= 0.00, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.00%, sys=3.99%, ctx=46, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181983: Tue Jun 2 23:02:09 2026 read: IOPS=0, BW=1316KiB/s (1348kB/s)(4096KiB/3112msec) clat (nsec): min=691439k, max=691439k, avg=691439397.00, stdev= 0.00 lat (nsec): min=691444k, max=691444k, avg=691443646.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 693], 5.00th=[ 693], 10.00th=[ 693], 20.00th=[ 693], | 30.00th=[ 693], 40.00th=[ 693], 50.00th=[ 693], 60.00th=[ 693], | 70.00th=[ 693], 80.00th=[ 693], 90.00th=[ 693], 95.00th=[ 693], | 99.00th=[ 693], 99.50th=[ 693], 99.90th=[ 693], 99.95th=[ 693], | 99.99th=[ 693] bw ( KiB/s): min= 8159, max= 8159, per=100.00%, avg=8159.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2632KiB/s (2696kB/s)(8192KiB/3112msec); 0 zone resets clat (msec): min=977, max=1367, avg=1172.43, stdev=275.34 lat (msec): min=978, max=1367, avg=1172.81, stdev=275.31 clat percentiles (msec): | 1.00th=[ 978], 5.00th=[ 978], 10.00th=[ 978], 20.00th=[ 978], | 30.00th=[ 978], 40.00th=[ 978], 50.00th=[ 978], 60.00th=[ 1368], | 70.00th=[ 1368], 80.00th=[ 1368], 90.00th=[ 1368], 95.00th=[ 1368], | 99.00th=[ 1368], 99.50th=[ 1368], 99.90th=[ 1368], 99.95th=[ 1368], | 99.99th=[ 1368] bw ( KiB/s): min= 8143, max= 8143, per=77.34%, avg=8143.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=5.24%, ctx=45, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181985: Tue Jun 2 23:02:09 2026 write: IOPS=1, BW=4783KiB/s (4898kB/s)(12.0MiB/2569msec); 0 zone resets clat (msec): min=244, max=1858, avg=835.42, stdev=889.53 lat (msec): min=252, max=1858, avg=838.35, stdev=887.10 clat percentiles (msec): | 1.00th=[ 245], 5.00th=[ 245], 10.00th=[ 245], 20.00th=[ 245], | 30.00th=[ 245], 40.00th=[ 405], 50.00th=[ 405], 60.00th=[ 405], | 70.00th=[ 1854], 80.00th=[ 1854], 90.00th=[ 1854], 95.00th=[ 1854], | 99.00th=[ 1854], 99.50th=[ 1854], 99.90th=[ 1854], 99.95th=[ 1854], | 99.99th=[ 1854] bw ( KiB/s): min= 5979, max= 7937, per=66.08%, avg=6958.00, stdev=1384.52, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 250=33.33%, 500=33.33%, 2000=33.33% cpu : usr=0.12%, sys=7.20%, ctx=92, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181986: Tue Jun 2 23:02:09 2026 write: IOPS=1, BW=6041KiB/s (6186kB/s)(12.0MiB/2034msec); 0 zone resets clat (msec): min=163, max=1159, avg=665.36, stdev=498.21 lat (msec): min=164, max=1160, avg=666.02, stdev=498.49 clat percentiles (msec): | 1.00th=[ 163], 5.00th=[ 163], 10.00th=[ 163], 20.00th=[ 163], | 30.00th=[ 163], 40.00th=[ 676], 50.00th=[ 676], 60.00th=[ 676], | 70.00th=[ 1167], 80.00th=[ 1167], 90.00th=[ 1167], 95.00th=[ 1167], | 99.00th=[ 1167], 99.50th=[ 1167], 99.90th=[ 1167], 99.95th=[ 1167], | 99.99th=[ 1167] bw ( KiB/s): min= 6884, max= 8159, per=71.44%, avg=7521.50, stdev=901.56, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 250=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.00%, sys=7.23%, ctx=55, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5265KiB/s (5391kB/s), 1316KiB/s-4496KiB/s (1348kB/s-4604kB/s), io=16.0MiB (16.8MB), run=2733-3112msec WRITE: bw=10.3MiB/s (10.8MB/s), 2632KiB/s-6041KiB/s (2696kB/s-6186kB/s), io=32.0MiB (33.6MB), run=2034-3112msec rand-rw: (groupid=0, jobs=1): err= 0: pid=181984: Tue Jun 2 23:02:09 2026 read: IOPS=1, BW=6181KiB/s (6329kB/s)(12.0MiB/1988msec) clat (msec): min=505, max=795, avg=626.63, stdev=150.43 lat (msec): min=505, max=795, avg=626.63, stdev=150.43 clat percentiles (msec): | 1.00th=[ 506], 5.00th=[ 506], 10.00th=[ 506], 20.00th=[ 506], | 30.00th=[ 506], 40.00th=[ 584], 50.00th=[ 584], 60.00th=[ 584], | 70.00th=[ 793], 80.00th=[ 793], 90.00th=[ 793], 95.00th=[ 793], | 99.00th=[ 793], 99.50th=[ 793], 99.90th=[ 793], 99.95th=[ 793], | 99.99th=[ 793] bw ( KiB/s): min= 7937, max= 8175, per=100.00%, avg=8056.00, stdev=168.29, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=66.67%, 1000=33.33% cpu : usr=0.15%, sys=21.34%, ctx=512, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181987: Tue Jun 2 23:02:09 2026 read: IOPS=0, BW=1634KiB/s (1673kB/s)(4096KiB/2507msec) clat (nsec): min=530483k, max=530483k, avg=530483057.00, stdev= 0.00 lat (nsec): min=530485k, max=530485k, avg=530485152.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 531], 5.00th=[ 531], 10.00th=[ 531], 20.00th=[ 531], | 30.00th=[ 531], 40.00th=[ 531], 50.00th=[ 531], 60.00th=[ 531], | 70.00th=[ 531], 80.00th=[ 531], 90.00th=[ 531], 95.00th=[ 531], | 99.00th=[ 531], 99.50th=[ 531], 99.90th=[ 531], 99.95th=[ 531], | 99.99th=[ 531] bw ( KiB/s): min= 8175, max= 8175, per=100.00%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=3268KiB/s (3346kB/s)(8192KiB/2507msec); 0 zone resets clat (msec): min=658, max=1210, avg=934.45, stdev=390.19 lat (msec): min=658, max=1210, avg=934.82, stdev=390.35 clat percentiles (msec): | 1.00th=[ 659], 5.00th=[ 659], 10.00th=[ 659], 20.00th=[ 659], | 30.00th=[ 659], 40.00th=[ 659], 50.00th=[ 659], 60.00th=[ 1217], | 70.00th=[ 1217], 80.00th=[ 1217], 90.00th=[ 1217], 95.00th=[ 1217], | 99.00th=[ 1217], 99.50th=[ 1217], 99.90th=[ 1217], 99.95th=[ 1217], | 99.99th=[ 1217] bw ( KiB/s): min= 7937, max= 7937, per=73.83%, avg=7937.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=66.67%, 2000=33.33% cpu : usr=0.00%, sys=5.51%, ctx=111, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181988: Tue Jun 2 23:02:09 2026 write: IOPS=0, BW=4031KiB/s (4128kB/s)(12.0MiB/3048msec); 0 zone resets clat (msec): min=205, max=1546, avg=984.41, stdev=696.29 lat (msec): min=207, max=1547, avg=985.53, stdev=695.29 clat percentiles (msec): | 1.00th=[ 207], 5.00th=[ 207], 10.00th=[ 207], 20.00th=[ 207], | 30.00th=[ 207], 40.00th=[ 1200], 50.00th=[ 1200], 60.00th=[ 1200], | 70.00th=[ 1552], 80.00th=[ 1552], 90.00th=[ 1552], 95.00th=[ 1552], | 99.00th=[ 1552], 99.50th=[ 1552], 99.90th=[ 1552], 99.95th=[ 1552], | 99.99th=[ 1552] bw ( KiB/s): min= 7892, max= 7892, per=73.41%, avg=7892.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 2000=66.67% cpu : usr=0.00%, sys=4.17%, ctx=51, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181989: Tue Jun 2 23:02:09 2026 write: IOPS=1, BW=4110KiB/s (4208kB/s)(12.0MiB/2990msec); 0 zone resets clat (msec): min=258, max=1883, avg=978.77, stdev=828.52 lat (msec): min=259, max=1884, avg=979.87, stdev=828.12 clat percentiles (msec): | 1.00th=[ 259], 5.00th=[ 259], 10.00th=[ 259], 20.00th=[ 259], | 30.00th=[ 259], 40.00th=[ 793], 50.00th=[ 793], 60.00th=[ 793], | 70.00th=[ 1888], 80.00th=[ 1888], 90.00th=[ 1888], 95.00th=[ 1888], | 99.00th=[ 1888], 99.50th=[ 1888], 99.90th=[ 1888], 99.95th=[ 1888], | 99.99th=[ 1888] bw ( KiB/s): min= 8175, max= 8175, per=76.05%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=4.72%, ctx=57, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=6535KiB/s (6692kB/s), 1634KiB/s-6181KiB/s (1673kB/s-6329kB/s), io=16.0MiB (16.8MB), run=1988-2507msec WRITE: bw=10.5MiB/s (11.0MB/s), 3268KiB/s-4110KiB/s (3346kB/s-4208kB/s), io=32.0MiB (33.6MB), run=2507-3048msec