== sanity test 398b: DIO and buffer IO race ============== 18:31:04 (1780525864) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 2.99967 s, 16.8 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=156486: Wed Jun 3 18:32:23 2026 read: IOPS=21, BW=86.1KiB/s (88.2kB/s)(5992KiB/69585msec) clat (usec): min=32, max=146463, avg=24251.87, stdev=13712.54 lat (usec): min=33, max=146463, avg=24252.51, stdev=13712.55 clat percentiles (usec): | 1.00th=[ 130], 5.00th=[ 5997], 10.00th=[ 10028], 20.00th=[ 13960], | 30.00th=[ 16909], 40.00th=[ 19530], 50.00th=[ 22414], 60.00th=[ 25297], | 70.00th=[ 28967], 80.00th=[ 33162], 90.00th=[ 39584], 95.00th=[ 47449], | 99.00th=[ 68682], 99.50th=[ 79168], 99.90th=[116917], 99.95th=[145753], | 99.99th=[145753] bw ( KiB/s): min= 20, max= 255, per=24.93%, avg=86.00, stdev=29.54, samples=137 iops : min= 5, max= 63, avg=20.99, stdev= 7.41, samples=137 write: IOPS=22, BW=90.5KiB/s (92.7kB/s)(6296KiB/69585msec); 0 zone resets clat (usec): min=789, max=728068, avg=20898.44, stdev=22991.72 lat (usec): min=789, max=728068, avg=20899.22, stdev=22991.73 clat percentiles (usec): | 1.00th=[ 922], 5.00th=[ 3228], 10.00th=[ 5276], 20.00th=[ 7308], | 30.00th=[ 10945], 40.00th=[ 14615], 50.00th=[ 17957], 60.00th=[ 21627], | 70.00th=[ 25822], 80.00th=[ 31327], 90.00th=[ 39060], 95.00th=[ 46400], | 99.00th=[ 68682], 99.50th=[ 84411], 99.90th=[103285], 99.95th=[725615], | 99.99th=[725615] bw ( KiB/s): min= 8, max= 255, per=25.00%, avg=90.26, stdev=30.81, samples=137 iops : min= 2, max= 63, avg=22.07, stdev= 7.72, samples=137 lat (usec) : 50=0.03%, 100=0.10%, 250=1.30%, 500=0.20%, 750=0.03% lat (usec) : 1000=0.72% lat (msec) : 2=0.88%, 4=1.89%, 10=14.06%, 20=29.95%, 50=47.14% lat (msec) : 100=3.48%, 250=0.20%, 750=0.03% cpu : usr=0.08%, sys=29.30%, ctx=10835, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=156487: Wed Jun 3 18:32:23 2026 read: IOPS=21, BW=86.1KiB/s (88.2kB/s)(5940KiB/68971msec) clat (usec): min=73, max=121192, avg=24021.27, stdev=12332.71 lat (usec): min=74, max=121193, avg=24021.94, stdev=12332.72 clat percentiles (usec): | 1.00th=[ 172], 5.00th=[ 8291], 10.00th=[ 10814], 20.00th=[ 14222], | 30.00th=[ 16909], 40.00th=[ 19792], 50.00th=[ 22676], 60.00th=[ 25560], | 70.00th=[ 28705], 80.00th=[ 32637], 90.00th=[ 39060], 95.00th=[ 44827], | 99.00th=[ 61604], 99.50th=[ 65799], 99.90th=[117965], 99.95th=[121111], | 99.99th=[121111] bw ( KiB/s): min= 6, max= 176, per=25.07%, avg=86.48, stdev=27.96, samples=136 iops : min= 1, max= 44, avg=21.11, stdev= 7.09, samples=136 write: IOPS=23, BW=92.0KiB/s (94.2kB/s)(6348KiB/68971msec); 0 zone resets clat (usec): min=773, max=745964, avg=20749.40, stdev=23932.03 lat (usec): min=773, max=745965, avg=20750.15, stdev=23932.05 clat percentiles (usec): | 1.00th=[ 1205], 5.00th=[ 3490], 10.00th=[ 5276], 20.00th=[ 7308], | 30.00th=[ 10028], 40.00th=[ 13435], 50.00th=[ 16581], 60.00th=[ 20317], | 70.00th=[ 25297], 80.00th=[ 31065], 90.00th=[ 40633], 95.00th=[ 47973], | 99.00th=[ 74974], 99.50th=[ 96994], 99.90th=[119014], 99.95th=[742392], | 99.99th=[742392] bw ( KiB/s): min= 6, max= 184, per=25.36%, avg=91.55, stdev=32.05, samples=137 iops : min= 1, max= 46, avg=22.39, stdev= 8.06, samples=137 lat (usec) : 100=0.16%, 250=1.07%, 500=0.10%, 1000=0.39% lat (msec) : 2=0.65%, 4=2.21%, 10=14.49%, 20=31.28%, 50=46.06% lat (msec) : 100=3.29%, 250=0.26%, 750=0.03% cpu : usr=0.09%, sys=29.51%, ctx=10796, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=156488: Wed Jun 3 18:32:23 2026 read: IOPS=21, BW=87.7KiB/s (89.8kB/s)(6028KiB/68699msec) clat (usec): min=30, max=762257, avg=24601.27, stdev=22808.66 lat (usec): min=30, max=762257, avg=24602.00, stdev=22808.67 clat percentiles (usec): | 1.00th=[ 121], 5.00th=[ 7898], 10.00th=[ 10814], 20.00th=[ 14222], | 30.00th=[ 16909], 40.00th=[ 19530], 50.00th=[ 22414], 60.00th=[ 25560], | 70.00th=[ 29230], 80.00th=[ 33162], 90.00th=[ 39584], 95.00th=[ 45876], | 99.00th=[ 61604], 99.50th=[ 74974], 99.90th=[108528], 99.95th=[759170], | 99.99th=[759170] bw ( KiB/s): min= 8, max= 176, per=25.51%, avg=88.02, stdev=27.16, samples=135 iops : min= 2, max= 44, avg=21.50, stdev= 6.86, samples=135 write: IOPS=22, BW=91.1KiB/s (93.3kB/s)(6260KiB/68699msec); 0 zone resets clat (usec): min=765, max=118963, avg=19971.49, stdev=14736.12 lat (usec): min=765, max=118964, avg=19973.02, stdev=14735.66 clat percentiles (usec): | 1.00th=[ 906], 5.00th=[ 3195], 10.00th=[ 4948], 20.00th=[ 6980], | 30.00th=[ 10028], 40.00th=[ 13566], 50.00th=[ 16909], 60.00th=[ 20841], | 70.00th=[ 25035], 80.00th=[ 30540], 90.00th=[ 40109], 95.00th=[ 46924], | 99.00th=[ 67634], 99.50th=[ 77071], 99.90th=[112722], 99.95th=[119014], | 99.99th=[119014] bw ( KiB/s): min= 20, max= 208, per=25.28%, avg=91.24, stdev=31.20, samples=135 iops : min= 5, max= 52, avg=22.31, stdev= 7.91, samples=135 lat (usec) : 50=0.13%, 100=0.23%, 250=1.20%, 500=0.10%, 750=0.07% lat (usec) : 1000=0.68% lat (msec) : 2=0.68%, 4=2.57%, 10=13.80%, 20=30.60%, 50=46.16% lat (msec) : 100=3.65%, 250=0.10%, 1000=0.03% cpu : usr=0.06%, sys=29.39%, ctx=10710, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=156489: Wed Jun 3 18:32:23 2026 read: IOPS=22, BW=89.1KiB/s (91.2kB/s)(6052KiB/67921msec) clat (usec): min=31, max=114696, avg=23496.63, stdev=12997.97 lat (usec): min=31, max=114697, avg=23497.32, stdev=12997.99 clat percentiles (usec): | 1.00th=[ 116], 5.00th=[ 6652], 10.00th=[ 10159], 20.00th=[ 13829], | 30.00th=[ 16581], 40.00th=[ 19268], 50.00th=[ 21890], 60.00th=[ 25035], | 70.00th=[ 28181], 80.00th=[ 32113], 90.00th=[ 38011], 95.00th=[ 43779], | 99.00th=[ 67634], 99.50th=[ 86508], 99.90th=[101188], 99.95th=[114820], | 99.99th=[114820] bw ( KiB/s): min= 39, max= 191, per=26.16%, avg=90.25, stdev=28.31, samples=133 iops : min= 9, max= 47, avg=22.05, stdev= 7.15, samples=133 write: IOPS=22, BW=91.8KiB/s (94.0kB/s)(6236KiB/67921msec); 0 zone resets clat (usec): min=794, max=780612, avg=20517.40, stdev=24296.04 lat (usec): min=795, max=780613, avg=20518.22, stdev=24296.03 clat percentiles (usec): | 1.00th=[ 1254], 5.00th=[ 3458], 10.00th=[ 4883], 20.00th=[ 6980], | 30.00th=[ 10290], 40.00th=[ 14353], 50.00th=[ 17171], 60.00th=[ 20841], | 70.00th=[ 25035], 80.00th=[ 30278], 90.00th=[ 39060], 95.00th=[ 46924], | 99.00th=[ 67634], 99.50th=[ 82314], 99.90th=[168821], 99.95th=[784335], | 99.99th=[784335] bw ( KiB/s): min= 23, max= 192, per=25.73%, avg=92.89, stdev=30.82, samples=133 iops : min= 5, max= 48, avg=22.71, stdev= 7.81, samples=133 lat (usec) : 50=0.13%, 100=0.16%, 250=1.37%, 500=0.29%, 1000=0.39% lat (msec) : 2=0.65%, 4=2.44%, 10=14.16%, 20=31.02%, 50=46.09% lat (msec) : 100=3.09%, 250=0.16%, 1000=0.03% cpu : usr=0.07%, sys=29.38%, ctx=10581, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=345KiB/s (353kB/s), 86.1KiB/s-89.1KiB/s (88.2kB/s-91.2kB/s), io=23.4MiB (24.6MB), run=67921-69585msec WRITE: bw=361KiB/s (370kB/s), 90.5KiB/s-92.0KiB/s (92.7kB/s-94.2kB/s), io=24.6MiB (25.7MB), run=67921-69585msec fio: pid=156493, err=5/file:backend.c:481, func=full resid, error=Input/output error fio: pid=156490, err=5/file:backend.c:481, func=full resid, error=Input/output error rand-rw: (groupid=0, jobs=1): err= 5 (file:backend.c:481, func=full resid, error=Input/output error): pid=156490: Wed Jun 3 18:32:44 2026 read: IOPS=16, BW=66.5KiB/s (68.1kB/s)(5936KiB/89270msec) clat (msec): min=2, max=719, avg=20.24, stdev=25.93 lat (msec): min=2, max=719, avg=20.24, stdev=25.93 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 4], 10.00th=[ 5], 20.00th=[ 6], | 30.00th=[ 8], 40.00th=[ 10], 50.00th=[ 15], 60.00th=[ 19], | 70.00th=[ 23], 80.00th=[ 30], 90.00th=[ 46], 95.00th=[ 58], | 99.00th=[ 90], 99.50th=[ 105], 99.90th=[ 180], 99.95th=[ 718], | 99.99th=[ 718] bw ( KiB/s): min= 7, max= 208, per=25.57%, avg=66.74, stdev=39.77, samples=175 iops : min= 1, max= 52, avg=16.31, stdev=10.12, samples=175 write: IOPS=17, BW=69.8KiB/s (71.5kB/s)(6232KiB/89270msec); 0 zone resets clat (msec): min=14, max=240, avg=37.79, stdev=19.91 lat (msec): min=14, max=240, avg=37.80, stdev=19.91 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 19], 10.00th=[ 21], 20.00th=[ 23], | 30.00th=[ 26], 40.00th=[ 29], 50.00th=[ 32], 60.00th=[ 36], | 70.00th=[ 42], 80.00th=[ 51], 90.00th=[ 65], 95.00th=[ 77], | 99.00th=[ 107], 99.50th=[ 123], 99.90th=[ 171], 99.95th=[ 241], | 99.99th=[ 241] bw ( KiB/s): min= 16, max= 168, per=25.60%, avg=69.89, stdev=35.37, samples=175 iops : min= 4, max= 42, avg=17.09, stdev= 9.04, samples=175 lat (msec) : 4=3.45%, 10=16.37%, 20=16.86%, 50=49.29%, 100=12.88% lat (msec) : 250=1.08%, 750=0.03% cpu : usr=0.08%, sys=13.10%, ctx=7047, majf=0, minf=19 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1558,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=156491: Wed Jun 3 18:32:44 2026 read: IOPS=16, BW=66.3KiB/s (67.9kB/s)(5940KiB/89628msec) clat (msec): min=2, max=774, avg=19.52, stdev=26.11 lat (msec): min=2, max=774, avg=19.53, stdev=26.11 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 4], 10.00th=[ 5], 20.00th=[ 6], | 30.00th=[ 7], 40.00th=[ 10], 50.00th=[ 15], 60.00th=[ 19], | 70.00th=[ 23], 80.00th=[ 30], 90.00th=[ 42], 95.00th=[ 56], | 99.00th=[ 82], 99.50th=[ 95], 99.90th=[ 157], 99.95th=[ 776], | 99.99th=[ 776] bw ( KiB/s): min= 8, max= 192, per=25.51%, avg=66.59, stdev=41.28, samples=176 iops : min= 2, max= 48, avg=16.27, stdev=10.48, samples=176 write: IOPS=17, BW=70.8KiB/s (72.5kB/s)(6348KiB/89628msec); 0 zone resets clat (msec): min=12, max=230, avg=37.99, stdev=21.26 lat (msec): min=12, max=230, avg=38.00, stdev=21.26 clat percentiles (msec): | 1.00th=[ 15], 5.00th=[ 18], 10.00th=[ 21], 20.00th=[ 23], | 30.00th=[ 26], 40.00th=[ 29], 50.00th=[ 32], 60.00th=[ 36], | 70.00th=[ 42], 80.00th=[ 51], 90.00th=[ 65], 95.00th=[ 78], | 99.00th=[ 116], 99.50th=[ 144], 99.90th=[ 184], 99.95th=[ 230], | 99.99th=[ 230] bw ( KiB/s): min= 16, max= 184, per=26.01%, avg=70.99, stdev=36.66, samples=176 iops : min= 4, max= 46, avg=17.37, stdev= 9.37, samples=176 lat (msec) : 4=4.26%, 10=15.72%, 20=15.72%, 50=50.72%, 100=12.37% lat (msec) : 250=1.17%, 1000=0.03% cpu : usr=0.08%, sys=12.92%, ctx=7210, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=156492: Wed Jun 3 18:32:44 2026 read: IOPS=16, BW=67.0KiB/s (68.6kB/s)(6028KiB/89925msec) clat (msec): min=2, max=159, avg=19.81, stdev=18.60 lat (msec): min=2, max=159, avg=19.81, stdev=18.60 clat percentiles (msec): | 1.00th=[ 3], 5.00th=[ 4], 10.00th=[ 5], 20.00th=[ 6], | 30.00th=[ 8], 40.00th=[ 11], 50.00th=[ 15], 60.00th=[ 19], | 70.00th=[ 23], 80.00th=[ 31], 90.00th=[ 44], 95.00th=[ 58], | 99.00th=[ 91], 99.50th=[ 106], 99.90th=[ 150], 99.95th=[ 161], | 99.99th=[ 161] bw ( KiB/s): min= 8, max= 192, per=25.87%, avg=67.51, stdev=39.10, samples=177 iops : min= 2, max= 48, avg=16.50, stdev= 9.96, samples=177 write: IOPS=17, BW=69.6KiB/s (71.3kB/s)(6260KiB/89925msec); 0 zone resets clat (msec): min=10, max=794, avg=38.17, stdev=27.49 lat (msec): min=10, max=794, avg=38.17, stdev=27.49 clat percentiles (msec): | 1.00th=[ 14], 5.00th=[ 18], 10.00th=[ 20], 20.00th=[ 23], | 30.00th=[ 26], 40.00th=[ 29], 50.00th=[ 32], 60.00th=[ 37], | 70.00th=[ 43], 80.00th=[ 52], 90.00th=[ 64], 95.00th=[ 75], | 99.00th=[ 105], 99.50th=[ 118], 99.90th=[ 241], 99.95th=[ 793], | 99.99th=[ 793] bw ( KiB/s): min= 8, max= 216, per=25.53%, avg=69.70, stdev=38.29, samples=178 iops : min= 2, max= 54, avg=17.05, stdev= 9.77, samples=178 lat (msec) : 4=3.71%, 10=15.92%, 20=17.38%, 50=48.76%, 100=13.22% lat (msec) : 250=0.98%, 1000=0.03% cpu : usr=0.06%, sys=12.91%, ctx=7207, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 5 (file:backend.c:481, func=full resid, error=Input/output error): pid=156493: Wed Jun 3 18:32:44 2026 read: IOPS=16, BW=64.4KiB/s (65.9kB/s)(5612KiB/87164msec) clat (msec): min=2, max=153, avg=20.78, stdev=17.44 lat (msec): min=2, max=153, avg=20.78, stdev=17.44 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 5], 10.00th=[ 5], 20.00th=[ 7], | 30.00th=[ 9], 40.00th=[ 12], 50.00th=[ 17], 60.00th=[ 21], | 70.00th=[ 25], 80.00th=[ 33], 90.00th=[ 45], 95.00th=[ 56], | 99.00th=[ 79], 99.50th=[ 90], 99.90th=[ 115], 99.95th=[ 155], | 99.99th=[ 155] bw ( KiB/s): min= 7, max= 200, per=24.92%, avg=65.03, stdev=36.25, samples=170 iops : min= 1, max= 50, avg=15.87, stdev= 9.25, samples=170 write: IOPS=16, BW=66.0KiB/s (67.6kB/s)(5756KiB/87164msec); 0 zone resets clat (msec): min=13, max=775, avg=40.08, stdev=28.30 lat (msec): min=13, max=775, avg=40.08, stdev=28.30 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 20], 10.00th=[ 22], 20.00th=[ 25], | 30.00th=[ 27], 40.00th=[ 31], 50.00th=[ 34], 60.00th=[ 39], | 70.00th=[ 44], 80.00th=[ 52], 90.00th=[ 66], 95.00th=[ 78], | 99.00th=[ 120], 99.50th=[ 136], 99.90th=[ 194], 99.95th=[ 776], | 99.99th=[ 776] bw ( KiB/s): min= 8, max= 160, per=24.15%, avg=65.94, stdev=32.62, samples=172 iops : min= 2, max= 40, avg=16.10, stdev= 8.32, samples=172 lat (msec) : 4=2.25%, 10=15.41%, 20=14.46%, 50=53.18%, 100=13.37% lat (msec) : 250=1.27%, 1000=0.04% cpu : usr=0.05%, sys=12.89%, ctx=6644, majf=0, minf=20 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1404,1439,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=262KiB/s (268kB/s), 64.4KiB/s-67.0KiB/s (65.9kB/s-68.6kB/s), io=22.0MiB (24.1MB), run=87164-89925msec WRITE: bw=274KiB/s (280kB/s), 66.0KiB/s-70.8KiB/s (67.6kB/s-72.5kB/s), io=24.0MiB (25.2MB), run=87164-89925msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=156520: Wed Jun 3 18:33:13 2026 read: IOPS=18, BW=289KiB/s (296kB/s)(5920KiB/20466msec) clat (usec): min=148, max=97281, avg=27223.48, stdev=13492.83 lat (usec): min=149, max=97282, avg=27224.31, stdev=13492.72 clat percentiles (usec): | 1.00th=[ 167], 5.00th=[ 223], 10.00th=[12125], 20.00th=[19006], | 30.00th=[21627], 40.00th=[23725], 50.00th=[26608], 60.00th=[29492], | 70.00th=[32113], 80.00th=[35914], 90.00th=[43254], 95.00th=[49021], | 99.00th=[65274], 99.50th=[67634], 99.90th=[96994], 99.95th=[96994], | 99.99th=[96994] bw ( KiB/s): min= 158, max= 480, per=25.21%, avg=285.42, stdev=80.54, samples=40 iops : min= 9, max= 30, avg=17.30, stdev= 5.06, samples=40 write: IOPS=19, BW=311KiB/s (319kB/s)(6368KiB/20466msec); 0 zone resets clat (usec): min=2655, max=83764, avg=25795.37, stdev=15427.40 lat (usec): min=2657, max=83765, avg=25796.75, stdev=15427.34 clat percentiles (usec): | 1.00th=[ 4424], 5.00th=[ 7832], 10.00th=[ 9241], 20.00th=[11994], | 30.00th=[15139], 40.00th=[19268], 50.00th=[22414], 60.00th=[25560], | 70.00th=[31851], 80.00th=[36963], 90.00th=[49021], 95.00th=[56361], | 99.00th=[70779], 99.50th=[76022], 99.90th=[83362], 99.95th=[83362], | 99.99th=[83362] bw ( KiB/s): min= 177, max= 480, per=26.13%, avg=311.25, stdev=69.76, samples=40 iops : min= 11, max= 30, avg=18.93, stdev= 4.39, samples=40 lat (usec) : 250=3.12%, 500=0.91% lat (msec) : 2=0.13%, 4=0.39%, 10=6.25%, 20=22.92%, 50=59.77% lat (msec) : 100=6.51% cpu : usr=0.07%, sys=32.02%, ctx=3371, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=156522: Wed Jun 3 18:33:13 2026 read: IOPS=17, BW=276KiB/s (283kB/s)(5744KiB/20777msec) clat (usec): min=37, max=96585, avg=30038.30, stdev=15348.80 lat (usec): min=38, max=96586, avg=30039.45, stdev=15348.51 clat percentiles (usec): | 1.00th=[ 151], 5.00th=[ 223], 10.00th=[16057], 20.00th=[19530], | 30.00th=[22152], 40.00th=[26084], 50.00th=[28967], 60.00th=[31589], | 70.00th=[34866], 80.00th=[40633], 90.00th=[49021], 95.00th=[55837], | 99.00th=[87557], 99.50th=[95945], 99.90th=[96994], 99.95th=[96994], | 99.99th=[96994] bw ( KiB/s): min= 118, max= 416, per=24.35%, avg=275.63, stdev=80.26, samples=41 iops : min= 7, max= 26, avg=16.68, stdev= 4.99, samples=41 write: IOPS=19, BW=315KiB/s (323kB/s)(6544KiB/20777msec); 0 zone resets clat (usec): min=1164, max=80653, avg=24182.14, stdev=14803.28 lat (usec): min=1189, max=80654, avg=24183.35, stdev=14803.19 clat percentiles (usec): | 1.00th=[ 2933], 5.00th=[ 7570], 10.00th=[ 8586], 20.00th=[10945], | 30.00th=[14484], 40.00th=[17695], 50.00th=[21103], 60.00th=[24511], | 70.00th=[28967], 80.00th=[36439], 90.00th=[45876], 95.00th=[52691], | 99.00th=[68682], 99.50th=[76022], 99.90th=[80217], 99.95th=[80217], | 99.99th=[80217] bw ( KiB/s): min= 158, max= 478, per=26.31%, avg=313.37, stdev=77.19, samples=41 iops : min= 9, max= 29, avg=19.05, stdev= 4.92, samples=41 lat (usec) : 50=0.13%, 250=2.34%, 500=0.52% lat (msec) : 2=0.39%, 4=0.52%, 10=7.94%, 20=23.70%, 50=56.64% lat (msec) : 100=7.81% cpu : usr=0.08%, sys=32.08%, ctx=3115, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=156524: Wed Jun 3 18:33:13 2026 read: IOPS=18, BW=296KiB/s (303kB/s)(6256KiB/21156msec) clat (usec): min=41, max=80105, avg=28483.29, stdev=14492.30 lat (usec): min=42, max=80106, avg=28497.59, stdev=14468.10 clat percentiles (usec): | 1.00th=[ 137], 5.00th=[ 219], 10.00th=[12256], 20.00th=[18482], | 30.00th=[22152], 40.00th=[24773], 50.00th=[27657], 60.00th=[31589], | 70.00th=[34866], 80.00th=[39584], 90.00th=[44827], 95.00th=[53740], | 99.00th=[70779], 99.50th=[78119], 99.90th=[80217], 99.95th=[80217], | 99.99th=[80217] bw ( KiB/s): min= 159, max= 479, per=26.17%, avg=296.29, stdev=75.81, samples=42 iops : min= 9, max= 29, avg=17.95, stdev= 4.71, samples=42 write: IOPS=17, BW=285KiB/s (292kB/s)(6032KiB/21156msec); 0 zone resets clat (usec): min=1440, max=81250, avg=26243.31, stdev=14804.53 lat (usec): min=1452, max=81252, avg=26244.94, stdev=14804.06 clat percentiles (usec): | 1.00th=[ 3621], 5.00th=[ 7635], 10.00th=[ 9110], 20.00th=[12780], | 30.00th=[17433], 40.00th=[20317], 50.00th=[22938], 60.00th=[26870], | 70.00th=[32375], 80.00th=[38011], 90.00th=[47973], 95.00th=[56361], | 99.00th=[66847], 99.50th=[68682], 99.90th=[81265], 99.95th=[81265], | 99.99th=[81265] bw ( KiB/s): min= 126, max= 638, per=23.71%, avg=282.43, stdev=96.47, samples=42 iops : min= 7, max= 39, avg=17.10, stdev= 6.03, samples=42 lat (usec) : 50=0.13%, 250=3.52%, 500=0.26% lat (msec) : 2=0.39%, 4=0.39%, 10=5.99%, 20=20.05%, 50=61.33% lat (msec) : 100=7.94% cpu : usr=0.07%, sys=31.20%, ctx=3244, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=156525: Wed Jun 3 18:33:13 2026 read: IOPS=18, BW=303KiB/s (310kB/s)(6032KiB/19900msec) clat (usec): min=88, max=97874, avg=27312.93, stdev=15127.99 lat (usec): min=88, max=97874, avg=27313.60, stdev=15127.98 clat percentiles (usec): | 1.00th=[ 159], 5.00th=[ 210], 10.00th=[ 314], 20.00th=[18220], | 30.00th=[21365], 40.00th=[23725], 50.00th=[26608], 60.00th=[29492], | 70.00th=[33817], 80.00th=[38011], 90.00th=[43779], 95.00th=[53216], | 99.00th=[74974], 99.50th=[93848], 99.90th=[98042], 99.95th=[98042], | 99.99th=[98042] bw ( KiB/s): min= 191, max= 480, per=26.74%, avg=302.74, stdev=77.45, samples=39 iops : min= 11, max= 30, avg=18.38, stdev= 4.97, samples=39 write: IOPS=19, BW=314KiB/s (322kB/s)(6256KiB/19900msec); 0 zone resets clat (usec): min=1328, max=100126, avg=24481.18, stdev=14691.20 lat (usec): min=1329, max=100128, avg=24501.94, stdev=14729.95 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 12], | 30.00th=[ 15], 40.00th=[ 19], 50.00th=[ 22], 60.00th=[ 26], | 70.00th=[ 30], 80.00th=[ 37], 90.00th=[ 44], 95.00th=[ 53], | 99.00th=[ 74], 99.50th=[ 79], 99.90th=[ 101], 99.95th=[ 101], | 99.99th=[ 101] bw ( KiB/s): min= 158, max= 448, per=26.58%, avg=316.54, stdev=72.92, samples=39 iops : min= 9, max= 28, avg=19.26, stdev= 4.60, samples=39 lat (usec) : 100=0.13%, 250=3.65%, 500=1.43%, 1000=0.13% lat (msec) : 2=0.39%, 4=0.39%, 10=7.03%, 20=22.01%, 50=58.72% lat (msec) : 100=5.99%, 250=0.13% cpu : usr=0.09%, sys=32.27%, ctx=3217, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1132KiB/s (1159kB/s), 276KiB/s-303KiB/s (283kB/s-310kB/s), io=23.4MiB (24.5MB), run=19900-21156msec WRITE: bw=1191KiB/s (1220kB/s), 285KiB/s-315KiB/s (292kB/s-323kB/s), io=24.6MiB (25.8MB), run=19900-21156msec rand-rw: (groupid=0, jobs=1): err= 0: pid=156521: Wed Jun 3 18:33:20 2026 read: IOPS=13, BW=217KiB/s (222kB/s)(5920KiB/27258msec) clat (msec): min=4, max=106, avg=26.09, stdev=19.19 lat (msec): min=4, max=106, avg=26.09, stdev=19.19 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 8], 10.00th=[ 10], 20.00th=[ 12], | 30.00th=[ 14], 40.00th=[ 17], 50.00th=[ 20], 60.00th=[ 24], | 70.00th=[ 29], 80.00th=[ 38], 90.00th=[ 54], 95.00th=[ 71], | 99.00th=[ 95], 99.50th=[ 100], 99.90th=[ 107], 99.95th=[ 107], | 99.99th=[ 107] bw ( KiB/s): min= 31, max= 544, per=24.72%, avg=215.28, stdev=115.06, samples=54 iops : min= 1, max= 34, avg=12.96, stdev= 7.37, samples=54 write: IOPS=14, BW=234KiB/s (239kB/s)(6368KiB/27258msec); 0 zone resets clat (msec): min=15, max=144, avg=44.14, stdev=22.47 lat (msec): min=15, max=144, avg=44.14, stdev=22.47 clat percentiles (msec): | 1.00th=[ 19], 5.00th=[ 23], 10.00th=[ 24], 20.00th=[ 27], | 30.00th=[ 30], 40.00th=[ 33], 50.00th=[ 37], 60.00th=[ 43], | 70.00th=[ 49], 80.00th=[ 60], 90.00th=[ 78], 95.00th=[ 89], | 99.00th=[ 128], 99.50th=[ 134], 99.90th=[ 144], 99.95th=[ 144], | 99.99th=[ 144] bw ( KiB/s): min= 31, max= 480, per=25.39%, avg=232.54, stdev=102.06, samples=54 iops : min= 1, max= 30, avg=14.06, stdev= 6.58, samples=54 lat (msec) : 10=6.38%, 20=19.01%, 50=54.04%, 100=19.14%, 250=1.43% cpu : usr=0.06%, sys=14.30%, ctx=2159, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=156523: Wed Jun 3 18:33:20 2026 read: IOPS=13, BW=209KiB/s (214kB/s)(5744KiB/27482msec) clat (msec): min=3, max=144, avg=28.74, stdev=23.70 lat (msec): min=3, max=144, avg=28.74, stdev=23.70 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 7], 10.00th=[ 9], 20.00th=[ 12], | 30.00th=[ 15], 40.00th=[ 17], 50.00th=[ 20], 60.00th=[ 24], | 70.00th=[ 32], 80.00th=[ 44], 90.00th=[ 65], 95.00th=[ 75], | 99.00th=[ 109], 99.50th=[ 140], 99.90th=[ 144], 99.95th=[ 144], | 99.99th=[ 144] bw ( KiB/s): min= 59, max= 576, per=23.73%, avg=206.69, stdev=113.65, samples=54 iops : min= 3, max= 36, avg=12.43, stdev= 7.26, samples=54 write: IOPS=14, BW=238KiB/s (244kB/s)(6544KiB/27482msec); 0 zone resets clat (msec): min=14, max=149, avg=41.73, stdev=20.85 lat (msec): min=14, max=149, avg=41.73, stdev=20.85 clat percentiles (msec): | 1.00th=[ 19], 5.00th=[ 22], 10.00th=[ 23], 20.00th=[ 26], | 30.00th=[ 28], 40.00th=[ 32], 50.00th=[ 35], 60.00th=[ 40], | 70.00th=[ 47], 80.00th=[ 58], 90.00th=[ 71], 95.00th=[ 86], | 99.00th=[ 108], 99.50th=[ 115], 99.90th=[ 150], 99.95th=[ 150], | 99.99th=[ 150] bw ( KiB/s): min= 31, max= 480, per=25.38%, avg=232.46, stdev=105.08, samples=54 iops : min= 1, max= 30, avg=14.04, stdev= 6.77, samples=54 lat (msec) : 4=0.13%, 10=6.12%, 20=19.14%, 50=52.86%, 100=19.79% lat (msec) : 250=1.95% cpu : usr=0.05%, sys=14.13%, ctx=2147, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=156526: Wed Jun 3 18:33:20 2026 read: IOPS=14, BW=231KiB/s (237kB/s)(6256KiB/27070msec) clat (msec): min=4, max=121, avg=26.48, stdev=20.60 lat (msec): min=4, max=121, avg=26.48, stdev=20.60 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 8], 10.00th=[ 10], 20.00th=[ 12], | 30.00th=[ 15], 40.00th=[ 18], 50.00th=[ 20], 60.00th=[ 24], | 70.00th=[ 27], 80.00th=[ 36], 90.00th=[ 56], 95.00th=[ 70], | 99.00th=[ 109], 99.50th=[ 113], 99.90th=[ 123], 99.95th=[ 123], | 99.99th=[ 123] bw ( KiB/s): min= 63, max= 574, per=26.44%, avg=230.28, stdev=120.99, samples=53 iops : min= 3, max= 35, avg=13.91, stdev= 7.65, samples=53 write: IOPS=13, BW=223KiB/s (228kB/s)(6032KiB/27070msec); 0 zone resets clat (msec): min=16, max=154, avg=44.00, stdev=21.69 lat (msec): min=16, max=154, avg=44.00, stdev=21.69 clat percentiles (msec): | 1.00th=[ 21], 5.00th=[ 22], 10.00th=[ 25], 20.00th=[ 28], | 30.00th=[ 31], 40.00th=[ 34], 50.00th=[ 37], 60.00th=[ 43], | 70.00th=[ 49], 80.00th=[ 61], 90.00th=[ 74], 95.00th=[ 89], | 99.00th=[ 117], 99.50th=[ 150], 99.90th=[ 155], 99.95th=[ 155], | 99.99th=[ 155] bw ( KiB/s): min= 95, max= 480, per=23.90%, avg=218.94, stdev=96.45, samples=53 iops : min= 5, max= 30, avg=13.19, stdev= 6.28, samples=53 lat (msec) : 10=5.73%, 20=20.18%, 50=53.39%, 100=18.88%, 250=1.82% cpu : usr=0.07%, sys=14.61%, ctx=2243, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=156527: Wed Jun 3 18:33:20 2026 read: IOPS=13, BW=221KiB/s (226kB/s)(6032KiB/27289msec) clat (msec): min=3, max=118, avg=25.93, stdev=19.65 lat (msec): min=3, max=118, avg=25.93, stdev=19.65 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 7], 10.00th=[ 9], 20.00th=[ 13], | 30.00th=[ 16], 40.00th=[ 17], 50.00th=[ 20], 60.00th=[ 24], | 70.00th=[ 28], 80.00th=[ 38], 90.00th=[ 54], 95.00th=[ 68], | 99.00th=[ 101], 99.50th=[ 106], 99.90th=[ 120], 99.95th=[ 120], | 99.99th=[ 120] bw ( KiB/s): min= 95, max= 544, per=25.01%, avg=217.81, stdev=109.93, samples=54 iops : min= 5, max= 34, avg=13.13, stdev= 7.06, samples=54 write: IOPS=14, BW=229KiB/s (235kB/s)(6256KiB/27289msec); 0 zone resets clat (msec): min=15, max=156, avg=44.52, stdev=22.17 lat (msec): min=15, max=156, avg=44.52, stdev=22.17 clat percentiles (msec): | 1.00th=[ 19], 5.00th=[ 22], 10.00th=[ 24], 20.00th=[ 28], | 30.00th=[ 30], 40.00th=[ 33], 50.00th=[ 39], 60.00th=[ 43], | 70.00th=[ 52], 80.00th=[ 59], 90.00th=[ 78], 95.00th=[ 93], | 99.00th=[ 118], 99.50th=[ 123], 99.90th=[ 157], 99.95th=[ 157], | 99.99th=[ 157] bw ( KiB/s): min= 94, max= 576, per=24.87%, avg=227.83, stdev=102.80, samples=54 iops : min= 5, max= 36, avg=13.76, stdev= 6.66, samples=54 lat (msec) : 4=0.26%, 10=6.25%, 20=19.92%, 50=51.82%, 100=20.05% lat (msec) : 250=1.69% cpu : usr=0.08%, sys=14.28%, ctx=2168, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=872KiB/s (892kB/s), 209KiB/s-231KiB/s (214kB/s-237kB/s), io=23.4MiB (24.5MB), run=27070-27482msec WRITE: bw=917KiB/s (939kB/s), 223KiB/s-238KiB/s (228kB/s-244kB/s), io=24.6MiB (25.8MB), run=27070-27482msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=156536: Wed Jun 3 18:33:28 2026 read: IOPS=3, BW=4068KiB/s (4166kB/s)(7168KiB/1762msec) clat (msec): min=2, max=251, avg=127.36, stdev=78.41 lat (msec): min=2, max=251, avg=127.36, stdev=78.41 clat percentiles (msec): | 1.00th=[ 3], 5.00th=[ 3], 10.00th=[ 3], 20.00th=[ 74], | 30.00th=[ 107], 40.00th=[ 107], 50.00th=[ 130], 60.00th=[ 161], | 70.00th=[ 161], 80.00th=[ 167], 90.00th=[ 251], 95.00th=[ 251], | 99.00th=[ 251], 99.50th=[ 251], 99.90th=[ 251], 99.95th=[ 251], | 99.99th=[ 251] bw ( KiB/s): min= 1976, max= 5361, per=51.68%, avg=3808.00, stdev=1709.66, samples=3 iops : min= 1, max= 5, avg= 3.00, stdev= 2.00, samples=3 write: IOPS=2, BW=2906KiB/s (2976kB/s)(5120KiB/1762msec); 0 zone resets clat (msec): min=120, max=260, avg=168.42, stdev=56.70 lat (msec): min=120, max=260, avg=168.46, stdev=56.70 clat percentiles (msec): | 1.00th=[ 121], 5.00th=[ 121], 10.00th=[ 121], 20.00th=[ 121], | 30.00th=[ 125], 40.00th=[ 125], 50.00th=[ 161], 60.00th=[ 161], | 70.00th=[ 178], 80.00th=[ 178], 90.00th=[ 262], 95.00th=[ 262], | 99.00th=[ 262], 99.50th=[ 262], 99.90th=[ 262], 99.95th=[ 262], | 99.99th=[ 262] bw ( KiB/s): min= 1787, max= 3953, per=25.15%, avg=2594.33, stdev=1183.58, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (msec) : 4=8.33%, 100=8.33%, 250=66.67%, 500=16.67% cpu : usr=0.00%, sys=59.34%, ctx=428, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=156537: Wed Jun 3 18:33:28 2026 read: IOPS=0, BW=737KiB/s (755kB/s)(2048KiB/2779msec) clat (usec): min=507, max=182177, avg=91342.78, stdev=128460.38 lat (usec): min=508, max=182179, avg=91343.97, stdev=128460.70 clat percentiles (usec): | 1.00th=[ 506], 5.00th=[ 506], 10.00th=[ 506], 20.00th=[ 506], | 30.00th=[ 506], 40.00th=[ 506], 50.00th=[ 506], 60.00th=[181404], | 70.00th=[181404], 80.00th=[181404], 90.00th=[181404], 95.00th=[181404], | 99.00th=[181404], 99.50th=[181404], 99.90th=[181404], 99.95th=[181404], | 99.99th=[181404] bw ( KiB/s): min= 1759, max= 2011, per=25.58%, avg=1885.00, stdev=178.19, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=3, BW=3685KiB/s (3773kB/s)(10.0MiB/2779msec); 0 zone resets clat (msec): min=90, max=500, avg=256.95, stdev=137.61 lat (msec): min=90, max=500, avg=257.02, stdev=137.61 clat percentiles (msec): | 1.00th=[ 91], 5.00th=[ 91], 10.00th=[ 91], 20.00th=[ 105], | 30.00th=[ 133], 40.00th=[ 176], 50.00th=[ 222], 60.00th=[ 284], | 70.00th=[ 288], 80.00th=[ 372], 90.00th=[ 405], 95.00th=[ 502], | 99.00th=[ 502], 99.50th=[ 502], 99.90th=[ 502], 99.95th=[ 502], | 99.99th=[ 502] bw ( KiB/s): min= 3953, max= 6071, per=43.94%, avg=4533.50, stdev=1026.46, samples=4 iops : min= 3, max= 5, avg= 3.50, stdev= 1.00, samples=4 lat (usec) : 750=8.33% lat (msec) : 100=8.33%, 250=41.67%, 500=33.33%, 750=8.33% cpu : usr=0.04%, sys=45.03%, ctx=143, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=156538: Wed Jun 3 18:33:28 2026 read: IOPS=2, BW=2771KiB/s (2838kB/s)(6144KiB/2217msec) clat (usec): min=453, max=260325, avg=105363.93, stdev=111291.19 lat (usec): min=454, max=260327, avg=105364.86, stdev=111291.20 clat percentiles (usec): | 1.00th=[ 453], 5.00th=[ 453], 10.00th=[ 453], 20.00th=[ 482], | 30.00th=[ 482], 40.00th=[ 27395], 50.00th=[ 27395], 60.00th=[149947], | 70.00th=[193987], 80.00th=[193987], 90.00th=[261096], 95.00th=[261096], | 99.00th=[261096], 99.50th=[261096], 99.90th=[261096], 99.95th=[261096], | 99.99th=[261096] bw ( KiB/s): min= 1976, max= 4087, per=45.62%, avg=3362.00, stdev=1200.74, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 write: IOPS=2, BW=2771KiB/s (2838kB/s)(6144KiB/2217msec); 0 zone resets clat (msec): min=139, max=564, avg=262.13, stdev=173.00 lat (msec): min=139, max=564, avg=262.18, stdev=173.01 clat percentiles (msec): | 1.00th=[ 140], 5.00th=[ 140], 10.00th=[ 140], 20.00th=[ 140], | 30.00th=[ 140], 40.00th=[ 169], 50.00th=[ 169], 60.00th=[ 184], | 70.00th=[ 376], 80.00th=[ 376], 90.00th=[ 567], 95.00th=[ 567], | 99.00th=[ 567], 99.50th=[ 567], 99.90th=[ 567], 99.95th=[ 567], | 99.99th=[ 567] bw ( KiB/s): min= 1976, max= 4023, per=28.01%, avg=2890.00, stdev=1037.77, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 1.15, samples=4 lat (usec) : 500=16.67% lat (msec) : 50=8.33%, 250=50.00%, 500=16.67%, 750=8.33% cpu : usr=0.00%, sys=43.82%, ctx=569, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=156539: Wed Jun 3 18:33:28 2026 read: IOPS=2, BW=2261KiB/s (2316kB/s)(5120KiB/2264msec) clat (usec): min=330, max=214754, avg=43287.92, stdev=95852.51 lat (usec): min=331, max=214755, avg=43288.79, stdev=95852.78 clat percentiles (usec): | 1.00th=[ 330], 5.00th=[ 330], 10.00th=[ 330], 20.00th=[ 330], | 30.00th=[ 375], 40.00th=[ 375], 50.00th=[ 457], 60.00th=[ 457], | 70.00th=[ 523], 80.00th=[ 523], 90.00th=[214959], 95.00th=[214959], | 99.00th=[214959], 99.50th=[214959], 99.90th=[214959], 99.95th=[214959], | 99.99th=[214959] bw ( KiB/s): min= 8047, max= 8047, per=100.00%, avg=8047.00, stdev= 0.00, samples=1 iops : min= 7, max= 7, avg= 7.00, stdev= 0.00, samples=1 write: IOPS=3, BW=3166KiB/s (3242kB/s)(7168KiB/2264msec); 0 zone resets clat (msec): min=118, max=673, avg=289.64, stdev=204.21 lat (msec): min=118, max=673, avg=289.70, stdev=204.22 clat percentiles (msec): | 1.00th=[ 118], 5.00th=[ 118], 10.00th=[ 118], 20.00th=[ 157], | 30.00th=[ 167], 40.00th=[ 167], 50.00th=[ 211], 60.00th=[ 239], | 70.00th=[ 239], 80.00th=[ 468], 90.00th=[ 676], 95.00th=[ 676], | 99.00th=[ 676], 99.50th=[ 676], 99.90th=[ 676], 99.95th=[ 676], | 99.99th=[ 676] bw ( KiB/s): min= 1783, max= 4087, per=23.89%, avg=2464.25, stdev=1086.47, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (usec) : 500=25.00%, 750=8.33% lat (msec) : 250=50.00%, 500=8.33%, 750=8.33% cpu : usr=0.00%, sys=43.61%, ctx=152, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=7370KiB/s (7546kB/s), 737KiB/s-4068KiB/s (755kB/s-4166kB/s), io=20.0MiB (20.0MB), run=1762-2779msec WRITE: bw=10.1MiB/s (10.6MB/s), 2771KiB/s-3685KiB/s (2838kB/s-3773kB/s), io=28.0MiB (29.4MB), run=1762-2779msec rand-rw: (groupid=0, jobs=1): err= 0: pid=156541: Wed Jun 3 18:33:28 2026 read: IOPS=2, BW=2716KiB/s (2781kB/s)(7168KiB/2639msec) clat (msec): min=36, max=672, avg=218.18, stdev=234.09 lat (msec): min=36, max=672, avg=218.18, stdev=234.09 clat percentiles (msec): | 1.00th=[ 36], 5.00th=[ 36], 10.00th=[ 36], 20.00th=[ 38], | 30.00th=[ 73], 40.00th=[ 73], 50.00th=[ 85], 60.00th=[ 309], | 70.00th=[ 309], 80.00th=[ 317], 90.00th=[ 676], 95.00th=[ 676], | 99.00th=[ 676], 99.50th=[ 676], 99.90th=[ 676], 99.95th=[ 676], | 99.99th=[ 676] bw ( KiB/s): min= 1914, max= 4087, per=33.64%, avg=2522.00, stdev=1045.12, samples=4 iops : min= 1, max= 3, avg= 1.75, stdev= 0.96, samples=4 write: IOPS=1, BW=1940KiB/s (1987kB/s)(5120KiB/2639msec); 0 zone resets clat (msec): min=59, max=358, avg=192.00, stdev=111.34 lat (msec): min=59, max=358, avg=192.07, stdev=111.33 clat percentiles (msec): | 1.00th=[ 60], 5.00th=[ 60], 10.00th=[ 60], 20.00th=[ 60], | 30.00th=[ 144], 40.00th=[ 144], 50.00th=[ 169], 60.00th=[ 169], | 70.00th=[ 230], 80.00th=[ 230], 90.00th=[ 359], 95.00th=[ 359], | 99.00th=[ 359], 99.50th=[ 359], 99.90th=[ 359], 99.95th=[ 359], | 99.99th=[ 359] bw ( KiB/s): min= 2043, max= 6144, per=39.01%, avg=4093.50, stdev=2899.84, samples=2 iops : min= 1, max= 6, avg= 3.50, stdev= 3.54, samples=2 lat (msec) : 50=16.67%, 100=25.00%, 250=25.00%, 500=25.00%, 750=8.33% cpu : usr=0.00%, sys=16.00%, ctx=119, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=156542: Wed Jun 3 18:33:28 2026 read: IOPS=0, BW=775KiB/s (794kB/s)(2048KiB/2641msec) clat (msec): min=104, max=222, avg=163.30, stdev=83.72 lat (msec): min=104, max=222, avg=163.30, stdev=83.72 clat percentiles (msec): | 1.00th=[ 105], 5.00th=[ 105], 10.00th=[ 105], 20.00th=[ 105], | 30.00th=[ 105], 40.00th=[ 105], 50.00th=[ 105], 60.00th=[ 224], | 70.00th=[ 224], 80.00th=[ 224], 90.00th=[ 224], 95.00th=[ 224], | 99.00th=[ 224], 99.50th=[ 224], 99.90th=[ 224], 99.95th=[ 224], | 99.99th=[ 224] bw ( KiB/s): min= 1943, max= 2043, per=26.59%, avg=1993.00, stdev=70.71, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=3, BW=3877KiB/s (3970kB/s)(10.0MiB/2641msec); 0 zone resets clat (msec): min=79, max=555, avg=218.12, stdev=144.02 lat (msec): min=79, max=555, avg=218.18, stdev=144.01 clat percentiles (msec): | 1.00th=[ 81], 5.00th=[ 81], 10.00th=[ 81], 20.00th=[ 84], | 30.00th=[ 138], 40.00th=[ 150], 50.00th=[ 159], 60.00th=[ 167], | 70.00th=[ 249], 80.00th=[ 266], 90.00th=[ 338], 95.00th=[ 558], | 99.00th=[ 558], 99.50th=[ 558], 99.90th=[ 558], 99.95th=[ 558], | 99.99th=[ 558] bw ( KiB/s): min= 2039, max= 6144, per=38.99%, avg=4091.50, stdev=1675.86, samples=4 iops : min= 1, max= 6, avg= 3.50, stdev= 2.08, samples=4 lat (msec) : 100=16.67%, 250=58.33%, 500=16.67%, 750=8.33% cpu : usr=0.04%, sys=20.95%, ctx=142, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=156543: Wed Jun 3 18:33:28 2026 read: IOPS=2, BW=2284KiB/s (2339kB/s)(6144KiB/2690msec) clat (msec): min=43, max=299, avg=151.83, stdev=106.27 lat (msec): min=43, max=299, avg=151.83, stdev=106.27 clat percentiles (msec): | 1.00th=[ 44], 5.00th=[ 44], 10.00th=[ 44], 20.00th=[ 67], | 30.00th=[ 67], 40.00th=[ 90], 50.00th=[ 90], 60.00th=[ 155], | 70.00th=[ 259], 80.00th=[ 259], 90.00th=[ 300], 95.00th=[ 300], | 99.00th=[ 300], 99.50th=[ 300], 99.90th=[ 300], 99.95th=[ 300], | 99.99th=[ 300] bw ( KiB/s): min= 2043, max= 4096, per=36.41%, avg=2729.00, stdev=1183.86, samples=3 iops : min= 1, max= 4, avg= 2.33, stdev= 1.53, samples=3 write: IOPS=2, BW=2284KiB/s (2339kB/s)(6144KiB/2690msec); 0 zone resets clat (msec): min=67, max=548, avg=272.93, stdev=177.60 lat (msec): min=67, max=548, avg=272.99, stdev=177.60 clat percentiles (msec): | 1.00th=[ 67], 5.00th=[ 67], 10.00th=[ 67], 20.00th=[ 117], | 30.00th=[ 117], 40.00th=[ 213], 50.00th=[ 213], 60.00th=[ 330], | 70.00th=[ 363], 80.00th=[ 363], 90.00th=[ 550], 95.00th=[ 550], | 99.00th=[ 550], 99.50th=[ 550], 99.90th=[ 550], 99.95th=[ 550], | 99.99th=[ 550] bw ( KiB/s): min= 1969, max= 2048, per=19.34%, avg=2029.40, stdev=33.97, samples=5 iops : min= 1, max= 2, avg= 1.40, stdev= 0.55, samples=5 lat (msec) : 50=8.33%, 100=25.00%, 250=25.00%, 500=33.33%, 750=8.33% cpu : usr=0.04%, sys=13.09%, ctx=75, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=156544: Wed Jun 3 18:33:28 2026 read: IOPS=1, BW=1874KiB/s (1919kB/s)(5120KiB/2732msec) clat (msec): min=17, max=312, avg=130.14, stdev=108.75 lat (msec): min=17, max=312, avg=130.14, stdev=108.75 clat percentiles (msec): | 1.00th=[ 18], 5.00th=[ 18], 10.00th=[ 18], 20.00th=[ 18], | 30.00th=[ 106], 40.00th=[ 106], 50.00th=[ 107], 60.00th=[ 107], | 70.00th=[ 109], 80.00th=[ 109], 90.00th=[ 313], 95.00th=[ 313], | 99.00th=[ 313], 99.50th=[ 313], 99.90th=[ 313], 99.95th=[ 313], | 99.99th=[ 313] bw ( KiB/s): min= 2043, max= 2043, per=27.25%, avg=2043.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=2, BW=2624KiB/s (2687kB/s)(7168KiB/2732msec); 0 zone resets clat (msec): min=42, max=835, avg=282.27, stdev=281.01 lat (msec): min=42, max=835, avg=282.34, stdev=281.01 clat percentiles (msec): | 1.00th=[ 43], 5.00th=[ 43], 10.00th=[ 43], 20.00th=[ 48], | 30.00th=[ 133], 40.00th=[ 133], 50.00th=[ 207], 60.00th=[ 268], | 70.00th=[ 268], 80.00th=[ 447], 90.00th=[ 835], 95.00th=[ 835], | 99.00th=[ 835], 99.50th=[ 835], 99.90th=[ 835], 99.95th=[ 835], | 99.99th=[ 835] bw ( KiB/s): min= 1370, max= 2048, per=17.89%, avg=1877.25, stdev=338.17, samples=4 iops : min= 1, max= 2, avg= 1.50, stdev= 0.58, samples=4 lat (msec) : 20=8.33%, 50=16.67%, 250=41.67%, 500=25.00%, 1000=8.33% cpu : usr=0.00%, sys=14.35%, ctx=85, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=7496KiB/s (7676kB/s), 775KiB/s-2716KiB/s (794kB/s-2781kB/s), io=20.0MiB (20.0MB), run=2639-2732msec WRITE: bw=10.2MiB/s (10.7MB/s), 1940KiB/s-3877KiB/s (1987kB/s-3970kB/s), io=28.0MiB (29.4MB), run=2639-2732msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=156554: Wed Jun 3 18:33:36 2026 read: IOPS=2, BW=8690KiB/s (8899kB/s)(12.0MiB/1414msec) clat (msec): min=395, max=507, avg=435.48, stdev=62.18 lat (msec): min=395, max=507, avg=435.48, stdev=62.18 clat percentiles (msec): | 1.00th=[ 397], 5.00th=[ 397], 10.00th=[ 397], 20.00th=[ 397], | 30.00th=[ 397], 40.00th=[ 405], 50.00th=[ 405], 60.00th=[ 405], | 70.00th=[ 506], 80.00th=[ 506], 90.00th=[ 506], 95.00th=[ 506], | 99.00th=[ 506], 99.50th=[ 506], 99.90th=[ 506], 99.95th=[ 506], | 99.99th=[ 506] bw ( KiB/s): min= 8062, max= 8062, per=90.30%, avg=8062.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=66.67%, 750=33.33% cpu : usr=0.00%, sys=51.80%, ctx=2717, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=156555: Wed Jun 3 18:33:36 2026 read: IOPS=0, BW=2232KiB/s (2286kB/s)(4096KiB/1835msec) clat (nsec): min=452655k, max=452655k, avg=452654587.00, stdev= 0.00 lat (nsec): min=452657k, max=452657k, avg=452657279.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 451], 5.00th=[ 451], 10.00th=[ 451], 20.00th=[ 451], | 30.00th=[ 451], 40.00th=[ 451], 50.00th=[ 451], 60.00th=[ 451], | 70.00th=[ 451], 80.00th=[ 451], 90.00th=[ 451], 95.00th=[ 451], | 99.00th=[ 451], 99.50th=[ 451], 99.90th=[ 451], 99.95th=[ 451], | 99.99th=[ 451] bw ( KiB/s): min= 8094, max= 8094, per=90.66%, avg=8094.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=1, BW=4464KiB/s (4571kB/s)(8192KiB/1835msec); 0 zone resets clat (msec): min=380, max=951, avg=665.68, stdev=403.86 lat (msec): min=380, max=951, avg=665.94, stdev=403.88 clat percentiles (msec): | 1.00th=[ 380], 5.00th=[ 380], 10.00th=[ 380], 20.00th=[ 380], | 30.00th=[ 380], 40.00th=[ 380], 50.00th=[ 380], 60.00th=[ 953], | 70.00th=[ 953], 80.00th=[ 953], 90.00th=[ 953], 95.00th=[ 953], | 99.00th=[ 953], 99.50th=[ 953], 99.90th=[ 953], 99.95th=[ 953], | 99.99th=[ 953] bw ( KiB/s): min= 8175, max= 8175, per=46.00%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=66.67%, 1000=33.33% cpu : usr=0.05%, sys=17.28%, ctx=902, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=156556: Wed Jun 3 18:33:36 2026 write: IOPS=1, BW=6664KiB/s (6824kB/s)(12.0MiB/1844msec); 0 zone resets clat (msec): min=146, max=817, avg=585.49, stdev=380.78 lat (msec): min=146, max=817, avg=585.76, stdev=380.77 clat percentiles (msec): | 1.00th=[ 146], 5.00th=[ 146], 10.00th=[ 146], 20.00th=[ 146], | 30.00th=[ 146], 40.00th=[ 793], 50.00th=[ 793], 60.00th=[ 793], | 70.00th=[ 818], 80.00th=[ 818], 90.00th=[ 818], 95.00th=[ 818], | 99.00th=[ 818], 99.50th=[ 818], 99.90th=[ 818], 99.95th=[ 818], | 99.99th=[ 818] bw ( KiB/s): min= 8175, max= 8175, per=46.00%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 1000=66.67% cpu : usr=0.00%, sys=18.07%, ctx=276, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=156557: Wed Jun 3 18:33:36 2026 write: IOPS=1, BW=7314KiB/s (7490kB/s)(12.0MiB/1680msec); 0 zone resets clat (msec): min=443, max=755, avg=549.82, stdev=177.99 lat (msec): min=443, max=755, avg=550.09, stdev=177.99 clat percentiles (msec): | 1.00th=[ 443], 5.00th=[ 443], 10.00th=[ 443], 20.00th=[ 443], | 30.00th=[ 443], 40.00th=[ 451], 50.00th=[ 451], 60.00th=[ 451], | 70.00th=[ 760], 80.00th=[ 760], 90.00th=[ 760], 95.00th=[ 760], | 99.00th=[ 760], 99.50th=[ 760], 99.90th=[ 760], 99.95th=[ 760], | 99.99th=[ 760] bw ( KiB/s): min= 7953, max= 8175, per=45.38%, avg=8064.00, stdev=156.98, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=66.67%, 1000=33.33% cpu : usr=0.06%, sys=15.19%, ctx=150, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=8929KiB/s (9143kB/s), 2232KiB/s-8690KiB/s (2286kB/s-8899kB/s), io=16.0MiB (16.8MB), run=1414-1835msec WRITE: bw=17.4MiB/s (18.2MB/s), 4464KiB/s-7314KiB/s (4571kB/s-7490kB/s), io=32.0MiB (33.6MB), run=1680-1844msec rand-rw: (groupid=0, jobs=1): err= 0: pid=156550: Wed Jun 3 18:33:37 2026 read: IOPS=1, BW=7797KiB/s (7984kB/s)(12.0MiB/1576msec) clat (msec): min=260, max=695, avg=519.46, stdev=229.08 lat (msec): min=260, max=695, avg=519.46, stdev=229.08 clat percentiles (msec): | 1.00th=[ 262], 5.00th=[ 262], 10.00th=[ 262], 20.00th=[ 262], | 30.00th=[ 262], 40.00th=[ 600], 50.00th=[ 600], 60.00th=[ 600], | 70.00th=[ 693], 80.00th=[ 693], 90.00th=[ 693], 95.00th=[ 693], | 99.00th=[ 693], 99.50th=[ 693], 99.90th=[ 693], 99.95th=[ 693], | 99.99th=[ 693] bw ( KiB/s): min= 8062, max= 8110, per=81.39%, avg=8086.00, stdev=33.94, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 750=66.67% cpu : usr=0.00%, sys=15.81%, ctx=60, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=156551: Wed Jun 3 18:33:37 2026 read: IOPS=0, BW=2484KiB/s (2544kB/s)(4096KiB/1649msec) clat (nsec): min=142603k, max=142603k, avg=142602968.00, stdev= 0.00 lat (nsec): min=142606k, max=142606k, avg=142605528.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 142], 5.00th=[ 142], 10.00th=[ 142], 20.00th=[ 142], | 30.00th=[ 142], 40.00th=[ 142], 50.00th=[ 142], 60.00th=[ 142], | 70.00th=[ 142], 80.00th=[ 142], 90.00th=[ 142], 95.00th=[ 142], | 99.00th=[ 142], 99.50th=[ 142], 99.90th=[ 142], 99.95th=[ 142], | 99.99th=[ 142] bw ( KiB/s): min= 7236, max= 7236, per=72.83%, avg=7236.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=1, BW=4968KiB/s (5087kB/s)(8192KiB/1649msec); 0 zone resets clat (msec): min=551, max=906, avg=729.22, stdev=251.41 lat (msec): min=551, max=907, avg=729.52, stdev=251.47 clat percentiles (msec): | 1.00th=[ 550], 5.00th=[ 550], 10.00th=[ 550], 20.00th=[ 550], | 30.00th=[ 550], 40.00th=[ 550], 50.00th=[ 550], 60.00th=[ 911], | 70.00th=[ 911], 80.00th=[ 911], 90.00th=[ 911], 95.00th=[ 911], | 99.00th=[ 911], 99.50th=[ 911], 99.90th=[ 911], 99.95th=[ 911], | 99.99th=[ 911] bw ( KiB/s): min= 8062, max= 8062, per=51.13%, avg=8062.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 750=33.33%, 1000=33.33% cpu : usr=0.00%, sys=17.35%, ctx=96, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=156552: Wed Jun 3 18:33:37 2026 write: IOPS=1, BW=5913KiB/s (6055kB/s)(12.0MiB/2078msec); 0 zone resets clat (msec): min=79, max=1350, avg=677.27, stdev=638.90 lat (msec): min=79, max=1350, avg=677.61, stdev=638.98 clat percentiles (msec): | 1.00th=[ 80], 5.00th=[ 80], 10.00th=[ 80], 20.00th=[ 80], | 30.00th=[ 80], 40.00th=[ 600], 50.00th=[ 600], 60.00th=[ 600], | 70.00th=[ 1351], 80.00th=[ 1351], 90.00th=[ 1351], 95.00th=[ 1351], | 99.00th=[ 1351], 99.50th=[ 1351], 99.90th=[ 1351], 99.95th=[ 1351], | 99.99th=[ 1351] bw ( KiB/s): min= 8110, max= 8110, per=51.43%, avg=8110.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 100=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.05%, sys=9.15%, ctx=46, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=156553: Wed Jun 3 18:33:37 2026 write: IOPS=1, BW=7553KiB/s (7734kB/s)(12.0MiB/1627msec); 0 zone resets clat (msec): min=258, max=1062, avg=527.10, stdev=463.96 lat (msec): min=259, max=1063, avg=527.45, stdev=463.91 clat percentiles (msec): | 1.00th=[ 259], 5.00th=[ 259], 10.00th=[ 259], 20.00th=[ 259], | 30.00th=[ 259], 40.00th=[ 259], 50.00th=[ 259], 60.00th=[ 259], | 70.00th=[ 1062], 80.00th=[ 1062], 90.00th=[ 1062], 95.00th=[ 1062], | 99.00th=[ 1062], 99.50th=[ 1062], 99.90th=[ 1062], 99.95th=[ 1062], | 99.99th=[ 1062] bw ( KiB/s): min=14550, max=14550, per=92.27%, avg=14550.00, stdev= 0.00, samples=1 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=1 lat (msec) : 500=66.67%, 2000=33.33% cpu : usr=0.00%, sys=18.39%, ctx=103, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=9936KiB/s (10.2MB/s), 2484KiB/s-7797KiB/s (2544kB/s-7984kB/s), io=16.0MiB (16.8MB), run=1576-1649msec WRITE: bw=15.4MiB/s (16.1MB/s), 4968KiB/s-7553KiB/s (5087kB/s-7734kB/s), io=32.0MiB (33.6MB), run=1627-2078msec