== sanity test 398b: DIO and buffer IO race ============== 22:37:05 (1775875025) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 2.98592 s, 16.9 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=148834: Fri Apr 10 22:38:12 2026 read: IOPS=25, BW=103KiB/s (106kB/s)(5992KiB/57923msec) clat (usec): min=39, max=630720, avg=19495.22, stdev=20878.64 lat (usec): min=39, max=630721, avg=19496.31, stdev=20878.58 clat percentiles (usec): | 1.00th=[ 57], 5.00th=[ 117], 10.00th=[ 7832], 20.00th=[ 10552], | 30.00th=[ 12256], 40.00th=[ 14222], 50.00th=[ 16450], 60.00th=[ 19268], | 70.00th=[ 22938], 80.00th=[ 26870], 90.00th=[ 33424], 95.00th=[ 39584], | 99.00th=[ 65274], 99.50th=[ 79168], 99.90th=[231736], 99.95th=[633340], | 99.99th=[633340] bw ( KiB/s): min= 14, max= 200, per=24.80%, avg=102.65, stdev=31.86, samples=115 iops : min= 3, max= 50, avg=25.21, stdev= 7.99, samples=115 write: IOPS=27, BW=109KiB/s (111kB/s)(6296KiB/57923msec); 0 zone resets clat (usec): min=813, max=147251, avg=18091.46, stdev=16438.31 lat (usec): min=814, max=147253, avg=18093.60, stdev=16438.01 clat percentiles (usec): | 1.00th=[ 1270], 5.00th=[ 1860], 10.00th=[ 2540], 20.00th=[ 3621], | 30.00th=[ 5473], 40.00th=[ 10814], 50.00th=[ 14615], 60.00th=[ 19006], | 70.00th=[ 23987], 80.00th=[ 29754], 90.00th=[ 38011], 95.00th=[ 45876], | 99.00th=[ 70779], 99.50th=[ 94897], 99.90th=[145753], 99.95th=[147850], | 99.99th=[147850] bw ( KiB/s): min= 40, max= 176, per=25.08%, avg=108.83, stdev=29.46, samples=114 iops : min= 10, max= 44, avg=26.75, stdev= 7.41, samples=114 lat (usec) : 50=0.20%, 100=1.79%, 250=1.43%, 500=0.16%, 750=0.03% lat (usec) : 1000=0.10% lat (msec) : 2=3.32%, 4=8.04%, 10=13.02%, 20=34.21%, 50=34.77% lat (msec) : 100=2.57%, 250=0.33%, 750=0.03% cpu : usr=0.13%, sys=18.18%, ctx=7921, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=148836: Fri Apr 10 22:38:12 2026 read: IOPS=25, BW=103KiB/s (106kB/s)(5940KiB/57445msec) clat (usec): min=37, max=144472, avg=19283.30, stdev=12441.84 lat (usec): min=38, max=144472, avg=19284.28, stdev=12441.83 clat percentiles (usec): | 1.00th=[ 61], 5.00th=[ 145], 10.00th=[ 8717], 20.00th=[ 10945], | 30.00th=[ 12649], 40.00th=[ 14615], 50.00th=[ 16909], 60.00th=[ 19530], | 70.00th=[ 22414], 80.00th=[ 27132], 90.00th=[ 33162], 95.00th=[ 39584], | 99.00th=[ 60031], 99.50th=[ 78119], 99.90th=[137364], 99.95th=[143655], | 99.99th=[143655] bw ( KiB/s): min= 14, max= 183, per=24.86%, avg=102.92, stdev=29.65, samples=114 iops : min= 3, max= 45, avg=25.28, stdev= 7.43, samples=114 write: IOPS=27, BW=111KiB/s (113kB/s)(6348KiB/57445msec); 0 zone resets clat (usec): min=864, max=588067, avg=18000.04, stdev=21352.15 lat (usec): min=865, max=588069, avg=18004.79, stdev=21352.35 clat percentiles (usec): | 1.00th=[ 1287], 5.00th=[ 1893], 10.00th=[ 2474], 20.00th=[ 3621], | 30.00th=[ 5538], 40.00th=[ 10159], 50.00th=[ 14484], 60.00th=[ 19006], | 70.00th=[ 23200], 80.00th=[ 28967], 90.00th=[ 37487], 95.00th=[ 44303], | 99.00th=[ 68682], 99.50th=[101188], 99.90th=[187696], 99.95th=[591397], | 99.99th=[591397] bw ( KiB/s): min= 37, max= 224, per=25.30%, avg=109.81, stdev=31.11, samples=114 iops : min= 9, max= 56, avg=27.00, stdev= 7.82, samples=114 lat (usec) : 50=0.03%, 100=1.33%, 250=1.40%, 500=0.10%, 1000=0.16% lat (msec) : 2=2.93%, 4=8.40%, 10=13.70%, 20=33.76%, 50=35.61% lat (msec) : 100=2.21%, 250=0.33%, 750=0.03% cpu : usr=0.16%, sys=18.46%, ctx=8083, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=148838: Fri Apr 10 22:38:12 2026 read: IOPS=26, BW=105KiB/s (107kB/s)(6028KiB/57552msec) clat (usec): min=35, max=631880, avg=19294.04, stdev=20705.66 lat (usec): min=36, max=631882, avg=19296.36, stdev=20705.68 clat percentiles (usec): | 1.00th=[ 57], 5.00th=[ 104], 10.00th=[ 7767], 20.00th=[ 10683], | 30.00th=[ 12256], 40.00th=[ 13829], 50.00th=[ 16450], 60.00th=[ 19006], | 70.00th=[ 22676], 80.00th=[ 26608], 90.00th=[ 33162], 95.00th=[ 40109], | 99.00th=[ 62129], 99.50th=[ 91751], 99.90th=[145753], 99.95th=[633340], | 99.99th=[633340] bw ( KiB/s): min= 7, max= 183, per=25.24%, avg=104.48, stdev=31.39, samples=114 iops : min= 1, max= 45, avg=25.67, stdev= 7.85, samples=114 write: IOPS=27, BW=109KiB/s (111kB/s)(6260KiB/57552msec); 0 zone resets clat (usec): min=661, max=178446, avg=18043.26, stdev=16350.56 lat (usec): min=662, max=178447, avg=18044.55, stdev=16350.58 clat percentiles (usec): | 1.00th=[ 1254], 5.00th=[ 1876], 10.00th=[ 2507], 20.00th=[ 3818], | 30.00th=[ 6194], 40.00th=[ 10814], 50.00th=[ 14877], 60.00th=[ 18482], | 70.00th=[ 23462], 80.00th=[ 29492], 90.00th=[ 37487], 95.00th=[ 46924], | 99.00th=[ 71828], 99.50th=[ 86508], 99.90th=[162530], 99.95th=[179307], | 99.99th=[179307] bw ( KiB/s): min= 22, max= 184, per=24.95%, avg=108.26, stdev=30.55, samples=114 iops : min= 5, max= 46, avg=26.61, stdev= 7.68, samples=114 lat (usec) : 50=0.26%, 100=1.99%, 250=1.66%, 500=0.13%, 750=0.03% lat (usec) : 1000=0.03% lat (msec) : 2=2.90%, 4=7.88%, 10=13.02%, 20=35.09%, 50=33.92% lat (msec) : 100=2.73%, 250=0.33%, 750=0.03% cpu : usr=0.15%, sys=18.03%, ctx=7871, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=148840: Fri Apr 10 22:38:12 2026 read: IOPS=26, BW=105KiB/s (107kB/s)(6052KiB/57780msec) clat (usec): min=35, max=160494, avg=18883.27, stdev=14323.17 lat (usec): min=36, max=160495, avg=18884.42, stdev=14323.21 clat percentiles (usec): | 1.00th=[ 53], 5.00th=[ 105], 10.00th=[ 7177], 20.00th=[ 10290], | 30.00th=[ 11863], 40.00th=[ 13566], 50.00th=[ 15926], 60.00th=[ 19006], | 70.00th=[ 22676], 80.00th=[ 26608], 90.00th=[ 33162], 95.00th=[ 40109], | 99.00th=[ 70779], 99.50th=[100140], 99.90th=[149947], 99.95th=[160433], | 99.99th=[160433] bw ( KiB/s): min= 39, max= 183, per=25.68%, avg=106.33, stdev=29.81, samples=113 iops : min= 9, max= 45, avg=26.13, stdev= 7.54, samples=113 write: IOPS=26, BW=108KiB/s (111kB/s)(6236KiB/57780msec); 0 zone resets clat (usec): min=919, max=689984, avg=18574.37, stdev=22836.02 lat (usec): min=920, max=689985, avg=18575.63, stdev=22836.01 clat percentiles (usec): | 1.00th=[ 1270], 5.00th=[ 1795], 10.00th=[ 2540], 20.00th=[ 3752], | 30.00th=[ 6128], 40.00th=[ 11207], 50.00th=[ 15270], 60.00th=[ 19268], | 70.00th=[ 23987], 80.00th=[ 30540], 90.00th=[ 38011], 95.00th=[ 46400], | 99.00th=[ 68682], 99.50th=[ 73925], 99.90th=[116917], 99.95th=[692061], | 99.99th=[692061] bw ( KiB/s): min= 16, max= 207, per=25.00%, avg=108.48, stdev=31.23, samples=114 iops : min= 4, max= 51, avg=26.67, stdev= 7.81, samples=114 lat (usec) : 50=0.20%, 100=2.08%, 250=1.69%, 500=0.03%, 750=0.07% lat (usec) : 1000=0.10% lat (msec) : 2=3.03%, 4=8.04%, 10=12.92%, 20=34.11%, 50=34.77% lat (msec) : 100=2.64%, 250=0.29%, 750=0.03% cpu : usr=0.15%, sys=18.23%, ctx=8045, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=415KiB/s (424kB/s), 103KiB/s-105KiB/s (106kB/s-107kB/s), io=23.4MiB (24.6MB), run=57445-57923msec WRITE: bw=434KiB/s (444kB/s), 108KiB/s-111KiB/s (111kB/s-113kB/s), io=24.6MiB (25.7MB), run=57445-57923msec rand-rw: (groupid=0, jobs=1): err= 0: pid=148833: Fri Apr 10 22:38:58 2026 read: IOPS=14, BW=57.6KiB/s (59.0kB/s)(5992KiB/103949msec) clat (msec): min=4, max=642, avg=17.38, stdev=22.00 lat (msec): min=4, max=642, avg=17.38, stdev=22.00 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 6], 10.00th=[ 7], 20.00th=[ 8], | 30.00th=[ 9], 40.00th=[ 11], 50.00th=[ 13], 60.00th=[ 15], | 70.00th=[ 18], 80.00th=[ 23], 90.00th=[ 33], 95.00th=[ 46], | 99.00th=[ 75], 99.50th=[ 109], 99.90th=[ 167], 99.95th=[ 642], | 99.99th=[ 642] bw ( KiB/s): min= 7, max= 168, per=25.17%, avg=57.90, stdev=33.64, samples=205 iops : min= 1, max= 42, avg=14.08, stdev= 8.46, samples=205 write: IOPS=15, BW=60.6KiB/s (62.0kB/s)(6296KiB/103949msec); 0 zone resets clat (msec): min=19, max=237, avg=49.36, stdev=23.35 lat (msec): min=19, max=237, avg=49.37, stdev=23.35 clat percentiles (msec): | 1.00th=[ 23], 5.00th=[ 26], 10.00th=[ 28], 20.00th=[ 32], | 30.00th=[ 36], 40.00th=[ 39], 50.00th=[ 43], 60.00th=[ 48], | 70.00th=[ 55], 80.00th=[ 67], 90.00th=[ 81], 95.00th=[ 92], | 99.00th=[ 126], 99.50th=[ 153], 99.90th=[ 234], 99.95th=[ 239], | 99.99th=[ 239] bw ( KiB/s): min= 7, max= 120, per=25.08%, avg=60.45, stdev=24.99, samples=206 iops : min= 1, max= 30, avg=14.72, stdev= 6.35, samples=206 lat (msec) : 10=18.00%, 20=18.91%, 50=42.77%, 100=18.36%, 250=1.92% lat (msec) : 750=0.03% cpu : usr=0.07%, sys=5.15%, ctx=5870, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=148835: Fri Apr 10 22:38:58 2026 read: IOPS=14, BW=57.2KiB/s (58.6kB/s)(5940KiB/103864msec) clat (msec): min=4, max=623, avg=17.26, stdev=21.52 lat (msec): min=4, max=623, avg=17.27, stdev=21.52 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 6], 10.00th=[ 6], 20.00th=[ 8], | 30.00th=[ 9], 40.00th=[ 12], 50.00th=[ 14], 60.00th=[ 16], | 70.00th=[ 18], 80.00th=[ 23], 90.00th=[ 33], 95.00th=[ 44], | 99.00th=[ 78], 99.50th=[ 99], 99.90th=[ 192], 99.95th=[ 625], | 99.99th=[ 625] bw ( KiB/s): min= 7, max= 152, per=25.09%, avg=57.72, stdev=33.64, samples=204 iops : min= 1, max= 38, avg=14.04, stdev= 8.46, samples=204 write: IOPS=15, BW=61.1KiB/s (62.6kB/s)(6348KiB/103864msec); 0 zone resets clat (msec): min=18, max=233, avg=49.15, stdev=24.21 lat (msec): min=18, max=233, avg=49.15, stdev=24.21 clat percentiles (msec): | 1.00th=[ 22], 5.00th=[ 26], 10.00th=[ 28], 20.00th=[ 32], | 30.00th=[ 35], 40.00th=[ 39], 50.00th=[ 42], 60.00th=[ 47], | 70.00th=[ 55], 80.00th=[ 65], 90.00th=[ 81], 95.00th=[ 94], | 99.00th=[ 127], 99.50th=[ 148], 99.90th=[ 232], 99.95th=[ 234], | 99.99th=[ 234] bw ( KiB/s): min= 23, max= 120, per=25.34%, avg=61.07, stdev=25.41, samples=206 iops : min= 5, max= 30, avg=14.88, stdev= 6.46, samples=206 lat (msec) : 10=16.83%, 20=20.12%, 50=43.59%, 100=17.35%, 250=2.08% lat (msec) : 750=0.03% cpu : usr=0.08%, sys=5.14%, ctx=5857, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=148837: Fri Apr 10 22:38:58 2026 read: IOPS=14, BW=58.2KiB/s (59.6kB/s)(6028KiB/103601msec) clat (msec): min=3, max=144, avg=16.82, stdev=14.14 lat (msec): min=3, max=144, avg=16.82, stdev=14.14 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 6], 10.00th=[ 7], 20.00th=[ 8], | 30.00th=[ 9], 40.00th=[ 12], 50.00th=[ 14], 60.00th=[ 16], | 70.00th=[ 18], 80.00th=[ 23], 90.00th=[ 32], 95.00th=[ 43], | 99.00th=[ 74], 99.50th=[ 95], 99.90th=[ 138], 99.95th=[ 144], | 99.99th=[ 144] bw ( KiB/s): min= 8, max= 159, per=25.26%, avg=58.10, stdev=31.03, samples=205 iops : min= 2, max= 39, avg=14.14, stdev= 7.79, samples=205 write: IOPS=15, BW=60.4KiB/s (61.9kB/s)(6260KiB/103601msec); 0 zone resets clat (msec): min=20, max=658, avg=49.85, stdev=28.80 lat (msec): min=20, max=658, avg=49.86, stdev=28.80 clat percentiles (msec): | 1.00th=[ 22], 5.00th=[ 26], 10.00th=[ 28], 20.00th=[ 32], | 30.00th=[ 35], 40.00th=[ 39], 50.00th=[ 43], 60.00th=[ 48], | 70.00th=[ 55], 80.00th=[ 65], 90.00th=[ 82], 95.00th=[ 95], | 99.00th=[ 138], 99.50th=[ 180], 99.90th=[ 222], 99.95th=[ 659], | 99.99th=[ 659] bw ( KiB/s): min= 15, max= 120, per=25.03%, avg=60.32, stdev=26.16, samples=205 iops : min= 3, max= 30, avg=14.69, stdev= 6.64, samples=205 lat (msec) : 4=0.03%, 10=16.67%, 20=20.48%, 50=43.03%, 100=17.64% lat (msec) : 250=2.12%, 750=0.03% cpu : usr=0.08%, sys=5.30%, ctx=5944, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=148839: Fri Apr 10 22:38:58 2026 read: IOPS=14, BW=58.7KiB/s (60.1kB/s)(6052KiB/103046msec) clat (msec): min=3, max=158, avg=16.68, stdev=14.30 lat (msec): min=3, max=158, avg=16.68, stdev=14.30 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 6], 10.00th=[ 6], 20.00th=[ 8], | 30.00th=[ 9], 40.00th=[ 11], 50.00th=[ 13], 60.00th=[ 15], | 70.00th=[ 18], 80.00th=[ 23], 90.00th=[ 33], 95.00th=[ 43], | 99.00th=[ 72], 99.50th=[ 92], 99.90th=[ 146], 99.95th=[ 159], | 99.99th=[ 159] bw ( KiB/s): min= 7, max= 183, per=25.67%, avg=59.03, stdev=32.82, samples=203 iops : min= 1, max= 45, avg=14.37, stdev= 8.31, samples=203 write: IOPS=15, BW=60.5KiB/s (61.0kB/s)(6236KiB/103046msec); 0 zone resets clat (msec): min=19, max=686, avg=49.76, stdev=29.09 lat (msec): min=19, max=686, avg=49.76, stdev=29.09 clat percentiles (msec): | 1.00th=[ 22], 5.00th=[ 26], 10.00th=[ 28], 20.00th=[ 32], | 30.00th=[ 35], 40.00th=[ 39], 50.00th=[ 43], 60.00th=[ 47], | 70.00th=[ 55], 80.00th=[ 66], 90.00th=[ 81], 95.00th=[ 95], | 99.00th=[ 142], 99.50th=[ 174], 99.90th=[ 249], 99.95th=[ 684], | 99.99th=[ 684] bw ( KiB/s): min= 23, max= 119, per=25.09%, avg=60.46, stdev=24.86, samples=204 iops : min= 5, max= 29, avg=14.73, stdev= 6.29, samples=204 lat (msec) : 4=0.03%, 10=18.10%, 20=19.66%, 50=43.00%, 100=17.25% lat (msec) : 250=1.92%, 750=0.03% cpu : usr=0.11%, sys=5.13%, ctx=5838, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=231KiB/s (237kB/s), 57.2KiB/s-58.7KiB/s (58.6kB/s-60.1kB/s), io=23.4MiB (24.6MB), run=103046-103949msec WRITE: bw=242KiB/s (248kB/s), 60.4KiB/s-61.1KiB/s (61.9kB/s-62.6kB/s), io=24.6MiB (25.7MB), run=103046-103949msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=148873: Fri Apr 10 22:39:18 2026 read: IOPS=25, BW=404KiB/s (414kB/s)(5920KiB/14660msec) clat (usec): min=32, max=95086, avg=19168.84, stdev=14139.84 lat (usec): min=32, max=95087, avg=19169.99, stdev=14139.85 clat percentiles (usec): | 1.00th=[ 55], 5.00th=[ 93], 10.00th=[ 125], 20.00th=[ 302], | 30.00th=[12780], 40.00th=[16057], 50.00th=[18220], 60.00th=[21890], | 70.00th=[25560], 80.00th=[29754], 90.00th=[36963], 95.00th=[42206], | 99.00th=[54264], 99.50th=[68682], 99.90th=[94897], 99.95th=[94897], | 99.99th=[94897] bw ( KiB/s): min= 252, max= 704, per=25.23%, avg=403.00, stdev=110.44, samples=29 iops : min= 15, max= 44, avg=24.66, stdev= 7.00, samples=29 write: IOPS=27, BW=434KiB/s (445kB/s)(6368KiB/14660msec); 0 zone resets clat (usec): min=1736, max=106316, avg=18903.70, stdev=16165.26 lat (usec): min=1738, max=106319, avg=18906.30, stdev=16165.23 clat percentiles (msec): | 1.00th=[ 3], 5.00th=[ 3], 10.00th=[ 4], 20.00th=[ 5], | 30.00th=[ 7], 40.00th=[ 10], 50.00th=[ 14], 60.00th=[ 20], | 70.00th=[ 25], 80.00th=[ 33], 90.00th=[ 43], 95.00th=[ 52], | 99.00th=[ 67], 99.50th=[ 83], 99.90th=[ 107], 99.95th=[ 107], | 99.99th=[ 107] bw ( KiB/s): min= 256, max= 672, per=25.74%, avg=432.45, stdev=107.39, samples=29 iops : min= 16, max= 42, avg=26.48, stdev= 6.83, samples=29 lat (usec) : 50=0.39%, 100=2.73%, 250=5.99%, 500=0.91% lat (msec) : 2=0.52%, 4=6.38%, 10=16.67%, 20=24.61%, 50=38.15% lat (msec) : 100=3.52%, 250=0.13% cpu : usr=0.16%, sys=21.81%, ctx=2058, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=148874: Fri Apr 10 22:39:18 2026 read: IOPS=23, BW=383KiB/s (392kB/s)(5744KiB/14994msec) clat (usec): min=41, max=88728, avg=19856.25, stdev=15699.62 lat (usec): min=42, max=88730, avg=19857.37, stdev=15699.67 clat percentiles (usec): | 1.00th=[ 56], 5.00th=[ 74], 10.00th=[ 104], 20.00th=[ 857], | 30.00th=[13042], 40.00th=[15008], 50.00th=[18482], 60.00th=[21627], | 70.00th=[25560], 80.00th=[29754], 90.00th=[38011], 95.00th=[44827], | 99.00th=[78119], 99.50th=[82314], 99.90th=[88605], 99.95th=[88605], | 99.99th=[88605] bw ( KiB/s): min= 57, max= 638, per=23.86%, avg=381.07, stdev=138.20, samples=29 iops : min= 3, max= 39, avg=23.28, stdev= 8.71, samples=29 write: IOPS=27, BW=436KiB/s (447kB/s)(6544KiB/14994msec); 0 zone resets clat (usec): min=1532, max=102035, avg=18912.61, stdev=17756.95 lat (usec): min=1536, max=102037, avg=18920.13, stdev=17752.85 clat percentiles (usec): | 1.00th=[ 1762], 5.00th=[ 2606], 10.00th=[ 3458], 20.00th=[ 5473], | 30.00th=[ 6652], 40.00th=[ 8848], 50.00th=[ 13435], 60.00th=[ 17957], | 70.00th=[ 22676], 80.00th=[ 30802], 90.00th=[ 42730], 95.00th=[ 52167], | 99.00th=[ 90702], 99.50th=[ 96994], 99.90th=[102237], 99.95th=[102237], | 99.99th=[102237] bw ( KiB/s): min= 190, max= 672, per=25.54%, avg=429.14, stdev=120.49, samples=29 iops : min= 11, max= 42, avg=26.28, stdev= 7.62, samples=29 lat (usec) : 50=0.13%, 100=4.30%, 250=3.91%, 500=0.78%, 750=0.13% lat (usec) : 1000=0.26% lat (msec) : 2=1.56%, 4=5.08%, 10=17.45%, 20=26.17%, 50=35.81% lat (msec) : 100=4.17%, 250=0.26% cpu : usr=0.13%, sys=21.75%, ctx=2115, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=148875: Fri Apr 10 22:39:18 2026 read: IOPS=26, BW=422KiB/s (432kB/s)(6256KiB/14815msec) clat (usec): min=26, max=100488, avg=21131.35, stdev=15518.63 lat (usec): min=26, max=100489, avg=21132.47, stdev=15518.66 clat percentiles (usec): | 1.00th=[ 39], 5.00th=[ 65], 10.00th=[ 104], 20.00th=[ 8717], | 30.00th=[ 13566], 40.00th=[ 16909], 50.00th=[ 20317], 60.00th=[ 23200], | 70.00th=[ 26870], 80.00th=[ 31589], 90.00th=[ 41681], 95.00th=[ 46924], | 99.00th=[ 67634], 99.50th=[ 79168], 99.90th=[100140], 99.95th=[100140], | 99.99th=[100140] bw ( KiB/s): min= 222, max= 698, per=26.29%, avg=419.79, stdev=113.16, samples=29 iops : min= 13, max= 43, avg=25.69, stdev= 7.08, samples=29 write: IOPS=25, BW=407KiB/s (417kB/s)(6032KiB/14815msec); 0 zone resets clat (usec): min=1420, max=87654, avg=17106.64, stdev=14973.78 lat (usec): min=1422, max=87656, avg=17115.39, stdev=14974.15 clat percentiles (usec): | 1.00th=[ 1647], 5.00th=[ 2442], 10.00th=[ 3261], 20.00th=[ 4883], | 30.00th=[ 6390], 40.00th=[ 8717], 50.00th=[12125], 60.00th=[16581], | 70.00th=[20841], 80.00th=[28443], 90.00th=[39060], 95.00th=[45876], | 99.00th=[67634], 99.50th=[71828], 99.90th=[87557], 99.95th=[87557], | 99.99th=[87557] bw ( KiB/s): min= 159, max= 608, per=23.81%, avg=399.97, stdev=109.64, samples=29 iops : min= 9, max= 38, avg=24.45, stdev= 6.96, samples=29 lat (usec) : 50=1.17%, 100=3.65%, 250=4.30%, 500=0.26%, 750=0.13% lat (msec) : 2=1.30%, 4=5.73%, 10=15.63%, 20=25.91%, 50=38.28% lat (msec) : 100=3.52%, 250=0.13% cpu : usr=0.17%, sys=22.09%, ctx=2138, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=148876: Fri Apr 10 22:39:18 2026 read: IOPS=25, BW=415KiB/s (425kB/s)(6032KiB/14535msec) clat (usec): min=33, max=88358, avg=19576.30, stdev=14720.13 lat (usec): min=33, max=88361, avg=19578.85, stdev=14719.70 clat percentiles (usec): | 1.00th=[ 49], 5.00th=[ 74], 10.00th=[ 111], 20.00th=[ 204], | 30.00th=[13042], 40.00th=[16188], 50.00th=[18744], 60.00th=[23200], | 70.00th=[25822], 80.00th=[30016], 90.00th=[36963], 95.00th=[43254], | 99.00th=[67634], 99.50th=[79168], 99.90th=[88605], 99.95th=[88605], | 99.99th=[88605] bw ( KiB/s): min= 192, max= 672, per=25.81%, avg=412.14, stdev=102.11, samples=28 iops : min= 12, max= 42, avg=25.21, stdev= 6.48, samples=28 write: IOPS=26, BW=430KiB/s (441kB/s)(6256KiB/14535msec); 0 zone resets clat (usec): min=1391, max=155830, avg=18043.83, stdev=17364.49 lat (usec): min=1394, max=155832, avg=18046.85, stdev=17364.38 clat percentiles (usec): | 1.00th=[ 1565], 5.00th=[ 2573], 10.00th=[ 3621], 20.00th=[ 5342], | 30.00th=[ 7046], 40.00th=[ 9372], 50.00th=[ 11600], 60.00th=[ 15664], | 70.00th=[ 22938], 80.00th=[ 29754], 90.00th=[ 39060], 95.00th=[ 47449], | 99.00th=[ 71828], 99.50th=[108528], 99.90th=[156238], 99.95th=[156238], | 99.99th=[156238] bw ( KiB/s): min= 191, max= 640, per=25.74%, avg=432.50, stdev=119.54, samples=28 iops : min= 11, max= 40, avg=26.50, stdev= 7.60, samples=28 lat (usec) : 50=0.52%, 100=3.52%, 250=6.38%, 500=0.39% lat (msec) : 2=1.17%, 4=4.95%, 10=17.19%, 20=24.87%, 50=37.50% lat (msec) : 100=3.12%, 250=0.39% cpu : usr=0.06%, sys=21.69%, ctx=2079, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1597KiB/s (1636kB/s), 383KiB/s-422KiB/s (392kB/s-432kB/s), io=23.4MiB (24.5MB), run=14535-14994msec WRITE: bw=1681KiB/s (1721kB/s), 407KiB/s-436KiB/s (417kB/s-447kB/s), io=24.6MiB (25.8MB), run=14535-14994msec rand-rw: (groupid=0, jobs=1): err= 0: pid=148869: Fri Apr 10 22:39:31 2026 read: IOPS=13, BW=208KiB/s (213kB/s)(5920KiB/28401msec) clat (msec): min=4, max=137, avg=19.29, stdev=20.85 lat (msec): min=4, max=137, avg=19.29, stdev=20.85 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 7], 10.00th=[ 7], 20.00th=[ 8], | 30.00th=[ 9], 40.00th=[ 11], 50.00th=[ 12], 60.00th=[ 14], | 70.00th=[ 17], 80.00th=[ 25], 90.00th=[ 42], 95.00th=[ 62], | 99.00th=[ 116], 99.50th=[ 130], 99.90th=[ 138], 99.95th=[ 138], | 99.99th=[ 138] bw ( KiB/s): min= 31, max= 448, per=24.46%, avg=206.23, stdev=105.41, samples=56 iops : min= 1, max= 28, avg=12.29, stdev= 6.62, samples=56 write: IOPS=14, BW=224KiB/s (230kB/s)(6368KiB/28401msec); 0 zone resets clat (msec): min=22, max=172, avg=53.04, stdev=25.34 lat (msec): min=22, max=172, avg=53.05, stdev=25.34 clat percentiles (msec): | 1.00th=[ 24], 5.00th=[ 28], 10.00th=[ 30], 20.00th=[ 34], | 30.00th=[ 37], 40.00th=[ 42], 50.00th=[ 46], 60.00th=[ 51], | 70.00th=[ 58], 80.00th=[ 73], 90.00th=[ 88], 95.00th=[ 109], | 99.00th=[ 144], 99.50th=[ 157], 99.90th=[ 174], 99.95th=[ 174], | 99.99th=[ 174] bw ( KiB/s): min= 63, max= 415, per=25.13%, avg=222.91, stdev=105.35, samples=56 iops : min= 3, max= 25, avg=13.32, stdev= 6.61, samples=56 lat (msec) : 10=19.01%, 20=17.06%, 50=39.06%, 100=20.96%, 250=3.91% cpu : usr=0.10%, sys=5.51%, ctx=1621, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=148870: Fri Apr 10 22:39:31 2026 read: IOPS=12, BW=202KiB/s (207kB/s)(5744KiB/28403msec) clat (msec): min=4, max=138, avg=17.57, stdev=18.53 lat (msec): min=4, max=138, avg=17.58, stdev=18.52 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 7], 10.00th=[ 7], 20.00th=[ 8], | 30.00th=[ 9], 40.00th=[ 9], 50.00th=[ 11], 60.00th=[ 13], | 70.00th=[ 17], 80.00th=[ 24], 90.00th=[ 36], 95.00th=[ 53], | 99.00th=[ 107], 99.50th=[ 131], 99.90th=[ 140], 99.95th=[ 140], | 99.99th=[ 140] bw ( KiB/s): min= 31, max= 509, per=25.24%, avg=212.77, stdev=123.23, samples=53 iops : min= 1, max= 31, avg=12.70, stdev= 7.69, samples=53 write: IOPS=14, BW=230KiB/s (236kB/s)(6544KiB/28403msec); 0 zone resets clat (msec): min=20, max=169, avg=53.86, stdev=27.22 lat (msec): min=20, max=169, avg=53.86, stdev=27.22 clat percentiles (msec): | 1.00th=[ 24], 5.00th=[ 28], 10.00th=[ 30], 20.00th=[ 34], | 30.00th=[ 37], 40.00th=[ 42], 50.00th=[ 46], 60.00th=[ 51], | 70.00th=[ 58], 80.00th=[ 70], 90.00th=[ 94], 95.00th=[ 111], | 99.00th=[ 148], 99.50th=[ 161], 99.90th=[ 169], 99.95th=[ 169], | 99.99th=[ 169] bw ( KiB/s): min= 63, max= 415, per=25.80%, avg=228.88, stdev=100.77, samples=56 iops : min= 3, max= 25, avg=13.70, stdev= 6.32, samples=56 lat (msec) : 10=23.05%, 20=12.50%, 50=40.49%, 100=19.40%, 250=4.56% cpu : usr=0.10%, sys=5.43%, ctx=1540, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=148871: Fri Apr 10 22:39:31 2026 read: IOPS=13, BW=224KiB/s (229kB/s)(6256KiB/27978msec) clat (msec): min=4, max=139, avg=16.95, stdev=16.70 lat (msec): min=4, max=139, avg=16.95, stdev=16.70 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 7], 10.00th=[ 7], 20.00th=[ 8], | 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 12], | 70.00th=[ 16], 80.00th=[ 23], 90.00th=[ 40], 95.00th=[ 50], | 99.00th=[ 85], 99.50th=[ 116], 99.90th=[ 140], 99.95th=[ 140], | 99.99th=[ 140] bw ( KiB/s): min= 31, max= 734, per=26.69%, avg=225.04, stdev=150.10, samples=55 iops : min= 1, max= 45, avg=13.45, stdev= 9.36, samples=55 write: IOPS=13, BW=216KiB/s (221kB/s)(6032KiB/27978msec); 0 zone resets clat (msec): min=23, max=206, avg=56.54, stdev=30.02 lat (msec): min=23, max=206, avg=56.54, stdev=30.02 clat percentiles (msec): | 1.00th=[ 26], 5.00th=[ 28], 10.00th=[ 30], 20.00th=[ 34], | 30.00th=[ 40], 40.00th=[ 43], 50.00th=[ 48], 60.00th=[ 53], | 70.00th=[ 60], 80.00th=[ 74], 90.00th=[ 100], 95.00th=[ 126], | 99.00th=[ 159], 99.50th=[ 184], 99.90th=[ 207], 99.95th=[ 207], | 99.99th=[ 207] bw ( KiB/s): min= 63, max= 384, per=24.06%, avg=213.45, stdev=95.65, samples=55 iops : min= 3, max= 24, avg=12.73, stdev= 5.99, samples=55 lat (msec) : 10=25.13%, 20=13.67%, 50=36.98%, 100=19.14%, 250=5.08% cpu : usr=0.06%, sys=5.30%, ctx=1522, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=148872: Fri Apr 10 22:39:31 2026 read: IOPS=13, BW=214KiB/s (219kB/s)(6032KiB/28190msec) clat (msec): min=5, max=100, avg=18.56, stdev=17.49 lat (msec): min=5, max=100, avg=18.56, stdev=17.49 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 7], 10.00th=[ 7], 20.00th=[ 8], | 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 13], | 70.00th=[ 18], 80.00th=[ 29], 90.00th=[ 40], 95.00th=[ 61], | 99.00th=[ 88], 99.50th=[ 91], 99.90th=[ 101], 99.95th=[ 101], | 99.99th=[ 101] bw ( KiB/s): min= 63, max= 447, per=25.22%, avg=212.64, stdev=113.57, samples=56 iops : min= 3, max= 27, avg=12.68, stdev= 7.19, samples=56 write: IOPS=13, BW=222KiB/s (227kB/s)(6256KiB/28190msec); 0 zone resets clat (msec): min=22, max=187, avg=54.01, stdev=26.53 lat (msec): min=22, max=187, avg=54.02, stdev=26.53 clat percentiles (msec): | 1.00th=[ 25], 5.00th=[ 29], 10.00th=[ 31], 20.00th=[ 35], | 30.00th=[ 39], 40.00th=[ 42], 50.00th=[ 46], 60.00th=[ 52], | 70.00th=[ 58], 80.00th=[ 69], 90.00th=[ 87], 95.00th=[ 107], | 99.00th=[ 155], 99.50th=[ 171], 99.90th=[ 188], 99.95th=[ 188], | 99.99th=[ 188] bw ( KiB/s): min= 95, max= 384, per=25.05%, avg=222.23, stdev=97.92, samples=56 iops : min= 5, max= 24, avg=13.29, stdev= 6.12, samples=56 lat (msec) : 10=21.09%, 20=14.84%, 50=39.45%, 100=20.57%, 250=4.04% cpu : usr=0.07%, sys=5.63%, ctx=1552, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=843KiB/s (864kB/s), 202KiB/s-224KiB/s (207kB/s-229kB/s), io=23.4MiB (24.5MB), run=27978-28403msec WRITE: bw=887KiB/s (909kB/s), 216KiB/s-230KiB/s (221kB/s-236kB/s), io=24.6MiB (25.8MB), run=27978-28403msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=148887: Fri Apr 10 22:39:41 2026 read: IOPS=3, BW=3691KiB/s (3780kB/s)(7168KiB/1942msec) clat (msec): min=46, max=299, avg=120.49, stdev=93.15 lat (msec): min=46, max=299, avg=120.49, stdev=93.15 clat percentiles (msec): | 1.00th=[ 47], 5.00th=[ 47], 10.00th=[ 47], 20.00th=[ 49], | 30.00th=[ 59], 40.00th=[ 59], 50.00th=[ 77], 60.00th=[ 138], | 70.00th=[ 138], 80.00th=[ 178], 90.00th=[ 300], 95.00th=[ 300], | 99.00th=[ 300], 99.50th=[ 300], 99.90th=[ 300], 99.95th=[ 300], | 99.99th=[ 300] bw ( KiB/s): min= 2027, max= 9258, per=85.25%, avg=5642.50, stdev=5113.09, samples=2 iops : min= 1, max= 9, avg= 5.00, stdev= 5.66, samples=2 write: IOPS=2, BW=2636KiB/s (2700kB/s)(5120KiB/1942msec); 0 zone resets clat (msec): min=88, max=334, avg=217.57, stdev=90.95 lat (msec): min=88, max=334, avg=217.65, stdev=90.94 clat percentiles (msec): | 1.00th=[ 88], 5.00th=[ 88], 10.00th=[ 88], 20.00th=[ 88], | 30.00th=[ 192], 40.00th=[ 192], 50.00th=[ 211], 60.00th=[ 211], | 70.00th=[ 262], 80.00th=[ 262], 90.00th=[ 334], 95.00th=[ 334], | 99.00th=[ 334], 99.50th=[ 334], 99.90th=[ 334], 99.95th=[ 334], | 99.99th=[ 334] bw ( KiB/s): min= 1851, max= 3886, per=27.93%, avg=2588.00, stdev=1127.54, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (msec) : 50=16.67%, 100=25.00%, 250=33.33%, 500=25.00% cpu : usr=0.00%, sys=14.43%, ctx=231, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=148888: Fri Apr 10 22:39:41 2026 read: IOPS=0, BW=662KiB/s (678kB/s)(2048KiB/3094msec) clat (msec): min=55, max=296, avg=176.32, stdev=170.60 lat (msec): min=55, max=296, avg=176.32, stdev=170.60 clat percentiles (msec): | 1.00th=[ 56], 5.00th=[ 56], 10.00th=[ 56], 20.00th=[ 56], | 30.00th=[ 56], 40.00th=[ 56], 50.00th=[ 56], 60.00th=[ 296], | 70.00th=[ 296], 80.00th=[ 296], 90.00th=[ 296], 95.00th=[ 296], | 99.00th=[ 296], 99.50th=[ 296], 99.90th=[ 296], 99.95th=[ 296], | 99.99th=[ 296] bw ( KiB/s): min= 1831, max= 2048, per=29.30%, avg=1939.50, stdev=153.44, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 write: IOPS=3, BW=3310KiB/s (3389kB/s)(10.0MiB/3094msec); 0 zone resets clat (msec): min=99, max=443, avg=269.51, stdev=116.25 lat (msec): min=99, max=443, avg=269.62, stdev=116.25 clat percentiles (msec): | 1.00th=[ 100], 5.00th=[ 100], 10.00th=[ 100], 20.00th=[ 142], | 30.00th=[ 171], 40.00th=[ 245], 50.00th=[ 245], 60.00th=[ 259], | 70.00th=[ 313], 80.00th=[ 342], 90.00th=[ 435], 95.00th=[ 443], | 99.00th=[ 443], 99.50th=[ 443], 99.90th=[ 443], 99.95th=[ 443], | 99.99th=[ 443] bw ( KiB/s): min= 1831, max= 3886, per=28.96%, avg=2683.20, stdev=986.43, samples=5 iops : min= 1, max= 3, avg= 2.00, stdev= 1.00, samples=5 lat (msec) : 100=16.67%, 250=33.33%, 500=50.00% cpu : usr=0.00%, sys=12.96%, ctx=199, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=148889: Fri Apr 10 22:39:41 2026 read: IOPS=1, BW=1992KiB/s (2040kB/s)(6144KiB/3084msec) clat (msec): min=62, max=436, avg=221.44, stdev=150.84 lat (msec): min=62, max=436, avg=221.44, stdev=150.85 clat percentiles (msec): | 1.00th=[ 63], 5.00th=[ 63], 10.00th=[ 63], 20.00th=[ 84], | 30.00th=[ 84], 40.00th=[ 144], 50.00th=[ 144], 60.00th=[ 255], | 70.00th=[ 347], 80.00th=[ 347], 90.00th=[ 435], 95.00th=[ 435], | 99.00th=[ 435], 99.50th=[ 435], 99.90th=[ 435], 99.95th=[ 435], | 99.99th=[ 435] bw ( KiB/s): min= 2027, max= 3624, per=38.77%, avg=2566.33, stdev=916.03, samples=3 iops : min= 1, max= 3, avg= 2.00, stdev= 1.00, samples=3 write: IOPS=1, BW=1992KiB/s (2040kB/s)(6144KiB/3084msec); 0 zone resets clat (msec): min=105, max=512, avg=286.35, stdev=178.19 lat (msec): min=106, max=512, avg=286.42, stdev=178.20 clat percentiles (msec): | 1.00th=[ 107], 5.00th=[ 107], 10.00th=[ 107], 20.00th=[ 107], | 30.00th=[ 107], 40.00th=[ 176], 50.00th=[ 176], 60.00th=[ 401], | 70.00th=[ 422], 80.00th=[ 422], 90.00th=[ 514], 95.00th=[ 514], | 99.00th=[ 514], 99.50th=[ 514], 99.90th=[ 514], 99.95th=[ 514], | 99.99th=[ 514] bw ( KiB/s): min= 1812, max= 3886, per=27.12%, avg=2513.00, stdev=1189.14, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (msec) : 100=16.67%, 250=33.33%, 500=41.67%, 750=8.33% cpu : usr=0.00%, sys=11.51%, ctx=98, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=148890: Fri Apr 10 22:39:41 2026 read: IOPS=1, BW=2011KiB/s (2059kB/s)(5120KiB/2546msec) clat (msec): min=77, max=571, avg=246.53, stdev=207.18 lat (msec): min=77, max=571, avg=246.53, stdev=207.18 clat percentiles (msec): | 1.00th=[ 78], 5.00th=[ 78], 10.00th=[ 78], 20.00th=[ 78], | 30.00th=[ 108], 40.00th=[ 108], 50.00th=[ 142], 60.00th=[ 142], | 70.00th=[ 334], 80.00th=[ 334], 90.00th=[ 575], 95.00th=[ 575], | 99.00th=[ 575], 99.50th=[ 575], 99.90th=[ 575], 99.95th=[ 575], | 99.99th=[ 575] bw ( KiB/s): min= 2048, max= 6083, per=61.42%, avg=4065.50, stdev=2853.18, samples=2 iops : min= 2, max= 5, avg= 3.50, stdev= 2.12, samples=2 write: IOPS=2, BW=2815KiB/s (2883kB/s)(7168KiB/2546msec); 0 zone resets clat (msec): min=86, max=335, avg=180.67, stdev=92.73 lat (msec): min=86, max=335, avg=180.81, stdev=92.73 clat percentiles (msec): | 1.00th=[ 87], 5.00th=[ 87], 10.00th=[ 87], 20.00th=[ 91], | 30.00th=[ 118], 40.00th=[ 118], 50.00th=[ 184], 60.00th=[ 188], | 70.00th=[ 188], 80.00th=[ 262], 90.00th=[ 338], 95.00th=[ 338], | 99.00th=[ 338], 99.50th=[ 338], 99.90th=[ 338], 99.95th=[ 338], | 99.99th=[ 338] bw ( KiB/s): min= 2048, max= 7420, per=51.09%, avg=4734.00, stdev=3798.58, samples=2 iops : min= 2, max= 7, avg= 4.50, stdev= 3.54, samples=2 lat (msec) : 100=25.00%, 250=41.67%, 500=25.00%, 750=8.33% cpu : usr=0.04%, sys=13.56%, ctx=311, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=6619KiB/s (6778kB/s), 662KiB/s-3691KiB/s (678kB/s-3780kB/s), io=20.0MiB (20.0MB), run=1942-3094msec WRITE: bw=9267KiB/s (9489kB/s), 1992KiB/s-3310KiB/s (2040kB/s-3389kB/s), io=28.0MiB (29.4MB), run=1942-3094msec rand-rw: (groupid=0, jobs=1): err= 0: pid=148892: Fri Apr 10 22:39:41 2026 read: IOPS=2, BW=3037KiB/s (3110kB/s)(7168KiB/2360msec) clat (usec): min=579, max=259868, avg=134885.95, stdev=82858.80 lat (usec): min=580, max=259870, avg=134887.06, stdev=82858.68 clat percentiles (usec): | 1.00th=[ 578], 5.00th=[ 578], 10.00th=[ 578], 20.00th=[ 84411], | 30.00th=[103285], 40.00th=[103285], 50.00th=[139461], 60.00th=[168821], | 70.00th=[168821], 80.00th=[187696], 90.00th=[258999], 95.00th=[258999], | 99.00th=[258999], 99.50th=[258999], 99.90th=[258999], 99.95th=[258999], | 99.99th=[258999] bw ( KiB/s): min= 2048, max= 5278, per=55.36%, avg=3770.00, stdev=1625.60, samples=3 iops : min= 2, max= 5, avg= 3.33, stdev= 1.53, samples=3 write: IOPS=2, BW=2169KiB/s (2222kB/s)(5120KiB/2360msec); 0 zone resets clat (msec): min=130, max=443, avg=266.87, stdev=151.97 lat (msec): min=130, max=443, avg=266.96, stdev=151.99 clat percentiles (msec): | 1.00th=[ 131], 5.00th=[ 131], 10.00th=[ 131], 20.00th=[ 131], | 30.00th=[ 136], 40.00th=[ 136], 50.00th=[ 211], 60.00th=[ 211], | 70.00th=[ 418], 80.00th=[ 418], 90.00th=[ 443], 95.00th=[ 443], | 99.00th=[ 443], 99.50th=[ 443], 99.90th=[ 443], 99.95th=[ 443], | 99.99th=[ 443] bw ( KiB/s): min= 1992, max= 4087, per=28.41%, avg=2709.00, stdev=1193.71, samples=3 iops : min= 1, max= 3, avg= 2.00, stdev= 1.00, samples=3 lat (usec) : 750=8.33% lat (msec) : 100=8.33%, 250=58.33%, 500=25.00% cpu : usr=0.08%, sys=39.08%, ctx=636, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=148893: Fri Apr 10 22:39:41 2026 read: IOPS=0, BW=681KiB/s (697kB/s)(2048KiB/3007msec) clat (msec): min=137, max=180, avg=158.95, stdev=30.03 lat (msec): min=137, max=180, avg=158.95, stdev=30.03 clat percentiles (msec): | 1.00th=[ 138], 5.00th=[ 138], 10.00th=[ 138], 20.00th=[ 138], | 30.00th=[ 138], 40.00th=[ 138], 50.00th=[ 138], 60.00th=[ 180], | 70.00th=[ 180], 80.00th=[ 180], 90.00th=[ 180], 95.00th=[ 180], | 99.00th=[ 180], 99.50th=[ 180], 99.90th=[ 180], 99.95th=[ 180], | 99.99th=[ 180] bw ( KiB/s): min= 1851, max= 2027, per=28.47%, avg=1939.00, stdev=124.45, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=3, BW=3405KiB/s (3487kB/s)(10.0MiB/3007msec); 0 zone resets clat (msec): min=93, max=712, avg=240.07, stdev=174.34 lat (msec): min=93, max=712, avg=240.16, stdev=174.35 clat percentiles (msec): | 1.00th=[ 94], 5.00th=[ 94], 10.00th=[ 94], 20.00th=[ 121], | 30.00th=[ 140], 40.00th=[ 197], 50.00th=[ 197], 60.00th=[ 218], | 70.00th=[ 230], 80.00th=[ 239], 90.00th=[ 257], 95.00th=[ 709], | 99.00th=[ 709], 99.50th=[ 709], 99.90th=[ 709], 99.95th=[ 709], | 99.99th=[ 709] bw ( KiB/s): min= 2043, max= 4096, per=37.17%, avg=3544.50, stdev=1002.07, samples=4 iops : min= 1, max= 4, avg= 2.75, stdev= 1.26, samples=4 lat (msec) : 100=8.33%, 250=75.00%, 500=8.33%, 750=8.33% cpu : usr=0.00%, sys=41.68%, ctx=308, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=148894: Fri Apr 10 22:39:41 2026 read: IOPS=2, BW=2285KiB/s (2340kB/s)(6144KiB/2689msec) clat (usec): min=393, max=229095, avg=63063.98, stdev=100165.57 lat (usec): min=393, max=229095, avg=63065.12, stdev=100165.39 clat percentiles (usec): | 1.00th=[ 396], 5.00th=[ 396], 10.00th=[ 396], 20.00th=[ 578], | 30.00th=[ 578], 40.00th=[ 750], 50.00th=[ 750], 60.00th=[ 799], | 70.00th=[145753], 80.00th=[145753], 90.00th=[229639], 95.00th=[229639], | 99.00th=[229639], 99.50th=[229639], 99.90th=[229639], 99.95th=[229639], | 99.99th=[229639] bw ( KiB/s): min= 2027, max= 4096, per=49.98%, avg=3403.33, stdev=1191.95, samples=3 iops : min= 1, max= 4, avg= 2.67, stdev= 1.53, samples=3 write: IOPS=2, BW=2285KiB/s (2340kB/s)(6144KiB/2689msec); 0 zone resets clat (msec): min=151, max=712, avg=371.00, stdev=210.99 lat (msec): min=151, max=712, avg=371.07, stdev=210.98 clat percentiles (msec): | 1.00th=[ 153], 5.00th=[ 153], 10.00th=[ 153], 20.00th=[ 209], | 30.00th=[ 209], 40.00th=[ 249], 50.00th=[ 249], 60.00th=[ 409], | 70.00th=[ 493], 80.00th=[ 493], 90.00th=[ 709], 95.00th=[ 709], | 99.00th=[ 709], 99.50th=[ 709], 99.90th=[ 709], 99.95th=[ 709], | 99.99th=[ 709] bw ( KiB/s): min= 1783, max= 2048, per=20.75%, avg=1978.60, stdev=111.52, samples=5 iops : min= 1, max= 2, avg= 1.20, stdev= 0.45, samples=5 lat (usec) : 500=8.33%, 750=16.67%, 1000=8.33% lat (msec) : 250=41.67%, 500=16.67%, 750=8.33% cpu : usr=0.00%, sys=31.55%, ctx=268, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=148895: Fri Apr 10 22:39:41 2026 read: IOPS=2, BW=2600KiB/s (2663kB/s)(5120KiB/1969msec) clat (usec): min=656, max=187964, avg=47546.91, stdev=81063.67 lat (usec): min=656, max=187965, avg=47547.79, stdev=81064.02 clat percentiles (usec): | 1.00th=[ 660], 5.00th=[ 660], 10.00th=[ 660], 20.00th=[ 660], | 30.00th=[ 676], 40.00th=[ 676], 50.00th=[ 938], 60.00th=[ 938], | 70.00th=[ 47449], 80.00th=[ 47449], 90.00th=[187696], 95.00th=[187696], | 99.00th=[187696], 99.50th=[187696], 99.90th=[187696], 99.95th=[187696], | 99.99th=[187696] bw ( KiB/s): min= 7968, max= 7968, per=100.00%, avg=7968.00, stdev= 0.00, samples=1 iops : min= 7, max= 7, avg= 7.00, stdev= 0.00, samples=1 write: IOPS=3, BW=3640KiB/s (3728kB/s)(7168KiB/1969msec); 0 zone resets clat (msec): min=125, max=592, avg=243.61, stdev=169.81 lat (msec): min=125, max=592, avg=243.69, stdev=169.81 clat percentiles (msec): | 1.00th=[ 126], 5.00th=[ 126], 10.00th=[ 126], 20.00th=[ 128], | 30.00th=[ 131], 40.00th=[ 131], 50.00th=[ 180], 60.00th=[ 228], | 70.00th=[ 228], 80.00th=[ 326], 90.00th=[ 592], 95.00th=[ 592], | 99.00th=[ 592], 99.50th=[ 592], 99.90th=[ 592], 99.95th=[ 592], | 99.99th=[ 592] bw ( KiB/s): min= 1992, max= 5233, per=39.55%, avg=3770.67, stdev=1643.49, samples=3 iops : min= 1, max= 5, avg= 3.00, stdev= 2.00, samples=3 lat (usec) : 750=16.67%, 1000=8.33% lat (msec) : 50=8.33%, 250=50.00%, 500=8.33%, 750=8.33% cpu : usr=0.00%, sys=42.43%, ctx=183, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=6811KiB/s (6974kB/s), 681KiB/s-3037KiB/s (697kB/s-3110kB/s), io=20.0MiB (20.0MB), run=1969-3007msec WRITE: bw=9535KiB/s (9764kB/s), 2169KiB/s-3640KiB/s (2222kB/s-3728kB/s), io=28.0MiB (29.4MB), run=1969-3007msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=148901: Fri Apr 10 22:39:47 2026 read: IOPS=1, BW=5891KiB/s (6032kB/s)(12.0MiB/2086msec) clat (msec): min=153, max=1061, avg=684.83, stdev=473.15 lat (msec): min=153, max=1061, avg=684.83, stdev=473.15 clat percentiles (msec): | 1.00th=[ 155], 5.00th=[ 155], 10.00th=[ 155], 20.00th=[ 155], | 30.00th=[ 155], 40.00th=[ 844], 50.00th=[ 844], 60.00th=[ 844], | 70.00th=[ 1062], 80.00th=[ 1062], 90.00th=[ 1062], 95.00th=[ 1062], | 99.00th=[ 1062], 99.50th=[ 1062], 99.90th=[ 1062], 99.95th=[ 1062], | 99.99th=[ 1062] bw ( KiB/s): min= 8192, max= 8192, per=100.00%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=10.36%, ctx=76, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=148903: Fri Apr 10 22:39:47 2026 read: IOPS=0, BW=2202KiB/s (2255kB/s)(4096KiB/1860msec) clat (nsec): min=397923k, max=397923k, avg=397923072.00, stdev= 0.00 lat (nsec): min=397925k, max=397925k, avg=397925300.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 397], 5.00th=[ 397], 10.00th=[ 397], 20.00th=[ 397], | 30.00th=[ 397], 40.00th=[ 397], 50.00th=[ 397], 60.00th=[ 397], | 70.00th=[ 397], 80.00th=[ 397], 90.00th=[ 397], 95.00th=[ 397], | 99.00th=[ 397], 99.50th=[ 397], 99.90th=[ 397], 99.95th=[ 397], | 99.99th=[ 397] bw ( KiB/s): min= 5752, max= 5752, per=73.24%, avg=5752.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=1, BW=4404KiB/s (4510kB/s)(8192KiB/1860msec); 0 zone resets clat (msec): min=431, max=933, avg=682.29, stdev=354.88 lat (msec): min=431, max=933, avg=682.68, stdev=354.92 clat percentiles (msec): | 1.00th=[ 430], 5.00th=[ 430], 10.00th=[ 430], 20.00th=[ 430], | 30.00th=[ 430], 40.00th=[ 430], 50.00th=[ 430], 60.00th=[ 936], | 70.00th=[ 936], 80.00th=[ 936], 90.00th=[ 936], 95.00th=[ 936], | 99.00th=[ 936], 99.50th=[ 936], 99.90th=[ 936], 99.95th=[ 936], | 99.99th=[ 936] bw ( KiB/s): min= 8192, max= 8192, per=47.18%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 500=66.67%, 1000=33.33% cpu : usr=0.00%, sys=17.64%, ctx=138, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=148905: Fri Apr 10 22:39:47 2026 write: IOPS=1, BW=6512KiB/s (6668kB/s)(12.0MiB/1887msec); 0 zone resets clat (msec): min=388, max=795, avg=616.45, stdev=207.60 lat (msec): min=389, max=797, avg=617.25, stdev=208.22 clat percentiles (msec): | 1.00th=[ 388], 5.00th=[ 388], 10.00th=[ 388], 20.00th=[ 388], | 30.00th=[ 388], 40.00th=[ 667], 50.00th=[ 667], 60.00th=[ 667], | 70.00th=[ 793], 80.00th=[ 793], 90.00th=[ 793], 95.00th=[ 793], | 99.00th=[ 793], 99.50th=[ 793], 99.90th=[ 793], 99.95th=[ 793], | 99.99th=[ 793] bw ( KiB/s): min= 8192, max= 8192, per=47.18%, avg=8192.00, stdev= 0.00, samples=2 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 750=33.33%, 1000=33.33% cpu : usr=0.16%, sys=25.03%, ctx=138, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=148907: Fri Apr 10 22:39:47 2026 write: IOPS=1, BW=6915KiB/s (7081kB/s)(12.0MiB/1777msec); 0 zone resets clat (msec): min=207, max=1268, avg=565.65, stdev=608.79 lat (msec): min=207, max=1268, avg=565.97, stdev=608.75 clat percentiles (msec): | 1.00th=[ 207], 5.00th=[ 207], 10.00th=[ 207], 20.00th=[ 207], | 30.00th=[ 207], 40.00th=[ 222], 50.00th=[ 222], 60.00th=[ 222], | 70.00th=[ 1267], 80.00th=[ 1267], 90.00th=[ 1267], 95.00th=[ 1267], | 99.00th=[ 1267], 99.50th=[ 1267], 99.90th=[ 1267], 99.95th=[ 1267], | 99.99th=[ 1267] bw ( KiB/s): min=11804, max=11804, per=67.98%, avg=11804.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 250=66.67%, 2000=33.33% cpu : usr=0.06%, sys=17.40%, ctx=64, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=7854KiB/s (8043kB/s), 2202KiB/s-5891KiB/s (2255kB/s-6032kB/s), io=16.0MiB (16.8MB), run=1860-2086msec WRITE: bw=16.0MiB/s (17.8MB/s), 4404KiB/s-6915KiB/s (4510kB/s-7081kB/s), io=32.0MiB (33.6MB), run=1777-1887msec rand-rw: (groupid=0, jobs=1): err= 0: pid=148902: Fri Apr 10 22:39:48 2026 read: IOPS=1, BW=7367KiB/s (7544kB/s)(12.0MiB/1668msec) clat (msec): min=491, max=577, avg=544.69, stdev=46.91 lat (msec): min=491, max=577, avg=544.69, stdev=46.91 clat percentiles (msec): | 1.00th=[ 493], 5.00th=[ 493], 10.00th=[ 493], 20.00th=[ 493], | 30.00th=[ 493], 40.00th=[ 567], 50.00th=[ 567], 60.00th=[ 567], | 70.00th=[ 575], 80.00th=[ 575], 90.00th=[ 575], 95.00th=[ 575], | 99.00th=[ 575], 99.50th=[ 575], 99.90th=[ 575], 99.95th=[ 575], | 99.99th=[ 575] bw ( KiB/s): min= 6340, max= 8192, per=89.86%, avg=7266.00, stdev=1309.56, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 500=33.33%, 750=66.67% cpu : usr=0.00%, sys=49.55%, ctx=2215, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=148904: Fri Apr 10 22:39:48 2026 read: IOPS=0, BW=2022KiB/s (2070kB/s)(4096KiB/2026msec) clat (nsec): min=464014k, max=464014k, avg=464014129.00, stdev= 0.00 lat (nsec): min=464016k, max=464016k, avg=464016464.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 464], 5.00th=[ 464], 10.00th=[ 464], 20.00th=[ 464], | 30.00th=[ 464], 40.00th=[ 464], 50.00th=[ 464], 60.00th=[ 464], | 70.00th=[ 464], 80.00th=[ 464], 90.00th=[ 464], 95.00th=[ 464], | 99.00th=[ 464], 99.50th=[ 464], 99.90th=[ 464], 99.95th=[ 464], | 99.99th=[ 464] bw ( KiB/s): min= 6792, max= 6792, per=84.00%, avg=6792.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=4043KiB/s (4140kB/s)(8192KiB/2026msec); 0 zone resets clat (msec): min=531, max=923, avg=727.50, stdev=277.70 lat (msec): min=531, max=925, avg=728.28, stdev=278.22 clat percentiles (msec): | 1.00th=[ 531], 5.00th=[ 531], 10.00th=[ 531], 20.00th=[ 531], | 30.00th=[ 531], 40.00th=[ 531], 50.00th=[ 531], 60.00th=[ 927], | 70.00th=[ 927], 80.00th=[ 927], 90.00th=[ 927], 95.00th=[ 927], | 99.00th=[ 927], 99.50th=[ 927], 99.90th=[ 927], 99.95th=[ 927], | 99.99th=[ 927] bw ( KiB/s): min= 8192, max= 8192, per=55.48%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 750=33.33%, 1000=33.33% cpu : usr=0.10%, sys=17.73%, ctx=696, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=148906: Fri Apr 10 22:39:48 2026 write: IOPS=1, BW=5538KiB/s (5671kB/s)(12.0MiB/2219msec); 0 zone resets clat (msec): min=75, max=1378, avg=694.31, stdev=654.23 lat (msec): min=75, max=1379, avg=694.77, stdev=654.35 clat percentiles (msec): | 1.00th=[ 75], 5.00th=[ 75], 10.00th=[ 75], 20.00th=[ 75], | 30.00th=[ 75], 40.00th=[ 634], 50.00th=[ 634], 60.00th=[ 634], | 70.00th=[ 1385], 80.00th=[ 1385], 90.00th=[ 1385], 95.00th=[ 1385], | 99.00th=[ 1385], 99.50th=[ 1385], 99.90th=[ 1385], 99.95th=[ 1385], | 99.99th=[ 1385] bw ( KiB/s): min= 8192, max= 8192, per=55.48%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 100=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.09%, sys=10.32%, ctx=50, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=148908: Fri Apr 10 22:39:48 2026 write: IOPS=1, BW=6700KiB/s (6861kB/s)(12.0MiB/1834msec); 0 zone resets clat (msec): min=341, max=990, avg=599.28, stdev=344.22 lat (msec): min=341, max=990, avg=599.60, stdev=344.23 clat percentiles (msec): | 1.00th=[ 342], 5.00th=[ 342], 10.00th=[ 342], 20.00th=[ 342], | 30.00th=[ 342], 40.00th=[ 468], 50.00th=[ 468], 60.00th=[ 468], | 70.00th=[ 995], 80.00th=[ 995], 90.00th=[ 995], 95.00th=[ 995], | 99.00th=[ 995], 99.50th=[ 995], 99.90th=[ 995], 99.95th=[ 995], | 99.99th=[ 995] bw ( KiB/s): min= 6617, max= 8192, per=50.14%, avg=7404.50, stdev=1113.69, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 500=66.67%, 1000=33.33% cpu : usr=0.00%, sys=13.64%, ctx=201, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=8087KiB/s (8281kB/s), 2022KiB/s-7367KiB/s (2070kB/s-7544kB/s), io=16.0MiB (16.8MB), run=1668-2026msec WRITE: bw=14.4MiB/s (15.1MB/s), 4043KiB/s-6700KiB/s (4140kB/s-6861kB/s), io=32.0MiB (33.6MB), run=1834-2219msec