== sanity test 398b: DIO and buffer IO race ============== 13:14:17 (1772475257) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 2.85451 s, 17.6 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=147288: Mon Mar 2 13:15:22 2026 read: IOPS=26, BW=105KiB/s (108kB/s)(5992KiB/56811msec) clat (usec): min=29, max=274971, avg=19342.56, stdev=13911.28 lat (usec): min=29, max=274972, avg=19343.77, stdev=13911.30 clat percentiles (usec): | 1.00th=[ 63], 5.00th=[ 174], 10.00th=[ 8225], 20.00th=[ 10683], | 30.00th=[ 12518], 40.00th=[ 14615], 50.00th=[ 16909], 60.00th=[ 19530], | 70.00th=[ 22414], 80.00th=[ 26870], 90.00th=[ 33424], 95.00th=[ 40633], | 99.00th=[ 66323], 99.50th=[ 74974], 99.90th=[101188], 99.95th=[274727], | 99.99th=[274727] bw ( KiB/s): min= 42, max= 183, per=25.30%, avg=105.27, stdev=26.00, samples=113 iops : min= 10, max= 45, avg=25.87, stdev= 6.51, samples=113 write: IOPS=27, BW=111KiB/s (113kB/s)(6296KiB/56811msec); 0 zone resets clat (usec): min=751, max=137779, avg=17529.72, stdev=14847.24 lat (usec): min=752, max=137781, avg=17536.32, stdev=14844.81 clat percentiles (usec): | 1.00th=[ 1369], 5.00th=[ 2114], 10.00th=[ 2900], 20.00th=[ 4555], | 30.00th=[ 7111], 40.00th=[ 11207], 50.00th=[ 14746], 60.00th=[ 17957], | 70.00th=[ 22152], 80.00th=[ 27657], 90.00th=[ 35390], 95.00th=[ 44303], | 99.00th=[ 69731], 99.50th=[ 85459], 99.90th=[117965], 99.95th=[137364], | 99.99th=[137364] bw ( KiB/s): min= 28, max= 192, per=25.33%, avg=110.46, stdev=30.00, samples=113 iops : min= 7, max= 48, avg=27.17, stdev= 7.52, samples=113 lat (usec) : 50=0.20%, 100=0.98%, 250=1.50%, 500=0.26%, 750=0.03% lat (usec) : 1000=0.13% lat (msec) : 2=1.95%, 4=7.06%, 10=15.10%, 20=36.13%, 50=33.95% lat (msec) : 100=2.47%, 250=0.20%, 500=0.03% cpu : usr=0.13%, sys=21.28%, ctx=8774, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147290: Mon Mar 2 13:15:22 2026 read: IOPS=26, BW=104KiB/s (107kB/s)(5940KiB/56894msec) clat (usec): min=35, max=136430, avg=19507.52, stdev=12245.88 lat (usec): min=36, max=136431, avg=19509.76, stdev=12245.42 clat percentiles (usec): | 1.00th=[ 80], 5.00th=[ 5080], 10.00th=[ 8717], 20.00th=[ 10814], | 30.00th=[ 12780], 40.00th=[ 14746], 50.00th=[ 16909], 60.00th=[ 19792], | 70.00th=[ 22938], 80.00th=[ 27395], 90.00th=[ 33162], 95.00th=[ 40109], | 99.00th=[ 65274], 99.50th=[ 72877], 99.90th=[110625], 99.95th=[137364], | 99.99th=[137364] bw ( KiB/s): min= 21, max= 167, per=25.04%, avg=104.16, stdev=27.81, samples=113 iops : min= 5, max= 41, avg=25.59, stdev= 6.93, samples=113 write: IOPS=27, BW=112KiB/s (114kB/s)(6348KiB/56894msec); 0 zone resets clat (usec): min=797, max=266697, avg=17443.29, stdev=15847.98 lat (usec): min=798, max=266698, avg=17444.73, stdev=15848.03 clat percentiles (usec): | 1.00th=[ 1221], 5.00th=[ 2180], 10.00th=[ 2966], 20.00th=[ 4359], | 30.00th=[ 6652], 40.00th=[ 10552], 50.00th=[ 14091], 60.00th=[ 17957], | 70.00th=[ 22414], 80.00th=[ 27395], 90.00th=[ 35390], 95.00th=[ 45351], | 99.00th=[ 67634], 99.50th=[ 77071], 99.90th=[143655], 99.95th=[267387], | 99.99th=[267387] bw ( KiB/s): min= 39, max= 223, per=25.45%, avg=110.95, stdev=32.27, samples=113 iops : min= 9, max= 55, avg=27.29, stdev= 8.08, samples=113 lat (usec) : 50=0.10%, 100=0.85%, 250=1.14%, 500=0.13%, 1000=0.26% lat (msec) : 2=2.02%, 4=6.97%, 10=15.69%, 20=35.94%, 50=34.05% lat (msec) : 100=2.73%, 250=0.10%, 500=0.03% cpu : usr=0.11%, sys=21.57%, ctx=8758, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147291: Mon Mar 2 13:15:22 2026 read: IOPS=26, BW=105KiB/s (107kB/s)(6028KiB/57588msec) clat (usec): min=38, max=143455, avg=19662.11, stdev=12650.14 lat (usec): min=40, max=143456, avg=19663.42, stdev=12650.18 clat percentiles (usec): | 1.00th=[ 69], 5.00th=[ 6325], 10.00th=[ 8717], 20.00th=[ 11076], | 30.00th=[ 13042], 40.00th=[ 14877], 50.00th=[ 17171], 60.00th=[ 20055], | 70.00th=[ 22938], 80.00th=[ 27132], 90.00th=[ 32900], 95.00th=[ 40109], | 99.00th=[ 60556], 99.50th=[ 87557], 99.90th=[124257], 99.95th=[143655], | 99.99th=[143655] bw ( KiB/s): min= 24, max= 168, per=25.17%, avg=104.69, stdev=27.41, samples=113 iops : min= 6, max= 42, avg=25.73, stdev= 6.87, samples=113 write: IOPS=27, BW=109KiB/s (111kB/s)(6260KiB/57588msec); 0 zone resets clat (usec): min=803, max=335435, avg=17705.12, stdev=16911.74 lat (usec): min=804, max=335438, avg=17706.81, stdev=16911.68 clat percentiles (usec): | 1.00th=[ 1205], 5.00th=[ 2180], 10.00th=[ 2868], 20.00th=[ 4424], | 30.00th=[ 6980], 40.00th=[ 10683], 50.00th=[ 14091], 60.00th=[ 17695], | 70.00th=[ 21890], 80.00th=[ 28705], 90.00th=[ 36963], 95.00th=[ 44303], | 99.00th=[ 69731], 99.50th=[ 80217], 99.90th=[129500], 99.95th=[333448], | 99.99th=[333448] bw ( KiB/s): min= 14, max= 191, per=24.63%, avg=107.39, stdev=29.12, samples=114 iops : min= 3, max= 47, avg=26.40, stdev= 7.30, samples=114 lat (usec) : 50=0.13%, 100=0.91%, 250=0.88%, 500=0.10%, 1000=0.26% lat (msec) : 2=1.89%, 4=6.97%, 10=15.17%, 20=36.04%, 50=35.38% lat (msec) : 100=1.99%, 250=0.26%, 500=0.03% cpu : usr=0.16%, sys=21.15%, ctx=8925, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147293: Mon Mar 2 13:15:22 2026 read: IOPS=26, BW=106KiB/s (108kB/s)(6052KiB/57218msec) clat (usec): min=38, max=184014, avg=19093.30, stdev=12805.22 lat (usec): min=39, max=184016, avg=19096.99, stdev=12807.74 clat percentiles (usec): | 1.00th=[ 68], 5.00th=[ 182], 10.00th=[ 7963], 20.00th=[ 10552], | 30.00th=[ 12387], 40.00th=[ 14615], 50.00th=[ 16712], 60.00th=[ 19268], | 70.00th=[ 22676], 80.00th=[ 26608], 90.00th=[ 32637], 95.00th=[ 38011], | 99.00th=[ 68682], 99.50th=[ 79168], 99.90th=[115868], 99.95th=[183501], | 99.99th=[183501] bw ( KiB/s): min= 48, max= 175, per=25.42%, avg=105.77, stdev=24.71, samples=112 iops : min= 12, max= 43, avg=25.99, stdev= 6.19, samples=112 write: IOPS=27, BW=109KiB/s (112kB/s)(6236KiB/57218msec); 0 zone resets clat (usec): min=936, max=364639, avg=18027.02, stdev=17315.14 lat (usec): min=938, max=364640, avg=18028.56, stdev=17315.08 clat percentiles (usec): | 1.00th=[ 1156], 5.00th=[ 1991], 10.00th=[ 2769], 20.00th=[ 4359], | 30.00th=[ 7046], 40.00th=[ 10945], 50.00th=[ 14615], 60.00th=[ 18744], | 70.00th=[ 23462], 80.00th=[ 28967], 90.00th=[ 37487], 95.00th=[ 45351], | 99.00th=[ 58983], 99.50th=[ 71828], 99.90th=[166724], 99.95th=[362808], | 99.99th=[362808] bw ( KiB/s): min= 14, max= 190, per=24.84%, avg=108.28, stdev=31.15, samples=113 iops : min= 3, max= 47, avg=26.62, stdev= 7.79, samples=113 lat (usec) : 50=0.13%, 100=0.85%, 250=1.76%, 500=0.03%, 1000=0.07% lat (msec) : 2=2.60%, 4=6.71%, 10=15.56%, 20=34.51%, 50=35.25% lat (msec) : 100=2.28%, 250=0.23%, 500=0.03% cpu : usr=0.14%, sys=21.21%, ctx=8706, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=417KiB/s (427kB/s), 104KiB/s-106KiB/s (107kB/s-108kB/s), io=23.4MiB (24.6MB), run=56811-57588msec WRITE: bw=437KiB/s (447kB/s), 109KiB/s-112KiB/s (111kB/s-114kB/s), io=24.6MiB (25.7MB), run=56811-57588msec rand-rw: (groupid=0, jobs=1): err= 0: pid=147287: Mon Mar 2 13:15:53 2026 read: IOPS=16, BW=67.5KiB/s (69.2kB/s)(5992KiB/88730msec) clat (msec): min=3, max=282, avg=15.07, stdev=16.22 lat (msec): min=3, max=282, avg=15.07, stdev=16.22 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 5], 10.00th=[ 5], 20.00th=[ 6], | 30.00th=[ 7], 40.00th=[ 7], 50.00th=[ 9], 60.00th=[ 12], | 70.00th=[ 16], 80.00th=[ 23], 90.00th=[ 34], 95.00th=[ 47], | 99.00th=[ 74], 99.50th=[ 84], 99.90th=[ 117], 99.95th=[ 284], | 99.99th=[ 284] bw ( KiB/s): min= 8, max= 183, per=24.98%, avg=67.45, stdev=42.72, samples=175 iops : min= 2, max= 45, avg=16.48, stdev=10.74, samples=175 write: IOPS=17, BW=70.0KiB/s (72.7kB/s)(6296KiB/88730msec); 0 zone resets clat (msec): min=15, max=200, avg=41.89, stdev=23.34 lat (msec): min=15, max=200, avg=41.89, stdev=23.34 clat percentiles (msec): | 1.00th=[ 18], 5.00th=[ 20], 10.00th=[ 22], 20.00th=[ 24], | 30.00th=[ 27], 40.00th=[ 30], 50.00th=[ 34], 60.00th=[ 40], | 70.00th=[ 48], 80.00th=[ 58], 90.00th=[ 74], 95.00th=[ 89], | 99.00th=[ 125], 99.50th=[ 130], 99.90th=[ 199], 99.95th=[ 201], | 99.99th=[ 201] bw ( KiB/s): min= 16, max= 152, per=25.14%, avg=70.90, stdev=36.22, samples=175 iops : min= 4, max= 38, avg=17.34, stdev= 9.14, samples=175 lat (msec) : 4=0.68%, 10=26.89%, 20=13.74%, 50=42.90%, 100=14.36% lat (msec) : 250=1.40%, 500=0.03% cpu : usr=0.10%, sys=7.02%, ctx=5924, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147289: Mon Mar 2 13:15:53 2026 read: IOPS=16, BW=66.8KiB/s (68.4kB/s)(5940KiB/88877msec) clat (msec): min=3, max=282, avg=15.23, stdev=16.70 lat (msec): min=3, max=282, avg=15.24, stdev=16.70 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 5], 10.00th=[ 5], 20.00th=[ 6], | 30.00th=[ 7], 40.00th=[ 8], 50.00th=[ 9], 60.00th=[ 12], | 70.00th=[ 16], 80.00th=[ 24], 90.00th=[ 34], 95.00th=[ 46], | 99.00th=[ 77], 99.50th=[ 89], 99.90th=[ 138], 99.95th=[ 284], | 99.99th=[ 284] bw ( KiB/s): min= 7, max= 199, per=24.65%, avg=66.56, stdev=43.52, samples=177 iops : min= 1, max= 49, avg=16.26, stdev=10.94, samples=177 write: IOPS=17, BW=71.4KiB/s (73.1kB/s)(6348KiB/88877msec); 0 zone resets clat (msec): min=14, max=195, avg=41.61, stdev=22.62 lat (msec): min=14, max=195, avg=41.61, stdev=22.62 clat percentiles (msec): | 1.00th=[ 18], 5.00th=[ 20], 10.00th=[ 22], 20.00th=[ 24], | 30.00th=[ 28], 40.00th=[ 31], 50.00th=[ 34], 60.00th=[ 40], | 70.00th=[ 48], 80.00th=[ 57], 90.00th=[ 73], 95.00th=[ 85], | 99.00th=[ 124], 99.50th=[ 144], 99.90th=[ 186], 99.95th=[ 197], | 99.99th=[ 197] bw ( KiB/s): min= 7, max= 144, per=25.22%, avg=71.12, stdev=36.11, samples=177 iops : min= 1, max= 36, avg=17.40, stdev= 9.12, samples=177 lat (msec) : 4=0.78%, 10=26.95%, 20=12.50%, 50=43.39%, 100=15.14% lat (msec) : 250=1.20%, 500=0.03% cpu : usr=0.11%, sys=7.09%, ctx=5895, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147292: Mon Mar 2 13:15:53 2026 read: IOPS=17, BW=68.0KiB/s (69.6kB/s)(6028KiB/88632msec) clat (msec): min=3, max=154, avg=15.57, stdev=15.68 lat (msec): min=3, max=154, avg=15.57, stdev=15.68 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 5], 10.00th=[ 5], 20.00th=[ 6], | 30.00th=[ 7], 40.00th=[ 8], 50.00th=[ 10], 60.00th=[ 12], | 70.00th=[ 16], 80.00th=[ 24], 90.00th=[ 35], 95.00th=[ 48], | 99.00th=[ 73], 99.50th=[ 89], 99.90th=[ 133], 99.95th=[ 155], | 99.99th=[ 155] bw ( KiB/s): min= 7, max= 208, per=25.23%, avg=68.11, stdev=41.38, samples=175 iops : min= 1, max= 52, avg=16.65, stdev=10.40, samples=175 write: IOPS=17, BW=70.6KiB/s (72.3kB/s)(6260KiB/88632msec); 0 zone resets clat (msec): min=14, max=327, avg=41.50, stdev=24.45 lat (msec): min=14, max=327, avg=41.50, stdev=24.45 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 20], 10.00th=[ 21], 20.00th=[ 24], | 30.00th=[ 27], 40.00th=[ 30], 50.00th=[ 33], 60.00th=[ 40], | 70.00th=[ 47], 80.00th=[ 58], 90.00th=[ 72], 95.00th=[ 88], | 99.00th=[ 125], 99.50th=[ 138], 99.90th=[ 197], 99.95th=[ 330], | 99.99th=[ 330] bw ( KiB/s): min= 14, max= 152, per=24.88%, avg=70.16, stdev=37.38, samples=176 iops : min= 3, max= 38, avg=17.16, stdev= 9.44, samples=176 lat (msec) : 4=0.68%, 10=26.07%, 20=14.55%, 50=43.29%, 100=13.77% lat (msec) : 250=1.60%, 500=0.03% cpu : usr=0.11%, sys=7.05%, ctx=5916, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147294: Mon Mar 2 13:15:53 2026 read: IOPS=17, BW=68.7KiB/s (70.4kB/s)(6052KiB/88076msec) clat (msec): min=3, max=154, avg=15.19, stdev=15.01 lat (msec): min=3, max=154, avg=15.19, stdev=15.01 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 5], 10.00th=[ 5], 20.00th=[ 6], | 30.00th=[ 7], 40.00th=[ 8], 50.00th=[ 9], 60.00th=[ 12], | 70.00th=[ 16], 80.00th=[ 23], 90.00th=[ 34], 95.00th=[ 46], | 99.00th=[ 68], 99.50th=[ 82], 99.90th=[ 138], 99.95th=[ 155], | 99.99th=[ 155] bw ( KiB/s): min= 7, max= 216, per=25.50%, avg=68.86, stdev=42.75, samples=174 iops : min= 1, max= 54, avg=16.83, stdev=10.76, samples=174 write: IOPS=17, BW=70.8KiB/s (72.5kB/s)(6236KiB/88076msec); 0 zone resets clat (msec): min=16, max=348, avg=41.62, stdev=23.74 lat (msec): min=16, max=348, avg=41.62, stdev=23.74 clat percentiles (msec): | 1.00th=[ 18], 5.00th=[ 20], 10.00th=[ 21], 20.00th=[ 24], | 30.00th=[ 27], 40.00th=[ 30], 50.00th=[ 35], 60.00th=[ 40], | 70.00th=[ 48], 80.00th=[ 58], 90.00th=[ 72], 95.00th=[ 86], | 99.00th=[ 116], 99.50th=[ 140], 99.90th=[ 207], 99.95th=[ 347], | 99.99th=[ 347] bw ( KiB/s): min= 14, max= 151, per=24.99%, avg=70.47, stdev=36.12, samples=175 iops : min= 3, max= 37, avg=17.23, stdev= 9.12, samples=175 lat (msec) : 4=0.42%, 10=26.79%, 20=14.26%, 50=42.94%, 100=14.19% lat (msec) : 250=1.37%, 500=0.03% cpu : usr=0.11%, sys=7.11%, ctx=5907, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=270KiB/s (277kB/s), 66.8KiB/s-68.7KiB/s (68.4kB/s-70.4kB/s), io=23.4MiB (24.6MB), run=88076-88877msec WRITE: bw=283KiB/s (290kB/s), 70.6KiB/s-71.4KiB/s (72.3kB/s-73.1kB/s), io=24.6MiB (25.7MB), run=88076-88877msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=147327: Mon Mar 2 13:16:10 2026 read: IOPS=29, BW=468KiB/s (479kB/s)(5920KiB/12663msec) clat (usec): min=36, max=140550, avg=17639.37, stdev=12708.24 lat (usec): min=37, max=140552, avg=17640.46, stdev=12708.21 clat percentiles (usec): | 1.00th=[ 66], 5.00th=[ 101], 10.00th=[ 137], 20.00th=[ 10159], | 30.00th=[ 12518], 40.00th=[ 14484], 50.00th=[ 16909], 60.00th=[ 19006], | 70.00th=[ 21627], 80.00th=[ 24511], 90.00th=[ 29230], 95.00th=[ 37487], | 99.00th=[ 61604], 99.50th=[ 68682], 99.90th=[141558], 99.95th=[141558], | 99.99th=[141558] bw ( KiB/s): min= 222, max= 704, per=26.18%, avg=469.44, stdev=122.50, samples=25 iops : min= 13, max= 44, avg=28.88, stdev= 7.72, samples=25 write: IOPS=31, BW=503KiB/s (515kB/s)(6368KiB/12663msec); 0 zone resets clat (usec): min=1625, max=72394, avg=15070.90, stdev=11952.01 lat (usec): min=1627, max=72396, avg=15072.90, stdev=11951.87 clat percentiles (usec): | 1.00th=[ 1893], 5.00th=[ 3195], 10.00th=[ 4047], 20.00th=[ 4948], | 30.00th=[ 6587], 40.00th=[ 8586], 50.00th=[11863], 60.00th=[14615], | 70.00th=[19530], 80.00th=[24249], 90.00th=[30278], 95.00th=[39060], | 99.00th=[59507], 99.50th=[66847], 99.90th=[72877], 99.95th=[72877], | 99.99th=[72877] bw ( KiB/s): min= 192, max= 792, per=26.71%, avg=504.04, stdev=154.04, samples=25 iops : min= 12, max= 49, avg=31.08, stdev= 9.60, samples=25 lat (usec) : 50=0.13%, 100=2.21%, 250=3.78%, 500=0.26%, 750=0.13% lat (usec) : 1000=0.13% lat (msec) : 2=0.65%, 4=4.30%, 10=20.83%, 20=35.16%, 50=30.73% lat (msec) : 100=1.56%, 250=0.13% cpu : usr=0.18%, sys=27.44%, ctx=2374, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147328: Mon Mar 2 13:16:10 2026 read: IOPS=26, BW=430KiB/s (441kB/s)(5744KiB/13352msec) clat (usec): min=58, max=90596, avg=19227.02, stdev=11959.48 lat (usec): min=59, max=90598, avg=19227.97, stdev=11959.48 clat percentiles (usec): | 1.00th=[ 75], 5.00th=[ 121], 10.00th=[ 5735], 20.00th=[11469], | 30.00th=[13304], 40.00th=[15139], 50.00th=[17171], 60.00th=[19530], | 70.00th=[23462], 80.00th=[27657], 90.00th=[33424], 95.00th=[41681], | 99.00th=[57410], 99.50th=[66847], 99.90th=[90702], 99.95th=[90702], | 99.99th=[90702] bw ( KiB/s): min= 236, max= 608, per=23.84%, avg=427.42, stdev=105.15, samples=26 iops : min= 14, max= 38, avg=26.23, stdev= 6.66, samples=26 write: IOPS=30, BW=490KiB/s (502kB/s)(6544KiB/13352msec); 0 zone resets clat (usec): min=1025, max=194421, avg=15478.08, stdev=14448.77 lat (usec): min=1026, max=194423, avg=15481.05, stdev=14449.92 clat percentiles (usec): | 1.00th=[ 1582], 5.00th=[ 3064], 10.00th=[ 4080], 20.00th=[ 5145], | 30.00th=[ 6718], 40.00th=[ 9765], 50.00th=[ 12387], 60.00th=[ 15139], | 70.00th=[ 18220], 80.00th=[ 24249], 90.00th=[ 31065], 95.00th=[ 34866], | 99.00th=[ 56361], 99.50th=[ 62129], 99.90th=[193987], 99.95th=[193987], | 99.99th=[193987] bw ( KiB/s): min= 223, max= 766, per=25.43%, avg=479.88, stdev=143.67, samples=26 iops : min= 13, max= 47, avg=29.54, stdev= 8.95, samples=26 lat (usec) : 100=1.30%, 250=2.86%, 1000=0.13% lat (msec) : 2=1.17%, 4=3.91%, 10=19.27%, 20=40.23%, 50=29.04% lat (msec) : 100=1.95%, 250=0.13% cpu : usr=0.15%, sys=26.19%, ctx=2528, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147329: Mon Mar 2 13:16:10 2026 read: IOPS=29, BW=476KiB/s (487kB/s)(6256KiB/13142msec) clat (usec): min=50, max=63347, avg=17917.45, stdev=10970.69 lat (usec): min=50, max=63348, avg=17918.43, stdev=10970.80 clat percentiles (usec): | 1.00th=[ 67], 5.00th=[ 108], 10.00th=[ 139], 20.00th=[10028], | 30.00th=[13173], 40.00th=[15139], 50.00th=[17171], 60.00th=[19792], | 70.00th=[22414], 80.00th=[26346], 90.00th=[30540], 95.00th=[36963], | 99.00th=[47973], 99.50th=[48497], 99.90th=[63177], 99.95th=[63177], | 99.99th=[63177] bw ( KiB/s): min= 288, max= 670, per=26.52%, avg=475.44, stdev=112.93, samples=25 iops : min= 18, max= 41, avg=29.28, stdev= 7.06, samples=25 write: IOPS=28, BW=459KiB/s (470kB/s)(6032KiB/13142msec); 0 zone resets clat (usec): min=1389, max=96501, avg=16151.94, stdev=13130.34 lat (usec): min=1391, max=96503, avg=16157.56, stdev=13130.56 clat percentiles (usec): | 1.00th=[ 1565], 5.00th=[ 3458], 10.00th=[ 3884], 20.00th=[ 5080], | 30.00th=[ 6718], 40.00th=[ 9765], 50.00th=[12911], 60.00th=[16319], | 70.00th=[20055], 80.00th=[24249], 90.00th=[33162], 95.00th=[40633], | 99.00th=[65274], 99.50th=[71828], 99.90th=[96994], 99.95th=[96994], | 99.99th=[96994] bw ( KiB/s): min= 222, max= 672, per=23.69%, avg=447.00, stdev=121.68, samples=25 iops : min= 13, max= 42, avg=27.48, stdev= 7.74, samples=25 lat (usec) : 100=1.82%, 250=4.82%, 500=0.26% lat (msec) : 2=1.04%, 4=4.17%, 10=18.10%, 20=34.90%, 50=33.59% lat (msec) : 100=1.30% cpu : usr=0.18%, sys=26.51%, ctx=2434, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147330: Mon Mar 2 13:16:10 2026 read: IOPS=29, BW=465KiB/s (476kB/s)(6032KiB/12970msec) clat (usec): min=37, max=80017, avg=18208.58, stdev=12916.90 lat (usec): min=37, max=80019, avg=18209.96, stdev=12916.73 clat percentiles (usec): | 1.00th=[ 52], 5.00th=[ 100], 10.00th=[ 121], 20.00th=[ 9634], | 30.00th=[11863], 40.00th=[14353], 50.00th=[17171], 60.00th=[20579], | 70.00th=[23725], 80.00th=[27919], 90.00th=[32637], 95.00th=[38536], | 99.00th=[55837], 99.50th=[79168], 99.90th=[80217], 99.95th=[80217], | 99.99th=[80217] bw ( KiB/s): min= 184, max= 763, per=25.89%, avg=464.24, stdev=137.52, samples=25 iops : min= 11, max= 47, avg=28.56, stdev= 8.59, samples=25 write: IOPS=30, BW=482KiB/s (494kB/s)(6256KiB/12970msec); 0 zone resets clat (usec): min=1192, max=81720, avg=15274.64, stdev=12040.85 lat (usec): min=1193, max=81722, avg=15298.98, stdev=12055.73 clat percentiles (usec): | 1.00th=[ 2114], 5.00th=[ 3621], 10.00th=[ 4228], 20.00th=[ 5211], | 30.00th=[ 6652], 40.00th=[ 9241], 50.00th=[11731], 60.00th=[15664], | 70.00th=[18744], 80.00th=[23462], 90.00th=[30802], 95.00th=[38536], | 99.00th=[53216], 99.50th=[72877], 99.90th=[81265], 99.95th=[81265], | 99.99th=[81265] bw ( KiB/s): min= 184, max= 704, per=25.68%, avg=484.52, stdev=123.02, samples=25 iops : min= 11, max= 44, avg=29.84, stdev= 7.79, samples=25 lat (usec) : 50=0.26%, 100=2.34%, 250=5.47%, 500=0.13%, 750=0.13% lat (usec) : 1000=0.13% lat (msec) : 2=0.52%, 4=3.12%, 10=20.44%, 20=33.07%, 50=32.29% lat (msec) : 100=2.08% cpu : usr=0.12%, sys=26.99%, ctx=2373, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1794KiB/s (1837kB/s), 430KiB/s-476KiB/s (441kB/s-487kB/s), io=23.4MiB (24.5MB), run=12663-13352msec WRITE: bw=1887KiB/s (1933kB/s), 459KiB/s-503KiB/s (470kB/s-515kB/s), io=24.6MiB (25.8MB), run=12663-13352msec rand-rw: (groupid=0, jobs=1): err= 0: pid=147322: Mon Mar 2 13:16:20 2026 read: IOPS=16, BW=262KiB/s (268kB/s)(5920KiB/22622msec) clat (usec): min=3892, max=77505, avg=16961.27, stdev=13272.40 lat (usec): min=3892, max=77506, avg=16962.99, stdev=13271.86 clat percentiles (usec): | 1.00th=[ 4359], 5.00th=[ 5014], 10.00th=[ 5800], 20.00th=[ 7439], | 30.00th=[ 9765], 40.00th=[11338], 50.00th=[12780], 60.00th=[13960], | 70.00th=[16188], 80.00th=[23200], 90.00th=[34866], 95.00th=[48497], | 99.00th=[69731], 99.50th=[72877], 99.90th=[77071], 99.95th=[77071], | 99.99th=[77071] bw ( KiB/s): min= 31, max= 608, per=24.33%, avg=256.16, stdev=124.86, samples=44 iops : min= 1, max= 38, avg=15.59, stdev= 7.96, samples=44 write: IOPS=17, BW=281KiB/s (288kB/s)(6368KiB/22622msec); 0 zone resets clat (msec): min=15, max=215, avg=40.65, stdev=20.63 lat (msec): min=15, max=215, avg=40.65, stdev=20.63 clat percentiles (msec): | 1.00th=[ 18], 5.00th=[ 21], 10.00th=[ 23], 20.00th=[ 27], | 30.00th=[ 29], 40.00th=[ 33], 50.00th=[ 36], 60.00th=[ 40], | 70.00th=[ 44], 80.00th=[ 51], 90.00th=[ 66], 95.00th=[ 82], | 99.00th=[ 125], 99.50th=[ 148], 99.90th=[ 215], 99.95th=[ 215], | 99.99th=[ 215] bw ( KiB/s): min= 78, max= 544, per=25.26%, avg=279.61, stdev=114.29, samples=44 iops : min= 4, max= 34, avg=17.05, stdev= 7.28, samples=44 lat (msec) : 4=0.13%, 10=14.84%, 20=23.83%, 50=48.70%, 100=11.72% lat (msec) : 250=0.78% cpu : usr=0.12%, sys=8.38%, ctx=1682, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147323: Mon Mar 2 13:16:20 2026 read: IOPS=15, BW=253KiB/s (259kB/s)(5744KiB/22744msec) clat (usec): min=4248, max=95868, avg=17022.61, stdev=15080.22 lat (usec): min=4250, max=95868, avg=17023.61, stdev=15080.17 clat percentiles (usec): | 1.00th=[ 4490], 5.00th=[ 5276], 10.00th=[ 6587], 20.00th=[ 7963], | 30.00th=[ 9503], 40.00th=[10945], 50.00th=[12256], 60.00th=[13960], | 70.00th=[15795], 80.00th=[20579], 90.00th=[34341], 95.00th=[53216], | 99.00th=[85459], 99.50th=[88605], 99.90th=[95945], 99.95th=[95945], | 99.99th=[95945] bw ( KiB/s): min= 52, max= 544, per=23.89%, avg=251.58, stdev=131.74, samples=45 iops : min= 3, max= 34, avg=15.31, stdev= 8.35, samples=45 write: IOPS=17, BW=288KiB/s (295kB/s)(6544KiB/22744msec); 0 zone resets clat (msec): min=15, max=195, avg=40.40, stdev=19.04 lat (msec): min=15, max=195, avg=40.40, stdev=19.04 clat percentiles (msec): | 1.00th=[ 19], 5.00th=[ 21], 10.00th=[ 24], 20.00th=[ 27], | 30.00th=[ 29], 40.00th=[ 32], 50.00th=[ 36], 60.00th=[ 40], | 70.00th=[ 44], 80.00th=[ 53], 90.00th=[ 66], 95.00th=[ 79], | 99.00th=[ 97], 99.50th=[ 111], 99.90th=[ 197], 99.95th=[ 197], | 99.99th=[ 197] bw ( KiB/s): min= 127, max= 544, per=25.99%, avg=287.71, stdev=105.70, samples=45 iops : min= 7, max= 34, avg=17.58, stdev= 6.74, samples=45 lat (msec) : 10=15.63%, 20=23.18%, 50=46.48%, 100=14.32%, 250=0.39% cpu : usr=0.13%, sys=8.40%, ctx=1696, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147324: Mon Mar 2 13:16:20 2026 read: IOPS=17, BW=285KiB/s (291kB/s)(6256KiB/21986msec) clat (usec): min=4222, max=90579, avg=17050.66, stdev=13385.85 lat (usec): min=4223, max=90580, avg=17052.05, stdev=13385.78 clat percentiles (usec): | 1.00th=[ 4490], 5.00th=[ 5407], 10.00th=[ 6325], 20.00th=[ 8094], | 30.00th=[ 9634], 40.00th=[11338], 50.00th=[13173], 60.00th=[15008], | 70.00th=[17433], 80.00th=[22676], 90.00th=[31065], 95.00th=[49021], | 99.00th=[68682], 99.50th=[74974], 99.90th=[90702], 99.95th=[90702], | 99.99th=[90702] bw ( KiB/s): min= 95, max= 734, per=27.09%, avg=285.23, stdev=151.86, samples=43 iops : min= 5, max= 45, avg=17.40, stdev= 9.57, samples=43 write: IOPS=17, BW=274KiB/s (281kB/s)(6032KiB/21986msec); 0 zone resets clat (msec): min=15, max=147, avg=40.37, stdev=19.04 lat (msec): min=15, max=147, avg=40.38, stdev=19.04 clat percentiles (msec): | 1.00th=[ 18], 5.00th=[ 21], 10.00th=[ 23], 20.00th=[ 26], | 30.00th=[ 29], 40.00th=[ 32], 50.00th=[ 35], 60.00th=[ 40], | 70.00th=[ 46], 80.00th=[ 54], 90.00th=[ 66], 95.00th=[ 77], | 99.00th=[ 105], 99.50th=[ 140], 99.90th=[ 148], 99.95th=[ 148], | 99.99th=[ 148] bw ( KiB/s): min= 127, max= 480, per=24.55%, avg=271.77, stdev=107.29, samples=43 iops : min= 7, max= 30, avg=16.56, stdev= 6.86, samples=43 lat (msec) : 10=16.41%, 20=24.09%, 50=45.05%, 100=13.80%, 250=0.65% cpu : usr=0.11%, sys=8.78%, ctx=1659, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147325: Mon Mar 2 13:16:20 2026 read: IOPS=16, BW=267KiB/s (273kB/s)(6032KiB/22595msec) clat (msec): min=4, max=113, avg=19.15, stdev=16.55 lat (msec): min=4, max=113, avg=19.15, stdev=16.55 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 6], 10.00th=[ 7], 20.00th=[ 9], | 30.00th=[ 11], 40.00th=[ 13], 50.00th=[ 14], 60.00th=[ 16], | 70.00th=[ 19], 80.00th=[ 26], 90.00th=[ 39], 95.00th=[ 54], | 99.00th=[ 87], 99.50th=[ 100], 99.90th=[ 114], 99.95th=[ 114], | 99.99th=[ 114] bw ( KiB/s): min= 96, max= 544, per=24.81%, avg=261.27, stdev=111.24, samples=44 iops : min= 6, max= 34, avg=15.91, stdev= 7.09, samples=44 write: IOPS=17, BW=277KiB/s (284kB/s)(6256KiB/22595msec); 0 zone resets clat (msec): min=17, max=119, avg=39.23, stdev=16.40 lat (msec): min=17, max=119, avg=39.23, stdev=16.40 clat percentiles (msec): | 1.00th=[ 18], 5.00th=[ 21], 10.00th=[ 23], 20.00th=[ 26], | 30.00th=[ 30], 40.00th=[ 32], 50.00th=[ 35], 60.00th=[ 39], | 70.00th=[ 44], 80.00th=[ 53], 90.00th=[ 63], 95.00th=[ 72], | 99.00th=[ 92], 99.50th=[ 95], 99.90th=[ 121], 99.95th=[ 121], | 99.99th=[ 121] bw ( KiB/s): min= 127, max= 512, per=24.82%, avg=274.77, stdev=111.15, samples=44 iops : min= 7, max= 32, avg=16.75, stdev= 7.07, samples=44 lat (msec) : 10=13.54%, 20=24.61%, 50=47.53%, 100=14.06%, 250=0.26% cpu : usr=0.13%, sys=8.40%, ctx=1662, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1053KiB/s (1078kB/s), 253KiB/s-285KiB/s (259kB/s-291kB/s), io=23.4MiB (24.5MB), run=21986-22744msec WRITE: bw=1108KiB/s (1135kB/s), 274KiB/s-288KiB/s (281kB/s-295kB/s), io=24.6MiB (25.8MB), run=21986-22744msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=147342: Mon Mar 2 13:16:29 2026 read: IOPS=2, BW=2651KiB/s (2715kB/s)(7168KiB/2704msec) clat (usec): min=665, max=643948, avg=220031.77, stdev=216238.22 lat (usec): min=667, max=643951, avg=220033.50, stdev=216238.79 clat percentiles (usec): | 1.00th=[ 668], 5.00th=[ 668], 10.00th=[ 668], 20.00th=[ 68682], | 30.00th=[ 84411], 40.00th=[ 84411], 50.00th=[185598], 60.00th=[238027], | 70.00th=[238027], 80.00th=[320865], 90.00th=[641729], 95.00th=[641729], | 99.00th=[641729], 99.50th=[641729], 99.90th=[641729], 99.95th=[641729], | 99.99th=[641729] bw ( KiB/s): min= 2031, max= 6131, per=77.27%, avg=4072.33, stdev=2050.05, samples=3 iops : min= 1, max= 5, avg= 3.00, stdev= 2.00, samples=3 write: IOPS=1, BW=1893KiB/s (1939kB/s)(5120KiB/2704msec); 0 zone resets clat (msec): min=109, max=395, avg=230.14, stdev=127.66 lat (msec): min=109, max=395, avg=230.23, stdev=127.66 clat percentiles (msec): | 1.00th=[ 110], 5.00th=[ 110], 10.00th=[ 110], 20.00th=[ 110], | 30.00th=[ 138], 40.00th=[ 138], 50.00th=[ 174], 60.00th=[ 174], | 70.00th=[ 338], 80.00th=[ 338], 90.00th=[ 397], 95.00th=[ 397], | 99.00th=[ 397], 99.50th=[ 397], 99.90th=[ 397], 99.95th=[ 397], | 99.99th=[ 397] bw ( KiB/s): min= 2043, max= 6000, per=54.51%, avg=4021.50, stdev=2798.02, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 lat (usec) : 750=8.33% lat (msec) : 100=16.67%, 250=41.67%, 500=25.00%, 750=8.33% cpu : usr=0.00%, sys=42.21%, ctx=783, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147344: Mon Mar 2 13:16:29 2026 read: IOPS=0, BW=527KiB/s (540kB/s)(2048KiB/3886msec) clat (msec): min=104, max=194, avg=149.46, stdev=63.04 lat (msec): min=104, max=194, avg=149.47, stdev=63.04 clat percentiles (msec): | 1.00th=[ 106], 5.00th=[ 106], 10.00th=[ 106], 20.00th=[ 106], | 30.00th=[ 106], 40.00th=[ 106], 50.00th=[ 106], 60.00th=[ 194], | 70.00th=[ 194], 80.00th=[ 194], 90.00th=[ 194], 95.00th=[ 194], | 99.00th=[ 194], 99.50th=[ 194], 99.90th=[ 194], 99.95th=[ 194], | 99.99th=[ 194] bw ( KiB/s): min= 1402, max= 2035, per=32.61%, avg=1718.50, stdev=447.60, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2635KiB/s (2698kB/s)(10.0MiB/3886msec); 0 zone resets clat (msec): min=147, max=738, avg=349.97, stdev=202.11 lat (msec): min=148, max=738, avg=350.06, stdev=202.11 clat percentiles (msec): | 1.00th=[ 148], 5.00th=[ 148], 10.00th=[ 148], 20.00th=[ 157], | 30.00th=[ 209], 40.00th=[ 222], 50.00th=[ 251], 60.00th=[ 268], | 70.00th=[ 426], 80.00th=[ 489], 90.00th=[ 592], 95.00th=[ 743], | 99.00th=[ 743], 99.50th=[ 743], 99.90th=[ 743], 99.95th=[ 743], | 99.99th=[ 743] bw ( KiB/s): min= 1996, max= 4096, per=41.36%, avg=3051.50, stdev=1129.40, samples=6 iops : min= 1, max= 4, avg= 2.33, stdev= 1.51, samples=6 lat (msec) : 250=50.00%, 500=33.33%, 750=16.67% cpu : usr=0.00%, sys=42.14%, ctx=508, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147346: Mon Mar 2 13:16:29 2026 read: IOPS=1, BW=1592KiB/s (1630kB/s)(6144KiB/3859msec) clat (usec): min=730, max=378460, avg=224806.80, stdev=141731.38 lat (usec): min=732, max=378462, avg=224808.33, stdev=141731.50 clat percentiles (usec): | 1.00th=[ 734], 5.00th=[ 734], 10.00th=[ 734], 20.00th=[154141], | 30.00th=[154141], 40.00th=[198181], 50.00th=[198181], 60.00th=[246416], | 70.00th=[367002], 80.00th=[367002], 90.00th=[379585], 95.00th=[379585], | 99.00th=[379585], 99.50th=[379585], 99.90th=[379585], 99.95th=[379585], | 99.99th=[379585] bw ( KiB/s): min= 2048, max= 4096, per=64.56%, avg=3402.33, stdev=1173.00, samples=3 iops : min= 2, max= 4, avg= 3.00, stdev= 1.00, samples=3 write: IOPS=1, BW=1592KiB/s (1630kB/s)(6144KiB/3859msec); 0 zone resets clat (msec): min=89, max=974, avg=404.99, stdev=313.61 lat (msec): min=89, max=974, avg=405.06, stdev=313.62 clat percentiles (msec): | 1.00th=[ 90], 5.00th=[ 90], 10.00th=[ 90], 20.00th=[ 169], | 30.00th=[ 169], 40.00th=[ 317], 50.00th=[ 317], 60.00th=[ 405], | 70.00th=[ 477], 80.00th=[ 477], 90.00th=[ 978], 95.00th=[ 978], | 99.00th=[ 978], 99.50th=[ 978], 99.90th=[ 978], 99.95th=[ 978], | 99.99th=[ 978] bw ( KiB/s): min= 1996, max= 4096, per=37.13%, avg=2739.75, stdev=982.81, samples=4 iops : min= 1, max= 4, avg= 2.00, stdev= 1.41, samples=4 lat (usec) : 750=8.33% lat (msec) : 100=8.33%, 250=33.33%, 500=41.67%, 1000=8.33% cpu : usr=0.00%, sys=33.20%, ctx=867, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147348: Mon Mar 2 13:16:29 2026 read: IOPS=1, BW=1817KiB/s (1860kB/s)(5120KiB/2818msec) clat (usec): min=374, max=121783, avg=48766.84, stdev=66108.49 lat (usec): min=374, max=121783, avg=48767.74, stdev=66108.46 clat percentiles (usec): | 1.00th=[ 375], 5.00th=[ 375], 10.00th=[ 375], 20.00th=[ 375], | 30.00th=[ 537], 40.00th=[ 537], 50.00th=[ 562], 60.00th=[ 562], | 70.00th=[120062], 80.00th=[120062], 90.00th=[122160], 95.00th=[122160], | 99.00th=[122160], 99.50th=[122160], 99.90th=[122160], 99.95th=[122160], | 99.99th=[122160] bw ( KiB/s): min= 7984, max= 7984, per=100.00%, avg=7984.00, stdev= 0.00, samples=1 iops : min= 7, max= 7, avg= 7.00, stdev= 0.00, samples=1 write: IOPS=2, BW=2544KiB/s (2605kB/s)(7168KiB/2818msec); 0 zone resets clat (msec): min=117, max=783, avg=364.40, stdev=244.74 lat (msec): min=117, max=783, avg=364.48, stdev=244.74 clat percentiles (msec): | 1.00th=[ 117], 5.00th=[ 117], 10.00th=[ 117], 20.00th=[ 153], | 30.00th=[ 220], 40.00th=[ 220], 50.00th=[ 300], 60.00th=[ 384], | 70.00th=[ 384], 80.00th=[ 592], 90.00th=[ 785], 95.00th=[ 785], | 99.00th=[ 785], 99.50th=[ 785], 99.90th=[ 785], 99.95th=[ 785], | 99.99th=[ 785] bw ( KiB/s): min= 1412, max= 4071, per=36.77%, avg=2713.00, stdev=1256.68, samples=5 iops : min= 1, max= 3, avg= 1.80, stdev= 1.10, samples=5 lat (usec) : 500=8.33%, 750=16.67% lat (msec) : 250=41.67%, 500=16.67%, 750=8.33%, 1000=8.33% cpu : usr=0.00%, sys=37.13%, ctx=552, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5270KiB/s (5397kB/s), 527KiB/s-2651KiB/s (540kB/s-2715kB/s), io=20.0MiB (20.0MB), run=2704-3886msec WRITE: bw=7378KiB/s (7555kB/s), 1592KiB/s-2635KiB/s (1630kB/s-2698kB/s), io=28.0MiB (29.4MB), run=2704-3886msec rand-rw: (groupid=0, jobs=1): err= 0: pid=147341: Mon Mar 2 13:16:30 2026 read: IOPS=1, BW=1692KiB/s (1733kB/s)(7168KiB/4236msec) clat (msec): min=39, max=1108, avg=435.06, stdev=411.11 lat (msec): min=39, max=1108, avg=435.06, stdev=411.11 clat percentiles (msec): | 1.00th=[ 40], 5.00th=[ 40], 10.00th=[ 40], 20.00th=[ 63], | 30.00th=[ 192], 40.00th=[ 192], 50.00th=[ 218], 60.00th=[ 684], | 70.00th=[ 684], 80.00th=[ 751], 90.00th=[ 1116], 95.00th=[ 1116], | 99.00th=[ 1116], 99.50th=[ 1116], 99.90th=[ 1116], 99.95th=[ 1116], | 99.99th=[ 1116] bw ( KiB/s): min= 1380, max= 4096, per=49.78%, avg=2386.50, stdev=1180.76, samples=4 iops : min= 1, max= 4, avg= 1.75, stdev= 1.50, samples=4 write: IOPS=1, BW=1209KiB/s (1238kB/s)(5120KiB/4236msec); 0 zone resets clat (msec): min=40, max=647, avg=234.79, stdev=255.86 lat (msec): min=40, max=647, avg=234.88, stdev=255.86 clat percentiles (msec): | 1.00th=[ 41], 5.00th=[ 41], 10.00th=[ 41], 20.00th=[ 41], | 30.00th=[ 59], 40.00th=[ 59], 50.00th=[ 110], 60.00th=[ 110], | 70.00th=[ 321], 80.00th=[ 321], 90.00th=[ 651], 95.00th=[ 651], | 99.00th=[ 651], 99.50th=[ 651], 99.90th=[ 651], 99.95th=[ 651], | 99.99th=[ 651] bw ( KiB/s): min= 2048, max= 2048, per=30.52%, avg=2048.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 50=16.67%, 100=16.67%, 250=25.00%, 500=8.33%, 750=25.00% lat (msec) : 2000=8.33% cpu : usr=0.00%, sys=8.64%, ctx=89, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147343: Mon Mar 2 13:16:30 2026 read: IOPS=0, BW=479KiB/s (491kB/s)(2048KiB/4272msec) clat (msec): min=60, max=192, avg=126.68, stdev=93.23 lat (msec): min=60, max=192, avg=126.69, stdev=93.23 clat percentiles (msec): | 1.00th=[ 61], 5.00th=[ 61], 10.00th=[ 61], 20.00th=[ 61], | 30.00th=[ 61], 40.00th=[ 61], 50.00th=[ 61], 60.00th=[ 192], | 70.00th=[ 192], 80.00th=[ 192], 90.00th=[ 192], 95.00th=[ 192], | 99.00th=[ 192], 99.50th=[ 192], 99.90th=[ 192], 99.95th=[ 192], | 99.99th=[ 192] bw ( KiB/s): min= 1391, max= 2048, per=35.87%, avg=1719.50, stdev=464.57, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 write: IOPS=2, BW=2397KiB/s (2455kB/s)(10.0MiB/4272msec); 0 zone resets clat (msec): min=36, max=1509, avg=391.87, stdev=516.83 lat (msec): min=36, max=1509, avg=392.03, stdev=516.99 clat percentiles (msec): | 1.00th=[ 37], 5.00th=[ 37], 10.00th=[ 37], 20.00th=[ 59], | 30.00th=[ 66], 40.00th=[ 77], 50.00th=[ 85], 60.00th=[ 180], | 70.00th=[ 279], 80.00th=[ 498], 90.00th=[ 1133], 95.00th=[ 1502], | 99.00th=[ 1502], 99.50th=[ 1502], 99.90th=[ 1502], 99.95th=[ 1502], | 99.99th=[ 1502] bw ( KiB/s): min= 2031, max=10240, per=68.54%, avg=4599.50, stdev=3881.30, samples=4 iops : min= 1, max= 10, avg= 4.00, stdev= 4.08, samples=4 lat (msec) : 50=8.33%, 100=41.67%, 250=16.67%, 500=16.67%, 2000=16.67% cpu : usr=0.02%, sys=12.22%, ctx=96, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147345: Mon Mar 2 13:16:30 2026 read: IOPS=1, BW=1661KiB/s (1701kB/s)(6144KiB/3698msec) clat (msec): min=55, max=299, avg=205.42, stdev=97.71 lat (msec): min=55, max=299, avg=205.42, stdev=97.71 clat percentiles (msec): | 1.00th=[ 56], 5.00th=[ 56], 10.00th=[ 56], 20.00th=[ 118], | 30.00th=[ 118], 40.00th=[ 220], 50.00th=[ 220], 60.00th=[ 257], | 70.00th=[ 284], 80.00th=[ 284], 90.00th=[ 300], 95.00th=[ 300], | 99.00th=[ 300], 99.50th=[ 300], 99.90th=[ 300], 99.95th=[ 300], | 99.99th=[ 300] bw ( KiB/s): min= 1996, max= 6144, per=70.72%, avg=3390.33, stdev=2384.81, samples=3 iops : min= 1, max= 6, avg= 2.67, stdev= 2.89, samples=3 write: IOPS=1, BW=1661KiB/s (1701kB/s)(6144KiB/3698msec); 0 zone resets clat (msec): min=98, max=883, avg=402.40, stdev=339.27 lat (msec): min=98, max=883, avg=402.49, stdev=339.28 clat percentiles (msec): | 1.00th=[ 99], 5.00th=[ 99], 10.00th=[ 99], 20.00th=[ 186], | 30.00th=[ 186], 40.00th=[ 220], 50.00th=[ 220], 60.00th=[ 245], | 70.00th=[ 785], 80.00th=[ 785], 90.00th=[ 885], 95.00th=[ 885], | 99.00th=[ 885], 99.50th=[ 885], 99.90th=[ 885], 99.95th=[ 885], | 99.99th=[ 885] bw ( KiB/s): min= 1996, max= 2805, per=33.11%, avg=2222.00, stdev=389.33, samples=4 iops : min= 1, max= 2, avg= 1.50, stdev= 0.58, samples=4 lat (msec) : 100=16.67%, 250=41.67%, 500=25.00%, 1000=16.67% cpu : usr=0.03%, sys=10.41%, ctx=208, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147347: Mon Mar 2 13:16:30 2026 read: IOPS=1, BW=1440KiB/s (1475kB/s)(5120KiB/3555msec) clat (msec): min=79, max=378, avg=233.18, stdev=138.69 lat (msec): min=79, max=378, avg=233.18, stdev=138.69 clat percentiles (msec): | 1.00th=[ 80], 5.00th=[ 80], 10.00th=[ 80], 20.00th=[ 80], | 30.00th=[ 116], 40.00th=[ 116], 50.00th=[ 224], 60.00th=[ 224], | 70.00th=[ 368], 80.00th=[ 368], 90.00th=[ 380], 95.00th=[ 380], | 99.00th=[ 380], 99.50th=[ 380], 99.90th=[ 380], 99.95th=[ 380], | 99.99th=[ 380] bw ( KiB/s): min= 2031, max= 4096, per=56.78%, avg=2722.00, stdev=1189.93, samples=3 iops : min= 1, max= 4, avg= 2.00, stdev= 1.73, samples=3 write: IOPS=1, BW=2016KiB/s (2065kB/s)(7168KiB/3555msec); 0 zone resets clat (msec): min=118, max=824, avg=329.14, stdev=250.26 lat (msec): min=118, max=824, avg=329.24, stdev=250.26 clat percentiles (msec): | 1.00th=[ 118], 5.00th=[ 118], 10.00th=[ 118], 20.00th=[ 136], | 30.00th=[ 234], 40.00th=[ 234], 50.00th=[ 245], 60.00th=[ 255], | 70.00th=[ 255], 80.00th=[ 493], 90.00th=[ 827], 95.00th=[ 827], | 99.00th=[ 827], 99.50th=[ 827], 99.90th=[ 827], 99.95th=[ 827], | 99.99th=[ 827] bw ( KiB/s): min= 1406, max= 4096, per=34.44%, avg=2311.20, stdev=1032.42, samples=5 iops : min= 1, max= 4, avg= 1.60, stdev= 1.34, samples=5 lat (msec) : 100=8.33%, 250=50.00%, 500=33.33%, 1000=8.33% cpu : usr=0.00%, sys=13.53%, ctx=530, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4794KiB/s (4909kB/s), 479KiB/s-1692KiB/s (491kB/s-1733kB/s), io=20.0MiB (20.0MB), run=3555-4272msec WRITE: bw=6712KiB/s (6873kB/s), 1209KiB/s-2397KiB/s (1238kB/s-2455kB/s), io=28.0MiB (29.4MB), run=3555-4272msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=147356: Mon Mar 2 13:16:38 2026 read: IOPS=1, BW=6169KiB/s (6317kB/s)(12.0MiB/1992msec) clat (msec): min=370, max=955, avg=649.55, stdev=293.49 lat (msec): min=370, max=955, avg=649.56, stdev=293.49 clat percentiles (msec): | 1.00th=[ 372], 5.00th=[ 372], 10.00th=[ 372], 20.00th=[ 372], | 30.00th=[ 372], 40.00th=[ 625], 50.00th=[ 625], 60.00th=[ 625], | 70.00th=[ 953], 80.00th=[ 953], 90.00th=[ 953], 95.00th=[ 953], | 99.00th=[ 953], 99.50th=[ 953], 99.90th=[ 953], 99.95th=[ 953], | 99.99th=[ 953] bw ( KiB/s): min= 8192, max= 8192, per=100.00%, avg=8192.00, stdev= 0.00, samples=2 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 750=33.33%, 1000=33.33% cpu : usr=0.00%, sys=15.62%, ctx=226, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147357: Mon Mar 2 13:16:38 2026 read: IOPS=0, BW=1958KiB/s (2005kB/s)(4096KiB/2092msec) clat (nsec): min=632616k, max=632616k, avg=632616012.00, stdev= 0.00 lat (nsec): min=632617k, max=632617k, avg=632617317.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 634], 5.00th=[ 634], 10.00th=[ 634], 20.00th=[ 634], | 30.00th=[ 634], 40.00th=[ 634], 50.00th=[ 634], 60.00th=[ 634], | 70.00th=[ 634], 80.00th=[ 634], 90.00th=[ 634], 95.00th=[ 634], | 99.00th=[ 634], 99.50th=[ 634], 99.90th=[ 634], 99.95th=[ 634], | 99.99th=[ 634] bw ( KiB/s): min= 8192, max= 8192, per=100.00%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 write: IOPS=0, BW=3916KiB/s (4010kB/s)(8192KiB/2092msec); 0 zone resets clat (msec): min=342, max=1082, avg=712.93, stdev=523.21 lat (msec): min=343, max=1083, avg=713.22, stdev=523.19 clat percentiles (msec): | 1.00th=[ 342], 5.00th=[ 342], 10.00th=[ 342], 20.00th=[ 342], | 30.00th=[ 342], 40.00th=[ 342], 50.00th=[ 342], 60.00th=[ 1083], | 70.00th=[ 1083], 80.00th=[ 1083], 90.00th=[ 1083], 95.00th=[ 1083], | 99.00th=[ 1083], 99.50th=[ 1083], 99.90th=[ 1083], 99.95th=[ 1083], | 99.99th=[ 1083] bw ( KiB/s): min= 8192, max= 8192, per=52.30%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.00%, sys=13.87%, ctx=69, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147358: Mon Mar 2 13:16:38 2026 write: IOPS=1, BW=7777KiB/s (7964kB/s)(12.0MiB/1580msec); 0 zone resets clat (msec): min=261, max=955, avg=515.39, stdev=383.01 lat (msec): min=261, max=956, avg=515.72, stdev=383.06 clat percentiles (msec): | 1.00th=[ 262], 5.00th=[ 262], 10.00th=[ 262], 20.00th=[ 262], | 30.00th=[ 262], 40.00th=[ 330], 50.00th=[ 330], 60.00th=[ 330], | 70.00th=[ 953], 80.00th=[ 953], 90.00th=[ 953], 95.00th=[ 953], | 99.00th=[ 953], 99.50th=[ 953], 99.90th=[ 953], 99.95th=[ 953], | 99.99th=[ 953] bw ( KiB/s): min= 7846, max= 8192, per=51.20%, avg=8019.00, stdev=244.66, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 500=66.67%, 1000=33.33% cpu : usr=0.06%, sys=16.72%, ctx=73, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147359: Mon Mar 2 13:16:38 2026 write: IOPS=1, BW=6872KiB/s (7037kB/s)(12.0MiB/1788msec); 0 zone resets clat (msec): min=246, max=948, avg=581.59, stdev=352.09 lat (msec): min=246, max=949, avg=581.99, stdev=352.13 clat percentiles (msec): | 1.00th=[ 247], 5.00th=[ 247], 10.00th=[ 247], 20.00th=[ 247], | 30.00th=[ 247], 40.00th=[ 550], 50.00th=[ 550], 60.00th=[ 550], | 70.00th=[ 953], 80.00th=[ 953], 90.00th=[ 953], 95.00th=[ 953], | 99.00th=[ 953], 99.50th=[ 953], 99.90th=[ 953], 99.95th=[ 953], | 99.99th=[ 953] bw ( KiB/s): min= 8192, max= 8192, per=52.30%, avg=8192.00, stdev= 0.00, samples=2 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=2 lat (msec) : 250=33.33%, 750=33.33%, 1000=33.33% cpu : usr=0.00%, sys=17.18%, ctx=62, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=7832KiB/s (8020kB/s), 1958KiB/s-6169KiB/s (2005kB/s-6317kB/s), io=16.0MiB (16.8MB), run=1992-2092msec WRITE: bw=15.3MiB/s (16.0MB/s), 3916KiB/s-7777KiB/s (4010kB/s-7964kB/s), io=32.0MiB (33.6MB), run=1580-2092msec rand-rw: (groupid=0, jobs=1): err= 0: pid=147360: Mon Mar 2 13:16:38 2026 read: IOPS=2, BW=8678KiB/s (8886kB/s)(12.0MiB/1416msec) clat (msec): min=455, max=465, avg=458.89, stdev= 5.67 lat (msec): min=455, max=465, avg=458.89, stdev= 5.68 clat percentiles (msec): | 1.00th=[ 456], 5.00th=[ 456], 10.00th=[ 456], 20.00th=[ 456], | 30.00th=[ 456], 40.00th=[ 456], 50.00th=[ 456], 60.00th=[ 456], | 70.00th=[ 464], 80.00th=[ 464], 90.00th=[ 464], 95.00th=[ 464], | 99.00th=[ 464], 99.50th=[ 464], 99.90th=[ 464], 99.95th=[ 464], | 99.99th=[ 464] bw ( KiB/s): min= 5826, max= 8192, per=94.03%, avg=7009.00, stdev=1673.01, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 500=100.00% cpu : usr=0.00%, sys=49.19%, ctx=2634, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147361: Mon Mar 2 13:16:38 2026 read: IOPS=0, BW=1864KiB/s (1908kB/s)(4096KiB/2198msec) clat (nsec): min=516616k, max=516616k, avg=516615750.00, stdev= 0.00 lat (nsec): min=516619k, max=516619k, avg=516618735.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 518], 5.00th=[ 518], 10.00th=[ 518], 20.00th=[ 518], | 30.00th=[ 518], 40.00th=[ 518], 50.00th=[ 518], 60.00th=[ 518], | 70.00th=[ 518], 80.00th=[ 518], 90.00th=[ 518], 95.00th=[ 518], | 99.00th=[ 518], 99.50th=[ 518], 99.90th=[ 518], 99.95th=[ 518], | 99.99th=[ 518] bw ( KiB/s): min= 5610, max= 5610, per=75.26%, avg=5610.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=3727KiB/s (3816kB/s)(8192KiB/2198msec); 0 zone resets clat (msec): min=145, max=1520, avg=832.93, stdev=972.38 lat (msec): min=145, max=1520, avg=833.35, stdev=972.48 clat percentiles (msec): | 1.00th=[ 146], 5.00th=[ 146], 10.00th=[ 146], 20.00th=[ 146], | 30.00th=[ 146], 40.00th=[ 146], 50.00th=[ 146], 60.00th=[ 1519], | 70.00th=[ 1519], 80.00th=[ 1519], 90.00th=[ 1519], 95.00th=[ 1519], | 99.00th=[ 1519], 99.50th=[ 1519], 99.90th=[ 1519], 99.95th=[ 1519], | 99.99th=[ 1519] lat (msec) : 250=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.09%, sys=19.98%, ctx=965, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147362: Mon Mar 2 13:16:38 2026 write: IOPS=1, BW=5676KiB/s (5812kB/s)(12.0MiB/2165msec); 0 zone resets clat (msec): min=347, max=1110, avg=713.89, stdev=382.53 lat (msec): min=347, max=1110, avg=714.12, stdev=382.58 clat percentiles (msec): | 1.00th=[ 347], 5.00th=[ 347], 10.00th=[ 347], 20.00th=[ 347], | 30.00th=[ 347], 40.00th=[ 684], 50.00th=[ 684], 60.00th=[ 684], | 70.00th=[ 1116], 80.00th=[ 1116], 90.00th=[ 1116], 95.00th=[ 1116], | 99.00th=[ 1116], 99.50th=[ 1116], 99.90th=[ 1116], 99.95th=[ 1116], | 99.99th=[ 1116] bw ( KiB/s): min= 8192, max= 8192, per=54.95%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.05%, sys=14.05%, ctx=78, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147363: Mon Mar 2 13:16:38 2026 write: IOPS=2, BW=9352KiB/s (9576kB/s)(12.0MiB/1314msec); 0 zone resets clat (msec): min=203, max=551, avg=432.08, stdev=197.94 lat (msec): min=203, max=551, avg=432.43, stdev=198.01 clat percentiles (msec): | 1.00th=[ 205], 5.00th=[ 205], 10.00th=[ 205], 20.00th=[ 205], | 30.00th=[ 205], 40.00th=[ 542], 50.00th=[ 542], 60.00th=[ 542], | 70.00th=[ 550], 80.00th=[ 550], 90.00th=[ 550], 95.00th=[ 550], | 99.00th=[ 550], 99.50th=[ 550], 99.90th=[ 550], 99.95th=[ 550], | 99.99th=[ 550] bw ( KiB/s): min= 5720, max= 8192, per=46.66%, avg=6956.00, stdev=1747.97, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 250=33.33%, 750=66.67% cpu : usr=0.08%, sys=29.25%, ctx=132, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=7454KiB/s (7633kB/s), 1864KiB/s-8678KiB/s (1908kB/s-8886kB/s), io=16.0MiB (16.8MB), run=1416-2198msec WRITE: bw=14.6MiB/s (15.3MB/s), 3727KiB/s-9352KiB/s (3816kB/s-9576kB/s), io=32.0MiB (33.6MB), run=1314-2198msec