== sanity test 398b: DIO and buffer IO race ============== 11:19:45 (1776871185) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 2.61997 s, 19.2 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=155334: Wed Apr 22 11:20:41 2026 read: IOPS=31, BW=127KiB/s (130kB/s)(5992KiB/47042msec) clat (usec): min=30, max=624108, avg=15829.37, stdev=18997.98 lat (usec): min=31, max=624108, avg=15830.10, stdev=18998.06 clat percentiles (usec): | 1.00th=[ 53], 5.00th=[ 113], 10.00th=[ 6194], 20.00th=[ 8225], | 30.00th=[ 9765], 40.00th=[ 11338], 50.00th=[ 13304], 60.00th=[ 15533], | 70.00th=[ 18220], 80.00th=[ 21890], 90.00th=[ 27657], 95.00th=[ 33424], | 99.00th=[ 53216], 99.50th=[ 74974], 99.90th=[120062], 99.95th=[624952], | 99.99th=[624952] bw ( KiB/s): min= 6, max= 216, per=24.86%, avg=126.81, stdev=37.88, samples=93 iops : min= 1, max= 54, avg=31.41, stdev= 9.58, samples=93 write: IOPS=33, BW=134KiB/s (137kB/s)(6296KiB/47042msec); 0 zone resets clat (usec): min=598, max=109572, avg=14686.82, stdev=13317.18 lat (usec): min=599, max=109573, avg=14687.56, stdev=13317.20 clat percentiles (usec): | 1.00th=[ 889], 5.00th=[ 1876], 10.00th=[ 2442], 20.00th=[ 3228], | 30.00th=[ 4883], 40.00th=[ 8586], 50.00th=[ 11469], 60.00th=[ 14877], | 70.00th=[ 18744], 80.00th=[ 23462], 90.00th=[ 31851], 95.00th=[ 39584], | 99.00th=[ 57934], 99.50th=[ 76022], 99.90th=[107480], 99.95th=[109577], | 99.99th=[109577] bw ( KiB/s): min= 56, max= 216, per=25.11%, avg=134.10, stdev=38.44, samples=92 iops : min= 14, max= 54, avg=33.24, stdev= 9.61, samples=92 lat (usec) : 50=0.39%, 100=1.53%, 250=1.30%, 750=0.23%, 1000=0.59% lat (msec) : 2=2.18%, 4=9.73%, 10=22.20%, 20=35.81%, 50=24.54% lat (msec) : 100=1.30%, 250=0.16%, 750=0.03% cpu : usr=0.10%, sys=25.25%, ctx=8114, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=155335: Wed Apr 22 11:20:41 2026 read: IOPS=31, BW=127KiB/s (130kB/s)(5940KiB/46875msec) clat (usec): min=26, max=81617, avg=15110.30, stdev=9652.20 lat (usec): min=26, max=81618, avg=15110.94, stdev=9652.26 clat percentiles (usec): | 1.00th=[ 64], 5.00th=[ 130], 10.00th=[ 6456], 20.00th=[ 7963], | 30.00th=[ 9503], 40.00th=[11207], 50.00th=[13042], 60.00th=[15533], | 70.00th=[17695], 80.00th=[22152], 90.00th=[27132], 95.00th=[32113], | 99.00th=[47449], 99.50th=[56361], 99.90th=[78119], 99.95th=[81265], | 99.99th=[81265] bw ( KiB/s): min= 6, max= 207, per=24.79%, avg=126.45, stdev=34.69, samples=93 iops : min= 1, max= 51, avg=31.32, stdev= 8.69, samples=93 write: IOPS=33, BW=135KiB/s (139kB/s)(6348KiB/46875msec); 0 zone resets clat (usec): min=689, max=617920, avg=15259.64, stdev=20383.69 lat (usec): min=689, max=617921, avg=15260.70, stdev=20383.63 clat percentiles (usec): | 1.00th=[ 799], 5.00th=[ 1745], 10.00th=[ 2474], 20.00th=[ 3195], | 30.00th=[ 5014], 40.00th=[ 8586], 50.00th=[ 11863], 60.00th=[ 15139], | 70.00th=[ 18482], 80.00th=[ 23725], 90.00th=[ 32113], 95.00th=[ 40109], | 99.00th=[ 63701], 99.50th=[ 73925], 99.90th=[127402], 99.95th=[616563], | 99.99th=[616563] bw ( KiB/s): min= 55, max= 232, per=25.50%, avg=136.20, stdev=37.63, samples=92 iops : min= 13, max= 58, avg=33.76, stdev= 9.50, samples=92 lat (usec) : 50=0.33%, 100=1.30%, 250=1.33%, 500=0.03%, 750=0.36% lat (usec) : 1000=0.72% lat (msec) : 2=2.31%, 4=9.90%, 10=22.66%, 20=35.45%, 50=24.02% lat (msec) : 100=1.50%, 250=0.07%, 750=0.03% cpu : usr=0.08%, sys=25.59%, ctx=8036, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=155336: Wed Apr 22 11:20:41 2026 read: IOPS=32, BW=128KiB/s (132kB/s)(6028KiB/46918msec) clat (usec): min=27, max=175766, avg=15383.38, stdev=11783.06 lat (usec): min=28, max=175767, avg=15384.10, stdev=11783.10 clat percentiles (usec): | 1.00th=[ 54], 5.00th=[ 118], 10.00th=[ 6456], 20.00th=[ 8029], | 30.00th=[ 9372], 40.00th=[ 10814], 50.00th=[ 12649], 60.00th=[ 15008], | 70.00th=[ 17957], 80.00th=[ 22414], 90.00th=[ 28181], 95.00th=[ 33424], | 99.00th=[ 47973], 99.50th=[ 67634], 99.90th=[158335], 99.95th=[175113], | 99.99th=[175113] bw ( KiB/s): min= 55, max= 215, per=25.43%, avg=129.70, stdev=36.04, samples=92 iops : min= 13, max= 53, avg=32.13, stdev= 9.06, samples=92 write: IOPS=33, BW=133KiB/s (137kB/s)(6260KiB/46918msec); 0 zone resets clat (usec): min=607, max=619874, avg=15026.19, stdev=20144.62 lat (usec): min=607, max=619874, avg=15028.07, stdev=20144.99 clat percentiles (usec): | 1.00th=[ 857], 5.00th=[ 1663], 10.00th=[ 2376], 20.00th=[ 3359], | 30.00th=[ 4948], 40.00th=[ 8356], 50.00th=[ 11338], 60.00th=[ 15139], | 70.00th=[ 19268], 80.00th=[ 23987], 90.00th=[ 31065], 95.00th=[ 39060], | 99.00th=[ 54789], 99.50th=[ 60556], 99.90th=[128451], 99.95th=[616563], | 99.99th=[616563] bw ( KiB/s): min= 13, max= 271, per=24.91%, avg=133.03, stdev=41.83, samples=93 iops : min= 3, max= 67, avg=32.98, stdev=10.48, samples=93 lat (usec) : 50=0.42%, 100=1.37%, 250=1.37%, 500=0.13%, 750=0.26% lat (usec) : 1000=0.62% lat (msec) : 2=2.41%, 4=9.80%, 10=23.93%, 20=32.98%, 50=25.42% lat (msec) : 100=1.04%, 250=0.23%, 750=0.03% cpu : usr=0.10%, sys=25.19%, ctx=8013, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=155337: Wed Apr 22 11:20:41 2026 read: IOPS=32, BW=129KiB/s (132kB/s)(6052KiB/47046msec) clat (usec): min=28, max=80645, avg=14904.02, stdev=9788.56 lat (usec): min=28, max=80645, avg=14904.64, stdev=9788.60 clat percentiles (usec): | 1.00th=[ 54], 5.00th=[ 115], 10.00th=[ 5932], 20.00th=[ 7898], | 30.00th=[ 9372], 40.00th=[10814], 50.00th=[12911], 60.00th=[15401], | 70.00th=[17957], 80.00th=[21627], 90.00th=[27132], 95.00th=[32900], | 99.00th=[46400], 99.50th=[53740], 99.90th=[78119], 99.95th=[80217], | 99.99th=[80217] bw ( KiB/s): min= 32, max= 224, per=25.30%, avg=129.04, stdev=37.21, samples=92 iops : min= 8, max= 56, avg=31.98, stdev= 9.33, samples=92 write: IOPS=33, BW=133KiB/s (136kB/s)(6236KiB/47046msec); 0 zone resets clat (usec): min=641, max=648782, avg=15564.51, stdev=22050.30 lat (usec): min=642, max=648784, avg=15565.32, stdev=22050.35 clat percentiles (usec): | 1.00th=[ 881], 5.00th=[ 1713], 10.00th=[ 2409], 20.00th=[ 3163], | 30.00th=[ 4752], 40.00th=[ 8160], 50.00th=[ 11338], 60.00th=[ 14746], | 70.00th=[ 18744], 80.00th=[ 24511], 90.00th=[ 33424], 95.00th=[ 41681], | 99.00th=[ 63177], 99.50th=[ 93848], 99.90th=[164627], 99.95th=[650118], | 99.99th=[650118] bw ( KiB/s): min= 56, max= 256, per=24.98%, avg=133.41, stdev=42.78, samples=92 iops : min= 14, max= 64, avg=33.07, stdev=10.79, samples=92 lat (usec) : 50=0.49%, 100=1.53%, 250=1.66%, 500=0.03%, 750=0.29% lat (usec) : 1000=0.52% lat (msec) : 2=2.70%, 4=9.70%, 10=23.27%, 20=34.21%, 50=23.93% lat (msec) : 100=1.46%, 250=0.16%, 750=0.03% cpu : usr=0.10%, sys=25.15%, ctx=8078, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=510KiB/s (523kB/s), 127KiB/s-129KiB/s (130kB/s-132kB/s), io=23.4MiB (24.6MB), run=46875-47046msec WRITE: bw=534KiB/s (547kB/s), 133KiB/s-135KiB/s (136kB/s-139kB/s), io=24.6MiB (25.7MB), run=46875-47046msec fio: pid=155342, err=5/file:backend.c:481, func=full resid, error=Input/output error rand-rw: (groupid=0, jobs=1): err= 0: pid=155339: Wed Apr 22 11:21:04 2026 read: IOPS=21, BW=85.7KiB/s (87.8kB/s)(5992KiB/69899msec) clat (msec): min=2, max=626, avg=13.19, stdev=21.30 lat (msec): min=2, max=626, avg=13.20, stdev=21.30 clat percentiles (msec): | 1.00th=[ 3], 5.00th=[ 4], 10.00th=[ 4], 20.00th=[ 5], | 30.00th=[ 5], 40.00th=[ 6], 50.00th=[ 8], 60.00th=[ 9], | 70.00th=[ 14], 80.00th=[ 19], 90.00th=[ 31], 95.00th=[ 42], | 99.00th=[ 74], 99.50th=[ 89], 99.90th=[ 134], 99.95th=[ 625], | 99.99th=[ 625] bw ( KiB/s): min= 7, max= 248, per=28.31%, avg=86.33, stdev=58.88, samples=138 iops : min= 1, max= 62, avg=21.38, stdev=14.85, samples=138 write: IOPS=22, BW=90.1KiB/s (92.2kB/s)(6296KiB/69899msec); 0 zone resets clat (msec): min=10, max=176, avg=31.77, stdev=19.54 lat (msec): min=10, max=176, avg=31.77, stdev=19.54 clat percentiles (msec): | 1.00th=[ 13], 5.00th=[ 14], 10.00th=[ 15], 20.00th=[ 17], | 30.00th=[ 19], 40.00th=[ 21], 50.00th=[ 23], 60.00th=[ 29], | 70.00th=[ 40], 80.00th=[ 49], 90.00th=[ 62], 95.00th=[ 69], | 99.00th=[ 89], 99.50th=[ 105], 99.90th=[ 132], 99.95th=[ 178], | 99.99th=[ 178] bw ( KiB/s): min= 31, max= 200, per=28.39%, avg=90.57, stdev=55.12, samples=138 iops : min= 7, max= 50, avg=22.43, stdev=13.94, samples=138 lat (msec) : 4=9.28%, 10=21.78%, 20=28.97%, 50=28.97%, 100=10.45% lat (msec) : 250=0.52%, 750=0.03% cpu : usr=0.08%, sys=8.31%, ctx=5944, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=155340: Wed Apr 22 11:21:04 2026 read: IOPS=21, BW=84.6KiB/s (86.6kB/s)(5940KiB/70236msec) clat (msec): min=2, max=614, avg=13.50, stdev=20.98 lat (msec): min=2, max=614, avg=13.50, stdev=20.98 clat percentiles (msec): | 1.00th=[ 3], 5.00th=[ 4], 10.00th=[ 4], 20.00th=[ 5], | 30.00th=[ 5], 40.00th=[ 7], 50.00th=[ 8], 60.00th=[ 10], | 70.00th=[ 14], 80.00th=[ 21], 90.00th=[ 32], 95.00th=[ 41], | 99.00th=[ 61], 99.50th=[ 89], 99.90th=[ 142], 99.95th=[ 617], | 99.99th=[ 617] bw ( KiB/s): min= 15, max= 264, per=27.75%, avg=84.65, stdev=59.41, samples=138 iops : min= 3, max= 66, avg=20.96, stdev=14.99, samples=138 write: IOPS=22, BW=90.4KiB/s (92.6kB/s)(6348KiB/70236msec); 0 zone resets clat (msec): min=10, max=187, avg=31.55, stdev=19.97 lat (msec): min=10, max=187, avg=31.55, stdev=19.97 clat percentiles (msec): | 1.00th=[ 12], 5.00th=[ 14], 10.00th=[ 15], 20.00th=[ 17], | 30.00th=[ 18], 40.00th=[ 20], 50.00th=[ 23], 60.00th=[ 29], | 70.00th=[ 39], 80.00th=[ 48], 90.00th=[ 59], 95.00th=[ 70], | 99.00th=[ 100], 99.50th=[ 106], 99.90th=[ 144], 99.95th=[ 188], | 99.99th=[ 188] bw ( KiB/s): min= 31, max= 192, per=28.23%, avg=90.04, stdev=54.73, samples=138 iops : min= 7, max= 48, avg=22.30, stdev=13.83, samples=138 lat (msec) : 4=9.18%, 10=21.48%, 20=28.71%, 50=30.70%, 100=9.24% lat (msec) : 250=0.65%, 750=0.03% cpu : usr=0.08%, sys=8.26%, ctx=5939, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=155341: Wed Apr 22 11:21:04 2026 read: IOPS=21, BW=86.1KiB/s (88.1kB/s)(6028KiB/70028msec) clat (msec): min=2, max=116, avg=13.00, stdev=13.16 lat (msec): min=2, max=116, avg=13.00, stdev=13.16 clat percentiles (msec): | 1.00th=[ 3], 5.00th=[ 4], 10.00th=[ 4], 20.00th=[ 5], | 30.00th=[ 5], 40.00th=[ 7], 50.00th=[ 8], 60.00th=[ 10], | 70.00th=[ 14], 80.00th=[ 22], 90.00th=[ 31], 95.00th=[ 41], | 99.00th=[ 62], 99.50th=[ 73], 99.90th=[ 95], 99.95th=[ 117], | 99.99th=[ 117] bw ( KiB/s): min= 15, max= 248, per=28.32%, avg=86.38, stdev=56.56, samples=138 iops : min= 3, max= 62, avg=21.39, stdev=14.26, samples=138 write: IOPS=22, BW=89.4KiB/s (91.5kB/s)(6260KiB/70028msec); 0 zone resets clat (msec): min=11, max=625, avg=32.15, stdev=25.60 lat (msec): min=11, max=625, avg=32.15, stdev=25.60 clat percentiles (msec): | 1.00th=[ 13], 5.00th=[ 14], 10.00th=[ 15], 20.00th=[ 17], | 30.00th=[ 19], 40.00th=[ 21], 50.00th=[ 23], 60.00th=[ 28], | 70.00th=[ 37], 80.00th=[ 48], 90.00th=[ 61], 95.00th=[ 72], | 99.00th=[ 104], 99.50th=[ 131], 99.90th=[ 190], 99.95th=[ 625], | 99.99th=[ 625] bw ( KiB/s): min= 23, max= 216, per=28.10%, avg=89.64, stdev=55.40, samples=138 iops : min= 5, max= 54, avg=22.20, stdev=14.00, samples=138 lat (msec) : 4=8.82%, 10=21.45%, 20=28.65%, 50=30.86%, 100=9.57% lat (msec) : 250=0.62%, 750=0.03% cpu : usr=0.08%, sys=8.31%, ctx=5877, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 5 (file:backend.c:481, func=full resid, error=Input/output error): pid=155342: Wed Apr 22 11:21:04 2026 read: IOPS=16, BW=64.2KiB/s (65.7kB/s)(3480KiB/54217msec) clat (msec): min=2, max=141, avg=17.99, stdev=16.11 lat (msec): min=2, max=141, avg=17.99, stdev=16.11 clat percentiles (msec): | 1.00th=[ 3], 5.00th=[ 4], 10.00th=[ 4], 20.00th=[ 5], | 30.00th=[ 7], 40.00th=[ 11], 50.00th=[ 14], 60.00th=[ 17], | 70.00th=[ 22], 80.00th=[ 30], 90.00th=[ 40], 95.00th=[ 48], | 99.00th=[ 67], 99.50th=[ 96], 99.90th=[ 142], 99.95th=[ 142], | 99.99th=[ 142] bw ( KiB/s): min= 7, max= 280, per=20.87%, avg=63.64, stdev=43.34, samples=106 iops : min= 1, max= 70, avg=15.64, stdev=10.93, samples=106 write: IOPS=16, BW=65.7KiB/s (67.2kB/s)(3560KiB/54217msec); 0 zone resets clat (msec): min=12, max=628, avg=43.20, stdev=29.25 lat (msec): min=12, max=628, avg=43.20, stdev=29.25 clat percentiles (msec): | 1.00th=[ 14], 5.00th=[ 17], 10.00th=[ 18], 20.00th=[ 23], | 30.00th=[ 29], 40.00th=[ 35], 50.00th=[ 42], 60.00th=[ 46], | 70.00th=[ 52], 80.00th=[ 58], 90.00th=[ 68], 95.00th=[ 80], | 99.00th=[ 128], 99.50th=[ 140], 99.90th=[ 625], 99.95th=[ 625], | 99.99th=[ 625] bw ( KiB/s): min= 31, max= 184, per=20.47%, avg=65.30, stdev=35.45, samples=106 iops : min= 7, max= 46, avg=16.06, stdev= 8.95, samples=106 lat (msec) : 4=5.51%, 10=13.97%, 20=20.73%, 50=41.28%, 100=17.26% lat (msec) : 250=1.14%, 750=0.06% cpu : usr=0.04%, sys=7.78%, ctx=2944, majf=0, minf=20 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=871,890,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=305KiB/s (313kB/s), 64.2KiB/s-86.1KiB/s (65.7kB/s-88.1kB/s), io=20.9MiB (21.0MB), run=54217-70236msec WRITE: bw=320KiB/s (328kB/s), 65.7KiB/s-90.4KiB/s (67.2kB/s-92.6kB/s), io=21.9MiB (23.0MB), run=54217-70236msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=155369: Wed Apr 22 11:21:21 2026 read: IOPS=31, BW=502KiB/s (514kB/s)(5920KiB/11799msec) clat (usec): min=32, max=123766, avg=15805.97, stdev=11333.78 lat (usec): min=33, max=123766, avg=15806.52, stdev=11333.79 clat percentiles (usec): | 1.00th=[ 76], 5.00th=[ 100], 10.00th=[ 198], 20.00th=[ 8848], | 30.00th=[ 10552], 40.00th=[ 12256], 50.00th=[ 14484], 60.00th=[ 16712], | 70.00th=[ 19006], 80.00th=[ 21627], 90.00th=[ 27132], 95.00th=[ 33817], | 99.00th=[ 50594], 99.50th=[ 70779], 99.90th=[124257], 99.95th=[124257], | 99.99th=[124257] bw ( KiB/s): min= 218, max= 800, per=24.84%, avg=496.39, stdev=172.54, samples=23 iops : min= 13, max= 50, avg=30.52, stdev=10.91, samples=23 write: IOPS=33, BW=540KiB/s (553kB/s)(6368KiB/11799msec); 0 zone resets clat (usec): min=1046, max=70251, avg=14834.22, stdev=10748.32 lat (usec): min=1047, max=70252, avg=14835.29, stdev=10748.36 clat percentiles (usec): | 1.00th=[ 2073], 5.00th=[ 3195], 10.00th=[ 3982], 20.00th=[ 5145], | 30.00th=[ 7701], 40.00th=[10159], 50.00th=[11994], 60.00th=[15401], | 70.00th=[18744], 80.00th=[21890], 90.00th=[29230], 95.00th=[35390], | 99.00th=[47449], 99.50th=[69731], 99.90th=[69731], 99.95th=[69731], | 99.99th=[69731] bw ( KiB/s): min= 287, max= 800, per=25.56%, avg=537.35, stdev=125.28, samples=23 iops : min= 17, max= 50, avg=33.13, stdev= 8.01, samples=23 lat (usec) : 50=0.26%, 100=2.21%, 250=2.73% lat (msec) : 2=0.39%, 4=5.21%, 10=21.88%, 20=41.54%, 50=24.87% lat (msec) : 100=0.78%, 250=0.13% cpu : usr=0.08%, sys=31.13%, ctx=2551, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=155370: Wed Apr 22 11:21:21 2026 read: IOPS=30, BW=484KiB/s (495kB/s)(5744KiB/11874msec) clat (usec): min=46, max=77847, avg=16662.16, stdev=10598.07 lat (usec): min=46, max=77848, avg=16662.77, stdev=10598.12 clat percentiles (usec): | 1.00th=[ 60], 5.00th=[ 123], 10.00th=[ 4490], 20.00th=[ 9110], | 30.00th=[11338], 40.00th=[13304], 50.00th=[15270], 60.00th=[17433], | 70.00th=[20317], 80.00th=[23725], 90.00th=[28181], 95.00th=[33817], | 99.00th=[53740], 99.50th=[58459], 99.90th=[78119], 99.95th=[78119], | 99.99th=[78119] bw ( KiB/s): min= 189, max= 736, per=24.08%, avg=481.09, stdev=156.28, samples=23 iops : min= 11, max= 46, avg=29.61, stdev= 9.91, samples=23 write: IOPS=34, BW=551KiB/s (564kB/s)(6544KiB/11874msec); 0 zone resets clat (usec): min=1309, max=64519, avg=14309.37, stdev=10866.65 lat (usec): min=1310, max=64520, avg=14310.37, stdev=10866.76 clat percentiles (usec): | 1.00th=[ 2024], 5.00th=[ 3326], 10.00th=[ 3818], 20.00th=[ 4686], | 30.00th=[ 6652], 40.00th=[ 9110], 50.00th=[11338], 60.00th=[13698], | 70.00th=[17433], 80.00th=[22676], 90.00th=[29492], 95.00th=[35390], | 99.00th=[46924], 99.50th=[52691], 99.90th=[64750], 99.95th=[64750], | 99.99th=[64750] bw ( KiB/s): min= 223, max= 768, per=25.77%, avg=541.65, stdev=171.02, samples=23 iops : min= 13, max= 48, avg=33.39, stdev=10.84, samples=23 lat (usec) : 50=0.13%, 100=1.17%, 250=2.86% lat (msec) : 2=0.65%, 4=6.51%, 10=23.57%, 20=37.37%, 50=26.69% lat (msec) : 100=1.04% cpu : usr=0.13%, sys=30.82%, ctx=2519, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=155371: Wed Apr 22 11:21:21 2026 read: IOPS=33, BW=536KiB/s (549kB/s)(6256KiB/11679msec) clat (usec): min=47, max=88726, avg=16329.29, stdev=11035.79 lat (usec): min=47, max=88727, avg=16329.92, stdev=11035.82 clat percentiles (usec): | 1.00th=[ 75], 5.00th=[ 105], 10.00th=[ 347], 20.00th=[ 9503], | 30.00th=[11469], 40.00th=[12780], 50.00th=[14746], 60.00th=[16909], | 70.00th=[19268], 80.00th=[22414], 90.00th=[27657], 95.00th=[33817], | 99.00th=[61604], 99.50th=[71828], 99.90th=[88605], 99.95th=[88605], | 99.99th=[88605] bw ( KiB/s): min= 192, max= 896, per=26.92%, avg=537.83, stdev=168.88, samples=23 iops : min= 12, max= 56, avg=33.13, stdev=10.64, samples=23 write: IOPS=32, BW=516KiB/s (529kB/s)(6032KiB/11679msec); 0 zone resets clat (usec): min=1323, max=69931, avg=13855.73, stdev=11226.75 lat (usec): min=1324, max=69932, avg=13856.83, stdev=11226.78 clat percentiles (usec): | 1.00th=[ 1549], 5.00th=[ 2835], 10.00th=[ 3556], 20.00th=[ 4555], | 30.00th=[ 6063], 40.00th=[ 8225], 50.00th=[10683], 60.00th=[13435], | 70.00th=[17433], 80.00th=[21103], 90.00th=[28705], 95.00th=[35390], | 99.00th=[53740], 99.50th=[63177], 99.90th=[69731], 99.95th=[69731], | 99.99th=[69731] bw ( KiB/s): min= 221, max= 768, per=24.36%, avg=512.04, stdev=165.83, samples=23 iops : min= 13, max= 48, avg=31.52, stdev=10.45, samples=23 lat (usec) : 50=0.13%, 100=1.95%, 250=2.99%, 500=0.26% lat (msec) : 2=0.91%, 4=5.86%, 10=23.05%, 20=39.19%, 50=24.22% lat (msec) : 100=1.43% cpu : usr=0.13%, sys=30.47%, ctx=2527, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=155372: Wed Apr 22 11:21:21 2026 read: IOPS=31, BW=503KiB/s (515kB/s)(6032KiB/11983msec) clat (usec): min=41, max=81867, avg=16149.15, stdev=11518.93 lat (usec): min=42, max=81867, avg=16149.75, stdev=11518.97 clat percentiles (usec): | 1.00th=[ 85], 5.00th=[ 111], 10.00th=[ 186], 20.00th=[ 8717], | 30.00th=[10945], 40.00th=[12256], 50.00th=[14353], 60.00th=[16712], | 70.00th=[19530], 80.00th=[22938], 90.00th=[28705], 95.00th=[36439], | 99.00th=[57934], 99.50th=[69731], 99.90th=[82314], 99.95th=[82314], | 99.99th=[82314] bw ( KiB/s): min= 223, max= 830, per=24.47%, avg=489.00, stdev=155.23, samples=23 iops : min= 13, max= 51, avg=30.09, stdev= 9.72, samples=23 write: IOPS=32, BW=522KiB/s (535kB/s)(6256KiB/11983msec); 0 zone resets clat (usec): min=887, max=71608, avg=14993.14, stdev=12088.07 lat (usec): min=888, max=71609, avg=14994.22, stdev=12088.12 clat percentiles (usec): | 1.00th=[ 1500], 5.00th=[ 3326], 10.00th=[ 3884], 20.00th=[ 4686], | 30.00th=[ 6849], 40.00th=[ 9241], 50.00th=[10945], 60.00th=[14615], | 70.00th=[17957], 80.00th=[22938], 90.00th=[30802], 95.00th=[39584], | 99.00th=[57934], 99.50th=[64226], 99.90th=[71828], 99.95th=[71828], | 99.99th=[71828] bw ( KiB/s): min= 256, max= 768, per=24.15%, avg=507.70, stdev=151.50, samples=23 iops : min= 16, max= 48, avg=31.26, stdev= 9.65, samples=23 lat (usec) : 50=0.26%, 100=1.43%, 250=3.91%, 500=0.13%, 750=0.13% lat (usec) : 1000=0.13% lat (msec) : 2=0.91%, 4=4.69%, 10=23.57%, 20=37.50%, 50=25.13% lat (msec) : 100=2.21% cpu : usr=0.10%, sys=30.05%, ctx=2640, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1999KiB/s (2047kB/s), 484KiB/s-536KiB/s (495kB/s-549kB/s), io=23.4MiB (24.5MB), run=11679-11983msec WRITE: bw=2103KiB/s (2153kB/s), 516KiB/s-551KiB/s (529kB/s-564kB/s), io=24.6MiB (25.8MB), run=11679-11983msec rand-rw: (groupid=0, jobs=1): err= 0: pid=155373: Wed Apr 22 11:21:27 2026 read: IOPS=20, BW=328KiB/s (336kB/s)(5920KiB/18059msec) clat (usec): min=2932, max=88887, avg=14098.03, stdev=12396.85 lat (usec): min=2933, max=88888, avg=14098.79, stdev=12396.79 clat percentiles (usec): | 1.00th=[ 3326], 5.00th=[ 3982], 10.00th=[ 4490], 20.00th=[ 5407], | 30.00th=[ 6521], 40.00th=[ 8094], 50.00th=[ 9896], 60.00th=[11863], | 70.00th=[14484], 80.00th=[19530], 90.00th=[31327], 95.00th=[41681], | 99.00th=[58983], 99.50th=[64226], 99.90th=[88605], 99.95th=[88605], | 99.99th=[88605] bw ( KiB/s): min= 95, max= 704, per=24.63%, avg=321.91, stdev=137.50, samples=35 iops : min= 5, max= 44, avg=19.60, stdev= 8.90, samples=35 write: IOPS=22, BW=353KiB/s (361kB/s)(6368KiB/18059msec); 0 zone resets clat (msec): min=13, max=135, avg=32.03, stdev=15.19 lat (msec): min=13, max=135, avg=32.03, stdev=15.19 clat percentiles (msec): | 1.00th=[ 15], 5.00th=[ 17], 10.00th=[ 20], 20.00th=[ 22], | 30.00th=[ 23], 40.00th=[ 26], 50.00th=[ 28], 60.00th=[ 31], | 70.00th=[ 35], 80.00th=[ 40], 90.00th=[ 53], 95.00th=[ 63], | 99.00th=[ 89], 99.50th=[ 105], 99.90th=[ 136], 99.95th=[ 136], | 99.99th=[ 136] bw ( KiB/s): min= 126, max= 704, per=25.50%, avg=350.66, stdev=150.62, samples=35 iops : min= 7, max= 44, avg=21.40, stdev= 9.78, samples=35 lat (msec) : 4=2.47%, 10=21.88%, 20=21.61%, 50=46.88%, 100=6.90% lat (msec) : 250=0.26% cpu : usr=0.10%, sys=10.56%, ctx=1593, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=155374: Wed Apr 22 11:21:27 2026 read: IOPS=19, BW=314KiB/s (321kB/s)(5744KiB/18318msec) clat (usec): min=2424, max=78775, avg=13656.58, stdev=11864.42 lat (usec): min=2425, max=78776, avg=13657.48, stdev=11864.36 clat percentiles (usec): | 1.00th=[ 2966], 5.00th=[ 3654], 10.00th=[ 4178], 20.00th=[ 4883], | 30.00th=[ 5932], 40.00th=[ 7504], 50.00th=[ 9241], 60.00th=[11076], | 70.00th=[14222], 80.00th=[21627], 90.00th=[31065], 95.00th=[41157], | 99.00th=[50594], 99.50th=[57410], 99.90th=[79168], 99.95th=[79168], | 99.99th=[79168] bw ( KiB/s): min= 63, max= 800, per=23.82%, avg=311.36, stdev=171.40, samples=36 iops : min= 3, max= 50, avg=18.97, stdev=11.03, samples=36 write: IOPS=22, BW=357KiB/s (366kB/s)(6544KiB/18318msec); 0 zone resets clat (msec): min=10, max=180, avg=32.58, stdev=17.92 lat (msec): min=10, max=180, avg=32.58, stdev=17.92 clat percentiles (msec): | 1.00th=[ 12], 5.00th=[ 16], 10.00th=[ 18], 20.00th=[ 21], | 30.00th=[ 23], 40.00th=[ 26], 50.00th=[ 28], 60.00th=[ 32], | 70.00th=[ 35], 80.00th=[ 42], 90.00th=[ 52], 95.00th=[ 64], | 99.00th=[ 102], 99.50th=[ 114], 99.90th=[ 182], 99.95th=[ 182], | 99.99th=[ 182] bw ( KiB/s): min= 95, max= 640, per=25.54%, avg=351.22, stdev=136.50, samples=36 iops : min= 5, max= 40, avg=21.47, stdev= 8.87, samples=36 lat (msec) : 4=3.52%, 10=21.35%, 20=20.96%, 50=47.66%, 100=5.86% lat (msec) : 250=0.65% cpu : usr=0.06%, sys=10.39%, ctx=1623, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=155375: Wed Apr 22 11:21:27 2026 read: IOPS=21, BW=349KiB/s (357kB/s)(6256KiB/17946msec) clat (msec): min=3, max=116, avg=14.42, stdev=14.01 lat (msec): min=3, max=116, avg=14.42, stdev=14.01 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 4], 10.00th=[ 5], 20.00th=[ 6], | 30.00th=[ 6], 40.00th=[ 8], 50.00th=[ 10], 60.00th=[ 12], | 70.00th=[ 16], 80.00th=[ 21], 90.00th=[ 32], 95.00th=[ 43], | 99.00th=[ 67], 99.50th=[ 99], 99.90th=[ 116], 99.95th=[ 116], | 99.99th=[ 116] bw ( KiB/s): min= 127, max= 1024, per=26.97%, avg=352.54, stdev=203.51, samples=35 iops : min= 7, max= 64, avg=21.51, stdev=13.00, samples=35 write: IOPS=21, BW=336KiB/s (344kB/s)(6032KiB/17946msec); 0 zone resets clat (msec): min=12, max=126, avg=32.45, stdev=15.19 lat (msec): min=12, max=126, avg=32.45, stdev=15.19 clat percentiles (msec): | 1.00th=[ 15], 5.00th=[ 18], 10.00th=[ 20], 20.00th=[ 22], | 30.00th=[ 24], 40.00th=[ 26], 50.00th=[ 29], 60.00th=[ 32], | 70.00th=[ 35], 80.00th=[ 41], 90.00th=[ 51], 95.00th=[ 61], | 99.00th=[ 96], 99.50th=[ 125], 99.90th=[ 127], 99.95th=[ 127], | 99.99th=[ 127] bw ( KiB/s): min= 95, max= 640, per=24.23%, avg=333.14, stdev=140.71, samples=35 iops : min= 5, max= 40, avg=20.31, stdev= 9.18, samples=35 lat (msec) : 4=4.04%, 10=23.18%, 20=18.75%, 50=47.92%, 100=5.60% lat (msec) : 250=0.52% cpu : usr=0.07%, sys=10.63%, ctx=1585, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=155376: Wed Apr 22 11:21:27 2026 read: IOPS=20, BW=332KiB/s (340kB/s)(6032KiB/18191msec) clat (usec): min=2940, max=94179, avg=15277.29, stdev=14523.84 lat (usec): min=2941, max=94180, avg=15278.19, stdev=14523.76 clat percentiles (usec): | 1.00th=[ 3326], 5.00th=[ 4178], 10.00th=[ 4752], 20.00th=[ 5407], | 30.00th=[ 6587], 40.00th=[ 8029], 50.00th=[10290], 60.00th=[12256], | 70.00th=[15270], 80.00th=[21627], 90.00th=[35914], 95.00th=[47973], | 99.00th=[77071], 99.50th=[89654], 99.90th=[93848], 99.95th=[93848], | 99.99th=[93848] bw ( KiB/s): min= 126, max= 640, per=25.23%, avg=329.72, stdev=148.80, samples=36 iops : min= 7, max= 40, avg=20.11, stdev= 9.63, samples=36 write: IOPS=21, BW=344KiB/s (352kB/s)(6256KiB/18191msec); 0 zone resets clat (msec): min=13, max=109, avg=31.72, stdev=15.33 lat (msec): min=13, max=109, avg=31.72, stdev=15.33 clat percentiles (msec): | 1.00th=[ 15], 5.00th=[ 17], 10.00th=[ 18], 20.00th=[ 21], | 30.00th=[ 24], 40.00th=[ 26], 50.00th=[ 28], 60.00th=[ 31], | 70.00th=[ 33], 80.00th=[ 40], 90.00th=[ 53], 95.00th=[ 64], | 99.00th=[ 93], 99.50th=[ 102], 99.90th=[ 110], 99.95th=[ 110], | 99.99th=[ 110] bw ( KiB/s): min= 159, max= 704, per=25.03%, avg=344.22, stdev=152.34, samples=36 iops : min= 9, max= 44, avg=21.03, stdev= 9.87, samples=36 lat (msec) : 4=1.69%, 10=22.40%, 20=22.92%, 50=45.31%, 100=7.42% lat (msec) : 250=0.26% cpu : usr=0.09%, sys=10.65%, ctx=1650, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1308KiB/s (1339kB/s), 314KiB/s-349KiB/s (321kB/s-357kB/s), io=23.4MiB (24.5MB), run=17946-18318msec WRITE: bw=1376KiB/s (1409kB/s), 336KiB/s-357KiB/s (344kB/s-366kB/s), io=24.6MiB (25.8MB), run=17946-18318msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=155383: Wed Apr 22 11:21:35 2026 read: IOPS=4, BW=4292KiB/s (4395kB/s)(7168KiB/1670msec) clat (usec): min=1129, max=177420, avg=115715.40, stdev=56852.27 lat (usec): min=1131, max=177421, avg=115716.69, stdev=56852.09 clat percentiles (usec): | 1.00th=[ 1123], 5.00th=[ 1123], 10.00th=[ 1123], 20.00th=[107480], | 30.00th=[110625], 40.00th=[110625], 50.00th=[114820], 60.00th=[147850], | 70.00th=[147850], 80.00th=[152044], 90.00th=[177210], 95.00th=[177210], | 99.00th=[177210], 99.50th=[177210], 99.90th=[177210], 99.95th=[177210], | 99.99th=[177210] bw ( KiB/s): min= 2048, max= 5189, per=50.52%, avg=3715.00, stdev=1579.37, samples=3 iops : min= 2, max= 5, avg= 3.33, stdev= 1.53, samples=3 write: IOPS=2, BW=3066KiB/s (3139kB/s)(5120KiB/1670msec); 0 zone resets clat (msec): min=157, max=186, avg=169.88, stdev=14.17 lat (msec): min=157, max=186, avg=169.94, stdev=14.18 clat percentiles (msec): | 1.00th=[ 159], 5.00th=[ 159], 10.00th=[ 159], 20.00th=[ 159], | 30.00th=[ 159], 40.00th=[ 159], 50.00th=[ 163], 60.00th=[ 163], | 70.00th=[ 184], 80.00th=[ 184], 90.00th=[ 188], 95.00th=[ 188], | 99.00th=[ 188], 99.50th=[ 188], 99.90th=[ 188], 99.95th=[ 188], | 99.99th=[ 188] bw ( KiB/s): min= 1729, max= 4096, per=25.19%, avg=2593.00, stdev=1306.49, samples=3 iops : min= 1, max= 4, avg= 2.00, stdev= 1.73, samples=3 lat (msec) : 2=8.33%, 250=91.67% cpu : usr=0.12%, sys=56.20%, ctx=918, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=155384: Wed Apr 22 11:21:35 2026 read: IOPS=0, BW=735KiB/s (753kB/s)(2048KiB/2785msec) clat (usec): min=744, max=224846, avg=112795.50, stdev=158464.31 lat (usec): min=745, max=224848, avg=112797.29, stdev=158464.81 clat percentiles (usec): | 1.00th=[ 742], 5.00th=[ 742], 10.00th=[ 742], 20.00th=[ 742], | 30.00th=[ 742], 40.00th=[ 742], 50.00th=[ 742], 60.00th=[225444], | 70.00th=[225444], 80.00th=[225444], 90.00th=[225444], 95.00th=[225444], | 99.00th=[225444], 99.50th=[225444], 99.90th=[225444], 99.95th=[225444], | 99.99th=[225444] bw ( KiB/s): min= 1726, max= 2000, per=25.34%, avg=1863.00, stdev=193.75, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=3, BW=3677KiB/s (3765kB/s)(10.0MiB/2785msec); 0 zone resets clat (msec): min=97, max=594, avg=250.77, stdev=166.95 lat (msec): min=97, max=594, avg=250.88, stdev=167.04 clat percentiles (msec): | 1.00th=[ 99], 5.00th=[ 99], 10.00th=[ 99], 20.00th=[ 115], | 30.00th=[ 169], 40.00th=[ 171], 50.00th=[ 184], 60.00th=[ 209], | 70.00th=[ 222], 80.00th=[ 230], 90.00th=[ 518], 95.00th=[ 592], | 99.00th=[ 592], 99.50th=[ 592], 99.90th=[ 592], 99.95th=[ 592], | 99.99th=[ 592] bw ( KiB/s): min= 1726, max= 8192, per=34.72%, avg=3574.80, stdev=2722.99, samples=5 iops : min= 1, max= 8, avg= 3.00, stdev= 2.92, samples=5 lat (usec) : 750=8.33% lat (msec) : 100=8.33%, 250=66.67%, 750=16.67% cpu : usr=0.00%, sys=39.15%, ctx=176, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=155385: Wed Apr 22 11:21:35 2026 read: IOPS=2, BW=2378KiB/s (2435kB/s)(6144KiB/2584msec) clat (usec): min=532, max=190305, avg=125881.63, stdev=68713.33 lat (usec): min=533, max=190306, avg=125882.65, stdev=68713.28 clat percentiles (usec): | 1.00th=[ 537], 5.00th=[ 537], 10.00th=[ 537], 20.00th=[ 99091], | 30.00th=[ 99091], 40.00th=[137364], 50.00th=[137364], 60.00th=[158335], | 70.00th=[168821], 80.00th=[168821], 90.00th=[189793], 95.00th=[189793], | 99.00th=[189793], 99.50th=[189793], 99.90th=[189793], 99.95th=[189793], | 99.99th=[189793] bw ( KiB/s): min= 4000, max= 4096, per=55.05%, avg=4048.00, stdev=67.88, samples=2 iops : min= 3, max= 4, avg= 3.50, stdev= 0.71, samples=2 write: IOPS=2, BW=2378KiB/s (2435kB/s)(6144KiB/2584msec); 0 zone resets clat (msec): min=171, max=479, avg=297.83, stdev=137.94 lat (msec): min=171, max=479, avg=297.88, stdev=137.94 clat percentiles (msec): | 1.00th=[ 171], 5.00th=[ 171], 10.00th=[ 171], 20.00th=[ 192], | 30.00th=[ 192], 40.00th=[ 222], 50.00th=[ 222], 60.00th=[ 262], | 70.00th=[ 464], 80.00th=[ 464], 90.00th=[ 481], 95.00th=[ 481], | 99.00th=[ 481], 99.50th=[ 481], 99.90th=[ 481], 99.95th=[ 481], | 99.99th=[ 481] bw ( KiB/s): min= 1954, max= 3453, per=23.98%, avg=2469.00, stdev=852.48, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (usec) : 750=8.33% lat (msec) : 100=8.33%, 250=58.33%, 500=25.00% cpu : usr=0.04%, sys=37.36%, ctx=845, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=155386: Wed Apr 22 11:21:35 2026 read: IOPS=2, BW=2378KiB/s (2435kB/s)(5120KiB/2153msec) clat (usec): min=323, max=277000, avg=138557.48, stdev=98128.35 lat (usec): min=324, max=277001, avg=138558.42, stdev=98128.07 clat percentiles (usec): | 1.00th=[ 322], 5.00th=[ 322], 10.00th=[ 322], 20.00th=[ 322], | 30.00th=[128451], 40.00th=[128451], 50.00th=[137364], 60.00th=[137364], | 70.00th=[149947], 80.00th=[149947], 90.00th=[278922], 95.00th=[278922], | 99.00th=[278922], 99.50th=[278922], 99.90th=[278922], 99.95th=[278922], | 99.99th=[278922] bw ( KiB/s): min= 8192, max= 8192, per=100.00%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 8, max= 8, avg= 8.00, stdev= 0.00, samples=1 write: IOPS=3, BW=3329KiB/s (3409kB/s)(7168KiB/2153msec); 0 zone resets clat (msec): min=82, max=414, avg=204.10, stdev=125.60 lat (msec): min=82, max=414, avg=204.16, stdev=125.59 clat percentiles (msec): | 1.00th=[ 83], 5.00th=[ 83], 10.00th=[ 83], 20.00th=[ 110], | 30.00th=[ 120], 40.00th=[ 120], 50.00th=[ 180], 60.00th=[ 184], | 70.00th=[ 184], 80.00th=[ 342], 90.00th=[ 414], 95.00th=[ 414], | 99.00th=[ 414], 99.50th=[ 414], 99.90th=[ 414], 99.95th=[ 414], | 99.99th=[ 414] bw ( KiB/s): min= 3442, max= 6000, per=43.22%, avg=4450.00, stdev=1362.41, samples=3 iops : min= 3, max= 5, avg= 3.67, stdev= 1.15, samples=3 lat (usec) : 500=8.33% lat (msec) : 100=8.33%, 250=58.33%, 500=25.00% cpu : usr=0.00%, sys=45.12%, ctx=486, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=7354KiB/s (7530kB/s), 735KiB/s-4292KiB/s (753kB/s-4395kB/s), io=20.0MiB (20.0MB), run=1670-2785msec WRITE: bw=10.1MiB/s (10.5MB/s), 2378KiB/s-3677KiB/s (2435kB/s-3765kB/s), io=28.0MiB (29.4MB), run=1670-2785msec rand-rw: (groupid=0, jobs=1): err= 0: pid=155388: Wed Apr 22 11:21:35 2026 read: IOPS=3, BW=3431KiB/s (3514kB/s)(7168KiB/2089msec) clat (msec): min=57, max=457, avg=183.29, stdev=135.68 lat (msec): min=57, max=457, avg=183.29, stdev=135.67 clat percentiles (msec): | 1.00th=[ 58], 5.00th=[ 58], 10.00th=[ 58], 20.00th=[ 80], | 30.00th=[ 120], 40.00th=[ 120], 50.00th=[ 136], 60.00th=[ 207], | 70.00th=[ 207], 80.00th=[ 228], 90.00th=[ 456], 95.00th=[ 456], | 99.00th=[ 456], 99.50th=[ 456], 99.90th=[ 456], 99.95th=[ 456], | 99.99th=[ 456] bw ( KiB/s): min= 1706, max= 4096, per=44.45%, avg=3288.33, stdev=1370.44, samples=3 iops : min= 1, max= 4, avg= 2.67, stdev= 1.53, samples=3 write: IOPS=2, BW=2451KiB/s (2510kB/s)(5120KiB/2089msec); 0 zone resets clat (msec): min=125, max=168, avg=146.86, stdev=20.27 lat (msec): min=125, max=168, avg=146.94, stdev=20.26 clat percentiles (msec): | 1.00th=[ 127], 5.00th=[ 127], 10.00th=[ 127], 20.00th=[ 127], | 30.00th=[ 133], 40.00th=[ 133], 50.00th=[ 140], 60.00th=[ 140], | 70.00th=[ 169], 80.00th=[ 169], 90.00th=[ 169], 95.00th=[ 169], | 99.00th=[ 169], 99.50th=[ 169], 99.90th=[ 169], 99.95th=[ 169], | 99.99th=[ 169] bw ( KiB/s): min= 2031, max= 4096, per=29.58%, avg=3063.50, stdev=1460.18, samples=2 iops : min= 1, max= 4, avg= 2.50, stdev= 2.12, samples=2 lat (msec) : 100=16.67%, 250=75.00%, 500=8.33% cpu : usr=0.00%, sys=19.01%, ctx=117, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=155389: Wed Apr 22 11:21:35 2026 read: IOPS=0, BW=740KiB/s (758kB/s)(2048KiB/2768msec) clat (msec): min=191, max=196, avg=194.17, stdev= 3.31 lat (msec): min=191, max=196, avg=194.17, stdev= 3.31 clat percentiles (msec): | 1.00th=[ 192], 5.00th=[ 192], 10.00th=[ 192], 20.00th=[ 192], | 30.00th=[ 192], 40.00th=[ 192], 50.00th=[ 192], 60.00th=[ 197], | 70.00th=[ 197], 80.00th=[ 197], 90.00th=[ 197], 95.00th=[ 197], | 99.00th=[ 197], 99.50th=[ 197], 99.90th=[ 197], 99.95th=[ 197], | 99.99th=[ 197] bw ( KiB/s): min= 1684, max= 1980, per=24.76%, avg=1832.00, stdev=209.30, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=3, BW=3699KiB/s (3788kB/s)(10.0MiB/2768msec); 0 zone resets clat (msec): min=31, max=557, avg=229.90, stdev=179.34 lat (msec): min=32, max=557, avg=229.96, stdev=179.34 clat percentiles (msec): | 1.00th=[ 32], 5.00th=[ 32], 10.00th=[ 32], 20.00th=[ 58], | 30.00th=[ 95], 40.00th=[ 121], 50.00th=[ 146], 60.00th=[ 188], | 70.00th=[ 262], 80.00th=[ 414], 90.00th=[ 430], 95.00th=[ 558], | 99.00th=[ 558], 99.50th=[ 558], 99.90th=[ 558], 99.95th=[ 558], | 99.99th=[ 558] bw ( KiB/s): min= 3961, max= 6095, per=45.54%, avg=4717.33, stdev=1195.00, samples=3 iops : min= 3, max= 5, avg= 4.00, stdev= 1.00, samples=3 lat (msec) : 50=8.33%, 100=16.67%, 250=41.67%, 500=25.00%, 750=8.33% cpu : usr=0.07%, sys=17.64%, ctx=298, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=155390: Wed Apr 22 11:21:35 2026 read: IOPS=2, BW=2319KiB/s (2375kB/s)(6144KiB/2649msec) clat (msec): min=29, max=222, avg=106.53, stdev=69.88 lat (msec): min=29, max=222, avg=106.53, stdev=69.88 clat percentiles (msec): | 1.00th=[ 30], 5.00th=[ 30], 10.00th=[ 30], 20.00th=[ 49], | 30.00th=[ 49], 40.00th=[ 89], 50.00th=[ 89], 60.00th=[ 108], | 70.00th=[ 142], 80.00th=[ 142], 90.00th=[ 224], 95.00th=[ 224], | 99.00th=[ 224], 99.50th=[ 224], 99.90th=[ 224], 99.95th=[ 224], | 99.99th=[ 224] bw ( KiB/s): min= 1980, max= 4096, per=45.83%, avg=3390.67, stdev=1221.67, samples=3 iops : min= 1, max= 4, avg= 3.00, stdev= 1.73, samples=3 write: IOPS=2, BW=2319KiB/s (2375kB/s)(6144KiB/2649msec); 0 zone resets clat (msec): min=146, max=493, avg=326.04, stdev=154.15 lat (msec): min=146, max=493, avg=326.12, stdev=154.15 clat percentiles (msec): | 1.00th=[ 146], 5.00th=[ 146], 10.00th=[ 146], 20.00th=[ 174], | 30.00th=[ 174], 40.00th=[ 253], 50.00th=[ 253], 60.00th=[ 435], | 70.00th=[ 460], 80.00th=[ 460], 90.00th=[ 493], 95.00th=[ 493], | 99.00th=[ 493], 99.50th=[ 493], 99.90th=[ 493], 99.95th=[ 493], | 99.99th=[ 493] bw ( KiB/s): min= 1681, max= 4096, per=22.85%, avg=2367.20, stdev=977.81, samples=5 iops : min= 1, max= 4, avg= 1.80, stdev= 1.30, samples=5 lat (msec) : 50=16.67%, 100=8.33%, 250=41.67%, 500=33.33% cpu : usr=0.00%, sys=15.60%, ctx=142, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=155391: Wed Apr 22 11:21:35 2026 read: IOPS=2, BW=2138KiB/s (2189kB/s)(5120KiB/2395msec) clat (msec): min=42, max=428, avg=147.39, stdev=158.68 lat (msec): min=42, max=428, avg=147.39, stdev=158.68 clat percentiles (msec): | 1.00th=[ 43], 5.00th=[ 43], 10.00th=[ 43], 20.00th=[ 43], | 30.00th=[ 75], 40.00th=[ 75], 50.00th=[ 93], 60.00th=[ 93], | 70.00th=[ 99], 80.00th=[ 99], 90.00th=[ 430], 95.00th=[ 430], | 99.00th=[ 430], 99.50th=[ 430], 99.90th=[ 430], 99.95th=[ 430], | 99.99th=[ 430] bw ( KiB/s): min= 3961, max= 4096, per=54.45%, avg=4028.50, stdev=95.46, samples=2 iops : min= 3, max= 4, avg= 3.50, stdev= 0.71, samples=2 write: IOPS=2, BW=2993KiB/s (3065kB/s)(7168KiB/2395msec); 0 zone resets clat (msec): min=118, max=497, avg=226.93, stdev=133.99 lat (msec): min=118, max=497, avg=227.00, stdev=134.00 clat percentiles (msec): | 1.00th=[ 118], 5.00th=[ 118], 10.00th=[ 118], 20.00th=[ 136], | 30.00th=[ 153], 40.00th=[ 153], 50.00th=[ 165], 60.00th=[ 224], | 70.00th=[ 224], 80.00th=[ 296], 90.00th=[ 498], 95.00th=[ 498], | 99.00th=[ 498], 99.50th=[ 498], 99.90th=[ 498], 99.95th=[ 498], | 99.99th=[ 498] bw ( KiB/s): min= 1715, max= 4063, per=23.67%, avg=2451.50, stdev=1083.90, samples=4 iops : min= 1, max= 3, avg= 1.75, stdev= 0.96, samples=4 lat (msec) : 50=8.33%, 100=25.00%, 250=41.67%, 500=25.00% cpu : usr=0.00%, sys=17.34%, ctx=114, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=7399KiB/s (7576kB/s), 740KiB/s-3431KiB/s (758kB/s-3514kB/s), io=20.0MiB (20.0MB), run=2089-2768msec WRITE: bw=10.1MiB/s (10.6MB/s), 2319KiB/s-3699KiB/s (2375kB/s-3788kB/s), io=28.0MiB (29.4MB), run=2089-2768msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=155397: Wed Apr 22 11:21:43 2026 read: IOPS=1, BW=6568KiB/s (6725kB/s)(12.0MiB/1871msec) clat (msec): min=419, max=954, avg=613.25, stdev=296.07 lat (msec): min=419, max=954, avg=613.25, stdev=296.07 clat percentiles (msec): | 1.00th=[ 422], 5.00th=[ 422], 10.00th=[ 422], 20.00th=[ 422], | 30.00th=[ 422], 40.00th=[ 468], 50.00th=[ 468], 60.00th=[ 468], | 70.00th=[ 953], 80.00th=[ 953], 90.00th=[ 953], 95.00th=[ 953], | 99.00th=[ 953], 99.50th=[ 953], 99.90th=[ 953], 99.95th=[ 953], | 99.99th=[ 953] bw ( KiB/s): min= 7984, max= 8143, per=92.09%, avg=8063.50, stdev=112.43, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=66.67%, 1000=33.33% cpu : usr=0.00%, sys=37.65%, ctx=2566, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=155398: Wed Apr 22 11:21:43 2026 read: IOPS=0, BW=2287KiB/s (2342kB/s)(4096KiB/1791msec) clat (nsec): min=945007k, max=945007k, avg=945006990.00, stdev= 0.00 lat (nsec): min=945009k, max=945009k, avg=945009135.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 944], 5.00th=[ 944], 10.00th=[ 944], 20.00th=[ 944], | 30.00th=[ 944], 40.00th=[ 944], 50.00th=[ 944], 60.00th=[ 944], | 70.00th=[ 944], 80.00th=[ 944], 90.00th=[ 944], 95.00th=[ 944], | 99.00th=[ 944], 99.50th=[ 944], 99.90th=[ 944], 99.95th=[ 944], | 99.99th=[ 944] bw ( KiB/s): min= 8143, max= 8143, per=93.00%, avg=8143.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=1, BW=4574KiB/s (4684kB/s)(8192KiB/1791msec); 0 zone resets clat (msec): min=262, max=543, avg=402.65, stdev=198.63 lat (msec): min=262, max=543, avg=402.85, stdev=198.72 clat percentiles (msec): | 1.00th=[ 264], 5.00th=[ 264], 10.00th=[ 264], 20.00th=[ 264], | 30.00th=[ 264], 40.00th=[ 264], 50.00th=[ 264], 60.00th=[ 542], | 70.00th=[ 542], 80.00th=[ 542], 90.00th=[ 542], 95.00th=[ 542], | 99.00th=[ 542], 99.50th=[ 542], 99.90th=[ 542], 99.95th=[ 542], | 99.99th=[ 542] bw ( KiB/s): min= 7984, max= 7984, per=48.05%, avg=7984.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 750=33.33%, 1000=33.33% cpu : usr=0.00%, sys=20.06%, ctx=1121, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=155399: Wed Apr 22 11:21:43 2026 write: IOPS=1, BW=6231KiB/s (6381kB/s)(12.0MiB/1972msec); 0 zone resets clat (msec): min=413, max=1023, avg=635.13, stdev=337.17 lat (msec): min=414, max=1023, avg=635.49, stdev=337.16 clat percentiles (msec): | 1.00th=[ 414], 5.00th=[ 414], 10.00th=[ 414], 20.00th=[ 414], | 30.00th=[ 414], 40.00th=[ 468], 50.00th=[ 468], 60.00th=[ 468], | 70.00th=[ 1020], 80.00th=[ 1020], 90.00th=[ 1020], 95.00th=[ 1020], | 99.00th=[ 1020], 99.50th=[ 1020], 99.90th=[ 1020], 99.95th=[ 1020], | 99.99th=[ 1020] bw ( KiB/s): min=15968, max=15968, per=96.10%, avg=15968.00, stdev= 0.00, samples=1 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=1 lat (msec) : 500=66.67%, 2000=33.33% cpu : usr=0.00%, sys=25.22%, ctx=106, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=155400: Wed Apr 22 11:21:43 2026 write: IOPS=1, BW=6667KiB/s (6827kB/s)(12.0MiB/1843msec); 0 zone resets clat (msec): min=92, max=1618, avg=611.43, stdev=872.03 lat (msec): min=93, max=1618, avg=611.94, stdev=871.88 clat percentiles (msec): | 1.00th=[ 93], 5.00th=[ 93], 10.00th=[ 93], 20.00th=[ 93], | 30.00th=[ 93], 40.00th=[ 124], 50.00th=[ 124], 60.00th=[ 124], | 70.00th=[ 1620], 80.00th=[ 1620], 90.00th=[ 1620], 95.00th=[ 1620], | 99.00th=[ 1620], 99.50th=[ 1620], 99.90th=[ 1620], 99.95th=[ 1620], | 99.99th=[ 1620] bw ( KiB/s): min=14271, max=14271, per=85.89%, avg=14271.00, stdev= 0.00, samples=1 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=1 lat (msec) : 100=33.33%, 250=33.33%, 2000=33.33% cpu : usr=0.00%, sys=10.91%, ctx=76, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=8757KiB/s (8967kB/s), 2287KiB/s-6568KiB/s (2342kB/s-6725kB/s), io=16.0MiB (16.8MB), run=1791-1871msec WRITE: bw=16.2MiB/s (17.0MB/s), 4574KiB/s-6667KiB/s (4684kB/s-6827kB/s), io=32.0MiB (33.6MB), run=1791-1972msec rand-rw: (groupid=0, jobs=1): err= 0: pid=155402: Wed Apr 22 11:21:43 2026 read: IOPS=1, BW=6071KiB/s (6217kB/s)(12.0MiB/2024msec) clat (msec): min=124, max=1237, avg=651.76, stdev=558.69 lat (msec): min=124, max=1237, avg=651.77, stdev=558.69 clat percentiles (msec): | 1.00th=[ 125], 5.00th=[ 125], 10.00th=[ 125], 20.00th=[ 125], | 30.00th=[ 125], 40.00th=[ 592], 50.00th=[ 592], 60.00th=[ 592], | 70.00th=[ 1234], 80.00th=[ 1234], 90.00th=[ 1234], 95.00th=[ 1234], | 99.00th=[ 1234], 99.50th=[ 1234], 99.90th=[ 1234], 99.95th=[ 1234], | 99.99th=[ 1234] bw ( KiB/s): min= 8062, max= 8062, per=99.60%, avg=8062.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.00%, sys=10.78%, ctx=86, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=155403: Wed Apr 22 11:21:43 2026 read: IOPS=0, BW=2046KiB/s (2095kB/s)(4096KiB/2002msec) clat (nsec): min=1107.2M, max=1107.2M, avg=1107213426.00, stdev= 0.00 lat (nsec): min=1107.2M, max=1107.2M, avg=1107215636.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1099], 5.00th=[ 1099], 10.00th=[ 1099], 20.00th=[ 1099], | 30.00th=[ 1099], 40.00th=[ 1099], 50.00th=[ 1099], 60.00th=[ 1099], | 70.00th=[ 1099], 80.00th=[ 1099], 90.00th=[ 1099], 95.00th=[ 1099], | 99.00th=[ 1099], 99.50th=[ 1099], 99.90th=[ 1099], 99.95th=[ 1099], | 99.99th=[ 1099] bw ( KiB/s): min= 8062, max= 8062, per=99.60%, avg=8062.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=4092KiB/s (4190kB/s)(8192KiB/2002msec); 0 zone resets clat (msec): min=174, max=677, avg=425.90, stdev=355.35 lat (msec): min=174, max=677, avg=426.20, stdev=355.40 clat percentiles (msec): | 1.00th=[ 176], 5.00th=[ 176], 10.00th=[ 176], 20.00th=[ 176], | 30.00th=[ 176], 40.00th=[ 176], 50.00th=[ 176], 60.00th=[ 676], | 70.00th=[ 676], 80.00th=[ 676], 90.00th=[ 676], 95.00th=[ 676], | 99.00th=[ 676], 99.50th=[ 676], 99.90th=[ 676], 99.95th=[ 676], | 99.99th=[ 676] bw ( KiB/s): min= 8062, max= 8062, per=52.24%, avg=8062.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.00%, sys=12.19%, ctx=64, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=155404: Wed Apr 22 11:21:43 2026 write: IOPS=1, BW=5788KiB/s (5927kB/s)(12.0MiB/2123msec); 0 zone resets clat (msec): min=68, max=1424, avg=691.55, stdev=685.05 lat (msec): min=68, max=1425, avg=691.91, stdev=685.02 clat percentiles (msec): | 1.00th=[ 69], 5.00th=[ 69], 10.00th=[ 69], 20.00th=[ 69], | 30.00th=[ 69], 40.00th=[ 584], 50.00th=[ 584], 60.00th=[ 584], | 70.00th=[ 1418], 80.00th=[ 1418], 90.00th=[ 1418], 95.00th=[ 1418], | 99.00th=[ 1418], 99.50th=[ 1418], 99.90th=[ 1418], 99.95th=[ 1418], | 99.99th=[ 1418] bw ( KiB/s): min= 8062, max= 8062, per=52.24%, avg=8062.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 100=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.05%, sys=7.73%, ctx=48, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=155405: Wed Apr 22 11:21:43 2026 write: IOPS=1, BW=6471KiB/s (6626kB/s)(12.0MiB/1899msec); 0 zone resets clat (msec): min=76, max=1684, avg=622.15, stdev=920.44 lat (msec): min=76, max=1685, avg=622.47, stdev=920.40 clat percentiles (msec): | 1.00th=[ 77], 5.00th=[ 77], 10.00th=[ 77], 20.00th=[ 77], | 30.00th=[ 77], 40.00th=[ 106], 50.00th=[ 106], 60.00th=[ 106], | 70.00th=[ 1687], 80.00th=[ 1687], 90.00th=[ 1687], 95.00th=[ 1687], | 99.00th=[ 1687], 99.50th=[ 1687], 99.90th=[ 1687], 99.95th=[ 1687], | 99.99th=[ 1687] bw ( KiB/s): min=15723, max=15723, per=100.00%, avg=15723.00, stdev= 0.00, samples=1 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=1 lat (msec) : 100=33.33%, 250=33.33%, 2000=33.33% cpu : usr=0.00%, sys=9.80%, ctx=59, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=8095KiB/s (8289kB/s), 2046KiB/s-6071KiB/s (2095kB/s-6217kB/s), io=16.0MiB (16.8MB), run=2002-2024msec WRITE: bw=15.1MiB/s (15.8MB/s), 4092KiB/s-6471KiB/s (4190kB/s-6626kB/s), io=32.0MiB (33.6MB), run=1899-2123msec