== sanity test 398b: DIO and buffer IO race ============== 12:26:31 (1776875191) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 2.38983 s, 21.1 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=186303: Wed Apr 22 12:27:28 2026 read: IOPS=31, BW=126KiB/s (129kB/s)(5992KiB/47488msec) clat (usec): min=34, max=937426, avg=17075.65, stdev=25105.36 lat (usec): min=34, max=937427, avg=17076.46, stdev=25105.37 clat percentiles (usec): | 1.00th=[ 100], 5.00th=[ 7504], 10.00th=[ 8717], 20.00th=[ 10159], | 30.00th=[ 11469], 40.00th=[ 13173], 50.00th=[ 15139], 60.00th=[ 17171], | 70.00th=[ 19268], 80.00th=[ 21890], 90.00th=[ 26084], 95.00th=[ 30540], | 99.00th=[ 44303], 99.50th=[ 50070], 99.90th=[ 61604], 99.95th=[935330], | 99.99th=[935330] bw ( KiB/s): min= 7, max= 191, per=25.57%, avg=127.08, stdev=28.62, samples=93 iops : min= 1, max= 47, avg=31.47, stdev= 7.20, samples=93 write: IOPS=33, BW=133KiB/s (136kB/s)(6296KiB/47488msec); 0 zone resets clat (usec): min=761, max=99712, avg=13792.69, stdev=10327.37 lat (usec): min=761, max=99712, avg=13793.80, stdev=10327.71 clat percentiles (usec): | 1.00th=[ 1270], 5.00th=[ 2671], 10.00th=[ 3130], 20.00th=[ 3982], | 30.00th=[ 6849], 40.00th=[ 9634], 50.00th=[ 11731], 60.00th=[ 14091], | 70.00th=[ 17695], 80.00th=[ 21103], 90.00th=[ 27395], 95.00th=[ 33817], | 99.00th=[ 44827], 99.50th=[ 51643], 99.90th=[ 68682], 99.95th=[100140], | 99.99th=[100140] bw ( KiB/s): min= 48, max= 207, per=25.92%, avg=134.78, stdev=33.48, samples=92 iops : min= 12, max= 51, avg=33.41, stdev= 8.38, samples=92 lat (usec) : 50=0.07%, 100=0.39%, 250=0.59%, 1000=0.26% lat (msec) : 2=0.78%, 4=9.24%, 10=19.24%, 20=44.47%, 50=24.38% lat (msec) : 100=0.55%, 1000=0.03% cpu : usr=0.09%, sys=25.80%, ctx=9441, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=186305: Wed Apr 22 12:27:28 2026 read: IOPS=30, BW=124KiB/s (127kB/s)(5940KiB/47925msec) clat (usec): min=72, max=65842, avg=16975.91, stdev=8512.36 lat (usec): min=72, max=65843, avg=16979.24, stdev=8513.74 clat percentiles (usec): | 1.00th=[ 122], 5.00th=[ 7504], 10.00th=[ 8586], 20.00th=[10290], | 30.00th=[11731], 40.00th=[13173], 50.00th=[15270], 60.00th=[17433], | 70.00th=[19792], 80.00th=[22676], 90.00th=[27657], 95.00th=[32113], | 99.00th=[46400], 99.50th=[53740], 99.90th=[59507], 99.95th=[65799], | 99.99th=[65799] bw ( KiB/s): min= 7, max= 191, per=25.07%, avg=124.61, stdev=31.83, samples=94 iops : min= 1, max= 47, avg=30.85, stdev= 8.01, samples=94 write: IOPS=33, BW=132KiB/s (136kB/s)(6348KiB/47925msec); 0 zone resets clat (usec): min=817, max=944703, avg=14204.98, stdev=25326.55 lat (usec): min=818, max=944704, avg=14205.78, stdev=25326.55 clat percentiles (usec): | 1.00th=[ 1467], 5.00th=[ 2704], 10.00th=[ 3163], 20.00th=[ 4080], | 30.00th=[ 7504], 40.00th=[ 9765], 50.00th=[ 11994], 60.00th=[ 14091], | 70.00th=[ 16581], 80.00th=[ 20841], 90.00th=[ 27395], 95.00th=[ 32637], | 99.00th=[ 45351], 99.50th=[ 51119], 99.90th=[ 57410], 99.95th=[943719], | 99.99th=[943719] bw ( KiB/s): min= 48, max= 208, per=25.79%, avg=134.12, stdev=33.83, samples=93 iops : min= 12, max= 52, avg=33.24, stdev= 8.42, samples=93 lat (usec) : 100=0.23%, 250=0.55%, 1000=0.07% lat (msec) : 2=0.94%, 4=9.21%, 10=18.65%, 20=45.05%, 50=24.61% lat (msec) : 100=0.65%, 1000=0.03% cpu : usr=0.08%, sys=25.77%, ctx=9733, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=186307: Wed Apr 22 12:27:28 2026 read: IOPS=31, BW=125KiB/s (128kB/s)(6028KiB/48142msec) clat (usec): min=46, max=948023, avg=17324.37, stdev=25419.12 lat (usec): min=47, max=948024, avg=17325.09, stdev=25419.14 clat percentiles (usec): | 1.00th=[ 114], 5.00th=[ 7373], 10.00th=[ 8586], 20.00th=[ 10028], | 30.00th=[ 11731], 40.00th=[ 13435], 50.00th=[ 15401], 60.00th=[ 17695], | 70.00th=[ 19530], 80.00th=[ 22414], 90.00th=[ 26870], 95.00th=[ 30802], | 99.00th=[ 42206], 99.50th=[ 51119], 99.90th=[111674], 99.95th=[952108], | 99.99th=[952108] bw ( KiB/s): min= 7, max= 216, per=25.43%, avg=126.41, stdev=32.88, samples=95 iops : min= 1, max= 54, avg=31.31, stdev= 8.25, samples=95 write: IOPS=32, BW=130KiB/s (133kB/s)(6260KiB/48142msec); 0 zone resets clat (usec): min=774, max=71865, avg=13965.84, stdev=10178.71 lat (usec): min=775, max=71866, avg=13966.74, stdev=10178.80 clat percentiles (usec): | 1.00th=[ 1270], 5.00th=[ 2802], 10.00th=[ 3163], 20.00th=[ 4047], | 30.00th=[ 7046], 40.00th=[ 9765], 50.00th=[11863], 60.00th=[14484], | 70.00th=[17433], 80.00th=[21627], 90.00th=[28443], 95.00th=[33162], | 99.00th=[45876], 99.50th=[51643], 99.90th=[62653], 99.95th=[71828], | 99.99th=[71828] bw ( KiB/s): min= 23, max= 232, per=25.23%, avg=131.21, stdev=34.63, samples=95 iops : min= 5, max= 58, avg=32.51, stdev= 8.65, samples=95 lat (usec) : 50=0.03%, 100=0.42%, 250=0.52%, 1000=0.20% lat (msec) : 2=0.75%, 4=9.21%, 10=19.56%, 20=43.55%, 50=25.20% lat (msec) : 100=0.49%, 250=0.03%, 1000=0.03% cpu : usr=0.07%, sys=25.55%, ctx=9706, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=186309: Wed Apr 22 12:27:28 2026 read: IOPS=31, BW=125KiB/s (128kB/s)(6052KiB/48286msec) clat (usec): min=34, max=68635, avg=16653.80, stdev=8317.10 lat (usec): min=35, max=68635, avg=16654.49, stdev=8317.04 clat percentiles (usec): | 1.00th=[ 114], 5.00th=[ 7373], 10.00th=[ 8586], 20.00th=[10290], | 30.00th=[11600], 40.00th=[13435], 50.00th=[15401], 60.00th=[17433], | 70.00th=[19268], 80.00th=[21890], 90.00th=[26084], 95.00th=[30802], | 99.00th=[47449], 99.50th=[50070], 99.90th=[63177], 99.95th=[68682], | 99.99th=[68682] bw ( KiB/s): min= 56, max= 231, per=25.61%, avg=127.27, stdev=29.98, samples=94 iops : min= 14, max= 57, avg=31.52, stdev= 7.46, samples=94 write: IOPS=32, BW=129KiB/s (132kB/s)(6236KiB/48286msec); 0 zone resets clat (usec): min=784, max=993302, avg=14693.03, stdev=26777.59 lat (usec): min=784, max=993303, avg=14700.38, stdev=26777.47 clat percentiles (usec): | 1.00th=[ 1237], 5.00th=[ 2835], 10.00th=[ 3294], 20.00th=[ 4490], | 30.00th=[ 7111], 40.00th=[ 9896], 50.00th=[ 11994], 60.00th=[ 14091], | 70.00th=[ 17957], 80.00th=[ 21627], 90.00th=[ 28705], 95.00th=[ 33817], | 99.00th=[ 44303], 99.50th=[ 47449], 99.90th=[ 70779], 99.95th=[994051], | 99.99th=[994051] bw ( KiB/s): min= 23, max= 232, per=24.97%, avg=129.84, stdev=33.86, samples=95 iops : min= 5, max= 58, avg=32.17, stdev= 8.46, samples=95 lat (usec) : 50=0.07%, 100=0.26%, 250=0.72%, 500=0.03%, 1000=0.16% lat (msec) : 2=1.01%, 4=7.36%, 10=20.08%, 20=44.69%, 50=25.16% lat (msec) : 100=0.42%, 1000=0.03% cpu : usr=0.11%, sys=25.43%, ctx=9909, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=497KiB/s (509kB/s), 124KiB/s-126KiB/s (127kB/s-129kB/s), io=23.4MiB (24.6MB), run=47488-48286msec WRITE: bw=521KiB/s (533kB/s), 129KiB/s-133KiB/s (132kB/s-136kB/s), io=24.6MiB (25.7MB), run=47488-48286msec rand-rw: (groupid=0, jobs=1): err= 0: pid=186302: Wed Apr 22 12:27:35 2026 read: IOPS=27, BW=109KiB/s (112kB/s)(5992KiB/54890msec) clat (msec): min=2, max=953, avg=15.93, stdev=27.07 lat (msec): min=2, max=953, avg=15.93, stdev=27.07 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 5], 10.00th=[ 5], 20.00th=[ 6], | 30.00th=[ 7], 40.00th=[ 10], 50.00th=[ 12], 60.00th=[ 14], | 70.00th=[ 18], 80.00th=[ 24], 90.00th=[ 34], 95.00th=[ 41], | 99.00th=[ 58], 99.50th=[ 64], 99.90th=[ 95], 99.95th=[ 953], | 99.99th=[ 953] bw ( KiB/s): min= 31, max= 416, per=25.29%, avg=110.52, stdev=77.08, samples=108 iops : min= 7, max= 104, avg=27.30, stdev=19.41, samples=108 write: IOPS=28, BW=115KiB/s (117kB/s)(6296KiB/54890msec); 0 zone resets clat (msec): min=4, max=129, avg=19.61, stdev=13.54 lat (msec): min=4, max=129, avg=19.61, stdev=13.54 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 6], 10.00th=[ 7], 20.00th=[ 8], | 30.00th=[ 10], 40.00th=[ 13], 50.00th=[ 16], 60.00th=[ 21], | 70.00th=[ 26], 80.00th=[ 31], 90.00th=[ 37], 95.00th=[ 45], | 99.00th=[ 63], 99.50th=[ 70], 99.90th=[ 84], 99.95th=[ 130], | 99.99th=[ 130] bw ( KiB/s): min= 7, max= 376, per=25.33%, avg=115.99, stdev=77.59, samples=108 iops : min= 1, max= 94, avg=28.67, stdev=19.54, samples=108 lat (msec) : 4=1.60%, 10=36.20%, 20=28.32%, 50=31.45%, 100=2.38% lat (msec) : 250=0.03%, 1000=0.03% cpu : usr=0.08%, sys=13.61%, ctx=6011, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=186304: Wed Apr 22 12:27:35 2026 read: IOPS=27, BW=109KiB/s (111kB/s)(5940KiB/54733msec) clat (msec): min=3, max=1009, avg=16.07, stdev=28.33 lat (msec): min=3, max=1009, avg=16.07, stdev=28.33 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 5], 10.00th=[ 5], 20.00th=[ 6], | 30.00th=[ 8], 40.00th=[ 10], 50.00th=[ 12], 60.00th=[ 14], | 70.00th=[ 19], 80.00th=[ 24], 90.00th=[ 34], 95.00th=[ 40], | 99.00th=[ 54], 99.50th=[ 59], 99.90th=[ 73], 99.95th=[ 1011], | 99.99th=[ 1011] bw ( KiB/s): min= 7, max= 392, per=24.94%, avg=109.01, stdev=73.72, samples=107 iops : min= 1, max= 98, avg=26.92, stdev=18.55, samples=107 write: IOPS=28, BW=116KiB/s (119kB/s)(6348KiB/54733msec); 0 zone resets clat (msec): min=4, max=120, avg=19.34, stdev=13.05 lat (msec): min=4, max=120, avg=19.34, stdev=13.05 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 7], 10.00th=[ 7], 20.00th=[ 8], | 30.00th=[ 10], 40.00th=[ 13], 50.00th=[ 16], 60.00th=[ 20], | 70.00th=[ 25], 80.00th=[ 31], 90.00th=[ 37], 95.00th=[ 44], | 99.00th=[ 63], 99.50th=[ 67], 99.90th=[ 87], 99.95th=[ 121], | 99.99th=[ 121] bw ( KiB/s): min= 7, max= 360, per=25.32%, avg=115.96, stdev=73.33, samples=107 iops : min= 1, max= 90, avg=28.65, stdev=18.47, samples=107 lat (msec) : 4=0.85%, 10=35.77%, 20=30.53%, 50=30.86%, 100=1.92% lat (msec) : 250=0.03%, 2000=0.03% cpu : usr=0.10%, sys=13.58%, ctx=6064, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=186306: Wed Apr 22 12:27:35 2026 read: IOPS=27, BW=111KiB/s (114kB/s)(6028KiB/54348msec) clat (msec): min=3, max=112, avg=15.14, stdev=11.84 lat (msec): min=3, max=112, avg=15.14, stdev=11.84 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 5], 10.00th=[ 5], 20.00th=[ 6], | 30.00th=[ 8], 40.00th=[ 10], 50.00th=[ 12], 60.00th=[ 14], | 70.00th=[ 17], 80.00th=[ 23], 90.00th=[ 33], 95.00th=[ 40], | 99.00th=[ 54], 99.50th=[ 68], 99.90th=[ 80], 99.95th=[ 113], | 99.99th=[ 113] bw ( KiB/s): min= 7, max= 400, per=25.49%, avg=111.39, stdev=76.93, samples=106 iops : min= 1, max= 100, avg=27.51, stdev=19.39, samples=106 write: IOPS=28, BW=115KiB/s (118kB/s)(6260KiB/54348msec); 0 zone resets clat (msec): min=4, max=1017, avg=20.04, stdev=28.23 lat (msec): min=4, max=1017, avg=20.04, stdev=28.23 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 7], 10.00th=[ 7], 20.00th=[ 8], | 30.00th=[ 10], 40.00th=[ 13], 50.00th=[ 17], 60.00th=[ 21], | 70.00th=[ 25], 80.00th=[ 30], 90.00th=[ 37], 95.00th=[ 44], | 99.00th=[ 61], 99.50th=[ 67], 99.90th=[ 82], 99.95th=[ 1020], | 99.99th=[ 1020] bw ( KiB/s): min= 23, max= 352, per=25.23%, avg=115.55, stdev=71.56, samples=106 iops : min= 5, max= 88, avg=28.55, stdev=18.02, samples=106 lat (msec) : 4=0.88%, 10=35.29%, 20=31.58%, 50=30.05%, 100=2.15% lat (msec) : 250=0.03%, 2000=0.03% cpu : usr=0.07%, sys=13.81%, ctx=6136, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=186308: Wed Apr 22 12:27:35 2026 read: IOPS=27, BW=110KiB/s (113kB/s)(6052KiB/54785msec) clat (usec): min=2886, max=92926, avg=15621.88, stdev=11870.20 lat (usec): min=2886, max=92926, avg=15622.57, stdev=11870.23 clat percentiles (usec): | 1.00th=[ 3556], 5.00th=[ 4359], 10.00th=[ 4817], 20.00th=[ 5473], | 30.00th=[ 7111], 40.00th=[ 9896], 50.00th=[11994], 60.00th=[14615], | 70.00th=[18482], 80.00th=[23987], 90.00th=[33162], 95.00th=[39584], | 99.00th=[55313], 99.50th=[62129], 99.90th=[73925], 99.95th=[92799], | 99.99th=[92799] bw ( KiB/s): min= 47, max= 360, per=25.53%, avg=111.56, stdev=74.14, samples=106 iops : min= 11, max= 90, avg=27.56, stdev=18.65, samples=106 write: IOPS=28, BW=114KiB/s (117kB/s)(6236KiB/54785msec); 0 zone resets clat (msec): min=4, max=1009, avg=19.87, stdev=28.37 lat (msec): min=4, max=1009, avg=19.87, stdev=28.37 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 6], 10.00th=[ 7], 20.00th=[ 8], | 30.00th=[ 10], 40.00th=[ 13], 50.00th=[ 16], 60.00th=[ 20], | 70.00th=[ 24], 80.00th=[ 30], 90.00th=[ 39], 95.00th=[ 44], | 99.00th=[ 65], 99.50th=[ 70], 99.90th=[ 86], 99.95th=[ 1011], | 99.99th=[ 1011] bw ( KiB/s): min= 15, max= 360, per=24.86%, avg=113.86, stdev=74.61, samples=107 iops : min= 3, max= 90, avg=28.13, stdev=18.79, samples=107 lat (msec) : 4=1.07%, 10=35.12%, 20=31.93%, 50=29.46%, 100=2.38% lat (msec) : 2000=0.03% cpu : usr=0.07%, sys=13.53%, ctx=6093, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=437KiB/s (448kB/s), 109KiB/s-111KiB/s (111kB/s-114kB/s), io=23.4MiB (24.6MB), run=54348-54890msec WRITE: bw=458KiB/s (469kB/s), 114KiB/s-116KiB/s (117kB/s-119kB/s), io=24.6MiB (25.7MB), run=54348-54890msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=186331: Wed Apr 22 12:27:55 2026 read: IOPS=26, BW=424KiB/s (434kB/s)(5920KiB/13970msec) clat (usec): min=81, max=67806, avg=19074.98, stdev=9578.18 lat (usec): min=81, max=67807, avg=19075.45, stdev=9578.19 clat percentiles (usec): | 1.00th=[ 105], 5.00th=[ 269], 10.00th=[ 9503], 20.00th=[11994], | 30.00th=[13698], 40.00th=[15926], 50.00th=[18482], 60.00th=[20317], | 70.00th=[22676], 80.00th=[25035], 90.00th=[28967], 95.00th=[33817], | 99.00th=[51119], 99.50th=[63177], 99.90th=[67634], 99.95th=[67634], | 99.99th=[67634] bw ( KiB/s): min= 191, max= 672, per=24.22%, avg=415.11, stdev=113.50, samples=27 iops : min= 11, max= 42, avg=25.33, stdev= 7.25, samples=27 write: IOPS=28, BW=456KiB/s (467kB/s)(6368KiB/13970msec); 0 zone resets clat (usec): min=1209, max=84106, avg=17276.33, stdev=12269.86 lat (usec): min=1210, max=84107, avg=17277.21, stdev=12269.92 clat percentiles (usec): | 1.00th=[ 2966], 5.00th=[ 4359], 10.00th=[ 4948], 20.00th=[ 6325], | 30.00th=[ 8979], 40.00th=[12387], 50.00th=[14484], 60.00th=[16909], | 70.00th=[20579], 80.00th=[25822], 90.00th=[33424], 95.00th=[42730], | 99.00th=[59507], 99.50th=[61080], 99.90th=[84411], 99.95th=[84411], | 99.99th=[84411] bw ( KiB/s): min= 223, max= 633, per=25.03%, avg=451.37, stdev=101.47, samples=27 iops : min= 13, max= 39, avg=27.63, stdev= 6.49, samples=27 lat (usec) : 100=0.26%, 250=2.08%, 500=0.13% lat (msec) : 2=0.26%, 4=1.30%, 10=18.36%, 20=40.76%, 50=34.90% lat (msec) : 100=1.95% cpu : usr=0.08%, sys=27.70%, ctx=2801, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=186332: Wed Apr 22 12:27:55 2026 read: IOPS=25, BW=412KiB/s (422kB/s)(5744KiB/13950msec) clat (usec): min=61, max=59983, avg=19664.42, stdev=9794.14 lat (usec): min=62, max=59984, avg=19665.26, stdev=9794.23 clat percentiles (usec): | 1.00th=[ 101], 5.00th=[ 139], 10.00th=[ 9765], 20.00th=[12518], | 30.00th=[14484], 40.00th=[16188], 50.00th=[18744], 60.00th=[21103], | 70.00th=[23200], 80.00th=[27132], 90.00th=[32900], 95.00th=[35914], | 99.00th=[49021], 99.50th=[55837], 99.90th=[60031], 99.95th=[60031], | 99.99th=[60031] bw ( KiB/s): min= 159, max= 576, per=24.09%, avg=412.85, stdev=101.70, samples=27 iops : min= 9, max= 36, avg=25.19, stdev= 6.46, samples=27 write: IOPS=29, BW=469KiB/s (480kB/s)(6544KiB/13950msec); 0 zone resets clat (usec): min=1152, max=68538, avg=16790.46, stdev=11067.87 lat (usec): min=1152, max=68539, avg=16791.71, stdev=11067.88 clat percentiles (usec): | 1.00th=[ 3097], 5.00th=[ 4555], 10.00th=[ 4948], 20.00th=[ 6521], | 30.00th=[ 9896], 40.00th=[11863], 50.00th=[14484], 60.00th=[17171], | 70.00th=[20579], 80.00th=[25035], 90.00th=[32637], 95.00th=[37487], | 99.00th=[51119], 99.50th=[60031], 99.90th=[68682], 99.95th=[68682], | 99.99th=[68682] bw ( KiB/s): min= 223, max= 672, per=25.76%, avg=464.37, stdev=115.25, samples=27 iops : min= 13, max= 42, avg=28.44, stdev= 7.27, samples=27 lat (usec) : 100=0.26%, 250=2.47%, 500=0.13% lat (msec) : 2=0.39%, 4=1.04%, 10=16.67%, 20=41.28%, 50=36.72% lat (msec) : 100=1.04% cpu : usr=0.13%, sys=27.95%, ctx=2891, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=186333: Wed Apr 22 12:27:55 2026 read: IOPS=28, BW=456KiB/s (467kB/s)(6256KiB/13707msec) clat (usec): min=33, max=82853, avg=19088.83, stdev=9900.93 lat (usec): min=33, max=82854, avg=19089.50, stdev=9901.01 clat percentiles (usec): | 1.00th=[ 74], 5.00th=[ 159], 10.00th=[ 9634], 20.00th=[12125], | 30.00th=[13829], 40.00th=[16057], 50.00th=[18220], 60.00th=[20317], | 70.00th=[22676], 80.00th=[26084], 90.00th=[30802], 95.00th=[34866], | 99.00th=[49021], 99.50th=[61604], 99.90th=[83362], 99.95th=[83362], | 99.99th=[83362] bw ( KiB/s): min= 222, max= 672, per=26.79%, avg=459.22, stdev=128.88, samples=27 iops : min= 13, max= 42, avg=28.11, stdev= 8.18, samples=27 write: IOPS=27, BW=440KiB/s (451kB/s)(6032KiB/13707msec); 0 zone resets clat (usec): min=1521, max=70418, avg=16438.91, stdev=11115.67 lat (usec): min=1522, max=70419, avg=16440.18, stdev=11115.58 clat percentiles (usec): | 1.00th=[ 2114], 5.00th=[ 4293], 10.00th=[ 4752], 20.00th=[ 6063], | 30.00th=[ 8848], 40.00th=[11863], 50.00th=[13829], 60.00th=[17171], | 70.00th=[20841], 80.00th=[24773], 90.00th=[32113], 95.00th=[35390], | 99.00th=[58983], 99.50th=[62129], 99.90th=[70779], 99.95th=[70779], | 99.99th=[70779] bw ( KiB/s): min= 254, max= 633, per=24.24%, avg=437.00, stdev=107.14, samples=27 iops : min= 15, max= 39, avg=26.70, stdev= 6.80, samples=27 lat (usec) : 50=0.13%, 100=0.65%, 250=2.21%, 500=0.13% lat (msec) : 2=0.26%, 4=1.82%, 10=17.19%, 20=40.23%, 50=36.46% lat (msec) : 100=0.91% cpu : usr=0.07%, sys=28.10%, ctx=2893, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=186334: Wed Apr 22 12:27:55 2026 read: IOPS=27, BW=435KiB/s (446kB/s)(6032KiB/13864msec) clat (usec): min=44, max=68098, avg=18666.34, stdev=11032.73 lat (usec): min=45, max=68098, avg=18666.89, stdev=11032.75 clat percentiles (usec): | 1.00th=[ 84], 5.00th=[ 125], 10.00th=[ 7963], 20.00th=[11600], | 30.00th=[13566], 40.00th=[15664], 50.00th=[17171], 60.00th=[19006], | 70.00th=[21890], 80.00th=[25297], 90.00th=[31851], 95.00th=[36963], | 99.00th=[59507], 99.50th=[66323], 99.90th=[67634], 99.95th=[67634], | 99.99th=[67634] bw ( KiB/s): min= 254, max= 665, per=25.18%, avg=431.59, stdev=80.89, samples=27 iops : min= 15, max= 41, avg=26.37, stdev= 5.18, samples=27 write: IOPS=28, BW=451KiB/s (462kB/s)(6256KiB/13864msec); 0 zone resets clat (usec): min=1142, max=69568, avg=17317.36, stdev=11968.70 lat (usec): min=1143, max=69569, avg=17318.26, stdev=11968.68 clat percentiles (usec): | 1.00th=[ 2638], 5.00th=[ 4228], 10.00th=[ 4686], 20.00th=[ 6587], | 30.00th=[ 9110], 40.00th=[11731], 50.00th=[15008], 60.00th=[17695], | 70.00th=[21627], 80.00th=[25822], 90.00th=[33817], 95.00th=[39584], | 99.00th=[55313], 99.50th=[66847], 99.90th=[69731], 99.95th=[69731], | 99.99th=[69731] bw ( KiB/s): min= 223, max= 606, per=24.80%, avg=447.19, stdev=96.81, samples=27 iops : min= 13, max= 37, avg=27.37, stdev= 6.17, samples=27 lat (usec) : 50=0.13%, 100=0.91%, 250=3.12%, 500=0.13% lat (msec) : 2=0.39%, 4=1.69%, 10=17.97%, 20=39.97%, 50=33.85% lat (msec) : 100=1.82% cpu : usr=0.06%, sys=27.42%, ctx=2812, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1715KiB/s (1756kB/s), 412KiB/s-456KiB/s (422kB/s-467kB/s), io=23.4MiB (24.5MB), run=13707-13970msec WRITE: bw=1804KiB/s (1847kB/s), 440KiB/s-469KiB/s (451kB/s-480kB/s), io=24.6MiB (25.8MB), run=13707-13970msec rand-rw: (groupid=0, jobs=1): err= 0: pid=186336: Wed Apr 22 12:27:58 2026 read: IOPS=22, BW=364KiB/s (373kB/s)(5920KiB/16245msec) clat (usec): min=4430, max=65147, avg=18033.04, stdev=11137.92 lat (usec): min=4430, max=65148, avg=18033.52, stdev=11137.91 clat percentiles (usec): | 1.00th=[ 4948], 5.00th=[ 6652], 10.00th=[ 7570], 20.00th=[ 8848], | 30.00th=[10945], 40.00th=[12911], 50.00th=[14746], 60.00th=[16450], | 70.00th=[20055], 80.00th=[24249], 90.00th=[36439], 95.00th=[42206], | 99.00th=[52691], 99.50th=[58983], 99.90th=[65274], 99.95th=[65274], | 99.99th=[65274] bw ( KiB/s): min= 128, max= 800, per=24.94%, avg=363.81, stdev=176.67, samples=32 iops : min= 8, max= 50, avg=22.19, stdev=11.03, samples=32 write: IOPS=24, BW=392KiB/s (401kB/s)(6368KiB/16245msec); 0 zone resets clat (usec): min=5727, max=96321, avg=23935.76, stdev=15067.76 lat (usec): min=5728, max=96322, avg=23936.85, stdev=15067.80 clat percentiles (usec): | 1.00th=[ 7177], 5.00th=[ 8455], 10.00th=[ 9372], 20.00th=[11469], | 30.00th=[13566], 40.00th=[15664], 50.00th=[18220], 60.00th=[23725], | 70.00th=[29492], 80.00th=[35390], 90.00th=[45351], 95.00th=[54264], | 99.00th=[76022], 99.50th=[89654], 99.90th=[95945], 99.95th=[95945], | 99.99th=[95945] bw ( KiB/s): min= 223, max= 1053, per=25.52%, avg=391.75, stdev=179.50, samples=32 iops : min= 13, max= 65, avg=23.94, stdev=11.15, samples=32 lat (msec) : 10=18.23%, 20=43.10%, 50=34.38%, 100=4.30% cpu : usr=0.04%, sys=14.28%, ctx=1762, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=186337: Wed Apr 22 12:27:58 2026 read: IOPS=21, BW=350KiB/s (358kB/s)(5744KiB/16407msec) clat (usec): min=3622, max=79257, avg=19453.28, stdev=13863.99 lat (usec): min=3623, max=79258, avg=19453.84, stdev=13864.20 clat percentiles (usec): | 1.00th=[ 4555], 5.00th=[ 5538], 10.00th=[ 6718], 20.00th=[ 9110], | 30.00th=[10945], 40.00th=[12911], 50.00th=[14615], 60.00th=[17433], | 70.00th=[21103], 80.00th=[29230], 90.00th=[41157], 95.00th=[51643], | 99.00th=[63177], 99.50th=[74974], 99.90th=[79168], 99.95th=[79168], | 99.99th=[79168] bw ( KiB/s): min= 127, max= 894, per=23.68%, avg=345.44, stdev=158.17, samples=32 iops : min= 7, max= 55, avg=21.03, stdev= 9.91, samples=32 write: IOPS=24, BW=399KiB/s (408kB/s)(6544KiB/16407msec); 0 zone resets clat (usec): min=5661, max=80404, avg=22811.12, stdev=14149.51 lat (usec): min=5661, max=80406, avg=22812.19, stdev=14149.54 clat percentiles (usec): | 1.00th=[ 6587], 5.00th=[ 8356], 10.00th=[ 9503], 20.00th=[11076], | 30.00th=[13566], 40.00th=[15795], 50.00th=[18482], 60.00th=[21890], | 70.00th=[26346], 80.00th=[33817], 90.00th=[43254], 95.00th=[51643], | 99.00th=[73925], 99.50th=[74974], 99.90th=[80217], 99.95th=[80217], | 99.99th=[80217] bw ( KiB/s): min= 160, max= 958, per=25.23%, avg=387.28, stdev=180.01, samples=32 iops : min= 10, max= 59, avg=23.66, stdev=11.24, samples=32 lat (msec) : 4=0.26%, 10=17.97%, 20=42.97%, 50=33.07%, 100=5.73% cpu : usr=0.07%, sys=14.24%, ctx=1732, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=186338: Wed Apr 22 12:27:58 2026 read: IOPS=23, BW=381KiB/s (390kB/s)(6256KiB/16406msec) clat (usec): min=4137, max=77345, avg=19621.26, stdev=14147.05 lat (usec): min=4138, max=77346, avg=19621.87, stdev=14147.10 clat percentiles (usec): | 1.00th=[ 4686], 5.00th=[ 6390], 10.00th=[ 7242], 20.00th=[ 8455], | 30.00th=[10159], 40.00th=[11863], 50.00th=[14222], 60.00th=[17433], | 70.00th=[22414], 80.00th=[29754], 90.00th=[43254], 95.00th=[50070], | 99.00th=[61080], 99.50th=[72877], 99.90th=[77071], 99.95th=[77071], | 99.99th=[77071] bw ( KiB/s): min= 96, max= 896, per=25.86%, avg=377.25, stdev=188.44, samples=32 iops : min= 6, max= 56, avg=23.03, stdev=11.82, samples=32 write: IOPS=22, BW=368KiB/s (376kB/s)(6032KiB/16406msec); 0 zone resets clat (usec): min=5608, max=98181, avg=22906.07, stdev=14252.72 lat (usec): min=5608, max=98183, avg=22907.32, stdev=14252.75 clat percentiles (usec): | 1.00th=[ 6521], 5.00th=[ 7898], 10.00th=[ 9110], 20.00th=[10945], | 30.00th=[12911], 40.00th=[15664], 50.00th=[19268], 60.00th=[22676], | 70.00th=[27132], 80.00th=[32900], 90.00th=[43779], 95.00th=[51119], | 99.00th=[73925], 99.50th=[77071], 99.90th=[98042], 99.95th=[98042], | 99.99th=[98042] bw ( KiB/s): min= 160, max= 958, per=23.32%, avg=357.97, stdev=176.32, samples=32 iops : min= 10, max= 59, avg=21.81, stdev=10.97, samples=32 lat (msec) : 10=21.88%, 20=36.59%, 50=36.59%, 100=4.95% cpu : usr=0.09%, sys=13.98%, ctx=1677, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=186339: Wed Apr 22 12:27:58 2026 read: IOPS=23, BW=372KiB/s (381kB/s)(6032KiB/16194msec) clat (usec): min=4515, max=75747, avg=18610.95, stdev=13153.39 lat (usec): min=4515, max=75748, avg=18611.47, stdev=13153.40 clat percentiles (usec): | 1.00th=[ 5473], 5.00th=[ 6652], 10.00th=[ 7439], 20.00th=[ 9110], | 30.00th=[10421], 40.00th=[11863], 50.00th=[13960], 60.00th=[16319], | 70.00th=[20317], 80.00th=[26346], 90.00th=[39584], 95.00th=[45351], | 99.00th=[71828], 99.50th=[73925], 99.90th=[76022], 99.95th=[76022], | 99.99th=[76022] bw ( KiB/s): min= 159, max= 958, per=25.39%, avg=370.41, stdev=173.83, samples=32 iops : min= 9, max= 59, avg=22.59, stdev=10.88, samples=32 write: IOPS=24, BW=386KiB/s (396kB/s)(6256KiB/16194msec); 0 zone resets clat (msec): min=6, max=115, avg=23.19, stdev=13.75 lat (msec): min=6, max=115, avg=23.19, stdev=13.75 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 9], 10.00th=[ 10], 20.00th=[ 12], | 30.00th=[ 14], 40.00th=[ 17], 50.00th=[ 21], 60.00th=[ 24], | 70.00th=[ 28], 80.00th=[ 33], 90.00th=[ 41], 95.00th=[ 48], | 99.00th=[ 79], 99.50th=[ 89], 99.90th=[ 115], 99.95th=[ 115], | 99.99th=[ 115] bw ( KiB/s): min= 159, max= 894, per=25.27%, avg=387.97, stdev=166.14, samples=32 iops : min= 9, max= 55, avg=23.69, stdev=10.33, samples=32 lat (msec) : 10=19.01%, 20=39.45%, 50=37.89%, 100=3.52%, 250=0.13% cpu : usr=0.06%, sys=14.27%, ctx=1757, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1460KiB/s (1495kB/s), 350KiB/s-381KiB/s (358kB/s-390kB/s), io=23.4MiB (24.5MB), run=16194-16407msec WRITE: bw=1536KiB/s (1573kB/s), 368KiB/s-399KiB/s (376kB/s-408kB/s), io=24.6MiB (25.8MB), run=16194-16407msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=186346: Wed Apr 22 12:28:06 2026 read: IOPS=3, BW=3468KiB/s (3551kB/s)(7168KiB/2067msec) clat (msec): min=49, max=318, avg=166.30, stdev=106.11 lat (msec): min=49, max=318, avg=166.31, stdev=106.11 clat percentiles (msec): | 1.00th=[ 50], 5.00th=[ 50], 10.00th=[ 50], 20.00th=[ 77], | 30.00th=[ 97], 40.00th=[ 97], 50.00th=[ 123], 60.00th=[ 224], | 70.00th=[ 224], 80.00th=[ 279], 90.00th=[ 321], 95.00th=[ 321], | 99.00th=[ 321], 99.50th=[ 321], 99.90th=[ 321], 99.95th=[ 321], | 99.99th=[ 321] bw ( KiB/s): min= 2031, max= 6989, per=50.67%, avg=3686.33, stdev=2860.20, samples=3 iops : min= 1, max= 6, avg= 2.67, stdev= 2.89, samples=3 write: IOPS=2, BW=2477KiB/s (2536kB/s)(5120KiB/2067msec); 0 zone resets clat (msec): min=81, max=255, avg=172.91, stdev=81.92 lat (msec): min=81, max=255, avg=172.97, stdev=81.93 clat percentiles (msec): | 1.00th=[ 83], 5.00th=[ 83], 10.00th=[ 83], 20.00th=[ 83], | 30.00th=[ 96], 40.00th=[ 96], 50.00th=[ 184], 60.00th=[ 184], | 70.00th=[ 249], 80.00th=[ 249], 90.00th=[ 255], 95.00th=[ 255], | 99.00th=[ 255], 99.50th=[ 255], 99.90th=[ 255], 99.95th=[ 255], | 99.99th=[ 255] bw ( KiB/s): min= 1747, max= 4079, per=25.71%, avg=2619.00, stdev=1272.35, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (msec) : 50=8.33%, 100=33.33%, 250=33.33%, 500=25.00% cpu : usr=0.00%, sys=15.88%, ctx=96, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=186347: Wed Apr 22 12:28:06 2026 read: IOPS=0, BW=728KiB/s (745kB/s)(2048KiB/2815msec) clat (msec): min=64, max=373, avg=218.76, stdev=218.32 lat (msec): min=64, max=373, avg=218.77, stdev=218.31 clat percentiles (msec): | 1.00th=[ 65], 5.00th=[ 65], 10.00th=[ 65], 20.00th=[ 65], | 30.00th=[ 65], 40.00th=[ 65], 50.00th=[ 65], 60.00th=[ 372], | 70.00th=[ 372], 80.00th=[ 372], 90.00th=[ 372], 95.00th=[ 372], | 99.00th=[ 372], 99.50th=[ 372], 99.90th=[ 372], 99.95th=[ 372], | 99.99th=[ 372] bw ( KiB/s): min= 1750, max= 2048, per=26.10%, avg=1899.00, stdev=210.72, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 write: IOPS=3, BW=3638KiB/s (3725kB/s)(10.0MiB/2815msec); 0 zone resets clat (msec): min=49, max=409, avg=235.32, stdev=123.87 lat (msec): min=49, max=409, avg=235.39, stdev=123.85 clat percentiles (msec): | 1.00th=[ 50], 5.00th=[ 50], 10.00th=[ 50], 20.00th=[ 85], | 30.00th=[ 104], 40.00th=[ 236], 50.00th=[ 239], 60.00th=[ 266], | 70.00th=[ 275], 80.00th=[ 296], 90.00th=[ 401], 95.00th=[ 409], | 99.00th=[ 409], 99.50th=[ 409], 99.90th=[ 409], 99.95th=[ 409], | 99.99th=[ 409] bw ( KiB/s): min= 2031, max= 8175, per=43.65%, avg=4446.25, stdev=2631.05, samples=4 iops : min= 1, max= 7, avg= 3.50, stdev= 2.52, samples=4 lat (msec) : 50=8.33%, 100=16.67%, 250=25.00%, 500=50.00% cpu : usr=0.04%, sys=23.99%, ctx=424, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=186348: Wed Apr 22 12:28:06 2026 read: IOPS=2, BW=2505KiB/s (2565kB/s)(6144KiB/2453msec) clat (msec): min=62, max=315, avg=180.29, stdev=112.85 lat (msec): min=62, max=315, avg=180.29, stdev=112.85 clat percentiles (msec): | 1.00th=[ 63], 5.00th=[ 63], 10.00th=[ 63], 20.00th=[ 72], | 30.00th=[ 72], 40.00th=[ 108], 50.00th=[ 108], 60.00th=[ 236], | 70.00th=[ 288], 80.00th=[ 288], 90.00th=[ 317], 95.00th=[ 317], | 99.00th=[ 317], 99.50th=[ 317], 99.90th=[ 317], 99.95th=[ 317], | 99.99th=[ 317] bw ( KiB/s): min= 2031, max= 2048, per=28.03%, avg=2039.33, stdev= 8.50, samples=3 iops : min= 1, max= 2, avg= 1.33, stdev= 0.58, samples=3 write: IOPS=2, BW=2505KiB/s (2565kB/s)(6144KiB/2453msec); 0 zone resets clat (msec): min=80, max=588, avg=223.03, stdev=198.76 lat (msec): min=80, max=588, avg=223.09, stdev=198.76 clat percentiles (msec): | 1.00th=[ 82], 5.00th=[ 82], 10.00th=[ 82], 20.00th=[ 85], | 30.00th=[ 85], 40.00th=[ 100], 50.00th=[ 100], 60.00th=[ 178], | 70.00th=[ 309], 80.00th=[ 309], 90.00th=[ 592], 95.00th=[ 592], | 99.00th=[ 592], 99.50th=[ 592], 99.90th=[ 592], 99.95th=[ 592], | 99.99th=[ 592] bw ( KiB/s): min= 2031, max= 3494, per=24.76%, avg=2521.33, stdev=842.36, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (msec) : 100=41.67%, 250=25.00%, 500=25.00%, 750=8.33% cpu : usr=0.00%, sys=15.95%, ctx=100, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=186349: Wed Apr 22 12:28:06 2026 read: IOPS=2, BW=2894KiB/s (2964kB/s)(5120KiB/1769msec) clat (msec): min=53, max=267, avg=166.35, stdev=94.77 lat (msec): min=53, max=267, avg=166.35, stdev=94.77 clat percentiles (msec): | 1.00th=[ 54], 5.00th=[ 54], 10.00th=[ 54], 20.00th=[ 54], | 30.00th=[ 79], 40.00th=[ 79], 50.00th=[ 205], 60.00th=[ 205], | 70.00th=[ 230], 80.00th=[ 230], 90.00th=[ 268], 95.00th=[ 268], | 99.00th=[ 268], 99.50th=[ 268], 99.90th=[ 268], 99.95th=[ 268], | 99.99th=[ 268] bw ( KiB/s): min= 4063, max= 4079, per=55.96%, avg=4071.00, stdev=11.31, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 write: IOPS=3, BW=4052KiB/s (4149kB/s)(7168KiB/1769msec); 0 zone resets clat (msec): min=52, max=280, avg=132.46, stdev=100.54 lat (msec): min=52, max=280, avg=132.53, stdev=100.53 clat percentiles (msec): | 1.00th=[ 53], 5.00th=[ 53], 10.00th=[ 53], 20.00th=[ 56], | 30.00th=[ 56], 40.00th=[ 56], 50.00th=[ 75], 60.00th=[ 146], | 70.00th=[ 146], 80.00th=[ 264], 90.00th=[ 279], 95.00th=[ 279], | 99.00th=[ 279], 99.50th=[ 279], 99.90th=[ 279], 99.95th=[ 279], | 99.99th=[ 279] bw ( KiB/s): min= 2031, max= 5260, per=37.21%, avg=3790.00, stdev=1633.78, samples=3 iops : min= 1, max= 5, avg= 3.00, stdev= 2.00, samples=3 lat (msec) : 100=50.00%, 250=25.00%, 500=25.00% cpu : usr=0.11%, sys=15.33%, ctx=75, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=7275KiB/s (7450kB/s), 728KiB/s-3468KiB/s (745kB/s-3551kB/s), io=20.0MiB (20.0MB), run=1769-2815msec WRITE: bw=9.95MiB/s (10.4MB/s), 2477KiB/s-4052KiB/s (2536kB/s-4149kB/s), io=28.0MiB (29.4MB), run=1769-2815msec rand-rw: (groupid=0, jobs=1): err= 0: pid=186351: Wed Apr 22 12:28:06 2026 read: IOPS=2, BW=3055KiB/s (3129kB/s)(7168KiB/2346msec) clat (usec): min=577, max=493404, avg=166220.86, stdev=153451.94 lat (usec): min=579, max=493406, avg=166222.27, stdev=153451.92 clat percentiles (usec): | 1.00th=[ 578], 5.00th=[ 578], 10.00th=[ 578], 20.00th=[110625], | 30.00th=[122160], 40.00th=[122160], 50.00th=[131597], 60.00th=[143655], | 70.00th=[143655], 80.00th=[162530], 90.00th=[492831], 95.00th=[492831], | 99.00th=[492831], 99.50th=[492831], 99.90th=[492831], 99.95th=[492831], | 99.99th=[492831] bw ( KiB/s): min= 1961, max= 5278, per=38.54%, avg=2833.75, stdev=1630.02, samples=4 iops : min= 1, max= 5, avg= 2.50, stdev= 1.73, samples=4 write: IOPS=2, BW=2182KiB/s (2235kB/s)(5120KiB/2346msec); 0 zone resets clat (msec): min=111, max=416, avg=227.82, stdev=138.18 lat (msec): min=111, max=416, avg=227.88, stdev=138.17 clat percentiles (msec): | 1.00th=[ 112], 5.00th=[ 112], 10.00th=[ 112], 20.00th=[ 112], | 30.00th=[ 132], 40.00th=[ 132], 50.00th=[ 146], 60.00th=[ 146], | 70.00th=[ 334], 80.00th=[ 334], 90.00th=[ 418], 95.00th=[ 418], | 99.00th=[ 418], 99.50th=[ 418], 99.90th=[ 418], 99.95th=[ 418], | 99.99th=[ 418] bw ( KiB/s): min= 1759, max= 4096, per=25.59%, avg=2634.33, stdev=1274.06, samples=3 iops : min= 1, max= 4, avg= 2.33, stdev= 1.53, samples=3 lat (usec) : 750=8.33% lat (msec) : 250=66.67%, 500=25.00% cpu : usr=0.00%, sys=45.50%, ctx=981, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=186352: Wed Apr 22 12:28:06 2026 read: IOPS=0, BW=735KiB/s (753kB/s)(2048KiB/2785msec) clat (msec): min=248, max=364, avg=306.33, stdev=82.35 lat (msec): min=248, max=364, avg=306.34, stdev=82.35 clat percentiles (msec): | 1.00th=[ 249], 5.00th=[ 249], 10.00th=[ 249], 20.00th=[ 249], | 30.00th=[ 249], 40.00th=[ 249], 50.00th=[ 249], 60.00th=[ 363], | 70.00th=[ 363], 80.00th=[ 363], 90.00th=[ 363], 95.00th=[ 363], | 99.00th=[ 363], 99.50th=[ 363], 99.90th=[ 363], 99.95th=[ 363], | 99.99th=[ 363] bw ( KiB/s): min= 1762, max= 2048, per=25.91%, avg=1905.00, stdev=202.23, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 write: IOPS=3, BW=3677KiB/s (3765kB/s)(10.0MiB/2785msec); 0 zone resets clat (msec): min=102, max=323, avg=212.49, stdev=86.86 lat (msec): min=102, max=323, avg=212.54, stdev=86.86 clat percentiles (msec): | 1.00th=[ 103], 5.00th=[ 103], 10.00th=[ 103], 20.00th=[ 131], | 30.00th=[ 138], 40.00th=[ 148], 50.00th=[ 180], 60.00th=[ 192], | 70.00th=[ 300], 80.00th=[ 309], 90.00th=[ 309], 95.00th=[ 326], | 99.00th=[ 326], 99.50th=[ 326], 99.90th=[ 326], 99.95th=[ 326], | 99.99th=[ 326] bw ( KiB/s): min= 2048, max= 6144, per=39.16%, avg=4031.25, stdev=2292.50, samples=4 iops : min= 2, max= 6, avg= 3.75, stdev= 2.06, samples=4 lat (msec) : 250=58.33%, 500=41.67% cpu : usr=0.04%, sys=50.04%, ctx=464, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=186353: Wed Apr 22 12:28:06 2026 read: IOPS=2, BW=2403KiB/s (2460kB/s)(6144KiB/2557msec) clat (usec): min=459, max=256079, avg=125830.65, stdev=89041.13 lat (usec): min=460, max=256080, avg=125831.67, stdev=89041.02 clat percentiles (usec): | 1.00th=[ 461], 5.00th=[ 461], 10.00th=[ 461], 20.00th=[ 84411], | 30.00th=[ 84411], 40.00th=[ 88605], 50.00th=[ 88605], 60.00th=[139461], | 70.00th=[185598], 80.00th=[185598], 90.00th=[256902], 95.00th=[256902], | 99.00th=[256902], 99.50th=[256902], 99.90th=[256902], 99.95th=[256902], | 99.99th=[256902] bw ( KiB/s): min= 4096, max= 4096, per=55.71%, avg=4096.00, stdev= 0.00, samples=2 iops : min= 4, max= 4, avg= 4.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2403KiB/s (2460kB/s)(6144KiB/2557msec); 0 zone resets clat (msec): min=162, max=610, avg=298.18, stdev=167.07 lat (msec): min=162, max=610, avg=298.24, stdev=167.08 clat percentiles (msec): | 1.00th=[ 163], 5.00th=[ 163], 10.00th=[ 163], 20.00th=[ 182], | 30.00th=[ 182], 40.00th=[ 203], 50.00th=[ 203], 60.00th=[ 309], | 70.00th=[ 321], 80.00th=[ 321], 90.00th=[ 609], 95.00th=[ 609], | 99.00th=[ 609], 99.50th=[ 609], 99.90th=[ 609], 99.95th=[ 609], | 99.99th=[ 609] bw ( KiB/s): min= 2048, max= 3500, per=24.59%, avg=2532.00, stdev=838.31, samples=3 iops : min= 2, max= 3, avg= 2.33, stdev= 0.58, samples=3 lat (usec) : 500=8.33% lat (msec) : 100=16.67%, 250=41.67%, 500=25.00%, 750=8.33% cpu : usr=0.04%, sys=41.90%, ctx=867, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=186354: Wed Apr 22 12:28:06 2026 read: IOPS=1, BW=1852KiB/s (1897kB/s)(5120KiB/2764msec) clat (usec): min=537, max=227006, avg=128203.09, stdev=88767.82 lat (usec): min=538, max=227007, avg=128204.31, stdev=88767.84 clat percentiles (usec): | 1.00th=[ 537], 5.00th=[ 537], 10.00th=[ 537], 20.00th=[ 537], | 30.00th=[102237], 40.00th=[102237], 50.00th=[114820], 60.00th=[114820], | 70.00th=[196084], 80.00th=[196084], 90.00th=[227541], 95.00th=[227541], | 99.00th=[227541], 99.50th=[227541], 99.90th=[227541], 99.95th=[227541], | 99.99th=[227541] bw ( KiB/s): min= 4096, max= 4096, per=55.71%, avg=4096.00, stdev= 0.00, samples=2 iops : min= 4, max= 4, avg= 4.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2593KiB/s (2656kB/s)(7168KiB/2764msec); 0 zone resets clat (msec): min=86, max=523, avg=300.25, stdev=187.08 lat (msec): min=86, max=523, avg=300.32, stdev=187.07 clat percentiles (msec): | 1.00th=[ 87], 5.00th=[ 87], 10.00th=[ 87], 20.00th=[ 110], | 30.00th=[ 165], 40.00th=[ 165], 50.00th=[ 279], 60.00th=[ 439], | 70.00th=[ 439], 80.00th=[ 498], 90.00th=[ 523], 95.00th=[ 523], | 99.00th=[ 523], 99.50th=[ 523], 99.90th=[ 523], 99.95th=[ 523], | 99.99th=[ 523] bw ( KiB/s): min= 1787, max= 2048, per=19.22%, avg=1978.40, stdev=113.43, samples=5 iops : min= 1, max= 2, avg= 1.60, stdev= 0.55, samples=5 lat (usec) : 750=8.33% lat (msec) : 100=8.33%, 250=50.00%, 500=25.00%, 750=8.33% cpu : usr=0.07%, sys=32.61%, ctx=363, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=7354KiB/s (7530kB/s), 735KiB/s-3055KiB/s (753kB/s-3129kB/s), io=20.0MiB (20.0MB), run=2346-2785msec WRITE: bw=10.1MiB/s (10.5MB/s), 2182KiB/s-3677KiB/s (2235kB/s-3765kB/s), io=28.0MiB (29.4MB), run=2346-2785msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=186360: Wed Apr 22 12:28:16 2026 read: IOPS=1, BW=4759KiB/s (4873kB/s)(12.0MiB/2582msec) clat (msec): min=198, max=1397, avg=838.24, stdev=603.39 lat (msec): min=198, max=1397, avg=838.25, stdev=603.39 clat percentiles (msec): | 1.00th=[ 199], 5.00th=[ 199], 10.00th=[ 199], 20.00th=[ 199], | 30.00th=[ 199], 40.00th=[ 919], 50.00th=[ 919], 60.00th=[ 919], | 70.00th=[ 1401], 80.00th=[ 1401], 90.00th=[ 1401], 95.00th=[ 1401], | 99.00th=[ 1401], 99.50th=[ 1401], 99.90th=[ 1401], 99.95th=[ 1401], | 99.99th=[ 1401] bw ( KiB/s): min= 8192, max= 8192, per=100.00%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=11.00%, ctx=78, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=186361: Wed Apr 22 12:28:16 2026 read: IOPS=0, BW=1407KiB/s (1441kB/s)(4096KiB/2911msec) clat (nsec): min=1792.6M, max=1792.6M, avg=1792555079.00, stdev= 0.00 lat (nsec): min=1792.6M, max=1792.6M, avg=1792556059.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1787], 5.00th=[ 1787], 10.00th=[ 1787], 20.00th=[ 1787], | 30.00th=[ 1787], 40.00th=[ 1787], 50.00th=[ 1787], 60.00th=[ 1787], | 70.00th=[ 1787], 80.00th=[ 1787], 90.00th=[ 1787], 95.00th=[ 1787], | 99.00th=[ 1787], 99.50th=[ 1787], 99.90th=[ 1787], 99.95th=[ 1787], | 99.99th=[ 1787] bw ( KiB/s): min= 8192, max= 8192, per=100.00%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2814KiB/s (2882kB/s)(8192KiB/2911msec); 0 zone resets clat (msec): min=474, max=552, avg=513.60, stdev=55.09 lat (msec): min=474, max=552, avg=513.90, stdev=55.06 clat percentiles (msec): | 1.00th=[ 477], 5.00th=[ 477], 10.00th=[ 477], 20.00th=[ 477], | 30.00th=[ 477], 40.00th=[ 477], 50.00th=[ 477], 60.00th=[ 550], | 70.00th=[ 550], 80.00th=[ 550], 90.00th=[ 550], 95.00th=[ 550], | 99.00th=[ 550], 99.50th=[ 550], 99.90th=[ 550], 99.95th=[ 550], | 99.99th=[ 550] bw ( KiB/s): min= 8192, max= 8192, per=72.78%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.00%, sys=11.37%, ctx=73, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=186362: Wed Apr 22 12:28:16 2026 write: IOPS=1, BW=5668KiB/s (5804kB/s)(12.0MiB/2168msec); 0 zone resets clat (msec): min=589, max=774, avg=684.86, stdev=92.77 lat (msec): min=589, max=775, avg=685.13, stdev=92.68 clat percentiles (msec): | 1.00th=[ 592], 5.00th=[ 592], 10.00th=[ 592], 20.00th=[ 592], | 30.00th=[ 592], 40.00th=[ 693], 50.00th=[ 693], 60.00th=[ 693], | 70.00th=[ 776], 80.00th=[ 776], 90.00th=[ 776], 95.00th=[ 776], | 99.00th=[ 776], 99.50th=[ 776], 99.90th=[ 776], 99.95th=[ 776], | 99.99th=[ 776] bw ( KiB/s): min= 8192, max= 8192, per=72.78%, avg=8192.00, stdev= 0.00, samples=2 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=2 lat (msec) : 750=66.67%, 1000=33.33% cpu : usr=0.00%, sys=16.43%, ctx=258, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=186363: Wed Apr 22 12:28:16 2026 write: IOPS=1, BW=4378KiB/s (4483kB/s)(12.0MiB/2807msec); 0 zone resets clat (msec): min=144, max=1844, avg=900.23, stdev=865.78 lat (msec): min=144, max=1845, avg=900.55, stdev=865.75 clat percentiles (msec): | 1.00th=[ 144], 5.00th=[ 144], 10.00th=[ 144], 20.00th=[ 144], | 30.00th=[ 144], 40.00th=[ 709], 50.00th=[ 709], 60.00th=[ 709], | 70.00th=[ 1838], 80.00th=[ 1838], 90.00th=[ 1838], 95.00th=[ 1838], | 99.00th=[ 1838], 99.50th=[ 1838], 99.90th=[ 1838], 99.95th=[ 1838], | 99.99th=[ 1838] bw ( KiB/s): min= 8192, max= 8192, per=72.78%, avg=8192.00, stdev= 0.00, samples=2 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=2 lat (msec) : 250=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.00%, sys=13.93%, ctx=76, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5628KiB/s (5763kB/s), 1407KiB/s-4759KiB/s (1441kB/s-4873kB/s), io=16.0MiB (16.8MB), run=2582-2911msec WRITE: bw=10.0MiB/s (11.5MB/s), 2814KiB/s-5668KiB/s (2882kB/s-5804kB/s), io=32.0MiB (33.6MB), run=2168-2911msec rand-rw: (groupid=0, jobs=1): err= 0: pid=186364: Wed Apr 22 12:28:16 2026 read: IOPS=1, BW=5510KiB/s (5643kB/s)(12.0MiB/2230msec) clat (msec): min=423, max=1291, avg=729.32, stdev=487.12 lat (msec): min=423, max=1291, avg=729.32, stdev=487.12 clat percentiles (msec): | 1.00th=[ 422], 5.00th=[ 422], 10.00th=[ 422], 20.00th=[ 422], | 30.00th=[ 422], 40.00th=[ 472], 50.00th=[ 472], 60.00th=[ 472], | 70.00th=[ 1284], 80.00th=[ 1284], 90.00th=[ 1284], 95.00th=[ 1284], | 99.00th=[ 1284], 99.50th=[ 1284], 99.90th=[ 1284], 99.95th=[ 1284], | 99.99th=[ 1284] bw ( KiB/s): min= 8126, max= 8192, per=100.00%, avg=8159.00, stdev=46.67, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 500=66.67%, 2000=33.33% cpu : usr=0.00%, sys=36.52%, ctx=2197, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=186365: Wed Apr 22 12:28:16 2026 read: IOPS=0, BW=1644KiB/s (1684kB/s)(4096KiB/2491msec) clat (nsec): min=955045k, max=955045k, avg=955044604.00, stdev= 0.00 lat (nsec): min=955046k, max=955046k, avg=955046204.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 953], 5.00th=[ 953], 10.00th=[ 953], 20.00th=[ 953], | 30.00th=[ 953], 40.00th=[ 953], 50.00th=[ 953], 60.00th=[ 953], | 70.00th=[ 953], 80.00th=[ 953], 90.00th=[ 953], 95.00th=[ 953], | 99.00th=[ 953], 99.50th=[ 953], 99.90th=[ 953], 99.95th=[ 953], | 99.99th=[ 953] bw ( KiB/s): min= 8192, max= 8192, per=100.00%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 write: IOPS=0, BW=3289KiB/s (3368kB/s)(8192KiB/2491msec); 0 zone resets clat (msec): min=645, max=873, avg=759.60, stdev=161.22 lat (msec): min=645, max=873, avg=759.81, stdev=161.31 clat percentiles (msec): | 1.00th=[ 642], 5.00th=[ 642], 10.00th=[ 642], 20.00th=[ 642], | 30.00th=[ 642], 40.00th=[ 642], 50.00th=[ 642], 60.00th=[ 877], | 70.00th=[ 877], 80.00th=[ 877], 90.00th=[ 877], 95.00th=[ 877], | 99.00th=[ 877], 99.50th=[ 877], 99.90th=[ 877], 99.95th=[ 877], | 99.99th=[ 877] bw ( KiB/s): min= 8192, max= 8192, per=71.28%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, 1000=66.67% cpu : usr=0.04%, sys=20.56%, ctx=978, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=186366: Wed Apr 22 12:28:16 2026 write: IOPS=1, BW=4310KiB/s (4414kB/s)(12.0MiB/2851msec); 0 zone resets clat (msec): min=130, max=2319, avg=937.73, stdev=1201.98 lat (msec): min=131, max=2319, avg=938.02, stdev=1201.98 clat percentiles (msec): | 1.00th=[ 131], 5.00th=[ 131], 10.00th=[ 131], 20.00th=[ 131], | 30.00th=[ 131], 40.00th=[ 363], 50.00th=[ 363], 60.00th=[ 363], | 70.00th=[ 2333], 80.00th=[ 2333], 90.00th=[ 2333], 95.00th=[ 2333], | 99.00th=[ 2333], 99.50th=[ 2333], 99.90th=[ 2333], 99.95th=[ 2333], | 99.99th=[ 2333] bw ( KiB/s): min=15937, max=15937, per=100.00%, avg=15937.00, stdev= 0.00, samples=1 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 500=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=10.42%, ctx=77, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=186367: Wed Apr 22 12:28:16 2026 write: IOPS=1, BW=4927KiB/s (5045kB/s)(12.0MiB/2494msec); 0 zone resets clat (msec): min=421, max=1268, avg=824.66, stdev=424.78 lat (msec): min=422, max=1268, avg=824.89, stdev=424.81 clat percentiles (msec): | 1.00th=[ 422], 5.00th=[ 422], 10.00th=[ 422], 20.00th=[ 422], | 30.00th=[ 422], 40.00th=[ 785], 50.00th=[ 785], 60.00th=[ 785], | 70.00th=[ 1267], 80.00th=[ 1267], 90.00th=[ 1267], 95.00th=[ 1267], | 99.00th=[ 1267], 99.50th=[ 1267], 99.90th=[ 1267], 99.95th=[ 1267], | 99.99th=[ 1267] bw ( KiB/s): min= 8126, max= 8192, per=70.99%, avg=8159.00, stdev=46.67, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 500=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=10.43%, ctx=66, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=6577KiB/s (6735kB/s), 1644KiB/s-5510KiB/s (1684kB/s-5643kB/s), io=16.0MiB (16.8MB), run=2230-2491msec WRITE: bw=11.2MiB/s (11.8MB/s), 3289KiB/s-4927KiB/s (3368kB/s-5045kB/s), io=32.0MiB (33.6MB), run=2491-2851msec