== sanity test 398b: DIO and buffer IO race ============== 21:08:22 (1777424902) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 2.3252 s, 21.6 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=158442: Tue Apr 28 21:09:21 2026 read: IOPS=29, BW=118KiB/s (121kB/s)(5992KiB/50747msec) clat (usec): min=42, max=919756, avg=17839.85, stdev=25323.74 lat (usec): min=42, max=919757, avg=17840.62, stdev=25323.74 clat percentiles (usec): | 1.00th=[ 98], 5.00th=[ 6325], 10.00th=[ 7963], 20.00th=[ 9896], | 30.00th=[ 11731], 40.00th=[ 13435], 50.00th=[ 15270], 60.00th=[ 17171], | 70.00th=[ 19792], 80.00th=[ 23462], 90.00th=[ 30016], 95.00th=[ 35914], | 99.00th=[ 53216], 99.50th=[ 59507], 99.90th=[ 78119], 99.95th=[918553], | 99.99th=[918553] bw ( KiB/s): min= 12, max= 198, per=24.95%, avg=117.50, stdev=34.27, samples=100 iops : min= 3, max= 49, avg=28.96, stdev= 8.60, samples=100 write: IOPS=31, BW=124KiB/s (127kB/s)(6296KiB/50747msec); 0 zone resets clat (usec): min=733, max=103473, avg=15138.16, stdev=12055.69 lat (usec): min=734, max=103475, avg=15139.27, stdev=12055.68 clat percentiles (usec): | 1.00th=[ 1123], 5.00th=[ 2409], 10.00th=[ 2933], 20.00th=[ 4424], | 30.00th=[ 6652], 40.00th=[ 9634], 50.00th=[ 12387], 60.00th=[ 15664], | 70.00th=[ 18744], 80.00th=[ 23200], 90.00th=[ 32375], 95.00th=[ 39584], | 99.00th=[ 53216], 99.50th=[ 59507], 99.90th=[ 73925], 99.95th=[103285], | 99.99th=[103285] bw ( KiB/s): min= 8, max= 208, per=25.20%, avg=124.24, stdev=37.42, samples=99 iops : min= 2, max= 52, avg=30.64, stdev= 9.43, samples=99 lat (usec) : 50=0.03%, 100=0.46%, 250=0.98%, 500=0.07%, 750=0.03% lat (usec) : 1000=0.33% lat (msec) : 2=1.43%, 4=7.45%, 10=20.28%, 20=40.85%, 50=26.69% lat (msec) : 100=1.33%, 250=0.03%, 1000=0.03% cpu : usr=0.15%, sys=28.06%, ctx=9492, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=158443: Tue Apr 28 21:09:21 2026 read: IOPS=29, BW=117KiB/s (120kB/s)(5940KiB/50574msec) clat (usec): min=31, max=73948, avg=17423.97, stdev=10231.26 lat (usec): min=31, max=73949, avg=17424.74, stdev=10231.30 clat percentiles (usec): | 1.00th=[ 82], 5.00th=[ 5800], 10.00th=[ 7635], 20.00th=[ 9634], | 30.00th=[11469], 40.00th=[13435], 50.00th=[15533], 60.00th=[17695], | 70.00th=[20317], 80.00th=[23987], 90.00th=[30540], 95.00th=[36963], | 99.00th=[50070], 99.50th=[62129], 99.90th=[72877], 99.95th=[73925], | 99.99th=[73925] bw ( KiB/s): min= 6, max= 208, per=25.14%, avg=118.39, stdev=35.32, samples=99 iops : min= 1, max= 52, avg=29.17, stdev= 8.87, samples=99 write: IOPS=31, BW=126KiB/s (129kB/s)(6348KiB/50574msec); 0 zone resets clat (usec): min=728, max=836105, avg=15441.81, stdev=23785.48 lat (usec): min=728, max=836106, avg=15442.83, stdev=23785.49 clat percentiles (usec): | 1.00th=[ 1057], 5.00th=[ 2212], 10.00th=[ 2835], 20.00th=[ 4424], | 30.00th=[ 6718], 40.00th=[ 9765], 50.00th=[ 12518], 60.00th=[ 15270], | 70.00th=[ 19006], 80.00th=[ 23462], 90.00th=[ 30278], 95.00th=[ 36439], | 99.00th=[ 53216], 99.50th=[ 58459], 99.90th=[107480], 99.95th=[834667], | 99.99th=[834667] bw ( KiB/s): min= 6, max= 248, per=25.33%, avg=124.87, stdev=44.46, samples=100 iops : min= 1, max= 62, avg=30.80, stdev=11.15, samples=100 lat (usec) : 50=0.20%, 100=0.62%, 250=0.88%, 500=0.13%, 750=0.07% lat (usec) : 1000=0.42% lat (msec) : 2=1.50%, 4=7.36%, 10=20.70%, 20=38.87%, 50=28.09% lat (msec) : 100=1.11%, 250=0.03%, 1000=0.03% cpu : usr=0.14%, sys=27.72%, ctx=9362, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=158444: Tue Apr 28 21:09:21 2026 read: IOPS=29, BW=119KiB/s (122kB/s)(6028KiB/50598msec) clat (usec): min=34, max=79058, avg=17231.01, stdev=10068.25 lat (usec): min=34, max=79059, avg=17231.90, stdev=10068.31 clat percentiles (usec): | 1.00th=[ 97], 5.00th=[ 5932], 10.00th=[ 7570], 20.00th=[ 9503], | 30.00th=[11207], 40.00th=[12649], 50.00th=[15139], 60.00th=[17433], | 70.00th=[20579], 80.00th=[24511], 90.00th=[30802], 95.00th=[36439], | 99.00th=[50594], 99.50th=[54264], 99.90th=[69731], 99.95th=[79168], | 99.99th=[79168] bw ( KiB/s): min= 55, max= 216, per=25.76%, avg=121.34, stdev=32.98, samples=98 iops : min= 13, max= 54, avg=29.91, stdev= 8.29, samples=98 write: IOPS=30, BW=124KiB/s (127kB/s)(6260KiB/50598msec); 0 zone resets clat (usec): min=669, max=864836, avg=15607.10, stdev=24614.84 lat (usec): min=669, max=864839, avg=15608.51, stdev=24614.83 clat percentiles (usec): | 1.00th=[ 1123], 5.00th=[ 2507], 10.00th=[ 3032], 20.00th=[ 4555], | 30.00th=[ 6783], 40.00th=[ 9634], 50.00th=[ 12518], 60.00th=[ 15401], | 70.00th=[ 19006], 80.00th=[ 23200], 90.00th=[ 30802], 95.00th=[ 38011], | 99.00th=[ 56361], 99.50th=[ 68682], 99.90th=[114820], 99.95th=[868221], | 99.99th=[868221] bw ( KiB/s): min= 24, max= 224, per=25.27%, avg=124.57, stdev=39.08, samples=99 iops : min= 6, max= 56, avg=30.72, stdev= 9.83, samples=99 lat (usec) : 50=0.10%, 100=0.42%, 250=1.40%, 500=0.10%, 750=0.03% lat (usec) : 1000=0.29% lat (msec) : 2=1.04%, 4=6.90%, 10=21.91%, 20=38.28%, 50=28.32% lat (msec) : 100=1.14%, 250=0.03%, 1000=0.03% cpu : usr=0.11%, sys=27.87%, ctx=9368, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=158445: Tue Apr 28 21:09:21 2026 read: IOPS=29, BW=119KiB/s (122kB/s)(6052KiB/50948msec) clat (usec): min=40, max=99542, avg=17669.73, stdev=10627.74 lat (usec): min=41, max=99542, avg=17670.65, stdev=10627.74 clat percentiles (usec): | 1.00th=[ 103], 5.00th=[ 5866], 10.00th=[ 7439], 20.00th=[ 9634], | 30.00th=[11469], 40.00th=[13566], 50.00th=[15795], 60.00th=[17957], | 70.00th=[20579], 80.00th=[24249], 90.00th=[30802], 95.00th=[36963], | 99.00th=[54264], 99.50th=[63177], 99.90th=[79168], 99.95th=[99091], | 99.99th=[99091] bw ( KiB/s): min= 48, max= 216, per=25.35%, avg=119.39, stdev=32.19, samples=100 iops : min= 12, max= 54, avg=29.42, stdev= 8.03, samples=100 write: IOPS=30, BW=122KiB/s (125kB/s)(6236KiB/50948msec); 0 zone resets clat (usec): min=755, max=845534, avg=15403.41, stdev=23914.12 lat (usec): min=756, max=845534, avg=15410.02, stdev=23914.16 clat percentiles (usec): | 1.00th=[ 1123], 5.00th=[ 2507], 10.00th=[ 3130], 20.00th=[ 4555], | 30.00th=[ 6915], 40.00th=[ 9765], 50.00th=[ 12387], 60.00th=[ 15270], | 70.00th=[ 18744], 80.00th=[ 23462], 90.00th=[ 30016], 95.00th=[ 37487], | 99.00th=[ 51119], 99.50th=[ 56886], 99.90th=[ 82314], 99.95th=[843056], | 99.99th=[843056] bw ( KiB/s): min= 13, max= 223, per=24.73%, avg=121.90, stdev=41.95, samples=101 iops : min= 3, max= 55, avg=30.05, stdev=10.56, samples=101 lat (usec) : 50=0.07%, 100=0.42%, 250=1.24%, 500=0.10%, 1000=0.29% lat (msec) : 2=1.17%, 4=6.84%, 10=21.48%, 20=38.96%, 50=28.06% lat (msec) : 100=1.33%, 1000=0.03% cpu : usr=0.14%, sys=27.68%, ctx=9430, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=471KiB/s (483kB/s), 117KiB/s-119KiB/s (120kB/s-122kB/s), io=23.4MiB (24.6MB), run=50574-50948msec WRITE: bw=493KiB/s (505kB/s), 122KiB/s-126KiB/s (125kB/s-129kB/s), io=24.6MiB (25.7MB), run=50574-50948msec rand-rw: (groupid=0, jobs=1): err= 0: pid=158437: Tue Apr 28 21:09:41 2026 read: IOPS=21, BW=85.5KiB/s (87.5kB/s)(5992KiB/70112msec) clat (msec): min=2, max=932, avg=14.36, stdev=27.25 lat (msec): min=2, max=932, avg=14.37, stdev=27.25 clat percentiles (msec): | 1.00th=[ 3], 5.00th=[ 4], 10.00th=[ 4], 20.00th=[ 5], | 30.00th=[ 5], 40.00th=[ 6], 50.00th=[ 9], 60.00th=[ 12], | 70.00th=[ 17], 80.00th=[ 22], 90.00th=[ 32], 95.00th=[ 43], | 99.00th=[ 64], 99.50th=[ 72], 99.90th=[ 95], 99.95th=[ 936], | 99.99th=[ 936] bw ( KiB/s): min= 23, max= 232, per=25.39%, avg=86.34, stdev=52.18, samples=137 iops : min= 5, max= 58, avg=21.30, stdev=13.20, samples=137 write: IOPS=22, BW=89.8KiB/s (91.0kB/s)(6296KiB/70112msec); 0 zone resets clat (msec): min=12, max=132, avg=30.71, stdev=16.61 lat (msec): min=12, max=132, avg=30.71, stdev=16.61 clat percentiles (msec): | 1.00th=[ 14], 5.00th=[ 16], 10.00th=[ 17], 20.00th=[ 18], | 30.00th=[ 20], 40.00th=[ 22], 50.00th=[ 25], 60.00th=[ 29], | 70.00th=[ 35], 80.00th=[ 43], 90.00th=[ 53], 95.00th=[ 64], | 99.00th=[ 88], 99.50th=[ 112], 99.90th=[ 132], 99.95th=[ 133], | 99.99th=[ 133] bw ( KiB/s): min= 24, max= 184, per=25.41%, avg=90.72, stdev=48.95, samples=137 iops : min= 6, max= 46, avg=22.39, stdev=12.42, samples=137 lat (msec) : 4=8.17%, 10=18.62%, 20=26.56%, 50=39.00%, 100=7.32% lat (msec) : 250=0.29%, 1000=0.03% cpu : usr=0.11%, sys=10.35%, ctx=5927, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=158438: Tue Apr 28 21:09:41 2026 read: IOPS=21, BW=84.5KiB/s (86.5kB/s)(5940KiB/70313msec) clat (msec): min=2, max=844, avg=14.15, stdev=25.82 lat (msec): min=2, max=844, avg=14.15, stdev=25.82 clat percentiles (msec): | 1.00th=[ 3], 5.00th=[ 4], 10.00th=[ 4], 20.00th=[ 5], | 30.00th=[ 5], 40.00th=[ 6], 50.00th=[ 8], 60.00th=[ 12], | 70.00th=[ 16], 80.00th=[ 21], 90.00th=[ 32], 95.00th=[ 45], | 99.00th=[ 68], 99.50th=[ 80], 99.90th=[ 115], 99.95th=[ 844], | 99.99th=[ 844] bw ( KiB/s): min= 8, max= 240, per=25.01%, avg=85.04, stdev=53.29, samples=139 iops : min= 2, max= 60, avg=20.98, stdev=13.47, samples=139 write: IOPS=22, BW=90.3KiB/s (92.4kB/s)(6348KiB/70313msec); 0 zone resets clat (msec): min=10, max=143, avg=30.90, stdev=16.32 lat (msec): min=10, max=143, avg=30.90, stdev=16.32 clat percentiles (msec): | 1.00th=[ 14], 5.00th=[ 16], 10.00th=[ 17], 20.00th=[ 18], | 30.00th=[ 20], 40.00th=[ 23], 50.00th=[ 26], 60.00th=[ 30], | 70.00th=[ 37], 80.00th=[ 44], 90.00th=[ 54], 95.00th=[ 63], | 99.00th=[ 83], 99.50th=[ 97], 99.90th=[ 130], 99.95th=[ 144], | 99.99th=[ 144] bw ( KiB/s): min= 23, max= 200, per=25.63%, avg=91.51, stdev=48.94, samples=138 iops : min= 5, max= 50, avg=22.59, stdev=12.42, samples=138 lat (msec) : 4=8.14%, 10=18.62%, 20=27.93%, 50=37.40%, 100=7.62% lat (msec) : 250=0.26%, 1000=0.03% cpu : usr=0.10%, sys=10.37%, ctx=5894, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=158439: Tue Apr 28 21:09:41 2026 read: IOPS=21, BW=85.6KiB/s (87.7kB/s)(6028KiB/70419msec) clat (msec): min=2, max=110, avg=13.95, stdev=14.18 lat (msec): min=2, max=110, avg=13.95, stdev=14.18 clat percentiles (msec): | 1.00th=[ 3], 5.00th=[ 4], 10.00th=[ 4], 20.00th=[ 5], | 30.00th=[ 5], 40.00th=[ 6], 50.00th=[ 9], 60.00th=[ 13], | 70.00th=[ 17], 80.00th=[ 22], 90.00th=[ 32], 95.00th=[ 44], | 99.00th=[ 68], 99.50th=[ 84], 99.90th=[ 107], 99.95th=[ 110], | 99.99th=[ 110] bw ( KiB/s): min= 23, max= 256, per=25.45%, avg=86.52, stdev=50.31, samples=138 iops : min= 5, max= 64, avg=21.35, stdev=12.75, samples=138 write: IOPS=22, BW=88.9KiB/s (91.0kB/s)(6260KiB/70419msec); 0 zone resets clat (msec): min=9, max=857, avg=31.40, stdev=26.53 lat (msec): min=9, max=857, avg=31.40, stdev=26.53 clat percentiles (msec): | 1.00th=[ 13], 5.00th=[ 16], 10.00th=[ 17], 20.00th=[ 19], | 30.00th=[ 21], 40.00th=[ 23], 50.00th=[ 25], 60.00th=[ 29], | 70.00th=[ 36], 80.00th=[ 44], 90.00th=[ 54], 95.00th=[ 64], | 99.00th=[ 87], 99.50th=[ 96], 99.90th=[ 130], 99.95th=[ 860], | 99.99th=[ 860] bw ( KiB/s): min= 15, max= 184, per=24.95%, avg=89.06, stdev=48.85, samples=139 iops : min= 3, max= 46, avg=21.99, stdev=12.40, samples=139 lat (msec) : 4=7.68%, 10=19.30%, 20=25.65%, 50=39.71%, 100=7.36% lat (msec) : 250=0.26%, 1000=0.03% cpu : usr=0.12%, sys=10.27%, ctx=6014, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=158440: Tue Apr 28 21:09:41 2026 read: IOPS=21, BW=86.3KiB/s (88.4kB/s)(6052KiB/70140msec) clat (usec): min=2521, max=98806, avg=13989.79, stdev=14569.05 lat (usec): min=2521, max=98807, avg=13991.38, stdev=14569.45 clat percentiles (usec): | 1.00th=[ 2933], 5.00th=[ 3294], 10.00th=[ 3589], 20.00th=[ 4113], | 30.00th=[ 4686], 40.00th=[ 5407], 50.00th=[ 7373], 60.00th=[11469], | 70.00th=[15270], 80.00th=[22414], 90.00th=[32375], 95.00th=[44827], | 99.00th=[68682], 99.50th=[79168], 99.90th=[94897], 99.95th=[99091], | 99.99th=[99091] bw ( KiB/s): min= 8, max= 264, per=25.56%, avg=86.92, stdev=53.57, samples=137 iops : min= 2, max= 66, avg=21.45, stdev=13.56, samples=137 write: IOPS=22, BW=88.9KiB/s (91.0kB/s)(6236KiB/70140msec); 0 zone resets clat (msec): min=13, max=861, avg=31.25, stdev=26.76 lat (msec): min=13, max=861, avg=31.25, stdev=26.76 clat percentiles (msec): | 1.00th=[ 15], 5.00th=[ 16], 10.00th=[ 17], 20.00th=[ 18], | 30.00th=[ 21], 40.00th=[ 23], 50.00th=[ 25], 60.00th=[ 29], | 70.00th=[ 35], 80.00th=[ 43], 90.00th=[ 53], 95.00th=[ 62], | 99.00th=[ 89], 99.50th=[ 122], 99.90th=[ 136], 99.95th=[ 860], | 99.99th=[ 860] bw ( KiB/s): min= 8, max= 192, per=24.97%, avg=89.13, stdev=48.23, samples=138 iops : min= 2, max= 48, avg=22.00, stdev=12.24, samples=138 lat (msec) : 4=8.72%, 10=18.91%, 20=25.68%, 50=38.87%, 100=7.49% lat (msec) : 250=0.29%, 1000=0.03% cpu : usr=0.13%, sys=10.22%, ctx=5849, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=341KiB/s (349kB/s), 84.5KiB/s-86.3KiB/s (86.5kB/s-88.4kB/s), io=23.4MiB (24.6MB), run=70112-70419msec WRITE: bw=357KiB/s (366kB/s), 88.9KiB/s-90.3KiB/s (91.0kB/s-92.4kB/s), io=24.6MiB (25.7MB), run=70112-70419msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=158474: Tue Apr 28 21:09:58 2026 read: IOPS=30, BW=487KiB/s (498kB/s)(5920KiB/12166msec) clat (usec): min=30, max=77579, avg=16387.07, stdev=10441.63 lat (usec): min=31, max=77581, avg=16387.95, stdev=10441.53 clat percentiles (usec): | 1.00th=[ 82], 5.00th=[ 117], 10.00th=[ 6980], 20.00th=[ 9634], | 30.00th=[10945], 40.00th=[12387], 50.00th=[14877], 60.00th=[16712], | 70.00th=[19006], 80.00th=[22414], 90.00th=[28443], 95.00th=[36439], | 99.00th=[51119], 99.50th=[56886], 99.90th=[77071], 99.95th=[77071], | 99.99th=[77071] bw ( KiB/s): min= 223, max= 764, per=24.76%, avg=484.08, stdev=152.64, samples=24 iops : min= 13, max= 47, avg=29.75, stdev= 9.57, samples=24 write: IOPS=32, BW=523KiB/s (536kB/s)(6368KiB/12166msec); 0 zone resets clat (usec): min=1137, max=85250, avg=15174.79, stdev=11261.88 lat (usec): min=1139, max=85251, avg=15176.40, stdev=11261.85 clat percentiles (usec): | 1.00th=[ 2573], 5.00th=[ 3851], 10.00th=[ 4293], 20.00th=[ 5342], | 30.00th=[ 7635], 40.00th=[ 9765], 50.00th=[12387], 60.00th=[15270], | 70.00th=[19268], 80.00th=[23462], 90.00th=[28967], 95.00th=[34866], | 99.00th=[54264], 99.50th=[62129], 99.90th=[85459], 99.95th=[85459], | 99.99th=[85459] bw ( KiB/s): min= 159, max= 830, per=25.40%, avg=522.50, stdev=181.37, samples=24 iops : min= 9, max= 51, avg=32.17, stdev=11.42, samples=24 lat (usec) : 50=0.13%, 100=1.56%, 250=2.47%, 500=0.13% lat (msec) : 2=0.39%, 4=2.60%, 10=24.87%, 20=40.36%, 50=26.17% lat (msec) : 100=1.30% cpu : usr=0.07%, sys=30.79%, ctx=2731, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=158476: Tue Apr 28 21:09:58 2026 read: IOPS=29, BW=475KiB/s (486kB/s)(5744KiB/12094msec) clat (usec): min=91, max=59267, avg=16529.77, stdev=10052.56 lat (usec): min=91, max=59267, avg=16530.51, stdev=10052.59 clat percentiles (usec): | 1.00th=[ 100], 5.00th=[ 135], 10.00th=[ 6390], 20.00th=[ 9372], | 30.00th=[10814], 40.00th=[12911], 50.00th=[15270], 60.00th=[17433], | 70.00th=[20055], 80.00th=[22938], 90.00th=[28967], 95.00th=[35914], | 99.00th=[48497], 99.50th=[51119], 99.90th=[59507], 99.95th=[59507], | 99.99th=[59507] bw ( KiB/s): min= 256, max= 798, per=24.07%, avg=470.65, stdev=130.44, samples=23 iops : min= 16, max= 49, avg=28.96, stdev= 8.19, samples=23 write: IOPS=33, BW=541KiB/s (554kB/s)(6544KiB/12094msec); 0 zone resets clat (usec): min=1069, max=93295, avg=14975.95, stdev=11914.24 lat (usec): min=1070, max=93296, avg=14977.46, stdev=11914.47 clat percentiles (usec): | 1.00th=[ 1778], 5.00th=[ 3621], 10.00th=[ 4146], 20.00th=[ 5211], | 30.00th=[ 7308], 40.00th=[ 9896], 50.00th=[11469], 60.00th=[14091], | 70.00th=[17433], 80.00th=[22414], 90.00th=[31065], 95.00th=[37487], | 99.00th=[58459], 99.50th=[61604], 99.90th=[92799], 99.95th=[92799], | 99.99th=[92799] bw ( KiB/s): min= 159, max= 862, per=25.65%, avg=527.52, stdev=179.59, samples=23 iops : min= 9, max= 53, avg=32.48, stdev=11.34, samples=23 lat (usec) : 100=0.52%, 250=3.26%, 500=0.13% lat (msec) : 2=0.91%, 4=3.12%, 10=24.22%, 20=40.23%, 50=26.30% lat (msec) : 100=1.30% cpu : usr=0.07%, sys=30.96%, ctx=2723, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=158478: Tue Apr 28 21:09:58 2026 read: IOPS=31, BW=511KiB/s (523kB/s)(6256KiB/12248msec) clat (usec): min=38, max=68272, avg=16697.98, stdev=11151.97 lat (usec): min=39, max=68273, avg=16698.81, stdev=11151.99 clat percentiles (usec): | 1.00th=[ 80], 5.00th=[ 103], 10.00th=[ 1336], 20.00th=[ 8979], | 30.00th=[10814], 40.00th=[12911], 50.00th=[14615], 60.00th=[16909], | 70.00th=[19530], 80.00th=[23462], 90.00th=[30278], 95.00th=[39584], | 99.00th=[58459], 99.50th=[59507], 99.90th=[68682], 99.95th=[68682], | 99.99th=[68682] bw ( KiB/s): min= 286, max= 860, per=26.02%, avg=508.63, stdev=170.12, samples=24 iops : min= 17, max= 53, avg=31.29, stdev=10.80, samples=24 write: IOPS=30, BW=492KiB/s (504kB/s)(6032KiB/12248msec); 0 zone resets clat (usec): min=1795, max=93303, avg=14898.08, stdev=11386.42 lat (usec): min=1795, max=93304, avg=14899.53, stdev=11386.44 clat percentiles (usec): | 1.00th=[ 2343], 5.00th=[ 3458], 10.00th=[ 4080], 20.00th=[ 5473], | 30.00th=[ 7701], 40.00th=[ 9896], 50.00th=[11994], 60.00th=[14877], | 70.00th=[18220], 80.00th=[22676], 90.00th=[29492], 95.00th=[35390], | 99.00th=[55837], 99.50th=[69731], 99.90th=[92799], 99.95th=[92799], | 99.99th=[92799] bw ( KiB/s): min= 286, max= 832, per=23.46%, avg=482.67, stdev=130.20, samples=24 iops : min= 17, max= 52, avg=29.67, stdev= 8.23, samples=24 lat (usec) : 50=0.13%, 100=2.08%, 250=2.47%, 500=0.13% lat (msec) : 2=0.65%, 4=4.17%, 10=23.31%, 20=39.97%, 50=25.39% lat (msec) : 100=1.69% cpu : usr=0.08%, sys=30.51%, ctx=2759, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=158479: Tue Apr 28 21:09:58 2026 read: IOPS=30, BW=495KiB/s (507kB/s)(6032KiB/12193msec) clat (usec): min=40, max=72951, avg=16314.90, stdev=10381.78 lat (usec): min=42, max=72952, avg=16315.73, stdev=10381.87 clat percentiles (usec): | 1.00th=[ 75], 5.00th=[ 112], 10.00th=[ 167], 20.00th=[10028], | 30.00th=[11731], 40.00th=[13435], 50.00th=[14877], 60.00th=[17171], | 70.00th=[19006], 80.00th=[22676], 90.00th=[29230], 95.00th=[35914], | 99.00th=[54264], 99.50th=[56361], 99.90th=[72877], 99.95th=[72877], | 99.99th=[72877] bw ( KiB/s): min= 191, max= 734, per=25.13%, avg=491.25, stdev=159.57, samples=24 iops : min= 11, max= 45, avg=30.21, stdev=10.05, samples=24 write: IOPS=32, BW=513KiB/s (525kB/s)(6256KiB/12193msec); 0 zone resets clat (usec): min=1590, max=100409, avg=15264.70, stdev=12662.17 lat (usec): min=1592, max=100411, avg=15266.24, stdev=12662.37 clat percentiles (msec): | 1.00th=[ 3], 5.00th=[ 4], 10.00th=[ 5], 20.00th=[ 6], | 30.00th=[ 8], 40.00th=[ 10], 50.00th=[ 12], 60.00th=[ 14], | 70.00th=[ 17], 80.00th=[ 24], 90.00th=[ 34], 95.00th=[ 41], | 99.00th=[ 58], 99.50th=[ 73], 99.90th=[ 101], 99.95th=[ 101], | 99.99th=[ 101] bw ( KiB/s): min= 223, max= 798, per=24.95%, avg=513.25, stdev=133.82, samples=24 iops : min= 13, max= 49, avg=31.58, stdev= 8.51, samples=24 lat (usec) : 50=0.13%, 100=1.56%, 250=3.91% lat (msec) : 2=0.39%, 4=4.30%, 10=21.61%, 20=42.97%, 50=23.57% lat (msec) : 100=1.43%, 250=0.13% cpu : usr=0.16%, sys=30.41%, ctx=2766, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1956KiB/s (2003kB/s), 475KiB/s-511KiB/s (486kB/s-523kB/s), io=23.4MiB (24.5MB), run=12094-12248msec WRITE: bw=2057KiB/s (2107kB/s), 492KiB/s-541KiB/s (504kB/s-554kB/s), io=24.6MiB (25.8MB), run=12094-12248msec fio: pid=158472, err=5/file:backend.c:481, func=full resid, error=Input/output error rand-rw: (groupid=0, jobs=1): err= 5 (file:backend.c:481, func=full resid, error=Input/output error): pid=158472: Tue Apr 28 21:10:03 2026 read: IOPS=18, BW=287KiB/s (294kB/s)(4144KiB/14438msec) clat (usec): min=3185, max=87372, avg=18175.38, stdev=14732.21 lat (usec): min=3186, max=87372, avg=18176.08, stdev=14732.19 clat percentiles (usec): | 1.00th=[ 3654], 5.00th=[ 4490], 10.00th=[ 5407], 20.00th=[ 6652], | 30.00th=[ 9241], 40.00th=[10814], 50.00th=[12911], 60.00th=[16712], | 70.00th=[20055], 80.00th=[27919], 90.00th=[39584], 95.00th=[48497], | 99.00th=[72877], 99.50th=[85459], 99.90th=[87557], 99.95th=[87557], | 99.99th=[87557] bw ( KiB/s): min= 159, max= 640, per=21.62%, avg=277.64, stdev=111.53, samples=28 iops : min= 9, max= 40, avg=16.96, stdev= 7.08, samples=28 write: IOPS=19, BW=313KiB/s (320kB/s)(4512KiB/14438msec); 0 zone resets clat (msec): min=13, max=151, avg=34.31, stdev=17.57 lat (msec): min=13, max=151, avg=34.32, stdev=17.57 clat percentiles (msec): | 1.00th=[ 15], 5.00th=[ 17], 10.00th=[ 19], 20.00th=[ 21], | 30.00th=[ 24], 40.00th=[ 27], 50.00th=[ 30], 60.00th=[ 34], | 70.00th=[ 40], 80.00th=[ 45], 90.00th=[ 57], 95.00th=[ 67], | 99.00th=[ 101], 99.50th=[ 109], 99.90th=[ 153], 99.95th=[ 153], | 99.99th=[ 153] bw ( KiB/s): min= 160, max= 704, per=22.96%, avg=310.21, stdev=148.46, samples=28 iops : min= 10, max= 44, avg=19.00, stdev= 9.42, samples=28 lat (msec) : 4=0.74%, 10=16.05%, 20=26.38%, 50=47.79%, 100=8.30% lat (msec) : 250=0.55% cpu : usr=0.11%, sys=11.53%, ctx=1155, majf=0, minf=20 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=260,282,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=158473: Tue Apr 28 21:10:03 2026 read: IOPS=20, BW=333KiB/s (341kB/s)(5744KiB/17270msec) clat (msec): min=2, max=100, avg=13.86, stdev=14.37 lat (msec): min=2, max=100, avg=13.86, stdev=14.37 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 4], 10.00th=[ 4], 20.00th=[ 5], | 30.00th=[ 6], 40.00th=[ 6], 50.00th=[ 8], 60.00th=[ 11], | 70.00th=[ 14], 80.00th=[ 22], 90.00th=[ 35], 95.00th=[ 46], | 99.00th=[ 67], 99.50th=[ 84], 99.90th=[ 101], 99.95th=[ 101], | 99.99th=[ 101] bw ( KiB/s): min= 95, max= 832, per=25.69%, avg=329.85, stdev=201.81, samples=34 iops : min= 5, max= 52, avg=20.29, stdev=12.81, samples=34 write: IOPS=23, BW=379KiB/s (388kB/s)(6544KiB/17270msec); 0 zone resets clat (msec): min=10, max=148, avg=29.93, stdev=17.15 lat (msec): min=10, max=148, avg=29.93, stdev=17.15 clat percentiles (msec): | 1.00th=[ 12], 5.00th=[ 14], 10.00th=[ 16], 20.00th=[ 18], | 30.00th=[ 20], 40.00th=[ 22], 50.00th=[ 25], 60.00th=[ 28], | 70.00th=[ 33], 80.00th=[ 41], 90.00th=[ 54], 95.00th=[ 63], | 99.00th=[ 89], 99.50th=[ 96], 99.90th=[ 148], 99.95th=[ 148], | 99.99th=[ 148] bw ( KiB/s): min= 126, max= 800, per=27.50%, avg=371.47, stdev=195.10, samples=34 iops : min= 7, max= 50, avg=22.88, stdev=12.38, samples=34 lat (msec) : 4=5.47%, 10=21.61%, 20=27.34%, 50=37.76%, 100=7.55% lat (msec) : 250=0.26% cpu : usr=0.10%, sys=11.11%, ctx=1602, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=158475: Tue Apr 28 21:10:03 2026 read: IOPS=22, BW=366KiB/s (375kB/s)(6256KiB/17081msec) clat (usec): min=2842, max=88132, avg=14360.37, stdev=14986.58 lat (usec): min=2842, max=88132, avg=14361.16, stdev=14986.57 clat percentiles (usec): | 1.00th=[ 3130], 5.00th=[ 3490], 10.00th=[ 3818], 20.00th=[ 4359], | 30.00th=[ 4948], 40.00th=[ 5735], 50.00th=[ 8160], 60.00th=[10421], | 70.00th=[16188], 80.00th=[22152], 90.00th=[34341], 95.00th=[46924], | 99.00th=[80217], 99.50th=[84411], 99.90th=[88605], 99.95th=[88605], | 99.99th=[88605] bw ( KiB/s): min= 127, max= 1088, per=28.43%, avg=365.09, stdev=248.85, samples=33 iops : min= 7, max= 68, avg=22.48, stdev=15.74, samples=33 write: IOPS=22, BW=353KiB/s (362kB/s)(6032KiB/17081msec); 0 zone resets clat (msec): min=11, max=111, avg=30.18, stdev=16.03 lat (msec): min=11, max=111, avg=30.18, stdev=16.03 clat percentiles (msec): | 1.00th=[ 13], 5.00th=[ 15], 10.00th=[ 16], 20.00th=[ 18], | 30.00th=[ 20], 40.00th=[ 22], 50.00th=[ 25], 60.00th=[ 29], | 70.00th=[ 35], 80.00th=[ 42], 90.00th=[ 53], 95.00th=[ 66], | 99.00th=[ 86], 99.50th=[ 94], 99.90th=[ 112], 99.95th=[ 112], | 99.99th=[ 112] bw ( KiB/s): min= 96, max= 736, per=25.21%, avg=340.55, stdev=179.69, samples=33 iops : min= 6, max= 46, avg=20.94, stdev=11.41, samples=33 lat (msec) : 4=6.77%, 10=22.92%, 20=24.61%, 50=37.89%, 100=7.68% lat (msec) : 250=0.13% cpu : usr=0.11%, sys=11.29%, ctx=1617, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=158477: Tue Apr 28 21:10:03 2026 read: IOPS=22, BW=354KiB/s (363kB/s)(6032KiB/17019msec) clat (usec): min=2951, max=83062, avg=14486.19, stdev=14436.33 lat (usec): min=2951, max=83064, avg=14486.90, stdev=14436.33 clat percentiles (usec): | 1.00th=[ 3032], 5.00th=[ 3458], 10.00th=[ 3720], 20.00th=[ 4490], | 30.00th=[ 5080], 40.00th=[ 6194], 50.00th=[ 8848], 60.00th=[11600], | 70.00th=[16319], 80.00th=[21365], 90.00th=[36439], 95.00th=[44827], | 99.00th=[71828], 99.50th=[81265], 99.90th=[83362], 99.95th=[83362], | 99.99th=[83362] bw ( KiB/s): min= 95, max= 864, per=26.74%, avg=343.30, stdev=195.64, samples=33 iops : min= 5, max= 54, avg=21.12, stdev=12.39, samples=33 write: IOPS=22, BW=368KiB/s (376kB/s)(6256KiB/17019msec); 0 zone resets clat (msec): min=11, max=140, avg=29.50, stdev=16.83 lat (msec): min=11, max=140, avg=29.51, stdev=16.83 clat percentiles (msec): | 1.00th=[ 13], 5.00th=[ 15], 10.00th=[ 16], 20.00th=[ 18], | 30.00th=[ 20], 40.00th=[ 22], 50.00th=[ 24], 60.00th=[ 27], | 70.00th=[ 32], 80.00th=[ 40], 90.00th=[ 52], 95.00th=[ 64], | 99.00th=[ 97], 99.50th=[ 113], 99.90th=[ 142], 99.95th=[ 142], | 99.99th=[ 142] bw ( KiB/s): min= 96, max= 736, per=26.55%, avg=358.73, stdev=192.27, samples=33 iops : min= 6, max= 46, avg=22.09, stdev=12.24, samples=33 lat (msec) : 4=6.90%, 10=20.05%, 20=28.13%, 50=37.76%, 100=6.90% lat (msec) : 250=0.26% cpu : usr=0.11%, sys=11.26%, ctx=1596, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1284KiB/s (1315kB/s), 287KiB/s-366KiB/s (294kB/s-375kB/s), io=21.7MiB (22.7MB), run=14438-17270msec WRITE: bw=1352KiB/s (1384kB/s), 313KiB/s-379KiB/s (320kB/s-388kB/s), io=22.8MiB (23.9MB), run=14438-17270msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=158492: Tue Apr 28 21:10:11 2026 read: IOPS=3, BW=3561KiB/s (3646kB/s)(7168KiB/2013msec) clat (usec): min=575, max=210601, avg=116548.48, stdev=65996.41 lat (usec): min=577, max=210602, avg=116549.86, stdev=65996.28 clat percentiles (usec): | 1.00th=[ 578], 5.00th=[ 578], 10.00th=[ 578], 20.00th=[ 87557], | 30.00th=[ 88605], 40.00th=[ 88605], 50.00th=[133694], 60.00th=[143655], | 70.00th=[143655], 80.00th=[152044], 90.00th=[210764], 95.00th=[210764], | 99.00th=[210764], 99.50th=[210764], 99.90th=[210764], 99.95th=[210764], | 99.99th=[210764] bw ( KiB/s): min= 4087, max= 5919, per=75.71%, avg=5003.00, stdev=1295.42, samples=2 iops : min= 3, max= 5, avg= 4.00, stdev= 1.41, samples=2 write: IOPS=2, BW=2543KiB/s (2605kB/s)(5120KiB/2013msec); 0 zone resets clat (msec): min=79, max=488, avg=224.22, stdev=161.33 lat (msec): min=79, max=488, avg=224.27, stdev=161.32 clat percentiles (msec): | 1.00th=[ 80], 5.00th=[ 80], 10.00th=[ 80], 20.00th=[ 80], | 30.00th=[ 110], 40.00th=[ 110], 50.00th=[ 220], 60.00th=[ 220], | 70.00th=[ 226], 80.00th=[ 226], 90.00th=[ 489], 95.00th=[ 489], | 99.00th=[ 489], 99.50th=[ 489], 99.90th=[ 489], 99.95th=[ 489], | 99.99th=[ 489] bw ( KiB/s): min= 2043, max= 6131, per=44.17%, avg=4087.00, stdev=2890.65, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 lat (usec) : 750=8.33% lat (msec) : 100=25.00%, 250=58.33%, 500=8.33% cpu : usr=0.05%, sys=46.72%, ctx=752, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=158494: Tue Apr 28 21:10:11 2026 read: IOPS=0, BW=661KiB/s (677kB/s)(2048KiB/3099msec) clat (usec): min=663, max=248615, avg=124639.60, stdev=175328.05 lat (usec): min=665, max=248616, avg=124640.74, stdev=175327.56 clat percentiles (usec): | 1.00th=[ 668], 5.00th=[ 668], 10.00th=[ 668], 20.00th=[ 668], | 30.00th=[ 668], 40.00th=[ 668], 50.00th=[ 668], 60.00th=[248513], | 70.00th=[248513], 80.00th=[248513], 90.00th=[248513], 95.00th=[248513], | 99.00th=[248513], 99.50th=[248513], 99.90th=[248513], 99.95th=[248513], | 99.99th=[248513] bw ( KiB/s): min= 1969, max= 2031, per=30.27%, avg=2000.00, stdev=43.84, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=3, BW=3304KiB/s (3384kB/s)(10.0MiB/3099msec); 0 zone resets clat (msec): min=72, max=563, avg=276.50, stdev=178.42 lat (msec): min=72, max=563, avg=276.56, stdev=178.42 clat percentiles (msec): | 1.00th=[ 73], 5.00th=[ 73], 10.00th=[ 73], 20.00th=[ 100], | 30.00th=[ 127], 40.00th=[ 144], 50.00th=[ 222], 60.00th=[ 275], | 70.00th=[ 292], 80.00th=[ 485], 90.00th=[ 489], 95.00th=[ 567], | 99.00th=[ 567], 99.50th=[ 567], 99.90th=[ 567], 99.95th=[ 567], | 99.99th=[ 567] bw ( KiB/s): min= 2015, max= 6144, per=39.70%, avg=3672.80, stdev=2249.98, samples=5 iops : min= 1, max= 6, avg= 2.80, stdev= 2.49, samples=5 lat (usec) : 750=8.33% lat (msec) : 100=16.67%, 250=33.33%, 500=33.33%, 750=8.33% cpu : usr=0.00%, sys=40.03%, ctx=363, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=158497: Tue Apr 28 21:10:11 2026 read: IOPS=2, BW=2714KiB/s (2779kB/s)(6144KiB/2264msec) clat (usec): min=371, max=207697, avg=88827.47, stdev=98011.69 lat (usec): min=373, max=207698, avg=88828.93, stdev=98011.60 clat percentiles (usec): | 1.00th=[ 371], 5.00th=[ 371], 10.00th=[ 371], 20.00th=[ 775], | 30.00th=[ 775], 40.00th=[ 1012], 50.00th=[ 1012], 60.00th=[158335], | 70.00th=[164627], 80.00th=[164627], 90.00th=[208667], 95.00th=[208667], | 99.00th=[208667], 99.50th=[208667], 99.90th=[208667], 99.95th=[208667], | 99.99th=[208667] bw ( KiB/s): min= 4087, max= 6095, per=77.04%, avg=5091.00, stdev=1419.87, samples=2 iops : min= 3, max= 5, avg= 4.00, stdev= 1.41, samples=2 write: IOPS=2, BW=2714KiB/s (2779kB/s)(6144KiB/2264msec); 0 zone resets clat (msec): min=154, max=500, avg=278.69, stdev=139.28 lat (msec): min=154, max=500, avg=278.74, stdev=139.29 clat percentiles (msec): | 1.00th=[ 155], 5.00th=[ 155], 10.00th=[ 155], 20.00th=[ 155], | 30.00th=[ 155], 40.00th=[ 184], 50.00th=[ 184], 60.00th=[ 334], | 70.00th=[ 347], 80.00th=[ 347], 90.00th=[ 502], 95.00th=[ 502], | 99.00th=[ 502], 99.50th=[ 502], 99.90th=[ 502], 99.95th=[ 502], | 99.99th=[ 502] bw ( KiB/s): min= 2015, max= 4087, per=27.50%, avg=2544.00, stdev=1028.73, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (usec) : 500=8.33%, 1000=8.33% lat (msec) : 2=8.33%, 250=50.00%, 500=16.67%, 750=8.33% cpu : usr=0.00%, sys=44.14%, ctx=505, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=158499: Tue Apr 28 21:10:11 2026 read: IOPS=1, BW=2016KiB/s (2064kB/s)(5120KiB/2540msec) clat (usec): min=704, max=404241, avg=184025.43, stdev=192232.74 lat (usec): min=705, max=404243, avg=184027.10, stdev=192233.00 clat percentiles (usec): | 1.00th=[ 701], 5.00th=[ 701], 10.00th=[ 701], 20.00th=[ 701], | 30.00th=[ 725], 40.00th=[ 725], 50.00th=[154141], 60.00th=[154141], | 70.00th=[358613], 80.00th=[358613], 90.00th=[404751], 95.00th=[404751], | 99.00th=[404751], 99.50th=[404751], 99.90th=[404751], 99.95th=[404751], | 99.99th=[404751] bw ( KiB/s): min= 2043, max= 6095, per=61.58%, avg=4069.00, stdev=2865.20, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 write: IOPS=2, BW=2822KiB/s (2890kB/s)(7168KiB/2540msec); 0 zone resets clat (msec): min=101, max=509, avg=228.72, stdev=132.47 lat (msec): min=101, max=509, avg=228.78, stdev=132.48 clat percentiles (msec): | 1.00th=[ 102], 5.00th=[ 102], 10.00th=[ 102], 20.00th=[ 161], | 30.00th=[ 176], 40.00th=[ 176], 50.00th=[ 190], 60.00th=[ 211], | 70.00th=[ 211], 80.00th=[ 255], 90.00th=[ 510], 95.00th=[ 510], | 99.00th=[ 510], 99.50th=[ 510], 99.90th=[ 510], 99.95th=[ 510], | 99.99th=[ 510] bw ( KiB/s): min= 1950, max= 6131, per=43.67%, avg=4040.50, stdev=2956.41, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 lat (usec) : 750=16.67% lat (msec) : 250=50.00%, 500=25.00%, 750=8.33% cpu : usr=0.00%, sys=44.86%, ctx=387, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=6609KiB/s (6767kB/s), 661KiB/s-3561KiB/s (677kB/s-3646kB/s), io=20.0MiB (20.0MB), run=2013-3099msec WRITE: bw=9252KiB/s (9474kB/s), 2543KiB/s-3304KiB/s (2605kB/s-3384kB/s), io=28.0MiB (29.4MB), run=2013-3099msec rand-rw: (groupid=0, jobs=1): err= 0: pid=158493: Tue Apr 28 21:10:11 2026 read: IOPS=2, BW=2979KiB/s (3051kB/s)(7168KiB/2406msec) clat (msec): min=39, max=457, avg=150.99, stdev=146.74 lat (msec): min=39, max=457, avg=150.99, stdev=146.74 clat percentiles (msec): | 1.00th=[ 40], 5.00th=[ 40], 10.00th=[ 40], 20.00th=[ 43], | 30.00th=[ 88], 40.00th=[ 88], 50.00th=[ 96], 60.00th=[ 125], | 70.00th=[ 125], 80.00th=[ 209], 90.00th=[ 460], 95.00th=[ 460], | 99.00th=[ 460], 99.50th=[ 460], 99.90th=[ 460], 99.95th=[ 460], | 99.99th=[ 460] bw ( KiB/s): min= 1984, max= 5678, per=44.89%, avg=2936.25, stdev=1828.04, samples=4 iops : min= 1, max= 5, avg= 2.25, stdev= 1.89, samples=4 write: IOPS=2, BW=2128KiB/s (2179kB/s)(5120KiB/2406msec); 0 zone resets clat (msec): min=166, max=444, avg=266.74, stdev=113.56 lat (msec): min=166, max=444, avg=266.80, stdev=113.55 clat percentiles (msec): | 1.00th=[ 167], 5.00th=[ 167], 10.00th=[ 167], 20.00th=[ 167], | 30.00th=[ 171], 40.00th=[ 171], 50.00th=[ 264], 60.00th=[ 264], | 70.00th=[ 292], 80.00th=[ 292], 90.00th=[ 443], 95.00th=[ 443], | 99.00th=[ 443], 99.50th=[ 443], 99.90th=[ 443], 99.95th=[ 443], | 99.99th=[ 443] bw ( KiB/s): min= 1892, max= 4071, per=28.93%, avg=2649.00, stdev=1232.35, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (msec) : 50=16.67%, 100=16.67%, 250=33.33%, 500=33.33% cpu : usr=0.04%, sys=15.51%, ctx=90, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=158495: Tue Apr 28 21:10:11 2026 read: IOPS=0, BW=706KiB/s (723kB/s)(2048KiB/2902msec) clat (msec): min=199, max=223, avg=211.71, stdev=16.59 lat (msec): min=199, max=223, avg=211.72, stdev=16.59 clat percentiles (msec): | 1.00th=[ 201], 5.00th=[ 201], 10.00th=[ 201], 20.00th=[ 201], | 30.00th=[ 201], 40.00th=[ 201], 50.00th=[ 201], 60.00th=[ 224], | 70.00th=[ 224], 80.00th=[ 224], 90.00th=[ 224], 95.00th=[ 224], | 99.00th=[ 224], 99.50th=[ 224], 99.90th=[ 224], 99.95th=[ 224], | 99.99th=[ 224] bw ( KiB/s): min= 1950, max= 1984, per=30.07%, avg=1967.00, stdev=24.04, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=3, BW=3529KiB/s (3613kB/s)(10.0MiB/2902msec); 0 zone resets clat (msec): min=112, max=477, avg=246.01, stdev=122.90 lat (msec): min=112, max=477, avg=246.08, stdev=122.91 clat percentiles (msec): | 1.00th=[ 113], 5.00th=[ 113], 10.00th=[ 113], 20.00th=[ 157], | 30.00th=[ 159], 40.00th=[ 174], 50.00th=[ 178], 60.00th=[ 194], | 70.00th=[ 251], 80.00th=[ 380], 90.00th=[ 384], 95.00th=[ 477], | 99.00th=[ 477], 99.50th=[ 477], 99.90th=[ 477], 99.95th=[ 477], | 99.99th=[ 477] bw ( KiB/s): min= 1950, max= 6144, per=30.92%, avg=2831.20, stdev=1852.30, samples=5 iops : min= 1, max= 6, avg= 2.00, stdev= 2.24, samples=5 lat (msec) : 250=66.67%, 500=33.33% cpu : usr=0.00%, sys=20.75%, ctx=174, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=158496: Tue Apr 28 21:10:11 2026 read: IOPS=1, BW=1962KiB/s (2009kB/s)(6144KiB/3131msec) clat (msec): min=29, max=607, avg=208.95, stdev=222.27 lat (msec): min=29, max=607, avg=208.96, stdev=222.27 clat percentiles (msec): | 1.00th=[ 30], 5.00th=[ 30], 10.00th=[ 30], 20.00th=[ 39], | 30.00th=[ 39], 40.00th=[ 123], 50.00th=[ 123], 60.00th=[ 132], | 70.00th=[ 326], 80.00th=[ 326], 90.00th=[ 609], 95.00th=[ 609], | 99.00th=[ 609], 99.50th=[ 609], 99.90th=[ 609], 99.95th=[ 609], | 99.99th=[ 609] bw ( KiB/s): min= 2043, max= 4096, per=51.51%, avg=3369.00, stdev=1150.13, samples=3 iops : min= 1, max= 4, avg= 2.67, stdev= 1.53, samples=3 write: IOPS=1, BW=1962KiB/s (2009kB/s)(6144KiB/3131msec); 0 zone resets clat (msec): min=167, max=545, avg=304.25, stdev=156.18 lat (msec): min=167, max=545, avg=304.32, stdev=156.17 clat percentiles (msec): | 1.00th=[ 167], 5.00th=[ 167], 10.00th=[ 167], 20.00th=[ 169], | 30.00th=[ 169], 40.00th=[ 230], 50.00th=[ 230], 60.00th=[ 271], | 70.00th=[ 443], 80.00th=[ 443], 90.00th=[ 550], 95.00th=[ 550], | 99.00th=[ 550], 99.50th=[ 550], 99.90th=[ 550], 99.95th=[ 550], | 99.99th=[ 550] bw ( KiB/s): min= 2043, max= 3792, per=27.11%, avg=2482.75, stdev=872.84, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 0.82, samples=4 lat (msec) : 50=16.67%, 250=41.67%, 500=25.00%, 750=16.67% cpu : usr=0.00%, sys=14.19%, ctx=314, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=158498: Tue Apr 28 21:10:11 2026 read: IOPS=1, BW=1646KiB/s (1685kB/s)(5120KiB/3111msec) clat (msec): min=39, max=377, avg=228.64, stdev=141.31 lat (msec): min=39, max=377, avg=228.64, stdev=141.31 clat percentiles (msec): | 1.00th=[ 40], 5.00th=[ 40], 10.00th=[ 40], 20.00th=[ 40], | 30.00th=[ 123], 40.00th=[ 123], 50.00th=[ 300], 60.00th=[ 300], | 70.00th=[ 305], 80.00th=[ 305], 90.00th=[ 380], 95.00th=[ 380], | 99.00th=[ 380], 99.50th=[ 380], 99.90th=[ 380], 99.95th=[ 380], | 99.99th=[ 380] bw ( KiB/s): min= 1984, max= 4087, per=41.37%, avg=2706.33, stdev=1196.12, samples=3 iops : min= 1, max= 3, avg= 2.00, stdev= 1.00, samples=3 write: IOPS=2, BW=2304KiB/s (2359kB/s)(7168KiB/3111msec); 0 zone resets clat (msec): min=116, max=610, avg=272.23, stdev=190.96 lat (msec): min=116, max=610, avg=272.29, stdev=190.96 clat percentiles (msec): | 1.00th=[ 117], 5.00th=[ 117], 10.00th=[ 117], 20.00th=[ 121], | 30.00th=[ 136], 40.00th=[ 136], 50.00th=[ 220], 60.00th=[ 247], | 70.00th=[ 247], 80.00th=[ 460], 90.00th=[ 609], 95.00th=[ 609], | 99.00th=[ 609], 99.50th=[ 609], 99.90th=[ 609], 99.95th=[ 609], | 99.99th=[ 609] bw ( KiB/s): min= 1921, max= 4096, per=33.13%, avg=3034.00, stdev=1213.01, samples=4 iops : min= 1, max= 4, avg= 2.50, stdev= 1.29, samples=4 lat (msec) : 50=8.33%, 250=50.00%, 500=33.33%, 750=8.33% cpu : usr=0.03%, sys=16.85%, ctx=145, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=6541KiB/s (6698kB/s), 706KiB/s-2979KiB/s (723kB/s-3051kB/s), io=20.0MiB (20.0MB), run=2406-3131msec WRITE: bw=9157KiB/s (9377kB/s), 1962KiB/s-3529KiB/s (2009kB/s-3613kB/s), io=28.0MiB (29.4MB), run=2406-3131msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=158504: Tue Apr 28 21:10:19 2026 read: IOPS=2, BW=11.1MiB/s (11.7MB/s)(12.0MiB/1079msec) clat (msec): min=240, max=497, avg=337.15, stdev=139.51 lat (msec): min=240, max=497, avg=337.15, stdev=139.51 clat percentiles (msec): | 1.00th=[ 241], 5.00th=[ 241], 10.00th=[ 241], 20.00th=[ 241], | 30.00th=[ 241], 40.00th=[ 275], 50.00th=[ 275], 60.00th=[ 275], | 70.00th=[ 498], 80.00th=[ 498], 90.00th=[ 498], 95.00th=[ 498], | 99.00th=[ 498], 99.50th=[ 498], 99.90th=[ 498], 99.95th=[ 498], | 99.99th=[ 498] bw ( KiB/s): min= 7787, max= 8062, per=52.19%, avg=7924.50, stdev=194.45, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 250=33.33%, 500=66.67% cpu : usr=0.00%, sys=24.49%, ctx=125, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=158505: Tue Apr 28 21:10:19 2026 read: IOPS=1, BW=4245KiB/s (4346kB/s)(4096KiB/965msec) clat (nsec): min=108117k, max=108117k, avg=108117148.00, stdev= 0.00 lat (nsec): min=108120k, max=108120k, avg=108120013.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 109], 5.00th=[ 109], 10.00th=[ 109], 20.00th=[ 109], | 30.00th=[ 109], 40.00th=[ 109], 50.00th=[ 109], 60.00th=[ 109], | 70.00th=[ 109], 80.00th=[ 109], 90.00th=[ 109], 95.00th=[ 109], | 99.00th=[ 109], 99.50th=[ 109], 99.90th=[ 109], 99.95th=[ 109], | 99.99th=[ 109] bw ( KiB/s): min= 7876, max= 7876, per=51.87%, avg=7876.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=2, BW=8489KiB/s (8693kB/s)(8192KiB/965msec); 0 zone resets clat (msec): min=384, max=409, avg=397.01, stdev=17.10 lat (msec): min=385, max=409, avg=397.32, stdev=17.05 clat percentiles (msec): | 1.00th=[ 384], 5.00th=[ 384], 10.00th=[ 384], 20.00th=[ 384], | 30.00th=[ 384], 40.00th=[ 384], 50.00th=[ 384], 60.00th=[ 409], | 70.00th=[ 409], 80.00th=[ 409], 90.00th=[ 409], 95.00th=[ 409], | 99.00th=[ 409], 99.50th=[ 409], 99.90th=[ 409], 99.95th=[ 409], | 99.99th=[ 409] lat (msec) : 250=33.33%, 500=66.67% cpu : usr=0.00%, sys=26.14%, ctx=81, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=158506: Tue Apr 28 21:10:19 2026 write: IOPS=1, BW=7310KiB/s (7485kB/s)(12.0MiB/1681msec); 0 zone resets clat (msec): min=165, max=1166, avg=538.00, stdev=547.06 lat (msec): min=166, max=1166, avg=538.26, stdev=547.15 clat percentiles (msec): | 1.00th=[ 167], 5.00th=[ 167], 10.00th=[ 167], 20.00th=[ 167], | 30.00th=[ 167], 40.00th=[ 284], 50.00th=[ 284], 60.00th=[ 284], | 70.00th=[ 1167], 80.00th=[ 1167], 90.00th=[ 1167], 95.00th=[ 1167], | 99.00th=[ 1167], 99.50th=[ 1167], 99.90th=[ 1167], 99.95th=[ 1167], | 99.99th=[ 1167] bw ( KiB/s): min=16351, max=16351, per=83.88%, avg=16351.00, stdev= 0.00, samples=1 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 500=33.33%, 2000=33.33% cpu : usr=0.00%, sys=19.29%, ctx=89, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=158507: Tue Apr 28 21:10:19 2026 write: IOPS=3, BW=12.5MiB/s (13.1MB/s)(12.0MiB/959msec); 0 zone resets clat (msec): min=132, max=592, avg=297.44, stdev=256.08 lat (msec): min=132, max=592, avg=297.74, stdev=256.05 clat percentiles (msec): | 1.00th=[ 133], 5.00th=[ 133], 10.00th=[ 133], 20.00th=[ 133], | 30.00th=[ 133], 40.00th=[ 167], 50.00th=[ 167], 60.00th=[ 167], | 70.00th=[ 592], 80.00th=[ 592], 90.00th=[ 592], 95.00th=[ 592], | 99.00th=[ 592], 99.50th=[ 592], 99.90th=[ 592], 99.95th=[ 592], | 99.99th=[ 592] bw ( KiB/s): min=15603, max=15603, per=80.04%, avg=15603.00, stdev= 0.00, samples=1 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=1 lat (msec) : 250=66.67%, 750=33.33% cpu : usr=0.10%, sys=28.99%, ctx=55, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=14.8MiB/s (15.5MB/s), 4245KiB/s-11.1MiB/s (4346kB/s-11.7MB/s), io=16.0MiB (16.8MB), run=965-1079msec WRITE: bw=19.0MiB/s (19.0MB/s), 7310KiB/s-12.5MiB/s (7485kB/s-13.1MB/s), io=32.0MiB (33.6MB), run=959-1681msec rand-rw: (groupid=0, jobs=1): err= 0: pid=158509: Tue Apr 28 21:10:19 2026 read: IOPS=2, BW=9150KiB/s (9369kB/s)(12.0MiB/1343msec) clat (msec): min=411, max=464, avg=440.38, stdev=27.11 lat (msec): min=411, max=464, avg=440.39, stdev=27.12 clat percentiles (msec): | 1.00th=[ 414], 5.00th=[ 414], 10.00th=[ 414], 20.00th=[ 414], | 30.00th=[ 414], 40.00th=[ 447], 50.00th=[ 447], 60.00th=[ 447], | 70.00th=[ 464], 80.00th=[ 464], 90.00th=[ 464], 95.00th=[ 464], | 99.00th=[ 464], 99.50th=[ 464], 99.90th=[ 464], 99.95th=[ 464], | 99.99th=[ 464] bw ( KiB/s): min= 5910, max= 8015, per=67.15%, avg=6962.50, stdev=1488.46, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=100.00% cpu : usr=0.00%, sys=54.10%, ctx=2404, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=158510: Tue Apr 28 21:10:19 2026 read: IOPS=0, BW=2592KiB/s (2655kB/s)(4096KiB/1580msec) clat (nsec): min=446021k, max=446021k, avg=446020813.00, stdev= 0.00 lat (nsec): min=446024k, max=446024k, avg=446023886.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 447], 5.00th=[ 447], 10.00th=[ 447], 20.00th=[ 447], | 30.00th=[ 447], 40.00th=[ 447], 50.00th=[ 447], 60.00th=[ 447], | 70.00th=[ 447], 80.00th=[ 447], 90.00th=[ 447], 95.00th=[ 447], | 99.00th=[ 447], 99.50th=[ 447], 99.90th=[ 447], 99.95th=[ 447], | 99.99th=[ 447] bw ( KiB/s): min= 5769, max= 5769, per=55.64%, avg=5769.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=1, BW=5185KiB/s (5309kB/s)(8192KiB/1580msec); 0 zone resets clat (msec): min=293, max=783, avg=538.59, stdev=345.95 lat (msec): min=294, max=783, avg=538.91, stdev=345.98 clat percentiles (msec): | 1.00th=[ 296], 5.00th=[ 296], 10.00th=[ 296], 20.00th=[ 296], | 30.00th=[ 296], 40.00th=[ 296], 50.00th=[ 296], 60.00th=[ 785], | 70.00th=[ 785], 80.00th=[ 785], 90.00th=[ 785], 95.00th=[ 785], | 99.00th=[ 785], 99.50th=[ 785], 99.90th=[ 785], 99.95th=[ 785], | 99.99th=[ 785] lat (msec) : 500=66.67%, 1000=33.33% cpu : usr=0.06%, sys=9.56%, ctx=664, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=158511: Tue Apr 28 21:10:19 2026 write: IOPS=1, BW=7767KiB/s (7954kB/s)(12.0MiB/1582msec); 0 zone resets clat (msec): min=137, max=1064, avg=519.24, stdev=484.49 lat (msec): min=137, max=1064, avg=519.53, stdev=484.51 clat percentiles (msec): | 1.00th=[ 138], 5.00th=[ 138], 10.00th=[ 138], 20.00th=[ 138], | 30.00th=[ 138], 40.00th=[ 355], 50.00th=[ 355], 60.00th=[ 355], | 70.00th=[ 1062], 80.00th=[ 1062], 90.00th=[ 1062], 95.00th=[ 1062], | 99.00th=[ 1062], 99.50th=[ 1062], 99.90th=[ 1062], 99.95th=[ 1062], | 99.99th=[ 1062] bw ( KiB/s): min= 8015, max= 8015, per=38.70%, avg=8015.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 500=33.33%, 2000=33.33% cpu : usr=0.00%, sys=16.76%, ctx=79, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=158512: Tue Apr 28 21:10:19 2026 write: IOPS=2, BW=9029KiB/s (9245kB/s)(12.0MiB/1361msec); 0 zone resets clat (msec): min=283, max=598, avg=445.67, stdev=157.59 lat (msec): min=284, max=598, avg=445.85, stdev=157.53 clat percentiles (msec): | 1.00th=[ 284], 5.00th=[ 284], 10.00th=[ 284], 20.00th=[ 284], | 30.00th=[ 284], 40.00th=[ 456], 50.00th=[ 456], 60.00th=[ 456], | 70.00th=[ 600], 80.00th=[ 600], 90.00th=[ 600], 95.00th=[ 600], | 99.00th=[ 600], 99.50th=[ 600], 99.90th=[ 600], 99.95th=[ 600], | 99.99th=[ 600] bw ( KiB/s): min= 5720, max= 8015, per=33.16%, avg=6867.50, stdev=1622.81, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=66.67%, 750=33.33% cpu : usr=0.00%, sys=15.88%, ctx=69, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=10.1MiB/s (10.6MB/s), 2592KiB/s-9150KiB/s (2655kB/s-9369kB/s), io=16.0MiB (16.8MB), run=1343-1580msec WRITE: bw=20.2MiB/s (21.2MB/s), 5185KiB/s-9029KiB/s (5309kB/s-9245kB/s), io=32.0MiB (33.6MB), run=1361-1582msec