== sanity test 398b: DIO and buffer IO race ============== 16:28:15 (1784406495) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 3.42568 s, 14.7 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=146522: Sat Jul 18 16:29:21 2026 read: IOPS=27, BW=108KiB/s (111kB/s)(5992KiB/55270msec) clat (usec): min=40, max=707539, avg=18713.73, stdev=21553.56 lat (usec): min=41, max=707541, avg=18716.50, stdev=21552.96 clat percentiles (usec): | 1.00th=[ 57], 5.00th=[ 194], 10.00th=[ 8160], 20.00th=[ 10290], | 30.00th=[ 12125], 40.00th=[ 13829], 50.00th=[ 15926], 60.00th=[ 18744], | 70.00th=[ 21890], 80.00th=[ 25822], 90.00th=[ 31589], 95.00th=[ 38011], | 99.00th=[ 50594], 99.50th=[ 60556], 99.90th=[225444], 99.95th=[708838], | 99.99th=[708838] bw ( KiB/s): min= 47, max= 176, per=25.20%, avg=108.62, stdev=26.55, samples=108 iops : min= 11, max= 44, avg=26.69, stdev= 6.67, samples=108 write: IOPS=28, BW=114KiB/s (117kB/s)(6296KiB/55270msec); 0 zone resets clat (usec): min=811, max=269705, avg=17204.13, stdev=15938.52 lat (usec): min=812, max=269707, avg=17205.33, stdev=15938.59 clat percentiles (usec): | 1.00th=[ 1188], 5.00th=[ 1860], 10.00th=[ 2606], 20.00th=[ 3949], | 30.00th=[ 6587], 40.00th=[ 10683], 50.00th=[ 13960], 60.00th=[ 17433], | 70.00th=[ 21890], 80.00th=[ 27395], 90.00th=[ 36439], 95.00th=[ 43779], | 99.00th=[ 62653], 99.50th=[ 78119], 99.90th=[168821], 99.95th=[270533], | 99.99th=[270533] bw ( KiB/s): min= 39, max= 199, per=25.14%, avg=113.64, stdev=30.18, samples=108 iops : min= 9, max= 49, avg=27.95, stdev= 7.61, samples=108 lat (usec) : 50=0.20%, 100=1.17%, 250=1.30%, 500=0.16%, 1000=0.20% lat (msec) : 2=2.67%, 4=7.62%, 10=15.30%, 20=36.82%, 50=32.58% lat (msec) : 100=1.79%, 250=0.13%, 500=0.03%, 750=0.03% cpu : usr=0.13%, sys=21.58%, ctx=8544, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146523: Sat Jul 18 16:29:21 2026 read: IOPS=26, BW=107KiB/s (109kB/s)(5940KiB/55603msec) clat (usec): min=43, max=752916, avg=19316.77, stdev=22870.68 lat (usec): min=43, max=752918, avg=19317.81, stdev=22870.76 clat percentiles (usec): | 1.00th=[ 69], 5.00th=[ 285], 10.00th=[ 8455], 20.00th=[ 10683], | 30.00th=[ 12125], 40.00th=[ 14091], 50.00th=[ 16450], 60.00th=[ 19006], | 70.00th=[ 22152], 80.00th=[ 26084], 90.00th=[ 31589], 95.00th=[ 38011], | 99.00th=[ 65274], 99.50th=[ 78119], 99.90th=[219153], 99.95th=[750781], | 99.99th=[750781] bw ( KiB/s): min= 15, max= 191, per=24.80%, avg=106.89, stdev=29.55, samples=109 iops : min= 3, max= 47, avg=26.27, stdev= 7.40, samples=109 write: IOPS=28, BW=114KiB/s (117kB/s)(6348KiB/55603msec); 0 zone resets clat (usec): min=853, max=197194, avg=16880.74, stdev=14450.79 lat (usec): min=855, max=197195, avg=16882.60, stdev=14451.91 clat percentiles (usec): | 1.00th=[ 1254], 5.00th=[ 1926], 10.00th=[ 2704], 20.00th=[ 4015], | 30.00th=[ 6718], 40.00th=[ 10552], 50.00th=[ 13566], 60.00th=[ 17695], | 70.00th=[ 21890], 80.00th=[ 27395], 90.00th=[ 35914], 95.00th=[ 42206], | 99.00th=[ 60556], 99.50th=[ 73925], 99.90th=[ 89654], 99.95th=[198181], | 99.99th=[198181] bw ( KiB/s): min= 39, max= 208, per=25.18%, avg=113.83, stdev=31.61, samples=109 iops : min= 9, max= 52, avg=28.01, stdev= 7.99, samples=109 lat (usec) : 50=0.16%, 100=1.14%, 250=1.04%, 500=0.10%, 1000=0.10% lat (msec) : 2=2.64%, 4=7.62%, 10=14.84%, 20=36.85%, 50=33.14% lat (msec) : 100=2.25%, 250=0.10%, 1000=0.03% cpu : usr=0.14%, sys=21.52%, ctx=8575, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146524: Sat Jul 18 16:29:21 2026 read: IOPS=27, BW=109KiB/s (112kB/s)(6028KiB/55149msec) clat (usec): min=38, max=150046, avg=18050.39, stdev=11575.78 lat (usec): min=39, max=150048, avg=18051.44, stdev=11575.74 clat percentiles (usec): | 1.00th=[ 58], 5.00th=[ 161], 10.00th=[ 8356], 20.00th=[ 10290], | 30.00th=[ 11994], 40.00th=[ 13829], 50.00th=[ 16188], 60.00th=[ 18744], | 70.00th=[ 21365], 80.00th=[ 25035], 90.00th=[ 30278], 95.00th=[ 35914], | 99.00th=[ 50594], 99.50th=[ 72877], 99.90th=[122160], 99.95th=[149947], | 99.99th=[149947] bw ( KiB/s): min= 39, max= 192, per=25.47%, avg=109.77, stdev=28.52, samples=108 iops : min= 9, max= 48, avg=26.99, stdev= 7.19, samples=108 write: IOPS=28, BW=114KiB/s (116kB/s)(6260KiB/55149msec); 0 zone resets clat (usec): min=1056, max=811598, avg=17775.06, stdev=26032.15 lat (usec): min=1058, max=811601, avg=17780.30, stdev=26030.20 clat percentiles (usec): | 1.00th=[ 1237], 5.00th=[ 2024], 10.00th=[ 2737], 20.00th=[ 4015], | 30.00th=[ 6783], 40.00th=[ 10814], 50.00th=[ 13960], 60.00th=[ 16909], | 70.00th=[ 21890], 80.00th=[ 27395], 90.00th=[ 35390], 95.00th=[ 44303], | 99.00th=[ 67634], 99.50th=[ 84411], 99.90th=[246416], 99.95th=[809501], | 99.99th=[809501] bw ( KiB/s): min= 47, max= 207, per=25.18%, avg=113.81, stdev=31.32, samples=108 iops : min= 11, max= 51, avg=27.99, stdev= 7.86, samples=108 lat (usec) : 50=0.29%, 100=1.20%, 250=1.37%, 500=0.10%, 750=0.03% lat (msec) : 2=2.41%, 4=7.81%, 10=15.07%, 20=37.47%, 50=32.23% lat (msec) : 100=1.76%, 250=0.23%, 1000=0.03% cpu : usr=0.15%, sys=21.57%, ctx=8609, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146525: Sat Jul 18 16:29:21 2026 read: IOPS=27, BW=110KiB/s (113kB/s)(6052KiB/55082msec) clat (usec): min=43, max=176051, avg=18202.16, stdev=12305.36 lat (usec): min=44, max=176052, avg=18203.04, stdev=12305.48 clat percentiles (usec): | 1.00th=[ 67], 5.00th=[ 137], 10.00th=[ 7898], 20.00th=[ 9896], | 30.00th=[ 11600], 40.00th=[ 13566], 50.00th=[ 15926], 60.00th=[ 18744], | 70.00th=[ 21627], 80.00th=[ 26084], 90.00th=[ 30802], 95.00th=[ 36963], | 99.00th=[ 61080], 99.50th=[ 78119], 99.90th=[121111], 99.95th=[175113], | 99.99th=[175113] bw ( KiB/s): min= 23, max= 190, per=25.59%, avg=110.31, stdev=28.69, samples=108 iops : min= 5, max= 47, avg=27.12, stdev= 7.26, samples=108 write: IOPS=28, BW=113KiB/s (116kB/s)(6236KiB/55082msec); 0 zone resets clat (usec): min=783, max=824726, avg=17585.26, stdev=25209.15 lat (usec): min=784, max=824727, avg=17586.78, stdev=25209.26 clat percentiles (usec): | 1.00th=[ 1188], 5.00th=[ 1975], 10.00th=[ 2737], 20.00th=[ 3752], | 30.00th=[ 6390], 40.00th=[ 10421], 50.00th=[ 13960], 60.00th=[ 17433], | 70.00th=[ 21890], 80.00th=[ 27919], 90.00th=[ 36439], 95.00th=[ 44827], | 99.00th=[ 64226], 99.50th=[ 80217], 99.90th=[127402], 99.95th=[826278], | 99.99th=[826278] bw ( KiB/s): min= 31, max= 215, per=25.18%, avg=113.83, stdev=34.51, samples=108 iops : min= 7, max= 53, avg=28.01, stdev= 8.64, samples=108 lat (usec) : 50=0.13%, 100=1.40%, 250=1.46%, 500=0.07%, 750=0.03% lat (usec) : 1000=0.16% lat (msec) : 2=2.47%, 4=8.14%, 10=16.02%, 20=35.51%, 50=32.26% lat (msec) : 100=2.15%, 250=0.16%, 1000=0.03% cpu : usr=0.15%, sys=21.67%, ctx=8606, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=432KiB/s (442kB/s), 107KiB/s-110KiB/s (109kB/s-113kB/s), io=23.4MiB (24.6MB), run=55082-55603msec WRITE: bw=452KiB/s (463kB/s), 113KiB/s-114KiB/s (116kB/s-117kB/s), io=24.6MiB (25.7MB), run=55082-55603msec fio: pid=146520, err=5/file:backend.c:481, func=full resid, error=Input/output error rand-rw: (groupid=0, jobs=1): err= 0: pid=146517: Sat Jul 18 16:29:56 2026 read: IOPS=16, BW=66.3KiB/s (67.9kB/s)(5992KiB/90359msec) clat (msec): min=3, max=733, avg=15.39, stdev=23.96 lat (msec): min=3, max=733, avg=15.39, stdev=23.96 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 5], 10.00th=[ 6], 20.00th=[ 6], | 30.00th=[ 7], 40.00th=[ 8], 50.00th=[ 9], 60.00th=[ 12], | 70.00th=[ 16], 80.00th=[ 22], 90.00th=[ 33], 95.00th=[ 45], | 99.00th=[ 82], 99.50th=[ 97], 99.90th=[ 133], 99.95th=[ 735], | 99.99th=[ 735] bw ( KiB/s): min= 7, max= 199, per=27.89%, avg=66.93, stdev=39.61, samples=178 iops : min= 1, max= 49, avg=16.43, stdev=10.00, samples=178 write: IOPS=17, BW=69.7KiB/s (71.3kB/s)(6296KiB/90359msec); 0 zone resets clat (msec): min=15, max=324, avg=42.62, stdev=22.69 lat (msec): min=15, max=324, avg=42.62, stdev=22.69 clat percentiles (msec): | 1.00th=[ 19], 5.00th=[ 22], 10.00th=[ 23], 20.00th=[ 26], | 30.00th=[ 29], 40.00th=[ 32], 50.00th=[ 35], 60.00th=[ 41], | 70.00th=[ 50], 80.00th=[ 59], 90.00th=[ 72], 95.00th=[ 83], | 99.00th=[ 112], 99.50th=[ 133], 99.90th=[ 239], 99.95th=[ 326], | 99.99th=[ 326] bw ( KiB/s): min= 16, max= 144, per=27.83%, avg=69.85, stdev=33.65, samples=179 iops : min= 4, max= 36, avg=17.16, stdev= 8.54, samples=179 lat (msec) : 4=0.39%, 10=27.05%, 20=11.49%, 50=44.14%, 100=16.11% lat (msec) : 250=0.75%, 500=0.03%, 750=0.03% cpu : usr=0.10%, sys=6.92%, ctx=5894, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146518: Sat Jul 18 16:29:56 2026 read: IOPS=16, BW=65.9KiB/s (67.5kB/s)(5940KiB/90152msec) clat (msec): min=3, max=759, avg=15.59, stdev=25.87 lat (msec): min=3, max=759, avg=15.59, stdev=25.87 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 5], 10.00th=[ 6], 20.00th=[ 6], | 30.00th=[ 7], 40.00th=[ 8], 50.00th=[ 9], 60.00th=[ 12], | 70.00th=[ 15], 80.00th=[ 21], 90.00th=[ 33], 95.00th=[ 46], | 99.00th=[ 81], 99.50th=[ 107], 99.90th=[ 309], 99.95th=[ 760], | 99.99th=[ 760] bw ( KiB/s): min= 7, max= 199, per=27.86%, avg=66.87, stdev=40.11, samples=176 iops : min= 1, max= 49, avg=16.41, stdev=10.14, samples=176 write: IOPS=17, BW=70.4KiB/s (72.1kB/s)(6348KiB/90152msec); 0 zone resets clat (msec): min=16, max=208, avg=42.08, stdev=20.29 lat (msec): min=16, max=208, avg=42.08, stdev=20.29 clat percentiles (msec): | 1.00th=[ 19], 5.00th=[ 22], 10.00th=[ 24], 20.00th=[ 26], | 30.00th=[ 29], 40.00th=[ 32], 50.00th=[ 36], 60.00th=[ 42], | 70.00th=[ 49], 80.00th=[ 58], 90.00th=[ 70], 95.00th=[ 81], | 99.00th=[ 112], 99.50th=[ 127], 99.90th=[ 165], 99.95th=[ 209], | 99.99th=[ 209] bw ( KiB/s): min= 16, max= 144, per=28.06%, avg=70.43, stdev=33.09, samples=178 iops : min= 4, max= 36, avg=17.30, stdev= 8.40, samples=178 lat (msec) : 4=0.20%, 10=27.25%, 20=12.14%, 50=43.85%, 100=15.49% lat (msec) : 250=1.01%, 500=0.03%, 1000=0.03% cpu : usr=0.11%, sys=6.95%, ctx=5886, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146519: Sat Jul 18 16:29:56 2026 read: IOPS=16, BW=66.0KiB/s (68.6kB/s)(6028KiB/90032msec) clat (msec): min=3, max=197, avg=15.21, stdev=15.57 lat (msec): min=3, max=197, avg=15.21, stdev=15.57 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 5], 10.00th=[ 6], 20.00th=[ 6], | 30.00th=[ 7], 40.00th=[ 8], 50.00th=[ 9], 60.00th=[ 12], | 70.00th=[ 16], 80.00th=[ 23], 90.00th=[ 35], 95.00th=[ 43], | 99.00th=[ 82], 99.50th=[ 96], 99.90th=[ 136], 99.95th=[ 199], | 99.99th=[ 199] bw ( KiB/s): min= 8, max= 168, per=28.12%, avg=67.48, stdev=37.74, samples=177 iops : min= 2, max= 42, avg=16.56, stdev= 9.52, samples=177 write: IOPS=17, BW=69.5KiB/s (71.2kB/s)(6260KiB/90032msec); 0 zone resets clat (msec): min=14, max=807, avg=42.74, stdev=28.64 lat (msec): min=14, max=807, avg=42.74, stdev=28.64 clat percentiles (msec): | 1.00th=[ 19], 5.00th=[ 22], 10.00th=[ 23], 20.00th=[ 26], | 30.00th=[ 29], 40.00th=[ 32], 50.00th=[ 36], 60.00th=[ 41], | 70.00th=[ 50], 80.00th=[ 59], 90.00th=[ 71], 95.00th=[ 82], | 99.00th=[ 110], 99.50th=[ 128], 99.90th=[ 251], 99.95th=[ 810], | 99.99th=[ 810] bw ( KiB/s): min= 15, max= 152, per=27.75%, avg=69.66, stdev=34.11, samples=178 iops : min= 3, max= 38, avg=17.11, stdev= 8.66, samples=178 lat (msec) : 4=0.33%, 10=26.46%, 20=12.30%, 50=44.66%, 100=15.23% lat (msec) : 250=0.94%, 500=0.03%, 1000=0.03% cpu : usr=0.10%, sys=6.93%, ctx=5822, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 5 (file:backend.c:481, func=full resid, error=Input/output error): pid=146520: Sat Jul 18 16:29:56 2026 read: IOPS=13, BW=54.6KiB/s (55.9kB/s)(3732KiB/68316msec) clat (msec): min=3, max=195, avg=19.78, stdev=17.55 lat (msec): min=3, max=195, avg=19.78, stdev=17.55 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 6], 10.00th=[ 6], 20.00th=[ 8], | 30.00th=[ 9], 40.00th=[ 12], 50.00th=[ 15], 60.00th=[ 18], | 70.00th=[ 23], 80.00th=[ 29], 90.00th=[ 41], 95.00th=[ 51], | 99.00th=[ 87], 99.50th=[ 109], 99.90th=[ 197], 99.95th=[ 197], | 99.99th=[ 197] bw ( KiB/s): min= 7, max= 192, per=23.20%, avg=55.67, stdev=31.41, samples=133 iops : min= 1, max= 48, avg=13.58, stdev= 7.97, samples=133 write: IOPS=14, BW=56.4KiB/s (57.8kB/s)(3856KiB/68316msec); 0 zone resets clat (msec): min=16, max=808, avg=51.51, stdev=34.65 lat (msec): min=16, max=808, avg=51.51, stdev=34.65 clat percentiles (msec): | 1.00th=[ 21], 5.00th=[ 24], 10.00th=[ 27], 20.00th=[ 32], | 30.00th=[ 36], 40.00th=[ 42], 50.00th=[ 47], 60.00th=[ 53], | 70.00th=[ 59], 80.00th=[ 67], 90.00th=[ 80], 95.00th=[ 90], | 99.00th=[ 120], 99.50th=[ 207], 99.90th=[ 810], 99.95th=[ 810], | 99.99th=[ 810] bw ( KiB/s): min= 16, max= 120, per=22.56%, avg=56.61, stdev=25.18, samples=135 iops : min= 4, max= 30, avg=13.81, stdev= 6.42, samples=135 lat (msec) : 4=0.11%, 10=17.07%, 20=14.86%, 50=42.62%, 100=23.34% lat (msec) : 250=1.84%, 500=0.05%, 1000=0.05% cpu : usr=0.08%, sys=7.06%, ctx=3508, majf=0, minf=19 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=934,964,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=240KiB/s (246kB/s), 54.6KiB/s-66.0KiB/s (55.9kB/s-68.6kB/s), io=21.2MiB (22.2MB), run=68316-90359msec WRITE: bw=252KiB/s (258kB/s), 56.4KiB/s-70.4KiB/s (57.8kB/s-72.1kB/s), io=22.2MiB (23.3MB), run=68316-90359msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=146559: Sat Jul 18 16:30:16 2026 read: IOPS=26, BW=424KiB/s (434kB/s)(5920KiB/13954msec) clat (usec): min=50, max=104228, avg=18385.89, stdev=12046.89 lat (usec): min=51, max=104228, avg=18386.81, stdev=12046.90 clat percentiles (usec): | 1.00th=[ 67], 5.00th=[ 106], 10.00th=[ 147], 20.00th=[ 10552], | 30.00th=[ 12911], 40.00th=[ 15270], 50.00th=[ 17695], 60.00th=[ 19792], | 70.00th=[ 22938], 80.00th=[ 26084], 90.00th=[ 31327], 95.00th=[ 37487], | 99.00th=[ 63701], 99.50th=[ 74974], 99.90th=[104334], 99.95th=[104334], | 99.99th=[104334] bw ( KiB/s): min= 287, max= 599, per=24.82%, avg=412.78, stdev=83.85, samples=27 iops : min= 17, max= 37, avg=25.37, stdev= 5.43, samples=27 write: IOPS=28, BW=456KiB/s (467kB/s)(6368KiB/13954msec); 0 zone resets clat (usec): min=1202, max=146494, avg=17853.86, stdev=16193.97 lat (usec): min=1203, max=146497, avg=17933.16, stdev=16209.75 clat percentiles (usec): | 1.00th=[ 1549], 5.00th=[ 3425], 10.00th=[ 4228], 20.00th=[ 5604], | 30.00th=[ 7308], 40.00th=[ 10028], 50.00th=[ 13042], 60.00th=[ 17171], | 70.00th=[ 21103], 80.00th=[ 27657], 90.00th=[ 38011], 95.00th=[ 46400], | 99.00th=[ 79168], 99.50th=[110625], 99.90th=[145753], 99.95th=[145753], | 99.99th=[145753] bw ( KiB/s): min= 223, max= 768, per=25.82%, avg=451.78, stdev=145.84, samples=27 iops : min= 13, max= 48, avg=27.78, stdev= 9.22, samples=27 lat (usec) : 100=2.08%, 250=4.30% lat (msec) : 2=0.91%, 4=3.52%, 10=18.62%, 20=34.11%, 50=34.11% lat (msec) : 100=1.82%, 250=0.52% cpu : usr=0.11%, sys=27.74%, ctx=2423, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146560: Sat Jul 18 16:30:16 2026 read: IOPS=25, BW=408KiB/s (418kB/s)(5744KiB/14081msec) clat (usec): min=39, max=176207, avg=19742.31, stdev=16405.68 lat (usec): min=40, max=176208, avg=19743.39, stdev=16405.69 clat percentiles (usec): | 1.00th=[ 69], 5.00th=[ 98], 10.00th=[ 137], 20.00th=[ 10421], | 30.00th=[ 12780], 40.00th=[ 15401], 50.00th=[ 18220], 60.00th=[ 21103], | 70.00th=[ 23987], 80.00th=[ 28443], 90.00th=[ 35390], 95.00th=[ 44827], | 99.00th=[ 71828], 99.50th=[120062], 99.90th=[177210], 99.95th=[177210], | 99.99th=[177210] bw ( KiB/s): min= 223, max= 542, per=24.57%, avg=408.64, stdev=99.32, samples=28 iops : min= 13, max= 33, avg=25.07, stdev= 6.24, samples=28 write: IOPS=29, BW=465KiB/s (476kB/s)(6544KiB/14081msec); 0 zone resets clat (usec): min=1411, max=88004, avg=17029.89, stdev=13261.18 lat (usec): min=1412, max=88005, avg=17031.93, stdev=13261.50 clat percentiles (usec): | 1.00th=[ 2114], 5.00th=[ 2933], 10.00th=[ 3982], 20.00th=[ 5800], | 30.00th=[ 7963], 40.00th=[10552], 50.00th=[13698], 60.00th=[18220], | 70.00th=[21890], 80.00th=[26608], 90.00th=[34341], 95.00th=[40633], | 99.00th=[60556], 99.50th=[83362], 99.90th=[87557], 99.95th=[87557], | 99.99th=[87557] bw ( KiB/s): min= 255, max= 798, per=26.53%, avg=464.21, stdev=117.99, samples=28 iops : min= 15, max= 49, avg=28.57, stdev= 7.50, samples=28 lat (usec) : 50=0.26%, 100=2.08%, 250=4.56%, 500=0.65%, 750=0.13% lat (msec) : 2=0.52%, 4=4.82%, 10=16.15%, 20=32.42%, 50=36.20% lat (msec) : 100=1.95%, 250=0.26% cpu : usr=0.11%, sys=27.54%, ctx=2555, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146561: Sat Jul 18 16:30:16 2026 read: IOPS=27, BW=435KiB/s (445kB/s)(6256KiB/14397msec) clat (usec): min=41, max=79265, avg=18978.56, stdev=13097.59 lat (usec): min=41, max=79266, avg=18979.51, stdev=13097.65 clat percentiles (usec): | 1.00th=[ 59], 5.00th=[ 106], 10.00th=[ 123], 20.00th=[10159], | 30.00th=[13042], 40.00th=[15008], 50.00th=[17433], 60.00th=[20055], | 70.00th=[23725], 80.00th=[27919], 90.00th=[35390], 95.00th=[42730], | 99.00th=[64226], 99.50th=[69731], 99.90th=[79168], 99.95th=[79168], | 99.99th=[79168] bw ( KiB/s): min= 256, max= 736, per=26.22%, avg=436.04, stdev=120.65, samples=28 iops : min= 16, max= 46, avg=26.79, stdev= 7.70, samples=28 write: IOPS=26, BW=419KiB/s (429kB/s)(6032KiB/14397msec); 0 zone resets clat (usec): min=1789, max=106597, avg=18455.49, stdev=15369.35 lat (usec): min=1792, max=106598, avg=18461.63, stdev=15368.50 clat percentiles (usec): | 1.00th=[ 1860], 5.00th=[ 3621], 10.00th=[ 4228], 20.00th=[ 5407], | 30.00th=[ 7177], 40.00th=[ 10552], 50.00th=[ 14091], 60.00th=[ 19268], | 70.00th=[ 23200], 80.00th=[ 29230], 90.00th=[ 39584], 95.00th=[ 46400], | 99.00th=[ 76022], 99.50th=[ 84411], 99.90th=[106431], 99.95th=[106431], | 99.99th=[106431] bw ( KiB/s): min= 223, max= 734, per=23.73%, avg=415.36, stdev=127.80, samples=28 iops : min= 13, max= 45, avg=25.50, stdev= 7.90, samples=28 lat (usec) : 50=0.13%, 100=2.08%, 250=5.08%, 500=0.39% lat (msec) : 2=0.52%, 4=3.39%, 10=16.80%, 20=33.07%, 50=35.16% lat (msec) : 100=3.26%, 250=0.13% cpu : usr=0.14%, sys=27.15%, ctx=2554, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146562: Sat Jul 18 16:30:16 2026 read: IOPS=26, BW=426KiB/s (436kB/s)(6032KiB/14157msec) clat (usec): min=21, max=70983, avg=19421.45, stdev=12423.25 lat (usec): min=21, max=70985, avg=19422.38, stdev=12423.31 clat percentiles (usec): | 1.00th=[ 45], 5.00th=[ 103], 10.00th=[ 130], 20.00th=[11076], | 30.00th=[13698], 40.00th=[15926], 50.00th=[18220], 60.00th=[21103], | 70.00th=[24511], 80.00th=[28443], 90.00th=[33817], 95.00th=[40109], | 99.00th=[62653], 99.50th=[70779], 99.90th=[70779], 99.95th=[70779], | 99.99th=[70779] bw ( KiB/s): min= 286, max= 638, per=25.33%, avg=421.18, stdev=100.26, samples=28 iops : min= 17, max= 39, avg=25.86, stdev= 6.26, samples=28 write: IOPS=27, BW=442KiB/s (453kB/s)(6256KiB/14157msec); 0 zone resets clat (usec): min=1432, max=156314, avg=17423.78, stdev=14983.13 lat (usec): min=1434, max=156315, avg=17425.72, stdev=14983.05 clat percentiles (usec): | 1.00th=[ 1827], 5.00th=[ 3359], 10.00th=[ 4228], 20.00th=[ 5669], | 30.00th=[ 7635], 40.00th=[ 10290], 50.00th=[ 13173], 60.00th=[ 16450], | 70.00th=[ 22152], 80.00th=[ 28705], 90.00th=[ 34866], 95.00th=[ 41681], | 99.00th=[ 65274], 99.50th=[ 82314], 99.90th=[156238], 99.95th=[156238], | 99.99th=[156238] bw ( KiB/s): min= 254, max= 766, per=25.11%, avg=439.39, stdev=125.03, samples=28 iops : min= 15, max= 47, avg=27.00, stdev= 7.86, samples=28 lat (usec) : 50=0.52%, 100=1.43%, 250=4.43%, 500=0.26%, 750=0.13% lat (msec) : 2=0.91%, 4=2.73%, 10=17.45%, 20=34.51%, 50=35.16% lat (msec) : 100=2.34%, 250=0.13% cpu : usr=0.11%, sys=27.67%, ctx=2399, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1664KiB/s (1704kB/s), 408KiB/s-435KiB/s (418kB/s-445kB/s), io=23.4MiB (24.5MB), run=13954-14397msec WRITE: bw=1750KiB/s (1792kB/s), 419KiB/s-465KiB/s (429kB/s-476kB/s), io=24.6MiB (25.8MB), run=13954-14397msec rand-rw: (groupid=0, jobs=1): err= 0: pid=146554: Sat Jul 18 16:30:27 2026 read: IOPS=14, BW=230KiB/s (236kB/s)(5920KiB/25706msec) clat (msec): min=4, max=120, avg=20.12, stdev=17.58 lat (msec): min=4, max=120, avg=20.12, stdev=17.58 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 7], 10.00th=[ 8], 20.00th=[ 9], | 30.00th=[ 12], 40.00th=[ 13], 50.00th=[ 15], 60.00th=[ 17], | 70.00th=[ 20], 80.00th=[ 26], 90.00th=[ 41], 95.00th=[ 58], | 99.00th=[ 97], 99.50th=[ 121], 99.90th=[ 121], 99.95th=[ 121], | 99.99th=[ 121] bw ( KiB/s): min= 95, max= 480, per=25.14%, avg=230.31, stdev=106.20, samples=51 iops : min= 5, max= 30, avg=14.00, stdev= 6.78, samples=51 write: IOPS=15, BW=248KiB/s (254kB/s)(6368KiB/25706msec); 0 zone resets clat (msec): min=18, max=167, avg=45.75, stdev=22.42 lat (msec): min=18, max=167, avg=45.76, stdev=22.42 clat percentiles (msec): | 1.00th=[ 21], 5.00th=[ 25], 10.00th=[ 27], 20.00th=[ 29], | 30.00th=[ 33], 40.00th=[ 35], 50.00th=[ 40], 60.00th=[ 43], | 70.00th=[ 50], 80.00th=[ 57], 90.00th=[ 77], 95.00th=[ 96], | 99.00th=[ 121], 99.50th=[ 124], 99.90th=[ 167], 99.95th=[ 167], | 99.99th=[ 167] bw ( KiB/s): min= 32, max= 447, per=25.69%, avg=247.61, stdev=105.71, samples=51 iops : min= 2, max= 27, avg=15.08, stdev= 6.75, samples=51 lat (msec) : 10=11.59%, 20=23.05%, 50=46.35%, 100=16.28%, 250=2.73% cpu : usr=0.14%, sys=8.23%, ctx=1818, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146555: Sat Jul 18 16:30:27 2026 read: IOPS=13, BW=220KiB/s (225kB/s)(5744KiB/26126msec) clat (msec): min=4, max=157, avg=18.83, stdev=16.95 lat (msec): min=4, max=157, avg=18.83, stdev=16.95 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 7], 10.00th=[ 7], 20.00th=[ 9], | 30.00th=[ 11], 40.00th=[ 13], 50.00th=[ 15], 60.00th=[ 17], | 70.00th=[ 19], 80.00th=[ 23], 90.00th=[ 35], 95.00th=[ 53], | 99.00th=[ 96], 99.50th=[ 118], 99.90th=[ 157], 99.95th=[ 157], | 99.99th=[ 157] bw ( KiB/s): min= 31, max= 608, per=23.94%, avg=219.33, stdev=127.31, samples=51 iops : min= 1, max= 38, avg=13.29, stdev= 8.13, samples=51 write: IOPS=15, BW=250KiB/s (256kB/s)(6544KiB/26126msec); 0 zone resets clat (msec): min=19, max=174, avg=47.28, stdev=22.93 lat (msec): min=19, max=174, avg=47.28, stdev=22.93 clat percentiles (msec): | 1.00th=[ 23], 5.00th=[ 26], 10.00th=[ 28], 20.00th=[ 31], | 30.00th=[ 34], 40.00th=[ 36], 50.00th=[ 40], 60.00th=[ 44], | 70.00th=[ 51], 80.00th=[ 61], 90.00th=[ 80], 95.00th=[ 95], | 99.00th=[ 128], 99.50th=[ 144], 99.90th=[ 176], 99.95th=[ 176], | 99.99th=[ 176] bw ( KiB/s): min= 63, max= 416, per=25.65%, avg=247.27, stdev=93.80, samples=51 iops : min= 3, max= 26, avg=15.06, stdev= 6.03, samples=51 lat (msec) : 10=12.89%, 20=22.14%, 50=46.35%, 100=16.28%, 250=2.34% cpu : usr=0.08%, sys=7.97%, ctx=1762, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146556: Sat Jul 18 16:30:27 2026 read: IOPS=15, BW=252KiB/s (258kB/s)(6256KiB/24839msec) clat (usec): min=4790, max=98429, avg=19564.47, stdev=16254.49 lat (usec): min=4791, max=98430, avg=19565.69, stdev=16254.40 clat percentiles (usec): | 1.00th=[ 5014], 5.00th=[ 6063], 10.00th=[ 6783], 20.00th=[ 8586], | 30.00th=[10290], 40.00th=[12125], 50.00th=[14615], 60.00th=[16450], | 70.00th=[19268], 80.00th=[26870], 90.00th=[38536], 95.00th=[58459], | 99.00th=[84411], 99.50th=[98042], 99.90th=[98042], 99.95th=[98042], | 99.99th=[98042] bw ( KiB/s): min= 63, max= 672, per=27.64%, avg=253.22, stdev=142.09, samples=49 iops : min= 3, max= 42, avg=15.41, stdev= 8.97, samples=49 write: IOPS=15, BW=243KiB/s (249kB/s)(6032KiB/24839msec); 0 zone resets clat (msec): min=18, max=172, avg=45.48, stdev=21.14 lat (msec): min=18, max=172, avg=45.49, stdev=21.14 clat percentiles (msec): | 1.00th=[ 20], 5.00th=[ 25], 10.00th=[ 27], 20.00th=[ 29], | 30.00th=[ 32], 40.00th=[ 35], 50.00th=[ 40], 60.00th=[ 44], | 70.00th=[ 50], 80.00th=[ 59], 90.00th=[ 75], 95.00th=[ 90], | 99.00th=[ 115], 99.50th=[ 123], 99.90th=[ 174], 99.95th=[ 174], | 99.99th=[ 174] bw ( KiB/s): min= 95, max= 480, per=25.03%, avg=241.29, stdev=101.96, samples=49 iops : min= 5, max= 30, avg=14.65, stdev= 6.54, samples=49 lat (msec) : 10=13.93%, 20=22.79%, 50=45.96%, 100=16.02%, 250=1.30% cpu : usr=0.08%, sys=8.60%, ctx=1730, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146557: Sat Jul 18 16:30:27 2026 read: IOPS=14, BW=238KiB/s (243kB/s)(6032KiB/25378msec) clat (msec): min=4, max=157, avg=20.15, stdev=17.93 lat (msec): min=4, max=157, avg=20.15, stdev=17.93 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 7], 10.00th=[ 8], 20.00th=[ 9], | 30.00th=[ 12], 40.00th=[ 14], 50.00th=[ 15], 60.00th=[ 17], | 70.00th=[ 20], 80.00th=[ 26], 90.00th=[ 39], 95.00th=[ 63], | 99.00th=[ 93], 99.50th=[ 111], 99.90th=[ 159], 99.95th=[ 159], | 99.99th=[ 159] bw ( KiB/s): min= 63, max= 480, per=25.76%, avg=236.00, stdev=108.68, samples=50 iops : min= 3, max= 30, avg=14.34, stdev= 6.94, samples=50 write: IOPS=15, BW=247KiB/s (252kB/s)(6256KiB/25378msec); 0 zone resets clat (msec): min=20, max=158, avg=45.32, stdev=19.80 lat (msec): min=20, max=158, avg=45.32, stdev=19.80 clat percentiles (msec): | 1.00th=[ 23], 5.00th=[ 26], 10.00th=[ 28], 20.00th=[ 31], | 30.00th=[ 34], 40.00th=[ 37], 50.00th=[ 40], 60.00th=[ 43], | 70.00th=[ 49], 80.00th=[ 58], 90.00th=[ 70], 95.00th=[ 89], | 99.00th=[ 113], 99.50th=[ 132], 99.90th=[ 159], 99.95th=[ 159], | 99.99th=[ 159] bw ( KiB/s): min= 95, max= 448, per=25.59%, avg=246.68, stdev=96.94, samples=50 iops : min= 5, max= 28, avg=15.00, stdev= 6.22, samples=50 lat (msec) : 10=12.50%, 20=22.27%, 50=47.79%, 100=16.02%, 250=1.43% cpu : usr=0.09%, sys=8.50%, ctx=1729, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=917KiB/s (939kB/s), 220KiB/s-252KiB/s (225kB/s-258kB/s), io=23.4MiB (24.5MB), run=24839-26126msec WRITE: bw=965KiB/s (988kB/s), 243KiB/s-250KiB/s (249kB/s-256kB/s), io=24.6MiB (25.8MB), run=24839-26126msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=146572: Sat Jul 18 16:30:37 2026 read: IOPS=2, BW=2436KiB/s (2495kB/s)(7168KiB/2942msec) clat (msec): min=96, max=363, avg=210.44, stdev=96.54 lat (msec): min=96, max=363, avg=210.45, stdev=96.54 clat percentiles (msec): | 1.00th=[ 97], 5.00th=[ 97], 10.00th=[ 97], 20.00th=[ 127], | 30.00th=[ 161], 40.00th=[ 161], 50.00th=[ 180], 60.00th=[ 249], | 70.00th=[ 249], 80.00th=[ 300], 90.00th=[ 363], 95.00th=[ 363], | 99.00th=[ 363], 99.50th=[ 363], 99.90th=[ 363], 99.95th=[ 363], | 99.99th=[ 363] bw ( KiB/s): min= 2043, max= 4071, per=49.76%, avg=2914.00, stdev=1030.15, samples=4 iops : min= 1, max= 3, avg= 2.25, stdev= 0.96, samples=4 write: IOPS=1, BW=1740KiB/s (1782kB/s)(5120KiB/2942msec); 0 zone resets clat (msec): min=134, max=487, avg=280.75, stdev=130.68 lat (msec): min=134, max=487, avg=280.84, stdev=130.69 clat percentiles (msec): | 1.00th=[ 136], 5.00th=[ 136], 10.00th=[ 136], 20.00th=[ 136], | 30.00th=[ 220], 40.00th=[ 220], 50.00th=[ 268], 60.00th=[ 268], | 70.00th=[ 296], 80.00th=[ 296], 90.00th=[ 489], 95.00th=[ 489], | 99.00th=[ 489], 99.50th=[ 489], 99.90th=[ 489], 99.95th=[ 489], | 99.99th=[ 489] bw ( KiB/s): min= 2035, max= 2048, per=24.91%, avg=2042.25, stdev= 5.38, samples=4 iops : min= 1, max= 2, avg= 1.25, stdev= 0.50, samples=4 lat (msec) : 100=8.33%, 250=50.00%, 500=41.67% cpu : usr=0.03%, sys=13.70%, ctx=117, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146573: Sat Jul 18 16:30:37 2026 read: IOPS=0, BW=586KiB/s (600kB/s)(2048KiB/3497msec) clat (msec): min=80, max=199, avg=139.76, stdev=84.39 lat (msec): min=80, max=199, avg=139.76, stdev=84.39 clat percentiles (msec): | 1.00th=[ 81], 5.00th=[ 81], 10.00th=[ 81], 20.00th=[ 81], | 30.00th=[ 81], 40.00th=[ 81], 50.00th=[ 81], 60.00th=[ 201], | 70.00th=[ 201], 80.00th=[ 201], 90.00th=[ 201], 95.00th=[ 201], | 99.00th=[ 201], 99.50th=[ 201], 99.90th=[ 201], 99.95th=[ 201], | 99.99th=[ 201] bw ( KiB/s): min= 1718, max= 2043, per=32.11%, avg=1880.50, stdev=229.81, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2928KiB/s (2999kB/s)(10.0MiB/3497msec); 0 zone resets clat (msec): min=84, max=558, avg=312.46, stdev=171.97 lat (msec): min=84, max=558, avg=312.53, stdev=171.98 clat percentiles (msec): | 1.00th=[ 85], 5.00th=[ 85], 10.00th=[ 85], 20.00th=[ 134], | 30.00th=[ 165], 40.00th=[ 207], 50.00th=[ 220], 60.00th=[ 376], | 70.00th=[ 376], 80.00th=[ 493], 90.00th=[ 510], 95.00th=[ 558], | 99.00th=[ 558], 99.50th=[ 558], 99.90th=[ 558], 99.95th=[ 558], | 99.99th=[ 558] bw ( KiB/s): min= 1718, max= 4071, per=28.39%, avg=2327.67, stdev=863.97, samples=6 iops : min= 1, max= 3, avg= 1.50, stdev= 0.84, samples=6 lat (msec) : 100=16.67%, 250=41.67%, 500=25.00%, 750=16.67% cpu : usr=0.00%, sys=18.25%, ctx=262, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146574: Sat Jul 18 16:30:37 2026 read: IOPS=1, BW=1765KiB/s (1807kB/s)(6144KiB/3481msec) clat (msec): min=101, max=180, avg=141.44, stdev=28.20 lat (msec): min=101, max=180, avg=141.44, stdev=28.20 clat percentiles (msec): | 1.00th=[ 102], 5.00th=[ 102], 10.00th=[ 102], 20.00th=[ 124], | 30.00th=[ 124], 40.00th=[ 138], 50.00th=[ 138], 60.00th=[ 142], | 70.00th=[ 165], 80.00th=[ 165], 90.00th=[ 180], 95.00th=[ 180], | 99.00th=[ 180], 99.50th=[ 180], 99.90th=[ 180], 99.95th=[ 180], | 99.99th=[ 180] bw ( KiB/s): min= 2043, max= 4087, per=43.63%, avg=2555.25, stdev=1021.17, samples=4 iops : min= 1, max= 3, avg= 1.75, stdev= 0.96, samples=4 write: IOPS=1, BW=1765KiB/s (1807kB/s)(6144KiB/3481msec); 0 zone resets clat (msec): min=111, max=801, avg=434.91, stdev=248.55 lat (msec): min=111, max=801, avg=434.99, stdev=248.58 clat percentiles (msec): | 1.00th=[ 112], 5.00th=[ 112], 10.00th=[ 112], 20.00th=[ 292], | 30.00th=[ 292], 40.00th=[ 347], 50.00th=[ 347], 60.00th=[ 422], | 70.00th=[ 642], 80.00th=[ 642], 90.00th=[ 802], 95.00th=[ 802], | 99.00th=[ 802], 99.50th=[ 802], 99.90th=[ 802], 99.95th=[ 802], | 99.99th=[ 802] bw ( KiB/s): min= 2043, max= 3407, per=29.08%, avg=2384.00, stdev=682.00, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (msec) : 250=58.33%, 500=25.00%, 750=8.33%, 1000=8.33% cpu : usr=0.03%, sys=13.74%, ctx=98, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146575: Sat Jul 18 16:30:37 2026 read: IOPS=2, BW=2352KiB/s (2408kB/s)(5120KiB/2177msec) clat (msec): min=62, max=275, avg=182.28, stdev=97.51 lat (msec): min=62, max=275, avg=182.28, stdev=97.51 clat percentiles (msec): | 1.00th=[ 63], 5.00th=[ 63], 10.00th=[ 63], 20.00th=[ 63], | 30.00th=[ 93], 40.00th=[ 93], 50.00th=[ 226], 60.00th=[ 226], | 70.00th=[ 255], 80.00th=[ 255], 90.00th=[ 275], 95.00th=[ 275], | 99.00th=[ 275], 99.50th=[ 275], 99.90th=[ 275], 99.95th=[ 275], | 99.99th=[ 275] bw ( KiB/s): min= 8175, max= 8175, per=100.00%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 7, max= 7, avg= 7.00, stdev= 0.00, samples=1 write: IOPS=3, BW=3293KiB/s (3372kB/s)(7168KiB/2177msec); 0 zone resets clat (msec): min=79, max=506, avg=174.48, stdev=149.63 lat (msec): min=79, max=506, avg=174.56, stdev=149.63 clat percentiles (msec): | 1.00th=[ 80], 5.00th=[ 80], 10.00th=[ 80], 20.00th=[ 82], | 30.00th=[ 116], 40.00th=[ 116], 50.00th=[ 130], 60.00th=[ 155], | 70.00th=[ 155], 80.00th=[ 155], 90.00th=[ 506], 95.00th=[ 506], | 99.00th=[ 506], 99.50th=[ 506], 99.90th=[ 506], 99.95th=[ 506], | 99.99th=[ 506] bw ( KiB/s): min= 2035, max= 6131, per=54.44%, avg=4463.33, stdev=2151.34, samples=3 iops : min= 1, max= 5, avg= 3.67, stdev= 2.31, samples=3 lat (msec) : 100=33.33%, 250=41.67%, 500=16.67%, 750=8.33% cpu : usr=0.05%, sys=13.28%, ctx=82, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5856KiB/s (5997kB/s), 586KiB/s-2436KiB/s (600kB/s-2495kB/s), io=20.0MiB (20.0MB), run=2177-3497msec WRITE: bw=8199KiB/s (8396kB/s), 1740KiB/s-3293KiB/s (1782kB/s-3372kB/s), io=28.0MiB (29.4MB), run=2177-3497msec rand-rw: (groupid=0, jobs=1): err= 0: pid=146577: Sat Jul 18 16:30:37 2026 read: IOPS=2, BW=2448KiB/s (2507kB/s)(7168KiB/2928msec) clat (usec): min=656, max=248258, avg=127703.88, stdev=97149.98 lat (usec): min=658, max=248260, avg=127705.19, stdev=97149.96 clat percentiles (usec): | 1.00th=[ 660], 5.00th=[ 660], 10.00th=[ 660], 20.00th=[ 734], | 30.00th=[122160], 40.00th=[122160], 50.00th=[127402], 60.00th=[193987], | 70.00th=[193987], 80.00th=[202376], 90.00th=[248513], 95.00th=[248513], | 99.00th=[248513], 99.50th=[248513], 99.90th=[248513], 99.95th=[248513], | 99.99th=[248513] bw ( KiB/s): min= 2048, max= 3893, per=48.66%, avg=2859.00, stdev=954.00, samples=4 iops : min= 2, max= 3, avg= 2.50, stdev= 0.58, samples=4 write: IOPS=1, BW=1749KiB/s (1791kB/s)(5120KiB/2928msec); 0 zone resets clat (msec): min=156, max=585, avg=374.59, stdev=152.75 lat (msec): min=156, max=585, avg=374.67, stdev=152.73 clat percentiles (msec): | 1.00th=[ 157], 5.00th=[ 157], 10.00th=[ 157], 20.00th=[ 157], | 30.00th=[ 351], 40.00th=[ 351], 50.00th=[ 380], 60.00th=[ 380], | 70.00th=[ 401], 80.00th=[ 401], 90.00th=[ 584], 95.00th=[ 584], | 99.00th=[ 584], 99.50th=[ 584], 99.90th=[ 584], 99.95th=[ 584], | 99.99th=[ 584] bw ( KiB/s): min= 1946, max= 4096, per=32.78%, avg=2696.67, stdev=1212.93, samples=3 iops : min= 1, max= 4, avg= 2.33, stdev= 1.53, samples=3 lat (usec) : 750=16.67% lat (msec) : 250=50.00%, 500=25.00%, 750=8.33% cpu : usr=0.00%, sys=44.24%, ctx=516, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146578: Sat Jul 18 16:30:37 2026 read: IOPS=0, BW=588KiB/s (602kB/s)(2048KiB/3485msec) clat (msec): min=117, max=174, avg=145.89, stdev=39.91 lat (msec): min=117, max=174, avg=145.89, stdev=39.91 clat percentiles (msec): | 1.00th=[ 118], 5.00th=[ 118], 10.00th=[ 118], 20.00th=[ 118], | 30.00th=[ 118], 40.00th=[ 118], 50.00th=[ 118], 60.00th=[ 176], | 70.00th=[ 176], 80.00th=[ 176], 90.00th=[ 176], 95.00th=[ 176], | 99.00th=[ 176], 99.50th=[ 176], 99.90th=[ 176], 99.95th=[ 176], | 99.99th=[ 176] bw ( KiB/s): min= 1741, max= 1996, per=31.80%, avg=1868.50, stdev=180.31, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2938KiB/s (3009kB/s)(10.0MiB/3485msec); 0 zone resets clat (msec): min=95, max=645, avg=316.13, stdev=203.91 lat (msec): min=95, max=645, avg=316.22, stdev=203.92 clat percentiles (msec): | 1.00th=[ 96], 5.00th=[ 96], 10.00th=[ 96], 20.00th=[ 114], | 30.00th=[ 146], 40.00th=[ 226], 50.00th=[ 230], 60.00th=[ 230], | 70.00th=[ 359], 80.00th=[ 518], 90.00th=[ 600], 95.00th=[ 642], | 99.00th=[ 642], 99.50th=[ 642], 99.90th=[ 642], 99.95th=[ 642], | 99.99th=[ 642] bw ( KiB/s): min= 1996, max= 4096, per=34.22%, avg=2815.20, stdev=1079.13, samples=5 iops : min= 1, max= 4, avg= 2.20, stdev= 1.30, samples=5 lat (msec) : 100=8.33%, 250=58.33%, 500=8.33%, 750=25.00% cpu : usr=0.00%, sys=37.63%, ctx=402, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146579: Sat Jul 18 16:30:37 2026 read: IOPS=2, BW=2444KiB/s (2503kB/s)(6144KiB/2514msec) clat (usec): min=421, max=274035, avg=73292.09, stdev=117942.56 lat (usec): min=421, max=274036, avg=73293.05, stdev=117942.57 clat percentiles (usec): | 1.00th=[ 420], 5.00th=[ 420], 10.00th=[ 420], 20.00th=[ 570], | 30.00th=[ 570], 40.00th=[ 635], 50.00th=[ 635], 60.00th=[ 734], | 70.00th=[162530], 80.00th=[162530], 90.00th=[274727], 95.00th=[274727], | 99.00th=[274727], 99.50th=[274727], 99.90th=[274727], 99.95th=[274727], | 99.99th=[274727] bw ( KiB/s): min= 1996, max= 6144, per=69.26%, avg=4070.00, stdev=2933.08, samples=2 iops : min= 1, max= 6, avg= 3.50, stdev= 3.54, samples=2 write: IOPS=2, BW=2444KiB/s (2503kB/s)(6144KiB/2514msec); 0 zone resets clat (msec): min=211, max=687, avg=322.75, stdev=181.85 lat (msec): min=211, max=687, avg=322.82, stdev=181.86 clat percentiles (msec): | 1.00th=[ 211], 5.00th=[ 211], 10.00th=[ 211], 20.00th=[ 218], | 30.00th=[ 218], 40.00th=[ 247], 50.00th=[ 247], 60.00th=[ 271], | 70.00th=[ 305], 80.00th=[ 305], 90.00th=[ 684], 95.00th=[ 684], | 99.00th=[ 684], 99.50th=[ 684], 99.90th=[ 684], 99.95th=[ 684], | 99.99th=[ 684] bw ( KiB/s): min= 1715, max= 4096, per=29.64%, avg=2438.25, stdev=1111.92, samples=4 iops : min= 1, max= 4, avg= 1.75, stdev= 1.50, samples=4 lat (usec) : 500=8.33%, 750=25.00% lat (msec) : 250=33.33%, 500=25.00%, 750=8.33% cpu : usr=0.04%, sys=42.30%, ctx=266, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146580: Sat Jul 18 16:30:37 2026 read: IOPS=1, BW=1718KiB/s (1759kB/s)(5120KiB/2980msec) clat (usec): min=613, max=208446, avg=82274.84, stdev=111660.21 lat (usec): min=613, max=208446, avg=82275.71, stdev=111660.02 clat percentiles (usec): | 1.00th=[ 611], 5.00th=[ 611], 10.00th=[ 611], 20.00th=[ 611], | 30.00th=[ 709], 40.00th=[ 709], 50.00th=[ 947], 60.00th=[ 947], | 70.00th=[200279], 80.00th=[200279], 90.00th=[208667], 95.00th=[208667], | 99.00th=[208667], 99.50th=[208667], 99.90th=[208667], 99.95th=[208667], | 99.99th=[208667] bw ( KiB/s): min= 3992, max= 4096, per=68.82%, avg=4044.00, stdev=73.54, samples=2 iops : min= 3, max= 4, avg= 3.50, stdev= 0.71, samples=2 write: IOPS=2, BW=2405KiB/s (2463kB/s)(7168KiB/2980msec); 0 zone resets clat (msec): min=173, max=521, avg=346.15, stdev=117.54 lat (msec): min=173, max=521, avg=346.24, stdev=117.56 clat percentiles (msec): | 1.00th=[ 174], 5.00th=[ 174], 10.00th=[ 174], 20.00th=[ 271], | 30.00th=[ 292], 40.00th=[ 292], 50.00th=[ 321], 60.00th=[ 393], | 70.00th=[ 393], 80.00th=[ 451], 90.00th=[ 523], 95.00th=[ 523], | 99.00th=[ 523], 99.50th=[ 523], 99.90th=[ 523], 99.95th=[ 523], | 99.99th=[ 523] bw ( KiB/s): min= 1735, max= 2048, per=23.76%, avg=1954.60, stdev=129.86, samples=5 iops : min= 1, max= 2, avg= 1.40, stdev= 0.55, samples=5 lat (usec) : 750=16.67%, 1000=8.33% lat (msec) : 250=25.00%, 500=41.67%, 750=8.33% cpu : usr=0.03%, sys=37.33%, ctx=196, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5877KiB/s (6018kB/s), 588KiB/s-2448KiB/s (602kB/s-2507kB/s), io=20.0MiB (20.0MB), run=2514-3485msec WRITE: bw=8227KiB/s (8425kB/s), 1749KiB/s-2938KiB/s (1791kB/s-3009kB/s), io=28.0MiB (29.4MB), run=2514-3485msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=146586: Sat Jul 18 16:30:46 2026 read: IOPS=1, BW=6767KiB/s (6929kB/s)(12.0MiB/1816msec) clat (msec): min=481, max=634, avg=561.77, stdev=76.66 lat (msec): min=481, max=634, avg=561.78, stdev=76.66 clat percentiles (msec): | 1.00th=[ 481], 5.00th=[ 481], 10.00th=[ 481], 20.00th=[ 481], | 30.00th=[ 481], 40.00th=[ 567], 50.00th=[ 567], 60.00th=[ 567], | 70.00th=[ 634], 80.00th=[ 634], 90.00th=[ 634], 95.00th=[ 634], | 99.00th=[ 634], 99.50th=[ 634], 99.90th=[ 634], 99.95th=[ 634], | 99.99th=[ 634] bw ( KiB/s): min= 8175, max= 8175, per=90.61%, avg=8175.00, stdev= 0.00, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 750=66.67% cpu : usr=0.00%, sys=36.86%, ctx=1185, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146587: Sat Jul 18 16:30:46 2026 read: IOPS=0, BW=2714KiB/s (2780kB/s)(4096KiB/1509msec) clat (nsec): min=632338k, max=632338k, avg=632337942.00, stdev= 0.00 lat (nsec): min=632339k, max=632339k, avg=632339323.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 634], 5.00th=[ 634], 10.00th=[ 634], 20.00th=[ 634], | 30.00th=[ 634], 40.00th=[ 634], 50.00th=[ 634], 60.00th=[ 634], | 70.00th=[ 634], 80.00th=[ 634], 90.00th=[ 634], 95.00th=[ 634], | 99.00th=[ 634], 99.50th=[ 634], 99.90th=[ 634], 99.95th=[ 634], | 99.99th=[ 634] bw ( KiB/s): min= 8175, max= 8175, per=90.61%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=1, BW=5429KiB/s (5559kB/s)(8192KiB/1509msec); 0 zone resets clat (msec): min=284, max=476, avg=380.44, stdev=135.66 lat (msec): min=284, max=476, avg=380.71, stdev=135.47 clat percentiles (msec): | 1.00th=[ 284], 5.00th=[ 284], 10.00th=[ 284], 20.00th=[ 284], | 30.00th=[ 284], 40.00th=[ 284], 50.00th=[ 284], 60.00th=[ 477], | 70.00th=[ 477], 80.00th=[ 477], 90.00th=[ 477], 95.00th=[ 477], | 99.00th=[ 477], 99.50th=[ 477], 99.90th=[ 477], 99.95th=[ 477], | 99.99th=[ 477] bw ( KiB/s): min= 8175, max= 8175, per=56.56%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=66.67%, 750=33.33% cpu : usr=0.07%, sys=31.37%, ctx=434, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146588: Sat Jul 18 16:30:46 2026 write: IOPS=1, BW=5420KiB/s (5550kB/s)(12.0MiB/2267msec); 0 zone resets clat (msec): min=598, max=877, avg=716.66, stdev=144.38 lat (msec): min=599, max=878, avg=717.05, stdev=144.52 clat percentiles (msec): | 1.00th=[ 600], 5.00th=[ 600], 10.00th=[ 600], 20.00th=[ 600], | 30.00th=[ 600], 40.00th=[ 676], 50.00th=[ 676], 60.00th=[ 676], | 70.00th=[ 877], 80.00th=[ 877], 90.00th=[ 877], 95.00th=[ 877], | 99.00th=[ 877], 99.50th=[ 877], 99.90th=[ 877], 99.95th=[ 877], | 99.99th=[ 877] bw ( KiB/s): min= 8175, max= 8175, per=56.56%, avg=8175.00, stdev= 0.00, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=66.67%, 1000=33.33% cpu : usr=0.00%, sys=25.73%, ctx=149, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146589: Sat Jul 18 16:30:46 2026 write: IOPS=1, BW=6481KiB/s (6637kB/s)(12.0MiB/1896msec); 0 zone resets clat (msec): min=267, max=1257, avg=602.36, stdev=567.77 lat (msec): min=268, max=1258, avg=602.81, stdev=567.69 clat percentiles (msec): | 1.00th=[ 268], 5.00th=[ 268], 10.00th=[ 268], 20.00th=[ 268], | 30.00th=[ 268], 40.00th=[ 284], 50.00th=[ 284], 60.00th=[ 284], | 70.00th=[ 1250], 80.00th=[ 1250], 90.00th=[ 1250], 95.00th=[ 1250], | 99.00th=[ 1250], 99.50th=[ 1250], 99.90th=[ 1250], 99.95th=[ 1250], | 99.99th=[ 1250] bw ( KiB/s): min=12564, max=12564, per=86.92%, avg=12564.00, stdev= 0.00, samples=1 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=1 lat (msec) : 500=66.67%, 2000=33.33% cpu : usr=0.00%, sys=15.62%, ctx=107, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=9022KiB/s (9239kB/s), 2714KiB/s-6767KiB/s (2780kB/s-6929kB/s), io=16.0MiB (16.8MB), run=1509-1816msec WRITE: bw=14.1MiB/s (14.8MB/s), 5420KiB/s-6481KiB/s (5550kB/s-6637kB/s), io=32.0MiB (33.6MB), run=1509-2267msec rand-rw: (groupid=0, jobs=1): err= 0: pid=146591: Sat Jul 18 16:30:46 2026 read: IOPS=1, BW=5713KiB/s (5850kB/s)(12.0MiB/2151msec) clat (msec): min=62, max=1422, avg=708.32, stdev=682.49 lat (msec): min=62, max=1422, avg=708.32, stdev=682.49 clat percentiles (msec): | 1.00th=[ 63], 5.00th=[ 63], 10.00th=[ 63], 20.00th=[ 63], | 30.00th=[ 63], 40.00th=[ 642], 50.00th=[ 642], 60.00th=[ 642], | 70.00th=[ 1418], 80.00th=[ 1418], 90.00th=[ 1418], 95.00th=[ 1418], | 99.00th=[ 1418], 99.50th=[ 1418], 99.90th=[ 1418], 99.95th=[ 1418], | 99.99th=[ 1418] bw ( KiB/s): min= 8192, max= 8192, per=100.00%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 100=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.00%, sys=8.65%, ctx=59, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146592: Sat Jul 18 16:30:46 2026 read: IOPS=0, BW=2067KiB/s (2116kB/s)(4096KiB/1982msec) clat (nsec): min=939795k, max=939795k, avg=939794904.00, stdev= 0.00 lat (nsec): min=939797k, max=939797k, avg=939796823.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 944], 5.00th=[ 944], 10.00th=[ 944], 20.00th=[ 944], | 30.00th=[ 944], 40.00th=[ 944], 50.00th=[ 944], 60.00th=[ 944], | 70.00th=[ 944], 80.00th=[ 944], 90.00th=[ 944], 95.00th=[ 944], | 99.00th=[ 944], 99.50th=[ 944], 99.90th=[ 944], 99.95th=[ 944], | 99.99th=[ 944] bw ( KiB/s): min= 8175, max= 8175, per=100.00%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=1, BW=4133KiB/s (4232kB/s)(8192KiB/1982msec); 0 zone resets clat (msec): min=411, max=609, avg=510.75, stdev=139.73 lat (msec): min=412, max=609, avg=511.03, stdev=139.71 clat percentiles (msec): | 1.00th=[ 414], 5.00th=[ 414], 10.00th=[ 414], 20.00th=[ 414], | 30.00th=[ 414], 40.00th=[ 414], 50.00th=[ 414], 60.00th=[ 609], | 70.00th=[ 609], 80.00th=[ 609], 90.00th=[ 609], 95.00th=[ 609], | 99.00th=[ 609], 99.50th=[ 609], 99.90th=[ 609], 99.95th=[ 609], | 99.99th=[ 609] bw ( KiB/s): min= 8192, max= 8192, per=51.08%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 750=33.33%, 1000=33.33% cpu : usr=0.00%, sys=11.66%, ctx=72, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146593: Sat Jul 18 16:30:46 2026 write: IOPS=1, BW=6015KiB/s (6159kB/s)(12.0MiB/2043msec); 0 zone resets clat (msec): min=273, max=1254, avg=665.50, stdev=519.51 lat (msec): min=273, max=1254, avg=665.75, stdev=519.43 clat percentiles (msec): | 1.00th=[ 275], 5.00th=[ 275], 10.00th=[ 275], 20.00th=[ 275], | 30.00th=[ 275], 40.00th=[ 468], 50.00th=[ 468], 60.00th=[ 468], | 70.00th=[ 1250], 80.00th=[ 1250], 90.00th=[ 1250], 95.00th=[ 1250], | 99.00th=[ 1250], 99.50th=[ 1250], 99.90th=[ 1250], 99.95th=[ 1250], | 99.99th=[ 1250] bw ( KiB/s): min= 8192, max= 8192, per=51.08%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 500=66.67%, 2000=33.33% cpu : usr=0.00%, sys=12.34%, ctx=76, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146594: Sat Jul 18 16:30:46 2026 write: IOPS=1, BW=6327KiB/s (6479kB/s)(12.0MiB/1942msec); 0 zone resets clat (msec): min=218, max=1237, avg=632.01, stdev=535.75 lat (msec): min=219, max=1237, avg=632.40, stdev=535.72 clat percentiles (msec): | 1.00th=[ 220], 5.00th=[ 220], 10.00th=[ 220], 20.00th=[ 220], | 30.00th=[ 220], 40.00th=[ 439], 50.00th=[ 439], 60.00th=[ 439], | 70.00th=[ 1234], 80.00th=[ 1234], 90.00th=[ 1234], 95.00th=[ 1234], | 99.00th=[ 1234], 99.50th=[ 1234], 99.90th=[ 1234], 99.95th=[ 1234], | 99.99th=[ 1234] bw ( KiB/s): min= 6253, max= 8175, per=44.98%, avg=7214.00, stdev=1359.06, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 250=33.33%, 500=33.33%, 2000=33.33% cpu : usr=0.00%, sys=14.73%, ctx=131, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=7617KiB/s (7800kB/s), 2067KiB/s-5713KiB/s (2116kB/s-5850kB/s), io=16.0MiB (16.8MB), run=1982-2151msec WRITE: bw=15.7MiB/s (16.4MB/s), 4133KiB/s-6327KiB/s (4232kB/s-6479kB/s), io=32.0MiB (33.6MB), run=1942-2043msec