== sanity test 398b: DIO and buffer IO race ============== 13:34:41 (1783445681) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 4.65578 s, 10.8 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=145694: Tue Jul 7 13:37:25 2026 read: IOPS=10, BW=41.3KiB/s (42.3kB/s)(5992KiB/145133msec) clat (usec): min=34, max=260349, avg=48002.43, stdev=35429.98 lat (usec): min=34, max=260351, avg=48007.82, stdev=35427.99 clat percentiles (usec): | 1.00th=[ 54], 5.00th=[ 65], 10.00th=[ 103], 20.00th=[ 22676], | 30.00th=[ 28443], 40.00th=[ 34866], 50.00th=[ 41681], 60.00th=[ 50070], | 70.00th=[ 58983], 80.00th=[ 71828], 90.00th=[ 92799], 95.00th=[108528], | 99.00th=[173016], 99.50th=[202376], 99.90th=[254804], 99.95th=[261096], | 99.99th=[261096] bw ( KiB/s): min= 7, max= 95, per=25.42%, avg=41.18, stdev=17.09, samples=283 iops : min= 1, max= 23, avg= 9.64, stdev= 4.31, samples=283 write: IOPS=10, BW=43.4KiB/s (44.4kB/s)(6296KiB/145133msec); 0 zone resets clat (usec): min=1097, max=971420, avg=46207.73, stdev=52302.86 lat (usec): min=1098, max=971422, avg=46211.64, stdev=52302.08 clat percentiles (usec): | 1.00th=[ 1319], 5.00th=[ 1582], 10.00th=[ 2474], 20.00th=[ 5538], | 30.00th=[ 10552], 40.00th=[ 20317], 50.00th=[ 32113], 60.00th=[ 45351], | 70.00th=[ 61604], 80.00th=[ 80217], 90.00th=[109577], 95.00th=[133694], | 99.00th=[193987], 99.50th=[240124], 99.90th=[505414], 99.95th=[968885], | 99.99th=[968885] bw ( KiB/s): min= 7, max= 116, per=25.25%, avg=42.93, stdev=18.47, samples=285 iops : min= 1, max= 29, avg=10.08, stdev= 4.68, samples=285 lat (usec) : 50=0.33%, 100=4.49%, 250=0.52%, 500=0.03%, 750=0.16% lat (usec) : 1000=0.03% lat (msec) : 2=4.20%, 4=3.74%, 10=7.10%, 20=7.85%, 50=33.40% lat (msec) : 100=28.09%, 250=9.80%, 500=0.20%, 750=0.03%, 1000=0.03% cpu : usr=0.10%, sys=5.37%, ctx=6773, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145695: Tue Jul 7 13:37:25 2026 read: IOPS=10, BW=40.7KiB/s (41.7kB/s)(5940KiB/145784msec) clat (usec): min=33, max=978415, avg=48334.36, stdev=42727.57 lat (usec): min=33, max=978416, avg=48337.80, stdev=42727.85 clat percentiles (usec): | 1.00th=[ 50], 5.00th=[ 65], 10.00th=[ 367], 20.00th=[ 23462], | 30.00th=[ 29492], 40.00th=[ 35390], 50.00th=[ 41157], 60.00th=[ 47973], | 70.00th=[ 57410], 80.00th=[ 70779], 90.00th=[ 89654], 95.00th=[106431], | 99.00th=[175113], 99.50th=[204473], 99.90th=[325059], 99.95th=[977273], | 99.99th=[977273] bw ( KiB/s): min= 7, max= 118, per=25.06%, avg=40.59, stdev=17.96, samples=284 iops : min= 1, max= 29, avg= 9.49, stdev= 4.53, samples=284 write: IOPS=10, BW=43.5KiB/s (44.6kB/s)(6348KiB/145784msec); 0 zone resets clat (usec): min=1163, max=378152, avg=46331.86, stdev=45678.40 lat (usec): min=1164, max=378154, avg=46335.48, stdev=45677.79 clat percentiles (usec): | 1.00th=[ 1336], 5.00th=[ 1565], 10.00th=[ 2638], 20.00th=[ 6194], | 30.00th=[ 11076], 40.00th=[ 21365], 50.00th=[ 33817], 60.00th=[ 46924], | 70.00th=[ 63701], 80.00th=[ 81265], 90.00th=[109577], 95.00th=[133694], | 99.00th=[185598], 99.50th=[227541], 99.90th=[316670], 99.95th=[379585], | 99.99th=[379585] bw ( KiB/s): min= 7, max= 112, per=25.41%, avg=43.20, stdev=18.62, samples=285 iops : min= 1, max= 28, avg=10.15, stdev= 4.70, samples=285 lat (usec) : 50=0.55%, 100=3.78%, 250=0.46%, 500=0.07%, 750=0.10% lat (usec) : 1000=0.03% lat (msec) : 2=4.23%, 4=3.52%, 10=7.71%, 20=7.42%, 50=34.51% lat (msec) : 100=27.60%, 250=9.80%, 500=0.20%, 1000=0.03% cpu : usr=0.08%, sys=5.31%, ctx=6731, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145696: Tue Jul 7 13:37:25 2026 read: IOPS=10, BW=41.2KiB/s (42.2kB/s)(6028KiB/146319msec) clat (usec): min=29, max=306401, avg=48459.15, stdev=35729.89 lat (usec): min=30, max=306402, avg=48462.14, stdev=35729.33 clat percentiles (usec): | 1.00th=[ 51], 5.00th=[ 65], 10.00th=[ 94], 20.00th=[ 22938], | 30.00th=[ 29492], 40.00th=[ 35914], 50.00th=[ 42206], 60.00th=[ 49546], | 70.00th=[ 59507], 80.00th=[ 73925], 90.00th=[ 91751], 95.00th=[108528], | 99.00th=[162530], 99.50th=[193987], 99.90th=[304088], 99.95th=[308282], | 99.99th=[308282] bw ( KiB/s): min= 7, max= 101, per=25.26%, avg=40.92, stdev=16.58, samples=286 iops : min= 1, max= 25, avg= 9.57, stdev= 4.16, samples=286 write: IOPS=10, BW=42.8KiB/s (43.8kB/s)(6260KiB/146319msec); 0 zone resets clat (usec): min=1121, max=922160, avg=46475.75, stdev=50151.83 lat (usec): min=1121, max=922161, avg=46484.35, stdev=50158.42 clat percentiles (usec): | 1.00th=[ 1303], 5.00th=[ 1582], 10.00th=[ 2769], 20.00th=[ 6063], | 30.00th=[ 11076], 40.00th=[ 20841], 50.00th=[ 35390], 60.00th=[ 47973], | 70.00th=[ 61080], 80.00th=[ 79168], 90.00th=[106431], 95.00th=[137364], | 99.00th=[187696], 99.50th=[225444], 99.90th=[367002], 99.95th=[918553], | 99.99th=[918553] bw ( KiB/s): min= 7, max= 95, per=24.98%, avg=42.46, stdev=17.44, samples=286 iops : min= 1, max= 23, avg= 9.96, stdev= 4.40, samples=286 lat (usec) : 50=0.46%, 100=4.46%, 250=0.39%, 500=0.03%, 750=0.10% lat (usec) : 1000=0.03% lat (msec) : 2=4.00%, 4=3.32%, 10=7.32%, 20=8.20%, 50=32.94% lat (msec) : 100=28.87%, 250=9.64%, 500=0.20%, 1000=0.03% cpu : usr=0.07%, sys=5.37%, ctx=6718, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145697: Tue Jul 7 13:37:25 2026 read: IOPS=10, BW=41.0KiB/s (42.0kB/s)(6052KiB/147520msec) clat (usec): min=34, max=955593, avg=47633.87, stdev=41872.57 lat (usec): min=35, max=955595, avg=47642.69, stdev=41873.22 clat percentiles (usec): | 1.00th=[ 52], 5.00th=[ 65], 10.00th=[ 123], 20.00th=[ 21627], | 30.00th=[ 28181], 40.00th=[ 33817], 50.00th=[ 40633], 60.00th=[ 49546], | 70.00th=[ 57934], 80.00th=[ 71828], 90.00th=[ 91751], 95.00th=[112722], | 99.00th=[160433], 99.50th=[181404], 99.90th=[371196], 99.95th=[952108], | 99.99th=[952108] bw ( KiB/s): min= 7, max= 103, per=25.52%, avg=41.33, stdev=17.02, samples=284 iops : min= 1, max= 25, avg= 9.67, stdev= 4.31, samples=284 write: IOPS=10, BW=42.3KiB/s (43.3kB/s)(6236KiB/147520msec); 0 zone resets clat (usec): min=1083, max=386953, avg=48012.42, stdev=48193.81 lat (usec): min=1084, max=386953, avg=48023.37, stdev=48193.29 clat percentiles (usec): | 1.00th=[ 1270], 5.00th=[ 1598], 10.00th=[ 2507], 20.00th=[ 6390], | 30.00th=[ 12125], 40.00th=[ 24249], 50.00th=[ 34866], 60.00th=[ 47973], | 70.00th=[ 63177], 80.00th=[ 82314], 90.00th=[111674], 95.00th=[141558], | 99.00th=[200279], 99.50th=[258999], 99.90th=[316670], 99.95th=[387974], | 99.99th=[387974] bw ( KiB/s): min= 7, max= 103, per=24.70%, avg=41.98, stdev=18.11, samples=287 iops : min= 1, max= 25, avg= 9.84, stdev= 4.57, samples=287 lat (usec) : 50=0.49%, 100=4.10%, 250=0.78%, 500=0.16%, 750=0.03% lat (usec) : 1000=0.10% lat (msec) : 2=4.20%, 4=3.22%, 10=6.80%, 20=7.65%, 50=33.24% lat (msec) : 100=28.84%, 250=10.03%, 500=0.33%, 1000=0.03% cpu : usr=0.09%, sys=5.20%, ctx=6785, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=163KiB/s (167kB/s), 40.7KiB/s-41.3KiB/s (41.7kB/s-42.3kB/s), io=23.4MiB (24.6MB), run=145133-147520msec WRITE: bw=170KiB/s (175kB/s), 42.3KiB/s-43.5KiB/s (43.3kB/s-44.6kB/s), io=24.6MiB (25.7MB), run=145133-147520msec fio: pid=145702, err=5/file:backend.c:481, func=full resid, error=Input/output error rand-rw: (groupid=0, jobs=1): err= 0: pid=145699: Tue Jul 7 13:39:55 2026 read: IOPS=5, BW=20.4KiB/s (20.9kB/s)(5992KiB/293998msec) clat (msec): min=6, max=1062, avg=40.80, stdev=47.30 lat (msec): min=6, max=1062, avg=40.81, stdev=47.30 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 16], | 30.00th=[ 20], 40.00th=[ 24], 50.00th=[ 28], 60.00th=[ 33], | 70.00th=[ 42], 80.00th=[ 55], 90.00th=[ 85], 95.00th=[ 115], | 99.00th=[ 188], 99.50th=[ 275], 99.90th=[ 422], 99.95th=[ 1062], | 99.99th=[ 1062] bw ( KiB/s): min= 7, max= 88, per=31.02%, avg=23.57, stdev=16.12, samples=490 iops : min= 1, max= 22, avg= 5.27, stdev= 4.08, samples=490 write: IOPS=5, BW=21.4KiB/s (21.9kB/s)(6296KiB/293998msec); 0 zone resets clat (msec): min=42, max=750, avg=147.82, stdev=72.39 lat (msec): min=42, max=750, avg=147.83, stdev=72.39 clat percentiles (msec): | 1.00th=[ 51], 5.00th=[ 65], 10.00th=[ 74], 20.00th=[ 89], | 30.00th=[ 104], 40.00th=[ 116], 50.00th=[ 132], 60.00th=[ 148], | 70.00th=[ 169], 80.00th=[ 201], 90.00th=[ 247], 95.00th=[ 279], | 99.00th=[ 368], 99.50th=[ 435], 99.90th=[ 567], 99.95th=[ 751], | 99.99th=[ 751] bw ( KiB/s): min= 7, max= 55, per=26.92%, avg=21.27, stdev=10.06, samples=568 iops : min= 1, max= 13, avg= 4.69, stdev= 2.55, samples=568 lat (msec) : 10=1.66%, 20=13.70%, 50=22.49%, 100=21.94%, 250=35.19% lat (msec) : 500=4.85%, 750=0.10%, 1000=0.03%, 2000=0.03% cpu : usr=0.04%, sys=1.37%, ctx=5574, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145700: Tue Jul 7 13:39:55 2026 read: IOPS=5, BW=20.1KiB/s (20.6kB/s)(5940KiB/295019msec) clat (msec): min=5, max=1023, avg=40.43, stdev=47.12 lat (msec): min=5, max=1024, avg=40.44, stdev=47.12 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 16], | 30.00th=[ 20], 40.00th=[ 23], 50.00th=[ 28], 60.00th=[ 33], | 70.00th=[ 40], 80.00th=[ 54], 90.00th=[ 86], 95.00th=[ 115], | 99.00th=[ 203], 99.50th=[ 251], 99.90th=[ 447], 99.95th=[ 1028], | 99.99th=[ 1028] bw ( KiB/s): min= 7, max= 88, per=30.28%, avg=23.01, stdev=15.49, samples=497 iops : min= 1, max= 22, avg= 5.14, stdev= 3.93, samples=497 write: IOPS=5, BW=21.5KiB/s (22.0kB/s)(6348KiB/295019msec); 0 zone resets clat (msec): min=39, max=567, avg=147.94, stdev=70.66 lat (msec): min=39, max=567, avg=147.94, stdev=70.66 clat percentiles (msec): | 1.00th=[ 53], 5.00th=[ 68], 10.00th=[ 78], 20.00th=[ 91], | 30.00th=[ 102], 40.00th=[ 115], 50.00th=[ 130], 60.00th=[ 148], | 70.00th=[ 171], 80.00th=[ 199], 90.00th=[ 245], 95.00th=[ 292], | 99.00th=[ 376], 99.50th=[ 426], 99.90th=[ 464], 99.95th=[ 567], | 99.99th=[ 567] bw ( KiB/s): min= 7, max= 55, per=26.83%, avg=21.20, stdev=10.08, samples=574 iops : min= 1, max= 13, avg= 4.67, stdev= 2.57, samples=574 lat (msec) : 10=2.12%, 20=13.87%, 50=22.14%, 100=21.88%, 250=34.83% lat (msec) : 500=5.11%, 750=0.03%, 2000=0.03% cpu : usr=0.05%, sys=1.39%, ctx=5713, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145701: Tue Jul 7 13:39:55 2026 read: IOPS=5, BW=20.3KiB/s (20.8kB/s)(6028KiB/296342msec) clat (msec): min=6, max=441, avg=42.82, stdev=42.82 lat (msec): min=6, max=441, avg=42.82, stdev=42.82 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 17], | 30.00th=[ 20], 40.00th=[ 24], 50.00th=[ 29], 60.00th=[ 35], | 70.00th=[ 44], 80.00th=[ 62], 90.00th=[ 93], 95.00th=[ 118], | 99.00th=[ 215], 99.50th=[ 288], 99.90th=[ 422], 99.95th=[ 443], | 99.99th=[ 443] bw ( KiB/s): min= 7, max= 103, per=30.06%, avg=22.84, stdev=15.51, samples=508 iops : min= 1, max= 25, avg= 5.09, stdev= 3.92, samples=508 write: IOPS=5, BW=21.1KiB/s (21.6kB/s)(6260KiB/296342msec); 0 zone resets clat (msec): min=43, max=1202, avg=148.00, stdev=76.15 lat (msec): min=43, max=1202, avg=148.00, stdev=76.15 clat percentiles (msec): | 1.00th=[ 54], 5.00th=[ 66], 10.00th=[ 75], 20.00th=[ 90], | 30.00th=[ 103], 40.00th=[ 115], 50.00th=[ 132], 60.00th=[ 146], | 70.00th=[ 169], 80.00th=[ 199], 90.00th=[ 241], 95.00th=[ 279], | 99.00th=[ 397], 99.50th=[ 447], 99.90th=[ 642], 99.95th=[ 1200], | 99.99th=[ 1200] bw ( KiB/s): min= 7, max= 62, per=27.04%, avg=21.36, stdev= 9.77, samples=563 iops : min= 1, max= 15, avg= 4.72, stdev= 2.50, samples=563 lat (msec) : 10=1.56%, 20=13.35%, 50=22.07%, 100=22.10%, 250=36.13% lat (msec) : 500=4.65%, 750=0.10%, 2000=0.03% cpu : usr=0.04%, sys=1.37%, ctx=5608, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 5 (file:backend.c:481, func=full resid, error=Input/output error): pid=145702: Tue Jul 7 13:39:55 2026 read: IOPS=4, BW=18.6KiB/s (19.0kB/s)(4676KiB/251720msec) clat (msec): min=7, max=438, avg=45.70, stdev=45.05 lat (msec): min=7, max=438, avg=45.71, stdev=45.05 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 17], | 30.00th=[ 21], 40.00th=[ 25], 50.00th=[ 30], 60.00th=[ 37], | 70.00th=[ 46], 80.00th=[ 69], 90.00th=[ 102], 95.00th=[ 129], | 99.00th=[ 213], 99.50th=[ 292], 99.90th=[ 430], 99.95th=[ 439], | 99.99th=[ 439] bw ( KiB/s): min= 7, max= 111, per=28.90%, avg=21.96, stdev=15.34, samples=409 iops : min= 1, max= 27, avg= 4.87, stdev= 3.88, samples=409 write: IOPS=4, BW=19.0KiB/s (19.5kB/s)(4792KiB/251720msec); 0 zone resets clat (msec): min=41, max=1273, avg=165.36, stdev=81.49 lat (msec): min=41, max=1273, avg=165.37, stdev=81.49 clat percentiles (msec): | 1.00th=[ 56], 5.00th=[ 73], 10.00th=[ 83], 20.00th=[ 102], | 30.00th=[ 118], 40.00th=[ 136], 50.00th=[ 150], 60.00th=[ 171], | 70.00th=[ 190], 80.00th=[ 215], 90.00th=[ 264], 95.00th=[ 305], | 99.00th=[ 409], 99.50th=[ 464], 99.90th=[ 592], 99.95th=[ 1267], | 99.99th=[ 1267] bw ( KiB/s): min= 7, max= 56, per=23.91%, avg=18.89, stdev= 9.11, samples=484 iops : min= 1, max= 14, avg= 4.09, stdev= 2.35, samples=484 lat (msec) : 10=1.14%, 20=13.18%, 50=21.88%, 100=17.91%, 250=39.19% lat (msec) : 500=6.50%, 750=0.13%, 2000=0.04% cpu : usr=0.04%, sys=1.28%, ctx=4143, majf=0, minf=21 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1170,1198,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=76.4KiB/s (78.2kB/s), 18.6KiB/s-20.4KiB/s (19.0kB/s-20.9kB/s), io=22.1MiB (23.2MB), run=251720-296342msec WRITE: bw=79.0KiB/s (81.9kB/s), 19.0KiB/s-21.5KiB/s (19.5kB/s-22.0kB/s), io=23.1MiB (24.3MB), run=251720-296342msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=145770: Tue Jul 7 13:40:32 2026 read: IOPS=13, BW=221KiB/s (226kB/s)(5920KiB/26778msec) clat (usec): min=33, max=208157, avg=37165.88, stdev=31316.38 lat (usec): min=33, max=208157, avg=37167.53, stdev=31316.61 clat percentiles (usec): | 1.00th=[ 44], 5.00th=[ 63], 10.00th=[ 72], 20.00th=[ 135], | 30.00th=[ 21365], 40.00th=[ 27132], 50.00th=[ 34341], 60.00th=[ 40633], | 70.00th=[ 47973], 80.00th=[ 57934], 90.00th=[ 74974], 95.00th=[ 88605], | 99.00th=[154141], 99.50th=[204473], 99.90th=[208667], 99.95th=[208667], | 99.99th=[208667] bw ( KiB/s): min= 64, max= 414, per=24.80%, avg=220.46, stdev=75.67, samples=52 iops : min= 4, max= 25, avg=13.10, stdev= 4.75, samples=52 write: IOPS=14, BW=238KiB/s (244kB/s)(6368KiB/26778msec); 0 zone resets clat (usec): min=1816, max=199428, avg=32281.60, stdev=31335.66 lat (usec): min=1818, max=199431, avg=32292.97, stdev=31330.80 clat percentiles (usec): | 1.00th=[ 1909], 5.00th=[ 2900], 10.00th=[ 3916], 20.00th=[ 6128], | 30.00th=[ 8455], 40.00th=[ 14222], 50.00th=[ 21627], 60.00th=[ 32637], | 70.00th=[ 41157], 80.00th=[ 55837], 90.00th=[ 74974], 95.00th=[ 94897], | 99.00th=[139461], 99.50th=[154141], 99.90th=[200279], 99.95th=[200279], | 99.99th=[200279] bw ( KiB/s): min= 94, max= 441, per=25.60%, avg=239.38, stdev=75.00, samples=52 iops : min= 5, max= 27, avg=14.29, stdev= 4.72, samples=52 lat (usec) : 50=0.65%, 100=7.16%, 250=2.08%, 750=0.26%, 1000=0.13% lat (msec) : 2=0.78%, 4=5.34%, 10=11.72%, 20=10.16%, 50=36.33% lat (msec) : 100=22.27%, 250=3.12% cpu : usr=0.10%, sys=7.85%, ctx=1636, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145771: Tue Jul 7 13:40:32 2026 read: IOPS=13, BW=213KiB/s (218kB/s)(5744KiB/26940msec) clat (usec): min=38, max=266081, avg=36657.49, stdev=29751.79 lat (usec): min=39, max=266082, avg=36665.91, stdev=29754.67 clat percentiles (usec): | 1.00th=[ 44], 5.00th=[ 67], 10.00th=[ 77], 20.00th=[ 1139], | 30.00th=[ 22152], 40.00th=[ 29754], 50.00th=[ 34341], 60.00th=[ 42206], | 70.00th=[ 49021], 80.00th=[ 57410], 90.00th=[ 68682], 95.00th=[ 79168], | 99.00th=[115868], 99.50th=[210764], 99.90th=[265290], 99.95th=[265290], | 99.99th=[265290] bw ( KiB/s): min= 32, max= 416, per=23.94%, avg=212.79, stdev=85.46, samples=52 iops : min= 2, max= 26, avg=12.60, stdev= 5.42, samples=52 write: IOPS=15, BW=243KiB/s (249kB/s)(6544KiB/26940msec); 0 zone resets clat (usec): min=1822, max=348445, avg=33171.26, stdev=38555.79 lat (usec): min=1824, max=348448, avg=33174.29, stdev=38555.69 clat percentiles (usec): | 1.00th=[ 1926], 5.00th=[ 3064], 10.00th=[ 3916], 20.00th=[ 5604], | 30.00th=[ 7767], 40.00th=[ 12387], 50.00th=[ 19530], 60.00th=[ 31589], | 70.00th=[ 39584], 80.00th=[ 58983], 90.00th=[ 77071], 95.00th=[ 92799], | 99.00th=[158335], 99.50th=[240124], 99.90th=[350225], 99.95th=[350225], | 99.99th=[350225] bw ( KiB/s): min= 62, max= 539, per=25.64%, avg=239.69, stdev=99.22, samples=52 iops : min= 3, max= 33, avg=14.29, stdev= 6.27, samples=52 lat (usec) : 50=0.78%, 100=5.99%, 250=1.69%, 500=0.39%, 750=0.26% lat (usec) : 1000=0.13% lat (msec) : 2=1.04%, 4=5.47%, 10=12.89%, 20=10.68%, 50=34.24% lat (msec) : 100=23.44%, 250=2.60%, 500=0.39% cpu : usr=0.09%, sys=8.00%, ctx=1708, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145772: Tue Jul 7 13:40:32 2026 read: IOPS=14, BW=236KiB/s (241kB/s)(6256KiB/26549msec) clat (usec): min=42, max=159232, avg=36725.79, stdev=28670.62 lat (usec): min=43, max=159233, avg=36727.71, stdev=28671.52 clat percentiles (usec): | 1.00th=[ 51], 5.00th=[ 67], 10.00th=[ 81], 20.00th=[ 1004], | 30.00th=[ 22414], 40.00th=[ 27919], 50.00th=[ 33424], 60.00th=[ 40633], | 70.00th=[ 47973], 80.00th=[ 56361], 90.00th=[ 72877], 95.00th=[ 87557], | 99.00th=[137364], 99.50th=[143655], 99.90th=[158335], 99.95th=[158335], | 99.99th=[158335] bw ( KiB/s): min= 95, max= 383, per=26.62%, avg=236.65, stdev=77.53, samples=52 iops : min= 5, max= 23, avg=14.12, stdev= 4.87, samples=52 write: IOPS=14, BW=227KiB/s (233kB/s)(6032KiB/26549msec); 0 zone resets clat (usec): min=1685, max=245694, avg=31705.56, stdev=31659.84 lat (usec): min=1686, max=245697, avg=31708.44, stdev=31659.66 clat percentiles (usec): | 1.00th=[ 1811], 5.00th=[ 2474], 10.00th=[ 3687], 20.00th=[ 6063], | 30.00th=[ 8979], 40.00th=[ 15008], 50.00th=[ 22938], 60.00th=[ 29754], | 70.00th=[ 40109], 80.00th=[ 53740], 90.00th=[ 72877], 95.00th=[ 93848], | 99.00th=[141558], 99.50th=[168821], 99.90th=[246416], 99.95th=[246416], | 99.99th=[246416] bw ( KiB/s): min= 63, max= 415, per=24.29%, avg=227.15, stdev=80.66, samples=52 iops : min= 3, max= 25, avg=13.50, stdev= 5.15, samples=52 lat (usec) : 50=0.39%, 100=6.77%, 250=2.08%, 500=0.78%, 750=0.13% lat (msec) : 2=1.30%, 4=4.82%, 10=10.16%, 20=8.98%, 50=39.58% lat (msec) : 100=21.48%, 250=3.52% cpu : usr=0.09%, sys=7.89%, ctx=1711, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145773: Tue Jul 7 13:40:32 2026 read: IOPS=14, BW=236KiB/s (241kB/s)(6032KiB/25595msec) clat (usec): min=40, max=397038, avg=37513.77, stdev=33714.54 lat (usec): min=40, max=397040, avg=37517.32, stdev=33712.13 clat percentiles (usec): | 1.00th=[ 46], 5.00th=[ 65], 10.00th=[ 78], 20.00th=[ 13960], | 30.00th=[ 23725], 40.00th=[ 28705], 50.00th=[ 32113], 60.00th=[ 39584], | 70.00th=[ 48497], 80.00th=[ 55313], 90.00th=[ 71828], 95.00th=[ 88605], | 99.00th=[139461], 99.50th=[164627], 99.90th=[396362], 99.95th=[396362], | 99.99th=[396362] bw ( KiB/s): min= 95, max= 474, per=26.49%, avg=235.50, stdev=84.30, samples=50 iops : min= 5, max= 29, avg=14.06, stdev= 5.30, samples=50 write: IOPS=15, BW=244KiB/s (250kB/s)(6256KiB/25595msec); 0 zone resets clat (usec): min=1654, max=252030, avg=29132.66, stdev=32139.79 lat (usec): min=1656, max=252032, avg=29136.03, stdev=32139.65 clat percentiles (usec): | 1.00th=[ 1827], 5.00th=[ 2704], 10.00th=[ 3818], 20.00th=[ 5735], | 30.00th=[ 8356], 40.00th=[ 10814], 50.00th=[ 16581], 60.00th=[ 24511], | 70.00th=[ 34341], 80.00th=[ 50070], 90.00th=[ 70779], 95.00th=[ 87557], | 99.00th=[158335], 99.50th=[179307], 99.90th=[252707], 99.95th=[252707], | 99.99th=[252707] bw ( KiB/s): min= 31, max= 416, per=26.33%, avg=246.20, stdev=83.99, samples=50 iops : min= 1, max= 26, avg=14.72, stdev= 5.32, samples=50 lat (usec) : 50=0.65%, 100=6.12%, 250=1.30%, 500=0.78%, 1000=0.13% lat (msec) : 2=1.82%, 4=4.56%, 10=13.54%, 20=10.03%, 50=37.37% lat (msec) : 100=20.18%, 250=3.26%, 500=0.26% cpu : usr=0.11%, sys=8.06%, ctx=1601, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=889KiB/s (910kB/s), 213KiB/s-236KiB/s (218kB/s-241kB/s), io=23.4MiB (24.5MB), run=25595-26940msec WRITE: bw=935KiB/s (958kB/s), 227KiB/s-244KiB/s (233kB/s-250kB/s), io=24.6MiB (25.8MB), run=25595-26940msec rand-rw: (groupid=0, jobs=1): err= 0: pid=145775: Tue Jul 7 13:41:06 2026 read: IOPS=6, BW=101KiB/s (103kB/s)(5920KiB/58729msec) clat (msec): min=6, max=295, avg=34.40, stdev=36.18 lat (msec): min=6, max=295, avg=34.40, stdev=36.18 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 12], 20.00th=[ 16], | 30.00th=[ 18], 40.00th=[ 20], 50.00th=[ 22], 60.00th=[ 26], | 70.00th=[ 31], 80.00th=[ 46], 90.00th=[ 69], 95.00th=[ 100], | 99.00th=[ 215], 99.50th=[ 271], 99.90th=[ 296], 99.95th=[ 296], | 99.99th=[ 296] bw ( KiB/s): min= 30, max= 320, per=27.28%, avg=107.77, stdev=63.51, samples=108 iops : min= 1, max= 20, avg= 6.00, stdev= 4.06, samples=108 write: IOPS=6, BW=108KiB/s (111kB/s)(6368KiB/58729msec); 0 zone resets clat (msec): min=38, max=380, avg=115.36, stdev=51.04 lat (msec): min=38, max=380, avg=115.37, stdev=51.04 clat percentiles (msec): | 1.00th=[ 47], 5.00th=[ 53], 10.00th=[ 64], 20.00th=[ 75], | 30.00th=[ 85], 40.00th=[ 96], 50.00th=[ 107], 60.00th=[ 116], | 70.00th=[ 127], 80.00th=[ 146], 90.00th=[ 182], 95.00th=[ 218], | 99.00th=[ 305], 99.50th=[ 380], 99.90th=[ 380], 99.95th=[ 380], | 99.99th=[ 380] bw ( KiB/s): min= 26, max= 224, per=25.99%, avg=108.11, stdev=47.89, samples=116 iops : min= 1, max= 14, avg= 6.01, stdev= 3.10, samples=116 lat (msec) : 10=1.95%, 20=17.84%, 50=21.74%, 100=27.47%, 250=29.43% lat (msec) : 500=1.56% cpu : usr=0.05%, sys=1.83%, ctx=1318, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145776: Tue Jul 7 13:41:06 2026 read: IOPS=5, BW=94.9KiB/s (97.2kB/s)(5744KiB/60501msec) clat (msec): min=7, max=231, avg=34.25, stdev=35.76 lat (msec): min=7, max=231, avg=34.25, stdev=35.76 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 12], 20.00th=[ 15], | 30.00th=[ 17], 40.00th=[ 19], 50.00th=[ 21], 60.00th=[ 25], | 70.00th=[ 31], 80.00th=[ 42], 90.00th=[ 75], 95.00th=[ 106], | 99.00th=[ 186], 99.50th=[ 222], 99.90th=[ 232], 99.95th=[ 232], | 99.99th=[ 232] bw ( KiB/s): min= 27, max= 384, per=26.77%, avg=105.74, stdev=71.21, samples=106 iops : min= 1, max= 24, avg= 5.88, stdev= 4.53, samples=106 write: IOPS=6, BW=108KiB/s (111kB/s)(6544KiB/60501msec); 0 zone resets clat (msec): min=39, max=382, avg=117.69, stdev=54.23 lat (msec): min=39, max=382, avg=117.69, stdev=54.23 clat percentiles (msec): | 1.00th=[ 47], 5.00th=[ 56], 10.00th=[ 63], 20.00th=[ 74], | 30.00th=[ 84], 40.00th=[ 93], 50.00th=[ 105], 60.00th=[ 115], | 70.00th=[ 133], 80.00th=[ 161], 90.00th=[ 194], 95.00th=[ 230], | 99.00th=[ 268], 99.50th=[ 317], 99.90th=[ 384], 99.95th=[ 384], | 99.99th=[ 384] bw ( KiB/s): min= 31, max= 223, per=25.77%, avg=107.22, stdev=49.23, samples=119 iops : min= 1, max= 13, avg= 5.95, stdev= 3.16, samples=119 lat (msec) : 10=2.08%, 20=19.79%, 50=17.97%, 100=28.52%, 250=30.08% lat (msec) : 500=1.56% cpu : usr=0.05%, sys=1.85%, ctx=1402, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145777: Tue Jul 7 13:41:06 2026 read: IOPS=6, BW=108KiB/s (110kB/s)(6256KiB/58079msec) clat (msec): min=7, max=285, avg=32.40, stdev=33.31 lat (msec): min=7, max=285, avg=32.41, stdev=33.31 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 12], 20.00th=[ 15], | 30.00th=[ 16], 40.00th=[ 19], 50.00th=[ 22], 60.00th=[ 24], | 70.00th=[ 31], 80.00th=[ 41], 90.00th=[ 67], 95.00th=[ 104], | 99.00th=[ 167], 99.50th=[ 266], 99.90th=[ 288], 99.95th=[ 288], | 99.99th=[ 288] bw ( KiB/s): min= 30, max= 416, per=29.90%, avg=118.11, stdev=84.79, samples=105 iops : min= 1, max= 26, avg= 6.65, stdev= 5.42, samples=105 write: IOPS=6, BW=104KiB/s (106kB/s)(6032KiB/58079msec); 0 zone resets clat (msec): min=41, max=378, avg=120.27, stdev=56.40 lat (msec): min=41, max=378, avg=120.28, stdev=56.40 clat percentiles (msec): | 1.00th=[ 48], 5.00th=[ 58], 10.00th=[ 67], 20.00th=[ 75], | 30.00th=[ 84], 40.00th=[ 93], 50.00th=[ 103], 60.00th=[ 116], | 70.00th=[ 138], 80.00th=[ 165], 90.00th=[ 203], 95.00th=[ 234], | 99.00th=[ 296], 99.50th=[ 330], 99.90th=[ 380], 99.95th=[ 380], | 99.99th=[ 380] bw ( KiB/s): min= 31, max= 192, per=25.31%, avg=105.30, stdev=45.63, samples=113 iops : min= 1, max= 12, avg= 5.84, stdev= 2.97, samples=113 lat (msec) : 10=2.34%, 20=20.83%, 50=21.09%, 100=27.34%, 250=26.43% lat (msec) : 500=1.95% cpu : usr=0.04%, sys=1.88%, ctx=1470, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145779: Tue Jul 7 13:41:06 2026 read: IOPS=6, BW=101KiB/s (103kB/s)(6032KiB/59805msec) clat (msec): min=6, max=270, avg=33.11, stdev=34.19 lat (msec): min=6, max=270, avg=33.12, stdev=34.19 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 15], | 30.00th=[ 17], 40.00th=[ 19], 50.00th=[ 22], 60.00th=[ 27], | 70.00th=[ 32], 80.00th=[ 41], 90.00th=[ 66], 95.00th=[ 104], | 99.00th=[ 199], 99.50th=[ 243], 99.90th=[ 271], 99.95th=[ 271], | 99.99th=[ 271] bw ( KiB/s): min= 31, max= 316, per=27.29%, avg=107.79, stdev=69.71, samples=109 iops : min= 1, max= 19, avg= 5.99, stdev= 4.40, samples=109 write: IOPS=6, BW=105KiB/s (107kB/s)(6256KiB/59805msec); 0 zone resets clat (msec): min=42, max=422, avg=120.82, stdev=54.51 lat (msec): min=42, max=422, avg=120.83, stdev=54.51 clat percentiles (msec): | 1.00th=[ 48], 5.00th=[ 62], 10.00th=[ 67], 20.00th=[ 80], | 30.00th=[ 87], 40.00th=[ 95], 50.00th=[ 109], 60.00th=[ 121], | 70.00th=[ 138], 80.00th=[ 155], 90.00th=[ 188], 95.00th=[ 226], | 99.00th=[ 305], 99.50th=[ 347], 99.90th=[ 422], 99.95th=[ 422], | 99.99th=[ 422] bw ( KiB/s): min= 31, max= 222, per=25.51%, avg=106.11, stdev=44.59, samples=116 iops : min= 1, max= 13, avg= 5.89, stdev= 2.92, samples=116 lat (msec) : 10=2.08%, 20=19.14%, 50=21.48%, 100=26.56%, 250=28.65% lat (msec) : 500=2.08% cpu : usr=0.05%, sys=1.89%, ctx=1385, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=396KiB/s (405kB/s), 94.9KiB/s-108KiB/s (97.2kB/s-110kB/s), io=23.4MiB (24.5MB), run=58079-60501msec WRITE: bw=417KiB/s (427kB/s), 104KiB/s-108KiB/s (106kB/s-111kB/s), io=24.6MiB (25.8MB), run=58079-60501msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=145796: Tue Jul 7 13:41:20 2026 read: IOPS=1, BW=2001KiB/s (2049kB/s)(7168KiB/3582msec) clat (usec): min=721, max=650065, avg=195422.58, stdev=233482.69 lat (usec): min=722, max=650067, avg=195424.36, stdev=233482.76 clat percentiles (usec): | 1.00th=[ 725], 5.00th=[ 725], 10.00th=[ 725], 20.00th=[ 775], | 30.00th=[ 2073], 40.00th=[ 2073], 50.00th=[206570], 60.00th=[246416], | 70.00th=[246416], 80.00th=[263193], 90.00th=[650118], 95.00th=[650118], | 99.00th=[650118], 99.50th=[650118], 99.90th=[650118], 99.95th=[650118], | 99.99th=[650118] bw ( KiB/s): min= 1885, max= 4087, per=68.02%, avg=2709.75, stdev=1012.14, samples=4 iops : min= 1, max= 3, avg= 1.75, stdev= 0.96, samples=4 write: IOPS=1, BW=1429KiB/s (1464kB/s)(5120KiB/3582msec); 0 zone resets clat (msec): min=201, max=642, avg=393.18, stdev=163.75 lat (msec): min=201, max=644, avg=393.61, stdev=164.39 clat percentiles (msec): | 1.00th=[ 203], 5.00th=[ 203], 10.00th=[ 203], 20.00th=[ 203], | 30.00th=[ 321], 40.00th=[ 321], 50.00th=[ 359], 60.00th=[ 359], | 70.00th=[ 439], 80.00th=[ 439], 90.00th=[ 642], 95.00th=[ 642], | 99.00th=[ 642], 99.50th=[ 642], 99.90th=[ 642], 99.95th=[ 642], | 99.99th=[ 642] bw ( KiB/s): min= 1885, max= 2043, per=35.81%, avg=1997.50, stdev=75.85, samples=4 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=4 lat (usec) : 750=8.33%, 1000=8.33% lat (msec) : 4=8.33%, 250=25.00%, 500=33.33%, 750=16.67% cpu : usr=0.00%, sys=15.92%, ctx=199, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145797: Tue Jul 7 13:41:20 2026 read: IOPS=0, BW=398KiB/s (408kB/s)(2048KiB/5140msec) clat (usec): min=621, max=435425, avg=218023.57, stdev=307453.30 lat (usec): min=623, max=435428, avg=218025.71, stdev=307453.76 clat percentiles (usec): | 1.00th=[ 619], 5.00th=[ 619], 10.00th=[ 619], 20.00th=[ 619], | 30.00th=[ 619], 40.00th=[ 619], 50.00th=[ 619], 60.00th=[434111], | 70.00th=[434111], 80.00th=[434111], 90.00th=[434111], 95.00th=[434111], | 99.00th=[434111], 99.50th=[434111], 99.90th=[434111], 99.95th=[434111], | 99.99th=[434111] bw ( KiB/s): min= 1380, max= 1973, per=42.08%, avg=1676.50, stdev=419.31, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1992KiB/s (2040kB/s)(10.0MiB/5140msec); 0 zone resets clat (msec): min=180, max=831, avg=439.75, stdev=208.46 lat (msec): min=181, max=831, avg=439.91, stdev=208.37 clat percentiles (msec): | 1.00th=[ 182], 5.00th=[ 182], 10.00th=[ 182], 20.00th=[ 213], | 30.00th=[ 226], 40.00th=[ 351], 50.00th=[ 426], 60.00th=[ 456], | 70.00th=[ 485], 80.00th=[ 592], 90.00th=[ 642], 95.00th=[ 835], | 99.00th=[ 835], 99.50th=[ 835], 99.90th=[ 835], 99.95th=[ 835], | 99.99th=[ 835] bw ( KiB/s): min= 1973, max= 4047, per=47.48%, avg=2648.67, stdev=980.46, samples=6 iops : min= 1, max= 3, avg= 1.67, stdev= 1.03, samples=6 lat (usec) : 750=8.33% lat (msec) : 250=25.00%, 500=41.67%, 750=16.67%, 1000=8.33% cpu : usr=0.00%, sys=14.98%, ctx=198, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145798: Tue Jul 7 13:41:20 2026 read: IOPS=1, BW=1524KiB/s (1560kB/s)(6144KiB/4032msec) clat (usec): min=985, max=549772, avg=266557.48, stdev=227382.45 lat (usec): min=986, max=549775, avg=266560.79, stdev=227382.42 clat percentiles (usec): | 1.00th=[ 988], 5.00th=[ 988], 10.00th=[ 988], 20.00th=[ 1270], | 30.00th=[ 1270], 40.00th=[244319], 50.00th=[244319], 60.00th=[379585], | 70.00th=[421528], 80.00th=[421528], 90.00th=[549454], 95.00th=[549454], | 99.00th=[549454], 99.50th=[549454], 99.90th=[549454], 99.95th=[549454], | 99.99th=[549454] bw ( KiB/s): min= 1973, max= 4087, per=82.25%, avg=3277.00, stdev=1140.30, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 write: IOPS=1, BW=1524KiB/s (1560kB/s)(6144KiB/4032msec); 0 zone resets clat (msec): min=152, max=680, avg=401.02, stdev=228.90 lat (msec): min=153, max=680, avg=401.10, stdev=228.91 clat percentiles (msec): | 1.00th=[ 153], 5.00th=[ 153], 10.00th=[ 153], 20.00th=[ 213], | 30.00th=[ 213], 40.00th=[ 253], 50.00th=[ 253], 60.00th=[ 460], | 70.00th=[ 651], 80.00th=[ 651], 90.00th=[ 684], 95.00th=[ 684], | 99.00th=[ 684], 99.50th=[ 684], 99.90th=[ 684], 99.95th=[ 684], | 99.99th=[ 684] bw ( KiB/s): min= 1762, max= 2797, per=38.64%, avg=2155.25, stdev=446.34, samples=4 iops : min= 1, max= 2, avg= 1.25, stdev= 0.50, samples=4 lat (usec) : 1000=8.33% lat (msec) : 2=8.33%, 250=25.00%, 500=33.33%, 750=25.00% cpu : usr=0.00%, sys=16.08%, ctx=210, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145799: Tue Jul 7 13:41:20 2026 read: IOPS=1, BW=1356KiB/s (1388kB/s)(5120KiB/3776msec) clat (usec): min=523, max=353610, avg=177507.95, stdev=166022.80 lat (usec): min=524, max=353611, avg=177509.56, stdev=166023.03 clat percentiles (usec): | 1.00th=[ 523], 5.00th=[ 523], 10.00th=[ 523], 20.00th=[ 523], | 30.00th=[ 1713], 40.00th=[ 1713], 50.00th=[240124], 60.00th=[240124], | 70.00th=[291505], 80.00th=[291505], 90.00th=[354419], 95.00th=[354419], | 99.00th=[354419], 99.50th=[354419], 99.90th=[354419], 99.95th=[354419], | 99.99th=[354419] bw ( KiB/s): min= 1885, max= 6131, per=100.00%, avg=4008.00, stdev=3002.38, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 write: IOPS=1, BW=1898KiB/s (1944kB/s)(7168KiB/3776msec); 0 zone resets clat (msec): min=120, max=854, avg=396.10, stdev=246.60 lat (msec): min=121, max=855, avg=396.81, stdev=246.46 clat percentiles (msec): | 1.00th=[ 122], 5.00th=[ 122], 10.00th=[ 122], 20.00th=[ 188], | 30.00th=[ 275], 40.00th=[ 275], 50.00th=[ 351], 60.00th=[ 481], | 70.00th=[ 481], 80.00th=[ 502], 90.00th=[ 852], 95.00th=[ 852], | 99.00th=[ 852], 99.50th=[ 852], 99.90th=[ 852], 99.95th=[ 852], | 99.99th=[ 852] bw ( KiB/s): min= 1762, max= 4087, per=47.29%, avg=2637.75, stdev=1074.87, samples=4 iops : min= 1, max= 3, avg= 1.75, stdev= 0.96, samples=4 lat (usec) : 750=8.33% lat (msec) : 2=8.33%, 250=25.00%, 500=41.67%, 750=8.33%, 1000=8.33% cpu : usr=0.05%, sys=19.28%, ctx=208, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3984KiB/s (4080kB/s), 398KiB/s-2001KiB/s (408kB/s-2049kB/s), io=20.0MiB (20.0MB), run=3582-5140msec WRITE: bw=5578KiB/s (5712kB/s), 1429KiB/s-1992KiB/s (1464kB/s-2040kB/s), io=28.0MiB (29.4MB), run=3582-5140msec rand-rw: (groupid=0, jobs=1): err= 0: pid=145800: Tue Jul 7 13:41:21 2026 read: IOPS=1, BW=1308KiB/s (1339kB/s)(7168KiB/5482msec) clat (msec): min=64, max=1431, avg=501.07, stdev=491.74 lat (msec): min=64, max=1431, avg=501.07, stdev=491.74 clat percentiles (msec): | 1.00th=[ 65], 5.00th=[ 65], 10.00th=[ 65], 20.00th=[ 91], | 30.00th=[ 92], 40.00th=[ 92], 50.00th=[ 493], 60.00th=[ 642], | 70.00th=[ 642], 80.00th=[ 701], 90.00th=[ 1435], 95.00th=[ 1435], | 99.00th=[ 1435], 99.50th=[ 1435], 99.90th=[ 1435], 99.95th=[ 1435], | 99.99th=[ 1435] bw ( KiB/s): min= 1980, max= 2043, per=54.31%, avg=2028.50, stdev=24.48, samples=6 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=6 write: IOPS=0, BW=934KiB/s (956kB/s)(5120KiB/5482msec); 0 zone resets clat (msec): min=130, max=659, avg=331.97, stdev=261.79 lat (msec): min=130, max=659, avg=332.10, stdev=261.78 clat percentiles (msec): | 1.00th=[ 131], 5.00th=[ 131], 10.00th=[ 131], 20.00th=[ 131], | 30.00th=[ 148], 40.00th=[ 148], 50.00th=[ 148], 60.00th=[ 148], | 70.00th=[ 575], 80.00th=[ 575], 90.00th=[ 659], 95.00th=[ 659], | 99.00th=[ 659], 99.50th=[ 659], 99.90th=[ 659], 99.95th=[ 659], | 99.99th=[ 659] bw ( KiB/s): min= 1946, max= 6131, per=77.22%, avg=4038.50, stdev=2959.24, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 lat (msec) : 100=25.00%, 250=25.00%, 500=8.33%, 750=33.33%, 2000=8.33% cpu : usr=0.00%, sys=4.31%, ctx=115, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145801: Tue Jul 7 13:41:21 2026 read: IOPS=0, BW=415KiB/s (425kB/s)(2048KiB/4932msec) clat (msec): min=157, max=437, avg=297.44, stdev=198.09 lat (msec): min=157, max=437, avg=297.44, stdev=198.09 clat percentiles (msec): | 1.00th=[ 159], 5.00th=[ 159], 10.00th=[ 159], 20.00th=[ 159], | 30.00th=[ 159], 40.00th=[ 159], 50.00th=[ 159], 60.00th=[ 439], | 70.00th=[ 439], 80.00th=[ 439], 90.00th=[ 439], 95.00th=[ 439], | 99.00th=[ 439], 99.50th=[ 439], 99.90th=[ 439], 99.95th=[ 439], | 99.99th=[ 439] bw ( KiB/s): min= 1393, max= 2043, per=46.00%, avg=1718.00, stdev=459.62, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2076KiB/s (2126kB/s)(10.0MiB/4932msec); 0 zone resets clat (msec): min=166, max=759, avg=427.59, stdev=209.71 lat (msec): min=166, max=759, avg=427.72, stdev=209.67 clat percentiles (msec): | 1.00th=[ 167], 5.00th=[ 167], 10.00th=[ 167], 20.00th=[ 201], | 30.00th=[ 271], 40.00th=[ 275], 50.00th=[ 384], 60.00th=[ 439], | 70.00th=[ 518], 80.00th=[ 523], 90.00th=[ 743], 95.00th=[ 760], | 99.00th=[ 760], 99.50th=[ 760], 99.90th=[ 760], 99.95th=[ 760], | 99.99th=[ 760] bw ( KiB/s): min= 1946, max= 4087, per=49.44%, avg=2585.71, stdev=1018.06, samples=7 iops : min= 1, max= 3, avg= 1.57, stdev= 0.98, samples=7 lat (msec) : 250=25.00%, 500=41.67%, 750=25.00%, 1000=8.33% cpu : usr=0.02%, sys=5.17%, ctx=76, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145802: Tue Jul 7 13:41:21 2026 read: IOPS=1, BW=1262KiB/s (1292kB/s)(6144KiB/4868msec) clat (msec): min=76, max=756, avg=281.26, stdev=250.58 lat (msec): min=76, max=756, avg=281.27, stdev=250.58 clat percentiles (msec): | 1.00th=[ 78], 5.00th=[ 78], 10.00th=[ 78], 20.00th=[ 150], | 30.00th=[ 150], 40.00th=[ 171], 50.00th=[ 171], 60.00th=[ 176], | 70.00th=[ 359], 80.00th=[ 359], 90.00th=[ 760], 95.00th=[ 760], | 99.00th=[ 760], 99.50th=[ 760], 99.90th=[ 760], 99.95th=[ 760], | 99.99th=[ 760] bw ( KiB/s): min= 1946, max= 4063, per=67.57%, avg=2523.75, stdev=1027.18, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 write: IOPS=1, BW=1262KiB/s (1292kB/s)(6144KiB/4868msec); 0 zone resets clat (msec): min=170, max=1265, avg=509.65, stdev=386.54 lat (msec): min=170, max=1265, avg=510.04, stdev=386.51 clat percentiles (msec): | 1.00th=[ 171], 5.00th=[ 171], 10.00th=[ 171], 20.00th=[ 300], | 30.00th=[ 300], 40.00th=[ 409], 50.00th=[ 409], 60.00th=[ 422], | 70.00th=[ 489], 80.00th=[ 489], 90.00th=[ 1267], 95.00th=[ 1267], | 99.00th=[ 1267], 99.50th=[ 1267], 99.90th=[ 1267], 99.95th=[ 1267], | 99.99th=[ 1267] bw ( KiB/s): min= 1469, max= 2043, per=36.65%, avg=1916.67, stdev=222.43, samples=6 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=6 lat (msec) : 100=8.33%, 250=33.33%, 500=41.67%, 1000=8.33%, 2000=8.33% cpu : usr=0.00%, sys=4.27%, ctx=112, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145803: Tue Jul 7 13:41:21 2026 read: IOPS=1, BW=1148KiB/s (1176kB/s)(5120KiB/4459msec) clat (msec): min=67, max=396, avg=201.29, stdev=124.09 lat (msec): min=67, max=396, avg=201.29, stdev=124.09 clat percentiles (msec): | 1.00th=[ 67], 5.00th=[ 67], 10.00th=[ 67], 20.00th=[ 67], | 30.00th=[ 136], 40.00th=[ 136], 50.00th=[ 178], 60.00th=[ 178], | 70.00th=[ 230], 80.00th=[ 230], 90.00th=[ 397], 95.00th=[ 397], | 99.00th=[ 397], 99.50th=[ 397], 99.90th=[ 397], 99.95th=[ 397], | 99.99th=[ 397] bw ( KiB/s): min= 3893, max= 4087, per=100.00%, avg=3990.00, stdev=137.18, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1608KiB/s (1646kB/s)(7168KiB/4459msec); 0 zone resets clat (msec): min=236, max=1190, avg=472.19, stdev=336.45 lat (msec): min=236, max=1190, avg=472.30, stdev=336.51 clat percentiles (msec): | 1.00th=[ 236], 5.00th=[ 236], 10.00th=[ 236], 20.00th=[ 243], | 30.00th=[ 259], 40.00th=[ 259], 50.00th=[ 384], 60.00th=[ 477], | 70.00th=[ 477], 80.00th=[ 518], 90.00th=[ 1183], 95.00th=[ 1183], | 99.00th=[ 1183], 99.50th=[ 1183], 99.90th=[ 1183], 99.95th=[ 1183], | 99.99th=[ 1183] bw ( KiB/s): min= 1424, max= 4063, per=44.07%, avg=2304.60, stdev=1016.12, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 lat (msec) : 100=8.33%, 250=41.67%, 500=33.33%, 750=8.33%, 2000=8.33% cpu : usr=0.02%, sys=6.66%, ctx=246, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3736KiB/s (3826kB/s), 415KiB/s-1308KiB/s (425kB/s-1339kB/s), io=20.0MiB (20.0MB), run=4459-5482msec WRITE: bw=5230KiB/s (5356kB/s), 934KiB/s-2076KiB/s (956kB/s-2126kB/s), io=28.0MiB (29.4MB), run=4459-5482msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=145811: Tue Jul 7 13:41:33 2026 read: IOPS=1, BW=4570KiB/s (4679kB/s)(12.0MiB/2689msec) clat (msec): min=383, max=1146, avg=860.29, stdev=415.47 lat (msec): min=383, max=1146, avg=860.29, stdev=415.47 clat percentiles (msec): | 1.00th=[ 384], 5.00th=[ 384], 10.00th=[ 384], 20.00th=[ 384], | 30.00th=[ 384], 40.00th=[ 1053], 50.00th=[ 1053], 60.00th=[ 1053], | 70.00th=[ 1150], 80.00th=[ 1150], 90.00th=[ 1150], 95.00th=[ 1150], | 99.00th=[ 1150], 99.50th=[ 1150], 99.90th=[ 1150], 99.95th=[ 1150], | 99.99th=[ 1150] bw ( KiB/s): min= 8175, max= 8192, per=100.00%, avg=8183.50, stdev=12.02, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.11%, sys=6.36%, ctx=65, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145813: Tue Jul 7 13:41:33 2026 read: IOPS=0, BW=1218KiB/s (1248kB/s)(4096KiB/3362msec) clat (nsec): min=787808k, max=787808k, avg=787807509.00, stdev= 0.00 lat (nsec): min=787810k, max=787810k, avg=787809552.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 785], 5.00th=[ 785], 10.00th=[ 785], 20.00th=[ 785], | 30.00th=[ 785], 40.00th=[ 785], 50.00th=[ 785], 60.00th=[ 785], | 70.00th=[ 785], 80.00th=[ 785], 90.00th=[ 785], 95.00th=[ 785], | 99.00th=[ 785], 99.50th=[ 785], 99.90th=[ 785], 99.95th=[ 785], | 99.99th=[ 785] bw ( KiB/s): min= 8175, max= 8175, per=100.00%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2437KiB/s (2495kB/s)(8192KiB/3362msec); 0 zone resets clat (msec): min=858, max=1599, avg=1228.68, stdev=523.99 lat (msec): min=860, max=1599, avg=1229.84, stdev=523.01 clat percentiles (msec): | 1.00th=[ 860], 5.00th=[ 860], 10.00th=[ 860], 20.00th=[ 860], | 30.00th=[ 860], 40.00th=[ 860], 50.00th=[ 860], 60.00th=[ 1603], | 70.00th=[ 1603], 80.00th=[ 1603], 90.00th=[ 1603], 95.00th=[ 1603], | 99.00th=[ 1603], 99.50th=[ 1603], 99.90th=[ 1603], 99.95th=[ 1603], | 99.99th=[ 1603] bw ( KiB/s): min= 8159, max= 8159, per=83.72%, avg=8159.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 1000=66.67%, 2000=33.33% cpu : usr=0.00%, sys=3.87%, ctx=41, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145815: Tue Jul 7 13:41:33 2026 write: IOPS=0, BW=3777KiB/s (3868kB/s)(12.0MiB/3253msec); 0 zone resets clat (msec): min=280, max=1533, avg=1058.15, stdev=679.04 lat (msec): min=280, max=1533, avg=1059.20, stdev=679.54 clat percentiles (msec): | 1.00th=[ 279], 5.00th=[ 279], 10.00th=[ 279], 20.00th=[ 279], | 30.00th=[ 279], 40.00th=[ 1368], 50.00th=[ 1368], 60.00th=[ 1368], | 70.00th=[ 1536], 80.00th=[ 1536], 90.00th=[ 1536], 95.00th=[ 1536], | 99.00th=[ 1536], 99.50th=[ 1536], 99.90th=[ 1536], 99.95th=[ 1536], | 99.99th=[ 1536] bw ( KiB/s): min= 8159, max= 8159, per=83.72%, avg=8159.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.00%, sys=5.47%, ctx=60, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145817: Tue Jul 7 13:41:33 2026 write: IOPS=1, BW=5278KiB/s (5405kB/s)(12.0MiB/2328msec); 0 zone resets clat (msec): min=331, max=1449, avg=760.03, stdev=602.85 lat (msec): min=332, max=1449, avg=760.57, stdev=602.76 clat percentiles (msec): | 1.00th=[ 334], 5.00th=[ 334], 10.00th=[ 334], 20.00th=[ 334], | 30.00th=[ 334], 40.00th=[ 498], 50.00th=[ 498], 60.00th=[ 498], | 70.00th=[ 1452], 80.00th=[ 1452], 90.00th=[ 1452], 95.00th=[ 1452], | 99.00th=[ 1452], 99.50th=[ 1452], 99.90th=[ 1452], 99.95th=[ 1452], | 99.99th=[ 1452] bw ( KiB/s): min=16351, max=16351, per=100.00%, avg=16351.00, stdev= 0.00, samples=1 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=1 lat (msec) : 500=66.67%, 2000=33.33% cpu : usr=0.09%, sys=6.32%, ctx=45, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4873KiB/s (4990kB/s), 1218KiB/s-4570KiB/s (1248kB/s-4679kB/s), io=16.0MiB (16.8MB), run=2689-3362msec WRITE: bw=9747KiB/s (9980kB/s), 2437KiB/s-5278KiB/s (2495kB/s-5405kB/s), io=32.0MiB (33.6MB), run=2328-3362msec rand-rw: (groupid=0, jobs=1): err= 0: pid=145812: Tue Jul 7 13:41:34 2026 read: IOPS=1, BW=5170KiB/s (5294kB/s)(12.0MiB/2377msec) clat (msec): min=612, max=845, avg=743.91, stdev=119.30 lat (msec): min=612, max=845, avg=743.91, stdev=119.30 clat percentiles (msec): | 1.00th=[ 609], 5.00th=[ 609], 10.00th=[ 609], 20.00th=[ 609], | 30.00th=[ 609], 40.00th=[ 776], 50.00th=[ 776], 60.00th=[ 776], | 70.00th=[ 844], 80.00th=[ 844], 90.00th=[ 844], 95.00th=[ 844], | 99.00th=[ 844], 99.50th=[ 844], 99.90th=[ 844], 99.95th=[ 844], | 99.99th=[ 844] bw ( KiB/s): min= 8143, max= 8192, per=100.00%, avg=8167.50, stdev=34.65, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 750=33.33%, 1000=66.67% cpu : usr=0.00%, sys=19.57%, ctx=382, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145814: Tue Jul 7 13:41:34 2026 read: IOPS=0, BW=1491KiB/s (1526kB/s)(4096KiB/2748msec) clat (nsec): min=697066k, max=697066k, avg=697066479.00, stdev= 0.00 lat (nsec): min=697068k, max=697068k, avg=697068483.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 701], 5.00th=[ 701], 10.00th=[ 701], 20.00th=[ 701], | 30.00th=[ 701], 40.00th=[ 701], 50.00th=[ 701], 60.00th=[ 701], | 70.00th=[ 701], 80.00th=[ 701], 90.00th=[ 701], 95.00th=[ 701], | 99.00th=[ 701], 99.50th=[ 701], 99.90th=[ 701], 99.95th=[ 701], | 99.99th=[ 701] bw ( KiB/s): min= 8143, max= 8143, per=100.00%, avg=8143.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2981KiB/s (3053kB/s)(8192KiB/2748msec); 0 zone resets clat (msec): min=612, max=1375, avg=993.99, stdev=539.10 lat (msec): min=612, max=1375, avg=994.29, stdev=539.28 clat percentiles (msec): | 1.00th=[ 617], 5.00th=[ 617], 10.00th=[ 617], 20.00th=[ 617], | 30.00th=[ 617], 40.00th=[ 617], 50.00th=[ 617], 60.00th=[ 1368], | 70.00th=[ 1368], 80.00th=[ 1368], 90.00th=[ 1368], 95.00th=[ 1368], | 99.00th=[ 1368], 99.50th=[ 1368], 99.90th=[ 1368], 99.95th=[ 1368], | 99.99th=[ 1368] bw ( KiB/s): min= 8159, max= 8159, per=94.10%, avg=8159.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=66.67%, 2000=33.33% cpu : usr=0.00%, sys=6.12%, ctx=143, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145816: Tue Jul 7 13:41:34 2026 write: IOPS=0, BW=3252KiB/s (3330kB/s)(12.0MiB/3779msec); 0 zone resets clat (msec): min=275, max=1828, avg=1209.17, stdev=822.70 lat (msec): min=275, max=1828, avg=1210.71, stdev=823.41 clat percentiles (msec): | 1.00th=[ 275], 5.00th=[ 275], 10.00th=[ 275], 20.00th=[ 275], | 30.00th=[ 275], 40.00th=[ 1519], 50.00th=[ 1519], 60.00th=[ 1519], | 70.00th=[ 1821], 80.00th=[ 1821], 90.00th=[ 1821], 95.00th=[ 1821], | 99.00th=[ 1821], 99.50th=[ 1821], 99.90th=[ 1821], 99.95th=[ 1821], | 99.99th=[ 1821] bw ( KiB/s): min= 8159, max= 8192, per=94.29%, avg=8175.50, stdev=23.33, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.00%, sys=2.51%, ctx=49, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145818: Tue Jul 7 13:41:34 2026 write: IOPS=1, BW=4536KiB/s (4645kB/s)(12.0MiB/2709msec); 0 zone resets clat (msec): min=639, max=1067, avg=829.52, stdev=218.17 lat (msec): min=640, max=1069, avg=830.51, stdev=218.91 clat percentiles (msec): | 1.00th=[ 642], 5.00th=[ 642], 10.00th=[ 642], 20.00th=[ 642], | 30.00th=[ 642], 40.00th=[ 785], 50.00th=[ 785], 60.00th=[ 785], | 70.00th=[ 1070], 80.00th=[ 1070], 90.00th=[ 1070], 95.00th=[ 1070], | 99.00th=[ 1070], 99.50th=[ 1070], 99.90th=[ 1070], 99.95th=[ 1070], | 99.99th=[ 1070] bw ( KiB/s): min= 8126, max= 8192, per=94.10%, avg=8159.00, stdev=46.67, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 750=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.04%, sys=8.57%, ctx=96, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5962KiB/s (6105kB/s), 1491KiB/s-5170KiB/s (1526kB/s-5294kB/s), io=16.0MiB (16.8MB), run=2377-2748msec WRITE: bw=8671KiB/s (8879kB/s), 2981KiB/s-4536KiB/s (3053kB/s-4645kB/s), io=32.0MiB (33.6MB), run=2709-3779msec