== sanity test 398b: DIO and buffer IO race ============== 23:15:45 (1789269345) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 4.91738 s, 10.2 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144410: Sat Sep 12 23:17:58 2026 read: IOPS=13, BW=52.3KiB/s (53.6kB/s)(5992KiB/114537msec) clat (usec): min=23, max=1142.2k, avg=36599.44, stdev=40954.88 lat (usec): min=23, max=1142.2k, avg=36603.25, stdev=40953.92 clat percentiles (usec): | 1.00th=[ 39], 5.00th=[ 55], 10.00th=[ 64], | 20.00th=[ 14877], 30.00th=[ 20055], 40.00th=[ 24511], | 50.00th=[ 29492], 60.00th=[ 35914], 70.00th=[ 45351], | 80.00th=[ 55837], 90.00th=[ 72877], 95.00th=[ 87557], | 99.00th=[ 141558], 99.50th=[ 156238], 99.90th=[ 248513], | 99.95th=[1149240], 99.99th=[1149240] bw ( KiB/s): min= 7, max= 119, per=25.48%, avg=52.50, stdev=22.68, samples=223 iops : min= 1, max= 29, avg=12.50, stdev= 5.71, samples=223 write: IOPS=13, BW=54.0KiB/s (56.3kB/s)(6296KiB/114537msec); 0 zone resets clat (usec): min=686, max=403630, avg=37614.73, stdev=41791.03 lat (usec): min=687, max=403631, avg=37624.10, stdev=41786.35 clat percentiles (usec): | 1.00th=[ 1020], 5.00th=[ 1123], 10.00th=[ 1254], 20.00th=[ 2769], | 30.00th=[ 6128], 40.00th=[ 15270], 50.00th=[ 27395], 60.00th=[ 38011], | 70.00th=[ 49546], 80.00th=[ 64226], 90.00th=[ 88605], 95.00th=[110625], | 99.00th=[179307], 99.50th=[246416], 99.90th=[367002], 99.95th=[404751], | 99.99th=[404751] bw ( KiB/s): min= 7, max= 183, per=25.45%, avg=54.97, stdev=23.62, samples=224 iops : min= 1, max= 45, avg=13.11, stdev= 5.93, samples=224 lat (usec) : 50=1.40%, 100=4.82%, 250=0.42%, 500=0.13%, 750=0.13% lat (usec) : 1000=0.42% lat (msec) : 2=7.81%, 4=4.39%, 10=6.22%, 20=10.90%, 50=35.90% lat (msec) : 100=22.04%, 250=5.14%, 500=0.23%, 2000=0.03% cpu : usr=0.08%, sys=5.11%, ctx=6202, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144411: Sat Sep 12 23:17:58 2026 read: IOPS=13, BW=52.3KiB/s (53.5kB/s)(5940KiB/113639msec) clat (usec): min=31, max=198290, avg=34883.72, stdev=27396.58 lat (usec): min=31, max=198301, avg=34894.60, stdev=27410.68 clat percentiles (usec): | 1.00th=[ 40], 5.00th=[ 56], 10.00th=[ 63], 20.00th=[ 14484], | 30.00th=[ 20055], 40.00th=[ 24773], 50.00th=[ 30016], 60.00th=[ 35914], | 70.00th=[ 44303], 80.00th=[ 54789], 90.00th=[ 70779], 95.00th=[ 86508], | 99.00th=[120062], 99.50th=[135267], 99.90th=[191890], 99.95th=[198181], | 99.99th=[198181] bw ( KiB/s): min= 7, max= 119, per=25.61%, avg=52.76, stdev=22.66, samples=220 iops : min= 1, max= 29, avg=12.56, stdev= 5.68, samples=220 write: IOPS=13, BW=55.9KiB/s (57.2kB/s)(6348KiB/113639msec); 0 zone resets clat (usec): min=920, max=1080.1k, avg=38629.99, stdev=48434.05 lat (usec): min=921, max=1080.1k, avg=38632.55, stdev=48433.96 clat percentiles (usec): | 1.00th=[ 1029], 5.00th=[ 1156], 10.00th=[ 1467], | 20.00th=[ 3458], 30.00th=[ 7046], 40.00th=[ 16319], | 50.00th=[ 27919], 60.00th=[ 37487], 70.00th=[ 50070], | 80.00th=[ 65274], 90.00th=[ 92799], 95.00th=[ 114820], | 99.00th=[ 164627], 99.50th=[ 198181], 99.90th=[ 488637], | 99.95th=[1082131], 99.99th=[1082131] bw ( KiB/s): min= 7, max= 128, per=25.84%, avg=55.81, stdev=23.37, samples=222 iops : min= 1, max= 32, avg=13.33, stdev= 5.87, samples=222 lat (usec) : 50=1.04%, 100=5.37%, 250=0.39%, 500=0.23%, 750=0.10% lat (usec) : 1000=0.33% lat (msec) : 2=6.67%, 4=4.46%, 10=6.84%, 20=11.23%, 50=36.30% lat (msec) : 100=21.68%, 250=5.27%, 500=0.07%, 2000=0.03% cpu : usr=0.09%, sys=5.28%, ctx=6223, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144412: Sat Sep 12 23:17:58 2026 read: IOPS=12, BW=51.9KiB/s (53.2kB/s)(6028KiB/116078msec) clat (usec): min=24, max=591274, avg=37139.66, stdev=33978.80 lat (usec): min=25, max=591275, avg=37141.00, stdev=33978.87 clat percentiles (usec): | 1.00th=[ 42], 5.00th=[ 57], 10.00th=[ 82], 20.00th=[ 14746], | 30.00th=[ 19792], 40.00th=[ 24773], 50.00th=[ 29754], 60.00th=[ 36963], | 70.00th=[ 45351], 80.00th=[ 57934], 90.00th=[ 73925], 95.00th=[ 91751], | 99.00th=[141558], 99.50th=[168821], 99.90th=[329253], 99.95th=[591397], | 99.99th=[591397] bw ( KiB/s): min= 7, max= 157, per=25.14%, avg=51.79, stdev=24.91, samples=227 iops : min= 1, max= 39, avg=12.32, stdev= 6.27, samples=227 write: IOPS=13, BW=53.9KiB/s (55.2kB/s)(6260KiB/116078msec); 0 zone resets clat (usec): min=785, max=1078.1k, avg=38069.81, stdev=49365.35 lat (usec): min=787, max=1078.1k, avg=38072.41, stdev=49366.90 clat percentiles (usec): | 1.00th=[ 1012], 5.00th=[ 1123], 10.00th=[ 1270], | 20.00th=[ 2802], 30.00th=[ 6456], 40.00th=[ 16909], | 50.00th=[ 27919], 60.00th=[ 38536], 70.00th=[ 48497], | 80.00th=[ 63701], 90.00th=[ 86508], 95.00th=[ 107480], | 99.00th=[ 196084], 99.50th=[ 225444], 99.90th=[ 501220], | 99.95th=[1082131], 99.99th=[1082131] bw ( KiB/s): min= 7, max= 182, per=24.92%, avg=53.83, stdev=25.23, samples=227 iops : min= 1, max= 45, avg=12.83, stdev= 6.34, samples=227 lat (usec) : 50=1.07%, 100=4.33%, 250=0.62%, 500=0.03%, 750=0.03% lat (usec) : 1000=0.49% lat (msec) : 2=7.68%, 4=4.00%, 10=6.38%, 20=11.98%, 50=35.94% lat (msec) : 100=22.30%, 250=4.85%, 500=0.20%, 750=0.07%, 2000=0.03% cpu : usr=0.06%, sys=5.25%, ctx=6386, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144413: Sat Sep 12 23:17:58 2026 read: IOPS=13, BW=52.7KiB/s (53.9kB/s)(6052KiB/114873msec) clat (usec): min=32, max=263029, avg=35652.07, stdev=29557.03 lat (usec): min=32, max=263030, avg=35656.14, stdev=29556.90 clat percentiles (usec): | 1.00th=[ 41], 5.00th=[ 55], 10.00th=[ 63], 20.00th=[ 14877], | 30.00th=[ 19792], 40.00th=[ 24773], 50.00th=[ 30278], 60.00th=[ 35914], | 70.00th=[ 44827], 80.00th=[ 53740], 90.00th=[ 68682], 95.00th=[ 90702], | 99.00th=[147850], 99.50th=[168821], 99.90th=[233833], 99.95th=[263193], | 99.99th=[263193] bw ( KiB/s): min= 7, max= 118, per=25.47%, avg=52.46, stdev=22.09, samples=224 iops : min= 1, max= 29, avg=12.49, stdev= 5.55, samples=224 write: IOPS=13, BW=54.3KiB/s (55.6kB/s)(6236KiB/114873msec); 0 zone resets clat (usec): min=787, max=1121.0k, avg=38761.74, stdev=49154.24 lat (usec): min=788, max=1121.0k, avg=38765.70, stdev=49153.33 clat percentiles (usec): | 1.00th=[ 1029], 5.00th=[ 1123], 10.00th=[ 1254], | 20.00th=[ 3392], 30.00th=[ 7177], 40.00th=[ 17171], | 50.00th=[ 28181], 60.00th=[ 38011], 70.00th=[ 51119], | 80.00th=[ 66323], 90.00th=[ 91751], 95.00th=[ 114820], | 99.00th=[ 177210], 99.50th=[ 206570], 99.90th=[ 484443], | 99.95th=[1115685], 99.99th=[1115685] bw ( KiB/s): min= 7, max= 134, per=25.05%, avg=54.11, stdev=23.46, samples=224 iops : min= 1, max= 33, avg=12.90, stdev= 5.92, samples=224 lat (usec) : 50=1.33%, 100=5.05%, 250=0.46%, 500=0.03%, 750=0.10% lat (usec) : 1000=0.23% lat (msec) : 2=7.71%, 4=3.42%, 10=6.28%, 20=12.04%, 50=35.90% lat (msec) : 100=22.01%, 250=5.27%, 500=0.13%, 2000=0.03% cpu : usr=0.08%, sys=5.20%, ctx=6197, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=207KiB/s (212kB/s), 51.9KiB/s-52.7KiB/s (53.2kB/s-53.9kB/s), io=23.4MiB (24.6MB), run=113639-116078msec WRITE: bw=217KiB/s (222kB/s), 53.9KiB/s-55.9KiB/s (55.2kB/s-57.2kB/s), io=24.6MiB (25.7MB), run=113639-116078msec fio: pid=144415, err=5/file:backend.c:481, func=full resid, error=Input/output error rand-rw: (groupid=0, jobs=1): err= 5 (file:backend.c:481, func=full resid, error=Input/output error): pid=144415: Sat Sep 12 23:19:53 2026 read: IOPS=6, BW=25.6KiB/s (26.2kB/s)(5772KiB/225346msec) clat (msec): min=5, max=885, avg=30.98, stdev=38.01 lat (msec): min=5, max=885, avg=30.98, stdev=38.01 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 8], 10.00th=[ 10], 20.00th=[ 12], | 30.00th=[ 14], 40.00th=[ 17], 50.00th=[ 20], 60.00th=[ 24], | 70.00th=[ 31], 80.00th=[ 43], 90.00th=[ 66], 95.00th=[ 90], | 99.00th=[ 155], 99.50th=[ 215], 99.90th=[ 271], 99.95th=[ 885], | 99.99th=[ 885] bw ( KiB/s): min= 7, max= 95, per=27.70%, avg=28.26, stdev=18.57, samples=396 iops : min= 1, max= 23, avg= 6.45, stdev= 4.68, samples=396 write: IOPS=6, BW=26.9KiB/s (27.6kB/s)(6072KiB/225346msec); 0 zone resets clat (msec): min=26, max=655, avg=118.88, stdev=62.07 lat (msec): min=26, max=655, avg=118.89, stdev=62.07 clat percentiles (msec): | 1.00th=[ 42], 5.00th=[ 52], 10.00th=[ 62], 20.00th=[ 72], | 30.00th=[ 83], 40.00th=[ 92], 50.00th=[ 105], 60.00th=[ 117], | 70.00th=[ 136], 80.00th=[ 159], 90.00th=[ 194], 95.00th=[ 228], | 99.00th=[ 313], 99.50th=[ 376], 99.90th=[ 600], 99.95th=[ 659], | 99.99th=[ 659] bw ( KiB/s): min= 7, max= 64, per=24.82%, avg=26.56, stdev=12.64, samples=442 iops : min= 1, max= 16, avg= 6.02, stdev= 3.22, samples=442 lat (msec) : 10=6.89%, 20=18.16%, 50=18.06%, 100=27.82%, 250=27.08% lat (msec) : 500=1.79%, 750=0.14%, 1000=0.03% cpu : usr=0.05%, sys=1.14%, ctx=5005, majf=0, minf=19 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1444,1518,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144416: Sat Sep 12 23:19:53 2026 read: IOPS=6, BW=25.7KiB/s (26.3kB/s)(5940KiB/230882msec) clat (msec): min=4, max=1156, avg=30.34, stdev=41.39 lat (msec): min=4, max=1156, avg=30.34, stdev=41.39 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 10], 20.00th=[ 12], | 30.00th=[ 14], 40.00th=[ 17], 50.00th=[ 20], 60.00th=[ 24], | 70.00th=[ 30], 80.00th=[ 42], 90.00th=[ 66], 95.00th=[ 88], | 99.00th=[ 150], 99.50th=[ 192], 99.90th=[ 268], 99.95th=[ 1150], | 99.99th=[ 1150] bw ( KiB/s): min= 7, max= 95, per=28.31%, avg=28.87, stdev=18.98, samples=399 iops : min= 1, max= 23, avg= 6.61, stdev= 4.78, samples=399 write: IOPS=6, BW=27.5KiB/s (28.2kB/s)(6348KiB/230882msec); 0 zone resets clat (msec): min=32, max=789, avg=117.02, stdev=62.07 lat (msec): min=32, max=789, avg=117.03, stdev=62.06 clat percentiles (msec): | 1.00th=[ 45], 5.00th=[ 53], 10.00th=[ 58], 20.00th=[ 70], | 30.00th=[ 81], 40.00th=[ 90], 50.00th=[ 102], 60.00th=[ 115], | 70.00th=[ 131], 80.00th=[ 157], 90.00th=[ 194], 95.00th=[ 232], | 99.00th=[ 309], 99.50th=[ 359], 99.90th=[ 667], 99.95th=[ 793], | 99.99th=[ 793] bw ( KiB/s): min= 7, max= 63, per=25.47%, avg=27.25, stdev=12.57, samples=451 iops : min= 1, max= 15, avg= 6.20, stdev= 3.20, samples=451 lat (msec) : 10=6.45%, 20=18.39%, 50=17.77%, 100=29.23%, 250=26.20% lat (msec) : 500=1.82%, 750=0.07%, 1000=0.03%, 2000=0.03% cpu : usr=0.05%, sys=1.17%, ctx=5005, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144417: Sat Sep 12 23:19:53 2026 read: IOPS=6, BW=26.1KiB/s (26.7kB/s)(6028KiB/231247msec) clat (msec): min=4, max=386, avg=31.50, stdev=31.74 lat (msec): min=4, max=386, avg=31.50, stdev=31.74 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 9], 10.00th=[ 10], 20.00th=[ 12], | 30.00th=[ 15], 40.00th=[ 17], 50.00th=[ 20], 60.00th=[ 25], | 70.00th=[ 32], 80.00th=[ 45], 90.00th=[ 70], 95.00th=[ 94], | 99.00th=[ 153], 99.50th=[ 203], 99.90th=[ 271], 99.95th=[ 388], | 99.99th=[ 388] bw ( KiB/s): min= 7, max= 111, per=27.31%, avg=27.85, stdev=19.27, samples=420 iops : min= 1, max= 27, avg= 6.35, stdev= 4.86, samples=420 write: IOPS=6, BW=27.1KiB/s (27.7kB/s)(6260KiB/231247msec); 0 zone resets clat (msec): min=30, max=1362, avg=117.35, stdev=68.91 lat (msec): min=30, max=1362, avg=117.36, stdev=68.91 clat percentiles (msec): | 1.00th=[ 41], 5.00th=[ 53], 10.00th=[ 60], 20.00th=[ 71], | 30.00th=[ 81], 40.00th=[ 90], 50.00th=[ 101], 60.00th=[ 113], | 70.00th=[ 131], 80.00th=[ 155], 90.00th=[ 197], 95.00th=[ 232], | 99.00th=[ 313], 99.50th=[ 401], 99.90th=[ 634], 99.95th=[ 1368], | 99.99th=[ 1368] bw ( KiB/s): min= 7, max= 63, per=25.07%, avg=26.83, stdev=13.05, samples=452 iops : min= 1, max= 15, avg= 6.09, stdev= 3.32, samples=452 lat (msec) : 10=6.12%, 20=19.01%, 50=17.22%, 100=30.11%, 250=25.78% lat (msec) : 500=1.63%, 750=0.10%, 2000=0.03% cpu : usr=0.04%, sys=1.16%, ctx=5154, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144418: Sat Sep 12 23:19:53 2026 read: IOPS=6, BW=26.4KiB/s (26.0kB/s)(6052KiB/229608msec) clat (msec): min=4, max=598, avg=30.85, stdev=36.01 lat (msec): min=4, max=598, avg=30.85, stdev=36.01 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 10], 20.00th=[ 12], | 30.00th=[ 14], 40.00th=[ 17], 50.00th=[ 20], 60.00th=[ 24], | 70.00th=[ 30], 80.00th=[ 41], 90.00th=[ 67], 95.00th=[ 94], | 99.00th=[ 144], 99.50th=[ 213], 99.90th=[ 451], 99.95th=[ 600], | 99.99th=[ 600] bw ( KiB/s): min= 7, max= 136, per=28.57%, avg=29.14, stdev=20.22, samples=403 iops : min= 1, max= 34, avg= 6.67, stdev= 5.09, samples=403 write: IOPS=6, BW=27.2KiB/s (27.8kB/s)(6236KiB/229608msec); 0 zone resets clat (msec): min=34, max=1213, avg=117.24, stdev=66.82 lat (msec): min=34, max=1213, avg=117.24, stdev=66.82 clat percentiles (msec): | 1.00th=[ 42], 5.00th=[ 51], 10.00th=[ 59], 20.00th=[ 70], | 30.00th=[ 81], 40.00th=[ 91], 50.00th=[ 102], 60.00th=[ 115], | 70.00th=[ 133], 80.00th=[ 157], 90.00th=[ 192], 95.00th=[ 234], | 99.00th=[ 330], 99.50th=[ 347], 99.90th=[ 785], 99.95th=[ 1217], | 99.99th=[ 1217] bw ( KiB/s): min= 7, max= 63, per=25.26%, avg=27.03, stdev=12.47, samples=446 iops : min= 1, max= 15, avg= 6.14, stdev= 3.18, samples=446 lat (msec) : 10=6.80%, 20=18.91%, 50=18.07%, 100=28.48%, 250=25.81% lat (msec) : 500=1.82%, 750=0.03%, 1000=0.03%, 2000=0.03% cpu : usr=0.04%, sys=1.18%, ctx=5189, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=103KiB/s (105kB/s), 25.6KiB/s-26.4KiB/s (26.2kB/s-26.0kB/s), io=23.2MiB (24.4MB), run=225346-231247msec WRITE: bw=108KiB/s (110kB/s), 26.9KiB/s-27.5KiB/s (27.6kB/s-28.2kB/s), io=24.3MiB (25.5MB), run=225346-231247msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144462: Sat Sep 12 23:20:29 2026 read: IOPS=15, BW=242KiB/s (248kB/s)(5920KiB/24438msec) clat (usec): min=32, max=236415, avg=31454.87, stdev=30368.92 lat (usec): min=32, max=236416, avg=31458.49, stdev=30368.08 clat percentiles (usec): | 1.00th=[ 38], 5.00th=[ 47], 10.00th=[ 61], 20.00th=[ 69], | 30.00th=[ 104], 40.00th=[ 21365], 50.00th=[ 28705], 60.00th=[ 35390], | 70.00th=[ 44303], 80.00th=[ 55837], 90.00th=[ 67634], 95.00th=[ 82314], | 99.00th=[117965], 99.50th=[139461], 99.90th=[235930], 99.95th=[235930], | 99.99th=[235930] bw ( KiB/s): min= 62, max= 442, per=25.02%, avg=236.47, stdev=83.54, samples=47 iops : min= 3, max= 27, avg=14.02, stdev= 5.26, samples=47 write: IOPS=16, BW=261KiB/s (267kB/s)(6368KiB/24438msec); 0 zone resets clat (usec): min=1337, max=198972, avg=31751.28, stdev=32754.49 lat (usec): min=1338, max=198974, avg=31757.65, stdev=32754.57 clat percentiles (usec): | 1.00th=[ 1483], 5.00th=[ 1926], 10.00th=[ 2606], 20.00th=[ 4621], | 30.00th=[ 6783], 40.00th=[ 10028], 50.00th=[ 21365], 60.00th=[ 29754], | 70.00th=[ 40633], 80.00th=[ 60556], 90.00th=[ 83362], 95.00th=[ 95945], | 99.00th=[135267], 99.50th=[139461], 99.90th=[198181], 99.95th=[198181], | 99.99th=[198181] bw ( KiB/s): min= 31, max= 479, per=25.94%, avg=257.85, stdev=100.83, samples=47 iops : min= 1, max= 29, avg=15.38, stdev= 6.38, samples=47 lat (usec) : 50=2.86%, 100=11.07%, 250=0.78%, 500=0.39% lat (msec) : 2=2.86%, 4=6.12%, 10=12.11%, 20=7.81%, 50=31.51% lat (msec) : 100=21.22%, 250=3.26% cpu : usr=0.08%, sys=5.67%, ctx=1344, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144463: Sat Sep 12 23:20:29 2026 read: IOPS=14, BW=227KiB/s (232kB/s)(5744KiB/25346msec) clat (usec): min=34, max=145822, avg=33994.42, stdev=29259.98 lat (usec): min=35, max=145822, avg=33996.48, stdev=29259.82 clat percentiles (usec): | 1.00th=[ 40], 5.00th=[ 52], 10.00th=[ 62], 20.00th=[ 74], | 30.00th=[ 15664], 40.00th=[ 25297], 50.00th=[ 32375], 60.00th=[ 38011], | 70.00th=[ 47449], 80.00th=[ 57934], 90.00th=[ 76022], 95.00th=[ 89654], | 99.00th=[108528], 99.50th=[122160], 99.90th=[145753], 99.95th=[145753], | 99.99th=[145753] bw ( KiB/s): min= 63, max= 408, per=23.70%, avg=223.94, stdev=83.20, samples=49 iops : min= 3, max= 25, avg=13.24, stdev= 5.29, samples=49 write: IOPS=16, BW=258KiB/s (264kB/s)(6544KiB/25346msec); 0 zone resets clat (usec): min=1287, max=181788, avg=31933.72, stdev=33287.38 lat (usec): min=1287, max=181790, avg=31935.77, stdev=33287.40 clat percentiles (usec): | 1.00th=[ 1450], 5.00th=[ 1713], 10.00th=[ 2147], 20.00th=[ 4015], | 30.00th=[ 7242], 40.00th=[ 10945], 50.00th=[ 19006], 60.00th=[ 30278], | 70.00th=[ 44303], 80.00th=[ 56886], 90.00th=[ 79168], 95.00th=[ 96994], | 99.00th=[137364], 99.50th=[149947], 99.90th=[181404], 99.95th=[181404], | 99.99th=[181404] bw ( KiB/s): min= 63, max= 447, per=25.28%, avg=251.29, stdev=80.02, samples=49 iops : min= 3, max= 27, avg=14.94, stdev= 5.03, samples=49 lat (usec) : 50=2.08%, 100=9.90%, 250=0.78%, 500=0.26% lat (msec) : 2=5.08%, 4=5.73%, 10=9.51%, 20=10.29%, 50=30.34% lat (msec) : 100=22.53%, 250=3.52% cpu : usr=0.09%, sys=5.43%, ctx=1371, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144464: Sat Sep 12 23:20:29 2026 read: IOPS=15, BW=255KiB/s (261kB/s)(6256KiB/24556msec) clat (usec): min=34, max=157900, avg=32798.36, stdev=30034.70 lat (usec): min=34, max=157901, avg=32799.63, stdev=30034.69 clat percentiles (usec): | 1.00th=[ 40], 5.00th=[ 50], 10.00th=[ 62], 20.00th=[ 72], | 30.00th=[ 12256], 40.00th=[ 25297], 50.00th=[ 30278], 60.00th=[ 34866], | 70.00th=[ 43779], 80.00th=[ 54264], 90.00th=[ 72877], 95.00th=[ 88605], | 99.00th=[133694], 99.50th=[147850], 99.90th=[158335], 99.95th=[158335], | 99.99th=[158335] bw ( KiB/s): min= 94, max= 476, per=27.00%, avg=255.15, stdev=89.28, samples=48 iops : min= 5, max= 29, avg=15.21, stdev= 5.62, samples=48 write: IOPS=15, BW=246KiB/s (252kB/s)(6032KiB/24556msec); 0 zone resets clat (usec): min=1391, max=163541, avg=30665.78, stdev=32258.77 lat (usec): min=1393, max=163545, avg=30668.08, stdev=32258.67 clat percentiles (usec): | 1.00th=[ 1434], 5.00th=[ 1631], 10.00th=[ 1926], 20.00th=[ 4228], | 30.00th=[ 6783], 40.00th=[ 11076], 50.00th=[ 19792], 60.00th=[ 28705], | 70.00th=[ 37487], 80.00th=[ 53740], 90.00th=[ 78119], 95.00th=[ 99091], | 99.00th=[135267], 99.50th=[154141], 99.90th=[162530], 99.95th=[162530], | 99.99th=[162530] bw ( KiB/s): min= 95, max= 442, per=24.42%, avg=242.75, stdev=82.81, samples=48 iops : min= 5, max= 27, avg=14.42, stdev= 5.25, samples=48 lat (usec) : 50=2.60%, 100=10.94%, 250=1.17%, 500=0.13% lat (msec) : 2=5.60%, 4=3.91%, 10=9.38%, 20=8.59%, 50=34.11% lat (msec) : 100=19.92%, 250=3.65% cpu : usr=0.09%, sys=5.46%, ctx=1350, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144465: Sat Sep 12 23:20:29 2026 read: IOPS=15, BW=242KiB/s (247kB/s)(6032KiB/24974msec) clat (usec): min=33, max=229709, avg=34860.34, stdev=32444.63 lat (usec): min=33, max=229710, avg=34861.76, stdev=32444.84 clat percentiles (usec): | 1.00th=[ 41], 5.00th=[ 55], 10.00th=[ 60], 20.00th=[ 70], | 30.00th=[ 4047], 40.00th=[ 24511], 50.00th=[ 33817], 60.00th=[ 40109], | 70.00th=[ 49546], 80.00th=[ 58459], 90.00th=[ 73925], 95.00th=[ 90702], | 99.00th=[128451], 99.50th=[179307], 99.90th=[229639], 99.95th=[229639], | 99.99th=[229639] bw ( KiB/s): min= 63, max= 440, per=25.50%, avg=240.96, stdev=85.99, samples=48 iops : min= 3, max= 27, avg=14.29, stdev= 5.41, samples=48 write: IOPS=15, BW=251KiB/s (257kB/s)(6256KiB/24974msec); 0 zone resets clat (usec): min=1374, max=232555, avg=29887.45, stdev=33127.19 lat (usec): min=1377, max=232556, avg=29891.90, stdev=33125.21 clat percentiles (usec): | 1.00th=[ 1516], 5.00th=[ 1713], 10.00th=[ 2311], 20.00th=[ 4555], | 30.00th=[ 8029], 40.00th=[ 11731], 50.00th=[ 17695], 60.00th=[ 25560], | 70.00th=[ 34866], 80.00th=[ 50594], 90.00th=[ 74974], 95.00th=[ 94897], | 99.00th=[149947], 99.50th=[185598], 99.90th=[231736], 99.95th=[231736], | 99.99th=[231736] bw ( KiB/s): min= 63, max= 505, per=25.27%, avg=251.15, stdev=101.30, samples=48 iops : min= 3, max= 31, avg=14.94, stdev= 6.46, samples=48 lat (usec) : 50=1.95%, 100=11.33%, 250=0.65%, 500=0.39%, 750=0.26% lat (msec) : 2=3.65%, 4=5.99%, 10=9.11%, 20=10.94%, 50=31.12% lat (msec) : 100=20.83%, 250=3.78% cpu : usr=0.09%, sys=6.08%, ctx=1357, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=945KiB/s (968kB/s), 227KiB/s-255KiB/s (232kB/s-261kB/s), io=23.4MiB (24.5MB), run=24438-25346msec WRITE: bw=994KiB/s (1018kB/s), 246KiB/s-261KiB/s (252kB/s-267kB/s), io=24.6MiB (25.8MB), run=24438-25346msec fio: pid=144469, err=5/file:backend.c:481, func=full resid, error=Input/output error rand-rw: (groupid=0, jobs=1): err= 0: pid=144467: Sat Sep 12 23:20:58 2026 read: IOPS=6, BW=109KiB/s (111kB/s)(5920KiB/54471msec) clat (msec): min=5, max=245, avg=32.19, stdev=34.01 lat (msec): min=5, max=245, avg=32.19, stdev=34.01 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 13], | 30.00th=[ 15], 40.00th=[ 17], 50.00th=[ 20], 60.00th=[ 25], | 70.00th=[ 30], 80.00th=[ 45], 90.00th=[ 66], 95.00th=[ 96], | 99.00th=[ 192], 99.50th=[ 241], 99.90th=[ 247], 99.95th=[ 247], | 99.99th=[ 247] bw ( KiB/s): min= 31, max= 382, per=28.56%, avg=115.09, stdev=76.84, samples=100 iops : min= 1, max= 23, avg= 6.45, stdev= 4.96, samples=100 write: IOPS=7, BW=117KiB/s (120kB/s)(6368KiB/54471msec); 0 zone resets clat (msec): min=37, max=438, avg=106.41, stdev=57.27 lat (msec): min=37, max=438, avg=106.41, stdev=57.27 clat percentiles (msec): | 1.00th=[ 40], 5.00th=[ 48], 10.00th=[ 54], 20.00th=[ 64], | 30.00th=[ 73], 40.00th=[ 81], 50.00th=[ 88], 60.00th=[ 100], | 70.00th=[ 115], 80.00th=[ 142], 90.00th=[ 194], 95.00th=[ 220], | 99.00th=[ 309], 99.50th=[ 359], 99.90th=[ 439], 99.95th=[ 439], | 99.99th=[ 439] bw ( KiB/s): min= 30, max= 224, per=27.43%, avg=117.41, stdev=58.14, samples=106 iops : min= 1, max= 14, avg= 6.58, stdev= 3.77, samples=106 lat (msec) : 10=4.43%, 20=20.31%, 50=18.88%, 100=33.85%, 250=21.09% lat (msec) : 500=1.43% cpu : usr=0.05%, sys=1.38%, ctx=1315, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144468: Sat Sep 12 23:20:58 2026 read: IOPS=6, BW=105KiB/s (108kB/s)(5744KiB/54682msec) clat (msec): min=5, max=168, avg=32.48, stdev=32.50 lat (msec): min=5, max=168, avg=32.49, stdev=32.50 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 10], 20.00th=[ 12], | 30.00th=[ 14], 40.00th=[ 16], 50.00th=[ 20], 60.00th=[ 24], | 70.00th=[ 29], 80.00th=[ 51], 90.00th=[ 82], 95.00th=[ 110], | 99.00th=[ 159], 99.50th=[ 167], 99.90th=[ 169], 99.95th=[ 169], | 99.99th=[ 169] bw ( KiB/s): min= 28, max= 383, per=28.52%, avg=114.92, stdev=78.90, samples=98 iops : min= 1, max= 23, avg= 6.45, stdev= 4.98, samples=98 write: IOPS=7, BW=120KiB/s (123kB/s)(6544KiB/54682msec); 0 zone resets clat (msec): min=29, max=331, avg=104.90, stdev=55.14 lat (msec): min=29, max=331, avg=104.90, stdev=55.13 clat percentiles (msec): | 1.00th=[ 36], 5.00th=[ 47], 10.00th=[ 52], 20.00th=[ 62], | 30.00th=[ 70], 40.00th=[ 80], 50.00th=[ 89], 60.00th=[ 102], | 70.00th=[ 120], 80.00th=[ 144], 90.00th=[ 180], 95.00th=[ 218], | 99.00th=[ 279], 99.50th=[ 313], 99.90th=[ 334], 99.95th=[ 334], | 99.99th=[ 334] bw ( KiB/s): min= 30, max= 288, per=28.13%, avg=120.41, stdev=59.78, samples=107 iops : min= 1, max= 18, avg= 6.78, stdev= 3.88, samples=107 lat (msec) : 10=6.25%, 20=19.14%, 50=16.28%, 100=33.46%, 250=23.05% lat (msec) : 500=1.82% cpu : usr=0.04%, sys=1.25%, ctx=1277, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 5 (file:backend.c:481, func=full resid, error=Input/output error): pid=144469: Sat Sep 12 23:20:58 2026 read: IOPS=6, BW=105KiB/s (107kB/s)(4384KiB/41795msec) clat (msec): min=6, max=319, avg=36.61, stdev=38.61 lat (msec): min=6, max=319, avg=36.62, stdev=38.61 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 10], 10.00th=[ 11], 20.00th=[ 13], | 30.00th=[ 16], 40.00th=[ 18], 50.00th=[ 23], 60.00th=[ 28], | 70.00th=[ 34], 80.00th=[ 52], 90.00th=[ 81], 95.00th=[ 132], | 99.00th=[ 171], 99.50th=[ 180], 99.90th=[ 321], 99.95th=[ 321], | 99.99th=[ 321] bw ( KiB/s): min= 30, max= 352, per=27.92%, avg=112.51, stdev=82.05, samples=75 iops : min= 1, max= 22, avg= 6.25, stdev= 5.25, samples=75 write: IOPS=6, BW=101KiB/s (104kB/s)(4240KiB/41795msec); 0 zone resets clat (msec): min=38, max=354, avg=118.87, stdev=63.58 lat (msec): min=38, max=354, avg=118.87, stdev=63.58 clat percentiles (msec): | 1.00th=[ 43], 5.00th=[ 51], 10.00th=[ 56], 20.00th=[ 64], | 30.00th=[ 74], 40.00th=[ 83], 50.00th=[ 96], 60.00th=[ 113], | 70.00th=[ 146], 80.00th=[ 174], 90.00th=[ 207], 95.00th=[ 243], | 99.00th=[ 321], 99.50th=[ 330], 99.90th=[ 355], 99.95th=[ 355], | 99.99th=[ 355] bw ( KiB/s): min= 31, max= 224, per=23.97%, avg=102.59, stdev=55.75, samples=81 iops : min= 1, max= 14, avg= 5.62, stdev= 3.62, samples=81 lat (msec) : 10=3.15%, 20=18.52%, 50=21.11%, 100=29.81%, 250=25.37% lat (msec) : 500=1.85% cpu : usr=0.03%, sys=1.37%, ctx=929, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=275,265,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144470: Sat Sep 12 23:20:58 2026 read: IOPS=6, BW=112KiB/s (114kB/s)(6032KiB/53999msec) clat (msec): min=5, max=296, avg=30.74, stdev=33.65 lat (msec): min=5, max=296, avg=30.75, stdev=33.65 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 10], 20.00th=[ 12], | 30.00th=[ 13], 40.00th=[ 15], 50.00th=[ 18], 60.00th=[ 24], | 70.00th=[ 31], 80.00th=[ 43], 90.00th=[ 67], 95.00th=[ 95], | 99.00th=[ 184], 99.50th=[ 211], 99.90th=[ 296], 99.95th=[ 296], | 99.99th=[ 296] bw ( KiB/s): min= 30, max= 383, per=30.93%, avg=124.65, stdev=81.47, samples=94 iops : min= 1, max= 23, avg= 7.04, stdev= 5.14, samples=94 write: IOPS=7, BW=116KiB/s (119kB/s)(6256KiB/53999msec); 0 zone resets clat (msec): min=30, max=346, avg=108.02, stdev=55.52 lat (msec): min=30, max=346, avg=108.03, stdev=55.52 clat percentiles (msec): | 1.00th=[ 34], 5.00th=[ 50], 10.00th=[ 56], 20.00th=[ 66], | 30.00th=[ 73], 40.00th=[ 82], 50.00th=[ 92], 60.00th=[ 105], | 70.00th=[ 121], 80.00th=[ 146], 90.00th=[ 188], 95.00th=[ 218], | 99.00th=[ 296], 99.50th=[ 347], 99.90th=[ 347], 99.95th=[ 347], | 99.99th=[ 347] bw ( KiB/s): min= 31, max= 252, per=27.18%, avg=116.31, stdev=57.23, samples=105 iops : min= 1, max= 15, avg= 6.50, stdev= 3.73, samples=105 lat (msec) : 10=7.16%, 20=19.40%, 50=17.32%, 100=32.81%, 250=21.88% lat (msec) : 500=1.43% cpu : usr=0.04%, sys=1.39%, ctx=1334, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=404KiB/s (413kB/s), 105KiB/s-112KiB/s (107kB/s-114kB/s), io=21.6MiB (22.6MB), run=41795-54682msec WRITE: bw=428KiB/s (438kB/s), 101KiB/s-120KiB/s (104kB/s-123kB/s), io=22.9MiB (23.0MB), run=41795-54682msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144484: Sat Sep 12 23:21:10 2026 read: IOPS=1, BW=1729KiB/s (1770kB/s)(7168KiB/4146msec) clat (usec): min=580, max=1938.3k, avg=369796.77, stdev=694728.75 lat (usec): min=580, max=1938.4k, avg=369798.17, stdev=694729.33 clat percentiles (usec): | 1.00th=[ 578], 5.00th=[ 578], 10.00th=[ 578], | 20.00th=[ 76022], 30.00th=[ 101188], 40.00th=[ 101188], | 50.00th=[ 121111], 60.00th=[ 133694], 70.00th=[ 133694], | 80.00th=[ 217056], 90.00th=[1937769], 95.00th=[1937769], | 99.00th=[1937769], 99.50th=[1937769], 99.90th=[1937769], | 99.95th=[1937769], 99.99th=[1937769] bw ( KiB/s): min= 4063, max= 6059, per=100.00%, avg=5061.00, stdev=1411.39, samples=2 iops : min= 3, max= 5, avg= 4.00, stdev= 1.41, samples=2 write: IOPS=1, BW=1235KiB/s (1265kB/s)(5120KiB/4146msec); 0 zone resets clat (msec): min=125, max=375, avg=269.22, stdev=91.03 lat (msec): min=125, max=375, avg=269.30, stdev=91.02 clat percentiles (msec): | 1.00th=[ 126], 5.00th=[ 126], 10.00th=[ 126], 20.00th=[ 126], | 30.00th=[ 259], 40.00th=[ 259], 50.00th=[ 288], 60.00th=[ 288], | 70.00th=[ 300], 80.00th=[ 300], 90.00th=[ 376], 95.00th=[ 376], | 99.00th=[ 376], 99.50th=[ 376], 99.90th=[ 376], 99.95th=[ 376], | 99.99th=[ 376] bw ( KiB/s): min= 2019, max= 3886, per=49.09%, avg=2952.50, stdev=1320.17, samples=2 iops : min= 1, max= 3, avg= 2.00, stdev= 1.41, samples=2 lat (usec) : 750=8.33% lat (msec) : 100=8.33%, 250=41.67%, 500=33.33%, 2000=8.33% cpu : usr=0.00%, sys=13.51%, ctx=546, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144485: Sat Sep 12 23:21:10 2026 read: IOPS=0, BW=430KiB/s (440kB/s)(2048KiB/4766msec) clat (usec): min=581, max=189900, avg=95240.92, stdev=133868.68 lat (usec): min=582, max=189904, avg=95243.20, stdev=133870.91 clat percentiles (usec): | 1.00th=[ 578], 5.00th=[ 578], 10.00th=[ 578], 20.00th=[ 578], | 30.00th=[ 578], 40.00th=[ 578], 50.00th=[ 578], 60.00th=[189793], | 70.00th=[189793], 80.00th=[189793], 90.00th=[189793], 95.00th=[189793], | 99.00th=[189793], 99.50th=[189793], 99.90th=[189793], 99.95th=[189793], | 99.99th=[189793] bw ( KiB/s): min= 1914, max= 1943, per=44.88%, avg=1928.50, stdev=20.51, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2149KiB/s (2200kB/s)(10.0MiB/4766msec); 0 zone resets clat (msec): min=138, max=2041, avg=441.06, stdev=577.21 lat (msec): min=138, max=2041, avg=441.24, stdev=577.18 clat percentiles (msec): | 1.00th=[ 140], 5.00th=[ 140], 10.00th=[ 140], 20.00th=[ 153], | 30.00th=[ 169], 40.00th=[ 190], 50.00th=[ 228], 60.00th=[ 239], | 70.00th=[ 326], 80.00th=[ 359], 90.00th=[ 575], 95.00th=[ 2039], | 99.00th=[ 2039], 99.50th=[ 2039], 99.90th=[ 2039], 99.95th=[ 2039], | 99.99th=[ 2039] bw ( KiB/s): min= 1943, max= 5720, per=58.97%, avg=3546.80, stdev=1604.15, samples=5 iops : min= 1, max= 5, avg= 2.60, stdev= 1.67, samples=5 lat (usec) : 750=8.33% lat (msec) : 250=58.33%, 500=16.67%, 750=8.33%, >=2000=8.33% cpu : usr=0.04%, sys=15.09%, ctx=274, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144486: Sat Sep 12 23:21:10 2026 read: IOPS=1, BW=1463KiB/s (1498kB/s)(6144KiB/4200msec) clat (usec): min=447, max=263666, avg=99625.67, stdev=115742.49 lat (usec): min=449, max=263668, avg=99626.96, stdev=115742.41 clat percentiles (usec): | 1.00th=[ 449], 5.00th=[ 449], 10.00th=[ 449], 20.00th=[ 486], | 30.00th=[ 486], 40.00th=[ 668], 50.00th=[ 668], 60.00th=[137364], | 70.00th=[196084], 80.00th=[196084], 90.00th=[263193], 95.00th=[263193], | 99.00th=[263193], 99.50th=[263193], 99.90th=[263193], 99.95th=[263193], | 99.99th=[263193] bw ( KiB/s): min= 1906, max= 6095, per=77.14%, avg=3314.67, stdev=2407.91, samples=3 iops : min= 1, max= 5, avg= 2.33, stdev= 2.31, samples=3 write: IOPS=1, BW=1463KiB/s (1498kB/s)(6144KiB/4200msec); 0 zone resets clat (msec): min=162, max=2218, avg=591.82, stdev=803.23 lat (msec): min=162, max=2218, avg=591.93, stdev=803.22 clat percentiles (msec): | 1.00th=[ 163], 5.00th=[ 163], 10.00th=[ 163], 20.00th=[ 167], | 30.00th=[ 167], 40.00th=[ 266], 50.00th=[ 266], 60.00th=[ 296], | 70.00th=[ 439], 80.00th=[ 439], 90.00th=[ 2232], 95.00th=[ 2232], | 99.00th=[ 2232], 99.50th=[ 2232], 99.90th=[ 2232], 99.95th=[ 2232], | 99.99th=[ 2232] bw ( KiB/s): min= 1943, max= 4063, per=53.48%, avg=3216.67, stdev=1122.75, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 lat (usec) : 500=16.67%, 750=8.33% lat (msec) : 250=33.33%, 500=33.33%, >=2000=8.33% cpu : usr=0.00%, sys=9.31%, ctx=189, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144487: Sat Sep 12 23:21:10 2026 read: IOPS=1, BW=1141KiB/s (1168kB/s)(5120KiB/4487msec) clat (usec): min=458, max=287326, avg=59260.25, stdev=127504.83 lat (usec): min=459, max=287327, avg=59261.22, stdev=127504.80 clat percentiles (usec): | 1.00th=[ 457], 5.00th=[ 457], 10.00th=[ 457], 20.00th=[ 457], | 30.00th=[ 1549], 40.00th=[ 1549], 50.00th=[ 1876], 60.00th=[ 1876], | 70.00th=[ 5080], 80.00th=[ 5080], 90.00th=[287310], 95.00th=[287310], | 99.00th=[287310], 99.50th=[287310], 99.90th=[287310], 99.95th=[287310], | 99.99th=[287310] bw ( KiB/s): min= 7772, max= 7772, per=100.00%, avg=7772.00, stdev= 0.00, samples=1 iops : min= 7, max= 7, avg= 7.00, stdev= 0.00, samples=1 write: IOPS=1, BW=1598KiB/s (1636kB/s)(7168KiB/4487msec); 0 zone resets clat (msec): min=80, max=2096, avg=584.16, stdev=731.07 lat (msec): min=80, max=2096, avg=584.24, stdev=731.07 clat percentiles (msec): | 1.00th=[ 81], 5.00th=[ 81], 10.00th=[ 81], 20.00th=[ 197], | 30.00th=[ 209], 40.00th=[ 209], 50.00th=[ 215], 60.00th=[ 309], | 70.00th=[ 309], 80.00th=[ 986], 90.00th=[ 2089], 95.00th=[ 2089], | 99.00th=[ 2089], 99.50th=[ 2089], 99.90th=[ 2089], 99.95th=[ 2089], | 99.99th=[ 2089] bw ( KiB/s): min= 1906, max= 4063, per=44.27%, avg=2662.67, stdev=1214.04, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (usec) : 500=8.33% lat (msec) : 2=16.67%, 10=8.33%, 100=8.33%, 250=25.00%, 500=16.67% lat (msec) : 1000=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=10.79%, ctx=131, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4297KiB/s (4400kB/s), 430KiB/s-1729KiB/s (440kB/s-1770kB/s), io=20.0MiB (20.0MB), run=4146-4766msec WRITE: bw=6016KiB/s (6160kB/s), 1235KiB/s-2149KiB/s (1265kB/s-2200kB/s), io=28.0MiB (29.4MB), run=4146-4766msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144489: Sat Sep 12 23:21:11 2026 read: IOPS=1, BW=1236KiB/s (1266kB/s)(7168KiB/5800msec) clat (msec): min=69, max=1710, avg=618.96, stdev=595.52 lat (msec): min=69, max=1710, avg=618.96, stdev=595.52 clat percentiles (msec): | 1.00th=[ 70], 5.00th=[ 70], 10.00th=[ 70], 20.00th=[ 102], | 30.00th=[ 201], 40.00th=[ 201], 50.00th=[ 477], 60.00th=[ 776], | 70.00th=[ 776], 80.00th=[ 1003], 90.00th=[ 1703], 95.00th=[ 1703], | 99.00th=[ 1703], 99.50th=[ 1703], 99.90th=[ 1703], 99.95th=[ 1703], | 99.99th=[ 1703] bw ( KiB/s): min= 1921, max= 2000, per=55.92%, avg=1974.60, stdev=31.65, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 write: IOPS=0, BW=883KiB/s (904kB/s)(5120KiB/5800msec); 0 zone resets clat (msec): min=107, max=427, avg=226.89, stdev=121.90 lat (msec): min=107, max=428, avg=226.98, stdev=121.89 clat percentiles (msec): | 1.00th=[ 108], 5.00th=[ 108], 10.00th=[ 108], 20.00th=[ 108], | 30.00th=[ 176], 40.00th=[ 176], 50.00th=[ 184], 60.00th=[ 184], | 70.00th=[ 241], 80.00th=[ 241], 90.00th=[ 430], 95.00th=[ 430], | 99.00th=[ 430], 99.50th=[ 430], 99.90th=[ 430], 99.95th=[ 430], | 99.99th=[ 430] bw ( KiB/s): min= 2011, max= 4000, per=60.80%, avg=3005.50, stdev=1406.44, samples=2 iops : min= 1, max= 3, avg= 2.00, stdev= 1.41, samples=2 lat (msec) : 100=8.33%, 250=50.00%, 500=16.67%, 1000=8.33%, 2000=16.67% cpu : usr=0.00%, sys=2.40%, ctx=64, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144490: Sat Sep 12 23:21:11 2026 read: IOPS=0, BW=376KiB/s (385kB/s)(2048KiB/5447msec) clat (msec): min=143, max=226, avg=184.87, stdev=59.18 lat (msec): min=143, max=226, avg=184.88, stdev=59.18 clat percentiles (msec): | 1.00th=[ 144], 5.00th=[ 144], 10.00th=[ 144], 20.00th=[ 144], | 30.00th=[ 144], 40.00th=[ 144], 50.00th=[ 144], 60.00th=[ 228], | 70.00th=[ 228], 80.00th=[ 228], 90.00th=[ 228], 95.00th=[ 228], | 99.00th=[ 228], 99.50th=[ 228], 99.90th=[ 228], 99.95th=[ 228], | 99.99th=[ 228] bw ( KiB/s): min= 1376, max= 1980, per=47.52%, avg=1678.00, stdev=427.09, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1880KiB/s (1925kB/s)(10.0MiB/5447msec); 0 zone resets clat (msec): min=156, max=2070, avg=474.71, stdev=575.04 lat (msec): min=156, max=2071, avg=475.09, stdev=575.23 clat percentiles (msec): | 1.00th=[ 157], 5.00th=[ 157], 10.00th=[ 157], 20.00th=[ 163], | 30.00th=[ 165], 40.00th=[ 224], 50.00th=[ 288], 60.00th=[ 334], | 70.00th=[ 351], 80.00th=[ 489], 90.00th=[ 514], 95.00th=[ 2072], | 99.00th=[ 2072], 99.50th=[ 2072], 99.90th=[ 2072], 99.95th=[ 2072], | 99.99th=[ 2072] bw ( KiB/s): min= 1976, max= 4000, per=60.15%, avg=2973.00, stdev=1054.62, samples=6 iops : min= 1, max= 3, avg= 2.17, stdev= 0.98, samples=6 lat (msec) : 250=50.00%, 500=33.33%, 750=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=4.24%, ctx=95, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144491: Sat Sep 12 23:21:11 2026 read: IOPS=1, BW=1111KiB/s (1137kB/s)(6144KiB/5532msec) clat (msec): min=134, max=428, avg=250.36, stdev=138.08 lat (msec): min=134, max=428, avg=250.36, stdev=138.08 clat percentiles (msec): | 1.00th=[ 136], 5.00th=[ 136], 10.00th=[ 136], 20.00th=[ 157], | 30.00th=[ 157], 40.00th=[ 165], 50.00th=[ 165], 60.00th=[ 192], | 70.00th=[ 426], 80.00th=[ 426], 90.00th=[ 430], 95.00th=[ 430], | 99.00th=[ 430], 99.50th=[ 430], 99.90th=[ 430], 99.95th=[ 430], | 99.99th=[ 430] bw ( KiB/s): min= 1917, max= 4023, per=70.25%, avg=2480.50, stdev=1029.80, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 write: IOPS=1, BW=1111KiB/s (1137kB/s)(6144KiB/5532msec); 0 zone resets clat (msec): min=92, max=2368, avg=642.43, stdev=852.19 lat (msec): min=92, max=2368, avg=642.56, stdev=852.16 clat percentiles (msec): | 1.00th=[ 93], 5.00th=[ 93], 10.00th=[ 93], 20.00th=[ 309], | 30.00th=[ 309], 40.00th=[ 351], 50.00th=[ 351], 60.00th=[ 363], | 70.00th=[ 372], 80.00th=[ 372], 90.00th=[ 2366], 95.00th=[ 2366], | 99.00th=[ 2366], 99.50th=[ 2366], 99.90th=[ 2366], 99.95th=[ 2366], | 99.99th=[ 2366] bw ( KiB/s): min= 1939, max= 4055, per=50.64%, avg=2503.25, stdev=1035.40, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (msec) : 100=8.33%, 250=33.33%, 500=50.00%, >=2000=8.33% cpu : usr=0.02%, sys=3.27%, ctx=75, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144492: Sat Sep 12 23:21:11 2026 read: IOPS=0, BW=924KiB/s (946kB/s)(5120KiB/5544msec) clat (msec): min=53, max=500, avg=272.39, stdev=193.65 lat (msec): min=53, max=500, avg=272.39, stdev=193.65 clat percentiles (msec): | 1.00th=[ 54], 5.00th=[ 54], 10.00th=[ 54], 20.00th=[ 54], | 30.00th=[ 163], 40.00th=[ 163], 50.00th=[ 197], 60.00th=[ 197], | 70.00th=[ 451], 80.00th=[ 451], 90.00th=[ 502], 95.00th=[ 502], | 99.00th=[ 502], 99.50th=[ 502], 99.90th=[ 502], 99.95th=[ 502], | 99.99th=[ 502] bw ( KiB/s): min= 1921, max= 3961, per=74.51%, avg=2631.00, stdev=1152.69, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 write: IOPS=1, BW=1293KiB/s (1324kB/s)(7168KiB/5544msec); 0 zone resets clat (msec): min=169, max=2221, avg=551.30, stdev=739.84 lat (msec): min=169, max=2221, avg=551.41, stdev=739.87 clat percentiles (msec): | 1.00th=[ 169], 5.00th=[ 169], 10.00th=[ 169], 20.00th=[ 224], | 30.00th=[ 234], 40.00th=[ 234], 50.00th=[ 313], 60.00th=[ 330], | 70.00th=[ 330], 80.00th=[ 372], 90.00th=[ 2232], 95.00th=[ 2232], | 99.00th=[ 2232], 99.50th=[ 2232], 99.90th=[ 2232], 99.95th=[ 2232], | 99.99th=[ 2232] bw ( KiB/s): min= 1400, max= 4000, per=57.02%, avg=2818.50, stdev=1354.09, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 1.15, samples=4 lat (msec) : 100=8.33%, 250=41.67%, 500=33.33%, 750=8.33%, >=2000=8.33% cpu : usr=0.02%, sys=3.72%, ctx=94, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3531KiB/s (3616kB/s), 376KiB/s-1236KiB/s (385kB/s-1266kB/s), io=20.0MiB (20.0MB), run=5447-5800msec WRITE: bw=4943KiB/s (5062kB/s), 883KiB/s-1880KiB/s (904kB/s-1925kB/s), io=28.0MiB (29.4MB), run=5447-5800msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144503: Sat Sep 12 23:21:23 2026 read: IOPS=1, BW=4947KiB/s (5066kB/s)(12.0MiB/2484msec) clat (msec): min=716, max=897, avg=795.16, stdev=92.65 lat (msec): min=716, max=897, avg=795.16, stdev=92.65 clat percentiles (msec): | 1.00th=[ 718], 5.00th=[ 718], 10.00th=[ 718], 20.00th=[ 718], | 30.00th=[ 718], 40.00th=[ 776], 50.00th=[ 776], 60.00th=[ 776], | 70.00th=[ 894], 80.00th=[ 894], 90.00th=[ 894], 95.00th=[ 894], | 99.00th=[ 894], 99.50th=[ 894], 99.90th=[ 894], 99.95th=[ 894], | 99.99th=[ 894] bw ( KiB/s): min= 7953, max= 8047, per=100.00%, avg=8000.00, stdev=66.47, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 1000=66.67% cpu : usr=0.00%, sys=13.89%, ctx=435, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144504: Sat Sep 12 23:21:23 2026 read: IOPS=0, BW=1232KiB/s (1261kB/s)(4096KiB/3325msec) clat (nsec): min=761093k, max=761093k, avg=761092932.00, stdev= 0.00 lat (nsec): min=761095k, max=761095k, avg=761095175.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 760], 5.00th=[ 760], 10.00th=[ 760], 20.00th=[ 760], | 30.00th=[ 760], 40.00th=[ 760], 50.00th=[ 760], 60.00th=[ 760], | 70.00th=[ 760], 80.00th=[ 760], 90.00th=[ 760], 95.00th=[ 760], | 99.00th=[ 760], 99.50th=[ 760], 99.90th=[ 760], 99.95th=[ 760], | 99.99th=[ 760] bw ( KiB/s): min= 8047, max= 8047, per=100.00%, avg=8047.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2464KiB/s (2523kB/s)(8192KiB/3325msec); 0 zone resets clat (msec): min=597, max=1774, avg=1186.12, stdev=832.14 lat (msec): min=598, max=1775, avg=1186.92, stdev=832.26 clat percentiles (msec): | 1.00th=[ 600], 5.00th=[ 600], 10.00th=[ 600], 20.00th=[ 600], | 30.00th=[ 600], 40.00th=[ 600], 50.00th=[ 600], 60.00th=[ 1770], | 70.00th=[ 1770], 80.00th=[ 1770], 90.00th=[ 1770], 95.00th=[ 1770], | 99.00th=[ 1770], 99.50th=[ 1770], 99.90th=[ 1770], 99.95th=[ 1770], | 99.99th=[ 1770] bw ( KiB/s): min= 8110, max= 8110, per=82.29%, avg=8110.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=5.51%, ctx=241, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144505: Sat Sep 12 23:21:23 2026 write: IOPS=0, BW=4069KiB/s (4167kB/s)(12.0MiB/3020msec); 0 zone resets clat (msec): min=296, max=1363, avg=934.54, stdev=563.58 lat (msec): min=296, max=1365, avg=935.62, stdev=564.37 clat percentiles (msec): | 1.00th=[ 296], 5.00th=[ 296], 10.00th=[ 296], 20.00th=[ 296], | 30.00th=[ 296], 40.00th=[ 1150], 50.00th=[ 1150], 60.00th=[ 1150], | 70.00th=[ 1368], 80.00th=[ 1368], 90.00th=[ 1368], 95.00th=[ 1368], | 99.00th=[ 1368], 99.50th=[ 1368], 99.90th=[ 1368], 99.95th=[ 1368], | 99.99th=[ 1368] bw ( KiB/s): min= 7876, max= 8031, per=80.71%, avg=7953.50, stdev=109.60, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.00%, sys=4.54%, ctx=57, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144506: Sat Sep 12 23:21:23 2026 write: IOPS=1, BW=4633KiB/s (4745kB/s)(12.0MiB/2652msec); 0 zone resets clat (msec): min=343, max=1182, avg=845.55, stdev=442.88 lat (msec): min=344, max=1182, avg=846.40, stdev=443.12 clat percentiles (msec): | 1.00th=[ 342], 5.00th=[ 342], 10.00th=[ 342], 20.00th=[ 342], | 30.00th=[ 342], 40.00th=[ 1011], 50.00th=[ 1011], 60.00th=[ 1011], | 70.00th=[ 1183], 80.00th=[ 1183], 90.00th=[ 1183], 95.00th=[ 1183], | 99.00th=[ 1183], 99.50th=[ 1183], 99.90th=[ 1183], 99.95th=[ 1183], | 99.99th=[ 1183] bw ( KiB/s): min= 7876, max= 7876, per=79.92%, avg=7876.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.00%, sys=4.53%, ctx=55, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4928KiB/s (5046kB/s), 1232KiB/s-4947KiB/s (1261kB/s-5066kB/s), io=16.0MiB (16.8MB), run=2484-3325msec WRITE: bw=9855KiB/s (10.1MB/s), 2464KiB/s-4633KiB/s (2523kB/s-4745kB/s), io=32.0MiB (33.6MB), run=2652-3325msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144498: Sat Sep 12 23:21:23 2026 read: IOPS=1, BW=5697KiB/s (5834kB/s)(12.0MiB/2157msec) clat (msec): min=421, max=1172, avg=685.77, stdev=422.41 lat (msec): min=421, max=1172, avg=685.78, stdev=422.41 clat percentiles (msec): | 1.00th=[ 422], 5.00th=[ 422], 10.00th=[ 422], 20.00th=[ 422], | 30.00th=[ 422], 40.00th=[ 464], 50.00th=[ 464], 60.00th=[ 464], | 70.00th=[ 1167], 80.00th=[ 1167], 90.00th=[ 1167], 95.00th=[ 1167], | 99.00th=[ 1167], 99.50th=[ 1167], 99.90th=[ 1167], 99.95th=[ 1167], | 99.99th=[ 1167] bw ( KiB/s): min= 6470, max= 7953, per=99.40%, avg=7211.50, stdev=1048.64, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=66.67%, 2000=33.33% cpu : usr=0.00%, sys=5.10%, ctx=67, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144499: Sat Sep 12 23:21:23 2026 read: IOPS=0, BW=1814KiB/s (1858kB/s)(4096KiB/2258msec) clat (nsec): min=275839k, max=275839k, avg=275838599.00, stdev= 0.00 lat (nsec): min=275841k, max=275841k, avg=275841369.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 275], 5.00th=[ 275], 10.00th=[ 275], 20.00th=[ 275], | 30.00th=[ 275], 40.00th=[ 275], 50.00th=[ 275], 60.00th=[ 275], | 70.00th=[ 275], 80.00th=[ 275], 90.00th=[ 275], 95.00th=[ 275], | 99.00th=[ 275], 99.50th=[ 275], 99.90th=[ 275], 99.95th=[ 275], | 99.99th=[ 275] bw ( KiB/s): min= 6370, max= 6370, per=87.80%, avg=6370.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=3628KiB/s (3715kB/s)(8192KiB/2258msec); 0 zone resets clat (msec): min=787, max=1130, avg=958.55, stdev=242.53 lat (msec): min=787, max=1130, avg=959.11, stdev=242.33 clat percentiles (msec): | 1.00th=[ 785], 5.00th=[ 785], 10.00th=[ 785], 20.00th=[ 785], | 30.00th=[ 785], 40.00th=[ 785], 50.00th=[ 785], 60.00th=[ 1133], | 70.00th=[ 1133], 80.00th=[ 1133], 90.00th=[ 1133], 95.00th=[ 1133], | 99.00th=[ 1133], 99.50th=[ 1133], 99.90th=[ 1133], 99.95th=[ 1133], | 99.99th=[ 1133] bw ( KiB/s): min= 7953, max= 7953, per=83.23%, avg=7953.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=6.91%, ctx=59, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144500: Sat Sep 12 23:21:23 2026 write: IOPS=0, BW=3584KiB/s (3670kB/s)(12.0MiB/3429msec); 0 zone resets clat (msec): min=296, max=1907, avg=1109.79, stdev=805.70 lat (msec): min=300, max=1908, avg=1111.41, stdev=803.85 clat percentiles (msec): | 1.00th=[ 296], 5.00th=[ 296], 10.00th=[ 296], 20.00th=[ 296], | 30.00th=[ 296], 40.00th=[ 1133], 50.00th=[ 1133], 60.00th=[ 1133], | 70.00th=[ 1905], 80.00th=[ 1905], 90.00th=[ 1905], 95.00th=[ 1905], | 99.00th=[ 1905], 99.50th=[ 1905], 99.90th=[ 1905], 99.95th=[ 1905], | 99.99th=[ 1905] bw ( KiB/s): min= 8094, max= 8159, per=85.04%, avg=8126.50, stdev=45.96, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.00%, sys=3.56%, ctx=50, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144501: Sat Sep 12 23:21:23 2026 write: IOPS=1, BW=4882KiB/s (4999kB/s)(12.0MiB/2517msec); 0 zone resets clat (msec): min=397, max=1280, avg=793.85, stdev=448.62 lat (msec): min=398, max=1282, avg=794.62, stdev=448.81 clat percentiles (msec): | 1.00th=[ 397], 5.00th=[ 397], 10.00th=[ 397], 20.00th=[ 397], | 30.00th=[ 397], 40.00th=[ 701], 50.00th=[ 701], 60.00th=[ 701], | 70.00th=[ 1284], 80.00th=[ 1284], 90.00th=[ 1284], 95.00th=[ 1284], | 99.00th=[ 1284], 99.50th=[ 1284], 99.90th=[ 1284], 99.95th=[ 1284], | 99.99th=[ 1284] bw ( KiB/s): min= 7353, max= 8000, per=80.33%, avg=7676.50, stdev=457.50, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.00%, sys=3.97%, ctx=44, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=7256KiB/s (7430kB/s), 1814KiB/s-5697KiB/s (1858kB/s-5834kB/s), io=16.0MiB (16.8MB), run=2157-2258msec WRITE: bw=9556KiB/s (9785kB/s), 3584KiB/s-4882KiB/s (3670kB/s-4999kB/s), io=32.0MiB (33.6MB), run=2258-3429msec