== sanity test 398b: DIO and buffer IO race ============== 22:50:50 (1789267850) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 6.63513 s, 7.6 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=150479: Sat Sep 12 22:53:43 2026 read: IOPS=9, BW=39.6KiB/s (40.5kB/s)(5992KiB/151418msec) clat (usec): min=33, max=559706, avg=48625.82, stdev=40449.10 lat (usec): min=33, max=559707, avg=48635.15, stdev=40453.83 clat percentiles (usec): | 1.00th=[ 49], 5.00th=[ 60], 10.00th=[ 124], 20.00th=[ 21103], | 30.00th=[ 27132], 40.00th=[ 33424], 50.00th=[ 39584], 60.00th=[ 47973], | 70.00th=[ 58459], 80.00th=[ 72877], 90.00th=[ 95945], 95.00th=[117965], | 99.00th=[175113], 99.50th=[225444], 99.90th=[362808], 99.95th=[557843], | 99.99th=[557843] bw ( KiB/s): min= 7, max= 100, per=25.31%, avg=39.74, stdev=19.32, samples=292 iops : min= 1, max= 25, avg= 9.28, stdev= 4.85, samples=292 write: IOPS=10, BW=41.6KiB/s (42.6kB/s)(6296KiB/151418msec); 0 zone resets clat (usec): min=826, max=1076.0k, avg=49614.83, stdev=62943.73 lat (usec): min=828, max=1076.0k, avg=49617.47, stdev=62943.40 clat percentiles (usec): | 1.00th=[ 1037], 5.00th=[ 1188], 10.00th=[ 1369], | 20.00th=[ 3589], 30.00th=[ 7701], 40.00th=[ 19006], | 50.00th=[ 33424], 60.00th=[ 47973], 70.00th=[ 65799], | 80.00th=[ 84411], 90.00th=[ 117965], 95.00th=[ 143655], | 99.00th=[ 274727], 99.50th=[ 312476], 99.90th=[ 843056], | 99.95th=[1082131], 99.99th=[1082131] bw ( KiB/s): min= 7, max= 104, per=25.27%, avg=41.44, stdev=21.06, samples=294 iops : min= 1, max= 26, avg= 9.70, stdev= 5.30, samples=294 lat (usec) : 50=0.52%, 100=4.20%, 250=0.36%, 500=0.03%, 750=0.03% lat (usec) : 1000=0.33% lat (msec) : 2=7.10%, 4=3.55%, 10=6.45%, 20=7.62%, 50=31.45% lat (msec) : 100=26.79%, 250=10.81%, 500=0.68%, 750=0.03%, 1000=0.03% lat (msec) : 2000=0.03% cpu : usr=0.07%, sys=4.19%, ctx=6285, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=150480: Sat Sep 12 22:53:43 2026 read: IOPS=9, BW=39.0KiB/s (39.0kB/s)(5940KiB/152224msec) clat (usec): min=26, max=320057, avg=48043.01, stdev=38663.75 lat (usec): min=26, max=320058, avg=48045.21, stdev=38662.87 clat percentiles (usec): | 1.00th=[ 48], 5.00th=[ 60], 10.00th=[ 277], 20.00th=[ 21365], | 30.00th=[ 27132], 40.00th=[ 32113], 50.00th=[ 40109], 60.00th=[ 47449], | 70.00th=[ 56886], 80.00th=[ 72877], 90.00th=[ 96994], 95.00th=[114820], | 99.00th=[177210], 99.50th=[235930], 99.90th=[295699], 99.95th=[320865], | 99.99th=[320865] bw ( KiB/s): min= 7, max= 103, per=25.12%, avg=39.43, stdev=19.74, samples=292 iops : min= 1, max= 25, avg= 9.20, stdev= 4.98, samples=292 write: IOPS=10, BW=41.7KiB/s (42.7kB/s)(6348KiB/152224msec); 0 zone resets clat (usec): min=774, max=1197.6k, avg=50685.18, stdev=65007.99 lat (usec): min=775, max=1197.6k, avg=50687.13, stdev=65007.78 clat percentiles (usec): | 1.00th=[ 1057], 5.00th=[ 1221], 10.00th=[ 1713], | 20.00th=[ 4752], 30.00th=[ 10290], 40.00th=[ 23987], | 50.00th=[ 36963], 60.00th=[ 49021], 70.00th=[ 64750], | 80.00th=[ 83362], 90.00th=[ 115868], 95.00th=[ 147850], | 99.00th=[ 242222], 99.50th=[ 320865], 99.90th=[ 968885], | 99.95th=[1199571], 99.99th=[1199571] bw ( KiB/s): min= 7, max= 135, per=25.37%, avg=41.60, stdev=20.59, samples=295 iops : min= 1, max= 33, avg= 9.75, stdev= 5.18, samples=295 lat (usec) : 50=0.59%, 100=3.91%, 250=0.29%, 500=0.13%, 750=0.10% lat (usec) : 1000=0.16% lat (msec) : 2=6.12%, 4=3.61%, 10=5.86%, 20=7.75%, 50=33.50% lat (msec) : 100=26.40%, 250=10.97%, 500=0.52%, 750=0.03%, 1000=0.03% lat (msec) : 2000=0.03% cpu : usr=0.06%, sys=4.18%, ctx=6320, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=150481: Sat Sep 12 22:53:43 2026 read: IOPS=9, BW=39.4KiB/s (40.4kB/s)(6028KiB/152825msec) clat (usec): min=28, max=1067.9k, avg=49491.25, stdev=47943.65 lat (usec): min=28, max=1067.9k, avg=49494.71, stdev=47942.63 clat percentiles (usec): | 1.00th=[ 48], 5.00th=[ 61], 10.00th=[ 120], | 20.00th=[ 20055], 30.00th=[ 26870], 40.00th=[ 32900], | 50.00th=[ 39584], 60.00th=[ 49546], 70.00th=[ 59507], | 80.00th=[ 73925], 90.00th=[ 96994], 95.00th=[ 121111], | 99.00th=[ 198181], 99.50th=[ 229639], 99.90th=[ 396362], | 99.95th=[1069548], 99.99th=[1069548] bw ( KiB/s): min= 7, max= 127, per=25.26%, avg=39.66, stdev=22.03, samples=295 iops : min= 1, max= 31, avg= 9.26, stdev= 5.54, samples=295 write: IOPS=10, BW=40.0KiB/s (41.9kB/s)(6260KiB/152825msec); 0 zone resets clat (usec): min=631, max=425637, avg=49694.08, stdev=55152.57 lat (usec): min=632, max=425639, avg=49702.96, stdev=55156.11 clat percentiles (usec): | 1.00th=[ 1020], 5.00th=[ 1172], 10.00th=[ 1369], 20.00th=[ 3949], | 30.00th=[ 10028], 40.00th=[ 21365], 50.00th=[ 36439], 60.00th=[ 49021], | 70.00th=[ 63701], 80.00th=[ 82314], 90.00th=[115868], 95.00th=[145753], | 99.00th=[267387], 99.50th=[316670], 99.90th=[392168], 99.95th=[425722], | 99.99th=[425722] bw ( KiB/s): min= 7, max= 151, per=24.83%, avg=40.72, stdev=20.51, samples=298 iops : min= 1, max= 37, avg= 9.53, stdev= 5.16, samples=298 lat (usec) : 50=0.62%, 100=4.07%, 250=0.49%, 500=0.16%, 750=0.16% lat (usec) : 1000=0.29% lat (msec) : 2=6.51%, 4=3.48%, 10=5.50%, 20=8.17%, 50=31.09% lat (msec) : 100=27.80%, 250=10.87%, 500=0.75%, 2000=0.03% cpu : usr=0.07%, sys=4.17%, ctx=6315, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=150482: Sat Sep 12 22:53:43 2026 read: IOPS=10, BW=40.1KiB/s (41.1kB/s)(6052KiB/150900msec) clat (usec): min=30, max=959933, avg=48578.56, stdev=45031.32 lat (usec): min=31, max=959934, avg=48579.86, stdev=45031.34 clat percentiles (usec): | 1.00th=[ 51], 5.00th=[ 59], 10.00th=[ 97], 20.00th=[ 20579], | 30.00th=[ 27132], 40.00th=[ 33162], 50.00th=[ 40109], 60.00th=[ 49021], | 70.00th=[ 58983], 80.00th=[ 72877], 90.00th=[ 94897], 95.00th=[117965], | 99.00th=[185598], 99.50th=[206570], 99.90th=[434111], 99.95th=[960496], | 99.99th=[960496] bw ( KiB/s): min= 7, max= 111, per=25.88%, avg=40.64, stdev=19.36, samples=289 iops : min= 1, max= 27, avg= 9.50, stdev= 4.89, samples=289 write: IOPS=10, BW=41.3KiB/s (42.3kB/s)(6236KiB/150900msec); 0 zone resets clat (usec): min=796, max=1208.2k, avg=49347.63, stdev=61200.05 lat (usec): min=798, max=1208.2k, avg=49349.42, stdev=61199.95 clat percentiles (usec): | 1.00th=[ 1029], 5.00th=[ 1139], 10.00th=[ 1336], | 20.00th=[ 4080], 30.00th=[ 8717], 40.00th=[ 20055], | 50.00th=[ 36439], 60.00th=[ 49021], 70.00th=[ 65274], | 80.00th=[ 83362], 90.00th=[ 111674], 95.00th=[ 139461], | 99.00th=[ 250610], 99.50th=[ 312476], 99.90th=[ 599786], | 99.95th=[1216349], 99.99th=[1216349] bw ( KiB/s): min= 7, max= 118, per=25.18%, avg=41.30, stdev=20.68, samples=293 iops : min= 1, max= 29, avg= 9.66, stdev= 5.21, samples=293 lat (usec) : 50=0.49%, 100=4.46%, 250=0.39%, 500=0.13%, 750=0.07% lat (usec) : 1000=0.29% lat (msec) : 2=6.74%, 4=3.22%, 10=6.45%, 20=7.55%, 50=31.12% lat (msec) : 100=28.06%, 250=10.42%, 500=0.52%, 750=0.03%, 1000=0.03% lat (msec) : 2000=0.03% cpu : usr=0.07%, sys=4.17%, ctx=6298, majf=0, minf=19 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=157KiB/s (161kB/s), 39.0KiB/s-40.1KiB/s (39.0kB/s-41.1kB/s), io=23.4MiB (24.6MB), run=150900-152825msec WRITE: bw=165KiB/s (168kB/s), 40.0KiB/s-41.7KiB/s (41.9kB/s-42.7kB/s), io=24.6MiB (25.7MB), run=150900-152825msec rand-rw: (groupid=0, jobs=1): err= 0: pid=150485: Sat Sep 12 22:56:33 2026 read: IOPS=4, BW=18.7KiB/s (19.1kB/s)(5992KiB/320908msec) clat (msec): min=4, max=1288, avg=39.77, stdev=52.41 lat (msec): min=4, max=1288, avg=39.77, stdev=52.41 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 15], | 30.00th=[ 18], 40.00th=[ 22], 50.00th=[ 26], 60.00th=[ 32], | 70.00th=[ 39], 80.00th=[ 55], 90.00th=[ 83], 95.00th=[ 109], | 99.00th=[ 226], 99.50th=[ 313], 99.90th=[ 502], 99.95th=[ 1284], | 99.99th=[ 1284] bw ( KiB/s): min= 7, max= 95, per=30.42%, avg=22.51, stdev=16.03, samples=511 iops : min= 1, max= 23, avg= 4.97, stdev= 4.04, samples=511 write: IOPS=4, BW=19.6KiB/s (20.1kB/s)(6296KiB/320908msec); 0 zone resets clat (msec): min=30, max=976, avg=165.94, stdev=94.49 lat (msec): min=30, max=976, avg=165.94, stdev=94.49 clat percentiles (msec): | 1.00th=[ 51], 5.00th=[ 66], 10.00th=[ 77], 20.00th=[ 92], | 30.00th=[ 108], 40.00th=[ 123], 50.00th=[ 140], 60.00th=[ 163], | 70.00th=[ 194], 80.00th=[ 234], 90.00th=[ 288], 95.00th=[ 334], | 99.00th=[ 489], 99.50th=[ 575], 99.90th=[ 827], 99.95th=[ 978], | 99.99th=[ 978] bw ( KiB/s): min= 7, max= 47, per=25.45%, avg=19.60, stdev= 9.84, samples=613 iops : min= 1, max= 11, avg= 4.24, stdev= 2.50, samples=613 lat (msec) : 10=2.70%, 20=14.75%, 50=21.09%, 100=20.18%, 250=32.65% lat (msec) : 500=8.11%, 750=0.42%, 1000=0.07%, 2000=0.03% cpu : usr=0.05%, sys=0.94%, ctx=5075, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=150486: Sat Sep 12 22:56:33 2026 read: IOPS=4, BW=18.4KiB/s (18.9kB/s)(5940KiB/322648msec) clat (msec): min=5, max=1162, avg=41.34, stdev=52.77 lat (msec): min=5, max=1162, avg=41.34, stdev=52.77 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 12], 20.00th=[ 16], | 30.00th=[ 19], 40.00th=[ 22], 50.00th=[ 26], 60.00th=[ 31], | 70.00th=[ 39], 80.00th=[ 53], 90.00th=[ 90], 95.00th=[ 133], | 99.00th=[ 232], 99.50th=[ 271], 99.90th=[ 426], 99.95th=[ 1167], | 99.99th=[ 1167] bw ( KiB/s): min= 7, max= 95, per=30.29%, avg=22.41, stdev=16.39, samples=509 iops : min= 1, max= 23, avg= 4.95, stdev= 4.14, samples=509 write: IOPS=4, BW=19.7KiB/s (20.1kB/s)(6348KiB/322648msec); 0 zone resets clat (msec): min=31, max=969, avg=164.52, stdev=91.63 lat (msec): min=31, max=969, avg=164.53, stdev=91.63 clat percentiles (msec): | 1.00th=[ 50], 5.00th=[ 66], 10.00th=[ 77], 20.00th=[ 93], | 30.00th=[ 109], 40.00th=[ 125], 50.00th=[ 142], 60.00th=[ 165], | 70.00th=[ 190], 80.00th=[ 224], 90.00th=[ 275], 95.00th=[ 330], | 99.00th=[ 514], 99.50th=[ 567], 99.90th=[ 751], 99.95th=[ 969], | 99.99th=[ 969] bw ( KiB/s): min= 7, max= 55, per=25.49%, avg=19.63, stdev=10.00, samples=618 iops : min= 1, max= 13, avg= 4.25, stdev= 2.53, samples=618 lat (msec) : 10=2.38%, 20=14.71%, 50=21.42%, 100=18.36%, 250=35.42% lat (msec) : 500=7.06%, 750=0.59%, 1000=0.03%, 2000=0.03% cpu : usr=0.05%, sys=0.94%, ctx=5080, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=150487: Sat Sep 12 22:56:33 2026 read: IOPS=4, BW=18.7KiB/s (19.2kB/s)(6028KiB/322245msec) clat (msec): min=5, max=504, avg=41.03, stdev=45.63 lat (msec): min=5, max=504, avg=41.04, stdev=45.63 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 16], | 30.00th=[ 18], 40.00th=[ 22], 50.00th=[ 27], 60.00th=[ 32], | 70.00th=[ 40], 80.00th=[ 56], 90.00th=[ 90], 95.00th=[ 121], | 99.00th=[ 224], 99.50th=[ 317], 99.90th=[ 426], 99.95th=[ 506], | 99.99th=[ 506] bw ( KiB/s): min= 7, max= 95, per=29.47%, avg=21.81, stdev=15.89, samples=530 iops : min= 1, max= 23, avg= 4.80, stdev= 4.00, samples=530 write: IOPS=4, BW=19.4KiB/s (19.9kB/s)(6260KiB/322245msec); 0 zone resets clat (msec): min=39, max=1294, avg=166.27, stdev=92.78 lat (msec): min=39, max=1294, avg=166.28, stdev=92.78 clat percentiles (msec): | 1.00th=[ 55], 5.00th=[ 69], 10.00th=[ 80], 20.00th=[ 94], | 30.00th=[ 108], 40.00th=[ 125], 50.00th=[ 142], 60.00th=[ 163], | 70.00th=[ 192], 80.00th=[ 226], 90.00th=[ 284], 95.00th=[ 355], | 99.00th=[ 481], 99.50th=[ 502], 99.90th=[ 642], 99.95th=[ 1301], | 99.99th=[ 1301] bw ( KiB/s): min= 7, max= 48, per=25.36%, avg=19.53, stdev= 9.85, samples=612 iops : min= 1, max= 12, avg= 4.23, stdev= 2.48, samples=612 lat (msec) : 10=2.73%, 20=14.49%, 50=21.03%, 100=19.27%, 250=34.44% lat (msec) : 500=7.75%, 750=0.26%, 2000=0.03% cpu : usr=0.04%, sys=0.93%, ctx=4987, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=150488: Sat Sep 12 22:56:33 2026 read: IOPS=4, BW=18.8KiB/s (19.3kB/s)(6052KiB/321121msec) clat (msec): min=5, max=743, avg=41.67, stdev=50.34 lat (msec): min=5, max=743, avg=41.67, stdev=50.34 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 13], 20.00th=[ 16], | 30.00th=[ 19], 40.00th=[ 22], 50.00th=[ 27], 60.00th=[ 32], | 70.00th=[ 39], 80.00th=[ 55], 90.00th=[ 88], 95.00th=[ 123], | 99.00th=[ 264], 99.50th=[ 355], 99.90th=[ 485], 99.95th=[ 743], | 99.99th=[ 743] bw ( KiB/s): min= 7, max= 111, per=30.23%, avg=22.37, stdev=15.67, samples=520 iops : min= 1, max= 27, avg= 4.94, stdev= 3.93, samples=520 write: IOPS=4, BW=19.4KiB/s (19.9kB/s)(6236KiB/321121msec); 0 zone resets clat (msec): min=34, max=1286, avg=165.43, stdev=93.91 lat (msec): min=34, max=1286, avg=165.43, stdev=93.91 clat percentiles (msec): | 1.00th=[ 53], 5.00th=[ 66], 10.00th=[ 78], 20.00th=[ 95], | 30.00th=[ 109], 40.00th=[ 125], 50.00th=[ 144], 60.00th=[ 163], | 70.00th=[ 186], 80.00th=[ 224], 90.00th=[ 288], 95.00th=[ 342], | 99.00th=[ 477], 99.50th=[ 575], 99.90th=[ 684], 99.95th=[ 1284], | 99.99th=[ 1284] bw ( KiB/s): min= 7, max= 55, per=25.06%, avg=19.30, stdev= 9.96, samples=617 iops : min= 1, max= 13, avg= 4.17, stdev= 2.54, samples=617 lat (msec) : 10=2.60%, 20=14.29%, 50=21.71%, 100=18.78%, 250=34.51% lat (msec) : 500=7.62%, 750=0.46%, 2000=0.03% cpu : usr=0.04%, sys=0.94%, ctx=4902, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=74.4KiB/s (76.2kB/s), 18.4KiB/s-18.8KiB/s (18.9kB/s-19.3kB/s), io=23.4MiB (24.6MB), run=320908-322648msec WRITE: bw=77.9KiB/s (79.8kB/s), 19.4KiB/s-19.7KiB/s (19.9kB/s-20.1kB/s), io=24.6MiB (25.7MB), run=320908-322648msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=150552: Sat Sep 12 22:57:15 2026 read: IOPS=11, BW=190KiB/s (194kB/s)(5920KiB/31210msec) clat (usec): min=33, max=198720, avg=41353.69, stdev=35695.83 lat (usec): min=33, max=198722, avg=41355.12, stdev=35695.89 clat percentiles (usec): | 1.00th=[ 42], 5.00th=[ 57], 10.00th=[ 72], 20.00th=[ 562], | 30.00th=[ 21627], 40.00th=[ 28967], 50.00th=[ 38011], 60.00th=[ 45351], | 70.00th=[ 52167], 80.00th=[ 64226], 90.00th=[ 82314], 95.00th=[105382], | 99.00th=[183501], 99.50th=[191890], 99.90th=[198181], 99.95th=[198181], | 99.99th=[198181] bw ( KiB/s): min= 31, max= 383, per=23.93%, avg=183.52, stdev=81.32, samples=61 iops : min= 1, max= 23, avg=10.70, stdev= 5.12, samples=61 write: IOPS=12, BW=204KiB/s (209kB/s)(6368KiB/31210msec); 0 zone resets clat (usec): min=1255, max=319822, avg=39032.81, stdev=44310.04 lat (usec): min=1258, max=319825, avg=39035.99, stdev=44309.61 clat percentiles (usec): | 1.00th=[ 1385], 5.00th=[ 1745], 10.00th=[ 2376], 20.00th=[ 5276], | 30.00th=[ 8455], 40.00th=[ 14222], 50.00th=[ 25560], 60.00th=[ 35390], | 70.00th=[ 50070], 80.00th=[ 66847], 90.00th=[ 92799], 95.00th=[111674], | 99.00th=[217056], 99.50th=[312476], 99.90th=[320865], 99.95th=[320865], | 99.99th=[320865] bw ( KiB/s): min= 29, max= 442, per=24.81%, avg=200.25, stdev=87.09, samples=61 iops : min= 1, max= 27, avg=11.75, stdev= 5.47, samples=61 lat (usec) : 50=1.04%, 100=6.64%, 250=1.56%, 500=0.13%, 750=0.52% lat (usec) : 1000=0.13% lat (msec) : 2=4.17%, 4=4.17%, 10=8.59%, 20=10.16%, 50=30.86% lat (msec) : 100=25.39%, 250=6.25%, 500=0.39% cpu : usr=0.06%, sys=5.10%, ctx=1542, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=150553: Sat Sep 12 22:57:15 2026 read: IOPS=12, BW=195KiB/s (200kB/s)(5744KiB/29424msec) clat (usec): min=37, max=364569, avg=43540.42, stdev=37317.72 lat (usec): min=37, max=364571, avg=43548.07, stdev=37314.27 clat percentiles (usec): | 1.00th=[ 47], 5.00th=[ 66], 10.00th=[ 83], 20.00th=[ 17957], | 30.00th=[ 25297], 40.00th=[ 32375], 50.00th=[ 39060], 60.00th=[ 46400], | 70.00th=[ 53216], 80.00th=[ 65274], 90.00th=[ 82314], 95.00th=[ 99091], | 99.00th=[191890], 99.50th=[219153], 99.90th=[362808], 99.95th=[362808], | 99.99th=[362808] bw ( KiB/s): min= 29, max= 349, per=25.89%, avg=198.58, stdev=72.44, samples=57 iops : min= 1, max= 21, avg=11.67, stdev= 4.60, samples=57 write: IOPS=13, BW=222KiB/s (228kB/s)(6544KiB/29424msec); 0 zone resets clat (usec): min=1462, max=197323, avg=32890.49, stdev=35186.44 lat (usec): min=1464, max=197326, avg=32896.80, stdev=35183.51 clat percentiles (usec): | 1.00th=[ 1565], 5.00th=[ 1860], 10.00th=[ 2540], 20.00th=[ 4228], | 30.00th=[ 7308], 40.00th=[ 10814], 50.00th=[ 18220], 60.00th=[ 29492], | 70.00th=[ 43779], 80.00th=[ 61604], 90.00th=[ 87557], 95.00th=[103285], | 99.00th=[139461], 99.50th=[162530], 99.90th=[198181], 99.95th=[198181], | 99.99th=[198181] bw ( KiB/s): min= 31, max= 666, per=27.50%, avg=221.91, stdev=106.51, samples=58 iops : min= 1, max= 41, avg=13.14, stdev= 6.69, samples=58 lat (usec) : 50=0.65%, 100=4.95%, 250=0.78%, 500=0.39%, 1000=0.26% lat (msec) : 2=4.17%, 4=6.51%, 10=10.29%, 20=9.38%, 50=32.29% lat (msec) : 100=25.13%, 250=5.08%, 500=0.13% cpu : usr=0.08%, sys=5.53%, ctx=1511, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=150554: Sat Sep 12 22:57:15 2026 read: IOPS=13, BW=213KiB/s (218kB/s)(6256KiB/29397msec) clat (usec): min=37, max=322054, avg=42006.35, stdev=35244.78 lat (usec): min=38, max=322056, avg=42007.99, stdev=35244.67 clat percentiles (usec): | 1.00th=[ 48], 5.00th=[ 62], 10.00th=[ 75], 20.00th=[ 4686], | 30.00th=[ 26346], 40.00th=[ 32637], 50.00th=[ 38536], 60.00th=[ 46924], | 70.00th=[ 53740], 80.00th=[ 64226], 90.00th=[ 80217], 95.00th=[ 92799], | 99.00th=[168821], 99.50th=[191890], 99.90th=[320865], 99.95th=[320865], | 99.99th=[320865] bw ( KiB/s): min= 30, max= 414, per=27.98%, avg=214.60, stdev=84.38, samples=57 iops : min= 1, max= 25, avg=12.67, stdev= 5.39, samples=57 write: IOPS=12, BW=205KiB/s (210kB/s)(6032KiB/29397msec); 0 zone resets clat (usec): min=1390, max=257070, avg=34052.54, stdev=36634.46 lat (usec): min=1393, max=257073, avg=34073.31, stdev=36623.89 clat percentiles (usec): | 1.00th=[ 1582], 5.00th=[ 1991], 10.00th=[ 2769], 20.00th=[ 5276], | 30.00th=[ 7832], 40.00th=[ 11207], 50.00th=[ 20317], 60.00th=[ 32113], | 70.00th=[ 43254], 80.00th=[ 61604], 90.00th=[ 87557], 95.00th=[107480], | 99.00th=[143655], 99.50th=[193987], 99.90th=[256902], 99.95th=[256902], | 99.99th=[256902] bw ( KiB/s): min= 31, max= 473, per=25.13%, avg=202.79, stdev=99.80, samples=57 iops : min= 1, max= 29, avg=11.89, stdev= 6.32, samples=57 lat (usec) : 50=0.91%, 100=6.51%, 250=0.91%, 500=0.65%, 750=0.39% lat (usec) : 1000=0.26% lat (msec) : 2=2.73%, 4=5.86%, 10=10.55%, 20=7.55%, 50=32.42% lat (msec) : 100=25.78%, 250=5.21%, 500=0.26% cpu : usr=0.10%, sys=5.69%, ctx=1505, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=150555: Sat Sep 12 22:57:15 2026 read: IOPS=12, BW=205KiB/s (210kB/s)(6032KiB/29475msec) clat (usec): min=41, max=319912, avg=41029.54, stdev=34779.78 lat (usec): min=41, max=319929, avg=41031.02, stdev=34780.05 clat percentiles (usec): | 1.00th=[ 47], 5.00th=[ 62], 10.00th=[ 75], 20.00th=[ 6390], | 30.00th=[ 24773], 40.00th=[ 31065], 50.00th=[ 36963], 60.00th=[ 44303], | 70.00th=[ 52691], 80.00th=[ 63177], 90.00th=[ 76022], 95.00th=[ 91751], | 99.00th=[145753], 99.50th=[254804], 99.90th=[320865], 99.95th=[320865], | 99.99th=[320865] bw ( KiB/s): min= 31, max= 378, per=27.07%, avg=207.63, stdev=76.68, samples=57 iops : min= 1, max= 23, avg=12.23, stdev= 4.89, samples=57 write: IOPS=13, BW=212KiB/s (217kB/s)(6256KiB/29475msec); 0 zone resets clat (usec): min=1333, max=208390, avg=35109.87, stdev=37327.70 lat (usec): min=1335, max=208391, avg=35117.81, stdev=37337.93 clat percentiles (usec): | 1.00th=[ 1467], 5.00th=[ 1762], 10.00th=[ 2769], 20.00th=[ 5211], | 30.00th=[ 8094], 40.00th=[ 12518], 50.00th=[ 21103], 60.00th=[ 33162], | 70.00th=[ 46924], 80.00th=[ 62653], 90.00th=[ 81265], 95.00th=[106431], | 99.00th=[173016], 99.50th=[202376], 99.90th=[208667], 99.95th=[208667], | 99.99th=[208667] bw ( KiB/s): min= 62, max= 383, per=26.36%, avg=212.74, stdev=82.25, samples=58 iops : min= 3, max= 23, avg=12.55, stdev= 5.16, samples=58 lat (usec) : 50=0.65%, 100=6.64%, 250=1.17%, 500=0.39%, 750=0.13% lat (usec) : 1000=0.13% lat (msec) : 2=3.65%, 4=4.04%, 10=11.59%, 20=8.33%, 50=33.07% lat (msec) : 100=25.00%, 250=4.95%, 500=0.26% cpu : usr=0.10%, sys=5.02%, ctx=1472, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=767KiB/s (786kB/s), 190KiB/s-213KiB/s (194kB/s-218kB/s), io=23.4MiB (24.5MB), run=29397-31210msec WRITE: bw=807KiB/s (827kB/s), 204KiB/s-222KiB/s (209kB/s-228kB/s), io=24.6MiB (25.8MB), run=29397-31210msec rand-rw: (groupid=0, jobs=1): err= 0: pid=150556: Sat Sep 12 22:57:57 2026 read: IOPS=5, BW=80.4KiB/s (82.3kB/s)(5920KiB/73635msec) clat (msec): min=8, max=269, avg=44.02, stdev=37.84 lat (msec): min=8, max=269, avg=44.02, stdev=37.84 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 12], 10.00th=[ 15], 20.00th=[ 18], | 30.00th=[ 22], 40.00th=[ 28], 50.00th=[ 33], 60.00th=[ 39], | 70.00th=[ 47], 80.00th=[ 57], 90.00th=[ 92], 95.00th=[ 132], | 99.00th=[ 194], 99.50th=[ 222], 99.90th=[ 271], 99.95th=[ 271], | 99.99th=[ 271] bw ( KiB/s): min= 29, max= 255, per=27.54%, avg=89.51, stdev=57.54, samples=128 iops : min= 1, max= 15, avg= 4.81, stdev= 3.60, samples=128 write: IOPS=5, BW=86.5KiB/s (88.6kB/s)(6368KiB/73635msec); 0 zone resets clat (msec): min=46, max=484, avg=143.70, stdev=60.73 lat (msec): min=46, max=484, avg=143.70, stdev=60.73 clat percentiles (msec): | 1.00th=[ 53], 5.00th=[ 70], 10.00th=[ 81], 20.00th=[ 95], | 30.00th=[ 107], 40.00th=[ 120], 50.00th=[ 134], 60.00th=[ 144], | 70.00th=[ 159], 80.00th=[ 188], 90.00th=[ 220], 95.00th=[ 268], | 99.00th=[ 342], 99.50th=[ 414], 99.90th=[ 485], 99.95th=[ 485], | 99.99th=[ 485] bw ( KiB/s): min= 29, max= 191, per=25.32%, avg=86.61, stdev=35.55, samples=143 iops : min= 1, max= 11, avg= 4.62, stdev= 2.29, samples=143 lat (msec) : 10=0.65%, 20=11.46%, 50=23.96%, 100=20.96%, 250=39.58% lat (msec) : 500=3.39% cpu : usr=0.04%, sys=1.16%, ctx=1276, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=150557: Sat Sep 12 22:57:57 2026 read: IOPS=4, BW=78.1KiB/s (79.9kB/s)(5744KiB/73583msec) clat (msec): min=8, max=325, avg=44.57, stdev=39.61 lat (msec): min=8, max=325, avg=44.57, stdev=39.61 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 13], 10.00th=[ 15], 20.00th=[ 19], | 30.00th=[ 23], 40.00th=[ 28], 50.00th=[ 33], 60.00th=[ 38], | 70.00th=[ 49], 80.00th=[ 64], 90.00th=[ 82], 95.00th=[ 131], | 99.00th=[ 218], 99.50th=[ 255], 99.90th=[ 326], 99.95th=[ 326], | 99.99th=[ 326] bw ( KiB/s): min= 29, max= 400, per=28.39%, avg=92.27, stdev=61.18, samples=121 iops : min= 1, max= 25, avg= 5.01, stdev= 3.91, samples=121 write: IOPS=5, BW=88.9KiB/s (91.1kB/s)(6544KiB/73583msec); 0 zone resets clat (msec): min=45, max=477, avg=139.96, stdev=60.05 lat (msec): min=45, max=477, avg=139.97, stdev=60.05 clat percentiles (msec): | 1.00th=[ 52], 5.00th=[ 65], 10.00th=[ 79], 20.00th=[ 91], | 30.00th=[ 103], 40.00th=[ 113], 50.00th=[ 128], 60.00th=[ 144], | 70.00th=[ 163], 80.00th=[ 186], 90.00th=[ 213], 95.00th=[ 247], | 99.00th=[ 326], 99.50th=[ 376], 99.90th=[ 477], 99.95th=[ 477], | 99.99th=[ 477] bw ( KiB/s): min= 30, max= 191, per=25.93%, avg=88.67, stdev=37.89, samples=144 iops : min= 1, max= 11, avg= 4.75, stdev= 2.42, samples=144 lat (msec) : 10=0.78%, 20=10.55%, 50=22.40%, 100=24.09%, 250=39.45% lat (msec) : 500=2.73% cpu : usr=0.04%, sys=1.15%, ctx=1253, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=150558: Sat Sep 12 22:57:57 2026 read: IOPS=5, BW=88.4KiB/s (90.5kB/s)(6256KiB/70787msec) clat (msec): min=7, max=320, avg=39.72, stdev=35.69 lat (msec): min=7, max=320, avg=39.72, stdev=35.69 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 19], | 30.00th=[ 22], 40.00th=[ 25], 50.00th=[ 30], 60.00th=[ 35], | 70.00th=[ 41], 80.00th=[ 52], 90.00th=[ 75], 95.00th=[ 109], | 99.00th=[ 222], 99.50th=[ 247], 99.90th=[ 321], 99.95th=[ 321], | 99.99th=[ 321] bw ( KiB/s): min= 31, max= 383, per=29.51%, avg=95.91, stdev=62.81, samples=129 iops : min= 1, max= 23, avg= 5.20, stdev= 3.95, samples=129 write: IOPS=5, BW=85.2KiB/s (87.3kB/s)(6032KiB/70787msec); 0 zone resets clat (msec): min=38, max=483, avg=145.48, stdev=64.41 lat (msec): min=38, max=483, avg=145.48, stdev=64.41 clat percentiles (msec): | 1.00th=[ 48], 5.00th=[ 66], 10.00th=[ 81], 20.00th=[ 93], | 30.00th=[ 106], 40.00th=[ 118], 50.00th=[ 136], 60.00th=[ 150], | 70.00th=[ 165], 80.00th=[ 190], 90.00th=[ 226], 95.00th=[ 262], | 99.00th=[ 384], 99.50th=[ 451], 99.90th=[ 485], 99.95th=[ 485], | 99.99th=[ 485] bw ( KiB/s): min= 29, max= 160, per=24.98%, avg=85.42, stdev=34.29, samples=139 iops : min= 1, max= 10, avg= 4.55, stdev= 2.23, samples=139 lat (msec) : 10=0.91%, 20=11.59%, 50=28.26%, 100=19.79%, 250=36.33% lat (msec) : 500=3.12% cpu : usr=0.04%, sys=1.30%, ctx=1375, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=150559: Sat Sep 12 22:57:57 2026 read: IOPS=5, BW=84.2KiB/s (86.2kB/s)(6032KiB/71661msec) clat (msec): min=7, max=211, avg=40.15, stdev=33.12 lat (msec): min=7, max=211, avg=40.15, stdev=33.12 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 18], | 30.00th=[ 22], 40.00th=[ 27], 50.00th=[ 30], 60.00th=[ 35], | 70.00th=[ 43], 80.00th=[ 53], 90.00th=[ 80], 95.00th=[ 120], | 99.00th=[ 165], 99.50th=[ 182], 99.90th=[ 213], 99.95th=[ 213], | 99.99th=[ 213] bw ( KiB/s): min= 31, max= 287, per=29.41%, avg=95.60, stdev=61.84, samples=124 iops : min= 1, max= 17, avg= 5.19, stdev= 3.89, samples=124 write: IOPS=5, BW=87.3KiB/s (89.4kB/s)(6256KiB/71661msec); 0 zone resets clat (msec): min=38, max=346, avg=143.78, stdev=59.02 lat (msec): min=38, max=346, avg=143.79, stdev=59.02 clat percentiles (msec): | 1.00th=[ 56], 5.00th=[ 72], 10.00th=[ 82], 20.00th=[ 94], | 30.00th=[ 109], 40.00th=[ 121], 50.00th=[ 130], 60.00th=[ 144], | 70.00th=[ 161], 80.00th=[ 188], 90.00th=[ 226], 95.00th=[ 271], | 99.00th=[ 326], 99.50th=[ 334], 99.90th=[ 347], 99.95th=[ 347], | 99.99th=[ 347] bw ( KiB/s): min= 31, max= 191, per=25.99%, avg=88.88, stdev=36.00, samples=139 iops : min= 1, max= 11, avg= 4.76, stdev= 2.31, samples=139 lat (msec) : 10=0.78%, 20=12.37%, 50=25.00%, 100=20.05%, 250=38.93% lat (msec) : 500=2.86% cpu : usr=0.05%, sys=1.18%, ctx=1308, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=325KiB/s (333kB/s), 78.1KiB/s-88.4KiB/s (79.9kB/s-90.5kB/s), io=23.4MiB (24.5MB), run=70787-73635msec WRITE: bw=342KiB/s (350kB/s), 85.2KiB/s-88.9KiB/s (87.3kB/s-91.1kB/s), io=24.6MiB (25.8MB), run=70787-73635msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=150582: Sat Sep 12 22:58:13 2026 read: IOPS=1, BW=1807KiB/s (1850kB/s)(7168KiB/3967msec) clat (usec): min=1681, max=552391, avg=237088.40, stdev=166115.46 lat (usec): min=1683, max=552393, avg=237091.45, stdev=166115.08 clat percentiles (usec): | 1.00th=[ 1680], 5.00th=[ 1680], 10.00th=[ 1680], 20.00th=[166724], | 30.00th=[173016], 40.00th=[173016], 50.00th=[238027], 60.00th=[258999], | 70.00th=[258999], 80.00th=[270533], 90.00th=[549454], 95.00th=[549454], | 99.00th=[549454], 99.50th=[549454], 99.90th=[549454], 99.95th=[549454], | 99.99th=[549454] bw ( KiB/s): min= 1885, max= 2716, per=48.40%, avg=2131.00, stdev=332.45, samples=5 iops : min= 1, max= 2, avg= 1.20, stdev= 0.45, samples=5 write: IOPS=1, BW=1291KiB/s (1322kB/s)(5120KiB/3967msec); 0 zone resets clat (msec): min=251, max=633, avg=426.12, stdev=189.57 lat (msec): min=251, max=633, avg=426.20, stdev=189.57 clat percentiles (msec): | 1.00th=[ 253], 5.00th=[ 253], 10.00th=[ 253], 20.00th=[ 253], | 30.00th=[ 275], 40.00th=[ 275], 50.00th=[ 342], 60.00th=[ 342], | 70.00th=[ 625], 80.00th=[ 625], 90.00th=[ 634], 95.00th=[ 634], | 99.00th=[ 634], 99.50th=[ 634], 99.90th=[ 634], 99.95th=[ 634], | 99.99th=[ 634] bw ( KiB/s): min= 1885, max= 2035, per=31.95%, avg=1969.25, stdev=66.37, samples=4 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=4 lat (msec) : 2=8.33%, 250=25.00%, 500=41.67%, 750=25.00% cpu : usr=0.03%, sys=11.85%, ctx=188, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=150583: Sat Sep 12 22:58:13 2026 read: IOPS=0, BW=440KiB/s (451kB/s)(2048KiB/4651msec) clat (msec): min=243, max=328, avg=286.40, stdev=60.00 lat (msec): min=243, max=328, avg=286.40, stdev=59.99 clat percentiles (msec): | 1.00th=[ 245], 5.00th=[ 245], 10.00th=[ 245], 20.00th=[ 245], | 30.00th=[ 245], 40.00th=[ 245], 50.00th=[ 245], 60.00th=[ 330], | 70.00th=[ 330], 80.00th=[ 330], 90.00th=[ 330], 95.00th=[ 330], | 99.00th=[ 330], 99.50th=[ 330], 99.90th=[ 330], 99.95th=[ 330], | 99.99th=[ 330] bw ( KiB/s): min= 1980, max= 2035, per=45.59%, avg=2007.50, stdev=38.89, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2202KiB/s (2255kB/s)(10.0MiB/4651msec); 0 zone resets clat (msec): min=73, max=1010, avg=400.77, stdev=336.78 lat (msec): min=73, max=1011, avg=400.90, stdev=336.81 clat percentiles (msec): | 1.00th=[ 74], 5.00th=[ 74], 10.00th=[ 74], 20.00th=[ 87], | 30.00th=[ 103], 40.00th=[ 167], 50.00th=[ 213], 60.00th=[ 342], | 70.00th=[ 550], 80.00th=[ 634], 90.00th=[ 827], 95.00th=[ 1011], | 99.00th=[ 1011], 99.50th=[ 1011], 99.90th=[ 1011], 99.95th=[ 1011], | 99.99th=[ 1011] bw ( KiB/s): min= 1889, max= 6119, per=58.84%, avg=3626.80, stdev=2264.75, samples=5 iops : min= 1, max= 5, avg= 2.60, stdev= 2.19, samples=5 lat (msec) : 100=16.67%, 250=33.33%, 500=16.67%, 750=16.67%, 1000=8.33% lat (msec) : 2000=8.33% cpu : usr=0.00%, sys=11.12%, ctx=148, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=150584: Sat Sep 12 22:58:13 2026 read: IOPS=1, BW=1622KiB/s (1661kB/s)(6144KiB/3788msec) clat (usec): min=597, max=251978, avg=130546.08, stdev=112444.03 lat (usec): min=598, max=251979, avg=130547.52, stdev=112444.17 clat percentiles (usec): | 1.00th=[ 594], 5.00th=[ 594], 10.00th=[ 594], 20.00th=[ 3818], | 30.00th=[ 3818], 40.00th=[115868], 50.00th=[115868], 60.00th=[160433], | 70.00th=[250610], 80.00th=[250610], 90.00th=[252707], 95.00th=[252707], | 99.00th=[252707], 99.50th=[252707], 99.90th=[252707], 99.95th=[252707], | 99.99th=[252707] bw ( KiB/s): min= 1996, max= 4023, per=60.97%, avg=2684.67, stdev=1159.19, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 write: IOPS=1, BW=1622KiB/s (1661kB/s)(6144KiB/3788msec); 0 zone resets clat (msec): min=84, max=1041, avg=438.21, stdev=352.40 lat (msec): min=84, max=1044, avg=438.99, stdev=353.62 clat percentiles (msec): | 1.00th=[ 85], 5.00th=[ 85], 10.00th=[ 85], 20.00th=[ 134], | 30.00th=[ 134], 40.00th=[ 300], 50.00th=[ 300], 60.00th=[ 510], | 70.00th=[ 558], 80.00th=[ 558], 90.00th=[ 1045], 95.00th=[ 1045], | 99.00th=[ 1045], 99.50th=[ 1045], 99.90th=[ 1045], 99.95th=[ 1045], | 99.99th=[ 1045] bw ( KiB/s): min= 1935, max= 2035, per=32.39%, avg=1996.25, stdev=43.86, samples=4 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=4 lat (usec) : 750=8.33% lat (msec) : 4=8.33%, 100=8.33%, 250=25.00%, 500=25.00%, 750=16.67% lat (msec) : 2000=8.33% cpu : usr=0.00%, sys=11.72%, ctx=119, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=150585: Sat Sep 12 22:58:13 2026 read: IOPS=1, BW=1129KiB/s (1157kB/s)(5120KiB/4533msec) clat (usec): min=699, max=444578, avg=105480.11, stdev=192248.10 lat (usec): min=699, max=444580, avg=105481.18, stdev=192248.14 clat percentiles (usec): | 1.00th=[ 701], 5.00th=[ 701], 10.00th=[ 701], 20.00th=[ 701], | 30.00th=[ 2311], 40.00th=[ 2311], 50.00th=[ 3654], 60.00th=[ 3654], | 70.00th=[ 76022], 80.00th=[ 76022], 90.00th=[442500], 95.00th=[442500], | 99.00th=[442500], 99.50th=[442500], 99.90th=[442500], 99.95th=[442500], | 99.99th=[442500] bw ( KiB/s): min= 3771, max= 4071, per=89.05%, avg=3921.00, stdev=212.13, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1581KiB/s (1619kB/s)(7168KiB/4533msec); 0 zone resets clat (msec): min=162, max=912, avg=516.84, stdev=301.92 lat (msec): min=162, max=912, avg=516.94, stdev=301.90 clat percentiles (msec): | 1.00th=[ 163], 5.00th=[ 163], 10.00th=[ 163], 20.00th=[ 241], | 30.00th=[ 243], 40.00th=[ 243], 50.00th=[ 558], 60.00th=[ 735], | 70.00th=[ 735], 80.00th=[ 776], 90.00th=[ 911], 95.00th=[ 911], | 99.00th=[ 911], 99.50th=[ 911], 99.90th=[ 911], 99.95th=[ 911], | 99.99th=[ 911] bw ( KiB/s): min= 1885, max= 2035, per=32.36%, avg=1994.80, stdev=63.90, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 lat (usec) : 750=8.33% lat (msec) : 4=16.67%, 100=8.33%, 250=25.00%, 500=8.33%, 750=16.67% lat (msec) : 1000=16.67% cpu : usr=0.04%, sys=9.00%, ctx=136, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4403KiB/s (4509kB/s), 440KiB/s-1807KiB/s (451kB/s-1850kB/s), io=20.0MiB (20.0MB), run=3788-4651msec WRITE: bw=6165KiB/s (6313kB/s), 1291KiB/s-2202KiB/s (1322kB/s-2255kB/s), io=28.0MiB (29.4MB), run=3788-4651msec rand-rw: (groupid=0, jobs=1): err= 0: pid=150577: Sat Sep 12 22:58:14 2026 read: IOPS=1, BW=1828KiB/s (1872kB/s)(7168KiB/3921msec) clat (msec): min=101, max=628, avg=231.13, stdev=184.48 lat (msec): min=101, max=628, avg=231.13, stdev=184.48 clat percentiles (msec): | 1.00th=[ 103], 5.00th=[ 103], 10.00th=[ 103], 20.00th=[ 120], | 30.00th=[ 132], 40.00th=[ 132], 50.00th=[ 150], 60.00th=[ 241], | 70.00th=[ 241], 80.00th=[ 249], 90.00th=[ 625], 95.00th=[ 625], | 99.00th=[ 625], 99.50th=[ 625], 99.90th=[ 625], 99.95th=[ 625], | 99.99th=[ 625] bw ( KiB/s): min= 1976, max= 3088, per=59.21%, avg=2236.40, stdev=476.91, samples=5 iops : min= 1, max= 3, avg= 1.60, stdev= 0.89, samples=5 write: IOPS=1, BW=1306KiB/s (1337kB/s)(5120KiB/3921msec); 0 zone resets clat (msec): min=206, max=632, avg=415.22, stdev=170.69 lat (msec): min=206, max=632, avg=415.33, stdev=170.67 clat percentiles (msec): | 1.00th=[ 207], 5.00th=[ 207], 10.00th=[ 207], 20.00th=[ 207], | 30.00th=[ 334], 40.00th=[ 334], 50.00th=[ 359], 60.00th=[ 359], | 70.00th=[ 542], 80.00th=[ 542], 90.00th=[ 634], 95.00th=[ 634], | 99.00th=[ 634], 99.50th=[ 634], 99.90th=[ 634], 99.95th=[ 634], | 99.99th=[ 634] bw ( KiB/s): min= 1976, max= 2048, per=38.32%, avg=2026.50, stdev=33.87, samples=4 iops : min= 1, max= 2, avg= 1.25, stdev= 0.50, samples=4 lat (msec) : 250=58.33%, 500=16.67%, 750=25.00% cpu : usr=0.00%, sys=3.70%, ctx=64, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=150578: Sat Sep 12 22:58:14 2026 read: IOPS=0, BW=378KiB/s (387kB/s)(2048KiB/5421msec) clat (msec): min=168, max=174, avg=171.56, stdev= 4.33 lat (msec): min=168, max=174, avg=171.56, stdev= 4.32 clat percentiles (msec): | 1.00th=[ 169], 5.00th=[ 169], 10.00th=[ 169], 20.00th=[ 169], | 30.00th=[ 169], 40.00th=[ 169], 50.00th=[ 169], 60.00th=[ 176], | 70.00th=[ 176], 80.00th=[ 176], 90.00th=[ 176], 95.00th=[ 176], | 99.00th=[ 176], 99.50th=[ 176], 99.90th=[ 176], 99.95th=[ 176], | 99.99th=[ 176] bw ( KiB/s): min= 1514, max= 2039, per=47.03%, avg=1776.50, stdev=371.23, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1889KiB/s (1934kB/s)(10.0MiB/5421msec); 0 zone resets clat (msec): min=116, max=1102, avg=463.03, stdev=311.32 lat (msec): min=116, max=1102, avg=463.17, stdev=311.31 clat percentiles (msec): | 1.00th=[ 116], 5.00th=[ 116], 10.00th=[ 116], 20.00th=[ 157], | 30.00th=[ 218], 40.00th=[ 271], 50.00th=[ 338], 60.00th=[ 481], | 70.00th=[ 518], 80.00th=[ 684], 90.00th=[ 751], 95.00th=[ 1099], | 99.00th=[ 1099], 99.50th=[ 1099], 99.90th=[ 1099], 99.95th=[ 1099], | 99.99th=[ 1099] bw ( KiB/s): min= 1917, max= 4087, per=51.01%, avg=2698.17, stdev=1076.79, samples=6 iops : min= 1, max= 3, avg= 1.83, stdev= 0.98, samples=6 lat (msec) : 250=41.67%, 500=25.00%, 750=16.67%, 1000=8.33%, 2000=8.33% cpu : usr=0.09%, sys=4.11%, ctx=93, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=150579: Sat Sep 12 22:58:14 2026 read: IOPS=1, BW=1291KiB/s (1322kB/s)(6144KiB/4760msec) clat (msec): min=106, max=541, avg=221.99, stdev=163.82 lat (msec): min=106, max=541, avg=222.00, stdev=163.82 clat percentiles (msec): | 1.00th=[ 107], 5.00th=[ 107], 10.00th=[ 107], 20.00th=[ 133], | 30.00th=[ 133], 40.00th=[ 142], 50.00th=[ 142], 60.00th=[ 163], | 70.00th=[ 247], 80.00th=[ 247], 90.00th=[ 542], 95.00th=[ 542], | 99.00th=[ 542], 99.50th=[ 542], 99.90th=[ 542], 99.95th=[ 542], | 99.99th=[ 542] bw ( KiB/s): min= 2039, max= 6119, per=90.03%, avg=3400.33, stdev=2354.44, samples=3 iops : min= 1, max= 5, avg= 2.33, stdev= 2.31, samples=3 write: IOPS=1, BW=1291KiB/s (1322kB/s)(6144KiB/4760msec); 0 zone resets clat (msec): min=179, max=976, avg=556.80, stdev=278.77 lat (msec): min=179, max=976, avg=556.94, stdev=278.77 clat percentiles (msec): | 1.00th=[ 180], 5.00th=[ 180], 10.00th=[ 180], 20.00th=[ 334], | 30.00th=[ 334], 40.00th=[ 567], 50.00th=[ 567], 60.00th=[ 592], | 70.00th=[ 693], 80.00th=[ 693], 90.00th=[ 978], 95.00th=[ 978], | 99.00th=[ 978], 99.50th=[ 978], 99.90th=[ 978], 99.95th=[ 978], | 99.99th=[ 978] bw ( KiB/s): min= 1917, max= 2048, per=37.97%, avg=2008.33, stdev=51.87, samples=6 iops : min= 1, max= 2, avg= 1.17, stdev= 0.41, samples=6 lat (msec) : 250=50.00%, 500=8.33%, 750=33.33%, 1000=8.33% cpu : usr=0.00%, sys=2.29%, ctx=56, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=150581: Sat Sep 12 22:58:14 2026 read: IOPS=0, BW=976KiB/s (999kB/s)(5120KiB/5248msec) clat (msec): min=68, max=885, avg=263.69, stdev=349.42 lat (msec): min=68, max=885, avg=263.69, stdev=349.42 clat percentiles (msec): | 1.00th=[ 69], 5.00th=[ 69], 10.00th=[ 69], 20.00th=[ 69], | 30.00th=[ 95], 40.00th=[ 95], 50.00th=[ 102], 60.00th=[ 102], | 70.00th=[ 167], 80.00th=[ 167], 90.00th=[ 885], 95.00th=[ 885], | 99.00th=[ 885], 99.50th=[ 885], 99.90th=[ 885], 99.95th=[ 885], | 99.99th=[ 885] bw ( KiB/s): min= 3835, max= 4096, per=100.00%, avg=3965.50, stdev=184.55, samples=2 iops : min= 3, max= 4, avg= 3.50, stdev= 0.71, samples=2 write: IOPS=1, BW=1366KiB/s (1399kB/s)(7168KiB/5248msec); 0 zone resets clat (msec): min=205, max=995, avg=529.78, stdev=317.89 lat (msec): min=206, max=995, avg=530.63, stdev=317.28 clat percentiles (msec): | 1.00th=[ 207], 5.00th=[ 207], 10.00th=[ 207], 20.00th=[ 247], | 30.00th=[ 309], 40.00th=[ 309], 50.00th=[ 426], 60.00th=[ 634], | 70.00th=[ 634], 80.00th=[ 894], 90.00th=[ 995], 95.00th=[ 995], | 99.00th=[ 995], 99.50th=[ 995], 99.90th=[ 995], 99.95th=[ 995], | 99.99th=[ 995] bw ( KiB/s): min= 1539, max= 4087, per=42.86%, avg=2266.83, stdev=911.23, samples=6 iops : min= 1, max= 3, avg= 1.33, stdev= 0.82, samples=6 lat (msec) : 100=16.67%, 250=33.33%, 500=16.67%, 750=8.33%, 1000=25.00% cpu : usr=0.02%, sys=3.34%, ctx=80, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3778KiB/s (3869kB/s), 378KiB/s-1828KiB/s (387kB/s-1872kB/s), io=20.0MiB (20.0MB), run=3921-5421msec WRITE: bw=5289KiB/s (5416kB/s), 1291KiB/s-1889KiB/s (1322kB/s-1934kB/s), io=28.0MiB (29.4MB), run=3921-5421msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=150597: Sat Sep 12 22:58:30 2026 read: IOPS=0, BW=1998KiB/s (2046kB/s)(12.0MiB/6150msec) clat (msec): min=632, max=3890, avg=2020.26, stdev=1681.43 lat (msec): min=632, max=3890, avg=2020.27, stdev=1681.43 clat percentiles (msec): | 1.00th=[ 634], 5.00th=[ 634], 10.00th=[ 634], 20.00th=[ 634], | 30.00th=[ 634], 40.00th=[ 1536], 50.00th=[ 1536], 60.00th=[ 1536], | 70.00th=[ 3876], 80.00th=[ 3876], 90.00th=[ 3876], 95.00th=[ 3876], | 99.00th=[ 3876], 99.50th=[ 3876], 99.90th=[ 3876], 99.95th=[ 3876], | 99.99th=[ 3876] bw ( KiB/s): min= 8143, max= 8175, per=100.00%, avg=8159.00, stdev=22.63, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.03%, sys=1.32%, ctx=43, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=150598: Sat Sep 12 22:58:30 2026 read: IOPS=0, BW=645KiB/s (660kB/s)(4096KiB/6351msec) clat (nsec): min=4388.7M, max=4388.7M, avg=4388669401.00, stdev= 0.00 lat (nsec): min=4388.7M, max=4388.7M, avg=4388672316.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 4396], 5.00th=[ 4396], 10.00th=[ 4396], 20.00th=[ 4396], | 30.00th=[ 4396], 40.00th=[ 4396], 50.00th=[ 4396], 60.00th=[ 4396], | 70.00th=[ 4396], 80.00th=[ 4396], 90.00th=[ 4396], 95.00th=[ 4396], | 99.00th=[ 4396], 99.50th=[ 4396], 99.90th=[ 4396], 99.95th=[ 4396], | 99.99th=[ 4396] bw ( KiB/s): min= 7984, max= 7984, per=100.00%, avg=7984.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=1290KiB/s (1321kB/s)(8192KiB/6351msec); 0 zone resets clat (msec): min=663, max=1275, avg=969.85, stdev=432.61 lat (msec): min=664, max=1276, avg=970.20, stdev=432.78 clat percentiles (msec): | 1.00th=[ 667], 5.00th=[ 667], 10.00th=[ 667], 20.00th=[ 667], | 30.00th=[ 667], 40.00th=[ 667], 50.00th=[ 667], 60.00th=[ 1284], | 70.00th=[ 1284], 80.00th=[ 1284], 90.00th=[ 1284], 95.00th=[ 1284], | 99.00th=[ 1284], 99.50th=[ 1284], 99.90th=[ 1284], 99.95th=[ 1284], | 99.99th=[ 1284] bw ( KiB/s): min= 8159, max= 8159, per=100.00%, avg=8159.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=2.13%, ctx=100, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=150599: Sat Sep 12 22:58:30 2026 write: IOPS=0, BW=1902KiB/s (1948kB/s)(12.0MiB/6459msec); 0 zone resets clat (msec): min=618, max=4216, avg=2140.63, stdev=1861.56 lat (msec): min=618, max=4217, avg=2141.53, stdev=1862.24 clat percentiles (msec): | 1.00th=[ 617], 5.00th=[ 617], 10.00th=[ 617], 20.00th=[ 617], | 30.00th=[ 617], 40.00th=[ 1586], 50.00th=[ 1586], 60.00th=[ 1586], | 70.00th=[ 4212], 80.00th=[ 4212], 90.00th=[ 4212], 95.00th=[ 4212], | 99.00th=[ 4212], 99.50th=[ 4212], 99.90th=[ 4212], 99.95th=[ 4212], | 99.99th=[ 4212] bw ( KiB/s): min= 7922, max= 8159, per=100.00%, avg=8040.50, stdev=167.58, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=0.93%, ctx=33, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=150600: Sat Sep 12 22:58:30 2026 write: IOPS=0, BW=2332KiB/s (2388kB/s)(12.0MiB/5270msec); 0 zone resets clat (msec): min=237, max=4598, avg=1748.03, stdev=2470.33 lat (msec): min=238, max=4599, avg=1748.43, stdev=2470.30 clat percentiles (msec): | 1.00th=[ 239], 5.00th=[ 239], 10.00th=[ 239], 20.00th=[ 239], | 30.00th=[ 239], 40.00th=[ 409], 50.00th=[ 409], 60.00th=[ 409], | 70.00th=[ 4597], 80.00th=[ 4597], 90.00th=[ 4597], 95.00th=[ 4597], | 99.00th=[ 4597], 99.50th=[ 4597], 99.90th=[ 4597], 99.95th=[ 4597], | 99.99th=[ 4597] bw ( KiB/s): min=10937, max=10937, per=100.00%, avg=10937.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 500=33.33%, >=2000=33.33% cpu : usr=0.02%, sys=1.99%, ctx=34, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2580KiB/s (2642kB/s), 645KiB/s-1998KiB/s (660kB/s-2046kB/s), io=16.0MiB (16.8MB), run=6150-6351msec WRITE: bw=5073KiB/s (5195kB/s), 1290KiB/s-2332KiB/s (1321kB/s-2388kB/s), io=32.0MiB (33.6MB), run=5270-6459msec rand-rw: (groupid=0, jobs=1): err= 0: pid=150592: Sat Sep 12 22:58:31 2026 read: IOPS=0, BW=2174KiB/s (2226kB/s)(12.0MiB/5653msec) clat (msec): min=912, max=3668, avg=1851.67, stdev=1573.46 lat (msec): min=912, max=3668, avg=1851.67, stdev=1573.47 clat percentiles (msec): | 1.00th=[ 911], 5.00th=[ 911], 10.00th=[ 911], 20.00th=[ 911], | 30.00th=[ 911], 40.00th=[ 978], 50.00th=[ 978], 60.00th=[ 978], | 70.00th=[ 3675], 80.00th=[ 3675], 90.00th=[ 3675], 95.00th=[ 3675], | 99.00th=[ 3675], 99.50th=[ 3675], 99.90th=[ 3675], 99.95th=[ 3675], | 99.99th=[ 3675] bw ( KiB/s): min= 8143, max= 8175, per=100.00%, avg=8159.00, stdev=22.63, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=66.67%, >=2000=33.33% cpu : usr=0.00%, sys=6.35%, ctx=544, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=150593: Sat Sep 12 22:58:31 2026 read: IOPS=0, BW=717KiB/s (734kB/s)(4096KiB/5712msec) clat (nsec): min=3682.6M, max=3682.6M, avg=3682637896.00, stdev= 0.00 lat (nsec): min=3682.6M, max=3682.6M, avg=3682639000.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 3675], 5.00th=[ 3675], 10.00th=[ 3675], 20.00th=[ 3675], | 30.00th=[ 3675], 40.00th=[ 3675], 50.00th=[ 3675], 60.00th=[ 3675], | 70.00th=[ 3675], 80.00th=[ 3675], 90.00th=[ 3675], 95.00th=[ 3675], | 99.00th=[ 3675], 99.50th=[ 3675], 99.90th=[ 3675], 99.95th=[ 3675], | 99.99th=[ 3675] bw ( KiB/s): min= 8143, max= 8143, per=100.00%, avg=8143.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=1434KiB/s (1469kB/s)(8192KiB/5712msec); 0 zone resets clat (msec): min=520, max=1384, avg=952.45, stdev=610.99 lat (msec): min=521, max=1385, avg=953.10, stdev=610.87 clat percentiles (msec): | 1.00th=[ 523], 5.00th=[ 523], 10.00th=[ 523], 20.00th=[ 523], | 30.00th=[ 523], 40.00th=[ 523], 50.00th=[ 523], 60.00th=[ 1385], | 70.00th=[ 1385], 80.00th=[ 1385], 90.00th=[ 1385], 95.00th=[ 1385], | 99.00th=[ 1385], 99.50th=[ 1385], 99.90th=[ 1385], 99.95th=[ 1385], | 99.99th=[ 1385] bw ( KiB/s): min= 7968, max= 7968, per=100.00%, avg=7968.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=3.82%, ctx=505, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=150594: Sat Sep 12 22:58:31 2026 write: IOPS=0, BW=1661KiB/s (1700kB/s)(12.0MiB/7400msec); 0 zone resets clat (msec): min=714, max=4147, avg=2431.08, stdev=1716.31 lat (msec): min=715, max=4147, avg=2431.46, stdev=1716.22 clat percentiles (msec): | 1.00th=[ 718], 5.00th=[ 718], 10.00th=[ 718], 20.00th=[ 718], | 30.00th=[ 718], 40.00th=[ 2433], 50.00th=[ 2433], 60.00th=[ 2433], | 70.00th=[ 4144], 80.00th=[ 4144], 90.00th=[ 4144], 95.00th=[ 4144], | 99.00th=[ 4144], 99.50th=[ 4144], 99.90th=[ 4144], 99.95th=[ 4144], | 99.99th=[ 4144] bw ( KiB/s): min= 7968, max= 8175, per=100.00%, avg=8071.50, stdev=146.37, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, >=2000=66.67% cpu : usr=0.00%, sys=2.31%, ctx=72, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=150596: Sat Sep 12 22:58:31 2026 write: IOPS=0, BW=2196KiB/s (2249kB/s)(12.0MiB/5596msec); 0 zone resets clat (msec): min=367, max=4513, avg=1825.02, stdev=2330.71 lat (msec): min=368, max=4513, avg=1826.61, stdev=2329.72 clat percentiles (msec): | 1.00th=[ 368], 5.00th=[ 368], 10.00th=[ 368], 20.00th=[ 368], | 30.00th=[ 368], 40.00th=[ 592], 50.00th=[ 592], 60.00th=[ 592], | 70.00th=[ 4530], 80.00th=[ 4530], 90.00th=[ 4530], 95.00th=[ 4530], | 99.00th=[ 4530], 99.50th=[ 4530], 99.90th=[ 4530], 99.95th=[ 4530], | 99.99th=[ 4530] bw ( KiB/s): min=16351, max=16351, per=100.00%, avg=16351.00, stdev= 0.00, samples=1 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 750=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=1.84%, ctx=57, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2868KiB/s (2937kB/s), 717KiB/s-2174KiB/s (734kB/s-2226kB/s), io=16.0MiB (16.8MB), run=5653-5712msec WRITE: bw=4428KiB/s (4534kB/s), 1434KiB/s-2196KiB/s (1469kB/s-2249kB/s), io=32.0MiB (33.6MB), run=5596-7400msec