== sanity test 398b: DIO and buffer IO race ============== 19:45:59 (1788392759) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 3.28936 s, 15.3 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=148064: Wed Sep 2 19:47:41 2026 read: IOPS=16, BW=65.1KiB/s (66.7kB/s)(5992KiB/92006msec) clat (usec): min=30, max=623804, avg=29529.71, stdev=30185.84 lat (usec): min=30, max=623805, avg=29530.79, stdev=30185.81 clat percentiles (usec): | 1.00th=[ 47], 5.00th=[ 56], 10.00th=[ 115], 20.00th=[ 11600], | 30.00th=[ 15270], 40.00th=[ 18482], 50.00th=[ 22938], 60.00th=[ 28181], | 70.00th=[ 34341], 80.00th=[ 44827], 90.00th=[ 60031], 95.00th=[ 73925], | 99.00th=[126354], 99.50th=[149947], 99.90th=[299893], 99.95th=[624952], | 99.99th=[624952] bw ( KiB/s): min= 7, max= 215, per=25.06%, avg=64.90, stdev=30.19, samples=181 iops : min= 1, max= 53, avg=15.63, stdev= 7.62, samples=181 write: IOPS=17, BW=68.4KiB/s (70.1kB/s)(6296KiB/92006msec); 0 zone resets clat (usec): min=792, max=262361, avg=30284.23, stdev=32005.87 lat (usec): min=793, max=262362, avg=30290.64, stdev=32017.71 clat percentiles (usec): | 1.00th=[ 1037], 5.00th=[ 1254], 10.00th=[ 1893], 20.00th=[ 3425], | 30.00th=[ 7046], 40.00th=[ 14091], 50.00th=[ 21890], 60.00th=[ 29754], | 70.00th=[ 39060], 80.00th=[ 50070], 90.00th=[ 71828], 95.00th=[ 89654], | 99.00th=[143655], 99.50th=[164627], 99.90th=[254804], 99.95th=[263193], | 99.99th=[263193] bw ( KiB/s): min= 7, max= 190, per=25.13%, avg=68.10, stdev=30.75, samples=181 iops : min= 1, max= 47, avg=16.44, stdev= 7.73, samples=181 lat (usec) : 50=1.01%, 100=3.42%, 250=0.78%, 500=0.07%, 750=0.07% lat (usec) : 1000=0.20% lat (msec) : 2=5.40%, 4=5.83%, 10=8.72%, 20=20.38%, 50=36.17% lat (msec) : 100=15.43%, 250=2.41%, 500=0.10%, 750=0.03% cpu : usr=0.07%, sys=7.82%, ctx=6945, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=148065: Wed Sep 2 19:47:41 2026 read: IOPS=16, BW=64.5KiB/s (66.1kB/s)(5940KiB/92041msec) clat (usec): min=33, max=680777, avg=28514.63, stdev=29662.28 lat (usec): min=33, max=680779, avg=28526.45, stdev=29655.94 clat percentiles (usec): | 1.00th=[ 47], 5.00th=[ 56], 10.00th=[ 96], 20.00th=[ 11600], | 30.00th=[ 15533], 40.00th=[ 19006], 50.00th=[ 23200], 60.00th=[ 27132], | 70.00th=[ 33817], 80.00th=[ 42730], 90.00th=[ 55837], 95.00th=[ 69731], | 99.00th=[112722], 99.50th=[137364], 99.90th=[358613], 99.95th=[683672], | 99.99th=[683672] bw ( KiB/s): min= 5, max= 175, per=24.90%, avg=64.49, stdev=27.30, samples=180 iops : min= 1, max= 43, avg=15.53, stdev= 6.88, samples=180 write: IOPS=17, BW=68.0KiB/s (70.6kB/s)(6348KiB/92041msec); 0 zone resets clat (usec): min=602, max=308668, avg=31254.51, stdev=32817.85 lat (usec): min=603, max=308669, avg=31258.33, stdev=32817.22 clat percentiles (usec): | 1.00th=[ 1004], 5.00th=[ 1172], 10.00th=[ 1582], 20.00th=[ 2999], | 30.00th=[ 6718], 40.00th=[ 15401], 50.00th=[ 23200], 60.00th=[ 30278], | 70.00th=[ 40109], 80.00th=[ 53216], 90.00th=[ 72877], 95.00th=[ 94897], | 99.00th=[132645], 99.50th=[158335], 99.90th=[270533], 99.95th=[308282], | 99.99th=[308282] bw ( KiB/s): min= 7, max= 159, per=25.36%, avg=68.73, stdev=29.55, samples=180 iops : min= 1, max= 39, avg=16.61, stdev= 7.45, samples=180 lat (usec) : 50=0.98%, 100=3.91%, 250=0.59%, 500=0.13%, 750=0.13% lat (usec) : 1000=0.42% lat (msec) : 2=7.00%, 4=4.88%, 10=7.39%, 20=18.88%, 50=37.60% lat (msec) : 100=15.27%, 250=2.67%, 500=0.13%, 750=0.03% cpu : usr=0.07%, sys=7.53%, ctx=6794, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=148066: Wed Sep 2 19:47:41 2026 read: IOPS=16, BW=67.4KiB/s (68.0kB/s)(6028KiB/89492msec) clat (usec): min=29, max=344067, avg=27179.37, stdev=23366.61 lat (usec): min=30, max=344068, avg=27183.88, stdev=23367.00 clat percentiles (usec): | 1.00th=[ 46], 5.00th=[ 56], 10.00th=[ 113], 20.00th=[ 11076], | 30.00th=[ 15008], 40.00th=[ 18482], 50.00th=[ 22152], 60.00th=[ 26608], | 70.00th=[ 32637], 80.00th=[ 41681], 90.00th=[ 55313], 95.00th=[ 65799], | 99.00th=[103285], 99.50th=[115868], 99.90th=[200279], 99.95th=[346031], | 99.99th=[346031] bw ( KiB/s): min= 16, max= 160, per=26.13%, avg=67.67, stdev=31.24, samples=175 iops : min= 4, max= 40, avg=16.31, stdev= 7.85, samples=175 write: IOPS=17, BW=69.0KiB/s (71.6kB/s)(6260KiB/89492msec); 0 zone resets clat (usec): min=711, max=701410, avg=30932.33, stdev=37460.74 lat (usec): min=712, max=701413, avg=30933.92, stdev=37460.82 clat percentiles (usec): | 1.00th=[ 996], 5.00th=[ 1205], 10.00th=[ 1713], 20.00th=[ 3163], | 30.00th=[ 6128], 40.00th=[ 13566], 50.00th=[ 20841], 60.00th=[ 29230], | 70.00th=[ 38536], 80.00th=[ 53216], 90.00th=[ 70779], 95.00th=[ 92799], | 99.00th=[156238], 99.50th=[198181], 99.90th=[261096], 99.95th=[700449], | 99.99th=[700449] bw ( KiB/s): min= 5, max= 191, per=25.75%, avg=69.77, stdev=31.20, samples=176 iops : min= 1, max= 47, avg=16.85, stdev= 7.84, samples=176 lat (usec) : 50=1.07%, 100=3.58%, 250=0.72%, 500=0.10%, 750=0.13% lat (usec) : 1000=0.62% lat (msec) : 2=5.96%, 4=5.70%, 10=8.79%, 20=20.08%, 50=35.55% lat (msec) : 100=14.97%, 250=2.64%, 500=0.07%, 750=0.03% cpu : usr=0.08%, sys=7.79%, ctx=6946, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=148067: Wed Sep 2 19:47:41 2026 read: IOPS=16, BW=65.4KiB/s (66.0kB/s)(6052KiB/92537msec) clat (usec): min=31, max=291816, avg=27855.14, stdev=24699.33 lat (usec): min=31, max=291817, avg=27858.35, stdev=24698.92 clat percentiles (usec): | 1.00th=[ 42], 5.00th=[ 53], 10.00th=[ 78], 20.00th=[ 10945], | 30.00th=[ 14746], 40.00th=[ 18220], 50.00th=[ 22414], 60.00th=[ 27395], | 70.00th=[ 33817], 80.00th=[ 43254], 90.00th=[ 56886], 95.00th=[ 70779], | 99.00th=[109577], 99.50th=[137364], 99.90th=[254804], 99.95th=[291505], | 99.99th=[291505] bw ( KiB/s): min= 8, max= 152, per=25.30%, avg=65.54, stdev=28.57, samples=180 iops : min= 2, max= 38, avg=15.81, stdev= 7.20, samples=180 write: IOPS=16, BW=67.4KiB/s (69.0kB/s)(6236KiB/92537msec); 0 zone resets clat (usec): min=807, max=671080, avg=32261.43, stdev=36352.57 lat (usec): min=807, max=671081, avg=32263.41, stdev=36353.10 clat percentiles (usec): | 1.00th=[ 1037], 5.00th=[ 1303], 10.00th=[ 1991], 20.00th=[ 3589], | 30.00th=[ 7373], 40.00th=[ 16712], 50.00th=[ 24511], 60.00th=[ 31851], | 70.00th=[ 40633], 80.00th=[ 52167], 90.00th=[ 73925], 95.00th=[ 93848], | 99.00th=[147850], 99.50th=[170918], 99.90th=[254804], 99.95th=[666895], | 99.99th=[666895] bw ( KiB/s): min= 5, max= 191, per=24.68%, avg=66.90, stdev=27.23, samples=182 iops : min= 1, max= 47, avg=16.13, stdev= 6.87, samples=182 lat (usec) : 50=1.37%, 100=4.30%, 250=0.65%, 500=0.07%, 750=0.10% lat (usec) : 1000=0.36% lat (msec) : 2=4.82%, 4=5.66%, 10=8.63%, 20=18.65%, 50=37.57% lat (msec) : 100=14.94%, 250=2.73%, 500=0.13%, 750=0.03% cpu : usr=0.07%, sys=7.67%, ctx=6948, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=259KiB/s (266kB/s), 64.5KiB/s-67.4KiB/s (66.1kB/s-68.0kB/s), io=23.4MiB (24.6MB), run=89492-92537msec WRITE: bw=272KiB/s (278kB/s), 67.4KiB/s-69.0KiB/s (69.0kB/s-71.6kB/s), io=24.6MiB (25.7MB), run=89492-92537msec rand-rw: (groupid=0, jobs=1): err= 0: pid=148059: Wed Sep 2 19:49:04 2026 read: IOPS=8, BW=34.1KiB/s (34.0kB/s)(5992KiB/175468msec) clat (msec): min=4, max=713, avg=26.47, stdev=34.41 lat (msec): min=4, max=713, avg=26.47, stdev=34.41 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 7], 10.00th=[ 8], 20.00th=[ 10], | 30.00th=[ 12], 40.00th=[ 14], 50.00th=[ 17], 60.00th=[ 20], | 70.00th=[ 25], 80.00th=[ 35], 90.00th=[ 58], 95.00th=[ 77], | 99.00th=[ 148], 99.50th=[ 213], 99.90th=[ 363], 99.95th=[ 718], | 99.99th=[ 718] bw ( KiB/s): min= 7, max= 119, per=26.00%, avg=35.36, stdev=24.07, samples=331 iops : min= 1, max= 29, avg= 8.28, stdev= 6.07, samples=331 write: IOPS=8, BW=35.9KiB/s (36.7kB/s)(6296KiB/175468msec); 0 zone resets clat (msec): min=26, max=451, avg=86.13, stdev=48.70 lat (msec): min=26, max=451, avg=86.14, stdev=48.70 clat percentiles (msec): | 1.00th=[ 33], 5.00th=[ 40], 10.00th=[ 44], 20.00th=[ 52], | 30.00th=[ 58], 40.00th=[ 64], 50.00th=[ 71], 60.00th=[ 80], | 70.00th=[ 93], 80.00th=[ 115], 90.00th=[ 148], 95.00th=[ 186], | 99.00th=[ 262], 99.50th=[ 334], 99.90th=[ 393], 99.95th=[ 451], | 99.99th=[ 451] bw ( KiB/s): min= 7, max= 80, per=24.84%, avg=35.51, stdev=17.67, samples=346 iops : min= 1, max= 20, avg= 8.32, stdev= 4.49, samples=346 lat (msec) : 10=11.10%, 20=18.39%, 50=22.53%, 100=33.59%, 250=13.61% lat (msec) : 500=0.75%, 750=0.03% cpu : usr=0.05%, sys=1.82%, ctx=5460, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=148060: Wed Sep 2 19:49:04 2026 read: IOPS=8, BW=33.0KiB/s (34.8kB/s)(5940KiB/174869msec) clat (msec): min=4, max=759, avg=25.39, stdev=32.94 lat (msec): min=4, max=759, avg=25.39, stdev=32.94 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 7], 10.00th=[ 8], 20.00th=[ 10], | 30.00th=[ 11], 40.00th=[ 14], 50.00th=[ 17], 60.00th=[ 20], | 70.00th=[ 25], 80.00th=[ 35], 90.00th=[ 53], 95.00th=[ 74], | 99.00th=[ 136], 99.50th=[ 190], 99.90th=[ 355], 99.95th=[ 760], | 99.99th=[ 760] bw ( KiB/s): min= 7, max= 110, per=26.52%, avg=36.07, stdev=22.59, samples=322 iops : min= 1, max= 27, avg= 8.46, stdev= 5.67, samples=322 write: IOPS=9, BW=36.3KiB/s (37.2kB/s)(6348KiB/174869msec); 0 zone resets clat (msec): min=27, max=456, avg=86.28, stdev=50.77 lat (msec): min=27, max=456, avg=86.28, stdev=50.77 clat percentiles (msec): | 1.00th=[ 33], 5.00th=[ 41], 10.00th=[ 44], 20.00th=[ 51], | 30.00th=[ 57], 40.00th=[ 63], 50.00th=[ 70], 60.00th=[ 80], | 70.00th=[ 93], 80.00th=[ 114], 90.00th=[ 155], 95.00th=[ 186], | 99.00th=[ 262], 99.50th=[ 317], 99.90th=[ 456], 99.95th=[ 456], | 99.99th=[ 456] bw ( KiB/s): min= 7, max= 79, per=25.15%, avg=35.96, stdev=17.80, samples=345 iops : min= 1, max= 19, avg= 8.43, stdev= 4.52, samples=345 lat (msec) : 10=11.43%, 20=18.10%, 50=23.80%, 100=32.36%, 250=13.67% lat (msec) : 500=0.62%, 1000=0.03% cpu : usr=0.06%, sys=1.77%, ctx=5339, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=148061: Wed Sep 2 19:49:04 2026 read: IOPS=8, BW=34.5KiB/s (35.3kB/s)(6028KiB/174713msec) clat (msec): min=4, max=386, avg=26.29, stdev=30.30 lat (msec): min=4, max=386, avg=26.29, stdev=30.30 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 7], 10.00th=[ 8], 20.00th=[ 10], | 30.00th=[ 12], 40.00th=[ 14], 50.00th=[ 17], 60.00th=[ 21], | 70.00th=[ 25], 80.00th=[ 35], 90.00th=[ 58], 95.00th=[ 80], | 99.00th=[ 157], 99.50th=[ 188], 99.90th=[ 347], 99.95th=[ 388], | 99.99th=[ 388] bw ( KiB/s): min= 7, max= 135, per=25.76%, avg=35.03, stdev=23.04, samples=337 iops : min= 1, max= 33, avg= 8.21, stdev= 5.81, samples=337 write: IOPS=8, BW=35.8KiB/s (36.7kB/s)(6260KiB/174713msec); 0 zone resets clat (msec): min=25, max=766, avg=86.17, stdev=51.01 lat (msec): min=25, max=766, avg=86.18, stdev=51.01 clat percentiles (msec): | 1.00th=[ 33], 5.00th=[ 40], 10.00th=[ 44], 20.00th=[ 52], | 30.00th=[ 57], 40.00th=[ 63], 50.00th=[ 71], 60.00th=[ 80], | 70.00th=[ 92], 80.00th=[ 117], 90.00th=[ 150], 95.00th=[ 182], | 99.00th=[ 271], 99.50th=[ 292], 99.90th=[ 451], 99.95th=[ 768], | 99.99th=[ 768] bw ( KiB/s): min= 7, max= 87, per=25.07%, avg=35.85, stdev=18.06, samples=342 iops : min= 1, max= 21, avg= 8.41, stdev= 4.57, samples=342 lat (msec) : 10=10.68%, 20=18.98%, 50=22.43%, 100=33.50%, 250=13.64% lat (msec) : 500=0.75%, 1000=0.03% cpu : usr=0.04%, sys=1.82%, ctx=5505, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=148062: Wed Sep 2 19:49:04 2026 read: IOPS=8, BW=34.6KiB/s (35.5kB/s)(6052KiB/174731msec) clat (msec): min=4, max=292, avg=25.08, stdev=27.24 lat (msec): min=4, max=292, avg=25.08, stdev=27.24 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 7], 10.00th=[ 8], 20.00th=[ 10], | 30.00th=[ 12], 40.00th=[ 14], 50.00th=[ 16], 60.00th=[ 20], | 70.00th=[ 24], 80.00th=[ 33], 90.00th=[ 56], 95.00th=[ 79], | 99.00th=[ 148], 99.50th=[ 169], 99.90th=[ 259], 99.95th=[ 292], | 99.99th=[ 292] bw ( KiB/s): min= 7, max= 119, per=27.07%, avg=36.82, stdev=23.78, samples=322 iops : min= 1, max= 29, avg= 8.65, stdev= 5.98, samples=322 write: IOPS=8, BW=35.7KiB/s (36.5kB/s)(6236KiB/174731msec); 0 zone resets clat (msec): min=22, max=765, avg=87.59, stdev=52.23 lat (msec): min=22, max=765, avg=87.59, stdev=52.23 clat percentiles (msec): | 1.00th=[ 34], 5.00th=[ 41], 10.00th=[ 45], 20.00th=[ 53], | 30.00th=[ 58], 40.00th=[ 64], 50.00th=[ 71], 60.00th=[ 81], | 70.00th=[ 95], 80.00th=[ 117], 90.00th=[ 153], 95.00th=[ 190], | 99.00th=[ 251], 99.50th=[ 279], 99.90th=[ 518], 99.95th=[ 768], | 99.99th=[ 768] bw ( KiB/s): min= 7, max= 80, per=24.80%, avg=35.47, stdev=17.49, samples=344 iops : min= 1, max= 20, avg= 8.31, stdev= 4.46, samples=344 lat (msec) : 10=11.59%, 20=19.14%, 50=21.22%, 100=32.81%, 250=14.62% lat (msec) : 500=0.55%, 750=0.03%, 1000=0.03% cpu : usr=0.04%, sys=1.81%, ctx=5474, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=137KiB/s (140kB/s), 33.0KiB/s-34.6KiB/s (34.8kB/s-35.5kB/s), io=23.4MiB (24.6MB), run=174713-175468msec WRITE: bw=143KiB/s (147kB/s), 35.7KiB/s-36.3KiB/s (36.5kB/s-37.2kB/s), io=24.6MiB (25.7MB), run=174713-175468msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=148102: Wed Sep 2 19:49:23 2026 read: IOPS=26, BW=425KiB/s (436kB/s)(5920KiB/13917msec) clat (usec): min=31, max=96050, avg=18318.67, stdev=15176.93 lat (usec): min=31, max=96051, avg=18319.84, stdev=15176.95 clat percentiles (usec): | 1.00th=[ 39], 5.00th=[ 56], 10.00th=[ 86], 20.00th=[ 221], | 30.00th=[12780], 40.00th=[15008], 50.00th=[17695], 60.00th=[20317], | 70.00th=[23725], 80.00th=[28181], 90.00th=[34866], 95.00th=[43779], | 99.00th=[82314], 99.50th=[88605], 99.90th=[95945], 99.95th=[95945], | 99.99th=[95945] bw ( KiB/s): min= 255, max= 640, per=24.42%, avg=420.22, stdev=112.17, samples=27 iops : min= 15, max= 40, avg=25.67, stdev= 7.07, samples=27 write: IOPS=28, BW=458KiB/s (469kB/s)(6368KiB/13917msec); 0 zone resets clat (usec): min=1492, max=133040, avg=17680.62, stdev=16245.39 lat (usec): min=1494, max=133041, avg=17682.38, stdev=16245.45 clat percentiles (usec): | 1.00th=[ 1565], 5.00th=[ 2343], 10.00th=[ 2868], 20.00th=[ 4015], | 30.00th=[ 5604], 40.00th=[ 8979], 50.00th=[ 13960], 60.00th=[ 18744], | 70.00th=[ 23200], 80.00th=[ 29230], 90.00th=[ 38011], 95.00th=[ 45351], | 99.00th=[ 62653], 99.50th=[126354], 99.90th=[132645], 99.95th=[132645], | 99.99th=[132645] bw ( KiB/s): min= 238, max= 670, per=25.21%, avg=456.33, stdev=112.44, samples=27 iops : min= 14, max= 41, avg=27.93, stdev= 6.94, samples=27 lat (usec) : 50=1.43%, 100=5.47%, 250=3.26%, 500=0.91%, 1000=0.13% lat (msec) : 2=2.08%, 4=8.98%, 10=11.85%, 20=27.34%, 50=35.55% lat (msec) : 100=2.73%, 250=0.26% cpu : usr=0.11%, sys=16.08%, ctx=1684, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=148103: Wed Sep 2 19:49:23 2026 read: IOPS=26, BW=424KiB/s (434kB/s)(5744KiB/13556msec) clat (usec): min=39, max=141122, avg=19436.16, stdev=15715.70 lat (usec): min=39, max=141123, avg=19437.20, stdev=15715.71 clat percentiles (usec): | 1.00th=[ 52], 5.00th=[ 59], 10.00th=[ 78], 20.00th=[ 277], | 30.00th=[ 12518], 40.00th=[ 16057], 50.00th=[ 18744], 60.00th=[ 20579], | 70.00th=[ 24511], 80.00th=[ 29754], 90.00th=[ 37487], 95.00th=[ 47449], | 99.00th=[ 66847], 99.50th=[ 70779], 99.90th=[141558], 99.95th=[141558], | 99.99th=[141558] bw ( KiB/s): min= 238, max= 569, per=24.83%, avg=427.35, stdev=85.03, samples=26 iops : min= 14, max= 35, avg=26.12, stdev= 5.35, samples=26 write: IOPS=30, BW=483KiB/s (494kB/s)(6544KiB/13556msec); 0 zone resets clat (usec): min=1121, max=74259, avg=15708.85, stdev=14997.62 lat (usec): min=1123, max=74259, avg=15712.27, stdev=14999.70 clat percentiles (usec): | 1.00th=[ 1565], 5.00th=[ 2212], 10.00th=[ 2835], 20.00th=[ 3851], | 30.00th=[ 5080], 40.00th=[ 6390], 50.00th=[ 9241], 60.00th=[14091], | 70.00th=[19530], 80.00th=[27395], 90.00th=[39584], 95.00th=[47973], | 99.00th=[62653], 99.50th=[68682], 99.90th=[73925], 99.95th=[73925], | 99.99th=[73925] bw ( KiB/s): min= 158, max= 672, per=26.64%, avg=482.23, stdev=133.84, samples=26 iops : min= 9, max= 42, avg=29.58, stdev= 8.42, samples=26 lat (usec) : 50=0.39%, 100=5.60%, 250=3.26%, 500=0.65% lat (msec) : 2=2.08%, 4=9.77%, 10=17.58%, 20=24.74%, 50=32.68% lat (msec) : 100=3.12%, 250=0.13% cpu : usr=0.10%, sys=16.58%, ctx=1760, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=148104: Wed Sep 2 19:49:23 2026 read: IOPS=28, BW=455KiB/s (466kB/s)(6256KiB/13751msec) clat (usec): min=38, max=118116, avg=18857.81, stdev=17443.60 lat (usec): min=38, max=118116, avg=18858.77, stdev=17443.60 clat percentiles (usec): | 1.00th=[ 42], 5.00th=[ 60], 10.00th=[ 75], 20.00th=[ 119], | 30.00th=[ 11994], 40.00th=[ 15008], 50.00th=[ 17171], 60.00th=[ 19530], | 70.00th=[ 24249], 80.00th=[ 28443], 90.00th=[ 35914], 95.00th=[ 43779], | 99.00th=[ 96994], 99.50th=[112722], 99.90th=[117965], 99.95th=[117965], | 99.99th=[117965] bw ( KiB/s): min= 252, max= 670, per=26.69%, avg=459.26, stdev=119.52, samples=27 iops : min= 15, max= 41, avg=28.11, stdev= 7.47, samples=27 write: IOPS=27, BW=439KiB/s (449kB/s)(6032KiB/13751msec); 0 zone resets clat (usec): min=1326, max=80948, avg=16558.17, stdev=14778.55 lat (usec): min=1328, max=80949, avg=16560.94, stdev=14780.33 clat percentiles (usec): | 1.00th=[ 1450], 5.00th=[ 2089], 10.00th=[ 2704], 20.00th=[ 4015], | 30.00th=[ 5604], 40.00th=[ 7570], 50.00th=[11076], 60.00th=[16712], | 70.00th=[21627], 80.00th=[28705], 90.00th=[38536], 95.00th=[46924], | 99.00th=[60031], 99.50th=[62653], 99.90th=[81265], 99.95th=[81265], | 99.99th=[81265] bw ( KiB/s): min= 223, max= 631, per=24.20%, avg=438.07, stdev=106.36, samples=27 iops : min= 13, max= 39, avg=26.81, stdev= 6.62, samples=27 lat (usec) : 50=1.43%, 100=7.81%, 250=2.47%, 500=0.91%, 750=0.13% lat (usec) : 1000=0.13% lat (msec) : 2=2.21%, 4=7.29%, 10=14.32%, 20=26.69%, 50=32.94% lat (msec) : 100=3.26%, 250=0.39% cpu : usr=0.07%, sys=16.28%, ctx=1720, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=148105: Wed Sep 2 19:49:23 2026 read: IOPS=28, BW=452KiB/s (462kB/s)(6032KiB/13358msec) clat (usec): min=40, max=114658, avg=17664.53, stdev=14862.27 lat (usec): min=40, max=114659, avg=17666.16, stdev=14862.25 clat percentiles (usec): | 1.00th=[ 44], 5.00th=[ 59], 10.00th=[ 79], 20.00th=[ 118], | 30.00th=[ 10945], 40.00th=[ 14091], 50.00th=[ 16450], 60.00th=[ 19268], | 70.00th=[ 22938], 80.00th=[ 29230], 90.00th=[ 35914], 95.00th=[ 41157], | 99.00th=[ 63701], 99.50th=[ 73925], 99.90th=[114820], 99.95th=[114820], | 99.99th=[114820] bw ( KiB/s): min= 159, max= 701, per=26.35%, avg=453.54, stdev=123.49, samples=26 iops : min= 9, max= 43, avg=27.77, stdev= 7.77, samples=26 write: IOPS=29, BW=468KiB/s (480kB/s)(6256KiB/13358msec); 0 zone resets clat (usec): min=1231, max=108295, avg=17033.64, stdev=17047.68 lat (usec): min=1233, max=108297, avg=17035.65, stdev=17047.78 clat percentiles (usec): | 1.00th=[ 1418], 5.00th=[ 2180], 10.00th=[ 2802], 20.00th=[ 3818], | 30.00th=[ 4948], 40.00th=[ 6980], 50.00th=[ 10028], 60.00th=[ 15270], | 70.00th=[ 22676], 80.00th=[ 30016], 90.00th=[ 39584], 95.00th=[ 49546], | 99.00th=[ 78119], 99.50th=[ 84411], 99.90th=[108528], 99.95th=[108528], | 99.99th=[108528] bw ( KiB/s): min= 284, max= 734, per=26.17%, avg=473.73, stdev=113.39, samples=26 iops : min= 17, max= 45, avg=29.04, stdev= 7.02, samples=26 lat (usec) : 50=0.91%, 100=6.90%, 250=4.43%, 500=0.13% lat (msec) : 2=1.95%, 4=9.11%, 10=15.76%, 20=26.43%, 50=30.99% lat (msec) : 100=3.12%, 250=0.26% cpu : usr=0.14%, sys=16.23%, ctx=1729, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1721KiB/s (1762kB/s), 424KiB/s-455KiB/s (434kB/s-466kB/s), io=23.4MiB (24.5MB), run=13358-13917msec WRITE: bw=1811KiB/s (1854kB/s), 439KiB/s-483KiB/s (449kB/s-494kB/s), io=24.6MiB (25.8MB), run=13358-13917msec rand-rw: (groupid=0, jobs=1): err= 0: pid=148107: Wed Sep 2 19:49:43 2026 read: IOPS=11, BW=179KiB/s (183kB/s)(5920KiB/33037msec) clat (msec): min=5, max=125, avg=19.03, stdev=17.80 lat (msec): min=5, max=125, avg=19.03, stdev=17.80 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 7], 10.00th=[ 8], 20.00th=[ 9], | 30.00th=[ 10], 40.00th=[ 11], 50.00th=[ 13], 60.00th=[ 15], | 70.00th=[ 18], 80.00th=[ 26], 90.00th=[ 40], 95.00th=[ 58], | 99.00th=[ 91], 99.50th=[ 126], 99.90th=[ 126], 99.95th=[ 126], | 99.99th=[ 126] bw ( KiB/s): min= 31, max= 574, per=25.11%, avg=177.80, stdev=102.60, samples=65 iops : min= 1, max= 35, avg=10.34, stdev= 6.40, samples=65 write: IOPS=12, BW=193KiB/s (197kB/s)(6368KiB/33037msec); 0 zone resets clat (msec): min=28, max=214, avg=64.83, stdev=24.92 lat (msec): min=28, max=214, avg=64.83, stdev=24.92 clat percentiles (msec): | 1.00th=[ 30], 5.00th=[ 35], 10.00th=[ 39], 20.00th=[ 46], | 30.00th=[ 52], 40.00th=[ 56], 50.00th=[ 61], 60.00th=[ 65], | 70.00th=[ 72], 80.00th=[ 81], 90.00th=[ 97], 95.00th=[ 112], | 99.00th=[ 146], 99.50th=[ 178], 99.90th=[ 215], 99.95th=[ 215], | 99.99th=[ 215] bw ( KiB/s): min= 31, max= 287, per=25.80%, avg=192.20, stdev=69.73, samples=65 iops : min= 1, max= 17, avg=11.25, stdev= 4.38, samples=65 lat (msec) : 10=16.67%, 20=18.88%, 50=23.83%, 100=35.55%, 250=5.08% cpu : usr=0.07%, sys=2.82%, ctx=1360, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=148108: Wed Sep 2 19:49:43 2026 read: IOPS=10, BW=170KiB/s (174kB/s)(5744KiB/33817msec) clat (msec): min=4, max=108, avg=18.00, stdev=15.70 lat (msec): min=4, max=108, avg=18.00, stdev=15.70 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 7], 10.00th=[ 8], 20.00th=[ 9], | 30.00th=[ 10], 40.00th=[ 11], 50.00th=[ 13], 60.00th=[ 15], | 70.00th=[ 18], 80.00th=[ 26], 90.00th=[ 37], 95.00th=[ 52], | 99.00th=[ 86], 99.50th=[ 87], 99.90th=[ 109], 99.95th=[ 109], | 99.99th=[ 109] bw ( KiB/s): min= 26, max= 475, per=23.92%, avg=169.34, stdev=102.93, samples=67 iops : min= 1, max= 29, avg= 9.84, stdev= 6.51, samples=67 write: IOPS=12, BW=194KiB/s (198kB/s)(6544KiB/33817msec); 0 zone resets clat (msec): min=27, max=209, avg=66.43, stdev=25.59 lat (msec): min=27, max=209, avg=66.43, stdev=25.59 clat percentiles (msec): | 1.00th=[ 33], 5.00th=[ 38], 10.00th=[ 42], 20.00th=[ 47], | 30.00th=[ 50], 40.00th=[ 56], 50.00th=[ 61], 60.00th=[ 66], | 70.00th=[ 74], 80.00th=[ 84], 90.00th=[ 101], 95.00th=[ 120], | 99.00th=[ 142], 99.50th=[ 153], 99.90th=[ 211], 99.95th=[ 211], | 99.99th=[ 211] bw ( KiB/s): min= 80, max= 320, per=25.92%, avg=193.07, stdev=66.07, samples=67 iops : min= 5, max= 20, avg=11.33, stdev= 4.17, samples=67 lat (msec) : 10=15.89%, 20=19.40%, 50=25.78%, 100=33.46%, 250=5.47% cpu : usr=0.06%, sys=2.79%, ctx=1428, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=148109: Wed Sep 2 19:49:43 2026 read: IOPS=12, BW=193KiB/s (198kB/s)(6256KiB/32389msec) clat (msec): min=4, max=135, avg=17.73, stdev=16.77 lat (msec): min=4, max=135, avg=17.73, stdev=16.77 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 7], 10.00th=[ 8], 20.00th=[ 9], | 30.00th=[ 10], 40.00th=[ 11], 50.00th=[ 13], 60.00th=[ 14], | 70.00th=[ 17], 80.00th=[ 22], 90.00th=[ 35], 95.00th=[ 48], | 99.00th=[ 101], 99.50th=[ 126], 99.90th=[ 136], 99.95th=[ 136], | 99.99th=[ 136] bw ( KiB/s): min= 31, max= 576, per=27.41%, avg=194.09, stdev=114.40, samples=64 iops : min= 1, max= 36, avg=11.36, stdev= 7.19, samples=64 write: IOPS=11, BW=186KiB/s (191kB/s)(6032KiB/32389msec); 0 zone resets clat (msec): min=28, max=209, avg=67.39, stdev=27.82 lat (msec): min=28, max=209, avg=67.39, stdev=27.82 clat percentiles (msec): | 1.00th=[ 32], 5.00th=[ 37], 10.00th=[ 40], 20.00th=[ 46], | 30.00th=[ 51], 40.00th=[ 55], 50.00th=[ 61], 60.00th=[ 67], | 70.00th=[ 74], 80.00th=[ 87], 90.00th=[ 106], 95.00th=[ 129], | 99.00th=[ 163], 99.50th=[ 178], 99.90th=[ 209], 99.95th=[ 209], | 99.99th=[ 209] bw ( KiB/s): min= 63, max= 287, per=24.90%, avg=185.52, stdev=65.67, samples=64 iops : min= 3, max= 17, avg=10.83, stdev= 4.08, samples=64 lat (msec) : 10=18.10%, 20=20.83%, 50=23.96%, 100=30.86%, 250=6.25% cpu : usr=0.07%, sys=3.01%, ctx=1481, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=148110: Wed Sep 2 19:49:43 2026 read: IOPS=11, BW=182KiB/s (186kB/s)(6032KiB/33128msec) clat (msec): min=5, max=123, avg=18.21, stdev=16.70 lat (msec): min=5, max=123, avg=18.21, stdev=16.70 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 7], 10.00th=[ 8], 20.00th=[ 9], | 30.00th=[ 10], 40.00th=[ 11], 50.00th=[ 13], 60.00th=[ 15], | 70.00th=[ 17], 80.00th=[ 23], 90.00th=[ 41], 95.00th=[ 52], | 99.00th=[ 97], 99.50th=[ 101], 99.90th=[ 124], 99.95th=[ 124], | 99.99th=[ 124] bw ( KiB/s): min= 26, max= 415, per=25.50%, avg=180.52, stdev=95.11, samples=65 iops : min= 1, max= 25, avg=10.51, stdev= 5.93, samples=65 write: IOPS=11, BW=189KiB/s (193kB/s)(6256KiB/33128msec); 0 zone resets clat (msec): min=29, max=200, avg=66.63, stdev=24.49 lat (msec): min=29, max=200, avg=66.64, stdev=24.49 clat percentiles (msec): | 1.00th=[ 33], 5.00th=[ 39], 10.00th=[ 42], 20.00th=[ 48], | 30.00th=[ 52], 40.00th=[ 56], 50.00th=[ 61], 60.00th=[ 67], | 70.00th=[ 74], 80.00th=[ 84], 90.00th=[ 101], 95.00th=[ 112], | 99.00th=[ 161], 99.50th=[ 169], 99.90th=[ 201], 99.95th=[ 201], | 99.99th=[ 201] bw ( KiB/s): min= 62, max= 320, per=25.19%, avg=187.63, stdev=63.96, samples=65 iops : min= 3, max= 20, avg=10.95, stdev= 4.04, samples=65 lat (msec) : 10=17.58%, 20=19.66%, 50=21.61%, 100=35.94%, 250=5.21% cpu : usr=0.07%, sys=2.87%, ctx=1402, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=708KiB/s (725kB/s), 170KiB/s-193KiB/s (174kB/s-198kB/s), io=23.4MiB (24.5MB), run=32389-33817msec WRITE: bw=745KiB/s (763kB/s), 186KiB/s-194KiB/s (191kB/s-198kB/s), io=24.6MiB (25.8MB), run=32389-33817msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=148126: Wed Sep 2 19:49:54 2026 read: IOPS=1, BW=1561KiB/s (1598kB/s)(7168KiB/4593msec) clat (msec): min=95, max=277, avg=171.49, stdev=64.96 lat (msec): min=95, max=277, avg=171.50, stdev=64.96 clat percentiles (msec): | 1.00th=[ 95], 5.00th=[ 95], 10.00th=[ 95], 20.00th=[ 124], | 30.00th=[ 124], 40.00th=[ 124], 50.00th=[ 157], 60.00th=[ 203], | 70.00th=[ 203], 80.00th=[ 224], 90.00th=[ 279], 95.00th=[ 279], | 99.00th=[ 279], 99.50th=[ 279], 99.90th=[ 279], 99.95th=[ 279], | 99.99th=[ 279] bw ( KiB/s): min= 2048, max= 4382, per=78.64%, avg=3505.67, stdev=1270.96, samples=3 iops : min= 2, max= 4, avg= 3.00, stdev= 1.00, samples=3 write: IOPS=1, BW=1115KiB/s (1141kB/s)(5120KiB/4593msec); 0 zone resets clat (msec): min=75, max=2151, avg=678.06, stdev=836.36 lat (msec): min=75, max=2151, avg=678.13, stdev=836.34 clat percentiles (msec): | 1.00th=[ 77], 5.00th=[ 77], 10.00th=[ 77], 20.00th=[ 77], | 30.00th=[ 313], 40.00th=[ 313], 50.00th=[ 388], 60.00th=[ 388], | 70.00th=[ 464], 80.00th=[ 464], 90.00th=[ 2165], 95.00th=[ 2165], | 99.00th=[ 2165], 99.50th=[ 2165], 99.90th=[ 2165], 99.95th=[ 2165], | 99.99th=[ 2165] bw ( KiB/s): min= 1460, max= 3696, per=38.32%, avg=2391.67, stdev=1163.65, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (msec) : 100=16.67%, 250=41.67%, 500=33.33%, >=2000=8.33% cpu : usr=0.00%, sys=19.14%, ctx=455, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=148127: Wed Sep 2 19:49:54 2026 read: IOPS=0, BW=688KiB/s (704kB/s)(2048KiB/2978msec) clat (usec): min=609, max=113118, avg=56863.82, stdev=79555.72 lat (usec): min=610, max=113119, avg=56865.09, stdev=79555.76 clat percentiles (usec): | 1.00th=[ 611], 5.00th=[ 611], 10.00th=[ 611], 20.00th=[ 611], | 30.00th=[ 611], 40.00th=[ 611], 50.00th=[ 611], 60.00th=[112722], | 70.00th=[112722], 80.00th=[112722], 90.00th=[112722], 95.00th=[112722], | 99.00th=[112722], 99.50th=[112722], 99.90th=[112722], 99.95th=[112722], | 99.99th=[112722] bw ( KiB/s): min= 1393, max= 1848, per=36.35%, avg=1620.50, stdev=321.73, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=3, BW=3439KiB/s (3521kB/s)(10.0MiB/2978msec); 0 zone resets clat (msec): min=96, max=589, avg=286.18, stdev=173.54 lat (msec): min=96, max=589, avg=286.26, stdev=173.54 clat percentiles (msec): | 1.00th=[ 97], 5.00th=[ 97], 10.00th=[ 97], 20.00th=[ 109], | 30.00th=[ 159], 40.00th=[ 180], 50.00th=[ 241], 60.00th=[ 284], | 70.00th=[ 288], 80.00th=[ 355], 90.00th=[ 567], 95.00th=[ 592], | 99.00th=[ 592], 99.50th=[ 592], 99.90th=[ 592], 99.95th=[ 592], | 99.99th=[ 592] bw ( KiB/s): min= 2019, max= 4096, per=46.91%, avg=2928.00, stdev=946.54, samples=5 iops : min= 1, max= 4, avg= 2.20, stdev= 1.30, samples=5 lat (usec) : 750=8.33% lat (msec) : 100=8.33%, 250=41.67%, 500=25.00%, 750=16.67% cpu : usr=0.00%, sys=32.35%, ctx=233, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=148128: Wed Sep 2 19:49:54 2026 read: IOPS=1, BW=1363KiB/s (1395kB/s)(6144KiB/4509msec) clat (usec): min=469, max=2619.1k, avg=482406.34, stdev=1050853.18 lat (usec): min=471, max=2619.1k, avg=482407.50, stdev=1050853.43 clat percentiles (usec): | 1.00th=[ 469], 5.00th=[ 469], 10.00th=[ 469], | 20.00th=[ 510], 30.00th=[ 510], 40.00th=[ 824], | 50.00th=[ 824], 60.00th=[ 34866], 70.00th=[ 238027], | 80.00th=[ 238027], 90.00th=[2634023], 95.00th=[2634023], | 99.00th=[2634023], 99.50th=[2634023], 99.90th=[2634023], | 99.95th=[2634023], 99.99th=[2634023] bw ( KiB/s): min= 2019, max= 4087, per=68.48%, avg=3053.00, stdev=1462.30, samples=2 iops : min= 1, max= 3, avg= 2.00, stdev= 1.41, samples=2 write: IOPS=1, BW=1363KiB/s (1395kB/s)(6144KiB/4509msec); 0 zone resets clat (msec): min=82, max=548, avg=267.72, stdev=169.24 lat (msec): min=82, max=548, avg=267.79, stdev=169.26 clat percentiles (msec): | 1.00th=[ 83], 5.00th=[ 83], 10.00th=[ 83], 20.00th=[ 129], | 30.00th=[ 129], 40.00th=[ 203], 50.00th=[ 203], 60.00th=[ 313], | 70.00th=[ 330], 80.00th=[ 330], 90.00th=[ 550], 95.00th=[ 550], | 99.00th=[ 550], 99.50th=[ 550], 99.90th=[ 550], 99.95th=[ 550], | 99.99th=[ 550] bw ( KiB/s): min= 2019, max= 2864, per=36.99%, avg=2308.67, stdev=481.08, samples=3 iops : min= 1, max= 2, avg= 1.33, stdev= 0.58, samples=3 lat (usec) : 500=8.33%, 750=8.33%, 1000=8.33% lat (msec) : 50=8.33%, 100=8.33%, 250=25.00%, 500=16.67%, 750=8.33% lat (msec) : >=2000=8.33% cpu : usr=0.00%, sys=15.75%, ctx=524, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=148129: Wed Sep 2 19:49:54 2026 read: IOPS=2, BW=2170KiB/s (2223kB/s)(5120KiB/2359msec) clat (usec): min=861, max=208165, avg=85605.37, stdev=89122.14 lat (usec): min=862, max=208166, avg=85606.32, stdev=89122.32 clat percentiles (usec): | 1.00th=[ 865], 5.00th=[ 865], 10.00th=[ 865], 20.00th=[ 865], | 30.00th=[ 1303], 40.00th=[ 1303], 50.00th=[ 82314], 60.00th=[ 82314], | 70.00th=[135267], 80.00th=[135267], 90.00th=[208667], 95.00th=[208667], | 99.00th=[208667], 99.50th=[208667], 99.90th=[208667], 99.95th=[208667], | 99.99th=[208667] bw ( KiB/s): min= 8078, max= 8078, per=100.00%, avg=8078.00, stdev= 0.00, samples=1 iops : min= 7, max= 7, avg= 7.00, stdev= 0.00, samples=1 write: IOPS=2, BW=3039KiB/s (3112kB/s)(7168KiB/2359msec); 0 zone resets clat (msec): min=125, max=415, avg=275.59, stdev=100.56 lat (msec): min=125, max=415, avg=275.69, stdev=100.50 clat percentiles (msec): | 1.00th=[ 126], 5.00th=[ 126], 10.00th=[ 126], 20.00th=[ 224], | 30.00th=[ 226], 40.00th=[ 226], 50.00th=[ 247], 60.00th=[ 309], | 70.00th=[ 309], 80.00th=[ 384], 90.00th=[ 418], 95.00th=[ 418], | 99.00th=[ 418], 99.50th=[ 418], 99.90th=[ 418], 99.95th=[ 418], | 99.99th=[ 418] bw ( KiB/s): min= 1438, max= 6131, per=45.80%, avg=2859.00, stdev=2194.91, samples=4 iops : min= 1, max= 5, avg= 2.00, stdev= 2.00, samples=4 lat (usec) : 1000=8.33% lat (msec) : 2=8.33%, 100=8.33%, 250=50.00%, 500=25.00% cpu : usr=0.00%, sys=36.01%, ctx=372, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4459KiB/s (4566kB/s), 688KiB/s-2170KiB/s (704kB/s-2223kB/s), io=20.0MiB (20.0MB), run=2359-4593msec WRITE: bw=6243KiB/s (6392kB/s), 1115KiB/s-3439KiB/s (1141kB/s-3521kB/s), io=28.0MiB (29.4MB), run=2359-4593msec rand-rw: (groupid=0, jobs=1): err= 0: pid=148121: Wed Sep 2 19:49:54 2026 read: IOPS=2, BW=2926KiB/s (2996kB/s)(7168KiB/2450msec) clat (msec): min=39, max=188, avg=100.05, stdev=66.49 lat (msec): min=39, max=188, avg=100.05, stdev=66.49 clat percentiles (msec): | 1.00th=[ 40], 5.00th=[ 40], 10.00th=[ 40], 20.00th=[ 47], | 30.00th=[ 52], 40.00th=[ 52], 50.00th=[ 56], 60.00th=[ 140], | 70.00th=[ 140], 80.00th=[ 180], 90.00th=[ 188], 95.00th=[ 188], | 99.00th=[ 188], 99.50th=[ 188], 99.90th=[ 188], 99.95th=[ 188], | 99.99th=[ 188] bw ( KiB/s): min= 2000, max= 9326, per=100.00%, avg=5663.00, stdev=5180.26, samples=2 iops : min= 1, max= 9, avg= 5.00, stdev= 5.66, samples=2 write: IOPS=2, BW=2090KiB/s (2140kB/s)(5120KiB/2450msec); 0 zone resets clat (msec): min=93, max=574, avg=347.21, stdev=214.62 lat (msec): min=94, max=574, avg=347.33, stdev=214.70 clat percentiles (msec): | 1.00th=[ 94], 5.00th=[ 94], 10.00th=[ 94], 20.00th=[ 94], | 30.00th=[ 224], 40.00th=[ 224], 50.00th=[ 279], 60.00th=[ 279], | 70.00th=[ 567], 80.00th=[ 567], 90.00th=[ 575], 95.00th=[ 575], | 99.00th=[ 575], 99.50th=[ 575], 99.90th=[ 575], 99.95th=[ 575], | 99.99th=[ 575] bw ( KiB/s): min= 1865, max= 4023, per=47.31%, avg=2639.67, stdev=1200.87, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (msec) : 50=16.67%, 100=25.00%, 250=33.33%, 500=8.33%, 750=16.67% cpu : usr=0.00%, sys=12.00%, ctx=133, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=148122: Wed Sep 2 19:49:54 2026 read: IOPS=0, BW=645KiB/s (660kB/s)(2048KiB/3176msec) clat (msec): min=79, max=100, avg=90.01, stdev=14.59 lat (msec): min=79, max=100, avg=90.01, stdev=14.59 clat percentiles (msec): | 1.00th=[ 80], 5.00th=[ 80], 10.00th=[ 80], 20.00th=[ 80], | 30.00th=[ 80], 40.00th=[ 80], 50.00th=[ 80], 60.00th=[ 101], | 70.00th=[ 101], 80.00th=[ 101], 90.00th=[ 101], 95.00th=[ 101], | 99.00th=[ 101], 99.50th=[ 101], 99.90th=[ 101], 99.95th=[ 101], | 99.99th=[ 101] bw ( KiB/s): min= 1828, max= 2000, per=48.03%, avg=1914.00, stdev=121.62, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=3, BW=3224KiB/s (3302kB/s)(10.0MiB/3176msec); 0 zone resets clat (msec): min=95, max=570, avg=293.26, stdev=146.76 lat (msec): min=95, max=570, avg=293.35, stdev=146.77 clat percentiles (msec): | 1.00th=[ 95], 5.00th=[ 95], 10.00th=[ 95], 20.00th=[ 107], | 30.00th=[ 230], 40.00th=[ 262], 50.00th=[ 271], 60.00th=[ 275], | 70.00th=[ 279], 80.00th=[ 380], 90.00th=[ 464], 95.00th=[ 575], | 99.00th=[ 575], 99.50th=[ 575], 99.90th=[ 575], 99.95th=[ 575], | 99.99th=[ 575] bw ( KiB/s): min= 2000, max= 4096, per=64.04%, avg=3572.60, stdev=897.44, samples=5 iops : min= 1, max= 4, avg= 2.80, stdev= 1.10, samples=5 lat (msec) : 100=16.67%, 250=25.00%, 500=50.00%, 750=8.33% cpu : usr=0.00%, sys=12.38%, ctx=149, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=148123: Wed Sep 2 19:49:54 2026 read: IOPS=1, BW=1196KiB/s (1224kB/s)(6144KiB/5139msec) clat (msec): min=41, max=2408, avg=685.55, stdev=893.70 lat (msec): min=41, max=2408, avg=685.55, stdev=893.70 clat percentiles (msec): | 1.00th=[ 42], 5.00th=[ 42], 10.00th=[ 42], 20.00th=[ 90], | 30.00th=[ 90], 40.00th=[ 203], 50.00th=[ 203], 60.00th=[ 584], | 70.00th=[ 785], 80.00th=[ 785], 90.00th=[ 2400], 95.00th=[ 2400], | 99.00th=[ 2400], 99.50th=[ 2400], 99.90th=[ 2400], 99.95th=[ 2400], | 99.99th=[ 2400] bw ( KiB/s): min= 2011, max= 4087, per=63.85%, avg=2544.25, stdev=1028.61, samples=4 iops : min= 1, max= 3, avg= 1.75, stdev= 0.96, samples=4 write: IOPS=1, BW=1196KiB/s (1224kB/s)(6144KiB/5139msec); 0 zone resets clat (msec): min=93, max=348, avg=163.30, stdev=100.31 lat (msec): min=93, max=348, avg=163.46, stdev=100.24 clat percentiles (msec): | 1.00th=[ 93], 5.00th=[ 93], 10.00th=[ 93], 20.00th=[ 95], | 30.00th=[ 95], 40.00th=[ 105], 50.00th=[ 105], 60.00th=[ 131], | 70.00th=[ 209], 80.00th=[ 209], 90.00th=[ 351], 95.00th=[ 351], | 99.00th=[ 351], 99.50th=[ 351], 99.90th=[ 351], 99.95th=[ 351], | 99.99th=[ 351] bw ( KiB/s): min= 2011, max= 5626, per=70.05%, avg=3908.00, stdev=1814.14, samples=3 iops : min= 1, max= 5, avg= 3.00, stdev= 2.00, samples=3 lat (msec) : 50=8.33%, 100=25.00%, 250=33.33%, 500=8.33%, 750=8.33% lat (msec) : 1000=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=4.53%, ctx=125, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=148124: Wed Sep 2 19:49:54 2026 read: IOPS=1, BW=1759KiB/s (1802kB/s)(5120KiB/2910msec) clat (msec): min=51, max=511, avg=212.31, stdev=177.30 lat (msec): min=51, max=511, avg=212.31, stdev=177.30 clat percentiles (msec): | 1.00th=[ 52], 5.00th=[ 52], 10.00th=[ 52], 20.00th=[ 52], | 30.00th=[ 122], 40.00th=[ 122], 50.00th=[ 171], 60.00th=[ 171], | 70.00th=[ 207], 80.00th=[ 207], 90.00th=[ 510], 95.00th=[ 510], | 99.00th=[ 510], 99.50th=[ 510], 99.90th=[ 510], 99.95th=[ 510], | 99.99th=[ 510] bw ( KiB/s): min= 2000, max= 4023, per=67.51%, avg=2690.33, stdev=1154.37, samples=3 iops : min= 1, max= 3, avg= 2.00, stdev= 1.00, samples=3 write: IOPS=2, BW=2463KiB/s (2522kB/s)(7168KiB/2910msec); 0 zone resets clat (msec): min=108, max=675, avg=257.68, stdev=196.22 lat (msec): min=109, max=675, avg=257.89, stdev=196.10 clat percentiles (msec): | 1.00th=[ 109], 5.00th=[ 109], 10.00th=[ 109], 20.00th=[ 120], | 30.00th=[ 138], 40.00th=[ 138], 50.00th=[ 243], 60.00th=[ 247], | 70.00th=[ 247], 80.00th=[ 275], 90.00th=[ 676], 95.00th=[ 676], | 99.00th=[ 676], 99.50th=[ 676], 99.90th=[ 676], 99.95th=[ 676], | 99.99th=[ 676] bw ( KiB/s): min= 2011, max= 5636, per=57.93%, avg=3231.67, stdev=2082.30, samples=3 iops : min= 1, max= 5, avg= 2.67, stdev= 2.08, samples=3 lat (msec) : 100=8.33%, 250=66.67%, 500=8.33%, 750=16.67% cpu : usr=0.00%, sys=10.90%, ctx=105, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3985KiB/s (4081kB/s), 645KiB/s-2926KiB/s (660kB/s-2996kB/s), io=20.0MiB (20.0MB), run=2450-5139msec WRITE: bw=5579KiB/s (5713kB/s), 1196KiB/s-3224KiB/s (1224kB/s-3302kB/s), io=28.0MiB (29.4MB), run=2450-5139msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=148136: Wed Sep 2 19:50:04 2026 read: IOPS=1, BW=4781KiB/s (4896kB/s)(12.0MiB/2570msec) clat (msec): min=164, max=2142, avg=824.79, stdev=1141.44 lat (msec): min=164, max=2142, avg=824.79, stdev=1141.44 clat percentiles (msec): | 1.00th=[ 165], 5.00th=[ 165], 10.00th=[ 165], 20.00th=[ 165], | 30.00th=[ 165], 40.00th=[ 167], 50.00th=[ 167], 60.00th=[ 167], | 70.00th=[ 2140], 80.00th=[ 2140], 90.00th=[ 2140], 95.00th=[ 2140], | 99.00th=[ 2140], 99.50th=[ 2140], 99.90th=[ 2140], 99.95th=[ 2140], | 99.99th=[ 2140] bw ( KiB/s): min=13791, max=13791, per=100.00%, avg=13791.00, stdev= 0.00, samples=1 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=1 lat (msec) : 250=66.67%, >=2000=33.33% cpu : usr=0.00%, sys=7.32%, ctx=73, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=148137: Wed Sep 2 19:50:04 2026 read: IOPS=0, BW=1016KiB/s (1040kB/s)(4096KiB/4033msec) clat (nsec): min=721387k, max=721387k, avg=721387498.00, stdev= 0.00 lat (nsec): min=721389k, max=721389k, avg=721388616.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 718], 5.00th=[ 718], 10.00th=[ 718], 20.00th=[ 718], | 30.00th=[ 718], 40.00th=[ 718], 50.00th=[ 718], 60.00th=[ 718], | 70.00th=[ 718], 80.00th=[ 718], 90.00th=[ 718], 95.00th=[ 718], | 99.00th=[ 718], 99.50th=[ 718], 99.90th=[ 718], 99.95th=[ 718], | 99.99th=[ 718] bw ( KiB/s): min= 8175, max= 8175, per=100.00%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2031KiB/s (2080kB/s)(8192KiB/4033msec); 0 zone resets clat (msec): min=601, max=2603, avg=1602.34, stdev=1415.23 lat (msec): min=602, max=2603, avg=1602.64, stdev=1415.00 clat percentiles (msec): | 1.00th=[ 600], 5.00th=[ 600], 10.00th=[ 600], 20.00th=[ 600], | 30.00th=[ 600], 40.00th=[ 600], 50.00th=[ 600], 60.00th=[ 2601], | 70.00th=[ 2601], 80.00th=[ 2601], 90.00th=[ 2601], 95.00th=[ 2601], | 99.00th=[ 2601], 99.50th=[ 2601], 99.90th=[ 2601], 99.95th=[ 2601], | 99.99th=[ 2601] bw ( KiB/s): min= 8126, max= 8126, per=100.00%, avg=8126.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=66.67%, >=2000=33.33% cpu : usr=0.00%, sys=4.94%, ctx=63, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=148138: Wed Sep 2 19:50:04 2026 write: IOPS=0, BW=3207KiB/s (3284kB/s)(12.0MiB/3832msec); 0 zone resets clat (msec): min=310, max=3027, avg=1230.15, stdev=1557.00 lat (msec): min=311, max=3028, avg=1230.57, stdev=1557.17 clat percentiles (msec): | 1.00th=[ 313], 5.00th=[ 313], 10.00th=[ 313], 20.00th=[ 313], | 30.00th=[ 313], 40.00th=[ 351], 50.00th=[ 351], 60.00th=[ 351], | 70.00th=[ 3037], 80.00th=[ 3037], 90.00th=[ 3037], 95.00th=[ 3037], | 99.00th=[ 3037], 99.50th=[ 3037], 99.90th=[ 3037], 99.95th=[ 3037], | 99.99th=[ 3037] bw ( KiB/s): min=16253, max=16253, per=100.00%, avg=16253.00, stdev= 0.00, samples=1 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=1 lat (msec) : 500=66.67%, >=2000=33.33% cpu : usr=0.00%, sys=9.14%, ctx=126, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=148139: Wed Sep 2 19:50:04 2026 write: IOPS=0, BW=3495KiB/s (3579kB/s)(12.0MiB/3516msec); 0 zone resets clat (msec): min=264, max=2912, avg=1150.07, stdev=1526.27 lat (msec): min=264, max=2912, avg=1150.29, stdev=1526.23 clat percentiles (msec): | 1.00th=[ 264], 5.00th=[ 264], 10.00th=[ 264], 20.00th=[ 264], | 30.00th=[ 264], 40.00th=[ 275], 50.00th=[ 275], 60.00th=[ 275], | 70.00th=[ 2903], 80.00th=[ 2903], 90.00th=[ 2903], 95.00th=[ 2903], | 99.00th=[ 2903], 99.50th=[ 2903], 99.90th=[ 2903], 99.95th=[ 2903], | 99.99th=[ 2903] bw ( KiB/s): min= 7301, max= 8175, per=95.25%, avg=7738.00, stdev=618.01, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=66.67%, >=2000=33.33% cpu : usr=0.00%, sys=5.80%, ctx=79, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4062KiB/s (4160kB/s), 1016KiB/s-4781KiB/s (1040kB/s-4896kB/s), io=16.0MiB (16.8MB), run=2570-4033msec WRITE: bw=8125KiB/s (8320kB/s), 2031KiB/s-3495KiB/s (2080kB/s-3579kB/s), io=32.0MiB (33.6MB), run=3516-4033msec rand-rw: (groupid=0, jobs=1): err= 0: pid=148140: Wed Sep 2 19:50:04 2026 read: IOPS=0, BW=3488KiB/s (3572kB/s)(12.0MiB/3523msec) clat (msec): min=577, max=2158, avg=1142.11, stdev=882.14 lat (msec): min=577, max=2158, avg=1142.12, stdev=882.14 clat percentiles (msec): | 1.00th=[ 575], 5.00th=[ 575], 10.00th=[ 575], 20.00th=[ 575], | 30.00th=[ 575], 40.00th=[ 693], 50.00th=[ 693], 60.00th=[ 693], | 70.00th=[ 2165], 80.00th=[ 2165], 90.00th=[ 2165], 95.00th=[ 2165], | 99.00th=[ 2165], 99.50th=[ 2165], 99.90th=[ 2165], 99.95th=[ 2165], | 99.99th=[ 2165] bw ( KiB/s): min= 8175, max= 8192, per=100.00%, avg=8183.50, stdev=12.02, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 750=66.67%, >=2000=33.33% cpu : usr=0.00%, sys=16.98%, ctx=880, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=148141: Wed Sep 2 19:50:04 2026 read: IOPS=0, BW=1318KiB/s (1350kB/s)(4096KiB/3108msec) clat (nsec): min=621111k, max=621111k, avg=621111410.00, stdev= 0.00 lat (nsec): min=621113k, max=621113k, avg=621113491.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 625], 5.00th=[ 625], 10.00th=[ 625], 20.00th=[ 625], | 30.00th=[ 625], 40.00th=[ 625], 50.00th=[ 625], 60.00th=[ 625], | 70.00th=[ 625], 80.00th=[ 625], 90.00th=[ 625], 95.00th=[ 625], | 99.00th=[ 625], 99.50th=[ 625], 99.90th=[ 625], 99.95th=[ 625], | 99.99th=[ 625] bw ( KiB/s): min= 8192, max= 8192, per=100.00%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2636KiB/s (2699kB/s)(8192KiB/3108msec); 0 zone resets clat (msec): min=352, max=2088, avg=1220.73, stdev=1227.92 lat (msec): min=353, max=2089, avg=1221.40, stdev=1227.19 clat percentiles (msec): | 1.00th=[ 355], 5.00th=[ 355], 10.00th=[ 355], 20.00th=[ 355], | 30.00th=[ 355], 40.00th=[ 355], 50.00th=[ 355], 60.00th=[ 2089], | 70.00th=[ 2089], 80.00th=[ 2089], 90.00th=[ 2089], 95.00th=[ 2089], | 99.00th=[ 2089], 99.50th=[ 2089], 99.90th=[ 2089], 99.95th=[ 2089], | 99.99th=[ 2089] bw ( KiB/s): min= 8175, max= 8175, per=98.70%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 750=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=10.14%, ctx=184, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=148142: Wed Sep 2 19:50:04 2026 write: IOPS=0, BW=3106KiB/s (3181kB/s)(12.0MiB/3956msec); 0 zone resets clat (msec): min=207, max=3274, avg=1301.26, stdev=1711.93 lat (msec): min=208, max=3274, avg=1301.56, stdev=1711.82 clat percentiles (msec): | 1.00th=[ 209], 5.00th=[ 209], 10.00th=[ 209], 20.00th=[ 209], | 30.00th=[ 209], 40.00th=[ 422], 50.00th=[ 422], 60.00th=[ 422], | 70.00th=[ 3272], 80.00th=[ 3272], 90.00th=[ 3272], 95.00th=[ 3272], | 99.00th=[ 3272], 99.50th=[ 3272], 99.90th=[ 3272], 99.95th=[ 3272], | 99.99th=[ 3272] bw ( KiB/s): min= 8192, max= 8192, per=98.90%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 500=33.33%, >=2000=33.33% cpu : usr=0.03%, sys=4.45%, ctx=94, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=148143: Wed Sep 2 19:50:04 2026 write: IOPS=0, BW=3345KiB/s (3426kB/s)(12.0MiB/3673msec); 0 zone resets clat (msec): min=600, max=2046, avg=1202.57, stdev=752.86 lat (msec): min=600, max=2046, avg=1202.87, stdev=752.85 clat percentiles (msec): | 1.00th=[ 600], 5.00th=[ 600], 10.00th=[ 600], 20.00th=[ 600], | 30.00th=[ 600], 40.00th=[ 961], 50.00th=[ 961], 60.00th=[ 961], | 70.00th=[ 2039], 80.00th=[ 2039], 90.00th=[ 2039], 95.00th=[ 2039], | 99.00th=[ 2039], 99.50th=[ 2039], 99.90th=[ 2039], 99.95th=[ 2039], | 99.99th=[ 2039] bw ( KiB/s): min= 8175, max= 8192, per=98.80%, avg=8183.50, stdev=12.02, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 750=33.33%, 1000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=4.17%, ctx=52, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4651KiB/s (4762kB/s), 1318KiB/s-3488KiB/s (1350kB/s-3572kB/s), io=16.0MiB (16.8MB), run=3108-3523msec WRITE: bw=8283KiB/s (8482kB/s), 2636KiB/s-3345KiB/s (2699kB/s-3426kB/s), io=32.0MiB (33.6MB), run=3108-3956msec