== sanity test 398b: DIO and buffer IO race ============== 06:51:09 (1790679069) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 5.43118 s, 9.3 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=180203: Tue Sep 29 06:53:18 2026 read: IOPS=13, BW=53.8KiB/s (55.1kB/s)(5992KiB/111305msec) clat (usec): min=32, max=953951, avg=40963.55, stdev=35984.88 lat (usec): min=32, max=953953, avg=40964.63, stdev=35984.90 clat percentiles (usec): | 1.00th=[ 55], 5.00th=[ 10290], 10.00th=[ 15926], 20.00th=[ 20579], | 30.00th=[ 24773], 40.00th=[ 29230], 50.00th=[ 34866], 60.00th=[ 41157], | 70.00th=[ 48497], 80.00th=[ 57410], 90.00th=[ 70779], 95.00th=[ 85459], | 99.00th=[143655], 99.50th=[183501], 99.90th=[316670], 99.95th=[952108], | 99.99th=[952108] bw ( KiB/s): min= 8, max= 104, per=25.53%, avg=54.38, stdev=19.32, samples=216 iops : min= 2, max= 26, avg=12.96, stdev= 4.85, samples=216 write: IOPS=14, BW=56.6KiB/s (57.9kB/s)(6296KiB/111305msec); 0 zone resets clat (usec): min=1011, max=256989, avg=31451.69, stdev=33149.48 lat (usec): min=1012, max=256991, avg=31455.24, stdev=33149.01 clat percentiles (usec): | 1.00th=[ 1074], 5.00th=[ 1287], 10.00th=[ 1778], 20.00th=[ 3490], | 30.00th=[ 6390], 40.00th=[ 13566], 50.00th=[ 21890], 60.00th=[ 30278], | 70.00th=[ 39584], 80.00th=[ 54264], 90.00th=[ 77071], 95.00th=[ 99091], | 99.00th=[137364], 99.50th=[154141], 99.90th=[250610], 99.95th=[256902], | 99.99th=[256902] bw ( KiB/s): min= 7, max= 143, per=25.37%, avg=56.58, stdev=23.29, samples=218 iops : min= 1, max= 35, avg=13.53, stdev= 5.87, samples=218 lat (usec) : 50=0.23%, 100=1.30%, 250=0.36%, 500=0.03%, 750=0.03% lat (msec) : 2=6.35%, 4=5.05%, 10=7.42%, 20=12.21%, 50=41.24% lat (msec) : 100=21.91%, 250=3.74%, 500=0.10%, 1000=0.03% cpu : usr=0.09%, sys=5.99%, ctx=6505, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180204: Tue Sep 29 06:53:18 2026 read: IOPS=13, BW=52.0KiB/s (54.2kB/s)(5940KiB/112122msec) clat (usec): min=38, max=956521, avg=41367.42, stdev=36182.99 lat (usec): min=38, max=956522, avg=41368.85, stdev=36183.11 clat percentiles (usec): | 1.00th=[ 56], 5.00th=[ 9110], 10.00th=[ 15533], 20.00th=[ 21365], | 30.00th=[ 25297], 40.00th=[ 29492], 50.00th=[ 35390], 60.00th=[ 41681], | 70.00th=[ 49021], 80.00th=[ 57410], 90.00th=[ 71828], 95.00th=[ 86508], | 99.00th=[149947], 99.50th=[170918], 99.90th=[270533], 99.95th=[960496], | 99.99th=[960496] bw ( KiB/s): min= 5, max= 144, per=24.71%, avg=52.64, stdev=20.46, samples=220 iops : min= 1, max= 36, avg=12.53, stdev= 5.15, samples=220 write: IOPS=14, BW=56.6KiB/s (57.0kB/s)(6348KiB/112122msec); 0 zone resets clat (usec): min=882, max=213065, avg=31676.15, stdev=33523.52 lat (usec): min=883, max=213066, avg=31678.19, stdev=33523.02 clat percentiles (usec): | 1.00th=[ 1074], 5.00th=[ 1237], 10.00th=[ 1614], 20.00th=[ 3294], | 30.00th=[ 6063], 40.00th=[ 12649], 50.00th=[ 21890], 60.00th=[ 30016], | 70.00th=[ 40633], 80.00th=[ 56886], 90.00th=[ 80217], 95.00th=[101188], | 99.00th=[141558], 99.50th=[154141], 99.90th=[200279], 99.95th=[212861], | 99.99th=[212861] bw ( KiB/s): min= 8, max= 135, per=25.20%, avg=56.19, stdev=22.20, samples=220 iops : min= 2, max= 33, avg=13.42, stdev= 5.54, samples=220 lat (usec) : 50=0.10%, 100=1.63%, 250=0.23%, 500=0.07%, 750=0.13% lat (usec) : 1000=0.07% lat (msec) : 2=6.54%, 4=4.98%, 10=7.94%, 20=12.04%, 50=40.14% lat (msec) : 100=22.17%, 250=3.91%, 500=0.03%, 1000=0.03% cpu : usr=0.07%, sys=5.99%, ctx=6499, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180205: Tue Sep 29 06:53:18 2026 read: IOPS=13, BW=53.8KiB/s (55.1kB/s)(6028KiB/112127msec) clat (usec): min=29, max=959370, avg=41049.37, stdev=35938.20 lat (usec): min=29, max=959371, avg=41051.04, stdev=35937.72 clat percentiles (usec): | 1.00th=[ 51], 5.00th=[ 9503], 10.00th=[ 15139], 20.00th=[ 20317], | 30.00th=[ 24773], 40.00th=[ 29492], 50.00th=[ 35390], 60.00th=[ 40633], | 70.00th=[ 48497], 80.00th=[ 57410], 90.00th=[ 73925], 95.00th=[ 89654], | 99.00th=[126354], 99.50th=[168821], 99.90th=[316670], 99.95th=[960496], | 99.99th=[960496] bw ( KiB/s): min= 5, max= 118, per=25.11%, avg=53.48, stdev=20.55, samples=220 iops : min= 1, max= 29, avg=12.75, stdev= 5.17, samples=220 write: IOPS=13, BW=55.8KiB/s (57.2kB/s)(6260KiB/112127msec); 0 zone resets clat (usec): min=946, max=239280, avg=31824.02, stdev=33165.47 lat (usec): min=947, max=239282, avg=31826.67, stdev=33166.35 clat percentiles (usec): | 1.00th=[ 1074], 5.00th=[ 1254], 10.00th=[ 1663], 20.00th=[ 3130], | 30.00th=[ 6390], 40.00th=[ 13960], 50.00th=[ 22676], 60.00th=[ 31065], | 70.00th=[ 41157], 80.00th=[ 56886], 90.00th=[ 76022], 95.00th=[ 94897], | 99.00th=[139461], 99.50th=[166724], 99.90th=[235930], 99.95th=[240124], | 99.99th=[240124] bw ( KiB/s): min= 7, max= 142, per=24.99%, avg=55.72, stdev=24.33, samples=219 iops : min= 1, max= 35, avg=13.31, stdev= 6.11, samples=219 lat (usec) : 50=0.39%, 100=1.43%, 250=0.26%, 500=0.03%, 750=0.10% lat (usec) : 1000=0.20% lat (msec) : 2=6.18%, 4=5.57%, 10=6.54%, 20=12.21%, 50=41.11% lat (msec) : 100=22.49%, 250=3.42%, 500=0.03%, 1000=0.03% cpu : usr=0.07%, sys=6.02%, ctx=6636, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180206: Tue Sep 29 06:53:18 2026 read: IOPS=13, BW=53.9KiB/s (55.2kB/s)(6052KiB/112309msec) clat (usec): min=31, max=816259, avg=41312.16, stdev=33669.76 lat (usec): min=31, max=816260, avg=41313.46, stdev=33669.73 clat percentiles (usec): | 1.00th=[ 53], 5.00th=[ 10683], 10.00th=[ 15401], 20.00th=[ 20841], | 30.00th=[ 24773], 40.00th=[ 29754], 50.00th=[ 34866], 60.00th=[ 40633], | 70.00th=[ 47973], 80.00th=[ 58459], 90.00th=[ 73925], 95.00th=[ 89654], | 99.00th=[139461], 99.50th=[168821], 99.90th=[219153], 99.95th=[817890], | 99.99th=[817890] bw ( KiB/s): min= 7, max= 141, per=25.18%, avg=53.64, stdev=20.19, samples=221 iops : min= 1, max= 35, avg=12.79, stdev= 5.10, samples=221 write: IOPS=13, BW=55.5KiB/s (56.9kB/s)(6236KiB/112309msec); 0 zone resets clat (usec): min=998, max=242675, avg=31705.64, stdev=33587.21 lat (usec): min=999, max=242676, avg=31709.92, stdev=33593.57 clat percentiles (usec): | 1.00th=[ 1074], 5.00th=[ 1254], 10.00th=[ 1663], 20.00th=[ 3294], | 30.00th=[ 5997], 40.00th=[ 13960], 50.00th=[ 22414], 60.00th=[ 30016], | 70.00th=[ 41157], 80.00th=[ 54789], 90.00th=[ 77071], 95.00th=[100140], | 99.00th=[139461], 99.50th=[170918], 99.90th=[240124], 99.95th=[242222], | 99.99th=[242222] bw ( KiB/s): min= 15, max= 135, per=24.89%, avg=55.50, stdev=22.62, samples=220 iops : min= 3, max= 33, avg=13.25, stdev= 5.68, samples=220 lat (usec) : 50=0.36%, 100=1.30%, 250=0.10%, 500=0.07%, 750=0.03% lat (usec) : 1000=0.03% lat (msec) : 2=6.61%, 4=5.18%, 10=6.74%, 20=12.14%, 50=41.99% lat (msec) : 100=21.35%, 250=4.07%, 1000=0.03% cpu : usr=0.07%, sys=5.89%, ctx=6613, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=214KiB/s (219kB/s), 52.0KiB/s-53.9KiB/s (54.2kB/s-55.2kB/s), io=23.4MiB (24.6MB), run=111305-112309msec WRITE: bw=224KiB/s (229kB/s), 55.5KiB/s-56.6KiB/s (56.9kB/s-57.0kB/s), io=24.6MiB (25.7MB), run=111305-112309msec rand-rw: (groupid=0, jobs=1): err= 0: pid=180208: Tue Sep 29 06:53:52 2026 read: IOPS=10, BW=40.0KiB/s (41.0kB/s)(5992KiB/146225msec) clat (msec): min=5, max=981, avg=38.60, stdev=43.89 lat (msec): min=5, max=981, avg=38.60, stdev=43.89 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 14], | 30.00th=[ 17], 40.00th=[ 20], 50.00th=[ 24], 60.00th=[ 30], | 70.00th=[ 39], 80.00th=[ 57], 90.00th=[ 89], 95.00th=[ 115], | 99.00th=[ 165], 99.50th=[ 211], 99.90th=[ 338], 99.95th=[ 986], | 99.99th=[ 986] bw ( KiB/s): min= 7, max= 143, per=25.36%, avg=41.34, stdev=29.28, samples=282 iops : min= 1, max= 35, avg= 9.70, stdev= 7.35, samples=282 write: IOPS=10, BW=43.1KiB/s (44.1kB/s)(6296KiB/146225msec); 0 zone resets clat (msec): min=11, max=306, avg=56.09, stdev=41.18 lat (msec): min=11, max=306, avg=56.10, stdev=41.18 clat percentiles (msec): | 1.00th=[ 15], 5.00th=[ 18], 10.00th=[ 22], 20.00th=[ 25], | 30.00th=[ 29], 40.00th=[ 34], 50.00th=[ 40], 60.00th=[ 51], | 70.00th=[ 65], 80.00th=[ 85], 90.00th=[ 115], 95.00th=[ 140], | 99.00th=[ 201], 99.50th=[ 211], 99.90th=[ 271], 99.95th=[ 309], | 99.99th=[ 309] bw ( KiB/s): min= 7, max= 142, per=24.89%, avg=42.57, stdev=28.93, samples=288 iops : min= 1, max= 35, avg=10.00, stdev= 7.27, samples=288 lat (msec) : 10=3.48%, 20=20.35%, 50=43.85%, 100=21.58%, 250=10.48% lat (msec) : 500=0.23%, 1000=0.03% cpu : usr=0.07%, sys=2.01%, ctx=4883, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180209: Tue Sep 29 06:53:52 2026 read: IOPS=10, BW=40.6KiB/s (41.6kB/s)(5940KiB/146379msec) clat (msec): min=5, max=839, avg=37.15, stdev=39.44 lat (msec): min=5, max=839, avg=37.16, stdev=39.44 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 15], | 30.00th=[ 17], 40.00th=[ 21], 50.00th=[ 25], 60.00th=[ 30], | 70.00th=[ 39], 80.00th=[ 54], 90.00th=[ 84], 95.00th=[ 111], | 99.00th=[ 163], 99.50th=[ 184], 99.90th=[ 292], 99.95th=[ 844], | 99.99th=[ 844] bw ( KiB/s): min= 7, max= 133, per=25.18%, avg=41.04, stdev=28.72, samples=281 iops : min= 1, max= 33, avg= 9.62, stdev= 7.22, samples=281 write: IOPS=10, BW=43.4KiB/s (44.4kB/s)(6348KiB/146379msec); 0 zone resets clat (msec): min=11, max=311, avg=57.37, stdev=41.22 lat (msec): min=11, max=311, avg=57.38, stdev=41.22 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 19], 10.00th=[ 22], 20.00th=[ 26], | 30.00th=[ 31], 40.00th=[ 36], 50.00th=[ 43], 60.00th=[ 53], | 70.00th=[ 68], 80.00th=[ 87], 90.00th=[ 114], 95.00th=[ 136], | 99.00th=[ 203], 99.50th=[ 239], 99.90th=[ 309], 99.95th=[ 313], | 99.99th=[ 313] bw ( KiB/s): min= 7, max= 128, per=25.06%, avg=42.85, stdev=27.14, samples=287 iops : min= 1, max= 32, avg=10.07, stdev= 6.84, samples=287 lat (msec) : 10=3.16%, 20=19.92%, 50=44.95%, 100=21.78%, 250=9.90% lat (msec) : 500=0.26%, 1000=0.03% cpu : usr=0.06%, sys=2.05%, ctx=4958, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180210: Tue Sep 29 06:53:52 2026 read: IOPS=10, BW=41.2KiB/s (42.1kB/s)(6028KiB/146454msec) clat (msec): min=5, max=281, avg=37.63, stdev=34.77 lat (msec): min=5, max=281, avg=37.63, stdev=34.77 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 11], 20.00th=[ 14], | 30.00th=[ 17], 40.00th=[ 21], 50.00th=[ 25], 60.00th=[ 31], | 70.00th=[ 40], 80.00th=[ 56], 90.00th=[ 84], 95.00th=[ 113], | 99.00th=[ 176], 99.50th=[ 203], 99.90th=[ 247], 99.95th=[ 284], | 99.99th=[ 284] bw ( KiB/s): min= 7, max= 144, per=25.08%, avg=40.88, stdev=29.13, samples=288 iops : min= 1, max= 36, avg= 9.58, stdev= 7.32, samples=288 write: IOPS=10, BW=42.7KiB/s (43.8kB/s)(6260KiB/146454msec); 0 zone resets clat (msec): min=11, max=862, avg=57.28, stdev=48.14 lat (msec): min=11, max=862, avg=57.28, stdev=48.14 clat percentiles (msec): | 1.00th=[ 15], 5.00th=[ 19], 10.00th=[ 22], 20.00th=[ 26], | 30.00th=[ 30], 40.00th=[ 35], 50.00th=[ 41], 60.00th=[ 51], | 70.00th=[ 65], 80.00th=[ 85], 90.00th=[ 114], 95.00th=[ 144], | 99.00th=[ 226], 99.50th=[ 275], 99.90th=[ 368], 99.95th=[ 860], | 99.99th=[ 860] bw ( KiB/s): min= 7, max= 135, per=24.83%, avg=42.45, stdev=28.78, samples=288 iops : min= 1, max= 33, avg= 9.97, stdev= 7.23, samples=288 lat (msec) : 10=2.90%, 20=20.31%, 50=44.99%, 100=21.13%, 250=10.25% lat (msec) : 500=0.39%, 1000=0.03% cpu : usr=0.06%, sys=1.99%, ctx=4927, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180211: Tue Sep 29 06:53:52 2026 read: IOPS=10, BW=41.4KiB/s (42.4kB/s)(6052KiB/146088msec) clat (msec): min=5, max=334, avg=36.70, stdev=34.93 lat (msec): min=5, max=334, avg=36.70, stdev=34.93 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 11], 20.00th=[ 14], | 30.00th=[ 16], 40.00th=[ 20], 50.00th=[ 24], 60.00th=[ 29], | 70.00th=[ 39], 80.00th=[ 55], 90.00th=[ 85], 95.00th=[ 114], | 99.00th=[ 155], 99.50th=[ 178], 99.90th=[ 300], 99.95th=[ 334], | 99.99th=[ 334] bw ( KiB/s): min= 7, max= 159, per=25.95%, avg=42.30, stdev=29.97, samples=279 iops : min= 1, max= 39, avg= 9.93, stdev= 7.53, samples=279 write: IOPS=10, BW=42.7KiB/s (43.7kB/s)(6236KiB/146088msec); 0 zone resets clat (msec): min=8, max=847, avg=58.02, stdev=47.42 lat (msec): min=8, max=847, avg=58.02, stdev=47.42 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 19], 10.00th=[ 22], 20.00th=[ 26], | 30.00th=[ 30], 40.00th=[ 35], 50.00th=[ 42], 60.00th=[ 51], | 70.00th=[ 68], 80.00th=[ 86], 90.00th=[ 116], 95.00th=[ 140], | 99.00th=[ 220], 99.50th=[ 271], 99.90th=[ 351], 99.95th=[ 852], | 99.99th=[ 852] bw ( KiB/s): min= 7, max= 126, per=24.68%, avg=42.21, stdev=27.71, samples=288 iops : min= 1, max= 31, avg= 9.91, stdev= 6.98, samples=288 lat (msec) : 10=3.81%, 20=20.15%, 50=44.66%, 100=20.35%, 250=10.58% lat (msec) : 500=0.42%, 1000=0.03% cpu : usr=0.05%, sys=2.00%, ctx=4853, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=164KiB/s (168kB/s), 40.6KiB/s-41.4KiB/s (41.6kB/s-42.4kB/s), io=23.4MiB (24.6MB), run=146088-146454msec WRITE: bw=172KiB/s (176kB/s), 42.7KiB/s-43.4KiB/s (43.7kB/s-44.4kB/s), io=24.6MiB (25.7MB), run=146088-146454msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=180253: Tue Sep 29 06:54:34 2026 read: IOPS=11, BW=191KiB/s (196kB/s)(5920KiB/31008msec) clat (usec): min=31, max=238093, avg=42611.74, stdev=29817.11 lat (usec): min=31, max=238094, avg=42612.80, stdev=29817.11 clat percentiles (usec): | 1.00th=[ 44], 5.00th=[ 57], 10.00th=[ 82], 20.00th=[ 20579], | 30.00th=[ 28181], 40.00th=[ 33817], 50.00th=[ 39060], 60.00th=[ 45351], | 70.00th=[ 52167], 80.00th=[ 62129], 90.00th=[ 77071], 95.00th=[ 89654], | 99.00th=[141558], 99.50th=[168821], 99.90th=[238027], 99.95th=[238027], | 99.99th=[238027] bw ( KiB/s): min= 62, max= 413, per=26.30%, avg=190.44, stdev=79.12, samples=61 iops : min= 3, max= 25, avg=11.07, stdev= 4.99, samples=61 write: IOPS=12, BW=205KiB/s (210kB/s)(6368KiB/31008msec); 0 zone resets clat (usec): min=1407, max=239239, avg=37386.40, stdev=36410.50 lat (usec): min=1408, max=239240, avg=37388.38, stdev=36410.56 clat percentiles (usec): | 1.00th=[ 1500], 5.00th=[ 1811], 10.00th=[ 2474], 20.00th=[ 4686], | 30.00th=[ 9241], 40.00th=[ 17433], 50.00th=[ 26346], 60.00th=[ 38011], | 70.00th=[ 53216], 80.00th=[ 67634], 90.00th=[ 88605], 95.00th=[106431], | 99.00th=[152044], 99.50th=[181404], 99.90th=[240124], 99.95th=[240124], | 99.99th=[240124] bw ( KiB/s): min= 27, max= 478, per=27.04%, avg=205.80, stdev=79.85, samples=61 iops : min= 1, max= 29, avg=12.03, stdev= 5.03, samples=61 lat (usec) : 50=0.78%, 100=4.56%, 250=0.65%, 500=0.13% lat (msec) : 2=3.52%, 4=5.60%, 10=7.16%, 20=9.38%, 50=36.46% lat (msec) : 100=26.69%, 250=5.08% cpu : usr=0.05%, sys=5.89%, ctx=1678, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180254: Tue Sep 29 06:54:34 2026 read: IOPS=10, BW=174KiB/s (178kB/s)(5744KiB/33076msec) clat (usec): min=40, max=187096, avg=46411.89, stdev=31977.60 lat (usec): min=40, max=187097, avg=46414.00, stdev=31977.73 clat percentiles (usec): | 1.00th=[ 53], 5.00th=[ 59], 10.00th=[ 93], 20.00th=[ 23725], | 30.00th=[ 28967], 40.00th=[ 34866], 50.00th=[ 41681], 60.00th=[ 49021], | 70.00th=[ 56886], 80.00th=[ 70779], 90.00th=[ 86508], 95.00th=[106431], | 99.00th=[156238], 99.50th=[175113], 99.90th=[187696], 99.95th=[187696], | 99.99th=[187696] bw ( KiB/s): min= 27, max= 380, per=24.09%, avg=174.43, stdev=69.18, samples=65 iops : min= 1, max= 23, avg=10.06, stdev= 4.37, samples=65 write: IOPS=12, BW=198KiB/s (203kB/s)(6544KiB/33076msec); 0 zone resets clat (usec): min=1436, max=278104, avg=39197.33, stdev=37731.04 lat (usec): min=1438, max=278106, avg=39200.06, stdev=37731.06 clat percentiles (usec): | 1.00th=[ 1516], 5.00th=[ 2180], 10.00th=[ 3228], 20.00th=[ 6128], | 30.00th=[ 10552], 40.00th=[ 21890], 50.00th=[ 28705], 60.00th=[ 37487], | 70.00th=[ 49546], 80.00th=[ 67634], 90.00th=[ 90702], 95.00th=[110625], | 99.00th=[152044], 99.50th=[158335], 99.90th=[278922], 99.95th=[278922], | 99.99th=[278922] bw ( KiB/s): min= 55, max= 383, per=25.99%, avg=197.82, stdev=77.13, samples=65 iops : min= 3, max= 23, avg=11.54, stdev= 4.84, samples=65 lat (usec) : 50=0.13%, 100=4.56%, 250=0.26%, 500=0.26% lat (msec) : 2=2.47%, 4=4.69%, 10=8.46%, 20=6.64%, 50=39.45% lat (msec) : 100=26.30%, 250=6.64%, 500=0.13% cpu : usr=0.08%, sys=5.64%, ctx=1651, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180255: Tue Sep 29 06:54:34 2026 read: IOPS=12, BW=196KiB/s (201kB/s)(6256KiB/31897msec) clat (usec): min=41, max=179026, avg=45113.54, stdev=30287.69 lat (usec): min=41, max=179027, avg=45114.93, stdev=30287.71 clat percentiles (usec): | 1.00th=[ 49], 5.00th=[ 61], 10.00th=[ 101], 20.00th=[ 22414], | 30.00th=[ 30278], 40.00th=[ 35914], 50.00th=[ 41157], 60.00th=[ 47973], | 70.00th=[ 55837], 80.00th=[ 64226], 90.00th=[ 81265], 95.00th=[ 98042], | 99.00th=[145753], 99.50th=[152044], 99.90th=[179307], 99.95th=[179307], | 99.99th=[179307] bw ( KiB/s): min= 27, max= 382, per=27.18%, avg=196.79, stdev=70.15, samples=62 iops : min= 1, max= 23, avg=11.47, stdev= 4.41, samples=62 write: IOPS=11, BW=189KiB/s (194kB/s)(6032KiB/31897msec); 0 zone resets clat (usec): min=1318, max=166236, avg=36773.32, stdev=34051.33 lat (usec): min=1319, max=166237, avg=36775.25, stdev=34051.34 clat percentiles (usec): | 1.00th=[ 1549], 5.00th=[ 1827], 10.00th=[ 3130], 20.00th=[ 7439], | 30.00th=[ 12911], 40.00th=[ 20317], 50.00th=[ 26608], 60.00th=[ 34866], | 70.00th=[ 45351], 80.00th=[ 62129], 90.00th=[ 91751], 95.00th=[107480], | 99.00th=[145753], 99.50th=[158335], 99.90th=[166724], 99.95th=[166724], | 99.99th=[166724] bw ( KiB/s): min= 62, max= 380, per=24.58%, avg=187.05, stdev=78.42, samples=62 iops : min= 3, max= 23, avg=10.85, stdev= 4.95, samples=62 lat (usec) : 50=0.52%, 100=4.56%, 250=0.39%, 500=0.13%, 1000=0.13% lat (msec) : 2=3.39%, 4=2.60%, 10=6.90%, 20=9.11%, 50=40.49% lat (msec) : 100=25.65%, 250=6.12% cpu : usr=0.06%, sys=5.62%, ctx=1734, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180256: Tue Sep 29 06:54:34 2026 read: IOPS=12, BW=203KiB/s (208kB/s)(6032KiB/29716msec) clat (usec): min=43, max=163835, avg=41679.81, stdev=25891.12 lat (usec): min=43, max=163836, avg=41680.91, stdev=25891.15 clat percentiles (usec): | 1.00th=[ 52], 5.00th=[ 62], 10.00th=[ 206], 20.00th=[ 22676], | 30.00th=[ 28443], 40.00th=[ 33817], 50.00th=[ 39584], 60.00th=[ 45351], | 70.00th=[ 51119], 80.00th=[ 61080], 90.00th=[ 71828], 95.00th=[ 87557], | 99.00th=[121111], 99.50th=[128451], 99.90th=[164627], 99.95th=[164627], | 99.99th=[164627] bw ( KiB/s): min= 63, max= 318, per=27.98%, avg=202.60, stdev=60.74, samples=58 iops : min= 3, max= 19, avg=11.83, stdev= 3.82, samples=58 write: IOPS=13, BW=211KiB/s (216kB/s)(6256KiB/29716msec); 0 zone resets clat (usec): min=1403, max=185406, avg=35509.78, stdev=35800.37 lat (usec): min=1404, max=185408, avg=35511.96, stdev=35800.21 clat percentiles (usec): | 1.00th=[ 1467], 5.00th=[ 1778], 10.00th=[ 2737], 20.00th=[ 5014], | 30.00th=[ 8094], 40.00th=[ 15926], 50.00th=[ 25035], 60.00th=[ 31851], | 70.00th=[ 45351], 80.00th=[ 62129], 90.00th=[ 87557], 95.00th=[108528], | 99.00th=[156238], 99.50th=[179307], 99.90th=[185598], 99.95th=[185598], | 99.99th=[185598] bw ( KiB/s): min= 62, max= 441, per=27.83%, avg=211.81, stdev=71.37, samples=58 iops : min= 3, max= 27, avg=12.41, stdev= 4.52, samples=58 lat (usec) : 50=0.39%, 100=3.91%, 250=0.65%, 1000=0.13% lat (msec) : 2=4.17%, 4=3.65%, 10=8.59%, 20=9.24%, 50=39.97% lat (msec) : 100=24.22%, 250=5.08% cpu : usr=0.04%, sys=6.18%, ctx=1648, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=724KiB/s (742kB/s), 174KiB/s-203KiB/s (178kB/s-208kB/s), io=23.4MiB (24.5MB), run=29716-33076msec WRITE: bw=762KiB/s (780kB/s), 189KiB/s-211KiB/s (194kB/s-216kB/s), io=24.6MiB (25.8MB), run=29716-33076msec rand-rw: (groupid=0, jobs=1): err= 0: pid=180249: Tue Sep 29 06:54:46 2026 read: IOPS=8, BW=133KiB/s (136kB/s)(5920KiB/44615msec) clat (msec): min=8, max=288, avg=45.41, stdev=38.63 lat (msec): min=8, max=288, avg=45.41, stdev=38.63 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 15], 10.00th=[ 17], 20.00th=[ 21], | 30.00th=[ 24], 40.00th=[ 28], 50.00th=[ 33], 60.00th=[ 38], | 70.00th=[ 48], 80.00th=[ 60], 90.00th=[ 91], 95.00th=[ 134], | 99.00th=[ 209], 99.50th=[ 226], 99.90th=[ 288], 99.95th=[ 288], | 99.99th=[ 288] bw ( KiB/s): min= 31, max= 380, per=24.93%, avg=132.62, stdev=80.53, samples=87 iops : min= 1, max= 23, avg= 7.51, stdev= 5.12, samples=87 write: IOPS=8, BW=143KiB/s (146kB/s)(6368KiB/44615msec); 0 zone resets clat (msec): min=14, max=357, avg=69.25, stdev=44.10 lat (msec): min=14, max=357, avg=69.25, stdev=44.10 clat percentiles (msec): | 1.00th=[ 19], 5.00th=[ 28], 10.00th=[ 31], 20.00th=[ 37], | 30.00th=[ 42], 40.00th=[ 48], 50.00th=[ 56], 60.00th=[ 67], | 70.00th=[ 77], 80.00th=[ 97], 90.00th=[ 131], 95.00th=[ 159], | 99.00th=[ 203], 99.50th=[ 300], 99.90th=[ 359], 99.95th=[ 359], | 99.99th=[ 359] bw ( KiB/s): min= 30, max= 384, per=25.91%, avg=145.07, stdev=71.90, samples=86 iops : min= 1, max= 24, avg= 8.28, stdev= 4.59, samples=86 lat (msec) : 10=0.52%, 20=8.85%, 50=47.66%, 100=29.04%, 250=13.54% lat (msec) : 500=0.39% cpu : usr=0.04%, sys=1.81%, ctx=1227, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180250: Tue Sep 29 06:54:46 2026 read: IOPS=8, BW=129KiB/s (132kB/s)(5744KiB/44541msec) clat (msec): min=7, max=345, avg=46.82, stdev=39.41 lat (msec): min=7, max=345, avg=46.83, stdev=39.41 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 14], 10.00th=[ 18], 20.00th=[ 22], | 30.00th=[ 26], 40.00th=[ 30], 50.00th=[ 34], 60.00th=[ 41], | 70.00th=[ 51], 80.00th=[ 64], 90.00th=[ 88], 95.00th=[ 123], | 99.00th=[ 203], 99.50th=[ 239], 99.90th=[ 347], 99.95th=[ 347], | 99.99th=[ 347] bw ( KiB/s): min= 31, max= 383, per=24.98%, avg=132.92, stdev=74.55, samples=85 iops : min= 1, max= 23, avg= 7.52, stdev= 4.73, samples=85 write: IOPS=9, BW=147KiB/s (150kB/s)(6544KiB/44541msec); 0 zone resets clat (msec): min=17, max=223, avg=67.63, stdev=39.86 lat (msec): min=17, max=223, avg=67.63, stdev=39.86 clat percentiles (msec): | 1.00th=[ 20], 5.00th=[ 27], 10.00th=[ 30], 20.00th=[ 36], | 30.00th=[ 41], 40.00th=[ 48], 50.00th=[ 56], 60.00th=[ 66], | 70.00th=[ 75], 80.00th=[ 97], 90.00th=[ 123], 95.00th=[ 153], | 99.00th=[ 192], 99.50th=[ 209], 99.90th=[ 224], 99.95th=[ 224], | 99.99th=[ 224] bw ( KiB/s): min= 31, max= 414, per=26.13%, avg=146.35, stdev=74.49, samples=88 iops : min= 1, max= 25, avg= 8.35, stdev= 4.74, samples=88 lat (msec) : 10=0.26%, 20=8.33%, 50=46.88%, 100=30.47%, 250=13.93% lat (msec) : 500=0.13% cpu : usr=0.05%, sys=1.86%, ctx=1240, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180251: Tue Sep 29 06:54:46 2026 read: IOPS=8, BW=140KiB/s (143kB/s)(6256KiB/44686msec) clat (msec): min=7, max=271, avg=47.24, stdev=39.81 lat (msec): min=7, max=271, avg=47.24, stdev=39.81 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 14], 10.00th=[ 17], 20.00th=[ 21], | 30.00th=[ 26], 40.00th=[ 30], 50.00th=[ 33], 60.00th=[ 38], | 70.00th=[ 46], 80.00th=[ 69], 90.00th=[ 104], 95.00th=[ 136], | 99.00th=[ 203], 99.50th=[ 226], 99.90th=[ 271], 99.95th=[ 271], | 99.99th=[ 271] bw ( KiB/s): min= 31, max= 416, per=26.36%, avg=140.25, stdev=85.97, samples=88 iops : min= 1, max= 26, avg= 7.98, stdev= 5.46, samples=88 write: IOPS=8, BW=135KiB/s (138kB/s)(6032KiB/44686msec); 0 zone resets clat (msec): min=14, max=233, avg=69.03, stdev=39.13 lat (msec): min=14, max=233, avg=69.04, stdev=39.12 clat percentiles (msec): | 1.00th=[ 18], 5.00th=[ 26], 10.00th=[ 31], 20.00th=[ 37], | 30.00th=[ 45], 40.00th=[ 51], 50.00th=[ 57], 60.00th=[ 68], | 70.00th=[ 85], 80.00th=[ 99], 90.00th=[ 118], 95.00th=[ 148], | 99.00th=[ 218], 99.50th=[ 230], 99.90th=[ 234], 99.95th=[ 234], | 99.99th=[ 234] bw ( KiB/s): min= 31, max= 384, per=23.75%, avg=133.02, stdev=71.62, samples=88 iops : min= 1, max= 24, avg= 7.52, stdev= 4.60, samples=88 lat (msec) : 10=0.26%, 20=10.29%, 50=46.35%, 100=28.52%, 250=14.45% lat (msec) : 500=0.13% cpu : usr=0.05%, sys=1.73%, ctx=1123, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180252: Tue Sep 29 06:54:46 2026 read: IOPS=8, BW=134KiB/s (137kB/s)(6032KiB/44966msec) clat (msec): min=7, max=334, avg=47.58, stdev=43.17 lat (msec): min=7, max=334, avg=47.58, stdev=43.17 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 12], 10.00th=[ 15], 20.00th=[ 20], | 30.00th=[ 24], 40.00th=[ 27], 50.00th=[ 31], 60.00th=[ 37], | 70.00th=[ 48], 80.00th=[ 66], 90.00th=[ 115], 95.00th=[ 140], | 99.00th=[ 186], 99.50th=[ 279], 99.90th=[ 334], 99.95th=[ 334], | 99.99th=[ 334] bw ( KiB/s): min= 31, max= 377, per=25.22%, avg=134.17, stdev=76.97, samples=88 iops : min= 1, max= 23, avg= 7.59, stdev= 4.92, samples=88 write: IOPS=8, BW=139KiB/s (142kB/s)(6256KiB/44966msec); 0 zone resets clat (msec): min=16, max=362, avg=68.69, stdev=43.26 lat (msec): min=16, max=362, avg=68.69, stdev=43.26 clat percentiles (msec): | 1.00th=[ 18], 5.00th=[ 24], 10.00th=[ 29], 20.00th=[ 36], | 30.00th=[ 44], 40.00th=[ 49], 50.00th=[ 56], 60.00th=[ 63], | 70.00th=[ 80], 80.00th=[ 99], 90.00th=[ 128], 95.00th=[ 150], | 99.00th=[ 201], 99.50th=[ 279], 99.90th=[ 363], 99.95th=[ 363], | 99.99th=[ 363] bw ( KiB/s): min= 31, max= 377, per=24.81%, avg=138.96, stdev=77.17, samples=89 iops : min= 1, max= 23, avg= 7.90, stdev= 4.91, samples=89 lat (msec) : 10=0.78%, 20=10.55%, 50=45.31%, 100=27.08%, 250=15.76% lat (msec) : 500=0.52% cpu : usr=0.04%, sys=1.73%, ctx=1173, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=533KiB/s (545kB/s), 129KiB/s-140KiB/s (132kB/s-143kB/s), io=23.4MiB (24.5MB), run=44541-44966msec WRITE: bw=560KiB/s (574kB/s), 135KiB/s-147KiB/s (138kB/s-150kB/s), io=24.6MiB (25.8MB), run=44541-44966msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=180268: Tue Sep 29 06:55:01 2026 read: IOPS=2, BW=2103KiB/s (2154kB/s)(7168KiB/3408msec) clat (msec): min=87, max=238, avg=129.05, stdev=51.02 lat (msec): min=87, max=238, avg=129.05, stdev=51.02 clat percentiles (msec): | 1.00th=[ 88], 5.00th=[ 88], 10.00th=[ 88], 20.00th=[ 97], | 30.00th=[ 104], 40.00th=[ 104], 50.00th=[ 120], 60.00th=[ 126], | 70.00th=[ 126], 80.00th=[ 133], 90.00th=[ 239], 95.00th=[ 239], | 99.00th=[ 239], 99.50th=[ 239], 99.90th=[ 239], 99.95th=[ 239], | 99.99th=[ 239] bw ( KiB/s): min= 2007, max= 5710, per=71.36%, avg=3245.33, stdev=2134.47, samples=3 iops : min= 1, max= 5, avg= 2.33, stdev= 2.31, samples=3 write: IOPS=1, BW=1502KiB/s (1538kB/s)(5120KiB/3408msec); 0 zone resets clat (msec): min=193, max=922, avg=491.57, stdev=297.99 lat (msec): min=196, max=922, avg=492.18, stdev=297.37 clat percentiles (msec): | 1.00th=[ 194], 5.00th=[ 194], 10.00th=[ 194], 20.00th=[ 194], | 30.00th=[ 224], 40.00th=[ 224], 50.00th=[ 550], 60.00th=[ 550], | 70.00th=[ 567], 80.00th=[ 567], 90.00th=[ 927], 95.00th=[ 927], | 99.00th=[ 927], 99.50th=[ 927], 99.90th=[ 927], 99.95th=[ 927], | 99.99th=[ 927] bw ( KiB/s): min= 2007, max= 4000, per=42.14%, avg=2683.33, stdev=1140.41, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (msec) : 100=16.67%, 250=58.33%, 750=16.67%, 1000=8.33% cpu : usr=0.06%, sys=3.96%, ctx=51, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180269: Tue Sep 29 06:55:01 2026 read: IOPS=0, BW=455KiB/s (466kB/s)(2048KiB/4503msec) clat (msec): min=54, max=335, avg=194.98, stdev=199.07 lat (msec): min=54, max=335, avg=194.98, stdev=199.07 clat percentiles (msec): | 1.00th=[ 55], 5.00th=[ 55], 10.00th=[ 55], 20.00th=[ 55], | 30.00th=[ 55], 40.00th=[ 55], 50.00th=[ 55], 60.00th=[ 338], | 70.00th=[ 338], 80.00th=[ 338], 90.00th=[ 338], 95.00th=[ 338], | 99.00th=[ 338], 99.50th=[ 338], 99.90th=[ 338], 99.95th=[ 338], | 99.99th=[ 338] bw ( KiB/s): min= 1935, max= 2000, per=43.26%, avg=1967.50, stdev=45.96, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2274KiB/s (2329kB/s)(10.0MiB/4503msec); 0 zone resets clat (msec): min=175, max=850, avg=401.79, stdev=212.16 lat (msec): min=175, max=850, avg=401.98, stdev=212.30 clat percentiles (msec): | 1.00th=[ 176], 5.00th=[ 176], 10.00th=[ 176], 20.00th=[ 203], | 30.00th=[ 228], 40.00th=[ 279], 50.00th=[ 330], 60.00th=[ 372], | 70.00th=[ 456], 80.00th=[ 510], 90.00th=[ 617], 95.00th=[ 852], | 99.00th=[ 852], 99.50th=[ 852], 99.90th=[ 852], 99.95th=[ 852], | 99.99th=[ 852] bw ( KiB/s): min= 1935, max= 4087, per=42.28%, avg=2691.67, stdev=1072.13, samples=6 iops : min= 1, max= 3, avg= 1.67, stdev= 1.03, samples=6 lat (msec) : 100=8.33%, 250=25.00%, 500=41.67%, 750=16.67%, 1000=8.33% cpu : usr=0.02%, sys=9.08%, ctx=158, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180270: Tue Sep 29 06:55:01 2026 read: IOPS=1, BW=1563KiB/s (1600kB/s)(6144KiB/3931msec) clat (msec): min=119, max=708, avg=307.04, stdev=221.20 lat (msec): min=119, max=708, avg=307.04, stdev=221.20 clat percentiles (msec): | 1.00th=[ 120], 5.00th=[ 120], 10.00th=[ 120], 20.00th=[ 146], | 30.00th=[ 146], 40.00th=[ 176], 50.00th=[ 176], 60.00th=[ 317], | 70.00th=[ 376], 80.00th=[ 376], 90.00th=[ 709], 95.00th=[ 709], | 99.00th=[ 709], 99.50th=[ 709], 99.90th=[ 709], 99.95th=[ 709], | 99.99th=[ 709] bw ( KiB/s): min= 2007, max= 4000, per=55.28%, avg=2514.25, stdev=990.55, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 write: IOPS=1, BW=1563KiB/s (1600kB/s)(6144KiB/3931msec); 0 zone resets clat (msec): min=133, max=832, avg=329.23, stdev=261.65 lat (msec): min=133, max=832, avg=329.40, stdev=261.63 clat percentiles (msec): | 1.00th=[ 134], 5.00th=[ 134], 10.00th=[ 134], 20.00th=[ 167], | 30.00th=[ 167], 40.00th=[ 178], 50.00th=[ 178], 60.00th=[ 309], | 70.00th=[ 359], 80.00th=[ 359], 90.00th=[ 835], 95.00th=[ 835], | 99.00th=[ 835], 99.50th=[ 835], 99.90th=[ 835], 99.95th=[ 835], | 99.99th=[ 835] bw ( KiB/s): min= 1992, max= 3799, per=38.59%, avg=2457.25, stdev=894.64, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (msec) : 250=50.00%, 500=33.33%, 750=8.33%, 1000=8.33% cpu : usr=0.00%, sys=5.22%, ctx=61, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180271: Tue Sep 29 06:55:01 2026 read: IOPS=1, BW=1300KiB/s (1332kB/s)(5120KiB/3937msec) clat (msec): min=113, max=677, avg=282.30, stdev=226.08 lat (msec): min=113, max=677, avg=282.72, stdev=226.01 clat percentiles (msec): | 1.00th=[ 114], 5.00th=[ 114], 10.00th=[ 114], 20.00th=[ 114], | 30.00th=[ 180], 40.00th=[ 180], 50.00th=[ 192], 60.00th=[ 192], | 70.00th=[ 249], 80.00th=[ 249], 90.00th=[ 676], 95.00th=[ 676], | 99.00th=[ 676], 99.50th=[ 676], 99.90th=[ 676], 99.95th=[ 676], | 99.99th=[ 676] bw ( KiB/s): min= 2000, max= 4087, per=59.50%, avg=2706.00, stdev=1196.08, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 write: IOPS=1, BW=1821KiB/s (1864kB/s)(7168KiB/3937msec); 0 zone resets clat (msec): min=105, max=835, avg=346.62, stdev=295.76 lat (msec): min=105, max=836, avg=346.90, stdev=295.94 clat percentiles (msec): | 1.00th=[ 106], 5.00th=[ 106], 10.00th=[ 106], 20.00th=[ 115], | 30.00th=[ 163], 40.00th=[ 163], 50.00th=[ 205], 60.00th=[ 313], | 70.00th=[ 313], 80.00th=[ 693], 90.00th=[ 835], 95.00th=[ 835], | 99.00th=[ 835], 99.50th=[ 835], 99.90th=[ 835], 99.95th=[ 835], | 99.99th=[ 835] bw ( KiB/s): min= 1992, max= 4063, per=46.87%, avg=2984.50, stdev=1133.42, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 1.15, samples=4 lat (msec) : 250=66.67%, 500=8.33%, 750=16.67%, 1000=8.33% cpu : usr=0.00%, sys=5.95%, ctx=85, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4548KiB/s (4657kB/s), 455KiB/s-2103KiB/s (466kB/s-2154kB/s), io=20.0MiB (20.0MB), run=3408-4503msec WRITE: bw=6367KiB/s (6520kB/s), 1502KiB/s-2274KiB/s (1538kB/s-2329kB/s), io=28.0MiB (29.4MB), run=3408-4503msec rand-rw: (groupid=0, jobs=1): err= 0: pid=180273: Tue Sep 29 06:55:01 2026 read: IOPS=1, BW=1896KiB/s (1941kB/s)(7168KiB/3781msec) clat (usec): min=481, max=630375, avg=167564.13, stdev=226665.98 lat (usec): min=482, max=630377, avg=167565.50, stdev=226666.00 clat percentiles (usec): | 1.00th=[ 482], 5.00th=[ 482], 10.00th=[ 482], 20.00th=[ 502], | 30.00th=[ 523], 40.00th=[ 523], 50.00th=[132645], 60.00th=[147850], | 70.00th=[147850], 80.00th=[261096], 90.00th=[633340], 95.00th=[633340], | 99.00th=[633340], 99.50th=[633340], 99.90th=[633340], 99.95th=[633340], | 99.99th=[633340] bw ( KiB/s): min= 2011, max= 5003, per=76.84%, avg=3697.67, stdev=1532.02, samples=3 iops : min= 1, max= 4, avg= 2.67, stdev= 1.53, samples=3 write: IOPS=1, BW=1354KiB/s (1387kB/s)(5120KiB/3781msec); 0 zone resets clat (msec): min=124, max=1055, avg=518.10, stdev=345.88 lat (msec): min=124, max=1055, avg=518.16, stdev=345.87 clat percentiles (msec): | 1.00th=[ 125], 5.00th=[ 125], 10.00th=[ 125], 20.00th=[ 125], | 30.00th=[ 338], 40.00th=[ 338], 50.00th=[ 506], 60.00th=[ 506], | 70.00th=[ 567], 80.00th=[ 567], 90.00th=[ 1053], 95.00th=[ 1053], | 99.00th=[ 1053], 99.50th=[ 1053], 99.90th=[ 1053], 99.95th=[ 1053], | 99.99th=[ 1053] bw ( KiB/s): min= 2011, max= 2039, per=30.14%, avg=2030.00, stdev=13.22, samples=4 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=4 lat (usec) : 500=8.33%, 750=16.67% lat (msec) : 250=25.00%, 500=16.67%, 750=25.00%, 2000=8.33% cpu : usr=0.00%, sys=15.61%, ctx=166, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180274: Tue Sep 29 06:55:01 2026 read: IOPS=0, BW=481KiB/s (493kB/s)(2048KiB/4256msec) clat (msec): min=169, max=633, avg=401.15, stdev=328.24 lat (msec): min=169, max=633, avg=401.15, stdev=328.24 clat percentiles (msec): | 1.00th=[ 169], 5.00th=[ 169], 10.00th=[ 169], 20.00th=[ 169], | 30.00th=[ 169], 40.00th=[ 169], 50.00th=[ 169], 60.00th=[ 634], | 70.00th=[ 634], 80.00th=[ 634], 90.00th=[ 634], 95.00th=[ 634], | 99.00th=[ 634], 99.50th=[ 634], 99.90th=[ 634], 99.95th=[ 634], | 99.99th=[ 634] bw ( KiB/s): min= 1612, max= 2031, per=37.85%, avg=1821.50, stdev=296.28, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2406KiB/s (2464kB/s)(10.0MiB/4256msec); 0 zone resets clat (msec): min=93, max=886, avg=345.14, stdev=222.25 lat (msec): min=93, max=887, avg=345.27, stdev=222.24 clat percentiles (msec): | 1.00th=[ 93], 5.00th=[ 93], 10.00th=[ 93], 20.00th=[ 140], | 30.00th=[ 215], 40.00th=[ 271], 50.00th=[ 326], 60.00th=[ 342], | 70.00th=[ 342], 80.00th=[ 347], 90.00th=[ 493], 95.00th=[ 885], | 99.00th=[ 885], 99.50th=[ 885], 99.90th=[ 885], 99.95th=[ 885], | 99.99th=[ 885] bw ( KiB/s): min= 2011, max= 4096, per=45.21%, avg=3045.17, stdev=1112.71, samples=6 iops : min= 1, max= 4, avg= 2.17, stdev= 1.33, samples=6 lat (msec) : 100=8.33%, 250=25.00%, 500=50.00%, 750=8.33%, 1000=8.33% cpu : usr=0.09%, sys=14.74%, ctx=162, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180275: Tue Sep 29 06:55:01 2026 read: IOPS=1, BW=1970KiB/s (2017kB/s)(6144KiB/3119msec) clat (usec): min=825, max=304397, avg=177327.19, stdev=140301.61 lat (usec): min=825, max=304399, avg=177328.35, stdev=140301.94 clat percentiles (usec): | 1.00th=[ 824], 5.00th=[ 824], 10.00th=[ 824], 20.00th=[ 3556], | 30.00th=[ 3556], 40.00th=[202376], 50.00th=[202376], 60.00th=[258999], | 70.00th=[295699], 80.00th=[295699], 90.00th=[304088], 95.00th=[304088], | 99.00th=[304088], 99.50th=[304088], 99.90th=[304088], 99.95th=[304088], | 99.99th=[304088] bw ( KiB/s): min= 2039, max= 4079, per=70.25%, avg=3380.33, stdev=1161.97, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 write: IOPS=1, BW=1970KiB/s (2017kB/s)(6144KiB/3119msec); 0 zone resets clat (msec): min=200, max=648, avg=342.22, stdev=176.22 lat (msec): min=200, max=648, avg=342.29, stdev=176.24 clat percentiles (msec): | 1.00th=[ 201], 5.00th=[ 201], 10.00th=[ 201], 20.00th=[ 228], | 30.00th=[ 228], 40.00th=[ 241], 50.00th=[ 241], 60.00th=[ 279], | 70.00th=[ 460], 80.00th=[ 460], 90.00th=[ 651], 95.00th=[ 651], | 99.00th=[ 651], 99.50th=[ 651], 99.90th=[ 651], 99.95th=[ 651], | 99.99th=[ 651] bw ( KiB/s): min= 2011, max= 3155, per=34.31%, avg=2311.00, stdev=562.82, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (usec) : 1000=8.33% lat (msec) : 4=8.33%, 250=33.33%, 500=41.67%, 750=8.33% cpu : usr=0.00%, sys=14.88%, ctx=122, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180276: Tue Sep 29 06:55:01 2026 read: IOPS=1, BW=1248KiB/s (1278kB/s)(5120KiB/4101msec) clat (usec): min=513, max=628535, avg=205179.94, stdev=292030.64 lat (usec): min=514, max=628536, avg=205181.04, stdev=292030.83 clat percentiles (usec): | 1.00th=[ 515], 5.00th=[ 515], 10.00th=[ 515], 20.00th=[ 515], | 30.00th=[ 553], 40.00th=[ 553], 50.00th=[ 619], 60.00th=[ 619], | 70.00th=[396362], 80.00th=[396362], 90.00th=[624952], 95.00th=[624952], | 99.00th=[624952], 99.50th=[624952], 99.90th=[624952], 99.95th=[624952], | 99.99th=[624952] bw ( KiB/s): min= 2031, max= 6035, per=83.81%, avg=4033.00, stdev=2831.26, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 write: IOPS=1, BW=1748KiB/s (1790kB/s)(7168KiB/4101msec); 0 zone resets clat (msec): min=151, max=1028, avg=438.89, stdev=319.88 lat (msec): min=151, max=1028, avg=438.96, stdev=319.89 clat percentiles (msec): | 1.00th=[ 153], 5.00th=[ 153], 10.00th=[ 153], 20.00th=[ 211], | 30.00th=[ 275], 40.00th=[ 275], 50.00th=[ 305], 60.00th=[ 380], | 70.00th=[ 380], 80.00th=[ 726], 90.00th=[ 1028], 95.00th=[ 1028], | 99.00th=[ 1028], 99.50th=[ 1028], 99.90th=[ 1028], 99.95th=[ 1028], | 99.99th=[ 1028] bw ( KiB/s): min= 1568, max= 2039, per=28.79%, avg=1939.20, stdev=207.86, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 lat (usec) : 750=25.00% lat (msec) : 250=16.67%, 500=33.33%, 750=16.67%, 2000=8.33% cpu : usr=0.00%, sys=15.46%, ctx=148, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4812KiB/s (4928kB/s), 481KiB/s-1970KiB/s (493kB/s-2017kB/s), io=20.0MiB (20.0MB), run=3119-4256msec WRITE: bw=6737KiB/s (6899kB/s), 1354KiB/s-2406KiB/s (1387kB/s-2464kB/s), io=28.0MiB (29.4MB), run=3119-4256msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=180287: Tue Sep 29 06:55:13 2026 read: IOPS=1, BW=6244KiB/s (6394kB/s)(12.0MiB/1968msec) clat (msec): min=458, max=959, avg=627.80, stdev=287.16 lat (msec): min=458, max=959, avg=627.81, stdev=287.16 clat percentiles (msec): | 1.00th=[ 460], 5.00th=[ 460], 10.00th=[ 460], 20.00th=[ 460], | 30.00th=[ 460], 40.00th=[ 468], 50.00th=[ 468], 60.00th=[ 468], | 70.00th=[ 961], 80.00th=[ 961], 90.00th=[ 961], 95.00th=[ 961], | 99.00th=[ 961], 99.50th=[ 961], 99.90th=[ 961], 99.95th=[ 961], | 99.99th=[ 961] bw ( KiB/s): min=16384, max=16384, per=100.00%, avg=16384.00, stdev= 0.00, samples=1 iops : min= 4, max= 4, avg= 4.00, stdev= 0.00, samples=1 lat (msec) : 500=66.67%, 1000=33.33% cpu : usr=0.00%, sys=7.93%, ctx=44, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180288: Tue Sep 29 06:55:13 2026 read: IOPS=0, BW=1598KiB/s (1636kB/s)(4096KiB/2563msec) clat (nsec): min=1410.5M, max=1410.5M, avg=1410512950.00, stdev= 0.00 lat (nsec): min=1410.5M, max=1410.5M, avg=1410515119.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1418], 5.00th=[ 1418], 10.00th=[ 1418], 20.00th=[ 1418], | 30.00th=[ 1418], 40.00th=[ 1418], 50.00th=[ 1418], 60.00th=[ 1418], | 70.00th=[ 1418], 80.00th=[ 1418], 90.00th=[ 1418], 95.00th=[ 1418], | 99.00th=[ 1418], 99.50th=[ 1418], 99.90th=[ 1418], 99.95th=[ 1418], | 99.99th=[ 1418] bw ( KiB/s): min= 8175, max= 8175, per=100.00%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=3196KiB/s (3273kB/s)(8192KiB/2563msec); 0 zone resets clat (msec): min=333, max=814, avg=574.08, stdev=340.54 lat (msec): min=333, max=815, avg=574.43, stdev=340.61 clat percentiles (msec): | 1.00th=[ 334], 5.00th=[ 334], 10.00th=[ 334], 20.00th=[ 334], | 30.00th=[ 334], 40.00th=[ 334], 50.00th=[ 334], 60.00th=[ 818], | 70.00th=[ 818], 80.00th=[ 818], 90.00th=[ 818], 95.00th=[ 818], | 99.00th=[ 818], 99.50th=[ 818], 99.90th=[ 818], 99.95th=[ 818], | 99.99th=[ 818] lat (msec) : 500=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=7.38%, ctx=92, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180289: Tue Sep 29 06:55:13 2026 write: IOPS=1, BW=4604KiB/s (4714kB/s)(12.0MiB/2669msec); 0 zone resets clat (msec): min=236, max=1929, avg=857.69, stdev=931.75 lat (msec): min=237, max=1929, avg=858.18, stdev=932.02 clat percentiles (msec): | 1.00th=[ 236], 5.00th=[ 236], 10.00th=[ 236], 20.00th=[ 236], | 30.00th=[ 236], 40.00th=[ 409], 50.00th=[ 409], 60.00th=[ 409], | 70.00th=[ 1921], 80.00th=[ 1921], 90.00th=[ 1921], 95.00th=[ 1921], | 99.00th=[ 1921], 99.50th=[ 1921], 99.90th=[ 1921], 99.95th=[ 1921], | 99.99th=[ 1921] bw ( KiB/s): min=16351, max=16351, per=100.00%, avg=16351.00, stdev= 0.00, samples=1 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 500=33.33%, 2000=33.33% cpu : usr=0.00%, sys=7.20%, ctx=73, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180290: Tue Sep 29 06:55:13 2026 write: IOPS=1, BW=4732KiB/s (4845kB/s)(12.0MiB/2597msec); 0 zone resets clat (msec): min=262, max=1877, avg=823.63, stdev=913.02 lat (msec): min=262, max=1877, avg=823.97, stdev=913.19 clat percentiles (msec): | 1.00th=[ 264], 5.00th=[ 264], 10.00th=[ 264], 20.00th=[ 264], | 30.00th=[ 264], 40.00th=[ 330], 50.00th=[ 330], 60.00th=[ 330], | 70.00th=[ 1871], 80.00th=[ 1871], 90.00th=[ 1871], 95.00th=[ 1871], | 99.00th=[ 1871], 99.50th=[ 1871], 99.90th=[ 1871], 99.95th=[ 1871], | 99.99th=[ 1871] bw ( KiB/s): min= 7728, max= 8110, per=64.50%, avg=7919.00, stdev=270.11, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=66.67%, 2000=33.33% cpu : usr=0.00%, sys=5.86%, ctx=63, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=6393KiB/s (6546kB/s), 1598KiB/s-6244KiB/s (1636kB/s-6394kB/s), io=16.0MiB (16.8MB), run=1968-2563msec WRITE: bw=11.0MiB/s (12.6MB/s), 3196KiB/s-4732KiB/s (3273kB/s-4845kB/s), io=32.0MiB (33.6MB), run=2563-2669msec rand-rw: (groupid=0, jobs=1): err= 0: pid=180282: Tue Sep 29 06:55:14 2026 read: IOPS=1, BW=5543KiB/s (5676kB/s)(12.0MiB/2217msec) clat (msec): min=505, max=806, avg=652.64, stdev=150.70 lat (msec): min=505, max=806, avg=652.64, stdev=150.71 clat percentiles (msec): | 1.00th=[ 506], 5.00th=[ 506], 10.00th=[ 506], 20.00th=[ 506], | 30.00th=[ 506], 40.00th=[ 651], 50.00th=[ 651], 60.00th=[ 651], | 70.00th=[ 810], 80.00th=[ 810], 90.00th=[ 810], 95.00th=[ 810], | 99.00th=[ 810], 99.50th=[ 810], 99.90th=[ 810], 99.95th=[ 810], | 99.99th=[ 810] bw ( KiB/s): min= 8175, max= 8192, per=100.00%, avg=8183.50, stdev=12.02, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 750=66.67%, 1000=33.33% cpu : usr=0.00%, sys=19.49%, ctx=368, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180283: Tue Sep 29 06:55:14 2026 read: IOPS=0, BW=1591KiB/s (1629kB/s)(4096KiB/2575msec) clat (nsec): min=798397k, max=798397k, avg=798397218.00, stdev= 0.00 lat (nsec): min=798399k, max=798399k, avg=798399371.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 802], 5.00th=[ 802], 10.00th=[ 802], 20.00th=[ 802], | 30.00th=[ 802], 40.00th=[ 802], 50.00th=[ 802], 60.00th=[ 802], | 70.00th=[ 802], 80.00th=[ 802], 90.00th=[ 802], 95.00th=[ 802], | 99.00th=[ 802], 99.50th=[ 802], 99.90th=[ 802], 99.95th=[ 802], | 99.99th=[ 802] bw ( KiB/s): min= 8175, max= 8175, per=100.00%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=3181KiB/s (3258kB/s)(8192KiB/2575msec); 0 zone resets clat (msec): min=526, max=985, avg=756.23, stdev=324.59 lat (msec): min=527, max=986, avg=756.54, stdev=324.58 clat percentiles (msec): | 1.00th=[ 527], 5.00th=[ 527], 10.00th=[ 527], 20.00th=[ 527], | 30.00th=[ 527], 40.00th=[ 527], 50.00th=[ 527], 60.00th=[ 986], | 70.00th=[ 986], 80.00th=[ 986], 90.00th=[ 986], 95.00th=[ 986], | 99.00th=[ 986], 99.50th=[ 986], 99.90th=[ 986], 99.95th=[ 986], | 99.99th=[ 986] bw ( KiB/s): min= 8192, max= 8192, per=85.60%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, 1000=66.67% cpu : usr=0.00%, sys=11.07%, ctx=137, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180285: Tue Sep 29 06:55:14 2026 write: IOPS=0, BW=3589KiB/s (3675kB/s)(12.0MiB/3424msec); 0 zone resets clat (msec): min=150, max=2577, avg=1074.34, stdev=1313.32 lat (msec): min=150, max=2579, avg=1075.22, stdev=1314.47 clat percentiles (msec): | 1.00th=[ 150], 5.00th=[ 150], 10.00th=[ 150], 20.00th=[ 150], | 30.00th=[ 150], 40.00th=[ 493], 50.00th=[ 493], 60.00th=[ 493], | 70.00th=[ 2567], 80.00th=[ 2567], 90.00th=[ 2567], 95.00th=[ 2567], | 99.00th=[ 2567], 99.50th=[ 2567], 99.90th=[ 2567], 99.95th=[ 2567], | 99.99th=[ 2567] bw ( KiB/s): min= 8175, max= 8175, per=85.42%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 500=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=6.57%, ctx=59, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180286: Tue Sep 29 06:55:14 2026 write: IOPS=1, BW=4486KiB/s (4594kB/s)(12.0MiB/2739msec); 0 zone resets clat (msec): min=284, max=1854, avg=824.28, stdev=892.96 lat (msec): min=284, max=1855, avg=824.63, stdev=892.95 clat percentiles (msec): | 1.00th=[ 284], 5.00th=[ 284], 10.00th=[ 284], 20.00th=[ 284], | 30.00th=[ 284], 40.00th=[ 334], 50.00th=[ 334], 60.00th=[ 334], | 70.00th=[ 1854], 80.00th=[ 1854], 90.00th=[ 1854], 95.00th=[ 1854], | 99.00th=[ 1854], 99.50th=[ 1854], 99.90th=[ 1854], 99.95th=[ 1854], | 99.99th=[ 1854] bw ( KiB/s): min=16286, max=16286, per=100.00%, avg=16286.00, stdev= 0.00, samples=1 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=1 lat (msec) : 500=66.67%, 2000=33.33% cpu : usr=0.00%, sys=5.73%, ctx=57, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=6363KiB/s (6515kB/s), 1591KiB/s-5543KiB/s (1629kB/s-5676kB/s), io=16.0MiB (16.8MB), run=2217-2575msec WRITE: bw=9570KiB/s (9800kB/s), 3181KiB/s-4486KiB/s (3258kB/s-4594kB/s), io=32.0MiB (33.6MB), run=2575-3424msec