== sanity test 398b: DIO and buffer IO race ============== 14:10:56 (1761243056) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 3.65095 s, 13.8 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=183465: Thu Oct 23 14:12:28 2025 read: IOPS=18, BW=75.7KiB/s (77.5kB/s)(5992KiB/79124msec) clat (usec): min=109, max=190184, avg=28765.52, stdev=17504.61 lat (usec): min=109, max=190185, avg=28768.41, stdev=17504.40 clat percentiles (usec): | 1.00th=[ 143], 5.00th=[ 8455], 10.00th=[ 11469], 20.00th=[ 15401], | 30.00th=[ 18482], 40.00th=[ 22152], 50.00th=[ 25560], 60.00th=[ 29754], | 70.00th=[ 34341], 80.00th=[ 40633], 90.00th=[ 50594], 95.00th=[ 58983], | 99.00th=[ 88605], 99.50th=[101188], 99.90th=[141558], 99.95th=[189793], | 99.99th=[189793] bw ( KiB/s): min= 15, max= 151, per=25.10%, avg=75.55, stdev=24.27, samples=155 iops : min= 3, max= 37, avg=18.28, stdev= 6.13, samples=155 write: IOPS=19, BW=79.6KiB/s (81.5kB/s)(6296KiB/79124msec); 0 zone resets clat (usec): min=856, max=824156, avg=22706.94, stdev=30130.98 lat (usec): min=857, max=824157, avg=22708.35, stdev=30130.98 clat percentiles (usec): | 1.00th=[ 1012], 5.00th=[ 1139], 10.00th=[ 1319], 20.00th=[ 2507], | 30.00th=[ 5014], 40.00th=[ 10552], 50.00th=[ 16712], 60.00th=[ 22152], | 70.00th=[ 28967], 80.00th=[ 39060], 90.00th=[ 52167], 95.00th=[ 64750], | 99.00th=[ 95945], 99.50th=[122160], 99.90th=[185598], 99.95th=[826278], | 99.99th=[826278] bw ( KiB/s): min= 30, max= 159, per=25.23%, avg=79.48, stdev=24.77, samples=155 iops : min= 7, max= 39, avg=19.26, stdev= 6.25, samples=155 lat (usec) : 250=1.69%, 500=0.36%, 1000=0.42% lat (msec) : 2=8.17%, 4=5.31%, 10=7.55%, 20=22.10%, 50=43.42% lat (msec) : 100=10.29%, 250=0.65%, 1000=0.03% cpu : usr=0.10%, sys=9.02%, ctx=6950, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183466: Thu Oct 23 14:12:28 2025 read: IOPS=18, BW=74.0KiB/s (76.8kB/s)(5940KiB/79202msec) clat (usec): min=113, max=193780, avg=29655.72, stdev=18167.02 lat (usec): min=114, max=193781, avg=29659.21, stdev=18167.34 clat percentiles (usec): | 1.00th=[ 165], 5.00th=[ 9241], 10.00th=[ 12256], 20.00th=[ 16188], | 30.00th=[ 19006], 40.00th=[ 22414], 50.00th=[ 25822], 60.00th=[ 30540], | 70.00th=[ 35390], 80.00th=[ 41157], 90.00th=[ 51119], 95.00th=[ 61604], | 99.00th=[ 92799], 99.50th=[109577], 99.90th=[152044], 99.95th=[193987], | 99.99th=[193987] bw ( KiB/s): min= 23, max= 144, per=24.91%, avg=74.98, stdev=23.97, samples=155 iops : min= 5, max= 36, avg=18.13, stdev= 6.05, samples=155 write: IOPS=20, BW=80.1KiB/s (82.1kB/s)(6348KiB/79202msec); 0 zone resets clat (usec): min=897, max=695600, avg=21969.17, stdev=27979.23 lat (usec): min=898, max=695601, avg=21972.40, stdev=27981.09 clat percentiles (usec): | 1.00th=[ 1029], 5.00th=[ 1139], 10.00th=[ 1303], 20.00th=[ 2409], | 30.00th=[ 5080], 40.00th=[ 10028], 50.00th=[ 16188], 60.00th=[ 21365], | 70.00th=[ 27657], 80.00th=[ 35914], 90.00th=[ 51119], 95.00th=[ 66323], | 99.00th=[ 96994], 99.50th=[123208], 99.90th=[189793], 99.95th=[692061], | 99.99th=[692061] bw ( KiB/s): min= 23, max= 151, per=25.39%, avg=79.98, stdev=26.02, samples=155 iops : min= 5, max= 37, avg=19.38, stdev= 6.54, samples=155 lat (usec) : 250=0.94%, 500=0.49%, 750=0.07%, 1000=0.46% lat (msec) : 2=8.53%, 4=5.11%, 10=7.81%, 20=22.10%, 50=43.88% lat (msec) : 100=9.83%, 250=0.75%, 750=0.03% cpu : usr=0.10%, sys=9.06%, ctx=6762, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183467: Thu Oct 23 14:12:28 2025 read: IOPS=18, BW=75.7KiB/s (77.6kB/s)(6028KiB/79590msec) clat (usec): min=94, max=847341, avg=29317.98, stdev=27080.58 lat (usec): min=94, max=847342, avg=29320.05, stdev=27080.48 clat percentiles (usec): | 1.00th=[ 151], 5.00th=[ 8848], 10.00th=[ 12125], 20.00th=[ 15664], | 30.00th=[ 18482], 40.00th=[ 21627], 50.00th=[ 25297], 60.00th=[ 30016], | 70.00th=[ 34866], 80.00th=[ 41157], 90.00th=[ 49546], 95.00th=[ 58459], | 99.00th=[ 89654], 99.50th=[100140], 99.90th=[124257], 99.95th=[851444], | 99.99th=[851444] bw ( KiB/s): min= 24, max= 135, per=25.10%, avg=75.54, stdev=22.37, samples=156 iops : min= 6, max= 33, avg=18.28, stdev= 5.63, samples=156 write: IOPS=19, BW=78.7KiB/s (80.5kB/s)(6260KiB/79590msec); 0 zone resets clat (usec): min=757, max=200189, avg=22431.97, stdev=21792.09 lat (usec): min=758, max=200191, avg=22437.66, stdev=21796.89 clat percentiles (usec): | 1.00th=[ 1020], 5.00th=[ 1139], 10.00th=[ 1287], 20.00th=[ 2474], | 30.00th=[ 5145], 40.00th=[ 12387], 50.00th=[ 17957], 60.00th=[ 22938], | 70.00th=[ 30016], 80.00th=[ 38536], 90.00th=[ 52167], 95.00th=[ 63701], | 99.00th=[ 90702], 99.50th=[102237], 99.90th=[168821], 99.95th=[200279], | 99.99th=[200279] bw ( KiB/s): min= 31, max= 191, per=24.89%, avg=78.42, stdev=27.25, samples=156 iops : min= 7, max= 47, avg=18.99, stdev= 6.85, samples=156 lat (usec) : 100=0.03%, 250=1.27%, 500=0.33%, 750=0.03%, 1000=0.33% lat (msec) : 2=8.66%, 4=4.56%, 10=6.58%, 20=23.05%, 50=45.02% lat (msec) : 100=9.60%, 250=0.52%, 1000=0.03% cpu : usr=0.12%, sys=9.04%, ctx=6883, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183468: Thu Oct 23 14:12:28 2025 read: IOPS=19, BW=77.3KiB/s (79.1kB/s)(6052KiB/78329msec) clat (usec): min=100, max=148786, avg=28206.17, stdev=17611.57 lat (usec): min=101, max=148787, avg=28207.65, stdev=17611.79 clat percentiles (usec): | 1.00th=[ 143], 5.00th=[ 1004], 10.00th=[ 11338], 20.00th=[ 15139], | 30.00th=[ 18220], 40.00th=[ 21365], 50.00th=[ 25035], 60.00th=[ 28967], | 70.00th=[ 34341], 80.00th=[ 39584], 90.00th=[ 49021], 95.00th=[ 58983], | 99.00th=[ 87557], 99.50th=[110625], 99.90th=[135267], 99.95th=[147850], | 99.99th=[147850] bw ( KiB/s): min= 23, max= 167, per=25.69%, avg=77.32, stdev=24.35, samples=154 iops : min= 5, max= 41, avg=18.73, stdev= 6.11, samples=154 write: IOPS=19, BW=79.6KiB/s (81.5kB/s)(6236KiB/78329msec); 0 zone resets clat (usec): min=902, max=724471, avg=22653.91, stdev=28898.28 lat (usec): min=904, max=724472, avg=22657.40, stdev=28899.22 clat percentiles (usec): | 1.00th=[ 1029], 5.00th=[ 1139], 10.00th=[ 1352], 20.00th=[ 2507], | 30.00th=[ 4948], 40.00th=[ 10290], 50.00th=[ 16581], 60.00th=[ 22152], | 70.00th=[ 28705], 80.00th=[ 38536], 90.00th=[ 52167], 95.00th=[ 64750], | 99.00th=[102237], 99.50th=[117965], 99.90th=[210764], 99.95th=[725615], | 99.99th=[725615] bw ( KiB/s): min= 15, max= 167, per=25.28%, avg=79.64, stdev=26.04, samples=154 iops : min= 3, max= 41, avg=19.31, stdev= 6.54, samples=154 lat (usec) : 250=1.53%, 500=0.75%, 750=0.13%, 1000=0.36% lat (msec) : 2=8.04%, 4=5.44%, 10=7.42%, 20=22.66%, 50=43.55% lat (msec) : 100=9.18%, 250=0.91%, 750=0.03% cpu : usr=0.10%, sys=8.93%, ctx=6755, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=302KiB/s (309kB/s), 74.0KiB/s-77.3KiB/s (76.8kB/s-79.1kB/s), io=23.4MiB (24.6MB), run=78329-79590msec WRITE: bw=316KiB/s (323kB/s), 78.7KiB/s-80.1KiB/s (80.5kB/s-82.1kB/s), io=24.6MiB (25.7MB), run=78329-79590msec rand-rw: (groupid=0, jobs=1): err= 0: pid=183470: Thu Oct 23 14:12:56 2025 read: IOPS=14, BW=56.5KiB/s (57.8kB/s)(5992KiB/106106msec) clat (msec): min=5, max=745, avg=27.46, stdev=30.40 lat (msec): min=5, max=745, avg=27.46, stdev=30.40 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 8], 10.00th=[ 10], 20.00th=[ 11], | 30.00th=[ 13], 40.00th=[ 16], 50.00th=[ 19], 60.00th=[ 23], | 70.00th=[ 29], 80.00th=[ 39], 90.00th=[ 58], 95.00th=[ 79], | 99.00th=[ 128], 99.50th=[ 146], 99.90th=[ 222], 99.95th=[ 743], | 99.99th=[ 743] bw ( KiB/s): min= 7, max= 176, per=25.42%, avg=56.69, stdev=34.47, samples=208 iops : min= 1, max= 44, avg=13.54, stdev= 8.66, samples=208 write: IOPS=14, BW=59.3KiB/s (60.8kB/s)(6296KiB/106106msec); 0 zone resets clat (msec): min=9, max=228, avg=41.19, stdev=26.88 lat (msec): min=9, max=228, avg=41.19, stdev=26.88 clat percentiles (msec): | 1.00th=[ 12], 5.00th=[ 15], 10.00th=[ 18], 20.00th=[ 21], | 30.00th=[ 24], 40.00th=[ 28], 50.00th=[ 33], 60.00th=[ 39], | 70.00th=[ 48], 80.00th=[ 60], 90.00th=[ 75], 95.00th=[ 93], | 99.00th=[ 140], 99.50th=[ 176], 99.90th=[ 197], 99.95th=[ 230], | 99.99th=[ 230] bw ( KiB/s): min= 15, max= 167, per=25.30%, avg=59.21, stdev=33.03, samples=209 iops : min= 3, max= 41, avg=14.17, stdev= 8.28, samples=209 lat (msec) : 10=7.23%, 20=28.71%, 50=43.42%, 100=17.84%, 250=2.77% lat (msec) : 750=0.03% cpu : usr=0.08%, sys=3.18%, ctx=4925, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183471: Thu Oct 23 14:12:56 2025 read: IOPS=13, BW=55.3KiB/s (56.7kB/s)(5940KiB/107370msec) clat (msec): min=4, max=878, avg=27.89, stdev=32.62 lat (msec): min=4, max=878, avg=27.89, stdev=32.62 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 12], | 30.00th=[ 14], 40.00th=[ 16], 50.00th=[ 19], 60.00th=[ 23], | 70.00th=[ 29], 80.00th=[ 39], 90.00th=[ 61], 95.00th=[ 80], | 99.00th=[ 122], 99.50th=[ 133], 99.90th=[ 218], 99.95th=[ 877], | 99.99th=[ 877] bw ( KiB/s): min= 7, max= 199, per=24.67%, avg=55.00, stdev=35.87, samples=211 iops : min= 1, max= 49, avg=13.12, stdev= 8.99, samples=211 write: IOPS=14, BW=59.1KiB/s (60.5kB/s)(6348KiB/107370msec); 0 zone resets clat (msec): min=8, max=216, avg=41.49, stdev=28.60 lat (msec): min=8, max=216, avg=41.50, stdev=28.60 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 14], 10.00th=[ 17], 20.00th=[ 20], | 30.00th=[ 24], 40.00th=[ 28], 50.00th=[ 32], 60.00th=[ 39], | 70.00th=[ 48], 80.00th=[ 62], 90.00th=[ 81], 95.00th=[ 95], | 99.00th=[ 148], 99.50th=[ 171], 99.90th=[ 203], 99.95th=[ 218], | 99.99th=[ 218] bw ( KiB/s): min= 15, max= 176, per=25.07%, avg=58.65, stdev=33.59, samples=211 iops : min= 3, max= 44, avg=14.03, stdev= 8.44, samples=211 lat (msec) : 10=7.52%, 20=29.65%, 50=41.76%, 100=17.84%, 250=3.19% lat (msec) : 1000=0.03% cpu : usr=0.09%, sys=3.15%, ctx=5034, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183472: Thu Oct 23 14:12:56 2025 read: IOPS=14, BW=56.5KiB/s (57.8kB/s)(6028KiB/106747msec) clat (msec): min=5, max=188, avg=27.80, stdev=24.35 lat (msec): min=5, max=188, avg=27.80, stdev=24.35 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 12], | 30.00th=[ 14], 40.00th=[ 16], 50.00th=[ 20], 60.00th=[ 24], | 70.00th=[ 30], 80.00th=[ 40], 90.00th=[ 59], 95.00th=[ 79], | 99.00th=[ 126], 99.50th=[ 144], 99.90th=[ 180], 99.95th=[ 188], | 99.99th=[ 188] bw ( KiB/s): min= 7, max= 191, per=25.22%, avg=56.24, stdev=33.63, samples=210 iops : min= 1, max= 47, avg=13.43, stdev= 8.44, samples=210 write: IOPS=14, BW=58.6KiB/s (60.1kB/s)(6260KiB/106747msec); 0 zone resets clat (msec): min=8, max=840, avg=41.34, stdev=33.56 lat (msec): min=8, max=840, avg=41.34, stdev=33.56 clat percentiles (msec): | 1.00th=[ 12], 5.00th=[ 15], 10.00th=[ 18], 20.00th=[ 21], | 30.00th=[ 24], 40.00th=[ 27], 50.00th=[ 32], 60.00th=[ 38], | 70.00th=[ 48], 80.00th=[ 61], 90.00th=[ 78], 95.00th=[ 94], | 99.00th=[ 138], 99.50th=[ 159], 99.90th=[ 220], 99.95th=[ 844], | 99.99th=[ 844] bw ( KiB/s): min= 7, max= 167, per=24.98%, avg=58.44, stdev=34.46, samples=210 iops : min= 1, max= 41, avg=13.98, stdev= 8.63, samples=210 lat (msec) : 10=7.16%, 20=27.41%, 50=44.21%, 100=18.26%, 250=2.93% lat (msec) : 1000=0.03% cpu : usr=0.09%, sys=3.19%, ctx=4930, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183473: Thu Oct 23 14:12:56 2025 read: IOPS=14, BW=56.0KiB/s (58.3kB/s)(6052KiB/106207msec) clat (msec): min=4, max=218, avg=27.33, stdev=24.29 lat (msec): min=4, max=218, avg=27.34, stdev=24.29 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 10], 20.00th=[ 11], | 30.00th=[ 13], 40.00th=[ 16], 50.00th=[ 19], 60.00th=[ 22], | 70.00th=[ 29], 80.00th=[ 41], 90.00th=[ 62], 95.00th=[ 83], | 99.00th=[ 117], 99.50th=[ 125], 99.90th=[ 186], 99.95th=[ 220], | 99.99th=[ 220] bw ( KiB/s): min= 7, max= 191, per=25.87%, avg=57.68, stdev=35.41, samples=206 iops : min= 1, max= 47, avg=13.79, stdev= 8.87, samples=206 write: IOPS=14, BW=58.7KiB/s (60.1kB/s)(6236KiB/106207msec); 0 zone resets clat (msec): min=8, max=851, avg=41.52, stdev=34.16 lat (msec): min=8, max=851, avg=41.52, stdev=34.16 clat percentiles (msec): | 1.00th=[ 12], 5.00th=[ 15], 10.00th=[ 18], 20.00th=[ 21], | 30.00th=[ 24], 40.00th=[ 27], 50.00th=[ 32], 60.00th=[ 37], | 70.00th=[ 48], 80.00th=[ 62], 90.00th=[ 79], 95.00th=[ 99], | 99.00th=[ 144], 99.50th=[ 161], 99.90th=[ 199], 99.95th=[ 852], | 99.99th=[ 852] bw ( KiB/s): min= 7, max= 167, per=25.00%, avg=58.50, stdev=33.40, samples=209 iops : min= 1, max= 41, avg=14.00, stdev= 8.37, samples=209 lat (msec) : 10=7.13%, 20=29.79%, 50=42.02%, 100=17.77%, 250=3.26% lat (msec) : 1000=0.03% cpu : usr=0.11%, sys=3.17%, ctx=5033, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=224KiB/s (229kB/s), 55.3KiB/s-56.0KiB/s (56.7kB/s-58.3kB/s), io=23.4MiB (24.6MB), run=106106-107370msec WRITE: bw=234KiB/s (240kB/s), 58.6KiB/s-59.3KiB/s (60.1kB/s-60.8kB/s), io=24.6MiB (25.7MB), run=106106-107370msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=183505: Thu Oct 23 14:13:22 2025 read: IOPS=18, BW=301KiB/s (309kB/s)(5920KiB/19645msec) clat (usec): min=125, max=122578, avg=27439.58, stdev=17553.02 lat (usec): min=125, max=122578, avg=27440.61, stdev=17553.01 clat percentiles (usec): | 1.00th=[ 139], 5.00th=[ 167], 10.00th=[ 5407], 20.00th=[ 14484], | 30.00th=[ 18220], 40.00th=[ 21365], 50.00th=[ 24511], 60.00th=[ 28705], | 70.00th=[ 33162], 80.00th=[ 40633], 90.00th=[ 51119], 95.00th=[ 58459], | 99.00th=[ 87557], 99.50th=[100140], 99.90th=[122160], 99.95th=[122160], | 99.99th=[122160] bw ( KiB/s): min= 127, max= 444, per=24.89%, avg=295.71, stdev=77.23, samples=38 iops : min= 7, max= 27, avg=17.76, stdev= 4.87, samples=38 write: IOPS=20, BW=324KiB/s (332kB/s)(6368KiB/19645msec); 0 zone resets clat (usec): min=1494, max=138067, avg=23615.65, stdev=20444.25 lat (usec): min=1496, max=138068, avg=23617.62, stdev=20444.40 clat percentiles (usec): | 1.00th=[ 1516], 5.00th=[ 1762], 10.00th=[ 2343], 20.00th=[ 4752], | 30.00th=[ 8291], 40.00th=[ 14353], 50.00th=[ 19792], 60.00th=[ 25035], | 70.00th=[ 30802], 80.00th=[ 38011], 90.00th=[ 50070], 95.00th=[ 61080], | 99.00th=[105382], 99.50th=[107480], 99.90th=[137364], 99.95th=[137364], | 99.99th=[137364] bw ( KiB/s): min= 124, max= 573, per=25.77%, avg=322.13, stdev=102.15, samples=38 iops : min= 7, max= 35, avg=19.39, stdev= 6.39, samples=38 lat (usec) : 250=3.39%, 500=1.17%, 750=0.13% lat (msec) : 2=4.04%, 4=4.69%, 10=8.85%, 20=21.09%, 50=46.22% lat (msec) : 100=9.64%, 250=0.78% cpu : usr=0.09%, sys=11.02%, ctx=1857, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183506: Thu Oct 23 14:13:22 2025 read: IOPS=18, BW=292KiB/s (299kB/s)(5744KiB/19702msec) clat (usec): min=128, max=126036, avg=29238.34, stdev=18864.81 lat (usec): min=128, max=126037, avg=29239.49, stdev=18864.99 clat percentiles (usec): | 1.00th=[ 145], 5.00th=[ 326], 10.00th=[ 10028], 20.00th=[ 15401], | 30.00th=[ 19792], 40.00th=[ 22676], 50.00th=[ 25560], 60.00th=[ 30540], | 70.00th=[ 35390], 80.00th=[ 41681], 90.00th=[ 49021], 95.00th=[ 64750], | 99.00th=[ 94897], 99.50th=[121111], 99.90th=[126354], 99.95th=[126354], | 99.99th=[126354] bw ( KiB/s): min= 63, max= 574, per=24.56%, avg=291.79, stdev=101.80, samples=39 iops : min= 3, max= 35, avg=17.51, stdev= 6.43, samples=39 write: IOPS=20, BW=332KiB/s (340kB/s)(6544KiB/19702msec); 0 zone resets clat (usec): min=1430, max=125698, avg=22175.65, stdev=20492.58 lat (usec): min=1431, max=125701, avg=22177.41, stdev=20492.58 clat percentiles (usec): | 1.00th=[ 1483], 5.00th=[ 1827], 10.00th=[ 2507], 20.00th=[ 4621], | 30.00th=[ 7177], 40.00th=[ 12125], 50.00th=[ 16909], 60.00th=[ 21365], | 70.00th=[ 27657], 80.00th=[ 36963], 90.00th=[ 52167], 95.00th=[ 60031], | 99.00th=[ 90702], 99.50th=[101188], 99.90th=[125305], 99.95th=[125305], | 99.99th=[125305] bw ( KiB/s): min= 127, max= 608, per=26.50%, avg=331.26, stdev=107.17, samples=39 iops : min= 7, max= 38, avg=20.00, stdev= 6.85, samples=39 lat (usec) : 250=1.82%, 500=1.04%, 750=0.39% lat (msec) : 2=3.78%, 4=5.60%, 10=10.16%, 20=22.40%, 50=45.05% lat (msec) : 100=8.98%, 250=0.78% cpu : usr=0.12%, sys=11.21%, ctx=1865, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183507: Thu Oct 23 14:13:22 2025 read: IOPS=19, BW=310KiB/s (318kB/s)(6256KiB/20159msec) clat (usec): min=106, max=132935, avg=28780.98, stdev=19270.98 lat (usec): min=107, max=132937, avg=28809.66, stdev=19262.21 clat percentiles (usec): | 1.00th=[ 141], 5.00th=[ 322], 10.00th=[ 8979], 20.00th=[ 15270], | 30.00th=[ 18744], 40.00th=[ 22152], 50.00th=[ 26084], 60.00th=[ 30016], | 70.00th=[ 33424], 80.00th=[ 40109], 90.00th=[ 51119], 95.00th=[ 61604], | 99.00th=[101188], 99.50th=[122160], 99.90th=[132645], 99.95th=[132645], | 99.99th=[132645] bw ( KiB/s): min= 159, max= 480, per=25.64%, avg=304.59, stdev=80.39, samples=39 iops : min= 9, max= 30, avg=18.33, stdev= 5.16, samples=39 write: IOPS=18, BW=299KiB/s (306kB/s)(6032KiB/20159msec); 0 zone resets clat (usec): min=1401, max=118283, avg=23480.28, stdev=20924.90 lat (usec): min=1403, max=118284, avg=23482.09, stdev=20924.92 clat percentiles (usec): | 1.00th=[ 1500], 5.00th=[ 1745], 10.00th=[ 2900], 20.00th=[ 4883], | 30.00th=[ 9110], 40.00th=[ 13435], 50.00th=[ 18220], 60.00th=[ 23462], | 70.00th=[ 29754], 80.00th=[ 37487], 90.00th=[ 50594], 95.00th=[ 67634], | 99.00th=[ 95945], 99.50th=[112722], 99.90th=[117965], 99.95th=[117965], | 99.99th=[117965] bw ( KiB/s): min= 95, max= 447, per=22.92%, avg=286.54, stdev=96.26, samples=39 iops : min= 5, max= 27, avg=17.21, stdev= 6.07, samples=39 lat (usec) : 250=2.34%, 500=0.91%, 1000=0.39% lat (msec) : 2=3.26%, 4=4.56%, 10=9.51%, 20=22.01%, 50=45.96% lat (msec) : 100=10.16%, 250=0.91% cpu : usr=0.05%, sys=11.22%, ctx=2003, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183508: Thu Oct 23 14:13:22 2025 read: IOPS=19, BW=311KiB/s (319kB/s)(6032KiB/19371msec) clat (usec): min=117, max=147886, avg=27895.82, stdev=18800.69 lat (usec): min=117, max=147887, avg=27896.94, stdev=18800.67 clat percentiles (usec): | 1.00th=[ 139], 5.00th=[ 289], 10.00th=[ 1221], 20.00th=[ 15401], | 30.00th=[ 19268], 40.00th=[ 22414], 50.00th=[ 25297], 60.00th=[ 29754], | 70.00th=[ 33424], 80.00th=[ 39584], 90.00th=[ 47973], 95.00th=[ 56886], | 99.00th=[102237], 99.50th=[116917], 99.90th=[147850], 99.95th=[147850], | 99.99th=[147850] bw ( KiB/s): min= 127, max= 445, per=25.87%, avg=307.37, stdev=77.48, samples=38 iops : min= 7, max= 27, avg=18.50, stdev= 4.95, samples=38 write: IOPS=20, BW=323KiB/s (331kB/s)(6256KiB/19371msec); 0 zone resets clat (usec): min=1221, max=101743, avg=22391.37, stdev=19979.24 lat (usec): min=1223, max=101745, avg=22393.25, stdev=19979.30 clat percentiles (usec): | 1.00th=[ 1418], 5.00th=[ 1745], 10.00th=[ 2343], 20.00th=[ 4555], | 30.00th=[ 7439], 40.00th=[ 12911], 50.00th=[ 16188], 60.00th=[ 22152], | 70.00th=[ 27919], 80.00th=[ 40109], 90.00th=[ 49546], 95.00th=[ 61080], | 99.00th=[ 84411], 99.50th=[100140], 99.90th=[102237], 99.95th=[102237], | 99.99th=[102237] bw ( KiB/s): min= 95, max= 605, per=25.52%, avg=319.03, stdev=109.97, samples=38 iops : min= 5, max= 37, avg=19.21, stdev= 6.88, samples=38 lat (usec) : 250=1.69%, 500=2.73%, 750=0.13%, 1000=0.26% lat (msec) : 2=4.56%, 4=5.34%, 10=9.90%, 20=19.53%, 50=47.14% lat (msec) : 100=7.94%, 250=0.78% cpu : usr=0.11%, sys=11.01%, ctx=1887, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1188KiB/s (1217kB/s), 292KiB/s-311KiB/s (299kB/s-319kB/s), io=23.4MiB (24.5MB), run=19371-20159msec WRITE: bw=1250KiB/s (1280kB/s), 299KiB/s-332KiB/s (306kB/s-340kB/s), io=24.6MiB (25.8MB), run=19371-20159msec rand-rw: (groupid=0, jobs=1): err= 0: pid=183510: Thu Oct 23 14:13:30 2025 read: IOPS=13, BW=216KiB/s (221kB/s)(5920KiB/27413msec) clat (msec): min=6, max=127, avg=27.80, stdev=21.17 lat (msec): min=6, max=127, avg=27.80, stdev=21.17 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 13], | 30.00th=[ 15], 40.00th=[ 17], 50.00th=[ 21], 60.00th=[ 24], | 70.00th=[ 31], 80.00th=[ 40], 90.00th=[ 60], 95.00th=[ 74], | 99.00th=[ 107], 99.50th=[ 120], 99.90th=[ 128], 99.95th=[ 128], | 99.99th=[ 128] bw ( KiB/s): min= 31, max= 576, per=24.71%, avg=215.76, stdev=118.34, samples=54 iops : min= 1, max= 36, avg=12.72, stdev= 7.55, samples=54 write: IOPS=14, BW=232KiB/s (238kB/s)(6368KiB/27413msec); 0 zone resets clat (msec): min=9, max=176, avg=42.84, stdev=26.42 lat (msec): min=9, max=176, avg=42.84, stdev=26.42 clat percentiles (msec): | 1.00th=[ 12], 5.00th=[ 16], 10.00th=[ 19], 20.00th=[ 24], | 30.00th=[ 27], 40.00th=[ 30], 50.00th=[ 35], 60.00th=[ 41], | 70.00th=[ 48], 80.00th=[ 61], 90.00th=[ 79], 95.00th=[ 97], | 99.00th=[ 140], 99.50th=[ 148], 99.90th=[ 178], 99.95th=[ 178], | 99.99th=[ 178] bw ( KiB/s): min= 62, max= 638, per=25.30%, avg=232.50, stdev=114.77, samples=54 iops : min= 3, max= 39, avg=13.78, stdev= 7.26, samples=54 lat (msec) : 10=4.82%, 20=25.13%, 50=49.48%, 100=17.71%, 250=2.86% cpu : usr=0.08%, sys=3.62%, ctx=1268, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183511: Thu Oct 23 14:13:30 2025 read: IOPS=13, BW=211KiB/s (216kB/s)(5744KiB/27274msec) clat (msec): min=6, max=182, avg=27.81, stdev=22.92 lat (msec): min=6, max=182, avg=27.81, stdev=22.92 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 13], | 30.00th=[ 14], 40.00th=[ 17], 50.00th=[ 21], 60.00th=[ 24], | 70.00th=[ 29], 80.00th=[ 40], 90.00th=[ 61], 95.00th=[ 75], | 99.00th=[ 114], 99.50th=[ 122], 99.90th=[ 182], 99.95th=[ 182], | 99.99th=[ 182] bw ( KiB/s): min= 31, max= 544, per=24.07%, avg=210.13, stdev=121.52, samples=53 iops : min= 1, max= 34, avg=12.38, stdev= 7.68, samples=53 write: IOPS=14, BW=240KiB/s (246kB/s)(6544KiB/27274msec); 0 zone resets clat (msec): min=10, max=181, avg=41.78, stdev=24.70 lat (msec): min=11, max=181, avg=41.78, stdev=24.70 clat percentiles (msec): | 1.00th=[ 13], 5.00th=[ 17], 10.00th=[ 19], 20.00th=[ 23], | 30.00th=[ 27], 40.00th=[ 30], 50.00th=[ 35], 60.00th=[ 40], | 70.00th=[ 50], 80.00th=[ 60], 90.00th=[ 75], 95.00th=[ 87], | 99.00th=[ 133], 99.50th=[ 140], 99.90th=[ 182], 99.95th=[ 182], | 99.99th=[ 182] bw ( KiB/s): min= 62, max= 510, per=25.82%, avg=237.30, stdev=109.17, samples=53 iops : min= 3, max= 31, avg=14.08, stdev= 6.94, samples=53 lat (msec) : 10=4.43%, 20=27.08%, 50=46.88%, 100=19.01%, 250=2.60% cpu : usr=0.08%, sys=3.67%, ctx=1276, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183512: Thu Oct 23 14:13:30 2025 read: IOPS=14, BW=231KiB/s (236kB/s)(6256KiB/27095msec) clat (msec): min=5, max=182, avg=27.87, stdev=22.33 lat (msec): min=5, max=182, avg=27.87, stdev=22.33 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 13], | 30.00th=[ 15], 40.00th=[ 18], 50.00th=[ 20], 60.00th=[ 24], | 70.00th=[ 29], 80.00th=[ 42], 90.00th=[ 59], 95.00th=[ 72], | 99.00th=[ 112], 99.50th=[ 130], 99.90th=[ 184], 99.95th=[ 184], | 99.99th=[ 184] bw ( KiB/s): min= 91, max= 670, per=26.62%, avg=232.36, stdev=138.91, samples=53 iops : min= 5, max= 41, avg=13.75, stdev= 8.79, samples=53 write: IOPS=13, BW=223KiB/s (228kB/s)(6032KiB/27095msec); 0 zone resets clat (msec): min=9, max=254, avg=42.45, stdev=26.63 lat (msec): min=9, max=254, avg=42.46, stdev=26.63 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 15], 10.00th=[ 18], 20.00th=[ 23], | 30.00th=[ 27], 40.00th=[ 31], 50.00th=[ 37], 60.00th=[ 41], | 70.00th=[ 48], 80.00th=[ 58], 90.00th=[ 75], 95.00th=[ 90], | 99.00th=[ 136], 99.50th=[ 176], 99.90th=[ 255], 99.95th=[ 255], | 99.99th=[ 255] bw ( KiB/s): min= 63, max= 480, per=23.86%, avg=219.28, stdev=102.67, samples=53 iops : min= 3, max= 30, avg=12.96, stdev= 6.55, samples=53 lat (msec) : 10=5.34%, 20=26.95%, 50=46.88%, 100=18.88%, 250=1.82% lat (msec) : 500=0.13% cpu : usr=0.07%, sys=3.57%, ctx=1294, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183513: Thu Oct 23 14:13:30 2025 read: IOPS=13, BW=223KiB/s (228kB/s)(6032KiB/27093msec) clat (msec): min=5, max=154, avg=27.21, stdev=21.30 lat (msec): min=5, max=154, avg=27.21, stdev=21.30 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 13], | 30.00th=[ 15], 40.00th=[ 18], 50.00th=[ 20], 60.00th=[ 24], | 70.00th=[ 29], 80.00th=[ 37], 90.00th=[ 59], 95.00th=[ 75], | 99.00th=[ 111], 99.50th=[ 116], 99.90th=[ 155], 99.95th=[ 155], | 99.99th=[ 155] bw ( KiB/s): min= 31, max= 507, per=25.27%, avg=220.64, stdev=115.22, samples=53 iops : min= 1, max= 31, avg=13.04, stdev= 7.29, samples=53 write: IOPS=14, BW=231KiB/s (236kB/s)(6256KiB/27093msec); 0 zone resets clat (msec): min=11, max=207, avg=42.64, stdev=26.99 lat (msec): min=11, max=207, avg=42.65, stdev=26.98 clat percentiles (msec): | 1.00th=[ 14], 5.00th=[ 16], 10.00th=[ 19], 20.00th=[ 24], | 30.00th=[ 27], 40.00th=[ 31], 50.00th=[ 35], 60.00th=[ 41], | 70.00th=[ 49], 80.00th=[ 60], 90.00th=[ 75], 95.00th=[ 93], | 99.00th=[ 176], 99.50th=[ 194], 99.90th=[ 207], 99.95th=[ 207], | 99.99th=[ 207] bw ( KiB/s): min= 94, max= 576, per=25.06%, avg=230.30, stdev=110.35, samples=53 iops : min= 5, max= 36, avg=13.64, stdev= 7.02, samples=53 lat (msec) : 10=4.56%, 20=27.08%, 50=47.79%, 100=18.23%, 250=2.34% cpu : usr=0.08%, sys=3.55%, ctx=1249, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=874KiB/s (895kB/s), 211KiB/s-231KiB/s (216kB/s-236kB/s), io=23.4MiB (24.5MB), run=27093-27413msec WRITE: bw=919KiB/s (941kB/s), 223KiB/s-240KiB/s (228kB/s-246kB/s), io=24.6MiB (25.8MB), run=27093-27413msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=183523: Thu Oct 23 14:13:47 2025 read: IOPS=1, BW=1502KiB/s (1538kB/s)(7168KiB/4773msec) clat (usec): min=625, max=383860, avg=195070.26, stdev=122415.21 lat (usec): min=626, max=383862, avg=195072.67, stdev=122415.00 clat percentiles (usec): | 1.00th=[ 627], 5.00th=[ 627], 10.00th=[ 627], 20.00th=[149947], | 30.00th=[162530], 40.00th=[162530], 50.00th=[179307], 60.00th=[181404], | 70.00th=[181404], 80.00th=[308282], 90.00th=[383779], 95.00th=[383779], | 99.00th=[383779], 99.50th=[383779], 99.90th=[383779], 99.95th=[383779], | 99.99th=[383779] bw ( KiB/s): min= 1889, max= 4079, per=100.00%, avg=2387.20, stdev=946.92, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 write: IOPS=1, BW=1073KiB/s (1098kB/s)(5120KiB/4773msec); 0 zone resets clat (msec): min=141, max=2336, avg=638.53, stdev=950.90 lat (msec): min=141, max=2336, avg=639.17, stdev=950.54 clat percentiles (msec): | 1.00th=[ 142], 5.00th=[ 142], 10.00th=[ 142], 20.00th=[ 142], | 30.00th=[ 186], 40.00th=[ 186], 50.00th=[ 253], 60.00th=[ 253], | 70.00th=[ 275], 80.00th=[ 275], 90.00th=[ 2333], 95.00th=[ 2333], | 99.00th=[ 2333], 99.50th=[ 2333], 99.90th=[ 2333], 99.95th=[ 2333], | 99.99th=[ 2333] bw ( KiB/s): min= 1889, max= 3953, per=80.83%, avg=2592.33, stdev=1178.60, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (usec) : 750=8.33% lat (msec) : 250=50.00%, 500=33.33%, >=2000=8.33% cpu : usr=0.00%, sys=8.57%, ctx=148, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183524: Thu Oct 23 14:13:47 2025 read: IOPS=0, BW=238KiB/s (244kB/s)(2048KiB/8607msec) clat (usec): min=648, max=2720.9k, avg=1360763.44, stdev=1923492.46 lat (usec): min=650, max=2720.9k, avg=1360765.13, stdev=1923492.97 clat percentiles (usec): | 1.00th=[ 652], 5.00th=[ 652], 10.00th=[ 652], | 20.00th=[ 652], 30.00th=[ 652], 40.00th=[ 652], | 50.00th=[ 652], 60.00th=[2734687], 70.00th=[2734687], | 80.00th=[2734687], 90.00th=[2734687], 95.00th=[2734687], | 99.00th=[2734687], 99.50th=[2734687], 99.90th=[2734687], | 99.95th=[2734687], 99.99th=[2734687] bw ( KiB/s): min= 1882, max= 1935, per=83.30%, avg=1908.50, stdev=37.48, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1190KiB/s (1218kB/s)(10.0MiB/8607msec); 0 zone resets clat (msec): min=181, max=2573, avg=583.69, stdev=714.07 lat (msec): min=181, max=2573, avg=583.76, stdev=714.08 clat percentiles (msec): | 1.00th=[ 182], 5.00th=[ 182], 10.00th=[ 182], 20.00th=[ 199], | 30.00th=[ 262], 40.00th=[ 313], 50.00th=[ 351], 60.00th=[ 372], | 70.00th=[ 422], 80.00th=[ 493], 90.00th=[ 676], 95.00th=[ 2567], | 99.00th=[ 2567], 99.50th=[ 2567], 99.90th=[ 2567], 99.95th=[ 2567], | 99.99th=[ 2567] bw ( KiB/s): min= 1889, max= 4079, per=81.83%, avg=2624.33, stdev=1010.82, samples=6 iops : min= 1, max= 3, avg= 1.67, stdev= 1.03, samples=6 lat (usec) : 750=8.33% lat (msec) : 250=16.67%, 500=50.00%, 750=8.33%, >=2000=16.67% cpu : usr=0.01%, sys=7.45%, ctx=514, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183525: Thu Oct 23 14:13:47 2025 read: IOPS=0, BW=687KiB/s (704kB/s)(6144KiB/8939msec) clat (msec): min=134, max=2815, avg=651.36, stdev=1061.95 lat (msec): min=134, max=2815, avg=651.36, stdev=1061.95 clat percentiles (msec): | 1.00th=[ 136], 5.00th=[ 136], 10.00th=[ 136], 20.00th=[ 194], | 30.00th=[ 194], 40.00th=[ 199], 50.00th=[ 199], 60.00th=[ 279], | 70.00th=[ 288], 80.00th=[ 288], 90.00th=[ 2802], 95.00th=[ 2802], | 99.00th=[ 2802], 99.50th=[ 2802], 99.90th=[ 2802], 99.95th=[ 2802], | 99.99th=[ 2802] bw ( KiB/s): min= 1976, max= 4039, per=100.00%, avg=3322.67, stdev=1167.04, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 write: IOPS=0, BW=687KiB/s (704kB/s)(6144KiB/8939msec); 0 zone resets clat (msec): min=126, max=2903, avg=805.96, stdev=1088.65 lat (msec): min=126, max=2903, avg=806.05, stdev=1088.63 clat percentiles (msec): | 1.00th=[ 127], 5.00th=[ 127], 10.00th=[ 127], 20.00th=[ 209], | 30.00th=[ 209], 40.00th=[ 247], 50.00th=[ 247], 60.00th=[ 251], | 70.00th=[ 1099], 80.00th=[ 1099], 90.00th=[ 2903], 95.00th=[ 2903], | 99.00th=[ 2903], 99.50th=[ 2903], 99.90th=[ 2903], 99.95th=[ 2903], | 99.99th=[ 2903] bw ( KiB/s): min= 1882, max= 6059, per=93.05%, avg=2984.00, stdev=2050.80, samples=4 iops : min= 1, max= 5, avg= 2.00, stdev= 2.00, samples=4 lat (msec) : 250=50.00%, 500=25.00%, 2000=8.33%, >=2000=16.67% cpu : usr=0.00%, sys=6.25%, ctx=452, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183526: Thu Oct 23 14:13:47 2025 read: IOPS=0, BW=865KiB/s (886kB/s)(5120KiB/5920msec) clat (usec): min=514, max=325568, avg=182453.71, stdev=117099.73 lat (usec): min=515, max=325569, avg=182455.05, stdev=117099.81 clat percentiles (usec): | 1.00th=[ 515], 5.00th=[ 515], 10.00th=[ 515], 20.00th=[ 515], | 30.00th=[175113], 40.00th=[175113], 50.00th=[196084], 60.00th=[196084], | 70.00th=[214959], 80.00th=[214959], 90.00th=[325059], 95.00th=[325059], | 99.00th=[325059], 99.50th=[325059], 99.90th=[325059], 99.95th=[325059], | 99.99th=[325059] bw ( KiB/s): min= 1889, max= 5647, per=100.00%, avg=3768.00, stdev=2657.31, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 write: IOPS=1, BW=1211KiB/s (1240kB/s)(7168KiB/5920msec); 0 zone resets clat (msec): min=206, max=2757, avg=678.34, stdev=925.14 lat (msec): min=206, max=2766, avg=679.61, stdev=928.28 clat percentiles (msec): | 1.00th=[ 207], 5.00th=[ 207], 10.00th=[ 207], 20.00th=[ 249], | 30.00th=[ 292], 40.00th=[ 292], 50.00th=[ 321], 60.00th=[ 334], | 70.00th=[ 334], 80.00th=[ 592], 90.00th=[ 2769], 95.00th=[ 2769], | 99.00th=[ 2769], 99.50th=[ 2769], 99.90th=[ 2769], 99.95th=[ 2769], | 99.99th=[ 2769] bw ( KiB/s): min= 1889, max= 4079, per=74.20%, avg=2379.60, stdev=951.22, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 lat (usec) : 750=8.33% lat (msec) : 250=41.67%, 500=33.33%, 750=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=7.08%, ctx=115, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2291KiB/s (2346kB/s), 238KiB/s-1502KiB/s (244kB/s-1538kB/s), io=20.0MiB (20.0MB), run=4773-8939msec WRITE: bw=3208KiB/s (3284kB/s), 687KiB/s-1211KiB/s (704kB/s-1240kB/s), io=28.0MiB (29.4MB), run=4773-8939msec rand-rw: (groupid=0, jobs=1): err= 0: pid=183528: Thu Oct 23 14:13:48 2025 read: IOPS=0, BW=800KiB/s (819kB/s)(7168KiB/8964msec) clat (msec): min=118, max=602, avg=320.40, stdev=205.98 lat (msec): min=118, max=602, avg=320.40, stdev=205.98 clat percentiles (msec): | 1.00th=[ 118], 5.00th=[ 118], 10.00th=[ 118], 20.00th=[ 165], | 30.00th=[ 171], 40.00th=[ 171], 50.00th=[ 178], 60.00th=[ 485], | 70.00th=[ 485], 80.00th=[ 523], 90.00th=[ 600], 95.00th=[ 600], | 99.00th=[ 600], 99.50th=[ 600], 99.90th=[ 600], 99.95th=[ 600], | 99.99th=[ 600] bw ( KiB/s): min= 2031, max= 4445, per=100.00%, avg=3515.67, stdev=1299.29, samples=3 iops : min= 1, max= 4, avg= 2.67, stdev= 1.53, samples=3 write: IOPS=0, BW=571KiB/s (585kB/s)(5120KiB/8964msec); 0 zone resets clat (msec): min=197, max=2926, avg=1313.00, stdev=1277.93 lat (msec): min=197, max=2926, avg=1313.56, stdev=1278.47 clat percentiles (msec): | 1.00th=[ 199], 5.00th=[ 199], 10.00th=[ 199], 20.00th=[ 199], | 30.00th=[ 259], 40.00th=[ 259], 50.00th=[ 751], 60.00th=[ 751], | 70.00th=[ 2433], 80.00th=[ 2433], 90.00th=[ 2937], 95.00th=[ 2937], | 99.00th=[ 2937], 99.50th=[ 2937], 99.90th=[ 2937], 99.95th=[ 2937], | 99.99th=[ 2937] bw ( KiB/s): min= 2007, max= 4079, per=85.47%, avg=2530.00, stdev=1032.68, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (msec) : 250=41.67%, 500=16.67%, 750=25.00%, >=2000=16.67% cpu : usr=0.00%, sys=2.60%, ctx=91, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183529: Thu Oct 23 14:13:48 2025 read: IOPS=0, BW=211KiB/s (217kB/s)(2048KiB/9685msec) clat (msec): min=200, max=2478, avg=1339.64, stdev=1610.33 lat (msec): min=200, max=2478, avg=1339.64, stdev=1610.33 clat percentiles (msec): | 1.00th=[ 201], 5.00th=[ 201], 10.00th=[ 201], 20.00th=[ 201], | 30.00th=[ 201], 40.00th=[ 201], 50.00th=[ 201], 60.00th=[ 2467], | 70.00th=[ 2467], 80.00th=[ 2467], 90.00th=[ 2467], 95.00th=[ 2467], | 99.00th=[ 2467], 99.50th=[ 2467], 99.90th=[ 2467], 99.95th=[ 2467], | 99.99th=[ 2467] bw ( KiB/s): min= 1906, max= 2007, per=92.55%, avg=1956.50, stdev=71.42, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1057KiB/s (1083kB/s)(10.0MiB/9685msec); 0 zone resets clat (msec): min=106, max=2530, avg=678.18, stdev=741.67 lat (msec): min=106, max=2530, avg=678.42, stdev=741.81 clat percentiles (msec): | 1.00th=[ 107], 5.00th=[ 107], 10.00th=[ 107], 20.00th=[ 124], | 30.00th=[ 213], 40.00th=[ 330], 50.00th=[ 363], 60.00th=[ 498], | 70.00th=[ 642], 80.00th=[ 659], 90.00th=[ 1318], 95.00th=[ 2534], | 99.00th=[ 2534], 99.50th=[ 2534], 99.90th=[ 2534], 99.95th=[ 2534], | 99.99th=[ 2534] bw ( KiB/s): min= 1939, max= 4071, per=79.45%, avg=2351.67, stdev=843.08, samples=6 iops : min= 1, max= 3, avg= 1.33, stdev= 0.82, samples=6 lat (msec) : 250=33.33%, 500=25.00%, 750=16.67%, 2000=8.33%, >=2000=16.67% cpu : usr=0.02%, sys=2.35%, ctx=78, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183530: Thu Oct 23 14:13:48 2025 read: IOPS=0, BW=678KiB/s (694kB/s)(6144KiB/9068msec) clat (msec): min=102, max=2321, avg=536.15, stdev=880.94 lat (msec): min=102, max=2321, avg=536.15, stdev=880.94 clat percentiles (msec): | 1.00th=[ 103], 5.00th=[ 103], 10.00th=[ 103], 20.00th=[ 105], | 30.00th=[ 105], 40.00th=[ 130], 50.00th=[ 130], 60.00th=[ 178], | 70.00th=[ 380], 80.00th=[ 380], 90.00th=[ 2333], 95.00th=[ 2333], | 99.00th=[ 2333], 99.50th=[ 2333], 99.90th=[ 2333], 99.95th=[ 2333], | 99.99th=[ 2333] bw ( KiB/s): min= 1939, max= 4063, per=100.00%, avg=2512.00, stdev=1034.84, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 write: IOPS=0, BW=678KiB/s (694kB/s)(6144KiB/9068msec); 0 zone resets clat (msec): min=394, max=3008, avg=942.51, stdev=1023.64 lat (msec): min=395, max=3008, avg=942.58, stdev=1023.64 clat percentiles (msec): | 1.00th=[ 397], 5.00th=[ 397], 10.00th=[ 397], 20.00th=[ 409], | 30.00th=[ 409], 40.00th=[ 418], 50.00th=[ 418], 60.00th=[ 676], | 70.00th=[ 751], 80.00th=[ 751], 90.00th=[ 3004], 95.00th=[ 3004], | 99.00th=[ 3004], 99.50th=[ 3004], 99.90th=[ 3004], 99.95th=[ 3004], | 99.99th=[ 3004] bw ( KiB/s): min= 1939, max= 4031, per=84.56%, avg=2503.00, stdev=1019.46, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (msec) : 250=33.33%, 500=33.33%, 750=8.33%, 1000=8.33%, >=2000=16.67% cpu : usr=0.00%, sys=3.25%, ctx=129, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183531: Thu Oct 23 14:13:48 2025 read: IOPS=0, BW=535KiB/s (548kB/s)(5120KiB/9565msec) clat (msec): min=65, max=380, avg=179.88, stdev=133.48 lat (msec): min=65, max=380, avg=179.88, stdev=133.48 clat percentiles (msec): | 1.00th=[ 66], 5.00th=[ 66], 10.00th=[ 66], 20.00th=[ 66], | 30.00th=[ 85], 40.00th=[ 85], 50.00th=[ 118], 60.00th=[ 118], | 70.00th=[ 251], 80.00th=[ 251], 90.00th=[ 380], 95.00th=[ 380], | 99.00th=[ 380], 99.50th=[ 380], 99.90th=[ 380], 99.95th=[ 380], | 99.99th=[ 380] bw ( KiB/s): min= 2035, max= 6023, per=100.00%, avg=4029.00, stdev=2819.94, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 write: IOPS=0, BW=749KiB/s (767kB/s)(7168KiB/9565msec); 0 zone resets clat (msec): min=91, max=3516, avg=1216.16, stdev=1535.80 lat (msec): min=91, max=3516, avg=1216.23, stdev=1535.80 clat percentiles (msec): | 1.00th=[ 92], 5.00th=[ 92], 10.00th=[ 92], 20.00th=[ 163], | 30.00th=[ 197], 40.00th=[ 197], 50.00th=[ 584], 60.00th=[ 592], | 70.00th=[ 592], 80.00th=[ 3373], 90.00th=[ 3507], 95.00th=[ 3507], | 99.00th=[ 3507], 99.50th=[ 3507], 99.90th=[ 3507], 99.95th=[ 3507], | 99.99th=[ 3507] bw ( KiB/s): min= 2015, max= 2035, per=68.48%, avg=2027.00, stdev= 9.38, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 lat (msec) : 100=25.00%, 250=25.00%, 500=16.67%, 750=16.67%, >=2000=16.67% cpu : usr=0.00%, sys=2.95%, ctx=105, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2115KiB/s (2165kB/s), 211KiB/s-800KiB/s (217kB/s-819kB/s), io=20.0MiB (20.0MB), run=8964-9685msec WRITE: bw=2960KiB/s (3032kB/s), 571KiB/s-1057KiB/s (585kB/s-1083kB/s), io=28.0MiB (29.4MB), run=8964-9685msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=183543: Thu Oct 23 14:14:06 2025 read: IOPS=0, BW=2719KiB/s (2784kB/s)(12.0MiB/4520msec) clat (msec): min=416, max=3366, avg=1473.58, stdev=1642.97 lat (msec): min=416, max=3366, avg=1473.58, stdev=1642.97 clat percentiles (msec): | 1.00th=[ 418], 5.00th=[ 418], 10.00th=[ 418], 20.00th=[ 418], | 30.00th=[ 418], 40.00th=[ 642], 50.00th=[ 642], 60.00th=[ 642], | 70.00th=[ 3373], 80.00th=[ 3373], 90.00th=[ 3373], 95.00th=[ 3373], | 99.00th=[ 3373], 99.50th=[ 3373], 99.90th=[ 3373], 99.95th=[ 3373], | 99.99th=[ 3373] bw ( KiB/s): min= 8159, max= 8175, per=100.00%, avg=8167.00, stdev=11.31, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 750=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=3.19%, ctx=56, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183544: Thu Oct 23 14:14:06 2025 read: IOPS=0, BW=849KiB/s (869kB/s)(4096KiB/4827msec) clat (nsec): min=2784.5M, max=2784.5M, avg=2784525440.00, stdev= 0.00 lat (nsec): min=2784.5M, max=2784.5M, avg=2784528012.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 2769], 5.00th=[ 2769], 10.00th=[ 2769], 20.00th=[ 2769], | 30.00th=[ 2769], 40.00th=[ 2769], 50.00th=[ 2769], 60.00th=[ 2769], | 70.00th=[ 2769], 80.00th=[ 2769], 90.00th=[ 2769], 95.00th=[ 2769], | 99.00th=[ 2769], 99.50th=[ 2769], 99.90th=[ 2769], 99.95th=[ 2769], | 99.99th=[ 2769] bw ( KiB/s): min= 8175, max= 8175, per=100.00%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=1697KiB/s (1738kB/s)(8192KiB/4827msec); 0 zone resets clat (msec): min=845, max=1117, avg=981.60, stdev=192.56 lat (msec): min=847, max=1118, avg=982.92, stdev=191.15 clat percentiles (msec): | 1.00th=[ 844], 5.00th=[ 844], 10.00th=[ 844], 20.00th=[ 844], | 30.00th=[ 844], 40.00th=[ 844], 50.00th=[ 844], 60.00th=[ 1116], | 70.00th=[ 1116], 80.00th=[ 1116], 90.00th=[ 1116], 95.00th=[ 1116], | 99.00th=[ 1116], 99.50th=[ 1116], 99.90th=[ 1116], 99.95th=[ 1116], | 99.99th=[ 1116] bw ( KiB/s): min= 8159, max= 8159, per=100.00%, avg=8159.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 1000=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=2.86%, ctx=47, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183545: Thu Oct 23 14:14:06 2025 write: IOPS=0, BW=2902KiB/s (2972kB/s)(12.0MiB/4234msec); 0 zone resets clat (msec): min=487, max=3056, avg=1353.20, stdev=1475.07 lat (msec): min=487, max=3056, avg=1354.26, stdev=1474.51 clat percentiles (msec): | 1.00th=[ 489], 5.00th=[ 489], 10.00th=[ 489], 20.00th=[ 489], | 30.00th=[ 489], 40.00th=[ 514], 50.00th=[ 514], 60.00th=[ 514], | 70.00th=[ 3071], 80.00th=[ 3071], 90.00th=[ 3071], 95.00th=[ 3071], | 99.00th=[ 3071], 99.50th=[ 3071], 99.90th=[ 3071], 99.95th=[ 3071], | 99.99th=[ 3071] bw ( KiB/s): min= 8159, max= 8175, per=100.00%, avg=8167.00, stdev=11.31, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 750=33.33%, >=2000=33.33% cpu : usr=0.17%, sys=2.88%, ctx=50, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183546: Thu Oct 23 14:14:06 2025 write: IOPS=0, BW=2774KiB/s (2840kB/s)(12.0MiB/4430msec); 0 zone resets clat (msec): min=502, max=2887, avg=1421.33, stdev=1283.47 lat (msec): min=502, max=2894, avg=1423.93, stdev=1287.31 clat percentiles (msec): | 1.00th=[ 502], 5.00th=[ 502], 10.00th=[ 502], 20.00th=[ 502], | 30.00th=[ 502], 40.00th=[ 877], 50.00th=[ 877], 60.00th=[ 877], | 70.00th=[ 2903], 80.00th=[ 2903], 90.00th=[ 2903], 95.00th=[ 2903], | 99.00th=[ 2903], 99.50th=[ 2903], 99.90th=[ 2903], 99.95th=[ 2903], | 99.99th=[ 2903] bw ( KiB/s): min= 8175, max= 8175, per=100.00%, avg=8175.00, stdev= 0.00, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 1000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=3.30%, ctx=63, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3394KiB/s (3476kB/s), 849KiB/s-2719KiB/s (869kB/s-2784kB/s), io=16.0MiB (16.8MB), run=4520-4827msec WRITE: bw=6788KiB/s (6951kB/s), 1697KiB/s-2902KiB/s (1738kB/s-2972kB/s), io=32.0MiB (33.6MB), run=4234-4827msec rand-rw: (groupid=0, jobs=1): err= 0: pid=183538: Thu Oct 23 14:14:06 2025 read: IOPS=0, BW=3379KiB/s (3460kB/s)(12.0MiB/3637msec) clat (msec): min=667, max=2159, avg=1170.09, stdev=856.68 lat (msec): min=667, max=2159, avg=1170.09, stdev=856.68 clat percentiles (msec): | 1.00th=[ 667], 5.00th=[ 667], 10.00th=[ 667], 20.00th=[ 667], | 30.00th=[ 667], 40.00th=[ 684], 50.00th=[ 684], 60.00th=[ 684], | 70.00th=[ 2165], 80.00th=[ 2165], 90.00th=[ 2165], 95.00th=[ 2165], | 99.00th=[ 2165], 99.50th=[ 2165], 99.90th=[ 2165], 99.95th=[ 2165], | 99.99th=[ 2165] bw ( KiB/s): min= 8192, max= 8192, per=100.00%, avg=8192.00, stdev= 0.00, samples=2 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=2 lat (msec) : 750=66.67%, >=2000=33.33% cpu : usr=0.00%, sys=11.85%, ctx=596, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183539: Thu Oct 23 14:14:06 2025 read: IOPS=0, BW=888KiB/s (909kB/s)(4096KiB/4613msec) clat (nsec): min=380978k, max=380978k, avg=380977569.00, stdev= 0.00 lat (nsec): min=380980k, max=380980k, avg=380980491.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 380], 5.00th=[ 380], 10.00th=[ 380], 20.00th=[ 380], | 30.00th=[ 380], 40.00th=[ 380], 50.00th=[ 380], 60.00th=[ 380], | 70.00th=[ 380], 80.00th=[ 380], 90.00th=[ 380], 95.00th=[ 380], | 99.00th=[ 380], 99.50th=[ 380], 99.90th=[ 380], 99.95th=[ 380], | 99.99th=[ 380] bw ( KiB/s): min= 8143, max= 8143, per=100.00%, avg=8143.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=1776KiB/s (1818kB/s)(8192KiB/4613msec); 0 zone resets clat (msec): min=613, max=3375, avg=1994.58, stdev=1952.76 lat (msec): min=614, max=3375, avg=1994.87, stdev=1952.77 clat percentiles (msec): | 1.00th=[ 617], 5.00th=[ 617], 10.00th=[ 617], 20.00th=[ 617], | 30.00th=[ 617], 40.00th=[ 617], 50.00th=[ 617], 60.00th=[ 3373], | 70.00th=[ 3373], 80.00th=[ 3373], 90.00th=[ 3373], 95.00th=[ 3373], | 99.00th=[ 3373], 99.50th=[ 3373], 99.90th=[ 3373], 99.95th=[ 3373], | 99.99th=[ 3373] bw ( KiB/s): min= 8143, max= 8143, per=100.00%, avg=8143.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 750=33.33%, >=2000=33.33% cpu : usr=0.02%, sys=3.86%, ctx=78, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183540: Thu Oct 23 14:14:06 2025 write: IOPS=0, BW=2485KiB/s (2545kB/s)(12.0MiB/4945msec); 0 zone resets clat (msec): min=155, max=3872, avg=1609.97, stdev=1985.89 lat (msec): min=155, max=3873, avg=1610.55, stdev=1986.35 clat percentiles (msec): | 1.00th=[ 157], 5.00th=[ 157], 10.00th=[ 157], 20.00th=[ 157], | 30.00th=[ 157], 40.00th=[ 802], 50.00th=[ 802], 60.00th=[ 802], | 70.00th=[ 3876], 80.00th=[ 3876], 90.00th=[ 3876], 95.00th=[ 3876], | 99.00th=[ 3876], 99.50th=[ 3876], 99.90th=[ 3876], 99.95th=[ 3876], | 99.99th=[ 3876] bw ( KiB/s): min= 8192, max= 8192, per=100.00%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 1000=33.33%, >=2000=33.33% cpu : usr=0.10%, sys=2.73%, ctx=57, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183542: Thu Oct 23 14:14:06 2025 write: IOPS=0, BW=2851KiB/s (2919kB/s)(12.0MiB/4310msec); 0 zone resets clat (msec): min=551, max=2468, avg=1378.32, stdev=985.14 lat (msec): min=551, max=2468, avg=1378.69, stdev=985.15 clat percentiles (msec): | 1.00th=[ 550], 5.00th=[ 550], 10.00th=[ 550], 20.00th=[ 550], | 30.00th=[ 550], 40.00th=[ 1116], 50.00th=[ 1116], 60.00th=[ 1116], | 70.00th=[ 2467], 80.00th=[ 2467], 90.00th=[ 2467], 95.00th=[ 2467], | 99.00th=[ 2467], 99.50th=[ 2467], 99.90th=[ 2467], 99.95th=[ 2467], | 99.99th=[ 2467] bw ( KiB/s): min= 8126, max= 8192, per=100.00%, avg=8159.00, stdev=46.67, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 750=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.09%, sys=2.74%, ctx=59, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3552KiB/s (3637kB/s), 888KiB/s-3379KiB/s (909kB/s-3460kB/s), io=16.0MiB (16.8MB), run=3637-4613msec WRITE: bw=6626KiB/s (6786kB/s), 1776KiB/s-2851KiB/s (1818kB/s-2919kB/s), io=32.0MiB (33.6MB), run=4310-4945msec