== sanity test 398b: DIO and buffer IO race ============== 16:42:03 (1760128923) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 3.08408 s, 16.3 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=191737: Fri Oct 10 16:43:18 2025 read: IOPS=23, BW=93.7KiB/s (95.0kB/s)(5992KiB/63945msec) clat (usec): min=149, max=733773, avg=23854.50, stdev=23111.39 lat (usec): min=150, max=733773, avg=23857.75, stdev=23110.75 clat percentiles (usec): | 1.00th=[ 194], 5.00th=[ 7898], 10.00th=[ 10290], 20.00th=[ 12649], | 30.00th=[ 15008], 40.00th=[ 17695], 50.00th=[ 20841], 60.00th=[ 23987], | 70.00th=[ 27395], 80.00th=[ 32375], 90.00th=[ 40633], 95.00th=[ 47973], | 99.00th=[ 72877], 99.50th=[ 82314], 99.90th=[137364], 99.95th=[734004], | 99.99th=[734004] bw ( KiB/s): min= 7, max= 159, per=25.02%, avg=93.31, stdev=27.81, samples=127 iops : min= 1, max= 39, avg=22.74, stdev= 6.99, samples=127 write: IOPS=24, BW=98.5KiB/s (101kB/s)(6296KiB/63945msec); 0 zone resets clat (usec): min=848, max=102706, avg=17733.61, stdev=16488.12 lat (usec): min=848, max=102708, avg=17735.11, stdev=16488.15 clat percentiles (usec): | 1.00th=[ 1090], 5.00th=[ 1418], 10.00th=[ 1958], 20.00th=[ 2802], | 30.00th=[ 4293], 40.00th=[ 8979], 50.00th=[ 13829], 60.00th=[ 17957], | 70.00th=[ 22938], 80.00th=[ 30540], 90.00th=[ 41157], 95.00th=[ 50594], | 99.00th=[ 70779], 99.50th=[ 76022], 99.90th=[ 90702], 99.95th=[102237], | 99.99th=[102237] bw ( KiB/s): min= 7, max= 191, per=25.25%, avg=98.75, stdev=30.44, samples=126 iops : min= 1, max= 47, avg=24.10, stdev= 7.62, samples=126 lat (usec) : 250=0.88%, 500=0.78%, 750=0.13%, 1000=0.16% lat (msec) : 2=5.21%, 4=9.57%, 10=9.08%, 20=30.31%, 50=39.19% lat (msec) : 100=4.52%, 250=0.13%, 750=0.03% cpu : usr=0.14%, sys=13.85%, ctx=7305, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=191739: Fri Oct 10 16:43:18 2025 read: IOPS=23, BW=92.7KiB/s (94.0kB/s)(5940KiB/64054msec) clat (usec): min=122, max=159600, avg=23383.03, stdev=13453.49 lat (usec): min=123, max=159602, avg=23384.20, stdev=13453.52 clat percentiles (usec): | 1.00th=[ 202], 5.00th=[ 8979], 10.00th=[ 10814], 20.00th=[ 13304], | 30.00th=[ 15664], 40.00th=[ 18220], 50.00th=[ 20841], 60.00th=[ 23987], | 70.00th=[ 27919], 80.00th=[ 32375], 90.00th=[ 38536], 95.00th=[ 45351], | 99.00th=[ 68682], 99.50th=[ 85459], 99.90th=[122160], 99.95th=[160433], | 99.99th=[160433] bw ( KiB/s): min= 7, max= 159, per=24.67%, avg=92.01, stdev=26.19, samples=127 iops : min= 1, max= 39, avg=22.41, stdev= 6.57, samples=127 write: IOPS=24, BW=99.1KiB/s (101kB/s)(6348KiB/64054msec); 0 zone resets clat (usec): min=755, max=752033, avg=18307.24, stdev=25036.57 lat (usec): min=757, max=752034, avg=18310.93, stdev=25035.96 clat percentiles (usec): | 1.00th=[ 1090], 5.00th=[ 1401], 10.00th=[ 1926], 20.00th=[ 2933], | 30.00th=[ 5145], 40.00th=[ 10159], 50.00th=[ 14091], 60.00th=[ 17433], | 70.00th=[ 22414], 80.00th=[ 29230], 90.00th=[ 40633], 95.00th=[ 52691], | 99.00th=[ 78119], 99.50th=[ 87557], 99.90th=[127402], 99.95th=[750781], | 99.99th=[750781] bw ( KiB/s): min= 7, max= 215, per=25.10%, avg=98.16, stdev=31.96, samples=127 iops : min= 1, max= 53, avg=23.95, stdev= 7.99, samples=127 lat (usec) : 250=0.55%, 500=0.46%, 750=0.07%, 1000=0.16% lat (msec) : 2=5.37%, 4=8.07%, 10=9.51%, 20=32.36%, 50=39.03% lat (msec) : 100=4.07%, 250=0.33%, 1000=0.03% cpu : usr=0.15%, sys=13.83%, ctx=7431, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=191742: Fri Oct 10 16:43:18 2025 read: IOPS=23, BW=93.9KiB/s (96.1kB/s)(6028KiB/64215msec) clat (usec): min=119, max=123221, avg=23025.28, stdev=13811.79 lat (usec): min=119, max=123221, avg=23026.73, stdev=13811.89 clat percentiles (usec): | 1.00th=[ 241], 5.00th=[ 7963], 10.00th=[ 10159], 20.00th=[ 12518], | 30.00th=[ 14877], 40.00th=[ 17171], 50.00th=[ 20317], 60.00th=[ 23725], | 70.00th=[ 27395], 80.00th=[ 32113], 90.00th=[ 39060], 95.00th=[ 46924], | 99.00th=[ 73925], 99.50th=[ 85459], 99.90th=[111674], 99.95th=[123208], | 99.99th=[123208] bw ( KiB/s): min= 15, max= 184, per=24.90%, avg=92.88, stdev=29.62, samples=127 iops : min= 3, max= 46, avg=22.63, stdev= 7.45, samples=127 write: IOPS=24, BW=97.5KiB/s (99.8kB/s)(6260KiB/64215msec); 0 zone resets clat (usec): min=898, max=725494, avg=18667.31, stdev=24839.89 lat (usec): min=899, max=725496, avg=18669.00, stdev=24839.93 clat percentiles (usec): | 1.00th=[ 1057], 5.00th=[ 1385], 10.00th=[ 1942], 20.00th=[ 2900], | 30.00th=[ 5014], 40.00th=[ 10814], 50.00th=[ 14353], 60.00th=[ 18220], | 70.00th=[ 23462], 80.00th=[ 30278], 90.00th=[ 40633], 95.00th=[ 50070], | 99.00th=[ 74974], 99.50th=[ 90702], 99.90th=[143655], 99.95th=[725615], | 99.99th=[725615] bw ( KiB/s): min= 15, max= 176, per=24.62%, avg=96.28, stdev=30.24, samples=127 iops : min= 3, max= 44, avg=23.48, stdev= 7.55, samples=127 lat (usec) : 250=0.62%, 500=0.98%, 750=0.13%, 1000=0.23% lat (msec) : 2=5.31%, 4=8.27%, 10=8.95%, 20=31.87%, 50=39.26% lat (msec) : 100=4.17%, 250=0.20%, 750=0.03% cpu : usr=0.15%, sys=13.85%, ctx=7329, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=191744: Fri Oct 10 16:43:18 2025 read: IOPS=23, BW=95.5KiB/s (97.8kB/s)(6052KiB/63367msec) clat (usec): min=101, max=138641, avg=23027.02, stdev=14868.34 lat (usec): min=101, max=138641, avg=23033.11, stdev=14865.99 clat percentiles (usec): | 1.00th=[ 227], 5.00th=[ 7570], 10.00th=[ 10028], 20.00th=[ 12387], | 30.00th=[ 14877], 40.00th=[ 17433], 50.00th=[ 19792], 60.00th=[ 23200], | 70.00th=[ 26870], 80.00th=[ 31851], 90.00th=[ 38536], 95.00th=[ 49546], | 99.00th=[ 79168], 99.50th=[ 99091], 99.90th=[131597], 99.95th=[139461], | 99.99th=[139461] bw ( KiB/s): min= 39, max= 191, per=25.74%, avg=96.02, stdev=25.40, samples=123 iops : min= 9, max= 47, avg=23.41, stdev= 6.34, samples=123 write: IOPS=24, BW=98.4KiB/s (101kB/s)(6236KiB/63367msec); 0 zone resets clat (usec): min=980, max=765818, avg=18088.95, stdev=25216.67 lat (usec): min=980, max=765820, avg=18090.79, stdev=25216.72 clat percentiles (usec): | 1.00th=[ 1090], 5.00th=[ 1450], 10.00th=[ 2008], 20.00th=[ 2900], | 30.00th=[ 4555], 40.00th=[ 9765], 50.00th=[ 14484], 60.00th=[ 18220], | 70.00th=[ 22676], 80.00th=[ 28705], 90.00th=[ 38536], 95.00th=[ 50070], | 99.00th=[ 76022], 99.50th=[ 85459], 99.90th=[130548], 99.95th=[767558], | 99.99th=[767558] bw ( KiB/s): min= 7, max= 192, per=25.16%, avg=98.37, stdev=31.14, samples=124 iops : min= 1, max= 48, avg=24.00, stdev= 7.82, samples=124 lat (usec) : 250=0.65%, 500=1.14%, 750=0.07%, 1000=0.13% lat (msec) : 2=4.98%, 4=8.72%, 10=9.80%, 20=32.58%, 50=37.11% lat (msec) : 100=4.46%, 250=0.33%, 1000=0.03% cpu : usr=0.16%, sys=13.95%, ctx=7334, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=374KiB/s (383kB/s), 92.7KiB/s-95.5KiB/s (94.0kB/s-97.8kB/s), io=23.4MiB (24.6MB), run=63367-64215msec WRITE: bw=391KiB/s (401kB/s), 97.5KiB/s-99.1KiB/s (99.8kB/s-101kB/s), io=24.6MiB (25.7MB), run=63367-64215msec rand-rw: (groupid=0, jobs=1): err= 0: pid=191738: Fri Oct 10 16:43:39 2025 read: IOPS=17, BW=69.8KiB/s (71.5kB/s)(5992KiB/85845msec) clat (msec): min=4, max=750, avg=23.02, stdev=26.31 lat (msec): min=4, max=750, avg=23.02, stdev=26.31 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 7], 10.00th=[ 8], 20.00th=[ 10], | 30.00th=[ 12], 40.00th=[ 14], 50.00th=[ 16], 60.00th=[ 19], | 70.00th=[ 24], 80.00th=[ 33], 90.00th=[ 50], 95.00th=[ 63], | 99.00th=[ 91], 99.50th=[ 101], 99.90th=[ 155], 99.95th=[ 751], | 99.99th=[ 751] bw ( KiB/s): min= 15, max= 199, per=24.89%, avg=69.44, stdev=38.85, samples=169 iops : min= 3, max= 49, avg=16.75, stdev= 9.73, samples=169 write: IOPS=18, BW=73.3KiB/s (75.1kB/s)(6296KiB/85845msec); 0 zone resets clat (msec): min=7, max=203, avg=32.44, stdev=21.12 lat (msec): min=7, max=203, avg=32.44, stdev=21.12 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 13], 10.00th=[ 15], 20.00th=[ 17], | 30.00th=[ 20], 40.00th=[ 23], 50.00th=[ 26], 60.00th=[ 30], | 70.00th=[ 37], 80.00th=[ 47], 90.00th=[ 59], 95.00th=[ 73], | 99.00th=[ 111], 99.50th=[ 123], 99.90th=[ 161], 99.95th=[ 203], | 99.99th=[ 203] bw ( KiB/s): min= 7, max= 182, per=25.15%, avg=73.45, stdev=37.05, samples=168 iops : min= 1, max= 45, avg=17.75, stdev= 9.29, samples=168 lat (msec) : 10=11.59%, 20=35.45%, 50=39.26%, 100=12.66%, 250=1.01% lat (msec) : 1000=0.03% cpu : usr=0.12%, sys=5.30%, ctx=5134, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=191740: Fri Oct 10 16:43:39 2025 read: IOPS=17, BW=69.8KiB/s (71.5kB/s)(5940KiB/85122msec) clat (msec): min=5, max=753, avg=22.15, stdev=26.19 lat (msec): min=5, max=753, avg=22.15, stdev=26.19 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 7], 10.00th=[ 8], 20.00th=[ 10], | 30.00th=[ 12], 40.00th=[ 13], 50.00th=[ 15], 60.00th=[ 18], | 70.00th=[ 22], 80.00th=[ 32], 90.00th=[ 45], 95.00th=[ 59], | 99.00th=[ 90], 99.50th=[ 104], 99.90th=[ 136], 99.95th=[ 751], | 99.99th=[ 751] bw ( KiB/s): min= 7, max= 223, per=24.99%, avg=69.73, stdev=41.39, samples=168 iops : min= 1, max= 55, avg=16.82, stdev=10.36, samples=168 write: IOPS=18, BW=74.6KiB/s (76.4kB/s)(6348KiB/85122msec); 0 zone resets clat (msec): min=7, max=173, avg=32.72, stdev=20.77 lat (msec): min=7, max=173, avg=32.72, stdev=20.77 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 13], 10.00th=[ 14], 20.00th=[ 17], | 30.00th=[ 20], 40.00th=[ 23], 50.00th=[ 26], 60.00th=[ 31], | 70.00th=[ 39], 80.00th=[ 48], 90.00th=[ 62], 95.00th=[ 75], | 99.00th=[ 104], 99.50th=[ 121], 99.90th=[ 150], 99.95th=[ 174], | 99.99th=[ 174] bw ( KiB/s): min= 7, max= 191, per=25.50%, avg=74.47, stdev=37.78, samples=168 iops : min= 1, max= 47, avg=18.01, stdev= 9.47, samples=168 lat (msec) : 10=12.08%, 20=36.82%, 50=38.05%, 100=12.21%, 250=0.81% lat (msec) : 1000=0.03% cpu : usr=0.12%, sys=5.28%, ctx=5131, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=191741: Fri Oct 10 16:43:39 2025 read: IOPS=17, BW=70.2KiB/s (71.9kB/s)(6028KiB/85879msec) clat (msec): min=4, max=154, avg=22.26, stdev=17.69 lat (msec): min=4, max=154, avg=22.26, stdev=17.69 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 10], | 30.00th=[ 12], 40.00th=[ 14], 50.00th=[ 17], 60.00th=[ 20], | 70.00th=[ 24], 80.00th=[ 32], 90.00th=[ 48], 95.00th=[ 60], | 99.00th=[ 89], 99.50th=[ 102], 99.90th=[ 123], 99.95th=[ 155], | 99.99th=[ 155] bw ( KiB/s): min= 15, max= 191, per=25.19%, avg=70.29, stdev=36.77, samples=168 iops : min= 3, max= 47, avg=16.96, stdev= 9.22, samples=168 write: IOPS=18, BW=72.9KiB/s (74.6kB/s)(6260KiB/85879msec); 0 zone resets clat (msec): min=5, max=758, avg=33.25, stdev=28.57 lat (msec): min=5, max=758, avg=33.25, stdev=28.57 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 17], | 30.00th=[ 20], 40.00th=[ 22], 50.00th=[ 26], 60.00th=[ 31], | 70.00th=[ 39], 80.00th=[ 48], 90.00th=[ 62], 95.00th=[ 73], | 99.00th=[ 114], 99.50th=[ 150], 99.90th=[ 209], 99.95th=[ 760], | 99.99th=[ 760] bw ( KiB/s): min= 16, max= 239, per=24.82%, avg=72.49, stdev=39.09, samples=169 iops : min= 4, max= 59, avg=17.51, stdev= 9.79, samples=169 lat (msec) : 10=11.43%, 20=36.43%, 50=38.67%, 100=12.40%, 250=1.04% lat (msec) : 1000=0.03% cpu : usr=0.12%, sys=5.42%, ctx=5099, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=191743: Fri Oct 10 16:43:39 2025 read: IOPS=17, BW=70.6KiB/s (72.3kB/s)(6052KiB/85667msec) clat (msec): min=3, max=184, avg=23.08, stdev=19.31 lat (msec): min=3, max=184, avg=23.08, stdev=19.31 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 7], 10.00th=[ 8], 20.00th=[ 10], | 30.00th=[ 12], 40.00th=[ 14], 50.00th=[ 17], 60.00th=[ 20], | 70.00th=[ 25], 80.00th=[ 35], 90.00th=[ 52], 95.00th=[ 66], | 99.00th=[ 95], 99.50th=[ 106], 99.90th=[ 128], 99.95th=[ 184], | 99.99th=[ 184] bw ( KiB/s): min= 7, max= 183, per=25.44%, avg=70.96, stdev=39.48, samples=168 iops : min= 1, max= 45, avg=17.13, stdev= 9.90, samples=168 write: IOPS=18, BW=72.8KiB/s (74.5kB/s)(6236KiB/85667msec); 0 zone resets clat (msec): min=6, max=776, avg=32.37, stdev=27.68 lat (msec): min=6, max=776, avg=32.37, stdev=27.68 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 17], | 30.00th=[ 20], 40.00th=[ 22], 50.00th=[ 25], 60.00th=[ 30], | 70.00th=[ 37], 80.00th=[ 46], 90.00th=[ 59], 95.00th=[ 72], | 99.00th=[ 104], 99.50th=[ 123], 99.90th=[ 161], 99.95th=[ 776], | 99.99th=[ 776] bw ( KiB/s): min= 15, max= 183, per=24.84%, avg=72.54, stdev=38.01, samples=169 iops : min= 3, max= 45, avg=17.52, stdev= 9.51, samples=169 lat (msec) : 4=0.03%, 10=11.65%, 20=35.42%, 50=39.42%, 100=12.60% lat (msec) : 250=0.85%, 1000=0.03% cpu : usr=0.10%, sys=5.26%, ctx=5154, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=280KiB/s (286kB/s), 69.8KiB/s-70.6KiB/s (71.5kB/s-72.3kB/s), io=23.4MiB (24.6MB), run=85122-85879msec WRITE: bw=293KiB/s (300kB/s), 72.8KiB/s-74.6KiB/s (74.5kB/s-76.4kB/s), io=24.6MiB (25.7MB), run=85122-85879msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=191776: Fri Oct 10 16:44:05 2025 read: IOPS=19, BW=311KiB/s (319kB/s)(5920KiB/19015msec) clat (usec): min=128, max=92715, avg=26185.47, stdev=15134.51 lat (usec): min=129, max=92717, avg=26187.08, stdev=15135.03 clat percentiles (usec): | 1.00th=[ 153], 5.00th=[ 367], 10.00th=[10552], 20.00th=[15139], | 30.00th=[18220], 40.00th=[20579], 50.00th=[23987], 60.00th=[27395], | 70.00th=[32375], 80.00th=[36439], 90.00th=[45351], 95.00th=[54789], | 99.00th=[74974], 99.50th=[82314], 99.90th=[92799], 99.95th=[92799], | 99.99th=[92799] bw ( KiB/s): min= 156, max= 509, per=25.03%, avg=308.89, stdev=74.17, samples=37 iops : min= 9, max= 31, avg=18.57, stdev= 4.68, samples=37 write: IOPS=20, BW=335KiB/s (343kB/s)(6368KiB/19015msec); 0 zone resets clat (usec): min=1435, max=99210, avg=23284.89, stdev=19148.65 lat (usec): min=1437, max=99211, avg=23290.14, stdev=19152.31 clat percentiles (usec): | 1.00th=[ 1696], 5.00th=[ 2474], 10.00th=[ 3425], 20.00th=[ 5538], | 30.00th=[ 8291], 40.00th=[14353], 50.00th=[18482], 60.00th=[24511], | 70.00th=[31327], 80.00th=[39584], 90.00th=[48497], 95.00th=[61080], | 99.00th=[87557], 99.50th=[98042], 99.90th=[99091], 99.95th=[99091], | 99.99th=[99091] bw ( KiB/s): min= 127, max= 507, per=25.79%, avg=334.78, stdev=84.57, samples=37 iops : min= 7, max= 31, avg=20.19, stdev= 5.35, samples=37 lat (usec) : 250=1.56%, 500=1.43%, 750=0.13%, 1000=0.26% lat (msec) : 2=1.17%, 4=6.12%, 10=11.33%, 20=22.66%, 50=47.01% lat (msec) : 100=8.33% cpu : usr=0.12%, sys=14.00%, ctx=2000, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=191777: Fri Oct 10 16:44:05 2025 read: IOPS=18, BW=298KiB/s (305kB/s)(5744KiB/19293msec) clat (usec): min=119, max=102701, avg=27062.74, stdev=15489.17 lat (usec): min=120, max=102701, avg=27064.08, stdev=15489.26 clat percentiles (usec): | 1.00th=[ 194], 5.00th=[ 594], 10.00th=[ 11469], 20.00th=[ 15664], | 30.00th=[ 18482], 40.00th=[ 21365], 50.00th=[ 24249], 60.00th=[ 28705], | 70.00th=[ 32637], 80.00th=[ 38011], 90.00th=[ 48497], 95.00th=[ 54264], | 99.00th=[ 78119], 99.50th=[ 93848], 99.90th=[102237], 99.95th=[102237], | 99.99th=[102237] bw ( KiB/s): min= 134, max= 476, per=24.19%, avg=298.47, stdev=82.69, samples=38 iops : min= 8, max= 29, avg=17.92, stdev= 5.12, samples=38 write: IOPS=21, BW=339KiB/s (347kB/s)(6544KiB/19293msec); 0 zone resets clat (usec): min=1546, max=101289, avg=23077.74, stdev=19572.35 lat (usec): min=1548, max=101292, avg=23095.20, stdev=19568.75 clat percentiles (usec): | 1.00th=[ 1795], 5.00th=[ 2606], 10.00th=[ 3425], 20.00th=[ 5800], | 30.00th=[ 8979], 40.00th=[ 13566], 50.00th=[ 18220], 60.00th=[ 22676], | 70.00th=[ 29754], 80.00th=[ 37487], 90.00th=[ 51643], 95.00th=[ 60031], | 99.00th=[ 84411], 99.50th=[ 85459], 99.90th=[101188], 99.95th=[101188], | 99.99th=[101188] bw ( KiB/s): min= 159, max= 701, per=26.11%, avg=338.87, stdev=112.28, samples=38 iops : min= 9, max= 43, avg=20.45, stdev= 6.98, samples=38 lat (usec) : 250=1.04%, 500=1.17%, 750=0.13%, 1000=0.13% lat (msec) : 2=1.30%, 4=6.38%, 10=10.03%, 20=25.00%, 50=45.18% lat (msec) : 100=9.38%, 250=0.26% cpu : usr=0.14%, sys=14.16%, ctx=2013, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=191778: Fri Oct 10 16:44:05 2025 read: IOPS=20, BW=322KiB/s (330kB/s)(6256KiB/19403msec) clat (usec): min=148, max=113953, avg=26875.92, stdev=15617.87 lat (usec): min=150, max=113954, avg=26877.23, stdev=15617.82 clat percentiles (usec): | 1.00th=[ 169], 5.00th=[ 371], 10.00th=[ 11076], 20.00th=[ 15926], | 30.00th=[ 19268], 40.00th=[ 21890], 50.00th=[ 25822], 60.00th=[ 28967], | 70.00th=[ 32375], 80.00th=[ 37487], 90.00th=[ 43779], 95.00th=[ 50594], | 99.00th=[ 92799], 99.50th=[108528], 99.90th=[113771], 99.95th=[113771], | 99.99th=[113771] bw ( KiB/s): min= 159, max= 509, per=26.15%, avg=322.71, stdev=83.74, samples=38 iops : min= 9, max= 31, avg=19.45, stdev= 5.31, samples=38 write: IOPS=19, BW=311KiB/s (318kB/s)(6032KiB/19403msec); 0 zone resets clat (usec): min=1507, max=133170, avg=23248.98, stdev=19537.63 lat (usec): min=1510, max=133172, avg=23251.60, stdev=19537.74 clat percentiles (usec): | 1.00th=[ 1696], 5.00th=[ 2737], 10.00th=[ 3752], 20.00th=[ 5997], | 30.00th=[ 10028], 40.00th=[ 13960], 50.00th=[ 17957], 60.00th=[ 23462], | 70.00th=[ 30802], 80.00th=[ 36963], 90.00th=[ 49021], 95.00th=[ 58459], | 99.00th=[ 89654], 99.50th=[ 98042], 99.90th=[133694], 99.95th=[133694], | 99.99th=[133694] bw ( KiB/s): min= 127, max= 572, per=23.59%, avg=306.21, stdev=99.84, samples=38 iops : min= 7, max= 35, avg=18.39, stdev= 6.25, samples=38 lat (usec) : 250=1.17%, 500=2.08%, 1000=0.13% lat (msec) : 2=1.56%, 4=4.30%, 10=10.03%, 20=24.22%, 50=49.22% lat (msec) : 100=6.90%, 250=0.39% cpu : usr=0.10%, sys=13.87%, ctx=2125, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=191779: Fri Oct 10 16:44:05 2025 read: IOPS=20, BW=324KiB/s (332kB/s)(6032KiB/18601msec) clat (usec): min=144, max=119356, avg=27034.92, stdev=17719.56 lat (usec): min=145, max=119357, avg=27036.25, stdev=17719.45 clat percentiles (usec): | 1.00th=[ 163], 5.00th=[ 262], 10.00th=[ 2376], 20.00th=[ 14353], | 30.00th=[ 17695], 40.00th=[ 21365], 50.00th=[ 24773], 60.00th=[ 28181], | 70.00th=[ 33162], 80.00th=[ 38536], 90.00th=[ 47449], 95.00th=[ 60031], | 99.00th=[ 84411], 99.50th=[109577], 99.90th=[119014], 99.95th=[119014], | 99.99th=[119014] bw ( KiB/s): min= 126, max= 477, per=26.31%, avg=324.64, stdev=85.62, samples=36 iops : min= 7, max= 29, avg=19.53, stdev= 5.36, samples=36 write: IOPS=21, BW=336KiB/s (344kB/s)(6256KiB/18601msec); 0 zone resets clat (usec): min=1379, max=106463, avg=21066.56, stdev=18296.72 lat (usec): min=1381, max=106465, avg=21069.05, stdev=18296.65 clat percentiles (usec): | 1.00th=[ 1680], 5.00th=[ 2073], 10.00th=[ 2933], 20.00th=[ 4752], | 30.00th=[ 6849], 40.00th=[ 12387], 50.00th=[ 17171], 60.00th=[ 20841], | 70.00th=[ 25560], 80.00th=[ 34866], 90.00th=[ 47449], 95.00th=[ 56886], | 99.00th=[ 74974], 99.50th=[ 90702], 99.90th=[106431], 99.95th=[106431], | 99.99th=[106431] bw ( KiB/s): min= 188, max= 669, per=25.96%, avg=336.94, stdev=116.78, samples=36 iops : min= 11, max= 41, avg=20.31, stdev= 7.29, samples=36 lat (usec) : 250=2.34%, 500=1.69%, 750=0.39%, 1000=0.13% lat (msec) : 2=2.60%, 4=5.99%, 10=10.42%, 20=23.18%, 50=45.05% lat (msec) : 100=7.81%, 250=0.39% cpu : usr=0.15%, sys=13.50%, ctx=1935, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1234KiB/s (1264kB/s), 298KiB/s-324KiB/s (305kB/s-332kB/s), io=23.4MiB (24.5MB), run=18601-19403msec WRITE: bw=1299KiB/s (1330kB/s), 311KiB/s-339KiB/s (318kB/s-347kB/s), io=24.6MiB (25.8MB), run=18601-19403msec rand-rw: (groupid=0, jobs=1): err= 0: pid=191772: Fri Oct 10 16:44:11 2025 read: IOPS=14, BW=232KiB/s (238kB/s)(5920KiB/25502msec) clat (msec): min=5, max=123, avg=25.14, stdev=20.29 lat (msec): min=5, max=123, avg=25.14, stdev=20.29 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 10], 20.00th=[ 11], | 30.00th=[ 13], 40.00th=[ 15], 50.00th=[ 17], 60.00th=[ 21], | 70.00th=[ 26], 80.00th=[ 39], 90.00th=[ 55], 95.00th=[ 71], | 99.00th=[ 97], 99.50th=[ 114], 99.90th=[ 125], 99.95th=[ 125], | 99.99th=[ 125] bw ( KiB/s): min= 63, max= 670, per=24.72%, avg=231.63, stdev=129.27, samples=49 iops : min= 3, max= 41, avg=13.73, stdev= 8.15, samples=49 write: IOPS=15, BW=250KiB/s (256kB/s)(6368KiB/25502msec); 0 zone resets clat (msec): min=9, max=157, avg=40.37, stdev=25.35 lat (msec): min=9, max=157, avg=40.37, stdev=25.35 clat percentiles (msec): | 1.00th=[ 12], 5.00th=[ 15], 10.00th=[ 18], 20.00th=[ 21], | 30.00th=[ 24], 40.00th=[ 27], 50.00th=[ 31], 60.00th=[ 39], | 70.00th=[ 50], 80.00th=[ 61], 90.00th=[ 79], 95.00th=[ 90], | 99.00th=[ 121], 99.50th=[ 146], 99.90th=[ 159], 99.95th=[ 159], | 99.99th=[ 159] bw ( KiB/s): min= 95, max= 573, per=25.05%, avg=246.96, stdev=126.13, samples=50 iops : min= 5, max= 35, avg=14.70, stdev= 8.00, samples=50 lat (msec) : 10=7.55%, 20=30.34%, 50=41.93%, 100=18.75%, 250=1.43% cpu : usr=0.12%, sys=4.64%, ctx=1330, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=191773: Fri Oct 10 16:44:11 2025 read: IOPS=14, BW=225KiB/s (230kB/s)(5744KiB/25540msec) clat (msec): min=5, max=121, avg=26.03, stdev=21.82 lat (msec): min=5, max=121, avg=26.03, stdev=21.82 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 10], 20.00th=[ 12], | 30.00th=[ 14], 40.00th=[ 16], 50.00th=[ 18], 60.00th=[ 21], | 70.00th=[ 27], 80.00th=[ 35], 90.00th=[ 62], 95.00th=[ 78], | 99.00th=[ 101], 99.50th=[ 121], 99.90th=[ 123], 99.95th=[ 123], | 99.99th=[ 123] bw ( KiB/s): min= 53, max= 606, per=24.16%, avg=226.39, stdev=131.27, samples=49 iops : min= 3, max= 37, avg=13.41, stdev= 8.26, samples=49 write: IOPS=16, BW=256KiB/s (262kB/s)(6544KiB/25540msec); 0 zone resets clat (msec): min=9, max=149, avg=39.34, stdev=23.98 lat (msec): min=9, max=149, avg=39.35, stdev=23.98 clat percentiles (msec): | 1.00th=[ 12], 5.00th=[ 15], 10.00th=[ 17], 20.00th=[ 21], | 30.00th=[ 24], 40.00th=[ 27], 50.00th=[ 31], 60.00th=[ 39], | 70.00th=[ 46], 80.00th=[ 57], 90.00th=[ 75], 95.00th=[ 88], | 99.00th=[ 111], 99.50th=[ 117], 99.90th=[ 150], 99.95th=[ 150], | 99.99th=[ 150] bw ( KiB/s): min= 94, max= 605, per=25.47%, avg=251.16, stdev=129.21, samples=50 iops : min= 5, max= 37, avg=14.96, stdev= 8.18, samples=50 lat (msec) : 10=7.03%, 20=29.95%, 50=43.23%, 100=17.97%, 250=1.82% cpu : usr=0.10%, sys=4.57%, ctx=1336, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=191774: Fri Oct 10 16:44:11 2025 read: IOPS=15, BW=246KiB/s (252kB/s)(6256KiB/25421msec) clat (msec): min=6, max=172, avg=27.38, stdev=24.84 lat (msec): min=6, max=172, avg=27.38, stdev=24.84 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 10], 20.00th=[ 12], | 30.00th=[ 14], 40.00th=[ 15], 50.00th=[ 18], 60.00th=[ 21], | 70.00th=[ 27], 80.00th=[ 39], 90.00th=[ 67], 95.00th=[ 82], | 99.00th=[ 120], 99.50th=[ 125], 99.90th=[ 174], 99.95th=[ 174], | 99.99th=[ 174] bw ( KiB/s): min= 63, max= 736, per=26.30%, avg=246.40, stdev=152.81, samples=50 iops : min= 3, max= 46, avg=14.64, stdev= 9.68, samples=50 write: IOPS=14, BW=237KiB/s (243kB/s)(6032KiB/25421msec); 0 zone resets clat (msec): min=9, max=150, avg=38.92, stdev=24.59 lat (msec): min=9, max=150, avg=38.92, stdev=24.59 clat percentiles (msec): | 1.00th=[ 12], 5.00th=[ 15], 10.00th=[ 17], 20.00th=[ 20], | 30.00th=[ 23], 40.00th=[ 26], 50.00th=[ 30], 60.00th=[ 36], | 70.00th=[ 44], 80.00th=[ 59], 90.00th=[ 78], 95.00th=[ 88], | 99.00th=[ 111], 99.50th=[ 117], 99.90th=[ 150], 99.95th=[ 150], | 99.99th=[ 150] bw ( KiB/s): min= 62, max= 631, per=23.58%, avg=232.54, stdev=127.18, samples=50 iops : min= 3, max= 39, avg=13.78, stdev= 8.04, samples=50 lat (msec) : 10=5.34%, 20=35.03%, 50=39.71%, 100=17.32%, 250=2.60% cpu : usr=0.11%, sys=4.70%, ctx=1315, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=191775: Fri Oct 10 16:44:11 2025 read: IOPS=15, BW=240KiB/s (246kB/s)(6032KiB/25133msec) clat (msec): min=5, max=170, avg=26.84, stdev=22.14 lat (msec): min=5, max=170, avg=26.84, stdev=22.14 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 9], 10.00th=[ 10], 20.00th=[ 13], | 30.00th=[ 14], 40.00th=[ 16], 50.00th=[ 19], 60.00th=[ 22], | 70.00th=[ 27], 80.00th=[ 40], 90.00th=[ 59], 95.00th=[ 77], | 99.00th=[ 105], 99.50th=[ 123], 99.90th=[ 171], 99.95th=[ 171], | 99.99th=[ 171] bw ( KiB/s): min= 94, max= 605, per=25.11%, avg=235.31, stdev=127.34, samples=49 iops : min= 5, max= 37, avg=13.96, stdev= 8.10, samples=49 write: IOPS=15, BW=249KiB/s (255kB/s)(6256KiB/25133msec); 0 zone resets clat (msec): min=10, max=138, avg=38.23, stdev=23.14 lat (msec): min=10, max=138, avg=38.23, stdev=23.14 clat percentiles (msec): | 1.00th=[ 13], 5.00th=[ 16], 10.00th=[ 17], 20.00th=[ 20], | 30.00th=[ 24], 40.00th=[ 27], 50.00th=[ 32], 60.00th=[ 36], | 70.00th=[ 45], 80.00th=[ 54], 90.00th=[ 73], 95.00th=[ 89], | 99.00th=[ 114], 99.50th=[ 115], 99.90th=[ 138], 99.95th=[ 138], | 99.99th=[ 138] bw ( KiB/s): min= 63, max= 606, per=24.96%, avg=246.10, stdev=120.90, samples=49 iops : min= 3, max= 37, avg=14.63, stdev= 7.68, samples=49 lat (msec) : 10=4.95%, 20=34.24%, 50=42.19%, 100=16.80%, 250=1.82% cpu : usr=0.08%, sys=4.68%, ctx=1292, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=938KiB/s (960kB/s), 225KiB/s-246KiB/s (230kB/s-252kB/s), io=23.4MiB (24.5MB), run=25133-25540msec WRITE: bw=987KiB/s (1010kB/s), 237KiB/s-256KiB/s (243kB/s-262kB/s), io=24.6MiB (25.8MB), run=25133-25540msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=191789: Fri Oct 10 16:44:21 2025 read: IOPS=3, BW=3200KiB/s (3277kB/s)(7168KiB/2240msec) clat (usec): min=799, max=178534, avg=106602.83, stdev=74382.38 lat (usec): min=799, max=178535, avg=106604.46, stdev=74382.64 clat percentiles (usec): | 1.00th=[ 799], 5.00th=[ 799], 10.00th=[ 799], 20.00th=[ 824], | 30.00th=[127402], 40.00th=[127402], 50.00th=[133694], 60.00th=[141558], | 70.00th=[141558], 80.00th=[164627], 90.00th=[179307], 95.00th=[179307], | 99.00th=[179307], 99.50th=[179307], 99.90th=[179307], 99.95th=[179307], | 99.99th=[179307] bw ( KiB/s): min= 1980, max= 5774, per=60.76%, avg=3950.00, stdev=1901.21, samples=3 iops : min= 1, max= 5, avg= 3.33, stdev= 2.08, samples=3 write: IOPS=2, BW=2286KiB/s (2341kB/s)(5120KiB/2240msec); 0 zone resets clat (msec): min=109, max=404, avg=284.65, stdev=123.00 lat (msec): min=109, max=404, avg=284.79, stdev=123.07 clat percentiles (msec): | 1.00th=[ 109], 5.00th=[ 109], 10.00th=[ 109], 20.00th=[ 109], | 30.00th=[ 239], 40.00th=[ 239], 50.00th=[ 271], 60.00th=[ 271], | 70.00th=[ 401], 80.00th=[ 401], 90.00th=[ 405], 95.00th=[ 405], | 99.00th=[ 405], 99.50th=[ 405], 99.90th=[ 405], 99.95th=[ 405], | 99.99th=[ 405] bw ( KiB/s): min= 2007, max= 3961, per=29.36%, avg=2672.00, stdev=1116.49, samples=3 iops : min= 1, max= 3, avg= 2.00, stdev= 1.00, samples=3 lat (usec) : 1000=16.67% lat (msec) : 250=58.33%, 500=25.00% cpu : usr=0.00%, sys=41.22%, ctx=533, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=191790: Fri Oct 10 16:44:21 2025 read: IOPS=0, BW=650KiB/s (666kB/s)(2048KiB/3150msec) clat (usec): min=786, max=354961, avg=177873.88, stdev=250439.45 lat (usec): min=787, max=354962, avg=177875.14, stdev=250439.68 clat percentiles (usec): | 1.00th=[ 791], 5.00th=[ 791], 10.00th=[ 791], 20.00th=[ 791], | 30.00th=[ 791], 40.00th=[ 791], 50.00th=[ 791], 60.00th=[354419], | 70.00th=[354419], 80.00th=[354419], 90.00th=[354419], 95.00th=[354419], | 99.00th=[354419], 99.50th=[354419], 99.90th=[354419], 99.95th=[354419], | 99.99th=[354419] bw ( KiB/s): min= 2007, max= 2048, per=31.19%, avg=2027.50, stdev=28.99, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 write: IOPS=3, BW=3251KiB/s (3329kB/s)(10.0MiB/3150msec); 0 zone resets clat (msec): min=101, max=687, avg=255.66, stdev=179.90 lat (msec): min=102, max=687, avg=255.78, stdev=179.89 clat percentiles (msec): | 1.00th=[ 103], 5.00th=[ 103], 10.00th=[ 103], 20.00th=[ 129], | 30.00th=[ 136], 40.00th=[ 167], 50.00th=[ 182], 60.00th=[ 224], | 70.00th=[ 230], 80.00th=[ 262], 90.00th=[ 443], 95.00th=[ 684], | 99.00th=[ 684], 99.50th=[ 684], 99.90th=[ 684], 99.95th=[ 684], | 99.99th=[ 684] bw ( KiB/s): min= 2007, max= 6144, per=50.51%, avg=4597.75, stdev=1978.68, samples=4 iops : min= 1, max= 6, avg= 4.25, stdev= 2.36, samples=4 lat (usec) : 1000=8.33% lat (msec) : 250=58.33%, 500=25.00%, 750=8.33% cpu : usr=0.06%, sys=35.69%, ctx=186, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=191791: Fri Oct 10 16:44:21 2025 read: IOPS=2, BW=2705KiB/s (2770kB/s)(6144KiB/2271msec) clat (usec): min=1047, max=217971, avg=128151.66, stdev=95927.19 lat (usec): min=1047, max=217974, avg=128152.92, stdev=95927.53 clat percentiles (usec): | 1.00th=[ 1045], 5.00th=[ 1045], 10.00th=[ 1045], 20.00th=[ 12125], | 30.00th=[ 12125], 40.00th=[162530], 50.00th=[162530], 60.00th=[181404], | 70.00th=[193987], 80.00th=[193987], 90.00th=[217056], 95.00th=[217056], | 99.00th=[217056], 99.50th=[217056], 99.90th=[217056], 99.95th=[217056], | 99.99th=[217056] bw ( KiB/s): min= 2007, max= 5941, per=51.25%, avg=3332.00, stdev=2259.55, samples=3 iops : min= 1, max= 5, avg= 2.67, stdev= 2.08, samples=3 write: IOPS=2, BW=2705KiB/s (2770kB/s)(6144KiB/2271msec); 0 zone resets clat (msec): min=112, max=431, avg=246.81, stdev=117.25 lat (msec): min=112, max=431, avg=246.91, stdev=117.23 clat percentiles (msec): | 1.00th=[ 113], 5.00th=[ 113], 10.00th=[ 113], 20.00th=[ 167], | 30.00th=[ 167], 40.00th=[ 192], 50.00th=[ 192], 60.00th=[ 247], | 70.00th=[ 334], 80.00th=[ 334], 90.00th=[ 430], 95.00th=[ 430], | 99.00th=[ 430], 99.50th=[ 430], 99.90th=[ 430], 99.95th=[ 430], | 99.99th=[ 430] bw ( KiB/s): min= 1980, max= 3923, per=27.35%, avg=2489.50, stdev=956.08, samples=4 iops : min= 1, max= 3, avg= 1.75, stdev= 0.96, samples=4 lat (msec) : 2=8.33%, 20=8.33%, 250=66.67%, 500=16.67% cpu : usr=0.04%, sys=42.38%, ctx=299, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=191792: Fri Oct 10 16:44:21 2025 read: IOPS=2, BW=2225KiB/s (2279kB/s)(5120KiB/2301msec) clat (usec): min=690, max=190141, avg=71003.89, stdev=96695.81 lat (usec): min=691, max=190142, avg=71004.85, stdev=96695.92 clat percentiles (usec): | 1.00th=[ 693], 5.00th=[ 693], 10.00th=[ 693], 20.00th=[ 693], | 30.00th=[ 725], 40.00th=[ 725], 50.00th=[ 824], 60.00th=[ 824], | 70.00th=[162530], 80.00th=[162530], 90.00th=[189793], 95.00th=[189793], | 99.00th=[189793], 99.50th=[189793], 99.90th=[189793], 99.95th=[189793], | 99.99th=[189793] bw ( KiB/s): min= 8192, max= 8192, per=100.00%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 8, max= 8, avg= 8.00, stdev= 0.00, samples=1 write: IOPS=3, BW=3115KiB/s (3190kB/s)(7168KiB/2301msec); 0 zone resets clat (msec): min=152, max=514, avg=264.02, stdev=133.62 lat (msec): min=152, max=514, avg=264.11, stdev=133.62 clat percentiles (msec): | 1.00th=[ 153], 5.00th=[ 153], 10.00th=[ 153], 20.00th=[ 159], | 30.00th=[ 194], 40.00th=[ 194], 50.00th=[ 224], 60.00th=[ 228], | 70.00th=[ 228], 80.00th=[ 380], 90.00th=[ 514], 95.00th=[ 514], | 99.00th=[ 514], 99.50th=[ 514], 99.90th=[ 514], 99.95th=[ 514], | 99.99th=[ 514] bw ( KiB/s): min= 1391, max= 4039, per=31.42%, avg=2859.75, stdev=1344.07, samples=4 iops : min= 1, max= 3, avg= 2.25, stdev= 0.96, samples=4 lat (usec) : 750=16.67%, 1000=8.33% lat (msec) : 250=58.33%, 500=8.33%, 750=8.33% cpu : usr=0.00%, sys=40.78%, ctx=212, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=6502KiB/s (6658kB/s), 650KiB/s-3200KiB/s (666kB/s-3277kB/s), io=20.0MiB (20.0MB), run=2240-3150msec WRITE: bw=9102KiB/s (9321kB/s), 2286KiB/s-3251KiB/s (2341kB/s-3329kB/s), io=28.0MiB (29.4MB), run=2240-3150msec rand-rw: (groupid=0, jobs=1): err= 0: pid=191793: Fri Oct 10 16:44:21 2025 read: IOPS=2, BW=2194KiB/s (2247kB/s)(7168KiB/3267msec) clat (msec): min=65, max=769, avg=255.90, stdev=252.29 lat (msec): min=65, max=769, avg=255.90, stdev=252.29 clat percentiles (msec): | 1.00th=[ 66], 5.00th=[ 66], 10.00th=[ 66], 20.00th=[ 95], | 30.00th=[ 117], 40.00th=[ 117], 50.00th=[ 130], 60.00th=[ 220], | 70.00th=[ 220], 80.00th=[ 397], 90.00th=[ 768], 95.00th=[ 768], | 99.00th=[ 768], 99.50th=[ 768], 99.90th=[ 768], 99.95th=[ 768], | 99.99th=[ 768] bw ( KiB/s): min= 1946, max= 4096, per=49.36%, avg=2999.50, stdev=1160.88, samples=4 iops : min= 1, max= 4, avg= 2.50, stdev= 1.29, samples=4 write: IOPS=1, BW=1567KiB/s (1605kB/s)(5120KiB/3267msec); 0 zone resets clat (msec): min=60, max=527, avg=234.52, stdev=175.87 lat (msec): min=60, max=527, avg=234.61, stdev=175.88 clat percentiles (msec): | 1.00th=[ 62], 5.00th=[ 62], 10.00th=[ 62], 20.00th=[ 62], | 30.00th=[ 171], 40.00th=[ 171], 50.00th=[ 176], 60.00th=[ 176], | 70.00th=[ 239], 80.00th=[ 239], 90.00th=[ 527], 95.00th=[ 527], | 99.00th=[ 527], 99.50th=[ 527], 99.90th=[ 527], 99.95th=[ 527], | 99.99th=[ 527] bw ( KiB/s): min= 2043, max= 6144, per=40.10%, avg=3411.67, stdev=2366.27, samples=3 iops : min= 1, max= 6, avg= 3.00, stdev= 2.65, samples=3 lat (msec) : 100=25.00%, 250=50.00%, 500=8.33%, 750=8.33%, 1000=8.33% cpu : usr=0.06%, sys=7.50%, ctx=96, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=191794: Fri Oct 10 16:44:21 2025 read: IOPS=0, BW=691KiB/s (708kB/s)(2048KiB/2962msec) clat (msec): min=405, max=444, avg=424.98, stdev=26.98 lat (msec): min=405, max=444, avg=424.98, stdev=26.98 clat percentiles (msec): | 1.00th=[ 405], 5.00th=[ 405], 10.00th=[ 405], 20.00th=[ 405], | 30.00th=[ 405], 40.00th=[ 405], 50.00th=[ 405], 60.00th=[ 443], | 70.00th=[ 443], 80.00th=[ 443], 90.00th=[ 443], 95.00th=[ 443], | 99.00th=[ 443], 99.50th=[ 443], 99.90th=[ 443], 99.95th=[ 443], | 99.99th=[ 443] bw ( KiB/s): min= 1899, max= 1954, per=31.70%, avg=1926.50, stdev=38.89, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=3, BW=3457KiB/s (3540kB/s)(10.0MiB/2962msec); 0 zone resets clat (msec): min=79, max=512, avg=206.18, stdev=152.86 lat (msec): min=79, max=512, avg=206.39, stdev=152.78 clat percentiles (msec): | 1.00th=[ 81], 5.00th=[ 81], 10.00th=[ 81], 20.00th=[ 100], | 30.00th=[ 112], 40.00th=[ 134], 50.00th=[ 138], 60.00th=[ 148], | 70.00th=[ 174], 80.00th=[ 205], 90.00th=[ 464], 95.00th=[ 514], | 99.00th=[ 514], 99.50th=[ 514], 99.90th=[ 514], 99.95th=[ 514], | 99.99th=[ 514] bw ( KiB/s): min= 1954, max= 6119, per=47.68%, avg=4056.33, stdev=2082.78, samples=3 iops : min= 1, max= 5, avg= 3.33, stdev= 2.08, samples=3 lat (msec) : 100=16.67%, 250=50.00%, 500=25.00%, 750=8.33% cpu : usr=0.00%, sys=11.65%, ctx=110, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=191795: Fri Oct 10 16:44:21 2025 read: IOPS=1, BW=1891KiB/s (1936kB/s)(6144KiB/3249msec) clat (msec): min=49, max=566, avg=227.67, stdev=207.87 lat (msec): min=49, max=566, avg=227.67, stdev=207.87 clat percentiles (msec): | 1.00th=[ 50], 5.00th=[ 50], 10.00th=[ 50], 20.00th=[ 92], | 30.00th=[ 92], 40.00th=[ 124], 50.00th=[ 124], 60.00th=[ 132], | 70.00th=[ 401], 80.00th=[ 401], 90.00th=[ 567], 95.00th=[ 567], | 99.00th=[ 567], 99.50th=[ 567], 99.90th=[ 567], 99.95th=[ 567], | 99.99th=[ 567] bw ( KiB/s): min= 1954, max= 4096, per=41.72%, avg=2535.25, stdev=1041.40, samples=4 iops : min= 1, max= 4, avg= 2.00, stdev= 1.41, samples=4 write: IOPS=1, BW=1891KiB/s (1936kB/s)(6144KiB/3249msec); 0 zone resets clat (msec): min=114, max=743, avg=269.92, stdev=235.34 lat (msec): min=114, max=743, avg=270.02, stdev=235.34 clat percentiles (msec): | 1.00th=[ 115], 5.00th=[ 115], 10.00th=[ 115], 20.00th=[ 140], | 30.00th=[ 140], 40.00th=[ 201], 50.00th=[ 201], 60.00th=[ 205], | 70.00th=[ 218], 80.00th=[ 218], 90.00th=[ 743], 95.00th=[ 743], | 99.00th=[ 743], 99.50th=[ 743], 99.90th=[ 743], 99.95th=[ 743], | 99.99th=[ 743] bw ( KiB/s): min= 1954, max= 2048, per=23.66%, avg=2013.00, stdev=44.65, samples=5 iops : min= 1, max= 2, avg= 1.40, stdev= 0.55, samples=5 lat (msec) : 50=8.33%, 100=8.33%, 250=58.33%, 500=8.33%, 750=16.67% cpu : usr=0.00%, sys=13.02%, ctx=95, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=191796: Fri Oct 10 16:44:21 2025 read: IOPS=1, BW=1519KiB/s (1556kB/s)(5120KiB/3370msec) clat (msec): min=36, max=243, avg=125.25, stdev=81.55 lat (msec): min=36, max=243, avg=125.25, stdev=81.55 clat percentiles (msec): | 1.00th=[ 37], 5.00th=[ 37], 10.00th=[ 37], 20.00th=[ 37], | 30.00th=[ 78], 40.00th=[ 78], 50.00th=[ 103], 60.00th=[ 103], | 70.00th=[ 167], 80.00th=[ 167], 90.00th=[ 245], 95.00th=[ 245], | 99.00th=[ 245], 99.50th=[ 245], 99.90th=[ 245], 99.95th=[ 245], | 99.99th=[ 245] bw ( KiB/s): min= 2043, max= 6144, per=67.36%, avg=4093.50, stdev=2899.84, samples=2 iops : min= 1, max= 6, avg= 3.50, stdev= 3.54, samples=2 write: IOPS=2, BW=2127KiB/s (2178kB/s)(7168KiB/3370msec); 0 zone resets clat (msec): min=62, max=748, avg=361.06, stdev=277.60 lat (msec): min=62, max=748, avg=361.16, stdev=277.61 clat percentiles (msec): | 1.00th=[ 63], 5.00th=[ 63], 10.00th=[ 63], 20.00th=[ 95], | 30.00th=[ 148], 40.00th=[ 148], 50.00th=[ 309], 60.00th=[ 535], | 70.00th=[ 535], 80.00th=[ 634], 90.00th=[ 751], 95.00th=[ 751], | 99.00th=[ 751], 99.50th=[ 751], 99.90th=[ 751], 99.95th=[ 751], | 99.99th=[ 751] bw ( KiB/s): min= 1954, max= 2048, per=23.75%, avg=2021.00, stdev=44.82, samples=4 iops : min= 1, max= 2, avg= 1.25, stdev= 0.50, samples=4 lat (msec) : 50=8.33%, 100=25.00%, 250=33.33%, 500=8.33%, 750=25.00% cpu : usr=0.03%, sys=12.20%, ctx=177, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=6077KiB/s (6223kB/s), 691KiB/s-2194KiB/s (708kB/s-2247kB/s), io=20.0MiB (20.0MB), run=2962-3370msec WRITE: bw=8508KiB/s (8712kB/s), 1567KiB/s-3457KiB/s (1605kB/s-3540kB/s), io=28.0MiB (29.4MB), run=2962-3370msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=191802: Fri Oct 10 16:44:30 2025 read: IOPS=1, BW=7078KiB/s (7248kB/s)(12.0MiB/1736msec) clat (msec): min=461, max=638, avg=557.49, stdev=89.41 lat (msec): min=461, max=638, avg=557.49, stdev=89.41 clat percentiles (msec): | 1.00th=[ 464], 5.00th=[ 464], 10.00th=[ 464], 20.00th=[ 464], | 30.00th=[ 464], 40.00th=[ 575], 50.00th=[ 575], 60.00th=[ 575], | 70.00th=[ 642], 80.00th=[ 642], 90.00th=[ 642], 95.00th=[ 642], | 99.00th=[ 642], 99.50th=[ 642], 99.90th=[ 642], 99.95th=[ 642], | 99.99th=[ 642] bw ( KiB/s): min= 8159, max= 8175, per=90.67%, avg=8167.00, stdev=11.31, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 750=66.67% cpu : usr=0.00%, sys=10.49%, ctx=53, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=191803: Fri Oct 10 16:44:30 2025 read: IOPS=0, BW=2252KiB/s (2306kB/s)(4096KiB/1819msec) clat (nsec): min=160627k, max=160627k, avg=160626545.00, stdev= 0.00 lat (nsec): min=160629k, max=160629k, avg=160629340.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 161], 5.00th=[ 161], 10.00th=[ 161], 20.00th=[ 161], | 30.00th=[ 161], 40.00th=[ 161], 50.00th=[ 161], 60.00th=[ 161], | 70.00th=[ 161], 80.00th=[ 161], 90.00th=[ 161], 95.00th=[ 161], | 99.00th=[ 161], 99.50th=[ 161], 99.90th=[ 161], 99.95th=[ 161], | 99.99th=[ 161] bw ( KiB/s): min= 7876, max= 7876, per=87.44%, avg=7876.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=1, BW=4504KiB/s (4612kB/s)(8192KiB/1819msec); 0 zone resets clat (msec): min=662, max=915, avg=789.16, stdev=179.22 lat (msec): min=662, max=916, avg=789.40, stdev=179.33 clat percentiles (msec): | 1.00th=[ 659], 5.00th=[ 659], 10.00th=[ 659], 20.00th=[ 659], | 30.00th=[ 659], 40.00th=[ 659], 50.00th=[ 659], 60.00th=[ 919], | 70.00th=[ 919], 80.00th=[ 919], 90.00th=[ 919], 95.00th=[ 919], | 99.00th=[ 919], 99.50th=[ 919], 99.90th=[ 919], 99.95th=[ 919], | 99.99th=[ 919] bw ( KiB/s): min= 8159, max= 8159, per=53.88%, avg=8159.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 750=33.33%, 1000=33.33% cpu : usr=0.00%, sys=9.41%, ctx=49, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=191804: Fri Oct 10 16:44:30 2025 write: IOPS=1, BW=5678KiB/s (5815kB/s)(12.0MiB/2164msec); 0 zone resets clat (msec): min=184, max=1150, avg=688.56, stdev=484.36 lat (msec): min=186, max=1151, avg=689.41, stdev=483.65 clat percentiles (msec): | 1.00th=[ 186], 5.00th=[ 186], 10.00th=[ 186], 20.00th=[ 186], | 30.00th=[ 186], 40.00th=[ 735], 50.00th=[ 735], 60.00th=[ 735], | 70.00th=[ 1150], 80.00th=[ 1150], 90.00th=[ 1150], 95.00th=[ 1150], | 99.00th=[ 1150], 99.50th=[ 1150], 99.90th=[ 1150], 99.95th=[ 1150], | 99.99th=[ 1150] bw ( KiB/s): min= 8175, max= 8175, per=53.99%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.00%, sys=6.56%, ctx=58, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=191805: Fri Oct 10 16:44:30 2025 write: IOPS=1, BW=7275KiB/s (7450kB/s)(12.0MiB/1689msec); 0 zone resets clat (msec): min=207, max=1091, avg=555.14, stdev=471.46 lat (msec): min=207, max=1092, avg=555.55, stdev=471.46 clat percentiles (msec): | 1.00th=[ 207], 5.00th=[ 207], 10.00th=[ 207], 20.00th=[ 207], | 30.00th=[ 207], 40.00th=[ 368], 50.00th=[ 368], 60.00th=[ 368], | 70.00th=[ 1099], 80.00th=[ 1099], 90.00th=[ 1099], 95.00th=[ 1099], | 99.00th=[ 1099], 99.50th=[ 1099], 99.90th=[ 1099], 99.95th=[ 1099], | 99.99th=[ 1099] bw ( KiB/s): min=13298, max=13298, per=87.82%, avg=13298.00, stdev= 0.00, samples=1 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 500=33.33%, 2000=33.33% cpu : usr=0.06%, sys=11.20%, ctx=69, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=9007KiB/s (9223kB/s), 2252KiB/s-7078KiB/s (2306kB/s-7248kB/s), io=16.0MiB (16.8MB), run=1736-1819msec WRITE: bw=14.8MiB/s (15.5MB/s), 4504KiB/s-7275KiB/s (4612kB/s-7450kB/s), io=32.0MiB (33.6MB), run=1689-2164msec rand-rw: (groupid=0, jobs=1): err= 0: pid=191806: Fri Oct 10 16:44:30 2025 read: IOPS=1, BW=8176KiB/s (8372kB/s)(12.0MiB/1503msec) clat (msec): min=376, max=565, avg=473.84, stdev=94.42 lat (msec): min=376, max=565, avg=473.84, stdev=94.42 clat percentiles (msec): | 1.00th=[ 376], 5.00th=[ 376], 10.00th=[ 376], 20.00th=[ 376], | 30.00th=[ 376], 40.00th=[ 481], 50.00th=[ 481], 60.00th=[ 481], | 70.00th=[ 567], 80.00th=[ 567], 90.00th=[ 567], 95.00th=[ 567], | 99.00th=[ 567], 99.50th=[ 567], 99.90th=[ 567], 99.95th=[ 567], | 99.99th=[ 567] bw ( KiB/s): min= 6649, max= 8192, per=100.00%, avg=7420.50, stdev=1091.07, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 500=66.67%, 750=33.33% cpu : usr=0.00%, sys=30.83%, ctx=643, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=191807: Fri Oct 10 16:44:30 2025 read: IOPS=0, BW=1688KiB/s (1728kB/s)(4096KiB/2427msec) clat (nsec): min=445957k, max=445957k, avg=445957053.00, stdev= 0.00 lat (nsec): min=445960k, max=445960k, avg=445959638.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 447], 5.00th=[ 447], 10.00th=[ 447], 20.00th=[ 447], | 30.00th=[ 447], 40.00th=[ 447], 50.00th=[ 447], 60.00th=[ 447], | 70.00th=[ 447], 80.00th=[ 447], 90.00th=[ 447], 95.00th=[ 447], | 99.00th=[ 447], 99.50th=[ 447], 99.90th=[ 447], 99.95th=[ 447], | 99.99th=[ 447] bw ( KiB/s): min= 6224, max= 6224, per=92.21%, avg=6224.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=3375KiB/s (3456kB/s)(8192KiB/2427msec); 0 zone resets clat (msec): min=520, max=1403, avg=961.93, stdev=624.29 lat (msec): min=520, max=1403, avg=962.29, stdev=624.23 clat percentiles (msec): | 1.00th=[ 523], 5.00th=[ 523], 10.00th=[ 523], 20.00th=[ 523], | 30.00th=[ 523], 40.00th=[ 523], 50.00th=[ 523], 60.00th=[ 1401], | 70.00th=[ 1401], 80.00th=[ 1401], 90.00th=[ 1401], 95.00th=[ 1401], | 99.00th=[ 1401], 99.50th=[ 1401], 99.90th=[ 1401], 99.95th=[ 1401], | 99.99th=[ 1401] bw ( KiB/s): min= 8143, max= 8143, per=60.56%, avg=8143.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.12%, sys=11.79%, ctx=211, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=191808: Fri Oct 10 16:44:30 2025 write: IOPS=1, BW=5042KiB/s (5163kB/s)(12.0MiB/2437msec); 0 zone resets clat (msec): min=173, max=1411, avg=803.46, stdev=618.95 lat (msec): min=174, max=1413, avg=804.38, stdev=619.63 clat percentiles (msec): | 1.00th=[ 174], 5.00th=[ 174], 10.00th=[ 174], 20.00th=[ 174], | 30.00th=[ 174], 40.00th=[ 827], 50.00th=[ 827], 60.00th=[ 827], | 70.00th=[ 1418], 80.00th=[ 1418], 90.00th=[ 1418], 95.00th=[ 1418], | 99.00th=[ 1418], 99.50th=[ 1418], 99.90th=[ 1418], 99.95th=[ 1418], | 99.99th=[ 1418] bw ( KiB/s): min= 8159, max= 8159, per=60.68%, avg=8159.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=5.83%, ctx=54, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=191809: Fri Oct 10 16:44:30 2025 write: IOPS=1, BW=5423KiB/s (5553kB/s)(12.0MiB/2266msec); 0 zone resets clat (msec): min=229, max=1043, avg=726.54, stdev=435.74 lat (msec): min=229, max=1044, avg=727.03, stdev=435.91 clat percentiles (msec): | 1.00th=[ 230], 5.00th=[ 230], 10.00th=[ 230], 20.00th=[ 230], | 30.00th=[ 230], 40.00th=[ 911], 50.00th=[ 911], 60.00th=[ 911], | 70.00th=[ 1045], 80.00th=[ 1045], 90.00th=[ 1045], 95.00th=[ 1045], | 99.00th=[ 1045], 99.50th=[ 1045], 99.90th=[ 1045], 99.95th=[ 1045], | 99.99th=[ 1045] bw ( KiB/s): min= 8143, max= 8192, per=60.74%, avg=8167.50, stdev=34.65, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 250=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=5.65%, ctx=47, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=6751KiB/s (6913kB/s), 1688KiB/s-8176KiB/s (1728kB/s-8372kB/s), io=16.0MiB (16.8MB), run=1503-2427msec WRITE: bw=13.1MiB/s (13.8MB/s), 3375KiB/s-5423KiB/s (3456kB/s-5553kB/s), io=32.0MiB (33.6MB), run=2266-2437msec