== sanity test 398b: DIO and buffer IO race ============== 06:33:38 (1762169618) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 2.92051 s, 17.2 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=187813: Mon Nov 3 06:34:44 2025 read: IOPS=27, BW=108KiB/s (111kB/s)(5992KiB/55361msec) clat (usec): min=121, max=751287, avg=20603.53, stdev=22397.84 lat (usec): min=122, max=751289, avg=20606.57, stdev=22398.62 clat percentiles (usec): | 1.00th=[ 204], 5.00th=[ 7635], 10.00th=[ 9241], 20.00th=[ 11207], | 30.00th=[ 13173], 40.00th=[ 15270], 50.00th=[ 17695], 60.00th=[ 20317], | 70.00th=[ 23725], 80.00th=[ 27657], 90.00th=[ 33424], 95.00th=[ 40109], | 99.00th=[ 62129], 99.50th=[ 85459], 99.90th=[127402], 99.95th=[750781], | 99.99th=[750781] bw ( KiB/s): min= 13, max= 176, per=24.97%, avg=107.89, stdev=30.09, samples=110 iops : min= 3, max= 44, avg=26.50, stdev= 7.55, samples=110 write: IOPS=28, BW=114KiB/s (116kB/s)(6296KiB/55361msec); 0 zone resets clat (usec): min=679, max=94637, avg=15390.37, stdev=13701.45 lat (usec): min=680, max=94638, avg=15391.91, stdev=13701.73 clat percentiles (usec): | 1.00th=[ 1029], 5.00th=[ 1483], 10.00th=[ 2008], 20.00th=[ 2900], | 30.00th=[ 4490], 40.00th=[ 9241], 50.00th=[12387], 60.00th=[15664], | 70.00th=[19792], 80.00th=[25560], 90.00th=[34341], 95.00th=[41681], | 99.00th=[60031], 99.50th=[69731], 99.90th=[88605], 99.95th=[94897], | 99.99th=[94897] bw ( KiB/s): min= 40, max= 223, per=25.29%, avg=114.32, stdev=32.04, samples=109 iops : min= 10, max= 55, avg=28.11, stdev= 8.03, samples=109 lat (usec) : 250=0.62%, 500=0.65%, 750=0.10%, 1000=0.36% lat (msec) : 2=4.72%, 4=9.05%, 10=12.50%, 20=36.52%, 50=32.88% lat (msec) : 100=2.47%, 250=0.10%, 1000=0.03% cpu : usr=0.13%, sys=16.65%, ctx=7658, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=187814: Mon Nov 3 06:34:44 2025 read: IOPS=26, BW=107KiB/s (110kB/s)(5940KiB/55385msec) clat (usec): min=107, max=145934, avg=19711.60, stdev=11158.77 lat (usec): min=107, max=145986, avg=19712.69, stdev=11159.18 clat percentiles (usec): | 1.00th=[ 265], 5.00th=[ 7242], 10.00th=[ 8979], 20.00th=[ 11207], | 30.00th=[ 12780], 40.00th=[ 15270], 50.00th=[ 17957], 60.00th=[ 20579], | 70.00th=[ 23200], 80.00th=[ 26870], 90.00th=[ 32900], 95.00th=[ 39060], | 99.00th=[ 56361], 99.50th=[ 63177], 99.90th=[ 92799], 99.95th=[145753], | 99.99th=[145753] bw ( KiB/s): min= 6, max= 168, per=24.76%, avg=106.95, stdev=27.79, samples=110 iops : min= 1, max= 42, avg=26.26, stdev= 6.96, samples=110 write: IOPS=28, BW=115KiB/s (117kB/s)(6348KiB/55385msec); 0 zone resets clat (usec): min=759, max=673025, avg=16292.49, stdev=21569.70 lat (usec): min=761, max=673026, avg=16294.65, stdev=21570.18 clat percentiles (usec): | 1.00th=[ 1004], 5.00th=[ 1598], 10.00th=[ 2180], 20.00th=[ 3032], | 30.00th=[ 5276], 40.00th=[ 10290], 50.00th=[ 13173], 60.00th=[ 16450], | 70.00th=[ 20579], 80.00th=[ 25560], 90.00th=[ 34866], 95.00th=[ 41681], | 99.00th=[ 63701], 99.50th=[ 74974], 99.90th=[105382], 99.95th=[675283], | 99.99th=[675283] bw ( KiB/s): min= 6, max= 207, per=25.23%, avg=114.05, stdev=31.75, samples=110 iops : min= 1, max= 51, avg=28.05, stdev= 7.99, samples=110 lat (usec) : 250=0.39%, 500=0.75%, 750=0.07%, 1000=0.46% lat (msec) : 2=3.81%, 4=9.31%, 10=12.08%, 20=36.95%, 50=33.92% lat (msec) : 100=2.18%, 250=0.07%, 750=0.03% cpu : usr=0.14%, sys=16.72%, ctx=7690, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=187815: Mon Nov 3 06:34:44 2025 read: IOPS=27, BW=109KiB/s (111kB/s)(6028KiB/55535msec) clat (usec): min=116, max=131120, avg=19853.80, stdev=11279.91 lat (usec): min=116, max=131123, avg=19855.11, stdev=11280.10 clat percentiles (usec): | 1.00th=[ 269], 5.00th=[ 7177], 10.00th=[ 9241], 20.00th=[ 11338], | 30.00th=[ 13173], 40.00th=[ 15270], 50.00th=[ 17695], 60.00th=[ 20317], | 70.00th=[ 23725], 80.00th=[ 27132], 90.00th=[ 33817], 95.00th=[ 39060], | 99.00th=[ 53740], 99.50th=[ 62653], 99.90th=[ 92799], 99.95th=[131597], | 99.99th=[131597] bw ( KiB/s): min= 24, max= 199, per=25.23%, avg=108.97, stdev=27.99, samples=109 iops : min= 6, max= 49, avg=26.77, stdev= 7.05, samples=109 write: IOPS=28, BW=113KiB/s (115kB/s)(6260KiB/55535msec); 0 zone resets clat (usec): min=887, max=701560, avg=16194.78, stdev=22408.61 lat (usec): min=888, max=701562, avg=16196.23, stdev=22408.60 clat percentiles (usec): | 1.00th=[ 1057], 5.00th=[ 1549], 10.00th=[ 2073], 20.00th=[ 2966], | 30.00th=[ 4490], 40.00th=[ 9241], 50.00th=[ 12780], 60.00th=[ 16057], | 70.00th=[ 19792], 80.00th=[ 26084], 90.00th=[ 35914], 95.00th=[ 43779], | 99.00th=[ 65274], 99.50th=[ 76022], 99.90th=[105382], 99.95th=[700449], | 99.99th=[700449] bw ( KiB/s): min= 32, max= 224, per=25.01%, avg=113.06, stdev=28.99, samples=109 iops : min= 8, max= 56, avg=27.80, stdev= 7.28, samples=109 lat (usec) : 250=0.36%, 500=1.04%, 750=0.13%, 1000=0.46% lat (msec) : 2=4.36%, 4=9.47%, 10=12.17%, 20=36.69%, 50=33.20% lat (msec) : 100=2.02%, 250=0.07%, 750=0.03% cpu : usr=0.12%, sys=16.77%, ctx=7741, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=187816: Mon Nov 3 06:34:44 2025 read: IOPS=27, BW=111KiB/s (113kB/s)(6052KiB/54620msec) clat (usec): min=108, max=105753, avg=20058.18, stdev=11311.98 lat (usec): min=109, max=105754, avg=20060.15, stdev=11311.51 clat percentiles (usec): | 1.00th=[ 219], 5.00th=[ 7963], 10.00th=[ 9372], 20.00th=[ 11469], | 30.00th=[ 13173], 40.00th=[ 15533], 50.00th=[ 17957], 60.00th=[ 20841], | 70.00th=[ 23725], 80.00th=[ 27657], 90.00th=[ 32900], 95.00th=[ 38536], | 99.00th=[ 59507], 99.50th=[ 69731], 99.90th=[ 87557], 99.95th=[105382], | 99.99th=[105382] bw ( KiB/s): min= 55, max= 166, per=25.73%, avg=111.15, stdev=23.64, samples=107 iops : min= 13, max= 41, avg=27.31, stdev= 5.93, samples=107 write: IOPS=28, BW=114KiB/s (117kB/s)(6236KiB/54620msec); 0 zone resets clat (usec): min=808, max=680875, avg=15396.41, stdev=21664.44 lat (usec): min=808, max=680876, avg=15403.05, stdev=21664.69 clat percentiles (usec): | 1.00th=[ 996], 5.00th=[ 1418], 10.00th=[ 1876], 20.00th=[ 2802], | 30.00th=[ 4424], 40.00th=[ 8356], 50.00th=[ 11994], 60.00th=[ 14877], | 70.00th=[ 18744], 80.00th=[ 25822], 90.00th=[ 34341], 95.00th=[ 41157], | 99.00th=[ 56886], 99.50th=[ 68682], 99.90th=[ 92799], 99.95th=[683672], | 99.99th=[683672] bw ( KiB/s): min= 20, max= 207, per=25.16%, avg=113.72, stdev=34.73, samples=108 iops : min= 5, max= 51, avg=27.95, stdev= 8.72, samples=108 lat (usec) : 250=0.59%, 500=0.72%, 1000=0.55% lat (msec) : 2=5.21%, 4=8.79%, 10=12.89%, 20=35.94%, 50=32.91% lat (msec) : 100=2.34%, 250=0.03%, 750=0.03% cpu : usr=0.11%, sys=17.00%, ctx=7628, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=432KiB/s (443kB/s), 107KiB/s-111KiB/s (110kB/s-113kB/s), io=23.4MiB (24.6MB), run=54620-55535msec WRITE: bw=453KiB/s (464kB/s), 113KiB/s-115KiB/s (115kB/s-117kB/s), io=24.6MiB (25.7MB), run=54620-55535msec rand-rw: (groupid=0, jobs=1): err= 0: pid=187818: Mon Nov 3 06:34:57 2025 read: IOPS=21, BW=87.8KiB/s (89.9kB/s)(5992KiB/68231msec) clat (msec): min=3, max=756, avg=18.10, stdev=24.09 lat (msec): min=3, max=756, avg=18.10, stdev=24.09 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 6], 10.00th=[ 6], 20.00th=[ 7], | 30.00th=[ 9], 40.00th=[ 11], 50.00th=[ 12], 60.00th=[ 15], | 70.00th=[ 20], 80.00th=[ 26], 90.00th=[ 39], 95.00th=[ 51], | 99.00th=[ 73], 99.50th=[ 79], 99.90th=[ 103], 99.95th=[ 760], | 99.99th=[ 760] bw ( KiB/s): min= 24, max= 248, per=25.14%, avg=87.75, stdev=55.12, samples=134 iops : min= 6, max= 62, avg=21.49, stdev=13.83, samples=134 write: IOPS=23, BW=92.3KiB/s (94.5kB/s)(6296KiB/68231msec); 0 zone resets clat (msec): min=5, max=144, avg=25.99, stdev=17.94 lat (msec): min=5, max=144, avg=25.99, stdev=17.94 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 11], 20.00th=[ 13], | 30.00th=[ 14], 40.00th=[ 17], 50.00th=[ 21], 60.00th=[ 25], | 70.00th=[ 32], 80.00th=[ 39], 90.00th=[ 50], 95.00th=[ 59], | 99.00th=[ 91], 99.50th=[ 109], 99.90th=[ 142], 99.95th=[ 144], | 99.99th=[ 144] bw ( KiB/s): min= 23, max= 231, per=25.10%, avg=91.87, stdev=54.80, samples=134 iops : min= 5, max= 57, avg=22.51, stdev=13.75, samples=134 lat (msec) : 4=0.29%, 10=23.21%, 20=36.88%, 50=32.39%, 100=6.84% lat (msec) : 250=0.36%, 1000=0.03% cpu : usr=0.10%, sys=7.01%, ctx=5055, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=187819: Mon Nov 3 06:34:57 2025 read: IOPS=21, BW=86.5KiB/s (88.6kB/s)(5940KiB/68665msec) clat (msec): min=3, max=684, avg=17.94, stdev=23.18 lat (msec): min=3, max=684, avg=17.94, stdev=23.18 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 6], 10.00th=[ 6], 20.00th=[ 7], | 30.00th=[ 8], 40.00th=[ 10], 50.00th=[ 12], 60.00th=[ 15], | 70.00th=[ 19], 80.00th=[ 26], 90.00th=[ 41], 95.00th=[ 51], | 99.00th=[ 79], 99.50th=[ 90], 99.90th=[ 134], 99.95th=[ 684], | 99.99th=[ 684] bw ( KiB/s): min= 7, max= 295, per=24.70%, avg=86.20, stdev=58.20, samples=135 iops : min= 1, max= 73, avg=21.10, stdev=14.59, samples=135 write: IOPS=23, BW=92.4KiB/s (94.7kB/s)(6348KiB/68665msec); 0 zone resets clat (msec): min=5, max=131, avg=26.35, stdev=17.84 lat (msec): min=5, max=131, avg=26.35, stdev=17.84 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 12], | 30.00th=[ 15], 40.00th=[ 17], 50.00th=[ 21], 60.00th=[ 26], | 70.00th=[ 33], 80.00th=[ 41], 90.00th=[ 51], 95.00th=[ 59], | 99.00th=[ 87], 99.50th=[ 108], 99.90th=[ 131], 99.95th=[ 132], | 99.99th=[ 132] bw ( KiB/s): min= 23, max= 263, per=25.07%, avg=91.77, stdev=53.97, samples=135 iops : min= 5, max= 65, avg=22.49, stdev=13.54, samples=135 lat (msec) : 4=0.33%, 10=24.58%, 20=36.20%, 50=31.25%, 100=7.16% lat (msec) : 250=0.46%, 750=0.03% cpu : usr=0.09%, sys=6.89%, ctx=5032, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=187820: Mon Nov 3 06:34:57 2025 read: IOPS=22, BW=88.3KiB/s (90.4kB/s)(6028KiB/68284msec) clat (msec): min=3, max=105, avg=17.82, stdev=14.83 lat (msec): min=3, max=105, avg=17.82, stdev=14.83 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 6], 10.00th=[ 6], 20.00th=[ 8], | 30.00th=[ 9], 40.00th=[ 11], 50.00th=[ 13], 60.00th=[ 16], | 70.00th=[ 20], 80.00th=[ 27], 90.00th=[ 40], 95.00th=[ 50], | 99.00th=[ 69], 99.50th=[ 82], 99.90th=[ 102], 99.95th=[ 106], | 99.99th=[ 106] bw ( KiB/s): min= 16, max= 248, per=25.26%, avg=88.16, stdev=54.28, samples=134 iops : min= 4, max= 62, avg=21.59, stdev=13.61, samples=134 write: IOPS=22, BW=91.7KiB/s (93.9kB/s)(6260KiB/68284msec); 0 zone resets clat (msec): min=5, max=692, avg=26.35, stdev=24.36 lat (msec): min=5, max=692, avg=26.35, stdev=24.36 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 11], 20.00th=[ 12], | 30.00th=[ 14], 40.00th=[ 17], 50.00th=[ 21], 60.00th=[ 26], | 70.00th=[ 32], 80.00th=[ 39], 90.00th=[ 50], 95.00th=[ 59], | 99.00th=[ 88], 99.50th=[ 96], 99.90th=[ 169], 99.95th=[ 693], | 99.99th=[ 693] bw ( KiB/s): min= 32, max= 271, per=24.95%, avg=91.33, stdev=54.63, samples=134 iops : min= 8, max= 67, avg=22.38, stdev=13.72, samples=134 lat (msec) : 4=0.36%, 10=23.37%, 20=36.07%, 50=33.01%, 100=6.87% lat (msec) : 250=0.29%, 750=0.03% cpu : usr=0.11%, sys=7.00%, ctx=5086, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=187821: Mon Nov 3 06:34:57 2025 read: IOPS=22, BW=88.5KiB/s (90.6kB/s)(6052KiB/68383msec) clat (msec): min=3, max=132, avg=17.83, stdev=15.19 lat (msec): min=3, max=132, avg=17.83, stdev=15.19 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 6], 10.00th=[ 6], 20.00th=[ 8], | 30.00th=[ 9], 40.00th=[ 11], 50.00th=[ 13], 60.00th=[ 15], | 70.00th=[ 19], 80.00th=[ 27], 90.00th=[ 39], 95.00th=[ 50], | 99.00th=[ 72], 99.50th=[ 86], 99.90th=[ 125], 99.95th=[ 133], | 99.99th=[ 133] bw ( KiB/s): min= 16, max= 248, per=25.64%, avg=89.48, stdev=55.61, samples=134 iops : min= 4, max= 62, avg=21.92, stdev=13.94, samples=134 write: IOPS=22, BW=91.2KiB/s (93.4kB/s)(6236KiB/68383msec); 0 zone resets clat (msec): min=4, max=695, avg=26.43, stdev=24.74 lat (msec): min=4, max=695, avg=26.43, stdev=24.74 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 11], 20.00th=[ 12], | 30.00th=[ 14], 40.00th=[ 17], 50.00th=[ 20], 60.00th=[ 26], | 70.00th=[ 32], 80.00th=[ 40], 90.00th=[ 51], 95.00th=[ 61], | 99.00th=[ 89], 99.50th=[ 106], 99.90th=[ 167], 99.95th=[ 693], | 99.99th=[ 693] bw ( KiB/s): min= 23, max= 263, per=24.98%, avg=91.41, stdev=54.50, samples=135 iops : min= 5, max= 65, avg=22.40, stdev=13.67, samples=135 lat (msec) : 4=0.23%, 10=23.14%, 20=37.57%, 50=31.67%, 100=6.97% lat (msec) : 250=0.39%, 750=0.03% cpu : usr=0.08%, sys=6.96%, ctx=5132, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=350KiB/s (358kB/s), 86.5KiB/s-88.5KiB/s (88.6kB/s-90.6kB/s), io=23.4MiB (24.6MB), run=68231-68665msec WRITE: bw=366KiB/s (375kB/s), 91.2KiB/s-92.4KiB/s (93.4kB/s-94.7kB/s), io=24.6MiB (25.7MB), run=68231-68665msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=187849: Mon Nov 3 06:35:18 2025 read: IOPS=25, BW=406KiB/s (415kB/s)(5920KiB/14598msec) clat (usec): min=129, max=117431, avg=20054.34, stdev=12161.78 lat (usec): min=130, max=117432, avg=20055.51, stdev=12161.63 clat percentiles (usec): | 1.00th=[ 198], 5.00th=[ 1106], 10.00th=[ 8979], 20.00th=[ 12125], | 30.00th=[ 13698], 40.00th=[ 16057], 50.00th=[ 18482], 60.00th=[ 20579], | 70.00th=[ 23462], 80.00th=[ 27132], 90.00th=[ 32637], 95.00th=[ 37487], | 99.00th=[ 68682], 99.50th=[ 90702], 99.90th=[116917], 99.95th=[116917], | 99.99th=[116917] bw ( KiB/s): min= 224, max= 576, per=25.94%, avg=405.72, stdev=88.48, samples=29 iops : min= 14, max= 36, avg=24.79, stdev= 5.53, samples=29 write: IOPS=27, BW=436KiB/s (447kB/s)(6368KiB/14598msec); 0 zone resets clat (usec): min=1262, max=81071, avg=17988.21, stdev=13674.98 lat (usec): min=1264, max=81073, avg=17990.74, stdev=13675.59 clat percentiles (usec): | 1.00th=[ 1450], 5.00th=[ 2769], 10.00th=[ 3687], 20.00th=[ 5080], | 30.00th=[ 7963], 40.00th=[11600], 50.00th=[15008], 60.00th=[17695], | 70.00th=[23200], 80.00th=[29492], 90.00th=[38536], 95.00th=[42730], | 99.00th=[56886], 99.50th=[73925], 99.90th=[81265], 99.95th=[81265], | 99.99th=[81265] bw ( KiB/s): min= 256, max= 638, per=26.44%, avg=435.21, stdev=101.55, samples=29 iops : min= 16, max= 39, avg=26.62, stdev= 6.24, samples=29 lat (usec) : 250=0.65%, 500=1.43%, 750=0.13%, 1000=0.13% lat (msec) : 2=1.56%, 4=5.21%, 10=15.23%, 20=35.81%, 50=37.76% lat (msec) : 100=1.95%, 250=0.13% cpu : usr=0.10%, sys=21.24%, ctx=2352, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=187850: Mon Nov 3 06:35:18 2025 read: IOPS=23, BW=383KiB/s (392kB/s)(5744KiB/14987msec) clat (usec): min=140, max=78375, avg=21503.42, stdev=10978.31 lat (usec): min=141, max=78376, avg=21504.36, stdev=10978.32 clat percentiles (usec): | 1.00th=[ 277], 5.00th=[ 8291], 10.00th=[11207], 20.00th=[13566], | 30.00th=[15795], 40.00th=[17695], 50.00th=[20317], 60.00th=[22414], | 70.00th=[25035], 80.00th=[27919], 90.00th=[33162], 95.00th=[39584], | 99.00th=[59507], 99.50th=[77071], 99.90th=[78119], 99.95th=[78119], | 99.99th=[78119] bw ( KiB/s): min= 224, max= 574, per=24.41%, avg=381.72, stdev=93.98, samples=29 iops : min= 14, max= 35, avg=23.28, stdev= 5.79, samples=29 write: IOPS=27, BW=437KiB/s (447kB/s)(6544KiB/14987msec); 0 zone resets clat (usec): min=1094, max=78915, avg=17716.58, stdev=14155.03 lat (usec): min=1095, max=78917, avg=17718.73, stdev=14154.69 clat percentiles (usec): | 1.00th=[ 1598], 5.00th=[ 2606], 10.00th=[ 3490], 20.00th=[ 4817], | 30.00th=[ 7308], 40.00th=[10945], 50.00th=[13829], 60.00th=[17171], | 70.00th=[22414], 80.00th=[30016], 90.00th=[38011], 95.00th=[46924], | 99.00th=[55837], 99.50th=[59507], 99.90th=[79168], 99.95th=[79168], | 99.99th=[79168] bw ( KiB/s): min= 287, max= 551, per=26.03%, avg=428.38, stdev=86.34, samples=29 iops : min= 17, max= 34, avg=26.21, stdev= 5.41, samples=29 lat (usec) : 250=0.26%, 500=1.17%, 750=0.26%, 1000=0.13% lat (msec) : 2=1.95%, 4=5.08%, 10=13.93%, 20=34.90%, 50=39.32% lat (msec) : 100=2.99% cpu : usr=0.12%, sys=21.15%, ctx=2409, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=187851: Mon Nov 3 06:35:18 2025 read: IOPS=25, BW=409KiB/s (419kB/s)(6256KiB/15307msec) clat (usec): min=130, max=103491, avg=21066.02, stdev=11531.80 lat (usec): min=131, max=103492, avg=21067.11, stdev=11531.84 clat percentiles (usec): | 1.00th=[ 265], 5.00th=[ 6587], 10.00th=[ 10290], 20.00th=[ 12387], | 30.00th=[ 14615], 40.00th=[ 17433], 50.00th=[ 19792], 60.00th=[ 21890], | 70.00th=[ 24773], 80.00th=[ 28967], 90.00th=[ 34866], 95.00th=[ 41681], | 99.00th=[ 57410], 99.50th=[ 71828], 99.90th=[103285], 99.95th=[103285], | 99.99th=[103285] bw ( KiB/s): min= 222, max= 864, per=25.91%, avg=405.27, stdev=126.45, samples=30 iops : min= 13, max= 54, avg=24.77, stdev= 8.01, samples=30 write: IOPS=24, BW=394KiB/s (404kB/s)(6032KiB/15307msec); 0 zone resets clat (usec): min=1382, max=80900, avg=18714.20, stdev=13335.31 lat (usec): min=1384, max=80903, avg=18716.09, stdev=13335.18 clat percentiles (usec): | 1.00th=[ 1663], 5.00th=[ 3064], 10.00th=[ 4359], 20.00th=[ 6325], | 30.00th=[10159], 40.00th=[12649], 50.00th=[16319], 60.00th=[19268], | 70.00th=[22938], 80.00th=[28443], 90.00th=[35914], 95.00th=[43779], | 99.00th=[61604], 99.50th=[66323], 99.90th=[81265], 99.95th=[81265], | 99.99th=[81265] bw ( KiB/s): min= 190, max= 768, per=23.43%, avg=385.73, stdev=115.76, samples=30 iops : min= 11, max= 48, avg=23.53, stdev= 7.16, samples=30 lat (usec) : 250=0.39%, 500=1.43%, 750=0.13% lat (msec) : 2=1.04%, 4=3.26%, 10=12.63%, 20=37.89%, 50=40.89% lat (msec) : 100=2.21%, 250=0.13% cpu : usr=0.14%, sys=20.74%, ctx=2485, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=187852: Mon Nov 3 06:35:18 2025 read: IOPS=25, BW=412KiB/s (422kB/s)(6032KiB/14644msec) clat (usec): min=134, max=107831, avg=21103.43, stdev=13706.25 lat (usec): min=135, max=107832, avg=21104.65, stdev=13706.85 clat percentiles (usec): | 1.00th=[ 202], 5.00th=[ 416], 10.00th=[ 9372], 20.00th=[ 12387], | 30.00th=[ 14091], 40.00th=[ 16188], 50.00th=[ 18744], 60.00th=[ 21103], | 70.00th=[ 23987], 80.00th=[ 29230], 90.00th=[ 34866], 95.00th=[ 42730], | 99.00th=[ 74974], 99.50th=[101188], 99.90th=[107480], 99.95th=[107480], | 99.99th=[107480] bw ( KiB/s): min= 223, max= 544, per=26.16%, avg=409.10, stdev=86.44, samples=29 iops : min= 13, max= 34, avg=25.00, stdev= 5.44, samples=29 write: IOPS=26, BW=427KiB/s (437kB/s)(6256KiB/14644msec); 0 zone resets clat (usec): min=1591, max=94099, avg=17055.13, stdev=13083.13 lat (usec): min=1592, max=94101, avg=17056.76, stdev=13083.16 clat percentiles (usec): | 1.00th=[ 1762], 5.00th=[ 2999], 10.00th=[ 4015], 20.00th=[ 5342], | 30.00th=[ 7832], 40.00th=[11338], 50.00th=[14091], 60.00th=[16909], | 70.00th=[20841], 80.00th=[27657], 90.00th=[35390], 95.00th=[40633], | 99.00th=[58459], 99.50th=[81265], 99.90th=[93848], 99.95th=[93848], | 99.99th=[93848] bw ( KiB/s): min= 224, max= 669, per=26.04%, avg=428.62, stdev=117.10, samples=29 iops : min= 14, max= 41, avg=26.21, stdev= 7.27, samples=29 lat (usec) : 250=0.91%, 500=1.69%, 750=0.13% lat (msec) : 2=1.04%, 4=4.30%, 10=15.89%, 20=38.28%, 50=35.03% lat (msec) : 100=2.47%, 250=0.26% cpu : usr=0.06%, sys=21.03%, ctx=2376, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1565KiB/s (1602kB/s), 383KiB/s-412KiB/s (392kB/s-422kB/s), io=23.4MiB (24.5MB), run=14598-15307msec WRITE: bw=1646KiB/s (1686kB/s), 394KiB/s-437KiB/s (404kB/s-447kB/s), io=24.6MiB (25.8MB), run=14598-15307msec rand-rw: (groupid=0, jobs=1): err= 0: pid=187844: Mon Nov 3 06:35:21 2025 read: IOPS=20, BW=325KiB/s (333kB/s)(5920KiB/18216msec) clat (usec): min=4701, max=93026, avg=18204.27, stdev=13866.72 lat (usec): min=4702, max=93026, avg=18205.37, stdev=13866.54 clat percentiles (usec): | 1.00th=[ 4948], 5.00th=[ 6063], 10.00th=[ 6783], 20.00th=[ 8225], | 30.00th=[ 9503], 40.00th=[11076], 50.00th=[12911], 60.00th=[15401], | 70.00th=[19530], 80.00th=[26346], 90.00th=[40109], 95.00th=[49021], | 99.00th=[62653], 99.50th=[70779], 99.90th=[92799], 99.95th=[92799], | 99.99th=[92799] bw ( KiB/s): min= 95, max= 828, per=24.82%, avg=324.14, stdev=167.86, samples=36 iops : min= 5, max= 51, avg=19.72, stdev=10.57, samples=36 write: IOPS=21, BW=350KiB/s (358kB/s)(6368KiB/18216msec); 0 zone resets clat (msec): min=6, max=150, avg=28.71, stdev=19.03 lat (msec): min=6, max=150, avg=28.71, stdev=19.03 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 12], 20.00th=[ 14], | 30.00th=[ 16], 40.00th=[ 19], 50.00th=[ 24], 60.00th=[ 29], | 70.00th=[ 34], 80.00th=[ 42], 90.00th=[ 52], 95.00th=[ 65], | 99.00th=[ 104], 99.50th=[ 120], 99.90th=[ 150], 99.95th=[ 150], | 99.99th=[ 150] bw ( KiB/s): min= 127, max= 830, per=25.37%, avg=348.53, stdev=162.18, samples=36 iops : min= 7, max= 51, avg=21.25, stdev=10.17, samples=36 lat (msec) : 10=18.10%, 20=37.76%, 50=36.07%, 100=7.55%, 250=0.52% cpu : usr=0.10%, sys=8.29%, ctx=1369, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=187845: Mon Nov 3 06:35:21 2025 read: IOPS=19, BW=315KiB/s (322kB/s)(5744KiB/18240msec) clat (usec): min=4107, max=73346, avg=18619.15, stdev=12851.22 lat (usec): min=4108, max=73346, avg=18620.05, stdev=12851.22 clat percentiles (usec): | 1.00th=[ 4817], 5.00th=[ 6259], 10.00th=[ 7373], 20.00th=[ 8979], | 30.00th=[10945], 40.00th=[12518], 50.00th=[14091], 60.00th=[16909], | 70.00th=[20317], 80.00th=[25822], 90.00th=[38536], 95.00th=[45876], | 99.00th=[62129], 99.50th=[65274], 99.90th=[72877], 99.95th=[72877], | 99.99th=[72877] bw ( KiB/s): min= 127, max= 736, per=23.99%, avg=313.25, stdev=141.56, samples=36 iops : min= 7, max= 46, avg=19.03, stdev= 8.90, samples=36 write: IOPS=22, BW=359KiB/s (367kB/s)(6544KiB/18240msec); 0 zone resets clat (msec): min=6, max=103, avg=28.11, stdev=17.10 lat (msec): min=6, max=103, avg=28.12, stdev=17.10 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 12], 20.00th=[ 15], | 30.00th=[ 17], 40.00th=[ 20], 50.00th=[ 23], 60.00th=[ 27], | 70.00th=[ 34], 80.00th=[ 42], 90.00th=[ 52], 95.00th=[ 62], | 99.00th=[ 90], 99.50th=[ 93], 99.90th=[ 104], 99.95th=[ 104], | 99.99th=[ 104] bw ( KiB/s): min= 192, max= 958, per=26.00%, avg=357.22, stdev=169.74, samples=36 iops : min= 12, max= 59, avg=21.78, stdev=10.63, samples=36 lat (msec) : 10=15.36%, 20=39.71%, 50=36.98%, 100=7.81%, 250=0.13% cpu : usr=0.10%, sys=8.41%, ctx=1354, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=187846: Mon Nov 3 06:35:21 2025 read: IOPS=21, BW=345KiB/s (353kB/s)(6256KiB/18127msec) clat (usec): min=4150, max=93244, avg=19157.26, stdev=13632.59 lat (usec): min=4151, max=93245, avg=19158.30, stdev=13632.58 clat percentiles (usec): | 1.00th=[ 4424], 5.00th=[ 6325], 10.00th=[ 7046], 20.00th=[ 8717], | 30.00th=[10814], 40.00th=[12911], 50.00th=[14615], 60.00th=[16909], | 70.00th=[20579], 80.00th=[28443], 90.00th=[40633], 95.00th=[47449], | 99.00th=[64750], 99.50th=[65274], 99.90th=[92799], 99.95th=[92799], | 99.99th=[92799] bw ( KiB/s): min= 159, max= 1019, per=26.30%, avg=343.51, stdev=184.35, samples=35 iops : min= 9, max= 63, avg=20.91, stdev=11.54, samples=35 write: IOPS=20, BW=333KiB/s (341kB/s)(6032KiB/18127msec); 0 zone resets clat (msec): min=6, max=150, avg=28.13, stdev=18.30 lat (msec): min=6, max=150, avg=28.13, stdev=18.30 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 12], 20.00th=[ 14], | 30.00th=[ 17], 40.00th=[ 20], 50.00th=[ 23], 60.00th=[ 28], | 70.00th=[ 36], 80.00th=[ 41], 90.00th=[ 50], 95.00th=[ 57], | 99.00th=[ 115], 99.50th=[ 120], 99.90th=[ 150], 99.95th=[ 150], | 99.99th=[ 150] bw ( KiB/s): min= 158, max= 864, per=23.45%, avg=322.17, stdev=151.71, samples=35 iops : min= 9, max= 54, avg=19.57, stdev= 9.52, samples=35 lat (msec) : 10=15.49%, 20=40.36%, 50=37.37%, 100=6.25%, 250=0.52% cpu : usr=0.10%, sys=8.41%, ctx=1330, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=187847: Mon Nov 3 06:35:21 2025 read: IOPS=20, BW=329KiB/s (337kB/s)(6032KiB/18337msec) clat (msec): min=4, max=121, avg=19.91, stdev=15.47 lat (msec): min=4, max=121, avg=19.91, stdev=15.47 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 6], 10.00th=[ 7], 20.00th=[ 9], | 30.00th=[ 11], 40.00th=[ 12], 50.00th=[ 15], 60.00th=[ 17], | 70.00th=[ 22], 80.00th=[ 31], 90.00th=[ 42], 95.00th=[ 53], | 99.00th=[ 69], 99.50th=[ 81], 99.90th=[ 122], 99.95th=[ 122], | 99.99th=[ 122] bw ( KiB/s): min= 159, max= 830, per=24.71%, avg=322.67, stdev=163.08, samples=36 iops : min= 9, max= 51, avg=19.64, stdev=10.22, samples=36 write: IOPS=21, BW=341KiB/s (349kB/s)(6256KiB/18337msec); 0 zone resets clat (msec): min=6, max=121, avg=27.57, stdev=17.53 lat (msec): min=6, max=121, avg=27.58, stdev=17.53 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 14], | 30.00th=[ 16], 40.00th=[ 19], 50.00th=[ 22], 60.00th=[ 27], | 70.00th=[ 35], 80.00th=[ 41], 90.00th=[ 48], 95.00th=[ 61], | 99.00th=[ 102], 99.50th=[ 120], 99.90th=[ 122], 99.95th=[ 122], | 99.99th=[ 122] bw ( KiB/s): min= 128, max= 734, per=24.51%, avg=336.81, stdev=157.27, samples=36 iops : min= 8, max= 45, avg=20.50, stdev= 9.86, samples=36 lat (msec) : 10=15.63%, 20=39.06%, 50=38.15%, 100=6.51%, 250=0.65% cpu : usr=0.09%, sys=8.38%, ctx=1406, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1306KiB/s (1338kB/s), 315KiB/s-345KiB/s (322kB/s-353kB/s), io=23.4MiB (24.5MB), run=18127-18337msec WRITE: bw=1374KiB/s (1407kB/s), 333KiB/s-359KiB/s (341kB/s-367kB/s), io=24.6MiB (25.8MB), run=18127-18337msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=187862: Mon Nov 3 06:35:29 2025 read: IOPS=2, BW=2979KiB/s (3051kB/s)(7168KiB/2406msec) clat (msec): min=86, max=196, avg=164.47, stdev=36.75 lat (msec): min=86, max=196, avg=164.47, stdev=36.75 clat percentiles (msec): | 1.00th=[ 87], 5.00th=[ 87], 10.00th=[ 87], 20.00th=[ 157], | 30.00th=[ 167], 40.00th=[ 167], 50.00th=[ 178], 60.00th=[ 182], | 70.00th=[ 182], 80.00th=[ 186], 90.00th=[ 197], 95.00th=[ 197], | 99.00th=[ 197], 99.50th=[ 197], 99.90th=[ 197], 99.95th=[ 197], | 99.99th=[ 197] bw ( KiB/s): min= 1882, max= 5180, per=55.55%, avg=3697.67, stdev=1674.08, samples=3 iops : min= 1, max= 5, avg= 3.00, stdev= 2.00, samples=3 write: IOPS=2, BW=2128KiB/s (2179kB/s)(5120KiB/2406msec); 0 zone resets clat (msec): min=166, max=339, avg=234.56, stdev=74.19 lat (msec): min=166, max=339, avg=234.63, stdev=74.18 clat percentiles (msec): | 1.00th=[ 167], 5.00th=[ 167], 10.00th=[ 167], 20.00th=[ 167], | 30.00th=[ 188], 40.00th=[ 188], 50.00th=[ 194], 60.00th=[ 194], | 70.00th=[ 288], 80.00th=[ 288], 90.00th=[ 338], 95.00th=[ 338], | 99.00th=[ 338], 99.50th=[ 338], 99.90th=[ 338], 99.95th=[ 338], | 99.99th=[ 338] bw ( KiB/s): min= 1882, max= 4087, per=28.55%, avg=2661.33, stdev=1236.45, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (msec) : 100=8.33%, 250=75.00%, 500=16.67% cpu : usr=0.00%, sys=51.10%, ctx=543, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=187863: Mon Nov 3 06:35:29 2025 read: IOPS=0, BW=666KiB/s (682kB/s)(2048KiB/3076msec) clat (usec): min=1018, max=108971, avg=54995.17, stdev=76334.49 lat (usec): min=1019, max=108974, avg=54997.33, stdev=76335.79 clat percentiles (usec): | 1.00th=[ 1020], 5.00th=[ 1020], 10.00th=[ 1020], 20.00th=[ 1020], | 30.00th=[ 1020], 40.00th=[ 1020], 50.00th=[ 1020], 60.00th=[108528], | 70.00th=[108528], 80.00th=[108528], 90.00th=[108528], 95.00th=[108528], | 99.00th=[108528], 99.50th=[108528], 99.90th=[108528], 99.95th=[108528], | 99.99th=[108528] bw ( KiB/s): min= 1747, max= 1882, per=27.26%, avg=1814.50, stdev=95.46, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=3, BW=3329KiB/s (3409kB/s)(10.0MiB/3076msec); 0 zone resets clat (msec): min=155, max=622, avg=295.46, stdev=142.94 lat (msec): min=155, max=622, avg=295.53, stdev=142.95 clat percentiles (msec): | 1.00th=[ 157], 5.00th=[ 157], 10.00th=[ 157], 20.00th=[ 186], | 30.00th=[ 194], 40.00th=[ 194], 50.00th=[ 257], 60.00th=[ 275], | 70.00th=[ 292], 80.00th=[ 342], 90.00th=[ 439], 95.00th=[ 625], | 99.00th=[ 625], 99.50th=[ 625], 99.90th=[ 625], 99.95th=[ 625], | 99.99th=[ 625] bw ( KiB/s): min= 1984, max= 5647, per=42.24%, avg=3937.25, stdev=1502.18, samples=4 iops : min= 1, max= 5, avg= 3.00, stdev= 1.63, samples=4 lat (msec) : 2=8.33%, 250=41.67%, 500=41.67%, 750=8.33% cpu : usr=0.00%, sys=42.15%, ctx=294, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=187864: Mon Nov 3 06:35:29 2025 read: IOPS=2, BW=2208KiB/s (2261kB/s)(6144KiB/2783msec) clat (usec): min=836, max=586515, avg=202944.79, stdev=202049.71 lat (usec): min=837, max=586516, avg=202946.06, stdev=202049.77 clat percentiles (usec): | 1.00th=[ 840], 5.00th=[ 840], 10.00th=[ 840], 20.00th=[109577], | 30.00th=[109577], 40.00th=[122160], 50.00th=[122160], 60.00th=[179307], | 70.00th=[219153], 80.00th=[219153], 90.00th=[583009], 95.00th=[583009], | 99.00th=[583009], 99.50th=[583009], 99.90th=[583009], 99.95th=[583009], | 99.99th=[583009] bw ( KiB/s): min= 1882, max= 3968, per=37.21%, avg=2477.00, stdev=996.48, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 write: IOPS=2, BW=2208KiB/s (2261kB/s)(6144KiB/2783msec); 0 zone resets clat (msec): min=127, max=434, avg=253.05, stdev=119.07 lat (msec): min=127, max=434, avg=253.12, stdev=119.06 clat percentiles (msec): | 1.00th=[ 128], 5.00th=[ 128], 10.00th=[ 128], 20.00th=[ 163], | 30.00th=[ 163], 40.00th=[ 176], 50.00th=[ 176], 60.00th=[ 284], | 70.00th=[ 338], 80.00th=[ 338], 90.00th=[ 435], 95.00th=[ 435], | 99.00th=[ 435], 99.50th=[ 435], 99.90th=[ 435], 99.95th=[ 435], | 99.99th=[ 435] bw ( KiB/s): min= 1984, max= 3561, per=25.76%, avg=2400.75, stdev=773.88, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (usec) : 1000=8.33% lat (msec) : 250=58.33%, 500=25.00%, 750=8.33% cpu : usr=0.00%, sys=30.91%, ctx=369, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=187865: Mon Nov 3 06:35:29 2025 read: IOPS=1, BW=1842KiB/s (1886kB/s)(5120KiB/2780msec) clat (usec): min=656, max=239551, avg=129786.25, stdev=118761.48 lat (usec): min=658, max=239552, avg=129787.36, stdev=118761.27 clat percentiles (usec): | 1.00th=[ 660], 5.00th=[ 660], 10.00th=[ 660], 20.00th=[ 660], | 30.00th=[ 865], 40.00th=[ 865], 50.00th=[198181], 60.00th=[198181], | 70.00th=[210764], 80.00th=[210764], 90.00th=[240124], 95.00th=[240124], | 99.00th=[240124], 99.50th=[240124], 99.90th=[240124], 99.95th=[240124], | 99.99th=[240124] bw ( KiB/s): min= 7529, max= 7529, per=100.00%, avg=7529.00, stdev= 0.00, samples=1 iops : min= 7, max= 7, avg= 7.00, stdev= 0.00, samples=1 write: IOPS=2, BW=2578KiB/s (2640kB/s)(7168KiB/2780msec); 0 zone resets clat (msec): min=113, max=430, avg=295.32, stdev=109.88 lat (msec): min=113, max=430, avg=295.39, stdev=109.90 clat percentiles (msec): | 1.00th=[ 114], 5.00th=[ 114], 10.00th=[ 114], 20.00th=[ 194], | 30.00th=[ 296], 40.00th=[ 296], 50.00th=[ 300], 60.00th=[ 347], | 70.00th=[ 347], 80.00th=[ 388], 90.00th=[ 430], 95.00th=[ 430], | 99.00th=[ 430], 99.50th=[ 430], 99.90th=[ 430], 99.95th=[ 430], | 99.99th=[ 430] bw ( KiB/s): min= 1762, max= 4087, per=26.41%, avg=2462.00, stdev=1089.18, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (usec) : 750=8.33%, 1000=8.33% lat (msec) : 250=41.67%, 500=41.67% cpu : usr=0.00%, sys=40.55%, ctx=386, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=6658KiB/s (6818kB/s), 666KiB/s-2979KiB/s (682kB/s-3051kB/s), io=20.0MiB (20.0MB), run=2406-3076msec WRITE: bw=9321KiB/s (9545kB/s), 2128KiB/s-3329KiB/s (2179kB/s-3409kB/s), io=28.0MiB (29.4MB), run=2406-3076msec rand-rw: (groupid=0, jobs=1): err= 0: pid=187866: Mon Nov 3 06:35:29 2025 read: IOPS=2, BW=2684KiB/s (2748kB/s)(7168KiB/2671msec) clat (msec): min=91, max=194, avg=139.65, stdev=34.28 lat (msec): min=91, max=194, avg=139.65, stdev=34.28 clat percentiles (msec): | 1.00th=[ 92], 5.00th=[ 92], 10.00th=[ 92], 20.00th=[ 110], | 30.00th=[ 125], 40.00th=[ 125], 50.00th=[ 146], 60.00th=[ 153], | 70.00th=[ 153], 80.00th=[ 159], 90.00th=[ 194], 95.00th=[ 194], | 99.00th=[ 194], 99.50th=[ 194], 99.90th=[ 194], 99.95th=[ 194], | 99.99th=[ 194] bw ( KiB/s): min= 2011, max= 4079, per=49.63%, avg=3018.50, stdev=1152.99, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 1.15, samples=4 write: IOPS=1, BW=1917KiB/s (1963kB/s)(5120KiB/2671msec); 0 zone resets clat (msec): min=154, max=525, avg=327.13, stdev=139.17 lat (msec): min=154, max=525, avg=327.25, stdev=139.11 clat percentiles (msec): | 1.00th=[ 155], 5.00th=[ 155], 10.00th=[ 155], 20.00th=[ 155], | 30.00th=[ 264], 40.00th=[ 264], 50.00th=[ 305], 60.00th=[ 305], | 70.00th=[ 388], 80.00th=[ 388], 90.00th=[ 527], 95.00th=[ 527], | 99.00th=[ 527], 99.50th=[ 527], 99.90th=[ 527], 99.95th=[ 527], | 99.99th=[ 527] bw ( KiB/s): min= 2011, max= 4063, per=39.34%, avg=3350.00, stdev=1160.42, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 lat (msec) : 100=8.33%, 250=58.33%, 500=25.00%, 750=8.33% cpu : usr=0.04%, sys=18.80%, ctx=159, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=187867: Mon Nov 3 06:35:29 2025 read: IOPS=0, BW=608KiB/s (623kB/s)(2048KiB/3367msec) clat (msec): min=120, max=363, avg=242.11, stdev=171.48 lat (msec): min=120, max=363, avg=242.11, stdev=171.48 clat percentiles (msec): | 1.00th=[ 122], 5.00th=[ 122], 10.00th=[ 122], 20.00th=[ 122], | 30.00th=[ 122], 40.00th=[ 122], 50.00th=[ 122], 60.00th=[ 363], | 70.00th=[ 363], 80.00th=[ 363], 90.00th=[ 363], 95.00th=[ 363], | 99.00th=[ 363], 99.50th=[ 363], 99.90th=[ 363], 99.95th=[ 363], | 99.99th=[ 363] bw ( KiB/s): min= 2011, max= 2043, per=33.33%, avg=2027.00, stdev=22.63, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=3041KiB/s (3114kB/s)(10.0MiB/3367msec); 0 zone resets clat (msec): min=55, max=745, avg=273.52, stdev=223.38 lat (msec): min=55, max=746, avg=273.63, stdev=223.36 clat percentiles (msec): | 1.00th=[ 56], 5.00th=[ 56], 10.00th=[ 56], 20.00th=[ 78], | 30.00th=[ 120], 40.00th=[ 133], 50.00th=[ 180], 60.00th=[ 234], | 70.00th=[ 257], 80.00th=[ 401], 90.00th=[ 535], 95.00th=[ 743], | 99.00th=[ 743], 99.50th=[ 743], 99.90th=[ 743], 99.95th=[ 743], | 99.99th=[ 743] bw ( KiB/s): min= 2011, max= 4087, per=35.84%, avg=3052.00, stdev=1190.53, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 1.15, samples=4 lat (msec) : 100=16.67%, 250=41.67%, 500=25.00%, 750=16.67% cpu : usr=0.03%, sys=17.62%, ctx=121, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=187868: Mon Nov 3 06:35:29 2025 read: IOPS=1, BW=1901KiB/s (1947kB/s)(6144KiB/3232msec) clat (msec): min=50, max=626, avg=181.94, stdev=220.86 lat (msec): min=50, max=626, avg=181.95, stdev=220.86 clat percentiles (msec): | 1.00th=[ 51], 5.00th=[ 51], 10.00th=[ 51], 20.00th=[ 59], | 30.00th=[ 59], 40.00th=[ 97], 50.00th=[ 97], 60.00th=[ 104], | 70.00th=[ 157], 80.00th=[ 157], 90.00th=[ 625], 95.00th=[ 625], | 99.00th=[ 625], 99.50th=[ 625], 99.90th=[ 625], 99.95th=[ 625], | 99.99th=[ 625] bw ( KiB/s): min= 1988, max= 4063, per=44.36%, avg=2698.00, stdev=1182.44, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 write: IOPS=1, BW=1901KiB/s (1947kB/s)(6144KiB/3232msec); 0 zone resets clat (msec): min=65, max=480, avg=328.72, stdev=150.40 lat (msec): min=65, max=480, avg=328.91, stdev=150.48 clat percentiles (msec): | 1.00th=[ 66], 5.00th=[ 66], 10.00th=[ 66], 20.00th=[ 257], | 30.00th=[ 257], 40.00th=[ 338], 50.00th=[ 338], 60.00th=[ 418], | 70.00th=[ 418], 80.00th=[ 418], 90.00th=[ 481], 95.00th=[ 481], | 99.00th=[ 481], 99.50th=[ 481], 99.90th=[ 481], 99.95th=[ 481], | 99.99th=[ 481] bw ( KiB/s): min= 2031, max= 4023, per=29.76%, avg=2534.00, stdev=992.68, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (msec) : 100=33.33%, 250=16.67%, 500=41.67%, 750=8.33% cpu : usr=0.00%, sys=13.09%, ctx=109, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=187869: Mon Nov 3 06:35:29 2025 read: IOPS=1, BW=1566KiB/s (1603kB/s)(5120KiB/3270msec) clat (msec): min=49, max=362, avg=163.10, stdev=133.51 lat (msec): min=49, max=362, avg=163.10, stdev=133.51 clat percentiles (msec): | 1.00th=[ 50], 5.00th=[ 50], 10.00th=[ 50], 20.00th=[ 50], | 30.00th=[ 69], 40.00th=[ 69], 50.00th=[ 100], 60.00th=[ 100], | 70.00th=[ 239], 80.00th=[ 239], 90.00th=[ 363], 95.00th=[ 363], | 99.00th=[ 363], 99.50th=[ 363], 99.90th=[ 363], 99.95th=[ 363], | 99.99th=[ 363] bw ( KiB/s): min= 4063, max= 4087, per=67.00%, avg=4075.00, stdev=16.97, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2192KiB/s (2245kB/s)(7168KiB/3270msec); 0 zone resets clat (msec): min=90, max=560, avg=327.16, stdev=181.22 lat (msec): min=90, max=560, avg=327.45, stdev=181.08 clat percentiles (msec): | 1.00th=[ 91], 5.00th=[ 91], 10.00th=[ 91], 20.00th=[ 140], | 30.00th=[ 213], 40.00th=[ 213], 50.00th=[ 380], 60.00th=[ 409], | 70.00th=[ 409], 80.00th=[ 498], 90.00th=[ 558], 95.00th=[ 558], | 99.00th=[ 558], 99.50th=[ 558], 99.90th=[ 558], 99.95th=[ 558], | 99.99th=[ 558] bw ( KiB/s): min= 1988, max= 4079, per=29.72%, avg=2530.25, stdev=1032.75, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (msec) : 50=8.33%, 100=25.00%, 250=25.00%, 500=33.33%, 750=8.33% cpu : usr=0.00%, sys=17.62%, ctx=161, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=6083KiB/s (6229kB/s), 608KiB/s-2684KiB/s (623kB/s-2748kB/s), io=20.0MiB (20.0MB), run=2671-3367msec WRITE: bw=8516KiB/s (8720kB/s), 1901KiB/s-3041KiB/s (1947kB/s-3114kB/s), io=28.0MiB (29.4MB), run=2671-3367msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=187875: Mon Nov 3 06:35:38 2025 read: IOPS=2, BW=9143KiB/s (9362kB/s)(12.0MiB/1344msec) clat (msec): min=309, max=551, avg=432.59, stdev=121.06 lat (msec): min=309, max=551, avg=432.59, stdev=121.06 clat percentiles (msec): | 1.00th=[ 309], 5.00th=[ 309], 10.00th=[ 309], 20.00th=[ 309], | 30.00th=[ 309], 40.00th=[ 439], 50.00th=[ 439], 60.00th=[ 439], | 70.00th=[ 550], 80.00th=[ 550], 90.00th=[ 550], 95.00th=[ 550], | 99.00th=[ 550], 99.50th=[ 550], 99.90th=[ 550], 99.95th=[ 550], | 99.99th=[ 550] bw ( KiB/s): min= 8110, max= 8192, per=85.93%, avg=8151.00, stdev=57.98, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 500=66.67%, 750=33.33% cpu : usr=0.00%, sys=20.63%, ctx=52, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=187876: Mon Nov 3 06:35:38 2025 read: IOPS=0, BW=2372KiB/s (2429kB/s)(4096KiB/1727msec) clat (nsec): min=103665k, max=103665k, avg=103665204.00, stdev= 0.00 lat (nsec): min=103668k, max=103668k, avg=103668025.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 104], 5.00th=[ 104], 10.00th=[ 104], 20.00th=[ 104], | 30.00th=[ 104], 40.00th=[ 104], 50.00th=[ 104], 60.00th=[ 104], | 70.00th=[ 104], 80.00th=[ 104], 90.00th=[ 104], 95.00th=[ 104], | 99.00th=[ 104], 99.50th=[ 104], 99.90th=[ 104], 99.95th=[ 104], | 99.99th=[ 104] bw ( KiB/s): min= 8062, max= 8062, per=84.99%, avg=8062.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=1, BW=4743KiB/s (4857kB/s)(8192KiB/1727msec); 0 zone resets clat (msec): min=749, max=826, avg=787.77, stdev=54.49 lat (msec): min=749, max=826, avg=788.07, stdev=54.48 clat percentiles (msec): | 1.00th=[ 751], 5.00th=[ 751], 10.00th=[ 751], 20.00th=[ 751], | 30.00th=[ 751], 40.00th=[ 751], 50.00th=[ 751], 60.00th=[ 827], | 70.00th=[ 827], 80.00th=[ 827], 90.00th=[ 827], 95.00th=[ 827], | 99.00th=[ 827], 99.50th=[ 827], 99.90th=[ 827], 99.95th=[ 827], | 99.99th=[ 827] bw ( KiB/s): min= 8192, max= 8192, per=52.95%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 750=33.33%, 1000=33.33% cpu : usr=0.00%, sys=13.96%, ctx=228, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=187877: Mon Nov 3 06:35:38 2025 write: IOPS=1, BW=5802KiB/s (5941kB/s)(12.0MiB/2118msec); 0 zone resets clat (msec): min=96, max=1334, avg=686.35, stdev=621.27 lat (msec): min=96, max=1337, avg=687.53, stdev=622.57 clat percentiles (msec): | 1.00th=[ 96], 5.00th=[ 96], 10.00th=[ 96], 20.00th=[ 96], | 30.00th=[ 96], 40.00th=[ 625], 50.00th=[ 625], 60.00th=[ 625], | 70.00th=[ 1334], 80.00th=[ 1334], 90.00th=[ 1334], 95.00th=[ 1334], | 99.00th=[ 1334], 99.50th=[ 1334], 99.90th=[ 1334], 99.95th=[ 1334], | 99.99th=[ 1334] bw ( KiB/s): min= 8192, max= 8192, per=52.95%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 100=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.14%, sys=14.36%, ctx=123, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=187880: Mon Nov 3 06:35:38 2025 write: IOPS=2, BW=9600KiB/s (9830kB/s)(12.0MiB/1280msec); 0 zone resets clat (msec): min=238, max=732, avg=416.09, stdev=274.84 lat (msec): min=238, max=732, avg=416.44, stdev=274.79 clat percentiles (msec): | 1.00th=[ 239], 5.00th=[ 239], 10.00th=[ 239], 20.00th=[ 239], | 30.00th=[ 239], 40.00th=[ 279], 50.00th=[ 279], 60.00th=[ 279], | 70.00th=[ 735], 80.00th=[ 735], 90.00th=[ 735], 95.00th=[ 735], | 99.00th=[ 735], 99.50th=[ 735], 99.90th=[ 735], 99.95th=[ 735], | 99.99th=[ 735] bw ( KiB/s): min=11457, max=11457, per=74.05%, avg=11457.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 500=33.33%, 750=33.33% cpu : usr=0.16%, sys=20.41%, ctx=84, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=9487KiB/s (9715kB/s), 2372KiB/s-9143KiB/s (2429kB/s-9362kB/s), io=16.0MiB (16.8MB), run=1344-1727msec WRITE: bw=15.1MiB/s (15.8MB/s), 4743KiB/s-9600KiB/s (4857kB/s-9830kB/s), io=32.0MiB (33.6MB), run=1280-2118msec rand-rw: (groupid=0, jobs=1): err= 0: pid=187878: Mon Nov 3 06:35:38 2025 read: IOPS=1, BW=7349KiB/s (7526kB/s)(12.0MiB/1672msec) clat (msec): min=441, max=623, avg=528.20, stdev=91.54 lat (msec): min=441, max=623, avg=528.20, stdev=91.54 clat percentiles (msec): | 1.00th=[ 443], 5.00th=[ 443], 10.00th=[ 443], 20.00th=[ 443], | 30.00th=[ 443], 40.00th=[ 518], 50.00th=[ 518], 60.00th=[ 518], | 70.00th=[ 625], 80.00th=[ 625], 90.00th=[ 625], 95.00th=[ 625], | 99.00th=[ 625], 99.50th=[ 625], 99.90th=[ 625], 99.95th=[ 625], | 99.99th=[ 625] bw ( KiB/s): min= 5859, max= 5859, per=62.52%, avg=5859.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 750=66.67% cpu : usr=0.00%, sys=42.49%, ctx=1506, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=187879: Mon Nov 3 06:35:38 2025 read: IOPS=0, BW=2343KiB/s (2399kB/s)(4096KiB/1748msec) clat (nsec): min=499018k, max=499018k, avg=499017845.00, stdev= 0.00 lat (nsec): min=499020k, max=499020k, avg=499020028.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 498], 5.00th=[ 498], 10.00th=[ 498], 20.00th=[ 498], | 30.00th=[ 498], 40.00th=[ 498], 50.00th=[ 498], 60.00th=[ 498], | 70.00th=[ 498], 80.00th=[ 498], 90.00th=[ 498], 95.00th=[ 498], | 99.00th=[ 498], 99.50th=[ 498], 99.90th=[ 498], 99.95th=[ 498], | 99.99th=[ 498] bw ( KiB/s): min= 5843, max= 5843, per=62.35%, avg=5843.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=1, BW=4686KiB/s (4799kB/s)(8192KiB/1748msec); 0 zone resets clat (msec): min=464, max=672, avg=568.67, stdev=147.17 lat (msec): min=464, max=673, avg=569.02, stdev=147.19 clat percentiles (msec): | 1.00th=[ 464], 5.00th=[ 464], 10.00th=[ 464], 20.00th=[ 464], | 30.00th=[ 464], 40.00th=[ 464], 50.00th=[ 464], 60.00th=[ 676], | 70.00th=[ 676], 80.00th=[ 676], 90.00th=[ 676], 95.00th=[ 676], | 99.00th=[ 676], 99.50th=[ 676], 99.90th=[ 676], 99.95th=[ 676], | 99.99th=[ 676] bw ( KiB/s): min= 8110, max= 8110, per=48.81%, avg=8110.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=66.67%, 750=33.33% cpu : usr=0.11%, sys=19.98%, ctx=699, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=187881: Mon Nov 3 06:35:38 2025 write: IOPS=1, BW=6231KiB/s (6381kB/s)(12.0MiB/1972msec); 0 zone resets clat (msec): min=164, max=975, avg=621.53, stdev=415.37 lat (msec): min=164, max=975, avg=621.89, stdev=415.38 clat percentiles (msec): | 1.00th=[ 165], 5.00th=[ 165], 10.00th=[ 165], 20.00th=[ 165], | 30.00th=[ 165], 40.00th=[ 726], 50.00th=[ 726], 60.00th=[ 726], | 70.00th=[ 978], 80.00th=[ 978], 90.00th=[ 978], 95.00th=[ 978], | 99.00th=[ 978], 99.50th=[ 978], 99.90th=[ 978], 99.95th=[ 978], | 99.99th=[ 978] bw ( KiB/s): min= 8110, max= 8110, per=48.81%, avg=8110.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 750=33.33%, 1000=33.33% cpu : usr=0.00%, sys=12.99%, ctx=74, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=187882: Mon Nov 3 06:35:38 2025 write: IOPS=1, BW=7704KiB/s (7889kB/s)(12.0MiB/1595msec); 0 zone resets clat (msec): min=233, max=804, avg=517.90, stdev=285.72 lat (msec): min=233, max=804, avg=518.25, stdev=285.71 clat percentiles (msec): | 1.00th=[ 234], 5.00th=[ 234], 10.00th=[ 234], 20.00th=[ 234], | 30.00th=[ 234], 40.00th=[ 518], 50.00th=[ 518], 60.00th=[ 518], | 70.00th=[ 802], 80.00th=[ 802], 90.00th=[ 802], 95.00th=[ 802], | 99.00th=[ 802], 99.50th=[ 802], 99.90th=[ 802], 99.95th=[ 802], | 99.99th=[ 802] bw ( KiB/s): min= 5736, max= 5736, per=34.52%, avg=5736.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 750=33.33%, 1000=33.33% cpu : usr=0.13%, sys=19.32%, ctx=86, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=9373KiB/s (9598kB/s), 2343KiB/s-7349KiB/s (2399kB/s-7526kB/s), io=16.0MiB (16.8MB), run=1672-1748msec WRITE: bw=16.2MiB/s (17.0MB/s), 4686KiB/s-7704KiB/s (4799kB/s-7889kB/s), io=32.0MiB (33.6MB), run=1595-1972msec