== sanity test 398b: DIO and buffer IO race ============== 10:21:22 (1761142882) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 2.7258 s, 18.5 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=154351: Wed Oct 22 10:22:31 2025 read: IOPS=24, BW=97.0KiB/s (100kB/s)(5992KiB/61162msec) clat (usec): min=96, max=676073, avg=21836.30, stdev=20121.21 lat (usec): min=97, max=676073, avg=21839.43, stdev=20120.87 clat percentiles (usec): | 1.00th=[ 519], 5.00th=[ 7570], 10.00th=[ 10290], 20.00th=[ 12911], | 30.00th=[ 15139], 40.00th=[ 17433], 50.00th=[ 19792], 60.00th=[ 22676], | 70.00th=[ 25822], 80.00th=[ 29230], 90.00th=[ 34341], 95.00th=[ 41157], | 99.00th=[ 56361], 99.50th=[ 64226], 99.90th=[122160], 99.95th=[675283], | 99.99th=[675283] bw ( KiB/s): min= 12, max= 152, per=24.94%, avg=97.52, stdev=24.72, samples=121 iops : min= 3, max= 38, avg=23.96, stdev= 6.24, samples=121 write: IOPS=25, BW=103KiB/s (105kB/s)(6296KiB/61162msec); 0 zone resets clat (usec): min=723, max=125793, avg=17939.25, stdev=13223.31 lat (usec): min=725, max=125794, avg=17940.35, stdev=13223.38 clat percentiles (usec): | 1.00th=[ 1696], 5.00th=[ 3294], 10.00th=[ 4424], 20.00th=[ 6063], | 30.00th=[ 8586], 40.00th=[ 12387], 50.00th=[ 15270], 60.00th=[ 18482], | 70.00th=[ 22676], 80.00th=[ 27919], 90.00th=[ 35390], 95.00th=[ 41157], | 99.00th=[ 61080], 99.50th=[ 69731], 99.90th=[ 95945], 99.95th=[125305], | 99.99th=[125305] bw ( KiB/s): min= 40, max= 200, per=25.17%, avg=103.22, stdev=29.51, samples=120 iops : min= 10, max= 50, avg=25.38, stdev= 7.37, samples=120 lat (usec) : 100=0.03%, 250=0.03%, 500=0.36%, 750=0.81%, 1000=0.36% lat (msec) : 2=0.85%, 4=2.93%, 10=16.18%, 20=36.33%, 50=40.10% lat (msec) : 100=1.92%, 250=0.07%, 750=0.03% cpu : usr=0.10%, sys=30.20%, ctx=10361, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=154352: Wed Oct 22 10:22:31 2025 read: IOPS=24, BW=97.0KiB/s (100kB/s)(5940KiB/60643msec) clat (usec): min=127, max=90410, avg=21667.67, stdev=10913.75 lat (usec): min=128, max=90410, avg=21683.14, stdev=10921.80 clat percentiles (usec): | 1.00th=[ 578], 5.00th=[ 7898], 10.00th=[10028], 20.00th=[13173], | 30.00th=[15401], 40.00th=[17695], 50.00th=[20055], 60.00th=[22676], | 70.00th=[25560], 80.00th=[29230], 90.00th=[35390], 95.00th=[41681], | 99.00th=[58983], 99.50th=[61604], 99.90th=[73925], 99.95th=[90702], | 99.99th=[90702] bw ( KiB/s): min= 6, max= 199, per=24.97%, avg=97.62, stdev=29.10, samples=120 iops : min= 1, max= 49, avg=23.98, stdev= 7.31, samples=120 write: IOPS=26, BW=105KiB/s (107kB/s)(6348KiB/60643msec); 0 zone resets clat (usec): min=652, max=668479, avg=17773.64, stdev=20814.86 lat (usec): min=652, max=668480, avg=17778.33, stdev=20816.40 clat percentiles (usec): | 1.00th=[ 1074], 5.00th=[ 2835], 10.00th=[ 4080], 20.00th=[ 5932], | 30.00th=[ 8291], 40.00th=[ 11994], 50.00th=[ 14877], 60.00th=[ 17957], | 70.00th=[ 21890], 80.00th=[ 27132], 90.00th=[ 33817], 95.00th=[ 41681], | 99.00th=[ 56886], 99.50th=[ 65799], 99.90th=[125305], 99.95th=[666895], | 99.99th=[666895] bw ( KiB/s): min= 55, max= 295, per=25.59%, avg=104.91, stdev=34.47, samples=119 iops : min= 13, max= 73, avg=25.80, stdev= 8.63, samples=119 lat (usec) : 250=0.07%, 500=0.26%, 750=0.59%, 1000=0.55% lat (msec) : 2=0.75%, 4=3.97%, 10=16.31%, 20=35.48%, 50=40.10% lat (msec) : 100=1.79%, 250=0.10%, 750=0.03% cpu : usr=0.12%, sys=30.37%, ctx=10236, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=154353: Wed Oct 22 10:22:31 2025 read: IOPS=24, BW=98.3KiB/s (101kB/s)(6028KiB/61294msec) clat (usec): min=163, max=108572, avg=21662.58, stdev=11727.92 lat (usec): min=164, max=108574, avg=21663.61, stdev=11727.98 clat percentiles (usec): | 1.00th=[ 562], 5.00th=[ 6390], 10.00th=[ 9634], 20.00th=[ 12649], | 30.00th=[ 15008], 40.00th=[ 17171], 50.00th=[ 19792], 60.00th=[ 22676], | 70.00th=[ 26346], 80.00th=[ 30016], 90.00th=[ 35390], 95.00th=[ 41157], | 99.00th=[ 60031], 99.50th=[ 70779], 99.90th=[ 96994], 99.95th=[108528], | 99.99th=[108528] bw ( KiB/s): min= 47, max= 199, per=25.02%, avg=97.84, stdev=29.20, samples=120 iops : min= 11, max= 49, avg=24.03, stdev= 7.35, samples=120 write: IOPS=25, BW=102KiB/s (105kB/s)(6260KiB/61294msec); 0 zone resets clat (usec): min=621, max=651530, avg=18173.64, stdev=20976.30 lat (usec): min=622, max=651530, avg=18174.73, stdev=20976.31 clat percentiles (usec): | 1.00th=[ 1319], 5.00th=[ 3064], 10.00th=[ 4293], 20.00th=[ 5800], | 30.00th=[ 7832], 40.00th=[ 11731], 50.00th=[ 15270], 60.00th=[ 18482], | 70.00th=[ 22414], 80.00th=[ 27657], 90.00th=[ 36439], 95.00th=[ 42730], | 99.00th=[ 62129], 99.50th=[ 77071], 99.90th=[116917], 99.95th=[650118], | 99.99th=[650118] bw ( KiB/s): min= 6, max= 207, per=24.51%, avg=100.49, stdev=30.26, samples=121 iops : min= 1, max= 51, avg=24.70, stdev= 7.55, samples=121 lat (usec) : 250=0.07%, 500=0.23%, 750=0.81%, 1000=0.42% lat (msec) : 2=0.81%, 4=3.58%, 10=17.32%, 20=34.31%, 50=40.07% lat (msec) : 100=2.25%, 250=0.10%, 750=0.03% cpu : usr=0.11%, sys=29.86%, ctx=10112, majf=1, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=154354: Wed Oct 22 10:22:31 2025 read: IOPS=24, BW=99.2KiB/s (102kB/s)(6052KiB/61003msec) clat (usec): min=81, max=81088, avg=21167.44, stdev=10841.93 lat (usec): min=81, max=81090, avg=21168.51, stdev=10841.96 clat percentiles (usec): | 1.00th=[ 469], 5.00th=[ 6521], 10.00th=[ 9503], 20.00th=[12911], | 30.00th=[15270], 40.00th=[17433], 50.00th=[19530], 60.00th=[22414], | 70.00th=[25297], 80.00th=[29230], 90.00th=[34866], 95.00th=[40633], | 99.00th=[54264], 99.50th=[61080], 99.90th=[81265], 99.95th=[81265], | 99.99th=[81265] bw ( KiB/s): min= 47, max= 191, per=25.55%, avg=99.91, stdev=25.94, samples=120 iops : min= 11, max= 47, avg=24.55, stdev= 6.51, samples=120 write: IOPS=25, BW=102KiB/s (105kB/s)(6236KiB/61003msec); 0 zone resets clat (usec): min=634, max=648683, avg=18447.47, stdev=20807.96 lat (usec): min=634, max=648683, avg=18448.61, stdev=20807.98 clat percentiles (usec): | 1.00th=[ 1369], 5.00th=[ 3326], 10.00th=[ 4359], 20.00th=[ 5866], | 30.00th=[ 8586], 40.00th=[ 12256], 50.00th=[ 15270], 60.00th=[ 18744], | 70.00th=[ 22938], 80.00th=[ 28443], 90.00th=[ 36439], 95.00th=[ 42730], | 99.00th=[ 58459], 99.50th=[ 78119], 99.90th=[100140], 99.95th=[650118], | 99.99th=[650118] bw ( KiB/s): min= 12, max= 205, per=24.85%, avg=101.87, stdev=31.19, samples=121 iops : min= 3, max= 51, avg=25.05, stdev= 7.80, samples=121 lat (usec) : 100=0.03%, 250=0.10%, 500=0.39%, 750=0.78%, 1000=0.78% lat (msec) : 2=0.75%, 4=3.16%, 10=16.73%, 20=35.06%, 50=40.56% lat (msec) : 100=1.63%, 750=0.03% cpu : usr=0.10%, sys=29.93%, ctx=10285, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=392KiB/s (401kB/s), 97.0KiB/s-99.2KiB/s (100kB/s-102kB/s), io=23.4MiB (24.6MB), run=60643-61294msec WRITE: bw=410KiB/s (420kB/s), 102KiB/s-105KiB/s (105kB/s-107kB/s), io=24.6MiB (25.7MB), run=60643-61294msec rand-rw: (groupid=0, jobs=1): err= 0: pid=154356: Wed Oct 22 10:22:50 2025 read: IOPS=18, BW=75.4KiB/s (77.2kB/s)(5992KiB/79484msec) clat (msec): min=2, max=682, avg=17.43, stdev=23.16 lat (msec): min=2, max=682, avg=17.43, stdev=23.16 clat percentiles (msec): | 1.00th=[ 3], 5.00th=[ 4], 10.00th=[ 4], 20.00th=[ 5], | 30.00th=[ 6], 40.00th=[ 10], 50.00th=[ 13], 60.00th=[ 16], | 70.00th=[ 20], 80.00th=[ 27], 90.00th=[ 38], 95.00th=[ 51], | 99.00th=[ 72], 99.50th=[ 84], 99.90th=[ 127], 99.95th=[ 684], | 99.99th=[ 684] bw ( KiB/s): min= 7, max= 256, per=25.23%, avg=75.69, stdev=48.39, samples=157 iops : min= 1, max= 64, avg=18.59, stdev=12.25, samples=157 write: IOPS=19, BW=79.2KiB/s (81.1kB/s)(6296KiB/79484msec); 0 zone resets clat (msec): min=11, max=133, avg=33.81, stdev=18.61 lat (msec): min=11, max=133, avg=33.81, stdev=18.61 clat percentiles (msec): | 1.00th=[ 14], 5.00th=[ 16], 10.00th=[ 17], 20.00th=[ 20], | 30.00th=[ 22], 40.00th=[ 25], 50.00th=[ 28], 60.00th=[ 33], | 70.00th=[ 40], 80.00th=[ 47], 90.00th=[ 61], 95.00th=[ 71], | 99.00th=[ 96], 99.50th=[ 115], 99.90th=[ 132], 99.95th=[ 133], | 99.99th=[ 133] bw ( KiB/s): min= 23, max= 184, per=25.31%, avg=79.46, stdev=43.43, samples=157 iops : min= 5, max= 46, avg=19.54, stdev=11.02, samples=157 lat (msec) : 4=6.84%, 10=13.51%, 20=26.53%, 50=42.19%, 100=10.48% lat (msec) : 250=0.42%, 750=0.03% cpu : usr=0.08%, sys=11.28%, ctx=6338, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=154357: Wed Oct 22 10:22:50 2025 read: IOPS=18, BW=74.4KiB/s (76.2kB/s)(5940KiB/79848msec) clat (msec): min=2, max=655, avg=18.07, stdev=23.89 lat (msec): min=2, max=655, avg=18.07, stdev=23.89 clat percentiles (msec): | 1.00th=[ 3], 5.00th=[ 4], 10.00th=[ 4], 20.00th=[ 5], | 30.00th=[ 6], 40.00th=[ 10], 50.00th=[ 13], 60.00th=[ 16], | 70.00th=[ 21], 80.00th=[ 27], 90.00th=[ 40], 95.00th=[ 55], | 99.00th=[ 82], 99.50th=[ 91], 99.90th=[ 161], 99.95th=[ 659], | 99.99th=[ 659] bw ( KiB/s): min= 15, max= 232, per=24.79%, avg=74.36, stdev=47.63, samples=157 iops : min= 3, max= 58, avg=18.26, stdev=12.05, samples=157 write: IOPS=19, BW=79.5KiB/s (81.4kB/s)(6348KiB/79848msec); 0 zone resets clat (msec): min=10, max=140, avg=33.31, stdev=18.09 lat (msec): min=10, max=140, avg=33.31, stdev=18.09 clat percentiles (msec): | 1.00th=[ 14], 5.00th=[ 16], 10.00th=[ 17], 20.00th=[ 19], | 30.00th=[ 22], 40.00th=[ 24], 50.00th=[ 28], 60.00th=[ 33], | 70.00th=[ 40], 80.00th=[ 46], 90.00th=[ 58], 95.00th=[ 69], | 99.00th=[ 94], 99.50th=[ 110], 99.90th=[ 136], 99.95th=[ 140], | 99.99th=[ 140] bw ( KiB/s): min= 23, max= 192, per=25.21%, avg=79.15, stdev=43.75, samples=157 iops : min= 5, max= 48, avg=19.46, stdev=11.12, samples=157 lat (msec) : 4=6.93%, 10=13.61%, 20=26.56%, 50=41.73%, 100=10.71% lat (msec) : 250=0.42%, 750=0.03% cpu : usr=0.08%, sys=11.30%, ctx=6449, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=154358: Wed Oct 22 10:22:50 2025 read: IOPS=18, BW=75.6KiB/s (77.4kB/s)(6028KiB/79759msec) clat (msec): min=2, max=161, avg=18.19, stdev=17.07 lat (msec): min=2, max=161, avg=18.20, stdev=17.07 clat percentiles (msec): | 1.00th=[ 3], 5.00th=[ 4], 10.00th=[ 4], 20.00th=[ 5], | 30.00th=[ 7], 40.00th=[ 11], 50.00th=[ 14], 60.00th=[ 17], | 70.00th=[ 21], 80.00th=[ 27], 90.00th=[ 41], 95.00th=[ 53], | 99.00th=[ 80], 99.50th=[ 94], 99.90th=[ 130], 99.95th=[ 161], | 99.99th=[ 161] bw ( KiB/s): min= 7, max= 248, per=25.21%, avg=75.64, stdev=45.46, samples=157 iops : min= 1, max= 62, avg=18.58, stdev=11.51, samples=157 write: IOPS=19, BW=78.5KiB/s (80.4kB/s)(6260KiB/79759msec); 0 zone resets clat (msec): min=12, max=659, avg=33.34, stdev=24.03 lat (msec): min=12, max=659, avg=33.34, stdev=24.03 clat percentiles (msec): | 1.00th=[ 14], 5.00th=[ 16], 10.00th=[ 17], 20.00th=[ 19], | 30.00th=[ 22], 40.00th=[ 24], 50.00th=[ 27], 60.00th=[ 32], | 70.00th=[ 38], 80.00th=[ 46], 90.00th=[ 57], 95.00th=[ 69], | 99.00th=[ 99], 99.50th=[ 110], 99.90th=[ 136], 99.95th=[ 659], | 99.99th=[ 659] bw ( KiB/s): min= 15, max= 192, per=24.95%, avg=78.34, stdev=44.68, samples=157 iops : min= 3, max= 48, avg=19.25, stdev=11.34, samples=157 lat (msec) : 4=6.18%, 10=12.96%, 20=26.69%, 50=43.46%, 100=10.16% lat (msec) : 250=0.52%, 750=0.03% cpu : usr=0.08%, sys=11.34%, ctx=6501, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=154359: Wed Oct 22 10:22:50 2025 read: IOPS=19, BW=76.6KiB/s (78.4kB/s)(6052KiB/79048msec) clat (msec): min=2, max=111, avg=17.63, stdev=16.43 lat (msec): min=2, max=111, avg=17.63, stdev=16.43 clat percentiles (msec): | 1.00th=[ 3], 5.00th=[ 4], 10.00th=[ 4], 20.00th=[ 5], | 30.00th=[ 7], 40.00th=[ 11], 50.00th=[ 14], 60.00th=[ 17], | 70.00th=[ 20], 80.00th=[ 27], 90.00th=[ 41], 95.00th=[ 54], | 99.00th=[ 77], 99.50th=[ 84], 99.90th=[ 111], 99.95th=[ 112], | 99.99th=[ 112] bw ( KiB/s): min= 7, max= 240, per=25.63%, avg=76.89, stdev=46.91, samples=156 iops : min= 1, max= 60, avg=18.89, stdev=11.90, samples=156 write: IOPS=19, BW=78.9KiB/s (80.8kB/s)(6236KiB/79048msec); 0 zone resets clat (msec): min=12, max=660, avg=33.49, stdev=23.90 lat (msec): min=12, max=660, avg=33.49, stdev=23.90 clat percentiles (msec): | 1.00th=[ 14], 5.00th=[ 16], 10.00th=[ 17], 20.00th=[ 19], | 30.00th=[ 22], 40.00th=[ 24], 50.00th=[ 28], 60.00th=[ 33], | 70.00th=[ 39], 80.00th=[ 46], 90.00th=[ 57], 95.00th=[ 71], | 99.00th=[ 95], 99.50th=[ 105], 99.90th=[ 131], 99.95th=[ 659], | 99.99th=[ 659] bw ( KiB/s): min= 24, max= 192, per=25.22%, avg=79.19, stdev=44.05, samples=156 iops : min= 6, max= 48, avg=19.47, stdev=11.17, samples=156 lat (msec) : 4=7.23%, 10=12.24%, 20=27.96%, 50=42.12%, 100=9.99% lat (msec) : 250=0.42%, 750=0.03% cpu : usr=0.08%, sys=11.53%, ctx=6425, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=301KiB/s (308kB/s), 74.4KiB/s-76.6KiB/s (76.2kB/s-78.4kB/s), io=23.4MiB (24.6MB), run=79048-79848msec WRITE: bw=315KiB/s (322kB/s), 78.5KiB/s-79.5KiB/s (80.4kB/s-81.4kB/s), io=24.6MiB (25.7MB), run=79048-79848msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=154393: Wed Oct 22 10:23:13 2025 read: IOPS=21, BW=344KiB/s (352kB/s)(5920KiB/17234msec) clat (usec): min=107, max=95173, avg=23998.59, stdev=14313.26 lat (usec): min=107, max=95173, avg=23999.25, stdev=14313.29 clat percentiles (usec): | 1.00th=[ 351], 5.00th=[ 594], 10.00th=[ 8291], 20.00th=[13042], | 30.00th=[16188], 40.00th=[19006], 50.00th=[21890], 60.00th=[25560], | 70.00th=[30016], 80.00th=[35390], 90.00th=[41157], 95.00th=[47449], | 99.00th=[66847], 99.50th=[87557], 99.90th=[94897], 99.95th=[94897], | 99.99th=[94897] bw ( KiB/s): min= 95, max= 699, per=24.54%, avg=340.91, stdev=121.32, samples=34 iops : min= 5, max= 43, avg=20.65, stdev= 7.67, samples=34 write: IOPS=23, BW=370KiB/s (378kB/s)(6368KiB/17234msec); 0 zone resets clat (usec): min=1313, max=76457, avg=20879.18, stdev=13595.75 lat (usec): min=1314, max=76458, avg=20880.66, stdev=13595.78 clat percentiles (usec): | 1.00th=[ 3261], 5.00th=[ 4621], 10.00th=[ 5604], 20.00th=[ 8291], | 30.00th=[11338], 40.00th=[14746], 50.00th=[17957], 60.00th=[22152], | 70.00th=[26346], 80.00th=[32637], 90.00th=[40633], 95.00th=[46400], | 99.00th=[67634], 99.50th=[74974], 99.90th=[76022], 99.95th=[76022], | 99.99th=[76022] bw ( KiB/s): min= 222, max= 736, per=25.18%, avg=368.12, stdev=107.43, samples=34 iops : min= 13, max= 46, avg=22.35, stdev= 6.91, samples=34 lat (usec) : 250=0.39%, 500=1.30%, 750=1.30%, 1000=0.78% lat (msec) : 2=0.13%, 4=1.69%, 10=13.28%, 20=29.56%, 50=48.31% lat (msec) : 100=3.26% cpu : usr=0.08%, sys=31.78%, ctx=2963, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=154394: Wed Oct 22 10:23:13 2025 read: IOPS=20, BW=334KiB/s (342kB/s)(5744KiB/17184msec) clat (usec): min=252, max=80333, avg=24125.89, stdev=12651.77 lat (usec): min=253, max=80334, avg=24126.61, stdev=12651.82 clat percentiles (usec): | 1.00th=[ 482], 5.00th=[ 4359], 10.00th=[11469], 20.00th=[14615], | 30.00th=[16909], 40.00th=[19006], 50.00th=[21890], 60.00th=[25560], | 70.00th=[29230], 80.00th=[34866], 90.00th=[41681], 95.00th=[44303], | 99.00th=[65274], 99.50th=[76022], 99.90th=[80217], 99.95th=[80217], | 99.99th=[80217] bw ( KiB/s): min= 127, max= 608, per=24.08%, avg=334.41, stdev=111.52, samples=34 iops : min= 7, max= 38, avg=20.24, stdev= 7.09, samples=34 write: IOPS=23, BW=381KiB/s (390kB/s)(6544KiB/17184msec); 0 zone resets clat (usec): min=1558, max=92694, avg=20732.57, stdev=14516.94 lat (usec): min=1559, max=92696, avg=20734.01, stdev=14516.90 clat percentiles (usec): | 1.00th=[ 2573], 5.00th=[ 4621], 10.00th=[ 5735], 20.00th=[ 8291], | 30.00th=[11076], 40.00th=[14091], 50.00th=[17171], 60.00th=[20579], | 70.00th=[25822], 80.00th=[31327], 90.00th=[40109], 95.00th=[51119], | 99.00th=[67634], 99.50th=[70779], 99.90th=[92799], 99.95th=[92799], | 99.99th=[92799] bw ( KiB/s): min= 95, max= 832, per=25.94%, avg=379.29, stdev=143.46, samples=34 iops : min= 5, max= 52, avg=23.06, stdev= 9.11, samples=34 lat (usec) : 500=0.52%, 750=0.65%, 1000=0.78% lat (msec) : 2=0.26%, 4=2.34%, 10=13.15%, 20=34.11%, 50=44.01% lat (msec) : 100=4.17% cpu : usr=0.10%, sys=31.56%, ctx=2991, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=154396: Wed Oct 22 10:23:13 2025 read: IOPS=22, BW=367KiB/s (376kB/s)(6256KiB/17046msec) clat (usec): min=92, max=112486, avg=23420.81, stdev=13505.84 lat (usec): min=93, max=112486, avg=23421.57, stdev=13505.86 clat percentiles (usec): | 1.00th=[ 190], 5.00th=[ 717], 10.00th=[ 9503], 20.00th=[ 13566], | 30.00th=[ 16581], 40.00th=[ 19006], 50.00th=[ 22152], 60.00th=[ 25035], | 70.00th=[ 28443], 80.00th=[ 32637], 90.00th=[ 40109], 95.00th=[ 45351], | 99.00th=[ 62653], 99.50th=[ 79168], 99.90th=[112722], 99.95th=[112722], | 99.99th=[112722] bw ( KiB/s): min= 159, max= 572, per=26.25%, avg=364.58, stdev=105.83, samples=33 iops : min= 9, max= 35, avg=22.12, stdev= 6.66, samples=33 write: IOPS=22, BW=354KiB/s (362kB/s)(6032KiB/17046msec); 0 zone resets clat (usec): min=1653, max=114886, avg=20736.20, stdev=14099.59 lat (usec): min=1653, max=114888, avg=20737.51, stdev=14099.65 clat percentiles (msec): | 1.00th=[ 3], 5.00th=[ 5], 10.00th=[ 7], 20.00th=[ 10], | 30.00th=[ 12], 40.00th=[ 15], 50.00th=[ 18], 60.00th=[ 22], | 70.00th=[ 25], 80.00th=[ 30], 90.00th=[ 38], 95.00th=[ 47], | 99.00th=[ 68], 99.50th=[ 100], 99.90th=[ 115], 99.95th=[ 115], | 99.99th=[ 115] bw ( KiB/s): min= 158, max= 672, per=23.59%, avg=344.91, stdev=112.69, samples=33 iops : min= 9, max= 42, avg=20.88, stdev= 7.19, samples=33 lat (usec) : 100=0.13%, 250=0.39%, 500=0.52%, 750=2.08%, 1000=0.78% lat (msec) : 2=0.65%, 4=0.65%, 10=11.98%, 20=32.42%, 50=47.14% lat (msec) : 100=2.99%, 250=0.26% cpu : usr=0.10%, sys=31.73%, ctx=3052, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=154397: Wed Oct 22 10:23:13 2025 read: IOPS=22, BW=359KiB/s (368kB/s)(6032KiB/16782msec) clat (usec): min=216, max=71609, avg=22627.50, stdev=13526.47 lat (usec): min=216, max=71610, avg=22628.32, stdev=13526.57 clat percentiles (usec): | 1.00th=[ 326], 5.00th=[ 594], 10.00th=[ 1614], 20.00th=[12125], | 30.00th=[15401], 40.00th=[17957], 50.00th=[21103], 60.00th=[24773], | 70.00th=[28181], 80.00th=[32900], 90.00th=[40109], 95.00th=[46400], | 99.00th=[65274], 99.50th=[65274], 99.90th=[71828], 99.95th=[71828], | 99.99th=[71828] bw ( KiB/s): min= 158, max= 638, per=25.75%, avg=357.73, stdev=115.21, samples=33 iops : min= 9, max= 39, avg=21.67, stdev= 7.21, samples=33 write: IOPS=23, BW=373KiB/s (382kB/s)(6256KiB/16782msec); 0 zone resets clat (usec): min=1406, max=100146, avg=20936.24, stdev=14311.81 lat (usec): min=1407, max=100147, avg=20937.53, stdev=14311.85 clat percentiles (msec): | 1.00th=[ 3], 5.00th=[ 5], 10.00th=[ 6], 20.00th=[ 9], | 30.00th=[ 11], 40.00th=[ 15], 50.00th=[ 19], 60.00th=[ 23], | 70.00th=[ 27], 80.00th=[ 33], 90.00th=[ 40], 95.00th=[ 48], | 99.00th=[ 69], 99.50th=[ 72], 99.90th=[ 101], 99.95th=[ 101], | 99.99th=[ 101] bw ( KiB/s): min= 127, max= 640, per=25.47%, avg=372.39, stdev=114.44, samples=33 iops : min= 7, max= 40, avg=22.61, stdev= 7.28, samples=33 lat (usec) : 250=0.39%, 500=1.43%, 750=2.34%, 1000=0.65% lat (msec) : 2=0.39%, 4=1.30%, 10=15.36%, 20=28.26%, 50=45.96% lat (msec) : 100=3.78%, 250=0.13% cpu : usr=0.06%, sys=31.55%, ctx=2927, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1390KiB/s (1423kB/s), 334KiB/s-367KiB/s (342kB/s-376kB/s), io=23.4MiB (24.5MB), run=16782-17234msec WRITE: bw=1462KiB/s (1497kB/s), 354KiB/s-381KiB/s (362kB/s-390kB/s), io=24.6MiB (25.8MB), run=16782-17234msec rand-rw: (groupid=0, jobs=1): err= 0: pid=154398: Wed Oct 22 10:23:19 2025 read: IOPS=16, BW=260KiB/s (266kB/s)(5920KiB/22788msec) clat (msec): min=3, max=110, avg=21.11, stdev=17.88 lat (msec): min=3, max=110, avg=21.12, stdev=17.88 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 5], 10.00th=[ 6], 20.00th=[ 9], | 30.00th=[ 10], 40.00th=[ 13], 50.00th=[ 16], 60.00th=[ 19], | 70.00th=[ 23], 80.00th=[ 32], 90.00th=[ 47], 95.00th=[ 59], | 99.00th=[ 85], 99.50th=[ 107], 99.90th=[ 110], 99.95th=[ 110], | 99.99th=[ 110] bw ( KiB/s): min= 63, max= 576, per=24.49%, avg=257.36, stdev=133.18, samples=45 iops : min= 3, max= 36, avg=15.56, stdev= 8.52, samples=45 write: IOPS=17, BW=279KiB/s (286kB/s)(6368KiB/22788msec); 0 zone resets clat (msec): min=13, max=170, avg=37.33, stdev=21.47 lat (msec): min=13, max=170, avg=37.33, stdev=21.47 clat percentiles (msec): | 1.00th=[ 15], 5.00th=[ 18], 10.00th=[ 21], 20.00th=[ 23], | 30.00th=[ 25], 40.00th=[ 28], 50.00th=[ 31], 60.00th=[ 35], | 70.00th=[ 42], 80.00th=[ 50], 90.00th=[ 62], 95.00th=[ 83], | 99.00th=[ 123], 99.50th=[ 144], 99.90th=[ 171], 99.95th=[ 171], | 99.99th=[ 171] bw ( KiB/s): min= 126, max= 576, per=25.21%, avg=278.58, stdev=128.73, samples=45 iops : min= 7, max= 36, avg=16.87, stdev= 8.29, samples=45 lat (msec) : 4=1.30%, 10=13.54%, 20=20.57%, 50=50.52%, 100=12.37% lat (msec) : 250=1.69% cpu : usr=0.07%, sys=12.38%, ctx=1853, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=154399: Wed Oct 22 10:23:19 2025 read: IOPS=15, BW=253KiB/s (259kB/s)(5744KiB/22738msec) clat (usec): min=3054, max=91022, avg=20474.02, stdev=16568.94 lat (usec): min=3055, max=91023, avg=20474.71, stdev=16568.93 clat percentiles (usec): | 1.00th=[ 3228], 5.00th=[ 4228], 10.00th=[ 5407], 20.00th=[ 8094], | 30.00th=[10552], 40.00th=[12649], 50.00th=[15533], 60.00th=[18482], | 70.00th=[22414], 80.00th=[29230], 90.00th=[45876], 95.00th=[58983], | 99.00th=[82314], 99.50th=[88605], 99.90th=[90702], 99.95th=[90702], | 99.99th=[90702] bw ( KiB/s): min= 52, max= 672, per=24.19%, avg=254.20, stdev=146.61, samples=45 iops : min= 3, max= 42, avg=15.36, stdev= 9.34, samples=45 write: IOPS=17, BW=288KiB/s (295kB/s)(6544KiB/22738msec); 0 zone resets clat (msec): min=14, max=115, avg=37.56, stdev=19.15 lat (msec): min=14, max=115, avg=37.56, stdev=19.15 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 18], 10.00th=[ 20], 20.00th=[ 23], | 30.00th=[ 25], 40.00th=[ 29], 50.00th=[ 32], 60.00th=[ 36], | 70.00th=[ 43], 80.00th=[ 51], 90.00th=[ 66], 95.00th=[ 79], | 99.00th=[ 97], 99.50th=[ 113], 99.90th=[ 116], 99.95th=[ 116], | 99.99th=[ 116] bw ( KiB/s): min= 96, max= 544, per=26.02%, avg=287.51, stdev=131.69, samples=45 iops : min= 6, max= 34, avg=17.44, stdev= 8.44, samples=45 lat (msec) : 4=1.82%, 10=10.81%, 20=23.18%, 50=49.22%, 100=14.58% lat (msec) : 250=0.39% cpu : usr=0.07%, sys=12.09%, ctx=1793, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=154400: Wed Oct 22 10:23:19 2025 read: IOPS=17, BW=275KiB/s (282kB/s)(6256KiB/22724msec) clat (msec): min=3, max=102, avg=21.02, stdev=18.95 lat (msec): min=3, max=102, avg=21.03, stdev=18.95 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 5], 10.00th=[ 6], 20.00th=[ 8], | 30.00th=[ 10], 40.00th=[ 12], 50.00th=[ 15], 60.00th=[ 18], | 70.00th=[ 21], 80.00th=[ 30], 90.00th=[ 48], 95.00th=[ 66], | 99.00th=[ 90], 99.50th=[ 100], 99.90th=[ 103], 99.95th=[ 103], | 99.99th=[ 103] bw ( KiB/s): min= 95, max= 768, per=26.29%, avg=276.27, stdev=168.61, samples=45 iops : min= 5, max= 48, avg=16.73, stdev=10.80, samples=45 write: IOPS=16, BW=265KiB/s (272kB/s)(6032KiB/22724msec); 0 zone resets clat (msec): min=14, max=165, avg=38.24, stdev=20.16 lat (msec): min=15, max=165, avg=38.25, stdev=20.16 clat percentiles (msec): | 1.00th=[ 18], 5.00th=[ 20], 10.00th=[ 21], 20.00th=[ 23], | 30.00th=[ 26], 40.00th=[ 28], 50.00th=[ 31], 60.00th=[ 37], | 70.00th=[ 43], 80.00th=[ 53], 90.00th=[ 65], 95.00th=[ 80], | 99.00th=[ 111], 99.50th=[ 153], 99.90th=[ 167], 99.95th=[ 167], | 99.99th=[ 167] bw ( KiB/s): min= 95, max= 544, per=23.95%, avg=264.67, stdev=123.49, samples=45 iops : min= 5, max= 34, avg=16.00, stdev= 7.94, samples=45 lat (msec) : 4=1.17%, 10=14.97%, 20=22.27%, 50=46.22%, 100=14.58% lat (msec) : 250=0.78% cpu : usr=0.10%, sys=12.02%, ctx=1748, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=154401: Wed Oct 22 10:23:19 2025 read: IOPS=16, BW=267KiB/s (274kB/s)(6032KiB/22584msec) clat (msec): min=3, max=126, avg=21.31, stdev=18.13 lat (msec): min=3, max=126, avg=21.31, stdev=18.13 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 6], 10.00th=[ 8], 20.00th=[ 9], | 30.00th=[ 11], 40.00th=[ 14], 50.00th=[ 16], 60.00th=[ 19], | 70.00th=[ 25], 80.00th=[ 29], 90.00th=[ 43], 95.00th=[ 62], | 99.00th=[ 94], 99.50th=[ 122], 99.90th=[ 127], 99.95th=[ 127], | 99.99th=[ 127] bw ( KiB/s): min= 96, max= 640, per=25.08%, avg=263.61, stdev=130.68, samples=44 iops : min= 6, max= 40, avg=15.93, stdev= 8.41, samples=44 write: IOPS=17, BW=277KiB/s (284kB/s)(6256KiB/22584msec); 0 zone resets clat (msec): min=15, max=123, avg=36.97, stdev=18.89 lat (msec): min=15, max=123, avg=36.97, stdev=18.89 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 18], 10.00th=[ 20], 20.00th=[ 23], | 30.00th=[ 26], 40.00th=[ 28], 50.00th=[ 31], 60.00th=[ 36], | 70.00th=[ 42], 80.00th=[ 51], 90.00th=[ 61], 95.00th=[ 75], | 99.00th=[ 111], 99.50th=[ 114], 99.90th=[ 124], 99.95th=[ 124], | 99.99th=[ 124] bw ( KiB/s): min= 95, max= 606, per=24.90%, avg=275.11, stdev=130.09, samples=44 iops : min= 5, max= 37, avg=16.66, stdev= 8.32, samples=44 lat (msec) : 4=0.26%, 10=12.50%, 20=23.70%, 50=49.74%, 100=12.50% lat (msec) : 250=1.30% cpu : usr=0.09%, sys=11.99%, ctx=1748, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1051KiB/s (1076kB/s), 253KiB/s-275KiB/s (259kB/s-282kB/s), io=23.4MiB (24.5MB), run=22584-22788msec WRITE: bw=1106KiB/s (1132kB/s), 265KiB/s-288KiB/s (272kB/s-295kB/s), io=24.6MiB (25.8MB), run=22584-22788msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=154411: Wed Oct 22 10:23:30 2025 read: IOPS=1, BW=1660KiB/s (1700kB/s)(7168KiB/4318msec) clat (msec): min=3, max=374, avg=188.11, stdev=129.27 lat (msec): min=3, max=374, avg=188.11, stdev=129.27 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 4], 10.00th=[ 4], 20.00th=[ 79], | 30.00th=[ 167], 40.00th=[ 167], 50.00th=[ 184], 60.00th=[ 186], | 70.00th=[ 186], 80.00th=[ 326], 90.00th=[ 376], 95.00th=[ 376], | 99.00th=[ 376], 99.50th=[ 376], 99.90th=[ 376], 99.95th=[ 376], | 99.99th=[ 376] bw ( KiB/s): min= 2000, max= 4564, per=68.63%, avg=2662.75, stdev=1267.67, samples=4 iops : min= 1, max= 4, avg= 2.00, stdev= 1.41, samples=4 write: IOPS=1, BW=1186KiB/s (1214kB/s)(5120KiB/4318msec); 0 zone resets clat (msec): min=215, max=985, avg=587.70, stdev=327.45 lat (msec): min=215, max=986, avg=587.86, stdev=327.55 clat percentiles (msec): | 1.00th=[ 215], 5.00th=[ 215], 10.00th=[ 215], 20.00th=[ 215], | 30.00th=[ 355], 40.00th=[ 355], 50.00th=[ 527], 60.00th=[ 527], | 70.00th=[ 860], 80.00th=[ 860], 90.00th=[ 986], 95.00th=[ 986], | 99.00th=[ 986], 99.50th=[ 986], 99.90th=[ 986], 99.95th=[ 986], | 99.99th=[ 986] bw ( KiB/s): min= 1828, max= 2048, per=36.32%, avg=1973.00, stdev=88.86, samples=5 iops : min= 1, max= 2, avg= 1.20, stdev= 0.45, samples=5 lat (msec) : 4=8.33%, 100=8.33%, 250=33.33%, 500=25.00%, 750=8.33% lat (msec) : 1000=16.67% cpu : usr=0.00%, sys=44.96%, ctx=1678, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=154412: Wed Oct 22 10:23:30 2025 read: IOPS=0, BW=388KiB/s (397kB/s)(2048KiB/5278msec) clat (msec): min=83, max=1898, avg=990.81, stdev=1283.77 lat (msec): min=83, max=1898, avg=990.81, stdev=1283.77 clat percentiles (msec): | 1.00th=[ 84], 5.00th=[ 84], 10.00th=[ 84], 20.00th=[ 84], | 30.00th=[ 84], 40.00th=[ 84], 50.00th=[ 84], 60.00th=[ 1905], | 70.00th=[ 1905], 80.00th=[ 1905], 90.00th=[ 1905], 95.00th=[ 1905], | 99.00th=[ 1905], 99.50th=[ 1905], 99.90th=[ 1905], 99.95th=[ 1905], | 99.99th=[ 1905] bw ( KiB/s): min= 2027, max= 2035, per=52.35%, avg=2031.00, stdev= 5.66, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1940KiB/s (1987kB/s)(10.0MiB/5278msec); 0 zone resets clat (msec): min=122, max=709, avg=326.29, stdev=176.06 lat (msec): min=122, max=709, avg=326.38, stdev=176.07 clat percentiles (msec): | 1.00th=[ 123], 5.00th=[ 123], 10.00th=[ 123], 20.00th=[ 153], | 30.00th=[ 186], 40.00th=[ 249], 50.00th=[ 253], 60.00th=[ 321], | 70.00th=[ 401], 80.00th=[ 409], 90.00th=[ 460], 95.00th=[ 709], | 99.00th=[ 709], 99.50th=[ 709], 99.90th=[ 709], 99.95th=[ 709], | 99.99th=[ 709] bw ( KiB/s): min= 1828, max= 3908, per=43.24%, avg=2348.60, stdev=875.15, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 lat (msec) : 100=8.33%, 250=33.33%, 500=41.67%, 750=8.33%, 2000=8.33% cpu : usr=0.02%, sys=41.86%, ctx=686, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=154413: Wed Oct 22 10:23:30 2025 read: IOPS=2, BW=2257KiB/s (2311kB/s)(6144KiB/2722msec) clat (usec): min=1057, max=184444, avg=105209.68, stdev=84135.05 lat (usec): min=1058, max=184445, avg=105210.55, stdev=84134.85 clat percentiles (usec): | 1.00th=[ 1057], 5.00th=[ 1057], 10.00th=[ 1057], 20.00th=[ 2933], | 30.00th=[ 2933], 40.00th=[108528], 50.00th=[108528], 60.00th=[158335], | 70.00th=[175113], 80.00th=[175113], 90.00th=[183501], 95.00th=[183501], | 99.00th=[183501], 99.50th=[183501], 99.90th=[183501], 99.95th=[183501], | 99.99th=[183501] bw ( KiB/s): min= 4071, max= 4079, per=100.00%, avg=4075.00, stdev= 5.66, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2257KiB/s (2311kB/s)(6144KiB/2722msec); 0 zone resets clat (msec): min=152, max=631, avg=346.70, stdev=158.61 lat (msec): min=152, max=631, avg=346.75, stdev=158.61 clat percentiles (msec): | 1.00th=[ 153], 5.00th=[ 153], 10.00th=[ 153], 20.00th=[ 264], | 30.00th=[ 264], 40.00th=[ 338], 50.00th=[ 338], 60.00th=[ 347], | 70.00th=[ 351], 80.00th=[ 351], 90.00th=[ 634], 95.00th=[ 634], | 99.00th=[ 634], 99.50th=[ 634], 99.90th=[ 634], 99.95th=[ 634], | 99.99th=[ 634] bw ( KiB/s): min= 2035, max= 3043, per=43.73%, avg=2375.33, stdev=578.25, samples=3 iops : min= 1, max= 2, avg= 1.67, stdev= 0.58, samples=3 lat (msec) : 2=8.33%, 4=8.33%, 250=41.67%, 500=33.33%, 750=8.33% cpu : usr=0.00%, sys=48.84%, ctx=492, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=154414: Wed Oct 22 10:23:30 2025 read: IOPS=1, BW=1551KiB/s (1588kB/s)(5120KiB/3302msec) clat (usec): min=907, max=278066, avg=58807.26, stdev=122685.38 lat (usec): min=908, max=278067, avg=58808.30, stdev=122685.54 clat percentiles (usec): | 1.00th=[ 906], 5.00th=[ 906], 10.00th=[ 906], 20.00th=[ 906], | 30.00th=[ 914], 40.00th=[ 914], 50.00th=[ 930], 60.00th=[ 930], | 70.00th=[ 13173], 80.00th=[ 13173], 90.00th=[278922], 95.00th=[278922], | 99.00th=[278922], 99.50th=[278922], 99.90th=[278922], 99.95th=[278922], | 99.99th=[278922] bw ( KiB/s): min= 8143, max= 8143, per=100.00%, avg=8143.00, stdev= 0.00, samples=1 iops : min= 7, max= 7, avg= 7.00, stdev= 0.00, samples=1 write: IOPS=2, BW=2171KiB/s (2223kB/s)(7168KiB/3302msec); 0 zone resets clat (msec): min=138, max=828, avg=406.59, stdev=271.48 lat (msec): min=138, max=828, avg=406.65, stdev=271.48 clat percentiles (msec): | 1.00th=[ 138], 5.00th=[ 138], 10.00th=[ 138], 20.00th=[ 176], | 30.00th=[ 234], 40.00th=[ 234], 50.00th=[ 268], 60.00th=[ 518], | 70.00th=[ 518], 80.00th=[ 684], 90.00th=[ 827], 95.00th=[ 827], | 99.00th=[ 827], 99.50th=[ 827], 99.90th=[ 827], 99.95th=[ 827], | 99.99th=[ 827] bw ( KiB/s): min= 1521, max= 4079, per=49.43%, avg=2684.80, stdev=1233.21, samples=5 iops : min= 1, max= 3, avg= 1.80, stdev= 1.10, samples=5 lat (usec) : 1000=25.00% lat (msec) : 20=8.33%, 250=25.00%, 500=16.67%, 750=16.67%, 1000=8.33% cpu : usr=0.06%, sys=41.56%, ctx=179, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3880KiB/s (3973kB/s), 388KiB/s-2257KiB/s (397kB/s-2311kB/s), io=20.0MiB (20.0MB), run=2722-5278msec WRITE: bw=5432KiB/s (5563kB/s), 1186KiB/s-2257KiB/s (1214kB/s-2311kB/s), io=28.0MiB (29.4MB), run=2722-5278msec rand-rw: (groupid=0, jobs=1): err= 0: pid=154416: Wed Oct 22 10:23:30 2025 read: IOPS=1, BW=1516KiB/s (1552kB/s)(7168KiB/4728msec) clat (msec): min=88, max=1085, avg=365.92, stdev=363.49 lat (msec): min=88, max=1085, avg=365.92, stdev=363.49 clat percentiles (msec): | 1.00th=[ 89], 5.00th=[ 89], 10.00th=[ 89], 20.00th=[ 92], | 30.00th=[ 106], 40.00th=[ 106], 50.00th=[ 249], 60.00th=[ 376], | 70.00th=[ 376], 80.00th=[ 567], 90.00th=[ 1083], 95.00th=[ 1083], | 99.00th=[ 1083], 99.50th=[ 1083], 99.90th=[ 1083], 99.95th=[ 1083], | 99.99th=[ 1083] bw ( KiB/s): min= 1729, max= 4079, per=62.96%, avg=2353.00, stdev=973.50, samples=5 iops : min= 1, max= 3, avg= 1.60, stdev= 0.89, samples=5 write: IOPS=1, BW=1083KiB/s (1109kB/s)(5120KiB/4728msec); 0 zone resets clat (msec): min=144, max=687, avg=401.29, stdev=225.08 lat (msec): min=144, max=687, avg=401.40, stdev=225.07 clat percentiles (msec): | 1.00th=[ 144], 5.00th=[ 144], 10.00th=[ 144], 20.00th=[ 144], | 30.00th=[ 222], 40.00th=[ 222], 50.00th=[ 405], 60.00th=[ 405], | 70.00th=[ 550], 80.00th=[ 550], 90.00th=[ 684], 95.00th=[ 684], | 99.00th=[ 684], 99.50th=[ 684], 99.90th=[ 684], 99.95th=[ 684], | 99.99th=[ 684] bw ( KiB/s): min= 1878, max= 4096, per=47.43%, avg=2481.75, stdev=1078.54, samples=4 iops : min= 1, max= 4, avg= 1.75, stdev= 1.50, samples=4 lat (msec) : 100=16.67%, 250=33.33%, 500=16.67%, 750=25.00%, 2000=8.33% cpu : usr=0.02%, sys=16.88%, ctx=199, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=154417: Wed Oct 22 10:23:30 2025 read: IOPS=0, BW=374KiB/s (383kB/s)(2048KiB/5480msec) clat (msec): min=128, max=2077, avg=1102.65, stdev=1378.09 lat (msec): min=128, max=2077, avg=1102.65, stdev=1378.09 clat percentiles (msec): | 1.00th=[ 129], 5.00th=[ 129], 10.00th=[ 129], 20.00th=[ 129], | 30.00th=[ 129], 40.00th=[ 129], 50.00th=[ 129], 60.00th=[ 2072], | 70.00th=[ 2072], 80.00th=[ 2072], 90.00th=[ 2072], 95.00th=[ 2072], | 99.00th=[ 2072], 99.50th=[ 2072], 99.90th=[ 2072], 99.95th=[ 2072], | 99.99th=[ 2072] bw ( KiB/s): min= 1910, max= 2048, per=52.96%, avg=1979.00, stdev=97.58, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 write: IOPS=1, BW=1869KiB/s (1913kB/s)(10.0MiB/5480msec); 0 zone resets clat (msec): min=51, max=676, avg=313.91, stdev=241.20 lat (msec): min=51, max=676, avg=314.00, stdev=241.20 clat percentiles (msec): | 1.00th=[ 52], 5.00th=[ 52], 10.00th=[ 52], 20.00th=[ 54], | 30.00th=[ 73], 40.00th=[ 116], 50.00th=[ 249], 60.00th=[ 368], | 70.00th=[ 397], 80.00th=[ 535], 90.00th=[ 625], 95.00th=[ 676], | 99.00th=[ 676], 99.50th=[ 676], 99.90th=[ 676], 99.95th=[ 676], | 99.99th=[ 676] bw ( KiB/s): min= 1878, max= 4087, per=47.99%, avg=2511.00, stdev=1053.44, samples=4 iops : min= 1, max= 3, avg= 1.75, stdev= 0.96, samples=4 lat (msec) : 100=25.00%, 250=25.00%, 500=16.67%, 750=25.00%, >=2000=8.33% cpu : usr=0.02%, sys=14.44%, ctx=159, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=154418: Wed Oct 22 10:23:30 2025 read: IOPS=1, BW=1160KiB/s (1188kB/s)(6144KiB/5296msec) clat (msec): min=43, max=644, avg=306.99, stdev=247.36 lat (msec): min=43, max=644, avg=307.00, stdev=247.36 clat percentiles (msec): | 1.00th=[ 44], 5.00th=[ 44], 10.00th=[ 44], 20.00th=[ 132], | 30.00th=[ 132], 40.00th=[ 203], 50.00th=[ 203], 60.00th=[ 236], | 70.00th=[ 584], 80.00th=[ 584], 90.00th=[ 642], 95.00th=[ 642], | 99.00th=[ 642], 99.50th=[ 642], 99.90th=[ 642], 99.95th=[ 642], | 99.99th=[ 642] bw ( KiB/s): min= 1878, max= 4096, per=71.51%, avg=2672.33, stdev=1235.69, samples=3 iops : min= 1, max= 4, avg= 2.00, stdev= 1.73, samples=3 write: IOPS=1, BW=1160KiB/s (1188kB/s)(6144KiB/5296msec); 0 zone resets clat (msec): min=67, max=2103, avg=550.49, stdev=776.00 lat (msec): min=67, max=2103, avg=550.58, stdev=776.01 clat percentiles (msec): | 1.00th=[ 68], 5.00th=[ 68], 10.00th=[ 68], 20.00th=[ 174], | 30.00th=[ 174], 40.00th=[ 180], 50.00th=[ 180], 60.00th=[ 266], | 70.00th=[ 518], 80.00th=[ 518], 90.00th=[ 2106], 95.00th=[ 2106], | 99.00th=[ 2106], 99.50th=[ 2106], 99.90th=[ 2106], 99.95th=[ 2106], | 99.99th=[ 2106] bw ( KiB/s): min= 2031, max= 3820, per=47.51%, avg=2485.50, stdev=889.70, samples=4 iops : min= 1, max= 3, avg= 1.75, stdev= 0.96, samples=4 lat (msec) : 50=8.33%, 100=8.33%, 250=41.67%, 500=8.33%, 750=25.00% lat (msec) : >=2000=8.33% cpu : usr=0.00%, sys=12.41%, ctx=150, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=154419: Wed Oct 22 10:23:30 2025 read: IOPS=0, BW=942KiB/s (965kB/s)(5120KiB/5434msec) clat (msec): min=44, max=640, avg=300.54, stdev=242.27 lat (msec): min=44, max=640, avg=300.54, stdev=242.27 clat percentiles (msec): | 1.00th=[ 45], 5.00th=[ 45], 10.00th=[ 45], 20.00th=[ 45], | 30.00th=[ 88], 40.00th=[ 88], 50.00th=[ 359], 60.00th=[ 359], | 70.00th=[ 372], 80.00th=[ 372], 90.00th=[ 642], 95.00th=[ 642], | 99.00th=[ 642], 99.50th=[ 642], 99.90th=[ 642], 99.95th=[ 642], | 99.99th=[ 642] bw ( KiB/s): min= 2043, max= 4096, per=73.03%, avg=2729.00, stdev=1183.86, samples=3 iops : min= 1, max= 4, avg= 2.33, stdev= 1.53, samples=3 write: IOPS=1, BW=1319KiB/s (1351kB/s)(7168KiB/5434msec); 0 zone resets clat (msec): min=76, max=2175, avg=538.65, stdev=752.37 lat (msec): min=76, max=2175, avg=538.74, stdev=752.38 clat percentiles (msec): | 1.00th=[ 77], 5.00th=[ 77], 10.00th=[ 77], 20.00th=[ 92], | 30.00th=[ 186], 40.00th=[ 186], 50.00th=[ 197], 60.00th=[ 347], | 70.00th=[ 347], 80.00th=[ 701], 90.00th=[ 2165], 95.00th=[ 2165], | 99.00th=[ 2165], 99.50th=[ 2165], 99.90th=[ 2165], 99.95th=[ 2165], | 99.99th=[ 2165] bw ( KiB/s): min= 3757, max= 3820, per=72.41%, avg=3788.50, stdev=44.55, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 lat (msec) : 50=8.33%, 100=25.00%, 250=16.67%, 500=25.00%, 750=16.67% lat (msec) : >=2000=8.33% cpu : usr=0.00%, sys=11.52%, ctx=113, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3737KiB/s (3827kB/s), 374KiB/s-1516KiB/s (383kB/s-1552kB/s), io=20.0MiB (20.0MB), run=4728-5480msec WRITE: bw=5232KiB/s (5358kB/s), 1083KiB/s-1869KiB/s (1109kB/s-1913kB/s), io=28.0MiB (29.4MB), run=4728-5480msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=154426: Wed Oct 22 10:23:41 2025 read: IOPS=1, BW=5067KiB/s (5189kB/s)(12.0MiB/2425msec) clat (msec): min=121, max=1676, avg=805.44, stdev=793.95 lat (msec): min=121, max=1676, avg=805.44, stdev=793.95 clat percentiles (msec): | 1.00th=[ 122], 5.00th=[ 122], 10.00th=[ 122], 20.00th=[ 122], | 30.00th=[ 122], 40.00th=[ 617], 50.00th=[ 617], 60.00th=[ 617], | 70.00th=[ 1670], 80.00th=[ 1670], 90.00th=[ 1670], 95.00th=[ 1670], | 99.00th=[ 1670], 99.50th=[ 1670], 99.90th=[ 1670], 99.95th=[ 1670], | 99.99th=[ 1670] bw ( KiB/s): min= 5610, max= 8126, per=100.00%, avg=6868.00, stdev=1779.08, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 250=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.00%, sys=13.82%, ctx=77, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=154427: Wed Oct 22 10:23:41 2025 read: IOPS=0, BW=1324KiB/s (1356kB/s)(4096KiB/3093msec) clat (nsec): min=675884k, max=675884k, avg=675884130.00, stdev= 0.00 lat (nsec): min=675888k, max=675888k, avg=675887612.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 676], 5.00th=[ 676], 10.00th=[ 676], 20.00th=[ 676], | 30.00th=[ 676], 40.00th=[ 676], 50.00th=[ 676], 60.00th=[ 676], | 70.00th=[ 676], 80.00th=[ 676], 90.00th=[ 676], 95.00th=[ 676], | 99.00th=[ 676], 99.50th=[ 676], 99.90th=[ 676], 99.95th=[ 676], | 99.99th=[ 676] bw ( KiB/s): min= 8126, max= 8126, per=100.00%, avg=8126.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2649KiB/s (2712kB/s)(8192KiB/3093msec); 0 zone resets clat (msec): min=560, max=1841, avg=1201.11, stdev=905.87 lat (msec): min=561, max=1842, avg=1201.54, stdev=905.85 clat percentiles (msec): | 1.00th=[ 558], 5.00th=[ 558], 10.00th=[ 558], 20.00th=[ 558], | 30.00th=[ 558], 40.00th=[ 558], 50.00th=[ 558], 60.00th=[ 1838], | 70.00th=[ 1838], 80.00th=[ 1838], 90.00th=[ 1838], 95.00th=[ 1838], | 99.00th=[ 1838], 99.50th=[ 1838], 99.90th=[ 1838], 99.95th=[ 1838], | 99.99th=[ 1838] bw ( KiB/s): min= 8192, max= 8192, per=77.33%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 750=66.67%, 2000=33.33% cpu : usr=0.06%, sys=16.36%, ctx=129, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=154428: Wed Oct 22 10:23:41 2025 write: IOPS=0, BW=4065KiB/s (4162kB/s)(12.0MiB/3023msec); 0 zone resets clat (msec): min=219, max=1684, avg=1002.55, stdev=737.62 lat (msec): min=219, max=1684, avg=1002.91, stdev=737.65 clat percentiles (msec): | 1.00th=[ 220], 5.00th=[ 220], 10.00th=[ 220], 20.00th=[ 220], | 30.00th=[ 220], 40.00th=[ 1099], 50.00th=[ 1099], 60.00th=[ 1099], | 70.00th=[ 1687], 80.00th=[ 1687], 90.00th=[ 1687], 95.00th=[ 1687], | 99.00th=[ 1687], 99.50th=[ 1687], 99.90th=[ 1687], 99.95th=[ 1687], | 99.99th=[ 1687] bw ( KiB/s): min= 8192, max= 8192, per=77.33%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 2000=66.67% cpu : usr=0.03%, sys=18.53%, ctx=234, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=154429: Wed Oct 22 10:23:41 2025 write: IOPS=1, BW=6126KiB/s (6273kB/s)(12.0MiB/2006msec); 0 zone resets clat (msec): min=316, max=910, avg=660.40, stdev=308.10 lat (msec): min=316, max=911, avg=660.78, stdev=308.14 clat percentiles (msec): | 1.00th=[ 317], 5.00th=[ 317], 10.00th=[ 317], 20.00th=[ 317], | 30.00th=[ 317], 40.00th=[ 751], 50.00th=[ 751], 60.00th=[ 751], | 70.00th=[ 911], 80.00th=[ 911], 90.00th=[ 911], 95.00th=[ 911], | 99.00th=[ 911], 99.50th=[ 911], 99.90th=[ 911], 99.95th=[ 911], | 99.99th=[ 911] bw ( KiB/s): min= 8126, max= 8126, per=76.70%, avg=8126.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 1000=66.67% cpu : usr=0.00%, sys=28.93%, ctx=324, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5297KiB/s (5424kB/s), 1324KiB/s-5067KiB/s (1356kB/s-5189kB/s), io=16.0MiB (16.8MB), run=2425-3093msec WRITE: bw=10.3MiB/s (10.8MB/s), 2649KiB/s-6126KiB/s (2712kB/s-6273kB/s), io=32.0MiB (33.6MB), run=2006-3093msec rand-rw: (groupid=0, jobs=1): err= 0: pid=154430: Wed Oct 22 10:23:41 2025 read: IOPS=1, BW=5440KiB/s (5570kB/s)(12.0MiB/2259msec) clat (msec): min=559, max=896, avg=749.01, stdev=172.39 lat (msec): min=559, max=896, avg=749.01, stdev=172.39 clat percentiles (msec): | 1.00th=[ 558], 5.00th=[ 558], 10.00th=[ 558], 20.00th=[ 558], | 30.00th=[ 558], 40.00th=[ 793], 50.00th=[ 793], 60.00th=[ 793], | 70.00th=[ 894], 80.00th=[ 894], 90.00th=[ 894], 95.00th=[ 894], | 99.00th=[ 894], 99.50th=[ 894], 99.90th=[ 894], 99.95th=[ 894], | 99.99th=[ 894] bw ( KiB/s): min= 6168, max= 8192, per=100.00%, avg=7180.00, stdev=1431.18, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 750=33.33%, 1000=66.67% cpu : usr=0.00%, sys=57.26%, ctx=2620, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=154431: Wed Oct 22 10:23:41 2025 read: IOPS=0, BW=1380KiB/s (1413kB/s)(4096KiB/2968msec) clat (nsec): min=510937k, max=510937k, avg=510937359.00, stdev= 0.00 lat (nsec): min=510938k, max=510938k, avg=510938379.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 510], 5.00th=[ 510], 10.00th=[ 510], 20.00th=[ 510], | 30.00th=[ 510], 40.00th=[ 510], 50.00th=[ 510], 60.00th=[ 510], | 70.00th=[ 510], 80.00th=[ 510], 90.00th=[ 510], 95.00th=[ 510], | 99.00th=[ 510], 99.50th=[ 510], 99.90th=[ 510], 99.95th=[ 510], | 99.99th=[ 510] bw ( KiB/s): min= 6234, max= 6234, per=100.00%, avg=6234.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2760KiB/s (2826kB/s)(8192KiB/2968msec); 0 zone resets clat (msec): min=1188, max=1214, avg=1201.31, stdev=18.73 lat (msec): min=1188, max=1214, avg=1201.69, stdev=18.67 clat percentiles (msec): | 1.00th=[ 1183], 5.00th=[ 1183], 10.00th=[ 1183], 20.00th=[ 1183], | 30.00th=[ 1183], 40.00th=[ 1183], 50.00th=[ 1183], 60.00th=[ 1217], | 70.00th=[ 1217], 80.00th=[ 1217], 90.00th=[ 1217], 95.00th=[ 1217], | 99.00th=[ 1217], 99.50th=[ 1217], 99.90th=[ 1217], 99.95th=[ 1217], | 99.99th=[ 1217] bw ( KiB/s): min= 8031, max= 8031, per=72.74%, avg=8031.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, 2000=66.67% cpu : usr=0.00%, sys=19.82%, ctx=1067, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=154432: Wed Oct 22 10:23:41 2025 write: IOPS=1, BW=4483KiB/s (4591kB/s)(12.0MiB/2741msec); 0 zone resets clat (msec): min=539, max=1146, avg=906.84, stdev=323.34 lat (msec): min=539, max=1147, avg=907.24, stdev=323.39 clat percentiles (msec): | 1.00th=[ 542], 5.00th=[ 542], 10.00th=[ 542], 20.00th=[ 542], | 30.00th=[ 542], 40.00th=[ 1036], 50.00th=[ 1036], 60.00th=[ 1036], | 70.00th=[ 1150], 80.00th=[ 1150], 90.00th=[ 1150], 95.00th=[ 1150], | 99.00th=[ 1150], 99.50th=[ 1150], 99.90th=[ 1150], 99.95th=[ 1150], | 99.99th=[ 1150] bw ( KiB/s): min= 8192, max= 8192, per=74.20%, avg=8192.00, stdev= 0.00, samples=2 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 2000=66.67% cpu : usr=0.07%, sys=16.90%, ctx=125, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=154433: Wed Oct 22 10:23:41 2025 write: IOPS=1, BW=4539KiB/s (4648kB/s)(12.0MiB/2707msec); 0 zone resets clat (msec): min=256, max=1352, avg=891.60, stdev=568.23 lat (msec): min=257, max=1352, avg=891.96, stdev=568.15 clat percentiles (msec): | 1.00th=[ 257], 5.00th=[ 257], 10.00th=[ 257], 20.00th=[ 257], | 30.00th=[ 257], 40.00th=[ 1070], 50.00th=[ 1070], 60.00th=[ 1070], | 70.00th=[ 1351], 80.00th=[ 1351], 90.00th=[ 1351], 95.00th=[ 1351], | 99.00th=[ 1351], 99.50th=[ 1351], 99.90th=[ 1351], 99.95th=[ 1351], | 99.99th=[ 1351] bw ( KiB/s): min= 8192, max= 8192, per=74.20%, avg=8192.00, stdev= 0.00, samples=2 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.00%, sys=18.14%, ctx=131, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5520KiB/s (5653kB/s), 1380KiB/s-5440KiB/s (1413kB/s-5570kB/s), io=16.0MiB (16.8MB), run=2259-2968msec WRITE: bw=10.8MiB/s (11.3MB/s), 2760KiB/s-4539KiB/s (2826kB/s-4648kB/s), io=32.0MiB (33.6MB), run=2707-2968msec