== sanity test 398b: DIO and buffer IO race ============== 01:51:31 (1783144291) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 2.95137 s, 17.1 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=147238: Sat Jul 4 01:52:40 2026 read: IOPS=25, BW=101KiB/s (103kB/s)(5992KiB/59483msec) clat (usec): min=35, max=190000, avg=18807.70, stdev=13140.31 lat (usec): min=36, max=190002, avg=18809.00, stdev=13140.30 clat percentiles (usec): | 1.00th=[ 52], 5.00th=[ 93], 10.00th=[ 6128], 20.00th=[ 9896], | 30.00th=[ 12125], 40.00th=[ 13960], 50.00th=[ 16909], 60.00th=[ 20055], | 70.00th=[ 22938], 80.00th=[ 26870], 90.00th=[ 34341], 95.00th=[ 39584], | 99.00th=[ 63177], 99.50th=[ 77071], 99.90th=[102237], 99.95th=[189793], | 99.99th=[189793] bw ( KiB/s): min= 16, max= 191, per=24.79%, avg=99.92, stdev=29.97, samples=118 iops : min= 4, max= 47, avg=24.50, stdev= 7.49, samples=118 write: IOPS=26, BW=106KiB/s (108kB/s)(6296KiB/59483msec); 0 zone resets clat (usec): min=927, max=668999, avg=19752.75, stdev=23802.28 lat (usec): min=928, max=669000, avg=19754.07, stdev=23802.24 clat percentiles (usec): | 1.00th=[ 1221], 5.00th=[ 1762], 10.00th=[ 2442], 20.00th=[ 3654], | 30.00th=[ 6390], 40.00th=[ 11600], 50.00th=[ 15926], 60.00th=[ 20579], | 70.00th=[ 25297], 80.00th=[ 32375], 90.00th=[ 41681], 95.00th=[ 49546], | 99.00th=[ 72877], 99.50th=[102237], 99.90th=[193987], 99.95th=[666895], | 99.99th=[666895] bw ( KiB/s): min= 31, max= 183, per=25.06%, avg=105.75, stdev=29.27, samples=117 iops : min= 7, max= 45, avg=25.97, stdev= 7.32, samples=117 lat (usec) : 50=0.39%, 100=2.25%, 250=1.50%, 500=0.07%, 750=0.03% lat (usec) : 1000=0.16% lat (msec) : 2=3.32%, 4=7.71%, 10=13.12%, 20=30.96%, 50=37.21% lat (msec) : 100=2.96%, 250=0.29%, 750=0.03% cpu : usr=0.12%, sys=17.52%, ctx=7723, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147239: Sat Jul 4 01:52:40 2026 read: IOPS=25, BW=101KiB/s (103kB/s)(5940KiB/58929msec) clat (usec): min=36, max=232927, avg=19084.90, stdev=13698.93 lat (usec): min=36, max=232928, avg=19087.23, stdev=13699.11 clat percentiles (usec): | 1.00th=[ 52], 5.00th=[ 97], 10.00th=[ 7373], 20.00th=[ 10290], | 30.00th=[ 12125], 40.00th=[ 13960], 50.00th=[ 16450], 60.00th=[ 19268], | 70.00th=[ 23200], 80.00th=[ 28443], 90.00th=[ 33817], 95.00th=[ 40633], | 99.00th=[ 56886], 99.50th=[ 77071], 99.90th=[147850], 99.95th=[233833], | 99.99th=[233833] bw ( KiB/s): min= 7, max= 191, per=24.88%, avg=100.26, stdev=30.61, samples=117 iops : min= 1, max= 47, avg=24.58, stdev= 7.63, samples=117 write: IOPS=26, BW=108KiB/s (110kB/s)(6348KiB/58929msec); 0 zone resets clat (usec): min=780, max=679030, avg=19135.80, stdev=25859.14 lat (usec): min=781, max=679031, avg=19137.45, stdev=25859.33 clat percentiles (usec): | 1.00th=[ 1156], 5.00th=[ 1647], 10.00th=[ 2278], 20.00th=[ 3294], | 30.00th=[ 5080], 40.00th=[ 9765], 50.00th=[ 15139], 60.00th=[ 19530], | 70.00th=[ 24511], 80.00th=[ 30802], 90.00th=[ 40633], 95.00th=[ 49546], | 99.00th=[ 69731], 99.50th=[ 95945], 99.90th=[341836], 99.95th=[675283], | 99.99th=[675283] bw ( KiB/s): min= 22, max= 191, per=25.35%, avg=106.97, stdev=33.99, samples=117 iops : min= 5, max= 47, avg=26.27, stdev= 8.50, samples=117 lat (usec) : 50=0.46%, 100=2.15%, 250=1.24%, 500=0.10%, 750=0.03% lat (usec) : 1000=0.16% lat (msec) : 2=3.94%, 4=9.02%, 10=12.76%, 20=31.74%, 50=34.96% lat (msec) : 100=3.16%, 250=0.20%, 500=0.07%, 750=0.03% cpu : usr=0.12%, sys=17.32%, ctx=7608, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147241: Sat Jul 4 01:52:40 2026 read: IOPS=25, BW=103KiB/s (105kB/s)(6028KiB/58737msec) clat (usec): min=33, max=241230, avg=19132.76, stdev=13763.85 lat (usec): min=33, max=241231, avg=19133.79, stdev=13763.87 clat percentiles (usec): | 1.00th=[ 49], 5.00th=[ 95], 10.00th=[ 6259], 20.00th=[ 10290], | 30.00th=[ 12387], 40.00th=[ 14615], 50.00th=[ 16909], 60.00th=[ 19792], | 70.00th=[ 22938], 80.00th=[ 27657], 90.00th=[ 34866], 95.00th=[ 40633], | 99.00th=[ 57410], 99.50th=[ 68682], 99.90th=[123208], 99.95th=[242222], | 99.99th=[242222] bw ( KiB/s): min= 14, max= 176, per=25.39%, avg=102.30, stdev=30.63, samples=116 iops : min= 3, max= 44, avg=25.09, stdev= 7.68, samples=116 write: IOPS=26, BW=107KiB/s (109kB/s)(6260KiB/58737msec); 0 zone resets clat (usec): min=729, max=738983, avg=18956.29, stdev=25170.92 lat (usec): min=730, max=738983, avg=18958.05, stdev=25170.96 clat percentiles (usec): | 1.00th=[ 1270], 5.00th=[ 1975], 10.00th=[ 2606], 20.00th=[ 3785], | 30.00th=[ 5866], 40.00th=[ 10552], 50.00th=[ 15008], 60.00th=[ 19268], | 70.00th=[ 23987], 80.00th=[ 30540], 90.00th=[ 40109], 95.00th=[ 48497], | 99.00th=[ 68682], 99.50th=[ 80217], 99.90th=[291505], 99.95th=[742392], | 99.99th=[742392] bw ( KiB/s): min= 15, max= 190, per=25.10%, avg=105.93, stdev=33.00, samples=116 iops : min= 3, max= 47, avg=26.01, stdev= 8.25, samples=116 lat (usec) : 50=0.62%, 100=2.08%, 250=1.56%, 500=0.16%, 750=0.20% lat (usec) : 1000=0.03% lat (msec) : 2=2.51%, 4=8.50%, 10=13.31%, 20=32.39%, 50=35.38% lat (msec) : 100=2.96%, 250=0.23%, 500=0.03%, 750=0.03% cpu : usr=0.12%, sys=17.69%, ctx=7718, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147242: Sat Jul 4 01:52:40 2026 read: IOPS=25, BW=102KiB/s (105kB/s)(6052KiB/59090msec) clat (usec): min=32, max=206763, avg=19217.65, stdev=13690.43 lat (usec): min=33, max=206764, avg=19218.77, stdev=13690.65 clat percentiles (usec): | 1.00th=[ 51], 5.00th=[ 101], 10.00th=[ 7046], 20.00th=[ 10290], | 30.00th=[ 12256], 40.00th=[ 14091], 50.00th=[ 16712], 60.00th=[ 19268], | 70.00th=[ 22938], 80.00th=[ 28181], 90.00th=[ 34866], 95.00th=[ 41157], | 99.00th=[ 64750], 99.50th=[ 82314], 99.90th=[102237], 99.95th=[206570], | 99.99th=[206570] bw ( KiB/s): min= 39, max= 183, per=25.66%, avg=103.39, stdev=27.51, samples=115 iops : min= 9, max= 45, avg=25.37, stdev= 6.91, samples=115 write: IOPS=26, BW=106KiB/s (108kB/s)(6236KiB/59090msec); 0 zone resets clat (usec): min=809, max=730831, avg=19105.27, stdev=26058.96 lat (usec): min=810, max=730833, avg=19107.02, stdev=26058.69 clat percentiles (usec): | 1.00th=[ 1139], 5.00th=[ 1713], 10.00th=[ 2343], 20.00th=[ 3294], | 30.00th=[ 5407], 40.00th=[ 10552], 50.00th=[ 15008], 60.00th=[ 19268], | 70.00th=[ 24511], 80.00th=[ 30278], 90.00th=[ 41157], 95.00th=[ 47449], | 99.00th=[ 73925], 99.50th=[ 99091], 99.90th=[337642], 99.95th=[734004], | 99.99th=[734004] bw ( KiB/s): min= 15, max= 183, per=25.09%, avg=105.88, stdev=31.89, samples=116 iops : min= 3, max= 45, avg=25.99, stdev= 7.95, samples=116 lat (usec) : 50=0.49%, 100=1.92%, 250=1.56%, 500=0.20%, 1000=0.16% lat (msec) : 2=3.45%, 4=8.98%, 10=12.27%, 20=33.07%, 50=34.57% lat (msec) : 100=3.03%, 250=0.23%, 500=0.03%, 750=0.03% cpu : usr=0.09%, sys=17.50%, ctx=7679, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=404KiB/s (413kB/s), 101KiB/s-103KiB/s (103kB/s-105kB/s), io=23.4MiB (24.6MB), run=58737-59483msec WRITE: bw=423KiB/s (433kB/s), 106KiB/s-108KiB/s (108kB/s-110kB/s), io=24.6MiB (25.7MB), run=58737-59483msec fio: pid=147240, err=5/file:backend.c:481, func=full resid, error=Input/output error rand-rw: (groupid=0, jobs=1): err= 0: pid=147235: Sat Jul 4 01:53:20 2026 read: IOPS=15, BW=60.3KiB/s (61.7kB/s)(5992KiB/99438msec) clat (msec): min=3, max=773, avg=15.77, stdev=24.22 lat (msec): min=3, max=773, avg=15.77, stdev=24.22 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 5], 10.00th=[ 6], 20.00th=[ 6], | 30.00th=[ 7], 40.00th=[ 8], 50.00th=[ 10], 60.00th=[ 13], | 70.00th=[ 17], 80.00th=[ 22], 90.00th=[ 35], 95.00th=[ 46], | 99.00th=[ 69], 99.50th=[ 87], 99.90th=[ 133], 99.95th=[ 776], | 99.99th=[ 776] bw ( KiB/s): min= 7, max= 200, per=25.64%, avg=60.25, stdev=39.72, samples=197 iops : min= 1, max= 50, avg=14.64, stdev=10.01, samples=197 write: IOPS=15, BW=63.3KiB/s (64.8kB/s)(6296KiB/99438msec); 0 zone resets clat (msec): min=16, max=377, avg=48.02, stdev=28.65 lat (msec): min=16, max=377, avg=48.02, stdev=28.65 clat percentiles (msec): | 1.00th=[ 20], 5.00th=[ 22], 10.00th=[ 24], 20.00th=[ 28], | 30.00th=[ 31], 40.00th=[ 35], 50.00th=[ 39], 60.00th=[ 45], | 70.00th=[ 55], 80.00th=[ 67], 90.00th=[ 85], 95.00th=[ 101], | 99.00th=[ 138], 99.50th=[ 161], 99.90th=[ 355], 99.95th=[ 380], | 99.99th=[ 380] bw ( KiB/s): min= 7, max= 135, per=25.85%, avg=63.60, stdev=31.72, samples=196 iops : min= 1, max= 33, avg=15.47, stdev= 8.05, samples=196 lat (msec) : 4=0.52%, 10=24.22%, 20=14.10%, 50=42.74%, 100=15.85% lat (msec) : 250=2.47%, 500=0.07%, 1000=0.03% cpu : usr=0.09%, sys=5.12%, ctx=5659, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147236: Sat Jul 4 01:53:20 2026 read: IOPS=14, BW=59.6KiB/s (61.0kB/s)(5940KiB/99672msec) clat (msec): min=3, max=697, avg=15.93, stdev=23.52 lat (msec): min=3, max=697, avg=15.94, stdev=23.52 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 5], 10.00th=[ 6], 20.00th=[ 6], | 30.00th=[ 7], 40.00th=[ 8], 50.00th=[ 10], 60.00th=[ 13], | 70.00th=[ 16], 80.00th=[ 22], 90.00th=[ 34], 95.00th=[ 47], | 99.00th=[ 78], 99.50th=[ 100], 99.90th=[ 220], 99.95th=[ 701], | 99.99th=[ 701] bw ( KiB/s): min= 7, max= 184, per=25.59%, avg=60.14, stdev=40.99, samples=195 iops : min= 1, max= 46, avg=14.62, stdev=10.35, samples=195 write: IOPS=15, BW=63.7KiB/s (65.2kB/s)(6348KiB/99672msec); 0 zone resets clat (msec): min=13, max=349, avg=47.75, stdev=28.02 lat (msec): min=13, max=349, avg=47.75, stdev=28.02 clat percentiles (msec): | 1.00th=[ 20], 5.00th=[ 22], 10.00th=[ 24], 20.00th=[ 28], | 30.00th=[ 31], 40.00th=[ 34], 50.00th=[ 39], 60.00th=[ 45], | 70.00th=[ 54], 80.00th=[ 67], 90.00th=[ 84], 95.00th=[ 102], | 99.00th=[ 142], 99.50th=[ 159], 99.90th=[ 245], 99.95th=[ 351], | 99.99th=[ 351] bw ( KiB/s): min= 7, max= 135, per=25.80%, avg=63.47, stdev=32.37, samples=197 iops : min= 1, max= 33, avg=15.44, stdev= 8.21, samples=197 lat (msec) : 4=0.39%, 10=24.51%, 20=13.70%, 50=41.80%, 100=16.73% lat (msec) : 250=2.80%, 500=0.03%, 750=0.03% cpu : usr=0.07%, sys=5.14%, ctx=5698, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147237: Sat Jul 4 01:53:20 2026 read: IOPS=15, BW=60.6KiB/s (62.0kB/s)(6028KiB/99542msec) clat (msec): min=3, max=343, avg=16.42, stdev=19.48 lat (msec): min=3, max=343, avg=16.42, stdev=19.48 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 5], 10.00th=[ 6], 20.00th=[ 7], | 30.00th=[ 7], 40.00th=[ 9], 50.00th=[ 11], 60.00th=[ 14], | 70.00th=[ 17], 80.00th=[ 23], 90.00th=[ 34], 95.00th=[ 48], | 99.00th=[ 78], 99.50th=[ 101], 99.90th=[ 342], 99.95th=[ 342], | 99.99th=[ 342] bw ( KiB/s): min= 7, max= 183, per=26.03%, avg=61.16, stdev=36.61, samples=195 iops : min= 1, max= 45, avg=14.87, stdev= 9.26, samples=195 write: IOPS=15, BW=62.9KiB/s (64.4kB/s)(6260KiB/99542msec); 0 zone resets clat (msec): min=16, max=751, avg=47.65, stdev=31.49 lat (msec): min=16, max=751, avg=47.65, stdev=31.49 clat percentiles (msec): | 1.00th=[ 20], 5.00th=[ 22], 10.00th=[ 24], 20.00th=[ 28], | 30.00th=[ 31], 40.00th=[ 34], 50.00th=[ 39], 60.00th=[ 45], | 70.00th=[ 54], 80.00th=[ 66], 90.00th=[ 84], 95.00th=[ 101], | 99.00th=[ 131], 99.50th=[ 163], 99.90th=[ 243], 99.95th=[ 751], | 99.99th=[ 751] bw ( KiB/s): min= 15, max= 135, per=25.52%, avg=62.78, stdev=32.77, samples=197 iops : min= 3, max= 33, avg=15.27, stdev= 8.31, samples=197 lat (msec) : 4=0.46%, 10=23.14%, 20=14.88%, 50=42.48%, 100=16.15% lat (msec) : 250=2.80%, 500=0.07%, 1000=0.03% cpu : usr=0.08%, sys=5.21%, ctx=5699, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 5 (file:backend.c:481, func=full resid, error=Input/output error): pid=147240: Sat Jul 4 01:53:20 2026 read: IOPS=14, BW=58.9KiB/s (60.3kB/s)(5544KiB/94102msec) clat (msec): min=3, max=156, avg=16.95, stdev=17.21 lat (msec): min=3, max=156, avg=16.95, stdev=17.21 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 5], 10.00th=[ 6], 20.00th=[ 7], | 30.00th=[ 7], 40.00th=[ 9], 50.00th=[ 11], 60.00th=[ 14], | 70.00th=[ 18], 80.00th=[ 26], 90.00th=[ 37], 95.00th=[ 50], | 99.00th=[ 102], 99.50th=[ 109], 99.90th=[ 131], 99.95th=[ 157], | 99.99th=[ 157] bw ( KiB/s): min= 7, max= 175, per=25.52%, avg=59.97, stdev=37.39, samples=183 iops : min= 1, max= 43, avg=14.57, stdev= 9.44, samples=183 write: IOPS=15, BW=60.4KiB/s (61.9kB/s)(5688KiB/94102msec); 0 zone resets clat (msec): min=16, max=723, avg=49.49, stdev=33.59 lat (msec): min=16, max=723, avg=49.49, stdev=33.59 clat percentiles (msec): | 1.00th=[ 20], 5.00th=[ 22], 10.00th=[ 24], 20.00th=[ 28], | 30.00th=[ 32], 40.00th=[ 36], 50.00th=[ 41], 60.00th=[ 47], | 70.00th=[ 57], 80.00th=[ 70], 90.00th=[ 86], 95.00th=[ 102], | 99.00th=[ 134], 99.50th=[ 150], 99.90th=[ 388], 99.95th=[ 726], | 99.99th=[ 726] bw ( KiB/s): min= 15, max= 136, per=24.54%, avg=60.37, stdev=31.70, samples=186 iops : min= 3, max= 34, avg=14.67, stdev= 8.05, samples=186 lat (msec) : 4=0.61%, 10=23.60%, 20=13.49%, 50=41.58%, 100=17.44% lat (msec) : 250=3.13%, 500=0.07%, 750=0.04% cpu : usr=0.08%, sys=5.07%, ctx=5055, majf=0, minf=20 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1387,1422,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=236KiB/s (241kB/s), 58.9KiB/s-60.6KiB/s (60.3kB/s-62.0kB/s), io=22.0MiB (24.1MB), run=94102-99672msec WRITE: bw=247KiB/s (253kB/s), 60.4KiB/s-63.7KiB/s (61.9kB/s-65.2kB/s), io=24.0MiB (25.2MB), run=94102-99672msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=147276: Sat Jul 4 01:53:41 2026 read: IOPS=24, BW=389KiB/s (399kB/s)(5920KiB/15199msec) clat (usec): min=39, max=91096, avg=19222.03, stdev=13522.87 lat (usec): min=40, max=91097, avg=19228.37, stdev=13522.61 clat percentiles (usec): | 1.00th=[ 60], 5.00th=[ 92], 10.00th=[ 127], 20.00th=[ 9896], | 30.00th=[13173], 40.00th=[15139], 50.00th=[17695], 60.00th=[20579], | 70.00th=[24249], 80.00th=[30016], 90.00th=[36439], 95.00th=[43254], | 99.00th=[53740], 99.50th=[66323], 99.90th=[90702], 99.95th=[90702], | 99.99th=[90702] bw ( KiB/s): min= 191, max= 672, per=24.81%, avg=390.83, stdev=124.42, samples=30 iops : min= 11, max= 42, avg=23.80, stdev= 7.85, samples=30 write: IOPS=26, BW=419KiB/s (429kB/s)(6368KiB/15199msec); 0 zone resets clat (usec): min=1697, max=153930, avg=20097.34, stdev=17402.52 lat (usec): min=1698, max=153931, avg=20099.00, stdev=17402.50 clat percentiles (usec): | 1.00th=[ 1909], 5.00th=[ 3392], 10.00th=[ 4146], 20.00th=[ 5342], | 30.00th=[ 8160], 40.00th=[ 12518], 50.00th=[ 15401], 60.00th=[ 19530], | 70.00th=[ 24773], 80.00th=[ 31851], 90.00th=[ 42206], 95.00th=[ 51643], | 99.00th=[ 78119], 99.50th=[100140], 99.90th=[154141], 99.95th=[154141], | 99.99th=[154141] bw ( KiB/s): min= 255, max= 638, per=25.32%, avg=419.80, stdev=109.23, samples=30 iops : min= 15, max= 39, avg=25.63, stdev= 6.88, samples=30 lat (usec) : 50=0.26%, 100=2.99%, 250=4.30%, 500=0.39% lat (msec) : 2=0.52%, 4=3.78%, 10=14.84%, 20=32.03%, 50=36.98% lat (msec) : 100=3.65%, 250=0.26% cpu : usr=0.13%, sys=24.48%, ctx=2328, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147277: Sat Jul 4 01:53:41 2026 read: IOPS=24, BW=386KiB/s (395kB/s)(5744KiB/14893msec) clat (usec): min=55, max=117281, avg=20781.75, stdev=14140.29 lat (usec): min=56, max=117282, avg=20782.69, stdev=14140.40 clat percentiles (usec): | 1.00th=[ 70], 5.00th=[ 103], 10.00th=[ 141], 20.00th=[ 10814], | 30.00th=[ 14746], 40.00th=[ 16712], 50.00th=[ 19792], 60.00th=[ 23200], | 70.00th=[ 26084], 80.00th=[ 30540], 90.00th=[ 36963], 95.00th=[ 45876], | 99.00th=[ 60556], 99.50th=[ 67634], 99.90th=[116917], 99.95th=[116917], | 99.99th=[116917] bw ( KiB/s): min= 192, max= 667, per=24.43%, avg=384.79, stdev=114.39, samples=29 iops : min= 12, max= 41, avg=23.41, stdev= 7.17, samples=29 write: IOPS=27, BW=439KiB/s (450kB/s)(6544KiB/14893msec); 0 zone resets clat (usec): min=1057, max=85243, avg=17983.07, stdev=14277.28 lat (usec): min=1058, max=85245, avg=17984.69, stdev=14277.29 clat percentiles (usec): | 1.00th=[ 1958], 5.00th=[ 3228], 10.00th=[ 4228], 20.00th=[ 5932], | 30.00th=[ 7242], 40.00th=[10290], 50.00th=[14222], 60.00th=[18220], | 70.00th=[22938], 80.00th=[28705], 90.00th=[38011], 95.00th=[43779], | 99.00th=[68682], 99.50th=[70779], 99.90th=[85459], 99.95th=[85459], | 99.99th=[85459] bw ( KiB/s): min= 282, max= 638, per=26.24%, avg=435.10, stdev=98.76, samples=29 iops : min= 17, max= 39, avg=26.55, stdev= 6.16, samples=29 lat (usec) : 100=1.82%, 250=5.08%, 500=0.13% lat (msec) : 2=0.65%, 4=3.91%, 10=17.45%, 20=28.78%, 50=39.32% lat (msec) : 100=2.73%, 250=0.13% cpu : usr=0.08%, sys=25.40%, ctx=2349, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147278: Sat Jul 4 01:53:41 2026 read: IOPS=26, BW=417KiB/s (427kB/s)(6256KiB/15006msec) clat (usec): min=38, max=168383, avg=20519.95, stdev=17392.98 lat (usec): min=38, max=168385, avg=20520.92, stdev=17393.02 clat percentiles (usec): | 1.00th=[ 50], 5.00th=[ 71], 10.00th=[ 113], 20.00th=[ 9372], | 30.00th=[ 13173], 40.00th=[ 16057], 50.00th=[ 18220], 60.00th=[ 21627], | 70.00th=[ 25035], 80.00th=[ 28967], 90.00th=[ 38536], 95.00th=[ 49546], | 99.00th=[ 87557], 99.50th=[105382], 99.90th=[168821], 99.95th=[168821], | 99.99th=[168821] bw ( KiB/s): min= 219, max= 736, per=26.51%, avg=417.48, stdev=131.46, samples=29 iops : min= 13, max= 46, avg=25.45, stdev= 8.33, samples=29 write: IOPS=25, BW=402KiB/s (412kB/s)(6032KiB/15006msec); 0 zone resets clat (usec): min=1210, max=82084, avg=18420.86, stdev=14018.43 lat (usec): min=1211, max=82086, avg=18422.58, stdev=14018.55 clat percentiles (usec): | 1.00th=[ 1958], 5.00th=[ 3163], 10.00th=[ 4146], 20.00th=[ 5538], | 30.00th=[ 8160], 40.00th=[11731], 50.00th=[15664], 60.00th=[20317], | 70.00th=[23200], 80.00th=[28443], 90.00th=[35914], 95.00th=[43779], | 99.00th=[72877], 99.50th=[74974], 99.90th=[82314], 99.95th=[82314], | 99.99th=[82314] bw ( KiB/s): min= 256, max= 606, per=23.95%, avg=397.17, stdev=82.16, samples=29 iops : min= 16, max= 37, avg=24.17, stdev= 5.03, samples=29 lat (usec) : 50=0.52%, 100=3.65%, 250=4.30%, 500=0.26%, 1000=0.13% lat (msec) : 2=0.78%, 4=3.78%, 10=14.84%, 20=30.08%, 50=37.37% lat (msec) : 100=4.04%, 250=0.26% cpu : usr=0.07%, sys=24.59%, ctx=2259, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147279: Sat Jul 4 01:53:41 2026 read: IOPS=25, BW=410KiB/s (420kB/s)(6032KiB/14722msec) clat (usec): min=36, max=95784, avg=19396.81, stdev=15180.52 lat (usec): min=36, max=95785, avg=19398.98, stdev=15180.01 clat percentiles (usec): | 1.00th=[ 57], 5.00th=[ 93], 10.00th=[ 124], 20.00th=[ 7832], | 30.00th=[12649], 40.00th=[15139], 50.00th=[18220], 60.00th=[21365], | 70.00th=[25035], 80.00th=[29492], 90.00th=[35390], 95.00th=[43779], | 99.00th=[89654], 99.50th=[94897], 99.90th=[95945], 99.95th=[95945], | 99.99th=[95945] bw ( KiB/s): min= 183, max= 605, per=26.08%, avg=410.69, stdev=98.19, samples=29 iops : min= 11, max= 37, avg=25.03, stdev= 6.15, samples=29 write: IOPS=26, BW=425KiB/s (435kB/s)(6256KiB/14722msec); 0 zone resets clat (usec): min=1574, max=113360, avg=18714.90, stdev=17232.32 lat (usec): min=1575, max=113361, avg=18716.65, stdev=17232.40 clat percentiles (usec): | 1.00th=[ 1795], 5.00th=[ 3097], 10.00th=[ 3851], 20.00th=[ 4948], | 30.00th=[ 6587], 40.00th=[ 9634], 50.00th=[ 13304], 60.00th=[ 17695], | 70.00th=[ 23462], 80.00th=[ 30278], 90.00th=[ 38536], 95.00th=[ 50070], | 99.00th=[ 92799], 99.50th=[ 98042], 99.90th=[113771], 99.95th=[113771], | 99.99th=[113771] bw ( KiB/s): min= 223, max= 704, per=25.81%, avg=427.86, stdev=111.26, samples=29 iops : min= 13, max= 44, avg=26.10, stdev= 7.02, samples=29 lat (usec) : 50=0.26%, 100=2.86%, 250=5.08%, 500=0.39%, 750=0.13% lat (msec) : 2=0.91%, 4=5.21%, 10=17.84%, 20=27.99%, 50=35.03% lat (msec) : 100=4.17%, 250=0.13% cpu : usr=0.11%, sys=24.53%, ctx=2164, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1576KiB/s (1614kB/s), 386KiB/s-417KiB/s (395kB/s-427kB/s), io=23.4MiB (24.5MB), run=14722-15199msec WRITE: bw=1658KiB/s (1698kB/s), 402KiB/s-439KiB/s (412kB/s-450kB/s), io=24.6MiB (25.8MB), run=14722-15199msec rand-rw: (groupid=0, jobs=1): err= 0: pid=147271: Sat Jul 4 01:53:51 2026 read: IOPS=14, BW=239KiB/s (245kB/s)(5920KiB/24734msec) clat (msec): min=4, max=111, avg=17.35, stdev=16.69 lat (msec): min=4, max=111, avg=17.35, stdev=16.69 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 6], 10.00th=[ 6], 20.00th=[ 7], | 30.00th=[ 8], 40.00th=[ 9], 50.00th=[ 11], 60.00th=[ 14], | 70.00th=[ 19], 80.00th=[ 26], 90.00th=[ 39], 95.00th=[ 52], | 99.00th=[ 89], 99.50th=[ 100], 99.90th=[ 111], 99.95th=[ 111], | 99.99th=[ 111] bw ( KiB/s): min= 63, max= 608, per=24.63%, avg=238.41, stdev=132.53, samples=49 iops : min= 3, max= 38, avg=14.43, stdev= 8.43, samples=49 write: IOPS=16, BW=257KiB/s (264kB/s)(6368KiB/24734msec); 0 zone resets clat (msec): min=17, max=225, avg=45.87, stdev=25.75 lat (msec): min=17, max=225, avg=45.87, stdev=25.75 clat percentiles (msec): | 1.00th=[ 20], 5.00th=[ 22], 10.00th=[ 25], 20.00th=[ 28], | 30.00th=[ 31], 40.00th=[ 34], 50.00th=[ 39], 60.00th=[ 43], | 70.00th=[ 51], 80.00th=[ 61], 90.00th=[ 79], 95.00th=[ 93], | 99.00th=[ 155], 99.50th=[ 171], 99.90th=[ 226], 99.95th=[ 226], | 99.99th=[ 226] bw ( KiB/s): min= 63, max= 512, per=25.26%, avg=257.12, stdev=126.56, samples=49 iops : min= 3, max= 32, avg=15.59, stdev= 8.18, samples=49 lat (msec) : 10=23.83%, 20=12.76%, 50=44.92%, 100=16.67%, 250=1.82% cpu : usr=0.08%, sys=7.73%, ctx=1623, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147272: Sat Jul 4 01:53:51 2026 read: IOPS=14, BW=238KiB/s (243kB/s)(5744KiB/24178msec) clat (msec): min=4, max=144, avg=17.94, stdev=18.80 lat (msec): min=4, max=144, avg=17.94, stdev=18.80 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 6], 10.00th=[ 6], 20.00th=[ 7], | 30.00th=[ 8], 40.00th=[ 9], 50.00th=[ 11], 60.00th=[ 13], | 70.00th=[ 18], 80.00th=[ 24], 90.00th=[ 43], 95.00th=[ 60], | 99.00th=[ 92], 99.50th=[ 103], 99.90th=[ 144], 99.95th=[ 144], | 99.99th=[ 144] bw ( KiB/s): min= 53, max= 574, per=24.53%, avg=237.40, stdev=137.64, samples=47 iops : min= 3, max= 35, avg=14.34, stdev= 8.78, samples=47 write: IOPS=16, BW=271KiB/s (277kB/s)(6544KiB/24178msec); 0 zone resets clat (msec): min=15, max=155, avg=43.24, stdev=20.66 lat (msec): min=15, max=155, avg=43.25, stdev=20.66 clat percentiles (msec): | 1.00th=[ 20], 5.00th=[ 23], 10.00th=[ 24], 20.00th=[ 28], | 30.00th=[ 31], 40.00th=[ 34], 50.00th=[ 37], 60.00th=[ 43], | 70.00th=[ 50], 80.00th=[ 58], 90.00th=[ 69], 95.00th=[ 82], | 99.00th=[ 122], 99.50th=[ 127], 99.90th=[ 157], 99.95th=[ 157], | 99.99th=[ 157] bw ( KiB/s): min= 127, max= 544, per=26.25%, avg=267.23, stdev=121.97, samples=47 iops : min= 7, max= 34, avg=16.19, stdev= 7.86, samples=47 lat (msec) : 10=22.92%, 20=13.41%, 50=45.05%, 100=17.06%, 250=1.56% cpu : usr=0.06%, sys=7.91%, ctx=1598, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147273: Sat Jul 4 01:53:51 2026 read: IOPS=16, BW=260KiB/s (266kB/s)(6256KiB/24049msec) clat (msec): min=4, max=127, avg=17.68, stdev=16.94 lat (msec): min=4, max=127, avg=17.68, stdev=16.94 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 6], 10.00th=[ 7], 20.00th=[ 7], | 30.00th=[ 8], 40.00th=[ 9], 50.00th=[ 11], 60.00th=[ 14], | 70.00th=[ 19], 80.00th=[ 26], 90.00th=[ 41], 95.00th=[ 51], | 99.00th=[ 87], 99.50th=[ 102], 99.90th=[ 128], 99.95th=[ 128], | 99.99th=[ 128] bw ( KiB/s): min= 63, max= 768, per=26.92%, avg=260.57, stdev=166.33, samples=47 iops : min= 3, max= 48, avg=15.79, stdev=10.55, samples=47 write: IOPS=15, BW=251KiB/s (257kB/s)(6032KiB/24049msec); 0 zone resets clat (msec): min=18, max=220, avg=45.27, stdev=25.17 lat (msec): min=18, max=220, avg=45.27, stdev=25.17 clat percentiles (msec): | 1.00th=[ 20], 5.00th=[ 22], 10.00th=[ 24], 20.00th=[ 27], | 30.00th=[ 31], 40.00th=[ 33], 50.00th=[ 38], 60.00th=[ 44], | 70.00th=[ 51], 80.00th=[ 61], 90.00th=[ 77], 95.00th=[ 91], | 99.00th=[ 146], 99.50th=[ 174], 99.90th=[ 222], 99.95th=[ 222], | 99.99th=[ 222] bw ( KiB/s): min= 63, max= 512, per=24.32%, avg=247.60, stdev=122.23, samples=47 iops : min= 3, max= 32, avg=14.98, stdev= 7.85, samples=47 lat (msec) : 10=23.96%, 20=13.41%, 50=44.66%, 100=15.89%, 250=2.08% cpu : usr=0.07%, sys=7.92%, ctx=1664, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147274: Sat Jul 4 01:53:51 2026 read: IOPS=15, BW=248KiB/s (254kB/s)(6032KiB/24321msec) clat (msec): min=4, max=137, avg=17.45, stdev=17.98 lat (msec): min=4, max=137, avg=17.45, stdev=17.98 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 6], 10.00th=[ 6], 20.00th=[ 7], | 30.00th=[ 8], 40.00th=[ 9], 50.00th=[ 11], 60.00th=[ 13], | 70.00th=[ 17], 80.00th=[ 23], 90.00th=[ 42], 95.00th=[ 55], | 99.00th=[ 95], 99.50th=[ 109], 99.90th=[ 138], 99.95th=[ 138], | 99.99th=[ 138] bw ( KiB/s): min= 63, max= 768, per=25.40%, avg=245.87, stdev=139.53, samples=48 iops : min= 3, max= 48, avg=14.88, stdev= 8.93, samples=48 write: IOPS=16, BW=257KiB/s (263kB/s)(6256KiB/24321msec); 0 zone resets clat (msec): min=16, max=156, avg=45.30, stdev=22.95 lat (msec): min=16, max=156, avg=45.31, stdev=22.95 clat percentiles (msec): | 1.00th=[ 20], 5.00th=[ 23], 10.00th=[ 24], 20.00th=[ 27], | 30.00th=[ 30], 40.00th=[ 34], 50.00th=[ 39], 60.00th=[ 45], | 70.00th=[ 52], 80.00th=[ 62], 90.00th=[ 78], 95.00th=[ 91], | 99.00th=[ 131], 99.50th=[ 144], 99.90th=[ 157], 99.95th=[ 157], | 99.99th=[ 157] bw ( KiB/s): min= 63, max= 480, per=25.19%, avg=256.42, stdev=126.42, samples=48 iops : min= 3, max= 30, avg=15.54, stdev= 8.12, samples=48 lat (msec) : 10=23.83%, 20=14.06%, 50=42.32%, 100=18.23%, 250=1.56% cpu : usr=0.11%, sys=7.74%, ctx=1573, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=968KiB/s (992kB/s), 238KiB/s-260KiB/s (243kB/s-266kB/s), io=23.4MiB (24.5MB), run=24049-24734msec WRITE: bw=1019KiB/s (1043kB/s), 251KiB/s-271KiB/s (257kB/s-277kB/s), io=24.6MiB (25.8MB), run=24049-24734msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=147288: Sat Jul 4 01:54:00 2026 read: IOPS=2, BW=2122KiB/s (2173kB/s)(7168KiB/3378msec) clat (msec): min=134, max=218, avg=172.72, stdev=34.12 lat (msec): min=134, max=218, avg=172.72, stdev=34.12 clat percentiles (msec): | 1.00th=[ 136], 5.00th=[ 136], 10.00th=[ 136], 20.00th=[ 142], | 30.00th=[ 148], 40.00th=[ 148], 50.00th=[ 174], 60.00th=[ 180], | 70.00th=[ 180], 80.00th=[ 215], 90.00th=[ 220], 95.00th=[ 220], | 99.00th=[ 220], 99.50th=[ 220], 99.90th=[ 220], 99.95th=[ 220], | 99.99th=[ 220] bw ( KiB/s): min= 1996, max= 5197, per=49.12%, avg=2819.00, stdev=1585.49, samples=4 iops : min= 1, max= 5, avg= 2.25, stdev= 1.89, samples=4 write: IOPS=1, BW=1516KiB/s (1552kB/s)(5120KiB/3378msec); 0 zone resets clat (msec): min=131, max=1165, avg=425.58, stdev=430.96 lat (msec): min=131, max=1165, avg=425.63, stdev=430.96 clat percentiles (msec): | 1.00th=[ 131], 5.00th=[ 131], 10.00th=[ 131], 20.00th=[ 131], | 30.00th=[ 171], 40.00th=[ 171], 50.00th=[ 218], 60.00th=[ 218], | 70.00th=[ 443], 80.00th=[ 443], 90.00th=[ 1167], 95.00th=[ 1167], | 99.00th=[ 1167], 99.50th=[ 1167], 99.90th=[ 1167], 99.95th=[ 1167], | 99.99th=[ 1167] bw ( KiB/s): min= 1996, max= 4071, per=33.67%, avg=2705.00, stdev=1183.28, samples=3 iops : min= 1, max= 3, avg= 2.00, stdev= 1.00, samples=3 lat (msec) : 250=83.33%, 500=8.33%, 2000=8.33% cpu : usr=0.00%, sys=34.71%, ctx=751, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147289: Sat Jul 4 01:54:00 2026 read: IOPS=0, BW=647KiB/s (662kB/s)(2048KiB/3167msec) clat (usec): min=1032, max=186541, avg=93787.33, stdev=131174.75 lat (usec): min=1033, max=186543, avg=93788.91, stdev=131175.41 clat percentiles (usec): | 1.00th=[ 1037], 5.00th=[ 1037], 10.00th=[ 1037], 20.00th=[ 1037], | 30.00th=[ 1037], 40.00th=[ 1037], 50.00th=[ 1037], 60.00th=[185598], | 70.00th=[185598], 80.00th=[185598], 90.00th=[185598], 95.00th=[185598], | 99.00th=[185598], 99.50th=[185598], 99.90th=[185598], 99.95th=[185598], | 99.99th=[185598] bw ( KiB/s): min= 1762, max= 1996, per=32.74%, avg=1879.00, stdev=165.46, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=3, BW=3233KiB/s (3311kB/s)(10.0MiB/3167msec); 0 zone resets clat (msec): min=85, max=1046, avg=293.66, stdev=291.58 lat (msec): min=85, max=1046, avg=293.72, stdev=291.59 clat percentiles (msec): | 1.00th=[ 86], 5.00th=[ 86], 10.00th=[ 86], 20.00th=[ 122], | 30.00th=[ 126], 40.00th=[ 130], 50.00th=[ 153], 60.00th=[ 211], | 70.00th=[ 215], 80.00th=[ 405], 90.00th=[ 451], 95.00th=[ 1045], | 99.00th=[ 1045], 99.50th=[ 1045], 99.90th=[ 1045], 99.95th=[ 1045], | 99.99th=[ 1045] bw ( KiB/s): min= 1996, max= 8192, per=57.07%, avg=4585.75, stdev=3080.38, samples=4 iops : min= 1, max= 8, avg= 4.00, stdev= 3.16, samples=4 lat (msec) : 2=8.33%, 100=8.33%, 250=58.33%, 500=16.67%, 2000=8.33% cpu : usr=0.00%, sys=37.18%, ctx=173, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147290: Sat Jul 4 01:54:00 2026 read: IOPS=1, BW=1722KiB/s (1763kB/s)(6144KiB/3568msec) clat (usec): min=471, max=1787.1k, avg=366812.28, stdev=703290.36 lat (usec): min=473, max=1787.1k, avg=366813.42, stdev=703290.39 clat percentiles (usec): | 1.00th=[ 474], 5.00th=[ 474], 10.00th=[ 474], | 20.00th=[ 506], 30.00th=[ 506], 40.00th=[ 553], | 50.00th=[ 553], 60.00th=[ 177210], 70.00th=[ 233833], | 80.00th=[ 233833], 90.00th=[1786774], 95.00th=[1786774], | 99.00th=[1786774], 99.50th=[1786774], 99.90th=[1786774], | 99.95th=[1786774], 99.99th=[1786774] bw ( KiB/s): min= 2048, max= 3992, per=52.62%, avg=3020.00, stdev=1374.62, samples=2 iops : min= 2, max= 3, avg= 2.50, stdev= 0.71, samples=2 write: IOPS=1, BW=1722KiB/s (1763kB/s)(6144KiB/3568msec); 0 zone resets clat (msec): min=123, max=516, avg=224.96, stdev=149.19 lat (msec): min=123, max=516, avg=225.01, stdev=149.19 clat percentiles (msec): | 1.00th=[ 124], 5.00th=[ 124], 10.00th=[ 124], 20.00th=[ 125], | 30.00th=[ 125], 40.00th=[ 155], 50.00th=[ 155], 60.00th=[ 199], | 70.00th=[ 232], 80.00th=[ 232], 90.00th=[ 518], 95.00th=[ 518], | 99.00th=[ 518], 99.50th=[ 518], 99.90th=[ 518], 99.95th=[ 518], | 99.99th=[ 518] bw ( KiB/s): min= 1996, max= 3430, per=31.01%, avg=2491.33, stdev=813.32, samples=3 iops : min= 1, max= 3, avg= 2.00, stdev= 1.00, samples=3 lat (usec) : 500=8.33%, 750=16.67% lat (msec) : 250=58.33%, 750=8.33%, 2000=8.33% cpu : usr=0.06%, sys=23.58%, ctx=812, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147291: Sat Jul 4 01:54:00 2026 read: IOPS=2, BW=2517KiB/s (2578kB/s)(5120KiB/2034msec) clat (usec): min=331, max=178235, avg=82095.79, stdev=78945.89 lat (usec): min=331, max=178236, avg=82096.77, stdev=78946.11 clat percentiles (usec): | 1.00th=[ 330], 5.00th=[ 330], 10.00th=[ 330], 20.00th=[ 330], | 30.00th=[ 457], 40.00th=[ 457], 50.00th=[109577], 60.00th=[109577], | 70.00th=[122160], 80.00th=[122160], 90.00th=[177210], 95.00th=[177210], | 99.00th=[177210], 99.50th=[177210], 99.90th=[177210], 99.95th=[177210], | 99.99th=[177210] bw ( KiB/s): min= 7984, max= 7984, per=100.00%, avg=7984.00, stdev= 0.00, samples=1 iops : min= 7, max= 7, avg= 7.00, stdev= 0.00, samples=1 write: IOPS=3, BW=3524KiB/s (3609kB/s)(7168KiB/2034msec); 0 zone resets clat (msec): min=109, max=429, avg=222.99, stdev=103.04 lat (msec): min=109, max=429, avg=223.05, stdev=103.03 clat percentiles (msec): | 1.00th=[ 110], 5.00th=[ 110], 10.00th=[ 110], 20.00th=[ 144], | 30.00th=[ 188], 40.00th=[ 188], 50.00th=[ 218], 60.00th=[ 228], | 70.00th=[ 228], 80.00th=[ 247], 90.00th=[ 430], 95.00th=[ 430], | 99.00th=[ 430], 99.50th=[ 430], 99.90th=[ 430], 99.95th=[ 430], | 99.99th=[ 430] bw ( KiB/s): min= 1753, max= 6144, per=41.04%, avg=3297.67, stdev=2467.99, samples=3 iops : min= 1, max= 6, avg= 2.67, stdev= 2.89, samples=3 lat (usec) : 500=16.67% lat (msec) : 250=75.00%, 500=8.33% cpu : usr=0.00%, sys=46.93%, ctx=326, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5740KiB/s (5878kB/s), 647KiB/s-2517KiB/s (662kB/s-2578kB/s), io=20.0MiB (20.0MB), run=2034-3568msec WRITE: bw=8036KiB/s (8229kB/s), 1516KiB/s-3524KiB/s (1552kB/s-3609kB/s), io=28.0MiB (29.4MB), run=2034-3568msec rand-rw: (groupid=0, jobs=1): err= 0: pid=147293: Sat Jul 4 01:54:01 2026 read: IOPS=1, BW=1753KiB/s (1795kB/s)(7168KiB/4090msec) clat (msec): min=39, max=734, avg=187.42, stdev=248.57 lat (msec): min=39, max=734, avg=187.42, stdev=248.57 clat percentiles (msec): | 1.00th=[ 41], 5.00th=[ 41], 10.00th=[ 41], 20.00th=[ 44], | 30.00th=[ 75], 40.00th=[ 75], 50.00th=[ 86], 60.00th=[ 121], | 70.00th=[ 121], 80.00th=[ 213], 90.00th=[ 735], 95.00th=[ 735], | 99.00th=[ 735], 99.50th=[ 735], 99.90th=[ 735], 99.95th=[ 735], | 99.99th=[ 735] bw ( KiB/s): min= 1643, max= 4096, per=48.95%, avg=2446.75, stdev=1114.25, samples=4 iops : min= 1, max= 4, avg= 2.00, stdev= 1.41, samples=4 write: IOPS=1, BW=1252KiB/s (1282kB/s)(5120KiB/4090msec); 0 zone resets clat (msec): min=61, max=1899, avg=524.20, stdev=774.69 lat (msec): min=61, max=1899, avg=524.27, stdev=774.69 clat percentiles (msec): | 1.00th=[ 62], 5.00th=[ 62], 10.00th=[ 62], 20.00th=[ 62], | 30.00th=[ 133], 40.00th=[ 133], 50.00th=[ 218], 60.00th=[ 218], | 70.00th=[ 313], 80.00th=[ 313], 90.00th=[ 1905], 95.00th=[ 1905], | 99.00th=[ 1905], 99.50th=[ 1905], 99.90th=[ 1905], 99.95th=[ 1905], | 99.99th=[ 1905] bw ( KiB/s): min= 2000, max= 2048, per=28.92%, avg=2024.00, stdev=33.94, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 50=16.67%, 100=25.00%, 250=33.33%, 500=8.33%, 750=8.33% lat (msec) : 2000=8.33% cpu : usr=0.00%, sys=10.93%, ctx=244, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147294: Sat Jul 4 01:54:01 2026 read: IOPS=0, BW=516KiB/s (528kB/s)(2048KiB/3970msec) clat (msec): min=67, max=113, avg=90.61, stdev=32.71 lat (msec): min=67, max=113, avg=90.61, stdev=32.71 clat percentiles (msec): | 1.00th=[ 68], 5.00th=[ 68], 10.00th=[ 68], 20.00th=[ 68], | 30.00th=[ 68], 40.00th=[ 68], 50.00th=[ 68], 60.00th=[ 114], | 70.00th=[ 114], 80.00th=[ 114], 90.00th=[ 114], 95.00th=[ 114], | 99.00th=[ 114], 99.50th=[ 114], 99.90th=[ 114], 99.95th=[ 114], | 99.99th=[ 114] bw ( KiB/s): min= 1735, max= 2000, per=37.36%, avg=1867.50, stdev=187.38, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2579KiB/s (2641kB/s)(10.0MiB/3970msec); 0 zone resets clat (msec): min=73, max=1938, avg=353.37, stdev=582.16 lat (msec): min=73, max=1938, avg=353.44, stdev=582.15 clat percentiles (msec): | 1.00th=[ 73], 5.00th=[ 73], 10.00th=[ 73], 20.00th=[ 75], | 30.00th=[ 94], 40.00th=[ 113], 50.00th=[ 123], 60.00th=[ 148], | 70.00th=[ 159], 80.00th=[ 165], 90.00th=[ 651], 95.00th=[ 1938], | 99.00th=[ 1938], 99.50th=[ 1938], 99.90th=[ 1938], 99.95th=[ 1938], | 99.99th=[ 1938] bw ( KiB/s): min= 2048, max= 6000, per=57.85%, avg=4048.00, stdev=1976.44, samples=3 iops : min= 2, max= 5, avg= 3.67, stdev= 1.53, samples=3 lat (msec) : 100=33.33%, 250=50.00%, 750=8.33%, 2000=8.33% cpu : usr=0.00%, sys=11.21%, ctx=95, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147295: Sat Jul 4 01:54:01 2026 read: IOPS=1, BW=1590KiB/s (1628kB/s)(6144KiB/3864msec) clat (msec): min=51, max=1500, avg=344.20, stdev=568.29 lat (msec): min=51, max=1500, avg=344.20, stdev=568.29 clat percentiles (msec): | 1.00th=[ 52], 5.00th=[ 52], 10.00th=[ 52], 20.00th=[ 69], | 30.00th=[ 69], 40.00th=[ 128], 50.00th=[ 128], 60.00th=[ 157], | 70.00th=[ 163], 80.00th=[ 163], 90.00th=[ 1502], 95.00th=[ 1502], | 99.00th=[ 1502], 99.50th=[ 1502], 99.90th=[ 1502], 99.95th=[ 1502], | 99.99th=[ 1502] bw ( KiB/s): min= 4000, max= 4096, per=80.99%, avg=4048.00, stdev=67.88, samples=2 iops : min= 3, max= 4, avg= 3.50, stdev= 0.71, samples=2 write: IOPS=1, BW=1590KiB/s (1628kB/s)(6144KiB/3864msec); 0 zone resets clat (msec): min=62, max=637, avg=253.96, stdev=218.68 lat (msec): min=63, max=637, avg=254.03, stdev=218.68 clat percentiles (msec): | 1.00th=[ 64], 5.00th=[ 64], 10.00th=[ 64], 20.00th=[ 123], | 30.00th=[ 123], 40.00th=[ 155], 50.00th=[ 155], 60.00th=[ 157], | 70.00th=[ 393], 80.00th=[ 393], 90.00th=[ 642], 95.00th=[ 642], | 99.00th=[ 642], 99.50th=[ 642], 99.90th=[ 642], 99.95th=[ 642], | 99.99th=[ 642] bw ( KiB/s): min= 2000, max= 3362, per=33.74%, avg=2361.25, stdev=667.47, samples=4 iops : min= 1, max= 3, avg= 1.75, stdev= 0.96, samples=4 lat (msec) : 100=25.00%, 250=50.00%, 500=8.33%, 750=8.33%, 2000=8.33% cpu : usr=0.00%, sys=8.78%, ctx=97, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147296: Sat Jul 4 01:54:01 2026 read: IOPS=1, BW=1250KiB/s (1280kB/s)(5120KiB/4097msec) clat (msec): min=40, max=126, avg=88.02, stdev=37.16 lat (msec): min=40, max=126, avg=88.02, stdev=37.16 clat percentiles (msec): | 1.00th=[ 41], 5.00th=[ 41], 10.00th=[ 41], 20.00th=[ 41], | 30.00th=[ 73], 40.00th=[ 73], 50.00th=[ 75], 60.00th=[ 75], | 70.00th=[ 126], 80.00th=[ 126], 90.00th=[ 127], 95.00th=[ 127], | 99.00th=[ 127], 99.50th=[ 127], 99.90th=[ 127], 99.95th=[ 127], | 99.99th=[ 127] bw ( KiB/s): min= 6000, max= 6000, per=100.00%, avg=6000.00, stdev= 0.00, samples=1 iops : min= 5, max= 5, avg= 5.00, stdev= 0.00, samples=1 write: IOPS=1, BW=1750KiB/s (1792kB/s)(7168KiB/4097msec); 0 zone resets clat (msec): min=53, max=2065, avg=501.74, stdev=717.11 lat (msec): min=53, max=2065, avg=501.81, stdev=717.11 clat percentiles (msec): | 1.00th=[ 54], 5.00th=[ 54], 10.00th=[ 54], 20.00th=[ 83], | 30.00th=[ 150], 40.00th=[ 150], 50.00th=[ 220], 60.00th=[ 305], | 70.00th=[ 305], 80.00th=[ 642], 90.00th=[ 2072], 95.00th=[ 2072], | 99.00th=[ 2072], 99.50th=[ 2072], 99.90th=[ 2072], 99.95th=[ 2072], | 99.99th=[ 2072] bw ( KiB/s): min= 1684, max= 4000, per=36.83%, avg=2577.33, stdev=1245.44, samples=3 iops : min= 1, max= 3, avg= 2.00, stdev= 1.00, samples=3 lat (msec) : 50=8.33%, 100=33.33%, 250=33.33%, 500=8.33%, 750=8.33% lat (msec) : >=2000=8.33% cpu : usr=0.00%, sys=7.25%, ctx=208, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4999KiB/s (5119kB/s), 516KiB/s-1753KiB/s (528kB/s-1795kB/s), io=20.0MiB (20.0MB), run=3864-4097msec WRITE: bw=6998KiB/s (7166kB/s), 1252KiB/s-2579KiB/s (1282kB/s-2641kB/s), io=28.0MiB (29.4MB), run=3864-4097msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=147302: Sat Jul 4 01:54:08 2026 read: IOPS=1, BW=6393KiB/s (6547kB/s)(12.0MiB/1922msec) clat (msec): min=473, max=740, avg=631.47, stdev=140.12 lat (msec): min=473, max=740, avg=631.47, stdev=140.12 clat percentiles (msec): | 1.00th=[ 472], 5.00th=[ 472], 10.00th=[ 472], 20.00th=[ 472], | 30.00th=[ 472], 40.00th=[ 684], 50.00th=[ 684], 60.00th=[ 684], | 70.00th=[ 743], 80.00th=[ 743], 90.00th=[ 743], 95.00th=[ 743], | 99.00th=[ 743], 99.50th=[ 743], 99.90th=[ 743], 99.95th=[ 743], | 99.99th=[ 743] bw ( KiB/s): min= 7571, max= 8159, per=92.27%, avg=7865.00, stdev=415.78, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 750=66.67% cpu : usr=0.00%, sys=38.05%, ctx=912, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147303: Sat Jul 4 01:54:08 2026 read: IOPS=0, BW=2365KiB/s (2422kB/s)(4096KiB/1732msec) clat (nsec): min=437402k, max=437402k, avg=437401998.00, stdev= 0.00 lat (nsec): min=437403k, max=437403k, avg=437403413.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 439], 5.00th=[ 439], 10.00th=[ 439], 20.00th=[ 439], | 30.00th=[ 439], 40.00th=[ 439], 50.00th=[ 439], 60.00th=[ 439], | 70.00th=[ 439], 80.00th=[ 439], 90.00th=[ 439], 95.00th=[ 439], | 99.00th=[ 439], 99.50th=[ 439], 99.90th=[ 439], 99.95th=[ 439], | 99.99th=[ 439] bw ( KiB/s): min= 5550, max= 5550, per=65.11%, avg=5550.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=1, BW=4730KiB/s (4843kB/s)(8192KiB/1732msec); 0 zone resets clat (msec): min=446, max=834, avg=640.43, stdev=274.70 lat (msec): min=446, max=834, avg=640.68, stdev=274.71 clat percentiles (msec): | 1.00th=[ 447], 5.00th=[ 447], 10.00th=[ 447], 20.00th=[ 447], | 30.00th=[ 447], 40.00th=[ 447], 50.00th=[ 447], 60.00th=[ 835], | 70.00th=[ 835], 80.00th=[ 835], 90.00th=[ 835], 95.00th=[ 835], | 99.00th=[ 835], 99.50th=[ 835], 99.90th=[ 835], 99.95th=[ 835], | 99.99th=[ 835] bw ( KiB/s): min= 8159, max= 8159, per=54.33%, avg=8159.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=66.67%, 1000=33.33% cpu : usr=0.00%, sys=19.24%, ctx=412, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147304: Sat Jul 4 01:54:08 2026 write: IOPS=1, BW=5632KiB/s (5767kB/s)(12.0MiB/2182msec); 0 zone resets clat (msec): min=648, max=818, avg=713.06, stdev=91.82 lat (msec): min=648, max=818, avg=713.36, stdev=91.78 clat percentiles (msec): | 1.00th=[ 651], 5.00th=[ 651], 10.00th=[ 651], 20.00th=[ 651], | 30.00th=[ 651], 40.00th=[ 676], 50.00th=[ 676], 60.00th=[ 676], | 70.00th=[ 818], 80.00th=[ 818], 90.00th=[ 818], 95.00th=[ 818], | 99.00th=[ 818], 99.50th=[ 818], 99.90th=[ 818], 99.95th=[ 818], | 99.99th=[ 818] bw ( KiB/s): min= 5649, max= 8192, per=46.08%, avg=6920.50, stdev=1798.17, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 750=66.67%, 1000=33.33% cpu : usr=0.00%, sys=10.68%, ctx=86, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147305: Sat Jul 4 01:54:08 2026 write: IOPS=1, BW=8127KiB/s (8322kB/s)(12.0MiB/1512msec); 0 zone resets clat (msec): min=194, max=985, avg=478.03, stdev=440.72 lat (msec): min=194, max=986, avg=478.36, stdev=440.83 clat percentiles (msec): | 1.00th=[ 194], 5.00th=[ 194], 10.00th=[ 194], 20.00th=[ 194], | 30.00th=[ 194], 40.00th=[ 255], 50.00th=[ 255], 60.00th=[ 255], | 70.00th=[ 986], 80.00th=[ 986], 90.00th=[ 986], 95.00th=[ 986], | 99.00th=[ 986], 99.50th=[ 986], 99.90th=[ 986], 99.95th=[ 986], | 99.99th=[ 986] bw ( KiB/s): min=11393, max=11393, per=75.87%, avg=11393.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 500=33.33%, 1000=33.33% cpu : usr=0.07%, sys=15.09%, ctx=86, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=8524KiB/s (8729kB/s), 2365KiB/s-6393KiB/s (2422kB/s-6547kB/s), io=16.0MiB (16.8MB), run=1732-1922msec WRITE: bw=14.7MiB/s (15.4MB/s), 4730KiB/s-8127KiB/s (4843kB/s-8322kB/s), io=32.0MiB (33.6MB), run=1512-2182msec rand-rw: (groupid=0, jobs=1): err= 0: pid=147307: Sat Jul 4 01:54:08 2026 read: IOPS=1, BW=5899KiB/s (6041kB/s)(12.0MiB/2083msec) clat (msec): min=207, max=996, avg=673.00, stdev=413.18 lat (msec): min=207, max=996, avg=673.00, stdev=413.18 clat percentiles (msec): | 1.00th=[ 207], 5.00th=[ 207], 10.00th=[ 207], 20.00th=[ 207], | 30.00th=[ 207], 40.00th=[ 818], 50.00th=[ 818], 60.00th=[ 818], | 70.00th=[ 995], 80.00th=[ 995], 90.00th=[ 995], 95.00th=[ 995], | 99.00th=[ 995], 99.50th=[ 995], 99.90th=[ 995], 99.95th=[ 995], | 99.99th=[ 995] bw ( KiB/s): min= 8047, max= 8126, per=100.00%, avg=8086.50, stdev=55.86, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 250=33.33%, 1000=66.67% cpu : usr=0.00%, sys=8.79%, ctx=36, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147308: Sat Jul 4 01:54:08 2026 read: IOPS=0, BW=2025KiB/s (2073kB/s)(4096KiB/2023msec) clat (nsec): min=793758k, max=793758k, avg=793758020.00, stdev= 0.00 lat (nsec): min=793760k, max=793760k, avg=793759857.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 793], 5.00th=[ 793], 10.00th=[ 793], 20.00th=[ 793], | 30.00th=[ 793], 40.00th=[ 793], 50.00th=[ 793], 60.00th=[ 793], | 70.00th=[ 793], 80.00th=[ 793], 90.00th=[ 793], 95.00th=[ 793], | 99.00th=[ 793], 99.50th=[ 793], 99.90th=[ 793], 99.95th=[ 793], | 99.99th=[ 793] bw ( KiB/s): min= 8192, max= 8192, per=100.00%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 write: IOPS=0, BW=4049KiB/s (4147kB/s)(8192KiB/2023msec); 0 zone resets clat (msec): min=275, max=886, avg=581.02, stdev=432.65 lat (msec): min=275, max=887, avg=581.37, stdev=432.78 clat percentiles (msec): | 1.00th=[ 275], 5.00th=[ 275], 10.00th=[ 275], 20.00th=[ 275], | 30.00th=[ 275], 40.00th=[ 275], 50.00th=[ 275], 60.00th=[ 885], | 70.00th=[ 885], 80.00th=[ 885], 90.00th=[ 885], 95.00th=[ 885], | 99.00th=[ 885], 99.50th=[ 885], 99.90th=[ 885], 99.95th=[ 885], | 99.99th=[ 885] bw ( KiB/s): min= 8126, max= 8126, per=56.10%, avg=8126.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 1000=66.67% cpu : usr=0.00%, sys=11.37%, ctx=64, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147309: Sat Jul 4 01:54:08 2026 write: IOPS=1, BW=5432KiB/s (5563kB/s)(12.0MiB/2262msec); 0 zone resets clat (msec): min=82, max=1197, avg=741.29, stdev=584.03 lat (msec): min=83, max=1197, avg=741.64, stdev=583.94 clat percentiles (msec): | 1.00th=[ 84], 5.00th=[ 84], 10.00th=[ 84], 20.00th=[ 84], | 30.00th=[ 84], 40.00th=[ 944], 50.00th=[ 944], 60.00th=[ 944], | 70.00th=[ 1200], 80.00th=[ 1200], 90.00th=[ 1200], 95.00th=[ 1200], | 99.00th=[ 1200], 99.50th=[ 1200], 99.90th=[ 1200], 99.95th=[ 1200], | 99.99th=[ 1200] bw ( KiB/s): min= 8126, max= 8126, per=56.10%, avg=8126.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 100=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.09%, sys=10.88%, ctx=137, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147310: Sat Jul 4 01:54:08 2026 write: IOPS=1, BW=7465KiB/s (7645kB/s)(12.0MiB/1646msec); 0 zone resets clat (msec): min=461, max=592, avg=527.78, stdev=65.50 lat (msec): min=461, max=592, avg=528.02, stdev=65.41 clat percentiles (msec): | 1.00th=[ 460], 5.00th=[ 460], 10.00th=[ 460], 20.00th=[ 460], | 30.00th=[ 460], 40.00th=[ 531], 50.00th=[ 531], 60.00th=[ 531], | 70.00th=[ 592], 80.00th=[ 592], 90.00th=[ 592], 95.00th=[ 592], | 99.00th=[ 592], 99.50th=[ 592], 99.90th=[ 592], 99.95th=[ 592], | 99.99th=[ 592] bw ( KiB/s): min= 5497, max= 8126, per=47.02%, avg=6811.50, stdev=1858.98, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 750=66.67% cpu : usr=0.00%, sys=24.12%, ctx=91, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=7866KiB/s (8054kB/s), 2025KiB/s-5899KiB/s (2073kB/s-6041kB/s), io=16.0MiB (16.8MB), run=2023-2083msec WRITE: bw=14.1MiB/s (14.8MB/s), 4049KiB/s-7465KiB/s (4147kB/s-7645kB/s), io=32.0MiB (33.6MB), run=1646-2262msec