== sanity test 398b: DIO and buffer IO race ============== 09:07:25 (1788613645) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 7.26812 s, 6.9 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144834: Sat Sep 5 09:09:56 2026 read: IOPS=11, BW=46.7KiB/s (47.8kB/s)(5992KiB/128351msec) clat (usec): min=32, max=994445, avg=42933.95, stdev=42907.50 lat (usec): min=33, max=994447, avg=42940.07, stdev=42906.89 clat percentiles (usec): | 1.00th=[ 54], 5.00th=[ 67], 10.00th=[ 10683], 20.00th=[ 19268], | 30.00th=[ 25035], 40.00th=[ 29492], 50.00th=[ 34866], 60.00th=[ 41681], | 70.00th=[ 49546], 80.00th=[ 60031], 90.00th=[ 81265], 95.00th=[100140], | 99.00th=[185598], 99.50th=[242222], 99.90th=[417334], 99.95th=[994051], | 99.99th=[994051] bw ( KiB/s): min= 5, max= 103, per=25.26%, avg=46.73, stdev=20.57, samples=250 iops : min= 1, max= 25, avg=11.02, stdev= 5.19, samples=250 write: IOPS=12, BW=49.1KiB/s (50.2kB/s)(6296KiB/128351msec); 0 zone resets clat (usec): min=1026, max=486820, avg=40565.15, stdev=42394.07 lat (usec): min=1026, max=486822, avg=40569.29, stdev=42393.07 clat percentiles (usec): | 1.00th=[ 1205], 5.00th=[ 1385], 10.00th=[ 2040], 20.00th=[ 5145], | 30.00th=[ 9765], 40.00th=[ 19268], 50.00th=[ 29754], 60.00th=[ 41157], | 70.00th=[ 54264], 80.00th=[ 68682], 90.00th=[ 92799], 95.00th=[120062], | 99.00th=[173016], 99.50th=[208667], 99.90th=[362808], 99.95th=[488637], | 99.99th=[488637] bw ( KiB/s): min= 7, max= 111, per=25.18%, avg=48.84, stdev=22.16, samples=251 iops : min= 1, max= 27, avg=11.55, stdev= 5.59, samples=251 lat (usec) : 50=0.42%, 100=3.52%, 250=0.36%, 500=0.07%, 750=0.03% lat (msec) : 2=5.11%, 4=3.97%, 10=6.97%, 20=10.74%, 50=37.73% lat (msec) : 100=24.28%, 250=6.48%, 500=0.29%, 1000=0.03% cpu : usr=0.09%, sys=5.56%, ctx=6714, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144835: Sat Sep 5 09:09:56 2026 read: IOPS=11, BW=46.2KiB/s (47.3kB/s)(5940KiB/128634msec) clat (usec): min=27, max=287356, avg=41106.94, stdev=32298.70 lat (usec): min=27, max=287358, avg=41111.75, stdev=32299.01 clat percentiles (usec): | 1.00th=[ 55], 5.00th=[ 68], 10.00th=[ 306], 20.00th=[ 18482], | 30.00th=[ 23987], 40.00th=[ 28967], 50.00th=[ 33817], 60.00th=[ 41157], | 70.00th=[ 49546], 80.00th=[ 59507], 90.00th=[ 78119], 95.00th=[ 98042], | 99.00th=[160433], 99.50th=[191890], 99.90th=[219153], 99.95th=[287310], | 99.99th=[287310] bw ( KiB/s): min= 5, max= 112, per=24.76%, avg=45.80, stdev=20.77, samples=253 iops : min= 1, max= 28, avg=10.79, stdev= 5.24, samples=253 write: IOPS=12, BW=49.3KiB/s (50.5kB/s)(6348KiB/128634msec); 0 zone resets clat (usec): min=1016, max=861162, avg=42429.95, stdev=46709.74 lat (usec): min=1018, max=861165, avg=42440.39, stdev=46706.96 clat percentiles (usec): | 1.00th=[ 1221], 5.00th=[ 1418], 10.00th=[ 2409], 20.00th=[ 5800], | 30.00th=[ 11600], 40.00th=[ 20841], 50.00th=[ 31065], 60.00th=[ 41157], | 70.00th=[ 54789], 80.00th=[ 71828], 90.00th=[ 98042], 95.00th=[122160], | 99.00th=[179307], 99.50th=[221250], 99.90th=[358613], 99.95th=[859833], | 99.99th=[859833] bw ( KiB/s): min= 5, max= 112, per=25.28%, avg=49.05, stdev=22.10, samples=253 iops : min= 1, max= 28, avg=11.61, stdev= 5.56, samples=253 lat (usec) : 50=0.29%, 100=3.91%, 250=0.55%, 500=0.20%, 1000=0.03% lat (msec) : 2=4.33%, 4=3.55%, 10=6.74%, 20=11.52%, 50=37.27% lat (msec) : 100=24.32%, 250=7.06%, 500=0.20%, 1000=0.03% cpu : usr=0.09%, sys=5.54%, ctx=6813, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144836: Sat Sep 5 09:09:56 2026 read: IOPS=11, BW=46.7KiB/s (47.9kB/s)(6028KiB/128962msec) clat (usec): min=30, max=399384, avg=41667.25, stdev=35608.95 lat (usec): min=31, max=399384, avg=41670.11, stdev=35608.56 clat percentiles (usec): | 1.00th=[ 57], 5.00th=[ 68], 10.00th=[ 10290], 20.00th=[ 19006], | 30.00th=[ 23987], 40.00th=[ 28967], 50.00th=[ 34866], 60.00th=[ 41157], | 70.00th=[ 49546], 80.00th=[ 60031], 90.00th=[ 77071], 95.00th=[ 95945], | 99.00th=[164627], 99.50th=[258999], 99.90th=[337642], 99.95th=[400557], | 99.99th=[400557] bw ( KiB/s): min= 7, max= 102, per=25.17%, avg=46.57, stdev=20.54, samples=252 iops : min= 1, max= 25, avg=10.99, stdev= 5.19, samples=252 write: IOPS=12, BW=48.5KiB/s (49.7kB/s)(6260KiB/128962msec); 0 zone resets clat (usec): min=1095, max=977427, avg=42147.28, stdev=47968.51 lat (usec): min=1096, max=977432, avg=42152.16, stdev=47966.42 clat percentiles (usec): | 1.00th=[ 1172], 5.00th=[ 1369], 10.00th=[ 1909], 20.00th=[ 5014], | 30.00th=[ 9372], 40.00th=[ 19792], 50.00th=[ 31327], 60.00th=[ 42206], | 70.00th=[ 55313], 80.00th=[ 71828], 90.00th=[ 94897], 95.00th=[124257], | 99.00th=[187696], 99.50th=[225444], 99.90th=[261096], 99.95th=[977273], | 99.99th=[977273] bw ( KiB/s): min= 7, max= 120, per=24.93%, avg=48.37, stdev=21.56, samples=252 iops : min= 1, max= 30, avg=11.43, stdev= 5.42, samples=252 lat (usec) : 50=0.26%, 100=3.94%, 250=0.20%, 500=0.10%, 750=0.07% lat (msec) : 2=5.31%, 4=3.55%, 10=7.52%, 20=10.32%, 50=37.17% lat (msec) : 100=24.97%, 250=6.25%, 500=0.33%, 1000=0.03% cpu : usr=0.09%, sys=5.46%, ctx=6626, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144837: Sat Sep 5 09:09:56 2026 read: IOPS=11, BW=46.8KiB/s (47.9kB/s)(6052KiB/129436msec) clat (usec): min=33, max=418264, avg=41472.15, stdev=33652.29 lat (usec): min=33, max=418265, avg=41481.49, stdev=33651.08 clat percentiles (usec): | 1.00th=[ 51], 5.00th=[ 66], 10.00th=[ 1663], 20.00th=[ 18744], | 30.00th=[ 24511], 40.00th=[ 29754], 50.00th=[ 34866], 60.00th=[ 41157], | 70.00th=[ 50070], 80.00th=[ 61604], 90.00th=[ 80217], 95.00th=[ 98042], | 99.00th=[143655], 99.50th=[181404], 99.90th=[354419], 99.95th=[417334], | 99.99th=[417334] bw ( KiB/s): min= 7, max= 95, per=25.09%, avg=46.41, stdev=20.40, samples=252 iops : min= 1, max= 23, avg=10.94, stdev= 5.16, samples=252 write: IOPS=12, BW=48.2KiB/s (49.3kB/s)(6236KiB/129436msec); 0 zone resets clat (usec): min=1056, max=968558, avg=42625.27, stdev=50576.91 lat (usec): min=1058, max=968560, avg=42628.54, stdev=50578.52 clat percentiles (usec): | 1.00th=[ 1221], 5.00th=[ 1369], 10.00th=[ 1958], 20.00th=[ 5080], | 30.00th=[ 10683], 40.00th=[ 19268], 50.00th=[ 29230], 60.00th=[ 41157], | 70.00th=[ 54264], 80.00th=[ 71828], 90.00th=[ 99091], 95.00th=[130548], | 99.00th=[193987], 99.50th=[231736], 99.90th=[459277], 99.95th=[968885], | 99.99th=[968885] bw ( KiB/s): min= 7, max= 128, per=24.73%, avg=47.97, stdev=22.51, samples=252 iops : min= 1, max= 32, avg=11.33, stdev= 5.71, samples=252 lat (usec) : 50=0.49%, 100=3.71%, 250=0.49%, 500=0.03%, 750=0.03% lat (usec) : 1000=0.07% lat (msec) : 2=5.34%, 4=3.48%, 10=6.61%, 20=11.56%, 50=36.88% lat (msec) : 100=24.35%, 250=6.64%, 500=0.29%, 1000=0.03% cpu : usr=0.08%, sys=5.46%, ctx=6744, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=186KiB/s (190kB/s), 46.2KiB/s-46.8KiB/s (47.3kB/s-47.9kB/s), io=23.4MiB (24.6MB), run=128351-129436msec WRITE: bw=194KiB/s (199kB/s), 48.2KiB/s-49.3KiB/s (49.3kB/s-50.5kB/s), io=24.6MiB (25.7MB), run=128351-129436msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144829: Sat Sep 5 09:12:10 2026 read: IOPS=5, BW=22.8KiB/s (23.4kB/s)(5992KiB/262470msec) clat (msec): min=5, max=1027, avg=34.99, stdev=45.61 lat (msec): min=5, max=1027, avg=34.99, stdev=45.61 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 11], 20.00th=[ 14], | 30.00th=[ 16], 40.00th=[ 20], 50.00th=[ 22], 60.00th=[ 27], | 70.00th=[ 32], 80.00th=[ 45], 90.00th=[ 74], 95.00th=[ 108], | 99.00th=[ 194], 99.50th=[ 213], 99.90th=[ 625], 99.95th=[ 1028], | 99.99th=[ 1028] bw ( KiB/s): min= 7, max= 87, per=27.82%, avg=25.04, stdev=16.79, samples=462 iops : min= 1, max= 21, avg= 5.62, stdev= 4.23, samples=462 write: IOPS=5, BW=23.0KiB/s (24.6kB/s)(6296KiB/262470msec); 0 zone resets clat (msec): min=35, max=518, avg=133.21, stdev=64.49 lat (msec): min=35, max=518, avg=133.22, stdev=64.49 clat percentiles (msec): | 1.00th=[ 51], 5.00th=[ 64], 10.00th=[ 72], 20.00th=[ 84], | 30.00th=[ 95], 40.00th=[ 106], 50.00th=[ 115], 60.00th=[ 130], | 70.00th=[ 150], 80.00th=[ 174], 90.00th=[ 218], 95.00th=[ 264], | 99.00th=[ 363], 99.50th=[ 422], 99.90th=[ 451], 99.95th=[ 518], | 99.99th=[ 518] bw ( KiB/s): min= 7, max= 55, per=25.07%, avg=23.82, stdev=10.67, samples=509 iops : min= 1, max= 13, avg= 5.31, stdev= 2.71, samples=509 lat (msec) : 10=3.35%, 20=18.03%, 50=19.30%, 100=23.70%, 250=32.52% lat (msec) : 500=2.99%, 750=0.07%, 2000=0.03% cpu : usr=0.05%, sys=1.18%, ctx=5025, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144830: Sat Sep 5 09:12:10 2026 read: IOPS=5, BW=22.5KiB/s (23.0kB/s)(5940KiB/264230msec) clat (msec): min=6, max=899, avg=34.61, stdev=43.76 lat (msec): min=6, max=899, avg=34.61, stdev=43.76 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 11], 20.00th=[ 14], | 30.00th=[ 16], 40.00th=[ 19], 50.00th=[ 22], 60.00th=[ 26], | 70.00th=[ 32], 80.00th=[ 45], 90.00th=[ 77], 95.00th=[ 107], | 99.00th=[ 169], 99.50th=[ 184], 99.90th=[ 634], 99.95th=[ 902], | 99.99th=[ 902] bw ( KiB/s): min= 7, max= 111, per=27.76%, avg=24.99, stdev=17.59, samples=459 iops : min= 1, max= 27, avg= 5.61, stdev= 4.42, samples=459 write: IOPS=6, BW=24.0KiB/s (24.6kB/s)(6348KiB/264230msec); 0 zone resets clat (msec): min=39, max=518, avg=133.88, stdev=65.24 lat (msec): min=39, max=518, avg=133.89, stdev=65.24 clat percentiles (msec): | 1.00th=[ 52], 5.00th=[ 64], 10.00th=[ 72], 20.00th=[ 84], | 30.00th=[ 95], 40.00th=[ 106], 50.00th=[ 118], 60.00th=[ 133], | 70.00th=[ 150], 80.00th=[ 174], 90.00th=[ 218], 95.00th=[ 255], | 99.00th=[ 368], 99.50th=[ 439], 99.90th=[ 514], 99.95th=[ 518], | 99.99th=[ 518] bw ( KiB/s): min= 7, max= 55, per=25.01%, avg=23.76, stdev=10.69, samples=515 iops : min= 1, max= 13, avg= 5.30, stdev= 2.73, samples=515 lat (msec) : 10=3.61%, 20=19.11%, 50=17.35%, 100=23.31%, 250=33.76% lat (msec) : 500=2.67%, 750=0.16%, 1000=0.03% cpu : usr=0.04%, sys=1.23%, ctx=5140, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144831: Sat Sep 5 09:12:10 2026 read: IOPS=5, BW=22.9KiB/s (23.5kB/s)(6028KiB/263054msec) clat (msec): min=6, max=507, avg=35.32, stdev=40.01 lat (msec): min=6, max=507, avg=35.32, stdev=40.01 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 14], | 30.00th=[ 16], 40.00th=[ 19], 50.00th=[ 22], 60.00th=[ 27], | 70.00th=[ 34], 80.00th=[ 47], 90.00th=[ 78], 95.00th=[ 108], | 99.00th=[ 209], 99.50th=[ 247], 99.90th=[ 418], 99.95th=[ 506], | 99.99th=[ 506] bw ( KiB/s): min= 7, max= 103, per=27.62%, avg=24.86, stdev=17.67, samples=468 iops : min= 1, max= 25, avg= 5.58, stdev= 4.45, samples=468 write: IOPS=5, BW=23.8KiB/s (24.4kB/s)(6260KiB/263054msec); 0 zone resets clat (msec): min=36, max=976, avg=133.83, stdev=64.96 lat (msec): min=36, max=976, avg=133.83, stdev=64.96 clat percentiles (msec): | 1.00th=[ 50], 5.00th=[ 63], 10.00th=[ 72], 20.00th=[ 85], | 30.00th=[ 96], 40.00th=[ 108], 50.00th=[ 118], 60.00th=[ 131], | 70.00th=[ 148], 80.00th=[ 178], 90.00th=[ 220], 95.00th=[ 262], | 99.00th=[ 338], 99.50th=[ 359], 99.90th=[ 506], 99.95th=[ 978], | 99.99th=[ 978] bw ( KiB/s): min= 7, max= 56, per=24.80%, avg=23.56, stdev=10.68, samples=511 iops : min= 1, max= 14, avg= 5.25, stdev= 2.71, samples=511 lat (msec) : 10=4.10%, 20=18.03%, 50=18.59%, 100=22.17%, 250=34.05% lat (msec) : 500=2.96%, 750=0.07%, 1000=0.03% cpu : usr=0.05%, sys=1.22%, ctx=5244, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144832: Sat Sep 5 09:12:10 2026 read: IOPS=5, BW=23.3KiB/s (23.8kB/s)(6052KiB/259846msec) clat (msec): min=6, max=462, avg=33.33, stdev=36.86 lat (msec): min=6, max=462, avg=33.34, stdev=36.86 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 14], | 30.00th=[ 16], 40.00th=[ 19], 50.00th=[ 22], 60.00th=[ 25], | 70.00th=[ 32], 80.00th=[ 43], 90.00th=[ 70], 95.00th=[ 106], | 99.00th=[ 165], 99.50th=[ 234], 99.90th=[ 414], 99.95th=[ 464], | 99.99th=[ 464] bw ( KiB/s): min= 7, max= 111, per=28.64%, avg=25.78, stdev=17.52, samples=454 iops : min= 1, max= 27, avg= 5.81, stdev= 4.41, samples=454 write: IOPS=5, BW=23.0KiB/s (24.6kB/s)(6236KiB/259846msec); 0 zone resets clat (msec): min=37, max=969, avg=134.09, stdev=67.50 lat (msec): min=37, max=969, avg=134.09, stdev=67.50 clat percentiles (msec): | 1.00th=[ 53], 5.00th=[ 64], 10.00th=[ 72], 20.00th=[ 84], | 30.00th=[ 94], 40.00th=[ 106], 50.00th=[ 118], 60.00th=[ 133], | 70.00th=[ 150], 80.00th=[ 176], 90.00th=[ 211], 95.00th=[ 259], | 99.00th=[ 368], 99.50th=[ 435], 99.90th=[ 523], 99.95th=[ 969], | 99.99th=[ 969] bw ( KiB/s): min= 7, max= 55, per=24.83%, avg=23.59, stdev=10.68, samples=509 iops : min= 1, max= 13, avg= 5.26, stdev= 2.71, samples=509 lat (msec) : 10=3.26%, 20=19.92%, 50=18.23%, 100=23.08%, 250=32.29% lat (msec) : 500=3.09%, 750=0.10%, 1000=0.03% cpu : usr=0.04%, sys=1.22%, ctx=5263, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=90.9KiB/s (93.1kB/s), 22.5KiB/s-23.3KiB/s (23.0kB/s-23.8kB/s), io=23.4MiB (24.6MB), run=259846-264230msec WRITE: bw=95.1KiB/s (97.4kB/s), 23.8KiB/s-24.0KiB/s (24.4kB/s-24.6kB/s), io=24.6MiB (25.7MB), run=259846-264230msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144898: Sat Sep 5 09:12:50 2026 read: IOPS=14, BW=228KiB/s (234kB/s)(5920KiB/25955msec) clat (usec): min=32, max=249621, avg=37113.84, stdev=35703.96 lat (usec): min=32, max=249621, avg=37115.35, stdev=35704.00 clat percentiles (usec): | 1.00th=[ 37], 5.00th=[ 63], 10.00th=[ 70], 20.00th=[ 99], | 30.00th=[ 19268], 40.00th=[ 25822], 50.00th=[ 32900], 60.00th=[ 40633], | 70.00th=[ 48497], 80.00th=[ 57934], 90.00th=[ 73925], 95.00th=[ 95945], | 99.00th=[179307], 99.50th=[191890], 99.90th=[250610], 99.95th=[250610], | 99.99th=[250610] bw ( KiB/s): min= 31, max= 530, per=25.61%, avg=228.22, stdev=88.23, samples=51 iops : min= 1, max= 33, avg=13.49, stdev= 5.61, samples=51 write: IOPS=15, BW=245KiB/s (251kB/s)(6368KiB/25955msec); 0 zone resets clat (usec): min=1415, max=194595, avg=30132.18, stdev=31368.12 lat (usec): min=1418, max=194599, avg=30134.93, stdev=31368.26 clat percentiles (usec): | 1.00th=[ 1565], 5.00th=[ 2442], 10.00th=[ 3228], 20.00th=[ 5080], | 30.00th=[ 7439], 40.00th=[ 11207], 50.00th=[ 16909], 60.00th=[ 26608], | 70.00th=[ 40109], 80.00th=[ 54789], 90.00th=[ 74974], 95.00th=[ 95945], | 99.00th=[132645], 99.50th=[170918], 99.90th=[193987], 99.95th=[193987], | 99.99th=[193987] bw ( KiB/s): min= 63, max= 428, per=26.78%, avg=250.90, stdev=89.96, samples=50 iops : min= 3, max= 26, avg=14.92, stdev= 5.73, samples=50 lat (usec) : 50=1.69%, 100=7.94%, 250=2.08%, 500=0.39%, 750=0.13% lat (usec) : 1000=0.39% lat (msec) : 2=2.21%, 4=5.73%, 10=11.20%, 20=10.55%, 50=31.77% lat (msec) : 100=21.88%, 250=4.04% cpu : usr=0.10%, sys=7.09%, ctx=1485, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144899: Sat Sep 5 09:12:50 2026 read: IOPS=13, BW=217KiB/s (222kB/s)(5744KiB/26464msec) clat (usec): min=39, max=151217, avg=36807.41, stdev=31142.55 lat (usec): min=39, max=151218, avg=36809.82, stdev=31143.77 clat percentiles (usec): | 1.00th=[ 42], 5.00th=[ 59], 10.00th=[ 69], 20.00th=[ 106], | 30.00th=[ 17957], 40.00th=[ 28705], 50.00th=[ 34866], 60.00th=[ 40109], | 70.00th=[ 50594], 80.00th=[ 59507], 90.00th=[ 78119], 95.00th=[ 95945], | 99.00th=[120062], 99.50th=[135267], 99.90th=[152044], 99.95th=[152044], | 99.99th=[152044] bw ( KiB/s): min= 62, max= 436, per=24.20%, avg=215.65, stdev=85.64, samples=52 iops : min= 3, max= 27, avg=12.71, stdev= 5.40, samples=52 write: IOPS=15, BW=247KiB/s (253kB/s)(6544KiB/26464msec); 0 zone resets clat (usec): min=1545, max=201587, avg=32130.66, stdev=32476.19 lat (usec): min=1548, max=201590, avg=32137.79, stdev=32472.95 clat percentiles (usec): | 1.00th=[ 1663], 5.00th=[ 2278], 10.00th=[ 3359], 20.00th=[ 5669], | 30.00th=[ 8717], 40.00th=[ 11994], 50.00th=[ 19530], 60.00th=[ 30016], | 70.00th=[ 42206], 80.00th=[ 57934], 90.00th=[ 76022], 95.00th=[ 91751], | 99.00th=[131597], 99.50th=[143655], 99.90th=[202376], 99.95th=[202376], | 99.99th=[202376] bw ( KiB/s): min= 63, max= 474, per=26.41%, avg=247.42, stdev=101.08, samples=52 iops : min= 3, max= 29, avg=14.69, stdev= 6.33, samples=52 lat (usec) : 50=1.43%, 100=7.68%, 250=1.82%, 500=0.52%, 750=0.13% lat (usec) : 1000=0.26% lat (msec) : 2=1.43%, 4=5.47%, 10=12.50%, 20=10.42%, 50=31.51% lat (msec) : 100=22.40%, 250=4.43% cpu : usr=0.09%, sys=6.84%, ctx=1473, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144900: Sat Sep 5 09:12:50 2026 read: IOPS=14, BW=233KiB/s (238kB/s)(6256KiB/26869msec) clat (usec): min=40, max=251682, avg=34385.49, stdev=31649.17 lat (usec): min=41, max=251685, avg=34387.17, stdev=31649.13 clat percentiles (usec): | 1.00th=[ 46], 5.00th=[ 63], 10.00th=[ 74], 20.00th=[ 95], | 30.00th=[ 17433], 40.00th=[ 26084], 50.00th=[ 32900], 60.00th=[ 38011], | 70.00th=[ 46400], 80.00th=[ 57934], 90.00th=[ 69731], 95.00th=[ 83362], | 99.00th=[139461], 99.50th=[204473], 99.90th=[252707], 99.95th=[252707], | 99.99th=[252707] bw ( KiB/s): min= 21, max= 473, per=26.35%, avg=234.79, stdev=91.62, samples=52 iops : min= 1, max= 29, avg=13.96, stdev= 5.66, samples=52 write: IOPS=14, BW=224KiB/s (230kB/s)(6032KiB/26869msec); 0 zone resets clat (usec): min=1474, max=239621, avg=34679.55, stdev=36089.01 lat (usec): min=1477, max=239621, avg=34687.32, stdev=36096.12 clat percentiles (usec): | 1.00th=[ 1762], 5.00th=[ 2311], 10.00th=[ 3458], 20.00th=[ 6128], | 30.00th=[ 8979], 40.00th=[ 12780], 50.00th=[ 21890], 60.00th=[ 35390], | 70.00th=[ 44303], 80.00th=[ 61604], 90.00th=[ 81265], 95.00th=[101188], | 99.00th=[164627], 99.50th=[227541], 99.90th=[240124], 99.95th=[240124], | 99.99th=[240124] bw ( KiB/s): min= 64, max= 476, per=23.77%, avg=222.73, stdev=86.15, samples=52 iops : min= 4, max= 29, avg=13.21, stdev= 5.42, samples=52 lat (usec) : 50=0.91%, 100=9.77%, 250=2.34%, 500=0.52%, 750=0.26% lat (usec) : 1000=0.26% lat (msec) : 2=1.82%, 4=4.43%, 10=10.94%, 20=8.98%, 50=34.11% lat (msec) : 100=22.27%, 250=3.26%, 500=0.13% cpu : usr=0.11%, sys=6.69%, ctx=1544, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144901: Sat Sep 5 09:12:50 2026 read: IOPS=14, BW=230KiB/s (235kB/s)(6032KiB/26267msec) clat (usec): min=44, max=178300, avg=34772.13, stdev=29686.69 lat (usec): min=44, max=178301, avg=34813.71, stdev=29653.57 clat percentiles (usec): | 1.00th=[ 48], 5.00th=[ 67], 10.00th=[ 77], 20.00th=[ 122], | 30.00th=[ 19006], 40.00th=[ 26870], 50.00th=[ 33424], 60.00th=[ 40109], | 70.00th=[ 45876], 80.00th=[ 58983], 90.00th=[ 70779], 95.00th=[ 85459], | 99.00th=[127402], 99.50th=[135267], 99.90th=[179307], 99.95th=[179307], | 99.99th=[179307] bw ( KiB/s): min= 95, max= 415, per=25.67%, avg=228.73, stdev=80.29, samples=51 iops : min= 5, max= 25, avg=13.53, stdev= 5.08, samples=51 write: IOPS=14, BW=238KiB/s (244kB/s)(6256KiB/26267msec); 0 zone resets clat (usec): min=1344, max=230348, avg=33228.82, stdev=33845.48 lat (usec): min=1344, max=230352, avg=33236.71, stdev=33843.13 clat percentiles (usec): | 1.00th=[ 1565], 5.00th=[ 2507], 10.00th=[ 3097], 20.00th=[ 5145], | 30.00th=[ 7832], 40.00th=[ 13698], 50.00th=[ 21365], 60.00th=[ 29754], | 70.00th=[ 41681], 80.00th=[ 63701], 90.00th=[ 81265], 95.00th=[ 99091], | 99.00th=[135267], 99.50th=[164627], 99.90th=[229639], 99.95th=[229639], | 99.99th=[229639] bw ( KiB/s): min= 96, max= 446, per=25.31%, avg=237.12, stdev=80.50, samples=51 iops : min= 6, max= 27, avg=14.04, stdev= 5.02, samples=51 lat (usec) : 50=0.65%, 100=7.42%, 250=3.91%, 500=0.78%, 750=0.13% lat (msec) : 2=1.95%, 4=6.64%, 10=9.38%, 20=8.59%, 50=34.51% lat (msec) : 100=22.01%, 250=4.04% cpu : usr=0.10%, sys=7.09%, ctx=1511, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=891KiB/s (913kB/s), 217KiB/s-233KiB/s (222kB/s-238kB/s), io=23.4MiB (24.5MB), run=25955-26869msec WRITE: bw=938KiB/s (960kB/s), 224KiB/s-247KiB/s (230kB/s-253kB/s), io=24.6MiB (25.8MB), run=25955-26869msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144894: Sat Sep 5 09:13:28 2026 read: IOPS=5, BW=92.9KiB/s (95.2kB/s)(5920KiB/63692msec) clat (msec): min=6, max=197, avg=35.91, stdev=34.84 lat (msec): min=6, max=197, avg=35.91, stdev=34.84 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 16], | 30.00th=[ 19], 40.00th=[ 21], 50.00th=[ 23], 60.00th=[ 28], | 70.00th=[ 33], 80.00th=[ 45], 90.00th=[ 80], 95.00th=[ 113], | 99.00th=[ 186], 99.50th=[ 194], 99.90th=[ 199], 99.95th=[ 199], | 99.99th=[ 199] bw ( KiB/s): min= 30, max= 382, per=26.61%, avg=99.50, stdev=65.52, samples=117 iops : min= 1, max= 23, avg= 5.42, stdev= 4.13, samples=117 write: IOPS=6, BW=99.0KiB/s (102kB/s)(6368KiB/63692msec); 0 zone resets clat (msec): min=46, max=420, avg=125.77, stdev=59.01 lat (msec): min=46, max=420, avg=125.77, stdev=59.02 clat percentiles (msec): | 1.00th=[ 50], 5.00th=[ 66], 10.00th=[ 71], 20.00th=[ 83], | 30.00th=[ 90], 40.00th=[ 97], 50.00th=[ 110], 60.00th=[ 124], | 70.00th=[ 138], 80.00th=[ 161], 90.00th=[ 203], 95.00th=[ 245], | 99.00th=[ 368], 99.50th=[ 388], 99.90th=[ 422], 99.95th=[ 422], | 99.99th=[ 422] bw ( KiB/s): min= 30, max= 222, per=25.51%, avg=100.25, stdev=44.46, samples=125 iops : min= 1, max= 13, avg= 5.46, stdev= 2.86, samples=125 lat (msec) : 10=1.43%, 20=16.28%, 50=23.31%, 100=26.30%, 250=30.47% lat (msec) : 500=2.21% cpu : usr=0.05%, sys=1.47%, ctx=1419, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144895: Sat Sep 5 09:13:28 2026 read: IOPS=5, BW=89.7KiB/s (91.9kB/s)(5744KiB/64017msec) clat (msec): min=8, max=288, avg=36.54, stdev=36.56 lat (msec): min=8, max=288, avg=36.54, stdev=36.56 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 12], 10.00th=[ 13], 20.00th=[ 16], | 30.00th=[ 18], 40.00th=[ 21], 50.00th=[ 23], 60.00th=[ 30], | 70.00th=[ 36], 80.00th=[ 47], 90.00th=[ 78], 95.00th=[ 120], | 99.00th=[ 201], 99.50th=[ 236], 99.90th=[ 288], 99.95th=[ 288], | 99.99th=[ 288] bw ( KiB/s): min= 31, max= 382, per=27.62%, avg=103.31, stdev=64.16, samples=110 iops : min= 1, max= 23, avg= 5.67, stdev= 4.10, samples=110 write: IOPS=6, BW=102KiB/s (105kB/s)(6544KiB/64017msec); 0 zone resets clat (msec): min=40, max=383, avg=123.96, stdev=57.87 lat (msec): min=40, max=384, avg=123.96, stdev=57.87 clat percentiles (msec): | 1.00th=[ 49], 5.00th=[ 60], 10.00th=[ 67], 20.00th=[ 78], | 30.00th=[ 88], 40.00th=[ 100], 50.00th=[ 109], 60.00th=[ 124], | 70.00th=[ 140], 80.00th=[ 161], 90.00th=[ 205], 95.00th=[ 247], | 99.00th=[ 326], 99.50th=[ 338], 99.90th=[ 384], 99.95th=[ 384], | 99.99th=[ 384] bw ( KiB/s): min= 30, max= 221, per=26.08%, avg=102.48, stdev=46.16, samples=126 iops : min= 1, max= 13, avg= 5.60, stdev= 2.96, samples=126 lat (msec) : 10=0.78%, 20=16.93%, 50=21.88%, 100=25.91%, 250=31.77% lat (msec) : 500=2.73% cpu : usr=0.04%, sys=1.49%, ctx=1364, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144896: Sat Sep 5 09:13:28 2026 read: IOPS=6, BW=102KiB/s (104kB/s)(6256KiB/61453msec) clat (msec): min=7, max=241, avg=33.14, stdev=31.59 lat (msec): min=7, max=241, avg=33.14, stdev=31.59 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 12], 20.00th=[ 15], | 30.00th=[ 17], 40.00th=[ 20], 50.00th=[ 23], 60.00th=[ 27], | 70.00th=[ 33], 80.00th=[ 43], 90.00th=[ 70], 95.00th=[ 102], | 99.00th=[ 157], 99.50th=[ 220], 99.90th=[ 243], 99.95th=[ 243], | 99.99th=[ 243] bw ( KiB/s): min= 31, max= 381, per=28.94%, avg=108.25, stdev=75.39, samples=114 iops : min= 1, max= 23, avg= 5.97, stdev= 4.73, samples=114 write: IOPS=6, BW=98.2KiB/s (101kB/s)(6032KiB/61453msec); 0 zone resets clat (msec): min=43, max=409, avg=128.46, stdev=59.43 lat (msec): min=43, max=409, avg=128.46, stdev=59.43 clat percentiles (msec): | 1.00th=[ 50], 5.00th=[ 62], 10.00th=[ 69], 20.00th=[ 84], | 30.00th=[ 92], 40.00th=[ 102], 50.00th=[ 113], 60.00th=[ 126], | 70.00th=[ 146], 80.00th=[ 171], 90.00th=[ 211], 95.00th=[ 247], | 99.00th=[ 330], 99.50th=[ 376], 99.90th=[ 409], 99.95th=[ 409], | 99.99th=[ 409] bw ( KiB/s): min= 30, max= 192, per=24.95%, avg=98.07, stdev=42.24, samples=120 iops : min= 1, max= 12, avg= 5.33, stdev= 2.74, samples=120 lat (msec) : 10=1.56%, 20=20.44%, 50=21.74%, 100=23.57%, 250=30.34% lat (msec) : 500=2.34% cpu : usr=0.07%, sys=1.46%, ctx=1398, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144897: Sat Sep 5 09:13:28 2026 read: IOPS=6, BW=97.4KiB/s (99.8kB/s)(6032KiB/61904msec) clat (msec): min=6, max=235, avg=34.28, stdev=32.75 lat (msec): min=6, max=235, avg=34.28, stdev=32.75 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 12], 10.00th=[ 13], 20.00th=[ 15], | 30.00th=[ 17], 40.00th=[ 20], 50.00th=[ 23], 60.00th=[ 27], | 70.00th=[ 33], 80.00th=[ 46], 90.00th=[ 74], 95.00th=[ 112], | 99.00th=[ 174], 99.50th=[ 182], 99.90th=[ 236], 99.95th=[ 236], | 99.99th=[ 236] bw ( KiB/s): min= 31, max= 288, per=29.04%, avg=108.61, stdev=70.92, samples=108 iops : min= 1, max= 18, avg= 6.00, stdev= 4.50, samples=108 write: IOPS=6, BW=101KiB/s (103kB/s)(6256KiB/61904msec); 0 zone resets clat (msec): min=48, max=372, avg=124.56, stdev=60.00 lat (msec): min=48, max=372, avg=124.56, stdev=60.00 clat percentiles (msec): | 1.00th=[ 50], 5.00th=[ 62], 10.00th=[ 68], 20.00th=[ 80], | 30.00th=[ 90], 40.00th=[ 100], 50.00th=[ 107], 60.00th=[ 120], | 70.00th=[ 134], 80.00th=[ 157], 90.00th=[ 211], 95.00th=[ 257], | 99.00th=[ 359], 99.50th=[ 359], 99.90th=[ 372], 99.95th=[ 372], | 99.99th=[ 372] bw ( KiB/s): min= 30, max= 192, per=25.76%, avg=101.24, stdev=44.46, samples=121 iops : min= 1, max= 12, avg= 5.52, stdev= 2.88, samples=121 lat (msec) : 10=0.78%, 20=19.53%, 50=20.83%, 100=26.17%, 250=29.95% lat (msec) : 500=2.73% cpu : usr=0.05%, sys=1.39%, ctx=1327, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=374KiB/s (383kB/s), 89.7KiB/s-102KiB/s (91.9kB/s-104kB/s), io=23.4MiB (24.5MB), run=61453-64017msec WRITE: bw=394KiB/s (403kB/s), 98.2KiB/s-102KiB/s (101kB/s-105kB/s), io=24.6MiB (25.8MB), run=61453-64017msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144917: Sat Sep 5 09:13:42 2026 read: IOPS=1, BW=1728KiB/s (1770kB/s)(7168KiB/4147msec) clat (usec): min=1551, max=487687, avg=277088.10, stdev=158432.99 lat (usec): min=1553, max=487689, avg=277090.39, stdev=158432.93 clat percentiles (usec): | 1.00th=[ 1549], 5.00th=[ 1549], 10.00th=[ 1549], 20.00th=[229639], | 30.00th=[231736], 40.00th=[231736], 50.00th=[242222], 60.00th=[316670], | 70.00th=[316670], 80.00th=[429917], 90.00th=[488637], 95.00th=[488637], | 99.00th=[488637], 99.50th=[488637], 99.90th=[488637], 99.95th=[488637], | 99.99th=[488637] bw ( KiB/s): min= 1875, max= 4063, per=66.99%, avg=2983.25, stdev=1247.01, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 1.15, samples=4 write: IOPS=1, BW=1235KiB/s (1264kB/s)(5120KiB/4147msec); 0 zone resets clat (msec): min=318, max=495, avg=413.01, stdev=68.03 lat (msec): min=318, max=495, avg=413.80, stdev=67.56 clat percentiles (msec): | 1.00th=[ 317], 5.00th=[ 317], 10.00th=[ 317], 20.00th=[ 317], | 30.00th=[ 376], 40.00th=[ 376], 50.00th=[ 426], 60.00th=[ 426], | 70.00th=[ 451], 80.00th=[ 451], 90.00th=[ 498], 95.00th=[ 498], | 99.00th=[ 498], 99.50th=[ 498], 99.90th=[ 498], 99.95th=[ 498], | 99.99th=[ 498] bw ( KiB/s): min= 1753, max= 2039, per=30.93%, avg=1928.00, stdev=124.58, samples=4 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=4 lat (msec) : 2=8.33%, 250=25.00%, 500=66.67% cpu : usr=0.00%, sys=15.17%, ctx=317, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144918: Sat Sep 5 09:13:42 2026 read: IOPS=0, BW=445KiB/s (456kB/s)(2048KiB/4599msec) clat (usec): min=1609, max=293993, avg=147801.38, stdev=206746.32 lat (usec): min=1610, max=293995, avg=147803.16, stdev=206747.86 clat percentiles (usec): | 1.00th=[ 1614], 5.00th=[ 1614], 10.00th=[ 1614], 20.00th=[ 1614], | 30.00th=[ 1614], 40.00th=[ 1614], 50.00th=[ 1614], 60.00th=[295699], | 70.00th=[295699], 80.00th=[295699], 90.00th=[295699], 95.00th=[295699], | 99.00th=[295699], 99.50th=[295699], 99.90th=[295699], 99.95th=[295699], | 99.99th=[295699] bw ( KiB/s): min= 1988, max= 2031, per=45.13%, avg=2009.50, stdev=30.41, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2227KiB/s (2280kB/s)(10.0MiB/4599msec); 0 zone resets clat (msec): min=93, max=841, avg=400.23, stdev=237.14 lat (msec): min=93, max=841, avg=400.54, stdev=237.07 clat percentiles (msec): | 1.00th=[ 94], 5.00th=[ 94], 10.00th=[ 94], 20.00th=[ 224], | 30.00th=[ 230], 40.00th=[ 309], 50.00th=[ 334], 60.00th=[ 376], | 70.00th=[ 405], 80.00th=[ 418], 90.00th=[ 776], 95.00th=[ 844], | 99.00th=[ 844], 99.50th=[ 844], 99.90th=[ 844], 99.95th=[ 844], | 99.99th=[ 844] bw ( KiB/s): min= 1753, max= 6095, per=50.38%, avg=3140.60, stdev=1857.41, samples=5 iops : min= 1, max= 5, avg= 2.20, stdev= 1.79, samples=5 lat (msec) : 2=8.33%, 100=8.33%, 250=16.67%, 500=50.00%, 1000=16.67% cpu : usr=0.02%, sys=17.22%, ctx=235, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144919: Sat Sep 5 09:13:42 2026 read: IOPS=1, BW=1479KiB/s (1515kB/s)(6144KiB/4153msec) clat (msec): min=5, max=486, avg=264.42, stdev=157.39 lat (msec): min=5, max=486, avg=264.43, stdev=157.39 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 6], 10.00th=[ 6], 20.00th=[ 222], | 30.00th=[ 222], 40.00th=[ 243], 50.00th=[ 243], 60.00th=[ 305], | 70.00th=[ 326], 80.00th=[ 326], 90.00th=[ 485], 95.00th=[ 485], | 99.00th=[ 485], 99.50th=[ 485], 99.90th=[ 485], 99.95th=[ 485], | 99.99th=[ 485] bw ( KiB/s): min= 1917, max= 4087, per=75.30%, avg=3353.00, stdev=1243.72, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 write: IOPS=1, BW=1479KiB/s (1515kB/s)(6144KiB/4153msec); 0 zone resets clat (msec): min=255, max=928, avg=419.19, stdev=251.64 lat (msec): min=255, max=928, avg=419.61, stdev=251.55 clat percentiles (msec): | 1.00th=[ 255], 5.00th=[ 255], 10.00th=[ 255], 20.00th=[ 317], | 30.00th=[ 317], 40.00th=[ 334], 50.00th=[ 334], 60.00th=[ 334], | 70.00th=[ 351], 80.00th=[ 351], 90.00th=[ 927], 95.00th=[ 927], | 99.00th=[ 927], 99.50th=[ 927], 99.90th=[ 927], 99.95th=[ 927], | 99.99th=[ 927] bw ( KiB/s): min= 1783, max= 2748, per=33.55%, avg=2091.80, stdev=378.26, samples=5 iops : min= 1, max= 2, avg= 1.20, stdev= 0.45, samples=5 lat (msec) : 10=8.33%, 250=16.67%, 500=66.67%, 1000=8.33% cpu : usr=0.00%, sys=16.14%, ctx=207, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144920: Sat Sep 5 09:13:42 2026 read: IOPS=1, BW=1322KiB/s (1353kB/s)(5120KiB/3874msec) clat (usec): min=879, max=319810, avg=118016.89, stdev=157813.70 lat (usec): min=880, max=319811, avg=118018.52, stdev=157814.06 clat percentiles (usec): | 1.00th=[ 881], 5.00th=[ 881], 10.00th=[ 881], 20.00th=[ 881], | 30.00th=[ 1139], 40.00th=[ 1139], 50.00th=[ 9634], 60.00th=[ 9634], | 70.00th=[258999], 80.00th=[258999], 90.00th=[320865], 95.00th=[320865], | 99.00th=[320865], 99.50th=[320865], 99.90th=[320865], 99.95th=[320865], | 99.99th=[320865] bw ( KiB/s): min= 2039, max= 5965, per=89.87%, avg=4002.00, stdev=2776.10, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 write: IOPS=1, BW=1850KiB/s (1895kB/s)(7168KiB/3874msec); 0 zone resets clat (msec): min=221, max=1103, avg=464.58, stdev=303.94 lat (msec): min=221, max=1103, avg=464.79, stdev=303.89 clat percentiles (msec): | 1.00th=[ 222], 5.00th=[ 222], 10.00th=[ 222], 20.00th=[ 262], | 30.00th=[ 313], 40.00th=[ 313], 50.00th=[ 330], 60.00th=[ 506], | 70.00th=[ 506], 80.00th=[ 518], 90.00th=[ 1099], 95.00th=[ 1099], | 99.00th=[ 1099], 99.50th=[ 1099], 99.90th=[ 1099], 99.95th=[ 1099], | 99.99th=[ 1099] bw ( KiB/s): min= 1753, max= 3864, per=37.43%, avg=2333.40, stdev=863.51, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 lat (usec) : 1000=8.33% lat (msec) : 2=8.33%, 10=8.33%, 250=8.33%, 500=41.67%, 750=16.67% lat (msec) : 2000=8.33% cpu : usr=0.00%, sys=13.35%, ctx=185, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4453KiB/s (4560kB/s), 445KiB/s-1728KiB/s (456kB/s-1770kB/s), io=20.0MiB (20.0MB), run=3874-4599msec WRITE: bw=6234KiB/s (6384kB/s), 1235KiB/s-2227KiB/s (1264kB/s-2280kB/s), io=28.0MiB (29.4MB), run=3874-4599msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144921: Sat Sep 5 09:13:43 2026 read: IOPS=1, BW=1507KiB/s (1543kB/s)(7168KiB/4757msec) clat (msec): min=126, max=1071, avg=314.69, stdev=341.07 lat (msec): min=126, max=1071, avg=314.69, stdev=341.07 clat percentiles (msec): | 1.00th=[ 128], 5.00th=[ 128], 10.00th=[ 128], 20.00th=[ 129], | 30.00th=[ 157], 40.00th=[ 157], 50.00th=[ 184], 60.00th=[ 203], | 70.00th=[ 203], 80.00th=[ 334], 90.00th=[ 1070], 95.00th=[ 1070], | 99.00th=[ 1070], 99.50th=[ 1070], 99.90th=[ 1070], 99.95th=[ 1070], | 99.99th=[ 1070] bw ( KiB/s): min= 1969, max= 4096, per=64.35%, avg=2430.00, stdev=931.77, samples=5 iops : min= 1, max= 4, avg= 1.60, stdev= 1.34, samples=5 write: IOPS=1, BW=1076KiB/s (1102kB/s)(5120KiB/4757msec); 0 zone resets clat (msec): min=212, max=739, avg=499.05, stdev=257.64 lat (msec): min=212, max=739, avg=499.20, stdev=257.66 clat percentiles (msec): | 1.00th=[ 213], 5.00th=[ 213], 10.00th=[ 213], 20.00th=[ 213], | 30.00th=[ 232], 40.00th=[ 232], 50.00th=[ 609], 60.00th=[ 609], | 70.00th=[ 701], 80.00th=[ 701], 90.00th=[ 743], 95.00th=[ 743], | 99.00th=[ 743], 99.50th=[ 743], 99.90th=[ 743], 99.95th=[ 743], | 99.99th=[ 743] bw ( KiB/s): min= 1932, max= 4015, per=47.17%, avg=2493.75, stdev=1015.28, samples=4 iops : min= 1, max= 3, avg= 1.75, stdev= 0.96, samples=4 lat (msec) : 250=58.33%, 500=8.33%, 750=25.00%, 2000=8.33% cpu : usr=0.00%, sys=5.59%, ctx=104, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144922: Sat Sep 5 09:13:43 2026 read: IOPS=0, BW=378KiB/s (387kB/s)(2048KiB/5423msec) clat (msec): min=223, max=555, avg=389.64, stdev=234.93 lat (msec): min=223, max=555, avg=389.64, stdev=234.93 clat percentiles (msec): | 1.00th=[ 224], 5.00th=[ 224], 10.00th=[ 224], 20.00th=[ 224], | 30.00th=[ 224], 40.00th=[ 224], 50.00th=[ 224], 60.00th=[ 558], | 70.00th=[ 558], 80.00th=[ 558], 90.00th=[ 558], 95.00th=[ 558], | 99.00th=[ 558], 99.50th=[ 558], 99.90th=[ 558], 99.95th=[ 558], | 99.99th=[ 558] bw ( KiB/s): min= 2007, max= 2048, per=53.69%, avg=2027.50, stdev=28.99, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 write: IOPS=1, BW=1888KiB/s (1934kB/s)(10.0MiB/5423msec); 0 zone resets clat (msec): min=148, max=1362, avg=438.45, stdev=375.87 lat (msec): min=148, max=1363, avg=438.57, stdev=375.88 clat percentiles (msec): | 1.00th=[ 148], 5.00th=[ 148], 10.00th=[ 148], 20.00th=[ 178], | 30.00th=[ 209], 40.00th=[ 213], 50.00th=[ 264], 60.00th=[ 284], | 70.00th=[ 481], 80.00th=[ 493], 90.00th=[ 760], 95.00th=[ 1368], | 99.00th=[ 1368], 99.50th=[ 1368], 99.90th=[ 1368], 99.95th=[ 1368], | 99.99th=[ 1368] bw ( KiB/s): min= 1932, max= 4087, per=60.88%, avg=3218.60, stdev=1153.05, samples=5 iops : min= 1, max= 3, avg= 2.20, stdev= 1.10, samples=5 lat (msec) : 250=41.67%, 500=33.33%, 750=8.33%, 1000=8.33%, 2000=8.33% cpu : usr=0.00%, sys=4.65%, ctx=105, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144923: Sat Sep 5 09:13:43 2026 read: IOPS=1, BW=1172KiB/s (1200kB/s)(6144KiB/5241msec) clat (msec): min=77, max=806, avg=278.74, stdev=277.41 lat (msec): min=77, max=806, avg=278.75, stdev=277.41 clat percentiles (msec): | 1.00th=[ 78], 5.00th=[ 78], 10.00th=[ 78], 20.00th=[ 88], | 30.00th=[ 88], 40.00th=[ 114], 50.00th=[ 114], 60.00th=[ 264], | 70.00th=[ 326], 80.00th=[ 326], 90.00th=[ 810], 95.00th=[ 810], | 99.00th=[ 810], 99.50th=[ 810], 99.90th=[ 810], 99.95th=[ 810], | 99.99th=[ 810] bw ( KiB/s): min= 1917, max= 4079, per=70.93%, avg=2678.33, stdev=1214.55, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 write: IOPS=1, BW=1172KiB/s (1200kB/s)(6144KiB/5241msec); 0 zone resets clat (msec): min=150, max=989, avg=562.64, stdev=333.90 lat (msec): min=150, max=989, avg=562.76, stdev=333.89 clat percentiles (msec): | 1.00th=[ 150], 5.00th=[ 150], 10.00th=[ 150], 20.00th=[ 220], | 30.00th=[ 220], 40.00th=[ 489], 50.00th=[ 489], 60.00th=[ 743], | 70.00th=[ 785], 80.00th=[ 785], 90.00th=[ 986], 95.00th=[ 986], | 99.00th=[ 986], 99.50th=[ 986], 99.90th=[ 986], 99.95th=[ 986], | 99.99th=[ 986] bw ( KiB/s): min= 1848, max= 2039, per=37.44%, avg=1979.50, stdev=90.42, samples=4 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=4 lat (msec) : 100=16.67%, 250=25.00%, 500=25.00%, 750=8.33%, 1000=25.00% cpu : usr=0.00%, sys=4.33%, ctx=106, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144924: Sat Sep 5 09:13:43 2026 read: IOPS=0, BW=945KiB/s (967kB/s)(5120KiB/5419msec) clat (msec): min=97, max=742, avg=345.16, stdev=276.83 lat (msec): min=97, max=742, avg=345.17, stdev=276.83 clat percentiles (msec): | 1.00th=[ 97], 5.00th=[ 97], 10.00th=[ 97], 20.00th=[ 97], | 30.00th=[ 113], 40.00th=[ 113], 50.00th=[ 264], 60.00th=[ 264], | 70.00th=[ 510], 80.00th=[ 510], 90.00th=[ 743], 95.00th=[ 743], | 99.00th=[ 743], 99.50th=[ 743], 99.90th=[ 743], 99.95th=[ 743], | 99.99th=[ 743] bw ( KiB/s): min= 1992, max= 3835, per=69.44%, avg=2622.00, stdev=1050.75, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 write: IOPS=1, BW=1323KiB/s (1354kB/s)(7168KiB/5419msec); 0 zone resets clat (msec): min=124, max=1340, avg=509.65, stdev=425.89 lat (msec): min=124, max=1340, avg=509.75, stdev=425.88 clat percentiles (msec): | 1.00th=[ 125], 5.00th=[ 125], 10.00th=[ 125], 20.00th=[ 190], | 30.00th=[ 224], 40.00th=[ 224], 50.00th=[ 368], 60.00th=[ 651], | 70.00th=[ 651], 80.00th=[ 667], 90.00th=[ 1334], 95.00th=[ 1334], | 99.00th=[ 1334], 99.50th=[ 1334], 99.90th=[ 1334], 99.95th=[ 1334], | 99.99th=[ 1334] bw ( KiB/s): min= 2035, max= 4047, per=57.13%, avg=3020.50, stdev=1136.19, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 1.15, samples=4 lat (msec) : 100=8.33%, 250=33.33%, 500=16.67%, 750=33.33%, 2000=8.33% cpu : usr=0.02%, sys=5.22%, ctx=109, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3777KiB/s (3867kB/s), 378KiB/s-1507KiB/s (387kB/s-1543kB/s), io=20.0MiB (20.0MB), run=4757-5423msec WRITE: bw=5287KiB/s (5414kB/s), 1076KiB/s-1888KiB/s (1102kB/s-1934kB/s), io=28.0MiB (29.4MB), run=4757-5423msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144934: Sat Sep 5 09:13:58 2026 read: IOPS=1, BW=4324KiB/s (4427kB/s)(12.0MiB/2842msec) clat (msec): min=675, max=1141, avg=931.15, stdev=236.12 lat (msec): min=675, max=1141, avg=931.15, stdev=236.12 clat percentiles (msec): | 1.00th=[ 676], 5.00th=[ 676], 10.00th=[ 676], 20.00th=[ 676], | 30.00th=[ 676], 40.00th=[ 978], 50.00th=[ 978], 60.00th=[ 978], | 70.00th=[ 1150], 80.00th=[ 1150], 90.00th=[ 1150], 95.00th=[ 1150], | 99.00th=[ 1150], 99.50th=[ 1150], 99.90th=[ 1150], 99.95th=[ 1150], | 99.99th=[ 1150] bw ( KiB/s): min= 8143, max= 8175, per=100.00%, avg=8159.00, stdev=22.63, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=12.92%, ctx=273, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144936: Sat Sep 5 09:13:58 2026 read: IOPS=0, BW=1323KiB/s (1355kB/s)(4096KiB/3096msec) clat (nsec): min=1018.2M, max=1018.2M, avg=1018188627.00, stdev= 0.00 lat (nsec): min=1018.2M, max=1018.2M, avg=1018191601.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1020], 5.00th=[ 1020], 10.00th=[ 1020], 20.00th=[ 1020], | 30.00th=[ 1020], 40.00th=[ 1020], 50.00th=[ 1020], 60.00th=[ 1020], | 70.00th=[ 1020], 80.00th=[ 1020], 90.00th=[ 1020], 95.00th=[ 1020], | 99.00th=[ 1020], 99.50th=[ 1020], 99.90th=[ 1020], 99.95th=[ 1020], | 99.99th=[ 1020] bw ( KiB/s): min= 7670, max= 7670, per=100.00%, avg=7670.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2646KiB/s (2709kB/s)(8192KiB/3096msec); 0 zone resets clat (msec): min=837, max=1180, avg=1008.84, stdev=242.72 lat (msec): min=837, max=1180, avg=1009.35, stdev=242.59 clat percentiles (msec): | 1.00th=[ 835], 5.00th=[ 835], 10.00th=[ 835], 20.00th=[ 835], | 30.00th=[ 835], 40.00th=[ 835], 50.00th=[ 835], 60.00th=[ 1183], | 70.00th=[ 1183], 80.00th=[ 1183], 90.00th=[ 1183], 95.00th=[ 1183], | 99.00th=[ 1183], 99.50th=[ 1183], 99.90th=[ 1183], 99.95th=[ 1183], | 99.99th=[ 1183] bw ( KiB/s): min= 8000, max= 8000, per=91.31%, avg=8000.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 1000=33.33%, 2000=66.67% cpu : usr=0.00%, sys=3.75%, ctx=97, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144937: Sat Sep 5 09:13:58 2026 write: IOPS=0, BW=3286KiB/s (3364kB/s)(12.0MiB/3740msec); 0 zone resets clat (msec): min=547, max=1935, avg=1218.52, stdev=695.36 lat (msec): min=548, max=1936, avg=1219.15, stdev=695.57 clat percentiles (msec): | 1.00th=[ 550], 5.00th=[ 550], 10.00th=[ 550], 20.00th=[ 550], | 30.00th=[ 550], 40.00th=[ 1167], 50.00th=[ 1167], 60.00th=[ 1167], | 70.00th=[ 1938], 80.00th=[ 1938], 90.00th=[ 1938], 95.00th=[ 1938], | 99.00th=[ 1938], 99.50th=[ 1938], 99.90th=[ 1938], 99.95th=[ 1938], | 99.99th=[ 1938] bw ( KiB/s): min= 7984, max= 8175, per=92.22%, avg=8079.50, stdev=135.06, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 2000=66.67% cpu : usr=0.00%, sys=3.69%, ctx=51, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144938: Sat Sep 5 09:13:58 2026 write: IOPS=1, BW=4470KiB/s (4577kB/s)(12.0MiB/2749msec); 0 zone resets clat (msec): min=310, max=1713, avg=879.14, stdev=737.95 lat (msec): min=311, max=1713, avg=879.83, stdev=737.91 clat percentiles (msec): | 1.00th=[ 313], 5.00th=[ 313], 10.00th=[ 313], 20.00th=[ 313], | 30.00th=[ 313], 40.00th=[ 617], 50.00th=[ 617], 60.00th=[ 617], | 70.00th=[ 1720], 80.00th=[ 1720], 90.00th=[ 1720], 95.00th=[ 1720], | 99.00th=[ 1720], 99.50th=[ 1720], 99.90th=[ 1720], 99.95th=[ 1720], | 99.99th=[ 1720] bw ( KiB/s): min= 5354, max= 5354, per=61.11%, avg=5354.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.00%, sys=4.95%, ctx=69, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5292KiB/s (5419kB/s), 1323KiB/s-4324KiB/s (1355kB/s-4427kB/s), io=16.0MiB (16.8MB), run=2842-3096msec WRITE: bw=8761KiB/s (8972kB/s), 2646KiB/s-4470KiB/s (2709kB/s-4577kB/s), io=32.0MiB (33.6MB), run=2749-3740msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144931: Sat Sep 5 09:13:59 2026 read: IOPS=1, BW=5469KiB/s (5600kB/s)(12.0MiB/2247msec) clat (msec): min=557, max=929, avg=714.54, stdev=192.68 lat (msec): min=557, max=929, avg=714.54, stdev=192.68 clat percentiles (msec): | 1.00th=[ 558], 5.00th=[ 558], 10.00th=[ 558], 20.00th=[ 558], | 30.00th=[ 558], 40.00th=[ 659], 50.00th=[ 659], 60.00th=[ 659], | 70.00th=[ 927], 80.00th=[ 927], 90.00th=[ 927], 95.00th=[ 927], | 99.00th=[ 927], 99.50th=[ 927], 99.90th=[ 927], 99.95th=[ 927], | 99.99th=[ 927] bw ( KiB/s): min= 7557, max= 7984, per=100.00%, avg=7770.50, stdev=301.93, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=66.67%, 1000=33.33% cpu : usr=0.00%, sys=4.45%, ctx=76, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144932: Sat Sep 5 09:13:59 2026 read: IOPS=0, BW=1071KiB/s (1096kB/s)(4096KiB/3826msec) clat (nsec): min=1528.9M, max=1528.9M, avg=1528909922.00, stdev= 0.00 lat (nsec): min=1528.9M, max=1528.9M, avg=1528911863.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1536], 5.00th=[ 1536], 10.00th=[ 1536], 20.00th=[ 1536], | 30.00th=[ 1536], 40.00th=[ 1536], 50.00th=[ 1536], 60.00th=[ 1536], | 70.00th=[ 1536], 80.00th=[ 1536], 90.00th=[ 1536], 95.00th=[ 1536], | 99.00th=[ 1536], 99.50th=[ 1536], 99.90th=[ 1536], 99.95th=[ 1536], | 99.99th=[ 1536] bw ( KiB/s): min= 8000, max= 8000, per=100.00%, avg=8000.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2141KiB/s (2193kB/s)(8192KiB/3826msec); 0 zone resets clat (msec): min=1095, max=1133, avg=1114.46, stdev=27.24 lat (msec): min=1097, max=1134, avg=1115.96, stdev=25.90 clat percentiles (msec): | 1.00th=[ 1099], 5.00th=[ 1099], 10.00th=[ 1099], 20.00th=[ 1099], | 30.00th=[ 1099], 40.00th=[ 1099], 50.00th=[ 1099], 60.00th=[ 1133], | 70.00th=[ 1133], 80.00th=[ 1133], 90.00th=[ 1133], 95.00th=[ 1133], | 99.00th=[ 1133], 99.50th=[ 1133], 99.90th=[ 1133], 99.95th=[ 1133], | 99.99th=[ 1133] bw ( KiB/s): min= 8078, max= 8078, per=100.00%, avg=8078.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 2000=100.00% cpu : usr=0.00%, sys=2.64%, ctx=49, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144933: Sat Sep 5 09:13:59 2026 write: IOPS=0, BW=3006KiB/s (3078kB/s)(12.0MiB/4088msec); 0 zone resets clat (msec): min=456, max=2188, avg=1336.24, stdev=866.03 lat (msec): min=457, max=2189, avg=1338.77, stdev=866.24 clat percentiles (msec): | 1.00th=[ 456], 5.00th=[ 456], 10.00th=[ 456], 20.00th=[ 456], | 30.00th=[ 456], 40.00th=[ 1368], 50.00th=[ 1368], 60.00th=[ 1368], | 70.00th=[ 2198], 80.00th=[ 2198], 90.00th=[ 2198], 95.00th=[ 2198], | 99.00th=[ 2198], 99.50th=[ 2198], 99.90th=[ 2198], 99.95th=[ 2198], | 99.99th=[ 2198] bw ( KiB/s): min= 8078, max= 8078, per=100.00%, avg=8078.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=2.54%, ctx=61, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144935: Sat Sep 5 09:13:59 2026 write: IOPS=0, BW=4074KiB/s (4172kB/s)(12.0MiB/3016msec); 0 zone resets clat (msec): min=255, max=1313, avg=937.45, stdev=591.90 lat (msec): min=255, max=1313, avg=938.09, stdev=591.90 clat percentiles (msec): | 1.00th=[ 255], 5.00th=[ 255], 10.00th=[ 255], 20.00th=[ 255], | 30.00th=[ 255], 40.00th=[ 1250], 50.00th=[ 1250], 60.00th=[ 1250], | 70.00th=[ 1318], 80.00th=[ 1318], 90.00th=[ 1318], 95.00th=[ 1318], | 99.00th=[ 1318], 99.50th=[ 1318], 99.90th=[ 1318], 99.95th=[ 1318], | 99.99th=[ 1318] bw ( KiB/s): min= 8000, max= 8078, per=100.00%, avg=8039.00, stdev=55.15, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.00%, sys=3.91%, ctx=60, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4282KiB/s (4385kB/s), 1071KiB/s-5469KiB/s (1096kB/s-5600kB/s), io=16.0MiB (16.8MB), run=2247-3826msec WRITE: bw=8016KiB/s (8208kB/s), 2141KiB/s-4074KiB/s (2193kB/s-4172kB/s), io=32.0MiB (33.6MB), run=3016-4088msec