== sanity test 398b: DIO and buffer IO race ============== 18:32:51 (1773613971) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 11.7278 s, 4.3 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=181442: Sun Mar 15 18:36:30 2026 read: IOPS=8, BW=32.0KiB/s (33.8kB/s)(5992KiB/181724msec) clat (usec): min=33, max=1257.2k, avg=68381.67, stdev=52215.96 lat (usec): min=33, max=1257.2k, avg=68384.08, stdev=52215.07 clat percentiles (usec): | 1.00th=[ 59], 5.00th=[ 17957], 10.00th=[ 26084], | 20.00th=[ 34866], 30.00th=[ 42730], 40.00th=[ 51643], | 50.00th=[ 59507], 60.00th=[ 69731], 70.00th=[ 81265], | 80.00th=[ 94897], 90.00th=[ 119014], 95.00th=[ 143655], | 99.00th=[ 227541], 99.50th=[ 261096], 99.90th=[ 304088], | 99.95th=[1249903], 99.99th=[1249903] bw ( KiB/s): min= 7, max= 71, per=25.19%, avg=32.49, stdev=13.28, samples=355 iops : min= 1, max= 17, avg= 7.45, stdev= 3.36, samples=355 write: IOPS=8, BW=34.6KiB/s (35.5kB/s)(6296KiB/181724msec); 0 zone resets clat (usec): min=1236, max=385574, avg=49956.38, stdev=49796.11 lat (usec): min=1236, max=385576, avg=49960.95, stdev=49794.87 clat percentiles (usec): | 1.00th=[ 1434], 5.00th=[ 1680], 10.00th=[ 2180], 20.00th=[ 6915], | 30.00th=[ 12911], 40.00th=[ 24249], 50.00th=[ 37487], 60.00th=[ 49021], | 70.00th=[ 64226], 80.00th=[ 85459], 90.00th=[120062], 95.00th=[147850], | 99.00th=[210764], 99.50th=[244319], 99.90th=[362808], 99.95th=[383779], | 99.99th=[383779] bw ( KiB/s): min= 7, max= 102, per=25.47%, avg=34.38, stdev=17.17, samples=353 iops : min= 1, max= 25, avg= 7.91, stdev= 4.33, samples=353 lat (usec) : 50=0.03%, 100=1.63%, 250=0.10%, 500=0.10%, 750=0.03% lat (msec) : 2=4.52%, 4=3.19%, 10=5.73%, 20=6.32%, 50=28.32% lat (msec) : 100=33.63%, 250=15.89%, 500=0.49%, 2000=0.03% cpu : usr=0.08%, sys=4.43%, ctx=6662, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181443: Sun Mar 15 18:36:30 2026 read: IOPS=8, BW=33.1KiB/s (33.9kB/s)(5940KiB/179673msec) clat (usec): min=37, max=1221.6k, avg=68690.66, stdev=53739.49 lat (usec): min=37, max=1221.6k, avg=68693.26, stdev=53738.47 clat percentiles (usec): | 1.00th=[ 58], 5.00th=[ 16188], 10.00th=[ 25822], | 20.00th=[ 34341], 30.00th=[ 42730], 40.00th=[ 52167], | 50.00th=[ 60556], 60.00th=[ 70779], 70.00th=[ 82314], | 80.00th=[ 93848], 90.00th=[ 117965], 95.00th=[ 141558], | 99.00th=[ 221250], 99.50th=[ 274727], 99.90th=[ 574620], | 99.95th=[1216349], 99.99th=[1216349] bw ( KiB/s): min= 7, max= 71, per=25.30%, avg=32.64, stdev=13.41, samples=350 iops : min= 1, max= 17, avg= 7.47, stdev= 3.38, samples=350 write: IOPS=8, BW=35.3KiB/s (36.2kB/s)(6348KiB/179673msec); 0 zone resets clat (usec): min=1136, max=432790, avg=48475.22, stdev=47431.19 lat (usec): min=1136, max=432800, avg=48486.56, stdev=47423.77 clat percentiles (usec): | 1.00th=[ 1401], 5.00th=[ 1663], 10.00th=[ 2278], 20.00th=[ 6718], | 30.00th=[ 12387], 40.00th=[ 23462], 50.00th=[ 36439], 60.00th=[ 51119], | 70.00th=[ 65274], 80.00th=[ 82314], 90.00th=[114820], 95.00th=[135267], | 99.00th=[191890], 99.50th=[233833], 99.90th=[325059], 99.95th=[434111], | 99.99th=[434111] bw ( KiB/s): min= 7, max= 95, per=26.08%, avg=35.21, stdev=16.64, samples=346 iops : min= 1, max= 23, avg= 8.13, stdev= 4.22, samples=346 lat (usec) : 50=0.13%, 100=1.69%, 250=0.03%, 500=0.13%, 750=0.03% lat (usec) : 1000=0.03% lat (msec) : 2=4.56%, 4=2.86%, 10=6.67%, 20=6.12%, 50=26.37% lat (msec) : 100=36.36%, 250=14.49%, 500=0.46%, 750=0.03%, 2000=0.03% cpu : usr=0.07%, sys=4.41%, ctx=6738, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181444: Sun Mar 15 18:36:30 2026 read: IOPS=8, BW=32.5KiB/s (33.3kB/s)(6028KiB/185537msec) clat (usec): min=35, max=481130, avg=67088.74, stdev=45502.47 lat (usec): min=35, max=481131, avg=67093.60, stdev=45503.14 clat percentiles (usec): | 1.00th=[ 57], 5.00th=[ 15533], 10.00th=[ 26084], 20.00th=[ 34866], | 30.00th=[ 41681], 40.00th=[ 49546], 50.00th=[ 56361], 60.00th=[ 66323], | 70.00th=[ 78119], 80.00th=[ 94897], 90.00th=[117965], 95.00th=[147850], | 99.00th=[244319], 99.50th=[263193], 99.90th=[387974], 99.95th=[480248], | 99.99th=[480248] bw ( KiB/s): min= 7, max= 102, per=24.96%, avg=32.20, stdev=15.23, samples=361 iops : min= 1, max= 25, avg= 7.37, stdev= 3.83, samples=361 write: IOPS=8, BW=33.7KiB/s (34.5kB/s)(6260KiB/185537msec); 0 zone resets clat (usec): min=1278, max=1149.2k, avg=53558.23, stdev=58745.10 lat (usec): min=1279, max=1149.2k, avg=53560.86, stdev=58745.43 clat percentiles (usec): | 1.00th=[ 1434], 5.00th=[ 1762], 10.00th=[ 2868], | 20.00th=[ 7635], 30.00th=[ 14615], 40.00th=[ 27919], | 50.00th=[ 39584], 60.00th=[ 51119], 70.00th=[ 68682], | 80.00th=[ 90702], 90.00th=[ 122160], 95.00th=[ 156238], | 99.00th=[ 229639], 99.50th=[ 261096], 99.90th=[ 429917], | 99.95th=[1149240], 99.99th=[1149240] bw ( KiB/s): min= 7, max= 94, per=25.26%, avg=34.11, stdev=16.32, samples=354 iops : min= 1, max= 23, avg= 7.84, stdev= 4.11, samples=354 lat (usec) : 50=0.10%, 100=1.63%, 250=0.20%, 500=0.07% lat (msec) : 2=3.78%, 4=2.31%, 10=6.45%, 20=6.15%, 50=29.52% lat (msec) : 100=32.58%, 250=16.44%, 500=0.75%, 2000=0.03% cpu : usr=0.07%, sys=4.37%, ctx=6819, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181445: Sun Mar 15 18:36:30 2026 read: IOPS=8, BW=33.2KiB/s (34.0kB/s)(6052KiB/182261msec) clat (usec): min=38, max=386657, avg=66374.33, stdev=42627.77 lat (usec): min=39, max=386659, avg=66378.59, stdev=42627.28 clat percentiles (usec): | 1.00th=[ 58], 5.00th=[ 269], 10.00th=[ 24773], 20.00th=[ 34341], | 30.00th=[ 41681], 40.00th=[ 49021], 50.00th=[ 56886], 60.00th=[ 67634], | 70.00th=[ 81265], 80.00th=[ 95945], 90.00th=[120062], 95.00th=[143655], | 99.00th=[204473], 99.50th=[217056], 99.90th=[358613], 99.95th=[387974], | 99.99th=[387974] bw ( KiB/s): min= 7, max= 80, per=25.35%, avg=32.71, stdev=14.53, samples=355 iops : min= 1, max= 20, avg= 7.50, stdev= 3.68, samples=355 write: IOPS=8, BW=34.2KiB/s (35.0kB/s)(6236KiB/182261msec); 0 zone resets clat (usec): min=985, max=1235.1k, avg=52076.20, stdev=59158.73 lat (usec): min=986, max=1235.1k, avg=52085.70, stdev=59155.34 clat percentiles (usec): | 1.00th=[ 1418], 5.00th=[ 1729], 10.00th=[ 2638], | 20.00th=[ 6652], 30.00th=[ 11994], 40.00th=[ 23987], | 50.00th=[ 36963], 60.00th=[ 50594], 70.00th=[ 69731], | 80.00th=[ 89654], 90.00th=[ 123208], 95.00th=[ 154141], | 99.00th=[ 210764], 99.50th=[ 238027], 99.90th=[ 383779], | 99.95th=[1233126], 99.99th=[1233126] bw ( KiB/s): min= 7, max= 102, per=25.25%, avg=34.09, stdev=17.19, samples=351 iops : min= 1, max= 25, avg= 7.85, stdev= 4.34, samples=351 lat (usec) : 50=0.13%, 100=2.05%, 250=0.20%, 500=0.16%, 1000=0.07% lat (msec) : 2=4.04%, 4=2.86%, 10=6.71%, 20=5.83%, 50=28.71% lat (msec) : 100=32.32%, 250=16.70%, 500=0.20%, 2000=0.03% cpu : usr=0.06%, sys=4.23%, ctx=6535, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=129KiB/s (133kB/s), 32.5KiB/s-33.2KiB/s (33.3kB/s-34.0kB/s), io=23.4MiB (24.6MB), run=179673-185537msec WRITE: bw=135KiB/s (139kB/s), 33.7KiB/s-35.3KiB/s (34.5kB/s-36.2kB/s), io=24.6MiB (25.7MB), run=179673-185537msec rand-rw: (groupid=0, jobs=1): err= 0: pid=181447: Sun Mar 15 18:37:31 2026 read: IOPS=6, BW=24.5KiB/s (25.1kB/s)(5992KiB/244402msec) clat (msec): min=7, max=1314, avg=63.45, stdev=64.77 lat (msec): min=7, max=1314, avg=63.46, stdev=64.77 clat percentiles (msec): | 1.00th=[ 12], 5.00th=[ 16], 10.00th=[ 20], 20.00th=[ 25], | 30.00th=[ 30], 40.00th=[ 35], 50.00th=[ 43], 60.00th=[ 51], | 70.00th=[ 65], 80.00th=[ 92], 90.00th=[ 142], 95.00th=[ 182], | 99.00th=[ 279], 99.50th=[ 317], 99.90th=[ 426], 99.95th=[ 1318], | 99.99th=[ 1318] bw ( KiB/s): min= 7, max= 95, per=26.39%, avg=25.60, stdev=17.58, samples=450 iops : min= 1, max= 23, avg= 5.70, stdev= 4.42, samples=450 write: IOPS=6, BW=25.8KiB/s (26.4kB/s)(6296KiB/244402msec); 0 zone resets clat (msec): min=15, max=469, avg=94.76, stdev=60.07 lat (msec): min=15, max=469, avg=94.76, stdev=60.07 clat percentiles (msec): | 1.00th=[ 25], 5.00th=[ 33], 10.00th=[ 38], 20.00th=[ 46], | 30.00th=[ 54], 40.00th=[ 65], 50.00th=[ 77], 60.00th=[ 92], | 70.00th=[ 112], 80.00th=[ 140], 90.00th=[ 180], 95.00th=[ 215], | 99.00th=[ 284], 99.50th=[ 317], 99.90th=[ 468], 99.95th=[ 468], | 99.99th=[ 468] bw ( KiB/s): min= 7, max= 103, per=25.46%, avg=25.97, stdev=15.86, samples=466 iops : min= 1, max= 25, avg= 5.79, stdev= 3.99, samples=466 lat (msec) : 10=0.29%, 20=5.18%, 50=36.49%, 100=31.54%, 250=24.64% lat (msec) : 500=1.82%, 2000=0.03% cpu : usr=0.05%, sys=1.68%, ctx=4930, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181448: Sun Mar 15 18:37:31 2026 read: IOPS=6, BW=24.2KiB/s (24.8kB/s)(5940KiB/245318msec) clat (msec): min=7, max=1412, avg=63.40, stdev=66.50 lat (msec): min=7, max=1412, avg=63.41, stdev=66.50 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 15], 10.00th=[ 18], 20.00th=[ 24], | 30.00th=[ 29], 40.00th=[ 35], 50.00th=[ 43], 60.00th=[ 52], | 70.00th=[ 67], 80.00th=[ 95], 90.00th=[ 138], 95.00th=[ 190], | 99.00th=[ 279], 99.50th=[ 292], 99.90th=[ 493], 99.95th=[ 1418], | 99.99th=[ 1418] bw ( KiB/s): min= 7, max= 103, per=26.41%, avg=25.61, stdev=17.61, samples=444 iops : min= 1, max= 25, avg= 5.71, stdev= 4.44, samples=444 write: IOPS=6, BW=25.9KiB/s (26.5kB/s)(6348KiB/245318msec); 0 zone resets clat (msec): min=12, max=589, avg=95.10, stdev=64.80 lat (msec): min=12, max=589, avg=95.10, stdev=64.80 clat percentiles (msec): | 1.00th=[ 23], 5.00th=[ 32], 10.00th=[ 37], 20.00th=[ 46], | 30.00th=[ 54], 40.00th=[ 63], 50.00th=[ 73], 60.00th=[ 88], | 70.00th=[ 111], 80.00th=[ 142], 90.00th=[ 184], 95.00th=[ 218], | 99.00th=[ 330], 99.50th=[ 388], 99.90th=[ 439], 99.95th=[ 592], | 99.99th=[ 592] bw ( KiB/s): min= 7, max= 104, per=25.58%, avg=26.09, stdev=16.64, samples=465 iops : min= 1, max= 26, avg= 5.82, stdev= 4.20, samples=465 lat (msec) : 10=0.42%, 20=6.28%, 50=35.19%, 100=31.41%, 250=24.48% lat (msec) : 500=2.15%, 750=0.03%, 2000=0.03% cpu : usr=0.06%, sys=1.71%, ctx=4957, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181449: Sun Mar 15 18:37:31 2026 read: IOPS=6, BW=24.7KiB/s (25.3kB/s)(6028KiB/243947msec) clat (msec): min=7, max=664, avg=62.59, stdev=57.89 lat (msec): min=7, max=664, avg=62.60, stdev=57.89 clat percentiles (msec): | 1.00th=[ 12], 5.00th=[ 16], 10.00th=[ 20], 20.00th=[ 26], | 30.00th=[ 31], 40.00th=[ 36], 50.00th=[ 43], 60.00th=[ 51], | 70.00th=[ 63], 80.00th=[ 90], 90.00th=[ 142], 95.00th=[ 182], | 99.00th=[ 257], 99.50th=[ 309], 99.90th=[ 498], 99.95th=[ 667], | 99.99th=[ 667] bw ( KiB/s): min= 7, max= 106, per=26.19%, avg=25.40, stdev=17.40, samples=456 iops : min= 1, max= 26, avg= 5.65, stdev= 4.39, samples=456 write: IOPS=6, BW=25.7KiB/s (26.3kB/s)(6260KiB/243947msec); 0 zone resets clat (msec): min=16, max=1440, avg=95.48, stdev=74.07 lat (msec): min=16, max=1440, avg=95.49, stdev=74.08 clat percentiles (msec): | 1.00th=[ 23], 5.00th=[ 31], 10.00th=[ 37], 20.00th=[ 46], | 30.00th=[ 53], 40.00th=[ 63], 50.00th=[ 73], 60.00th=[ 88], | 70.00th=[ 112], 80.00th=[ 140], 90.00th=[ 182], 95.00th=[ 222], | 99.00th=[ 309], 99.50th=[ 384], 99.90th=[ 617], 99.95th=[ 1435], | 99.99th=[ 1435] bw ( KiB/s): min= 7, max= 94, per=25.18%, avg=25.68, stdev=16.83, samples=468 iops : min= 1, max= 23, avg= 5.72, stdev= 4.24, samples=468 lat (msec) : 10=0.13%, 20=5.92%, 50=36.43%, 100=31.32%, 250=24.22% lat (msec) : 500=1.79%, 750=0.16%, 2000=0.03% cpu : usr=0.05%, sys=1.67%, ctx=4794, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181450: Sun Mar 15 18:37:31 2026 read: IOPS=6, BW=24.8KiB/s (25.4kB/s)(6052KiB/244221msec) clat (msec): min=7, max=482, avg=61.78, stdev=57.50 lat (msec): min=7, max=482, avg=61.78, stdev=57.50 clat percentiles (msec): | 1.00th=[ 12], 5.00th=[ 16], 10.00th=[ 19], 20.00th=[ 24], | 30.00th=[ 30], 40.00th=[ 36], 50.00th=[ 42], 60.00th=[ 51], | 70.00th=[ 64], 80.00th=[ 88], 90.00th=[ 134], 95.00th=[ 190], | 99.00th=[ 284], 99.50th=[ 351], 99.90th=[ 451], 99.95th=[ 481], | 99.99th=[ 481] bw ( KiB/s): min= 7, max= 103, per=27.07%, avg=26.25, stdev=18.76, samples=442 iops : min= 1, max= 25, avg= 5.86, stdev= 4.73, samples=442 write: IOPS=6, BW=25.5KiB/s (26.1kB/s)(6236KiB/244221msec); 0 zone resets clat (msec): min=18, max=1380, avg=96.53, stdev=74.75 lat (msec): min=18, max=1380, avg=96.54, stdev=74.75 clat percentiles (msec): | 1.00th=[ 25], 5.00th=[ 33], 10.00th=[ 38], 20.00th=[ 46], | 30.00th=[ 54], 40.00th=[ 62], 50.00th=[ 72], 60.00th=[ 89], | 70.00th=[ 112], 80.00th=[ 140], 90.00th=[ 186], 95.00th=[ 230], | 99.00th=[ 334], 99.50th=[ 388], 99.90th=[ 617], 99.95th=[ 1385], | 99.99th=[ 1385] bw ( KiB/s): min= 7, max= 87, per=25.24%, avg=25.75, stdev=16.37, samples=464 iops : min= 1, max= 21, avg= 5.73, stdev= 4.13, samples=464 lat (msec) : 10=0.16%, 20=6.35%, 50=36.39%, 100=31.51%, 250=23.11% lat (msec) : 500=2.34%, 750=0.10%, 2000=0.03% cpu : usr=0.05%, sys=1.73%, ctx=4900, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=97.9KiB/s (100kB/s), 24.2KiB/s-24.8KiB/s (24.8kB/s-25.4kB/s), io=23.4MiB (24.6MB), run=243947-245318msec WRITE: bw=102KiB/s (105kB/s), 25.5KiB/s-25.9KiB/s (26.1kB/s-26.5kB/s), io=24.6MiB (25.7MB), run=243947-245318msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=181507: Sun Mar 15 18:38:31 2026 read: IOPS=8, BW=141KiB/s (144kB/s)(5920KiB/42088msec) clat (usec): min=44, max=343570, avg=58900.55, stdev=42758.13 lat (usec): min=46, max=343572, avg=58902.33, stdev=42758.05 clat percentiles (usec): | 1.00th=[ 57], 5.00th=[ 66], 10.00th=[ 19268], 20.00th=[ 30802], | 30.00th=[ 38536], 40.00th=[ 43779], 50.00th=[ 49546], 60.00th=[ 57934], | 70.00th=[ 70779], 80.00th=[ 85459], 90.00th=[104334], 95.00th=[120062], | 99.00th=[263193], 99.50th=[299893], 99.90th=[341836], 99.95th=[341836], | 99.99th=[341836] bw ( KiB/s): min= 31, max= 377, per=25.07%, avg=142.64, stdev=71.18, samples=81 iops : min= 1, max= 23, avg= 8.09, stdev= 4.50, samples=81 write: IOPS=9, BW=151KiB/s (155kB/s)(6368KiB/42088msec); 0 zone resets clat (usec): min=1819, max=287284, avg=49714.64, stdev=47318.94 lat (usec): min=1821, max=287286, avg=49720.84, stdev=47315.25 clat percentiles (msec): | 1.00th=[ 3], 5.00th=[ 4], 10.00th=[ 6], 20.00th=[ 11], | 30.00th=[ 16], 40.00th=[ 27], 50.00th=[ 35], 60.00th=[ 49], | 70.00th=[ 64], 80.00th=[ 84], 90.00th=[ 110], 95.00th=[ 150], | 99.00th=[ 224], 99.50th=[ 251], 99.90th=[ 288], 99.95th=[ 288], | 99.99th=[ 288] bw ( KiB/s): min= 31, max= 345, per=25.67%, avg=153.51, stdev=64.18, samples=81 iops : min= 1, max= 21, avg= 8.78, stdev= 4.07, samples=81 lat (usec) : 50=0.13%, 100=3.52%, 250=0.13%, 500=0.26%, 750=0.13% lat (msec) : 2=0.26%, 4=3.52%, 10=6.64%, 20=7.94%, 50=33.85% lat (msec) : 100=30.73%, 250=12.24%, 500=0.65% cpu : usr=0.06%, sys=5.19%, ctx=1860, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181508: Sun Mar 15 18:38:31 2026 read: IOPS=8, BW=140KiB/s (144kB/s)(5744KiB/40916msec) clat (usec): min=46, max=261674, avg=59345.21, stdev=37403.17 lat (usec): min=47, max=261676, avg=59346.68, stdev=37403.19 clat percentiles (usec): | 1.00th=[ 57], 5.00th=[ 71], 10.00th=[ 22676], 20.00th=[ 30802], | 30.00th=[ 40633], 40.00th=[ 46924], 50.00th=[ 53740], 60.00th=[ 63177], | 70.00th=[ 70779], 80.00th=[ 82314], 90.00th=[103285], 95.00th=[123208], | 99.00th=[202376], 99.50th=[235930], 99.90th=[261096], 99.95th=[261096], | 99.99th=[261096] bw ( KiB/s): min= 22, max= 318, per=24.54%, avg=139.65, stdev=65.91, samples=80 iops : min= 1, max= 19, avg= 7.90, stdev= 4.14, samples=80 write: IOPS=9, BW=160KiB/s (164kB/s)(6544KiB/40916msec); 0 zone resets clat (msec): min=2, max=259, avg=47.48, stdev=43.53 lat (msec): min=2, max=259, avg=47.48, stdev=43.53 clat percentiles (msec): | 1.00th=[ 3], 5.00th=[ 4], 10.00th=[ 6], 20.00th=[ 10], | 30.00th=[ 16], 40.00th=[ 26], 50.00th=[ 35], 60.00th=[ 48], | 70.00th=[ 65], 80.00th=[ 84], 90.00th=[ 103], 95.00th=[ 130], | 99.00th=[ 184], 99.50th=[ 222], 99.90th=[ 259], 99.95th=[ 259], | 99.99th=[ 259] bw ( KiB/s): min= 31, max= 319, per=26.71%, avg=159.70, stdev=72.01, samples=80 iops : min= 1, max= 19, avg= 9.18, stdev= 4.53, samples=80 lat (usec) : 50=0.13%, 100=2.47%, 250=0.26%, 500=0.26% lat (msec) : 2=0.13%, 4=3.12%, 10=7.81%, 20=8.98%, 50=30.34% lat (msec) : 100=35.55%, 250=10.55%, 500=0.39% cpu : usr=0.07%, sys=5.47%, ctx=1808, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181509: Sun Mar 15 18:38:31 2026 read: IOPS=9, BW=150KiB/s (154kB/s)(6256KiB/41700msec) clat (usec): min=57, max=302748, avg=60065.51, stdev=41487.26 lat (usec): min=58, max=302751, avg=60068.79, stdev=41486.25 clat percentiles (usec): | 1.00th=[ 61], 5.00th=[ 83], 10.00th=[ 21627], 20.00th=[ 31589], | 30.00th=[ 38536], 40.00th=[ 45876], 50.00th=[ 53740], 60.00th=[ 61080], | 70.00th=[ 68682], 80.00th=[ 83362], 90.00th=[104334], 95.00th=[129500], | 99.00th=[231736], 99.50th=[263193], 99.90th=[304088], 99.95th=[304088], | 99.99th=[304088] bw ( KiB/s): min= 31, max= 319, per=26.72%, avg=152.06, stdev=63.96, samples=80 iops : min= 1, max= 19, avg= 8.68, stdev= 4.05, samples=80 write: IOPS=9, BW=145KiB/s (148kB/s)(6032KiB/41700msec); 0 zone resets clat (usec): min=1498, max=237065, avg=46389.00, stdev=43220.38 lat (usec): min=1499, max=237068, avg=46398.67, stdev=43223.09 clat percentiles (msec): | 1.00th=[ 3], 5.00th=[ 3], 10.00th=[ 6], 20.00th=[ 10], | 30.00th=[ 16], 40.00th=[ 23], 50.00th=[ 34], 60.00th=[ 46], | 70.00th=[ 59], 80.00th=[ 84], 90.00th=[ 106], 95.00th=[ 132], | 99.00th=[ 194], 99.50th=[ 218], 99.90th=[ 239], 99.95th=[ 239], | 99.99th=[ 239] bw ( KiB/s): min= 31, max= 347, per=25.10%, avg=150.08, stdev=67.90, samples=77 iops : min= 1, max= 21, avg= 8.56, stdev= 4.28, samples=77 lat (usec) : 100=2.86%, 250=0.13%, 500=0.39% lat (msec) : 2=0.39%, 4=4.17%, 10=6.25%, 20=8.46%, 50=31.77% lat (msec) : 100=33.72%, 250=11.46%, 500=0.39% cpu : usr=0.06%, sys=5.19%, ctx=1875, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181510: Sun Mar 15 18:38:31 2026 read: IOPS=9, BW=151KiB/s (155kB/s)(6032KiB/39921msec) clat (usec): min=36, max=291544, avg=54553.52, stdev=36685.03 lat (usec): min=36, max=291546, avg=54559.05, stdev=36687.20 clat percentiles (usec): | 1.00th=[ 53], 5.00th=[ 64], 10.00th=[ 217], 20.00th=[ 31589], | 30.00th=[ 37487], 40.00th=[ 42730], 50.00th=[ 49021], 60.00th=[ 57410], | 70.00th=[ 66847], 80.00th=[ 77071], 90.00th=[101188], 95.00th=[116917], | 99.00th=[170918], 99.50th=[256902], 99.90th=[291505], 99.95th=[291505], | 99.99th=[291505] bw ( KiB/s): min= 31, max= 319, per=26.88%, avg=152.95, stdev=64.72, samples=77 iops : min= 1, max= 19, avg= 8.74, stdev= 4.12, samples=77 write: IOPS=9, BW=157KiB/s (160kB/s)(6256KiB/39921msec); 0 zone resets clat (usec): min=1955, max=247834, avg=48209.37, stdev=45364.50 lat (usec): min=1957, max=247837, avg=48214.25, stdev=45364.25 clat percentiles (msec): | 1.00th=[ 3], 5.00th=[ 5], 10.00th=[ 6], 20.00th=[ 10], | 30.00th=[ 14], 40.00th=[ 24], 50.00th=[ 36], 60.00th=[ 48], | 70.00th=[ 62], 80.00th=[ 83], 90.00th=[ 111], 95.00th=[ 140], | 99.00th=[ 207], 99.50th=[ 222], 99.90th=[ 249], 99.95th=[ 249], | 99.99th=[ 249] bw ( KiB/s): min= 22, max= 318, per=26.35%, avg=157.58, stdev=61.18, samples=78 iops : min= 1, max= 19, avg= 9.05, stdev= 3.88, samples=78 lat (usec) : 50=0.13%, 100=4.43%, 250=0.39%, 500=0.26% lat (msec) : 2=0.39%, 4=2.08%, 10=10.29%, 20=7.55%, 50=31.38% lat (msec) : 100=31.51%, 250=11.33%, 500=0.26% cpu : usr=0.06%, sys=5.24%, ctx=1789, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=569KiB/s (583kB/s), 140KiB/s-151KiB/s (144kB/s-155kB/s), io=23.4MiB (24.5MB), run=39921-42088msec WRITE: bw=599KiB/s (613kB/s), 145KiB/s-160KiB/s (148kB/s-164kB/s), io=24.6MiB (25.8MB), run=39921-42088msec rand-rw: (groupid=0, jobs=1): err= 0: pid=181503: Sun Mar 15 18:38:47 2026 read: IOPS=6, BW=103KiB/s (106kB/s)(5920KiB/57245msec) clat (msec): min=8, max=334, avg=57.81, stdev=48.24 lat (msec): min=8, max=334, avg=57.82, stdev=48.25 clat percentiles (msec): | 1.00th=[ 14], 5.00th=[ 18], 10.00th=[ 22], 20.00th=[ 28], | 30.00th=[ 32], 40.00th=[ 37], 50.00th=[ 43], 60.00th=[ 47], | 70.00th=[ 55], 80.00th=[ 80], 90.00th=[ 128], 95.00th=[ 169], | 99.00th=[ 251], 99.50th=[ 253], 99.90th=[ 334], 99.95th=[ 334], | 99.99th=[ 334] bw ( KiB/s): min= 31, max= 348, per=26.01%, avg=107.95, stdev=62.76, samples=106 iops : min= 1, max= 21, avg= 5.91, stdev= 3.98, samples=106 write: IOPS=6, BW=111KiB/s (114kB/s)(6368KiB/57245msec); 0 zone resets clat (msec): min=22, max=366, avg=89.54, stdev=58.84 lat (msec): min=22, max=366, avg=89.55, stdev=58.84 clat percentiles (msec): | 1.00th=[ 27], 5.00th=[ 33], 10.00th=[ 39], 20.00th=[ 48], | 30.00th=[ 54], 40.00th=[ 60], 50.00th=[ 69], 60.00th=[ 83], | 70.00th=[ 101], 80.00th=[ 126], 90.00th=[ 169], 95.00th=[ 228], | 99.00th=[ 300], 99.50th=[ 359], 99.90th=[ 368], 99.95th=[ 368], | 99.99th=[ 368] bw ( KiB/s): min= 23, max= 254, per=25.83%, avg=112.86, stdev=57.20, samples=110 iops : min= 1, max= 15, avg= 6.21, stdev= 3.64, samples=110 lat (msec) : 10=0.26%, 20=3.65%, 50=39.71%, 100=34.38%, 250=20.44% lat (msec) : 500=1.56% cpu : usr=0.05%, sys=1.88%, ctx=1196, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181504: Sun Mar 15 18:38:47 2026 read: IOPS=6, BW=99.6KiB/s (102kB/s)(5744KiB/57648msec) clat (msec): min=9, max=265, avg=59.30, stdev=46.55 lat (msec): min=9, max=265, avg=59.31, stdev=46.55 clat percentiles (msec): | 1.00th=[ 14], 5.00th=[ 17], 10.00th=[ 21], 20.00th=[ 27], | 30.00th=[ 32], 40.00th=[ 36], 50.00th=[ 42], 60.00th=[ 51], | 70.00th=[ 63], 80.00th=[ 86], 90.00th=[ 127], 95.00th=[ 165], | 99.00th=[ 220], 99.50th=[ 262], 99.90th=[ 266], 99.95th=[ 266], | 99.99th=[ 266] bw ( KiB/s): min= 23, max= 351, per=25.83%, avg=107.18, stdev=63.76, samples=104 iops : min= 1, max= 21, avg= 5.86, stdev= 4.03, samples=104 write: IOPS=7, BW=114KiB/s (116kB/s)(6544KiB/57648msec); 0 zone resets clat (msec): min=21, max=322, avg=87.70, stdev=55.09 lat (msec): min=21, max=322, avg=87.70, stdev=55.09 clat percentiles (msec): | 1.00th=[ 27], 5.00th=[ 35], 10.00th=[ 39], 20.00th=[ 48], | 30.00th=[ 55], 40.00th=[ 62], 50.00th=[ 71], 60.00th=[ 81], | 70.00th=[ 100], 80.00th=[ 124], 90.00th=[ 157], 95.00th=[ 203], | 99.00th=[ 288], 99.50th=[ 321], 99.90th=[ 321], 99.95th=[ 321], | 99.99th=[ 321] bw ( KiB/s): min= 30, max= 286, per=26.20%, avg=114.48, stdev=59.68, samples=111 iops : min= 1, max= 17, avg= 6.31, stdev= 3.77, samples=111 lat (msec) : 10=0.13%, 20=4.17%, 50=36.20%, 100=36.20%, 250=21.61% lat (msec) : 500=1.69% cpu : usr=0.05%, sys=1.90%, ctx=1250, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181505: Sun Mar 15 18:38:47 2026 read: IOPS=6, BW=109KiB/s (111kB/s)(6256KiB/57544msec) clat (msec): min=13, max=370, avg=59.82, stdev=50.36 lat (msec): min=13, max=370, avg=59.82, stdev=50.36 clat percentiles (msec): | 1.00th=[ 15], 5.00th=[ 18], 10.00th=[ 22], 20.00th=[ 26], | 30.00th=[ 31], 40.00th=[ 37], 50.00th=[ 43], 60.00th=[ 49], | 70.00th=[ 62], 80.00th=[ 85], 90.00th=[ 126], 95.00th=[ 165], | 99.00th=[ 257], 99.50th=[ 313], 99.90th=[ 372], 99.95th=[ 372], | 99.99th=[ 372] bw ( KiB/s): min= 31, max= 317, per=27.67%, avg=114.81, stdev=73.37, samples=107 iops : min= 1, max= 19, avg= 6.34, stdev= 4.67, samples=107 write: IOPS=6, BW=105KiB/s (107kB/s)(6032KiB/57544msec); 0 zone resets clat (msec): min=16, max=376, avg=89.61, stdev=58.03 lat (msec): min=16, max=376, avg=89.61, stdev=58.03 clat percentiles (msec): | 1.00th=[ 25], 5.00th=[ 35], 10.00th=[ 41], 20.00th=[ 48], | 30.00th=[ 56], 40.00th=[ 63], 50.00th=[ 70], 60.00th=[ 84], | 70.00th=[ 101], 80.00th=[ 117], 90.00th=[ 161], 95.00th=[ 218], | 99.00th=[ 313], 99.50th=[ 363], 99.90th=[ 376], 99.95th=[ 376], | 99.99th=[ 376] bw ( KiB/s): min= 31, max= 255, per=24.61%, avg=107.54, stdev=55.95, samples=109 iops : min= 1, max= 15, avg= 5.87, stdev= 3.53, samples=109 lat (msec) : 20=4.30%, 50=39.06%, 100=34.38%, 250=20.31%, 500=1.95% cpu : usr=0.04%, sys=1.75%, ctx=1203, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181506: Sun Mar 15 18:38:47 2026 read: IOPS=6, BW=105KiB/s (108kB/s)(6032KiB/57221msec) clat (msec): min=10, max=380, avg=61.40, stdev=52.34 lat (msec): min=10, max=380, avg=61.41, stdev=52.34 clat percentiles (msec): | 1.00th=[ 15], 5.00th=[ 20], 10.00th=[ 23], 20.00th=[ 27], | 30.00th=[ 31], 40.00th=[ 36], 50.00th=[ 42], 60.00th=[ 52], | 70.00th=[ 63], 80.00th=[ 90], 90.00th=[ 130], 95.00th=[ 178], | 99.00th=[ 255], 99.50th=[ 317], 99.90th=[ 380], 99.95th=[ 380], | 99.99th=[ 380] bw ( KiB/s): min= 31, max= 313, per=26.27%, avg=109.03, stdev=62.18, samples=107 iops : min= 1, max= 19, avg= 5.96, stdev= 3.94, samples=107 write: IOPS=6, BW=109KiB/s (112kB/s)(6256KiB/57221msec); 0 zone resets clat (msec): min=20, max=345, avg=86.92, stdev=51.23 lat (msec): min=20, max=345, avg=86.92, stdev=51.23 clat percentiles (msec): | 1.00th=[ 31], 5.00th=[ 36], 10.00th=[ 43], 20.00th=[ 49], | 30.00th=[ 55], 40.00th=[ 59], 50.00th=[ 71], 60.00th=[ 82], | 70.00th=[ 100], 80.00th=[ 117], 90.00th=[ 161], 95.00th=[ 186], | 99.00th=[ 275], 99.50th=[ 326], 99.90th=[ 347], 99.95th=[ 347], | 99.99th=[ 347] bw ( KiB/s): min= 30, max= 287, per=25.55%, avg=111.63, stdev=60.77, samples=109 iops : min= 1, max= 17, avg= 6.14, stdev= 3.87, samples=109 lat (msec) : 20=2.60%, 50=37.50%, 100=36.33%, 250=22.01%, 500=1.56% cpu : usr=0.05%, sys=1.86%, ctx=1145, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=415KiB/s (425kB/s), 99.6KiB/s-109KiB/s (102kB/s-111kB/s), io=23.4MiB (24.5MB), run=57221-57648msec WRITE: bw=437KiB/s (448kB/s), 105KiB/s-114KiB/s (107kB/s-116kB/s), io=24.6MiB (25.8MB), run=57221-57648msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=181529: Sun Mar 15 18:39:12 2026 read: IOPS=0, BW=920KiB/s (942kB/s)(7168KiB/7793msec) clat (msec): min=122, max=1328, avg=547.18, stdev=405.74 lat (msec): min=122, max=1328, avg=547.18, stdev=405.74 clat percentiles (msec): | 1.00th=[ 124], 5.00th=[ 124], 10.00th=[ 124], 20.00th=[ 247], | 30.00th=[ 279], 40.00th=[ 279], 50.00th=[ 514], 60.00th=[ 642], | 70.00th=[ 642], 80.00th=[ 701], 90.00th=[ 1334], 95.00th=[ 1334], | 99.00th=[ 1334], 99.50th=[ 1334], 99.90th=[ 1334], 99.95th=[ 1334], | 99.99th=[ 1334] bw ( KiB/s): min= 1954, max= 3820, per=90.13%, avg=2367.80, stdev=812.46, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 write: IOPS=0, BW=657KiB/s (673kB/s)(5120KiB/7793msec); 0 zone resets clat (msec): min=293, max=1480, avg=714.64, stdev=504.57 lat (msec): min=293, max=1480, avg=714.78, stdev=504.55 clat percentiles (msec): | 1.00th=[ 292], 5.00th=[ 292], 10.00th=[ 292], 20.00th=[ 292], | 30.00th=[ 326], 40.00th=[ 326], 50.00th=[ 514], 60.00th=[ 514], | 70.00th=[ 961], 80.00th=[ 961], 90.00th=[ 1485], 95.00th=[ 1485], | 99.00th=[ 1485], 99.50th=[ 1485], 99.90th=[ 1485], 99.95th=[ 1485], | 99.99th=[ 1485] bw ( KiB/s): min= 1780, max= 2043, per=53.50%, avg=1968.25, stdev=126.05, samples=4 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=4 lat (msec) : 250=16.67%, 500=25.00%, 750=33.33%, 1000=8.33%, 2000=16.67% cpu : usr=0.00%, sys=1.73%, ctx=71, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181531: Sun Mar 15 18:39:12 2026 read: IOPS=0, BW=282KiB/s (289kB/s)(2048KiB/7254msec) clat (msec): min=314, max=844, avg=579.88, stdev=374.67 lat (msec): min=314, max=844, avg=579.88, stdev=374.67 clat percentiles (msec): | 1.00th=[ 317], 5.00th=[ 317], 10.00th=[ 317], 20.00th=[ 317], | 30.00th=[ 317], 40.00th=[ 317], 50.00th=[ 317], 60.00th=[ 844], | 70.00th=[ 844], 80.00th=[ 844], 90.00th=[ 844], 95.00th=[ 844], | 99.00th=[ 844], 99.50th=[ 844], 99.90th=[ 844], 99.95th=[ 844], | 99.99th=[ 844] bw ( KiB/s): min= 1768, max= 1783, per=67.59%, avg=1775.50, stdev=10.61, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1412KiB/s (1446kB/s)(10.0MiB/7254msec); 0 zone resets clat (msec): min=267, max=1288, avg=592.36, stdev=353.28 lat (msec): min=267, max=1288, avg=592.50, stdev=353.34 clat percentiles (msec): | 1.00th=[ 268], 5.00th=[ 268], 10.00th=[ 268], 20.00th=[ 275], | 30.00th=[ 300], 40.00th=[ 334], 50.00th=[ 414], 60.00th=[ 489], | 70.00th=[ 760], 80.00th=[ 818], 90.00th=[ 986], 95.00th=[ 1284], | 99.00th=[ 1284], 99.50th=[ 1284], 99.90th=[ 1284], 99.95th=[ 1284], | 99.99th=[ 1284] bw ( KiB/s): min= 1882, max= 2039, per=54.45%, avg=2003.25, stdev=57.58, samples=8 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=8 lat (msec) : 500=58.33%, 1000=33.33%, 2000=8.33% cpu : usr=0.03%, sys=4.14%, ctx=90, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181533: Sun Mar 15 18:39:12 2026 read: IOPS=0, BW=810KiB/s (830kB/s)(6144KiB/7584msec) clat (msec): min=148, max=813, avg=447.00, stdev=288.47 lat (msec): min=148, max=813, avg=447.00, stdev=288.47 clat percentiles (msec): | 1.00th=[ 150], 5.00th=[ 150], 10.00th=[ 150], 20.00th=[ 184], | 30.00th=[ 184], 40.00th=[ 334], 50.00th=[ 334], 60.00th=[ 426], | 70.00th=[ 776], 80.00th=[ 776], 90.00th=[ 810], 95.00th=[ 810], | 99.00th=[ 810], 99.50th=[ 810], 99.90th=[ 810], 99.95th=[ 810], | 99.99th=[ 810] bw ( KiB/s): min= 1996, max= 2027, per=76.59%, avg=2012.00, stdev=12.45, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 write: IOPS=0, BW=810KiB/s (830kB/s)(6144KiB/7584msec); 0 zone resets clat (msec): min=276, max=1196, avg=762.60, stdev=361.67 lat (msec): min=276, max=1196, avg=762.94, stdev=361.85 clat percentiles (msec): | 1.00th=[ 275], 5.00th=[ 275], 10.00th=[ 275], 20.00th=[ 510], | 30.00th=[ 510], 40.00th=[ 592], 50.00th=[ 592], 60.00th=[ 894], | 70.00th=[ 1116], 80.00th=[ 1116], 90.00th=[ 1200], 95.00th=[ 1200], | 99.00th=[ 1200], 99.50th=[ 1200], 99.90th=[ 1200], 99.95th=[ 1200], | 99.99th=[ 1200] bw ( KiB/s): min= 1954, max= 2048, per=54.79%, avg=2015.83, stdev=36.13, samples=6 iops : min= 1, max= 2, avg= 1.17, stdev= 0.41, samples=6 lat (msec) : 250=16.67%, 500=25.00%, 750=16.67%, 1000=25.00%, 2000=16.67% cpu : usr=0.00%, sys=3.85%, ctx=109, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181535: Sun Mar 15 18:39:12 2026 read: IOPS=0, BW=702KiB/s (719kB/s)(5120KiB/7295msec) clat (msec): min=119, max=712, avg=469.21, stdev=249.74 lat (msec): min=119, max=717, avg=470.19, stdev=250.94 clat percentiles (msec): | 1.00th=[ 120], 5.00th=[ 120], 10.00th=[ 120], 20.00th=[ 120], | 30.00th=[ 309], 40.00th=[ 309], 50.00th=[ 550], 60.00th=[ 550], | 70.00th=[ 659], 80.00th=[ 659], 90.00th=[ 709], 95.00th=[ 709], | 99.00th=[ 709], 99.50th=[ 709], 99.90th=[ 709], 99.95th=[ 709], | 99.99th=[ 709] bw ( KiB/s): min= 1954, max= 4031, per=100.00%, avg=2668.00, stdev=1180.84, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 write: IOPS=0, BW=983KiB/s (1006kB/s)(7168KiB/7295msec); 0 zone resets clat (msec): min=210, max=1325, avg=690.35, stdev=540.23 lat (msec): min=210, max=1325, avg=690.49, stdev=540.21 clat percentiles (msec): | 1.00th=[ 211], 5.00th=[ 211], 10.00th=[ 211], 20.00th=[ 232], | 30.00th=[ 266], 40.00th=[ 266], 50.00th=[ 330], 60.00th=[ 1183], | 70.00th=[ 1183], 80.00th=[ 1284], 90.00th=[ 1334], 95.00th=[ 1334], | 99.00th=[ 1334], 99.50th=[ 1334], 99.90th=[ 1334], 99.95th=[ 1334], | 99.99th=[ 1334] bw ( KiB/s): min= 1996, max= 4071, per=82.31%, avg=3028.25, stdev=1167.54, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 1.15, samples=4 lat (msec) : 250=25.00%, 500=25.00%, 750=25.00%, 2000=25.00% cpu : usr=0.00%, sys=3.04%, ctx=88, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2628KiB/s (2691kB/s), 282KiB/s-920KiB/s (289kB/s-942kB/s), io=20.0MiB (20.0MB), run=7254-7793msec WRITE: bw=3679KiB/s (3768kB/s), 657KiB/s-1412KiB/s (673kB/s-1446kB/s), io=28.0MiB (29.4MB), run=7254-7793msec rand-rw: (groupid=0, jobs=1): err= 0: pid=181528: Sun Mar 15 18:39:12 2026 read: IOPS=1, BW=1555KiB/s (1592kB/s)(7168KiB/4610msec) clat (usec): min=1027, max=686855, avg=336689.80, stdev=254165.04 lat (usec): min=1029, max=686856, avg=336691.30, stdev=254164.91 clat percentiles (usec): | 1.00th=[ 1029], 5.00th=[ 1029], 10.00th=[ 1029], 20.00th=[ 1254], | 30.00th=[346031], 40.00th=[346031], 50.00th=[375391], 60.00th=[446694], | 70.00th=[446694], 80.00th=[497026], 90.00th=[683672], 95.00th=[683672], | 99.00th=[683672], 99.50th=[683672], 99.90th=[683672], 99.95th=[683672], | 99.99th=[683672] bw ( KiB/s): min= 1712, max= 3961, per=89.25%, avg=2339.20, stdev=915.91, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 write: IOPS=1, BW=1111KiB/s (1137kB/s)(5120KiB/4610msec); 0 zone resets clat (msec): min=190, max=832, avg=441.25, stdev=251.34 lat (msec): min=191, max=832, avg=441.36, stdev=251.39 clat percentiles (msec): | 1.00th=[ 192], 5.00th=[ 192], 10.00th=[ 192], 20.00th=[ 192], | 30.00th=[ 262], 40.00th=[ 262], 50.00th=[ 418], 60.00th=[ 418], | 70.00th=[ 506], 80.00th=[ 506], 90.00th=[ 835], 95.00th=[ 835], | 99.00th=[ 835], 99.50th=[ 835], 99.90th=[ 835], 99.95th=[ 835], | 99.99th=[ 835] bw ( KiB/s): min= 2015, max= 5919, per=90.58%, avg=3324.33, stdev=2247.08, samples=3 iops : min= 1, max= 5, avg= 2.33, stdev= 2.31, samples=3 lat (msec) : 2=16.67%, 250=8.33%, 500=50.00%, 750=16.67%, 1000=8.33% cpu : usr=0.00%, sys=11.02%, ctx=176, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181530: Sun Mar 15 18:39:12 2026 read: IOPS=0, BW=262KiB/s (268kB/s)(2048KiB/7812msec) clat (usec): min=609, max=583227, avg=291918.72, stdev=411973.16 lat (usec): min=610, max=583230, avg=291920.47, stdev=411974.11 clat percentiles (usec): | 1.00th=[ 611], 5.00th=[ 611], 10.00th=[ 611], 20.00th=[ 611], | 30.00th=[ 611], 40.00th=[ 611], 50.00th=[ 611], 60.00th=[583009], | 70.00th=[583009], 80.00th=[583009], 90.00th=[583009], 95.00th=[583009], | 99.00th=[583009], 99.50th=[583009], 99.90th=[583009], 99.95th=[583009], | 99.99th=[583009] bw ( KiB/s): min= 1436, max= 1899, per=63.62%, avg=1667.50, stdev=327.39, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1311KiB/s (1342kB/s)(10.0MiB/7812msec); 0 zone resets clat (msec): min=270, max=1663, avg=715.43, stdev=442.18 lat (msec): min=270, max=1663, avg=715.81, stdev=442.36 clat percentiles (msec): | 1.00th=[ 271], 5.00th=[ 271], 10.00th=[ 271], 20.00th=[ 338], | 30.00th=[ 388], 40.00th=[ 468], 50.00th=[ 472], 60.00th=[ 550], | 70.00th=[ 894], 80.00th=[ 1003], 90.00th=[ 1099], 95.00th=[ 1670], | 99.00th=[ 1670], 99.50th=[ 1670], 99.90th=[ 1670], 99.95th=[ 1670], | 99.99th=[ 1670] bw ( KiB/s): min= 1899, max= 2043, per=54.57%, avg=2002.63, stdev=46.07, samples=8 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=8 lat (usec) : 750=8.33% lat (msec) : 500=41.67%, 750=16.67%, 1000=8.33%, 2000=25.00% cpu : usr=0.00%, sys=9.50%, ctx=185, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181532: Sun Mar 15 18:39:12 2026 read: IOPS=1, BW=1052KiB/s (1077kB/s)(6144KiB/5840msec) clat (msec): min=350, max=738, avg=513.32, stdev=134.19 lat (msec): min=350, max=738, avg=513.33, stdev=134.19 clat percentiles (msec): | 1.00th=[ 351], 5.00th=[ 351], 10.00th=[ 351], 20.00th=[ 422], | 30.00th=[ 422], 40.00th=[ 481], 50.00th=[ 481], 60.00th=[ 518], | 70.00th=[ 575], 80.00th=[ 575], 90.00th=[ 743], 95.00th=[ 743], | 99.00th=[ 743], 99.50th=[ 743], 99.90th=[ 743], 99.95th=[ 743], | 99.99th=[ 743] bw ( KiB/s): min= 1899, max= 2027, per=75.28%, avg=1973.00, stdev=58.65, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 write: IOPS=1, BW=1052KiB/s (1077kB/s)(6144KiB/5840msec); 0 zone resets clat (msec): min=256, max=654, avg=440.33, stdev=134.82 lat (msec): min=256, max=654, avg=440.63, stdev=134.86 clat percentiles (msec): | 1.00th=[ 257], 5.00th=[ 257], 10.00th=[ 257], 20.00th=[ 355], | 30.00th=[ 355], 40.00th=[ 418], 50.00th=[ 418], 60.00th=[ 460], | 70.00th=[ 498], 80.00th=[ 498], 90.00th=[ 659], 95.00th=[ 659], | 99.00th=[ 659], 99.50th=[ 659], 99.90th=[ 659], 99.95th=[ 659], | 99.99th=[ 659] bw ( KiB/s): min= 1530, max= 2043, per=52.72%, avg=1934.83, stdev=198.83, samples=6 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=6 lat (msec) : 500=66.67%, 750=33.33% cpu : usr=0.03%, sys=10.45%, ctx=284, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181534: Sun Mar 15 18:39:12 2026 read: IOPS=1, BW=1040KiB/s (1065kB/s)(5120KiB/4921msec) clat (usec): min=416, max=472808, avg=190258.86, stdev=200322.80 lat (usec): min=417, max=472810, avg=190260.15, stdev=200322.96 clat percentiles (usec): | 1.00th=[ 416], 5.00th=[ 416], 10.00th=[ 416], 20.00th=[ 416], | 30.00th=[ 502], 40.00th=[ 502], 50.00th=[193987], 60.00th=[193987], | 70.00th=[283116], 80.00th=[283116], 90.00th=[471860], 95.00th=[471860], | 99.00th=[471860], 99.50th=[471860], 99.90th=[471860], 99.95th=[471860], | 99.99th=[471860] bw ( KiB/s): min= 7892, max= 7892, per=100.00%, avg=7892.00, stdev= 0.00, samples=1 iops : min= 7, max= 7, avg= 7.00, stdev= 0.00, samples=1 write: IOPS=1, BW=1457KiB/s (1492kB/s)(7168KiB/4921msec); 0 zone resets clat (msec): min=281, max=864, avg=532.30, stdev=207.85 lat (msec): min=282, max=867, avg=532.91, stdev=208.78 clat percentiles (msec): | 1.00th=[ 284], 5.00th=[ 284], 10.00th=[ 284], 20.00th=[ 309], | 30.00th=[ 456], 40.00th=[ 456], 50.00th=[ 542], 60.00th=[ 584], | 70.00th=[ 584], 80.00th=[ 693], 90.00th=[ 869], 95.00th=[ 869], | 99.00th=[ 869], 99.50th=[ 869], 99.90th=[ 869], 99.95th=[ 869], | 99.99th=[ 869] bw ( KiB/s): min= 1885, max= 2039, per=54.42%, avg=1997.14, stdev=53.35, samples=7 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=7 lat (usec) : 500=8.33%, 750=8.33% lat (msec) : 250=8.33%, 500=41.67%, 750=25.00%, 1000=8.33% cpu : usr=0.00%, sys=9.75%, ctx=113, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2622KiB/s (2685kB/s), 262KiB/s-1555KiB/s (268kB/s-1592kB/s), io=20.0MiB (20.0MB), run=4610-7812msec WRITE: bw=3670KiB/s (3758kB/s), 1052KiB/s-1457KiB/s (1077kB/s-1492kB/s), io=28.0MiB (29.4MB), run=4610-7812msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=181545: Sun Mar 15 18:39:40 2026 read: IOPS=0, BW=1739KiB/s (1780kB/s)(12.0MiB/7068msec) clat (msec): min=1336, max=4318, avg=2333.87, stdev=1718.65 lat (msec): min=1336, max=4318, avg=2333.87, stdev=1718.65 clat percentiles (msec): | 1.00th=[ 1334], 5.00th=[ 1334], 10.00th=[ 1334], 20.00th=[ 1334], | 30.00th=[ 1334], 40.00th=[ 1351], 50.00th=[ 1351], 60.00th=[ 1351], | 70.00th=[ 4329], 80.00th=[ 4329], 90.00th=[ 4329], 95.00th=[ 4329], | 99.00th=[ 4329], 99.50th=[ 4329], 99.90th=[ 4329], 99.95th=[ 4329], | 99.99th=[ 4329] bw ( KiB/s): min= 7816, max= 7984, per=100.00%, avg=7900.00, stdev=118.79, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 2000=66.67%, >=2000=33.33% cpu : usr=0.00%, sys=5.48%, ctx=225, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181546: Sun Mar 15 18:39:40 2026 read: IOPS=0, BW=479KiB/s (491kB/s)(4096KiB/8548msec) clat (nsec): min=4450.7M, max=4450.7M, avg=4450688355.00, stdev= 0.00 lat (nsec): min=4450.7M, max=4450.7M, avg=4450691293.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 4463], 5.00th=[ 4463], 10.00th=[ 4463], 20.00th=[ 4463], | 30.00th=[ 4463], 40.00th=[ 4463], 50.00th=[ 4463], 60.00th=[ 4463], | 70.00th=[ 4463], 80.00th=[ 4463], 90.00th=[ 4463], 95.00th=[ 4463], | 99.00th=[ 4463], 99.50th=[ 4463], 99.90th=[ 4463], 99.95th=[ 4463], | 99.99th=[ 4463] bw ( KiB/s): min= 7816, max= 7816, per=100.00%, avg=7816.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=958KiB/s (981kB/s)(8192KiB/8548msec); 0 zone resets clat (msec): min=1418, max=2580, avg=1999.55, stdev=822.27 lat (msec): min=1419, max=2585, avg=2002.78, stdev=824.39 clat percentiles (msec): | 1.00th=[ 1418], 5.00th=[ 1418], 10.00th=[ 1418], 20.00th=[ 1418], | 30.00th=[ 1418], 40.00th=[ 1418], 50.00th=[ 1418], 60.00th=[ 2567], | 70.00th=[ 2567], 80.00th=[ 2567], 90.00th=[ 2567], 95.00th=[ 2567], | 99.00th=[ 2567], 99.50th=[ 2567], 99.90th=[ 2567], 99.95th=[ 2567], | 99.99th=[ 2567] bw ( KiB/s): min= 7984, max= 7984, per=100.00%, avg=7984.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 2000=33.33%, >=2000=66.67% cpu : usr=0.00%, sys=3.50%, ctx=638, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181548: Sun Mar 15 18:39:40 2026 write: IOPS=0, BW=1445KiB/s (1480kB/s)(12.0MiB/8502msec); 0 zone resets clat (msec): min=997, max=4207, avg=2763.22, stdev=1629.05 lat (msec): min=997, max=4209, avg=2764.17, stdev=1629.83 clat percentiles (msec): | 1.00th=[ 995], 5.00th=[ 995], 10.00th=[ 995], 20.00th=[ 995], | 30.00th=[ 995], 40.00th=[ 3071], 50.00th=[ 3071], 60.00th=[ 3071], | 70.00th=[ 4212], 80.00th=[ 4212], 90.00th=[ 4212], 95.00th=[ 4212], | 99.00th=[ 4212], 99.50th=[ 4212], 99.90th=[ 4212], 99.95th=[ 4212], | 99.99th=[ 4212] bw ( KiB/s): min= 7816, max= 8159, per=100.00%, avg=7987.50, stdev=242.54, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=33.33%, >=2000=66.67% cpu : usr=0.00%, sys=1.80%, ctx=68, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181550: Sun Mar 15 18:39:40 2026 write: IOPS=0, BW=1594KiB/s (1632kB/s)(12.0MiB/7711msec); 0 zone resets clat (msec): min=445, max=3962, avg=2553.18, stdev=1859.78 lat (msec): min=446, max=3965, avg=2554.51, stdev=1860.32 clat percentiles (msec): | 1.00th=[ 447], 5.00th=[ 447], 10.00th=[ 447], 20.00th=[ 447], | 30.00th=[ 447], 40.00th=[ 3239], 50.00th=[ 3239], 60.00th=[ 3239], | 70.00th=[ 3977], 80.00th=[ 3977], 90.00th=[ 3977], 95.00th=[ 3977], | 99.00th=[ 3977], 99.50th=[ 3977], 99.90th=[ 3977], 99.95th=[ 3977], | 99.99th=[ 3977] bw ( KiB/s): min= 8143, max= 8159, per=100.00%, avg=8151.00, stdev=11.31, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, >=2000=66.67% cpu : usr=0.00%, sys=1.22%, ctx=43, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1917KiB/s (1963kB/s), 479KiB/s-1739KiB/s (491kB/s-1780kB/s), io=16.0MiB (16.8MB), run=7068-8548msec WRITE: bw=3833KiB/s (3925kB/s), 958KiB/s-1594KiB/s (981kB/s-1632kB/s), io=32.0MiB (33.6MB), run=7711-8548msec rand-rw: (groupid=0, jobs=1): err= 0: pid=181547: Sun Mar 15 18:39:41 2026 read: IOPS=0, BW=1363KiB/s (1395kB/s)(12.0MiB/9018msec) clat (msec): min=1144, max=5615, avg=2972.79, stdev=2344.40 lat (msec): min=1144, max=5615, avg=2972.80, stdev=2344.40 clat percentiles (msec): | 1.00th=[ 1150], 5.00th=[ 1150], 10.00th=[ 1150], 20.00th=[ 1150], | 30.00th=[ 1150], 40.00th=[ 2165], 50.00th=[ 2165], 60.00th=[ 2165], | 70.00th=[ 5604], 80.00th=[ 5604], 90.00th=[ 5604], 95.00th=[ 5604], | 99.00th=[ 5604], 99.50th=[ 5604], 99.90th=[ 5604], 99.95th=[ 5604], | 99.99th=[ 5604] bw ( KiB/s): min= 8031, max= 8078, per=100.00%, avg=8054.50, stdev=33.23, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 2000=33.33%, >=2000=66.67% cpu : usr=0.00%, sys=1.10%, ctx=47, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181549: Sun Mar 15 18:39:41 2026 read: IOPS=0, BW=463KiB/s (474kB/s)(4096KiB/8841msec) clat (nsec): min=4659.9M, max=4659.9M, avg=4659901237.00, stdev= 0.00 lat (nsec): min=4659.9M, max=4659.9M, avg=4659904175.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 4665], 5.00th=[ 4665], 10.00th=[ 4665], 20.00th=[ 4665], | 30.00th=[ 4665], 40.00th=[ 4665], 50.00th=[ 4665], 60.00th=[ 4665], | 70.00th=[ 4665], 80.00th=[ 4665], 90.00th=[ 4665], 95.00th=[ 4665], | 99.00th=[ 4665], 99.50th=[ 4665], 99.90th=[ 4665], 99.95th=[ 4665], | 99.99th=[ 4665] bw ( KiB/s): min= 7757, max= 7757, per=100.00%, avg=7757.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=927KiB/s (949kB/s)(8192KiB/8841msec); 0 zone resets clat (msec): min=1439, max=2704, avg=2071.82, stdev=894.86 lat (msec): min=1439, max=2704, avg=2072.11, stdev=894.71 clat percentiles (msec): | 1.00th=[ 1435], 5.00th=[ 1435], 10.00th=[ 1435], 20.00th=[ 1435], | 30.00th=[ 1435], 40.00th=[ 1435], 50.00th=[ 1435], 60.00th=[ 2702], | 70.00th=[ 2702], 80.00th=[ 2702], 90.00th=[ 2702], 95.00th=[ 2702], | 99.00th=[ 2702], 99.50th=[ 2702], 99.90th=[ 2702], 99.95th=[ 2702], | 99.99th=[ 2702] bw ( KiB/s): min= 8175, max= 8175, per=100.00%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 2000=33.33%, >=2000=66.67% cpu : usr=0.00%, sys=1.13%, ctx=64, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181551: Sun Mar 15 18:39:41 2026 write: IOPS=0, BW=1438KiB/s (1473kB/s)(12.0MiB/8543msec); 0 zone resets clat (msec): min=1673, max=5059, avg=2820.44, stdev=1939.53 lat (msec): min=1673, max=5061, avg=2821.79, stdev=1939.94 clat percentiles (msec): | 1.00th=[ 1670], 5.00th=[ 1670], 10.00th=[ 1670], 20.00th=[ 1670], | 30.00th=[ 1670], 40.00th=[ 1720], 50.00th=[ 1720], 60.00th=[ 1720], | 70.00th=[ 5067], 80.00th=[ 5067], 90.00th=[ 5067], 95.00th=[ 5067], | 99.00th=[ 5067], 99.50th=[ 5067], 99.90th=[ 5067], 99.95th=[ 5067], | 99.99th=[ 5067] bw ( KiB/s): min= 7968, max= 8159, per=100.00%, avg=8063.50, stdev=135.06, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 2000=66.67%, >=2000=33.33% cpu : usr=0.02%, sys=1.99%, ctx=49, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181552: Sun Mar 15 18:39:41 2026 write: IOPS=0, BW=1827KiB/s (1871kB/s)(12.0MiB/6726msec); 0 zone resets clat (msec): min=867, max=4947, avg=2231.41, stdev=2351.85 lat (msec): min=870, max=4947, avg=2232.59, stdev=2351.45 clat percentiles (msec): | 1.00th=[ 869], 5.00th=[ 869], 10.00th=[ 869], 20.00th=[ 869], | 30.00th=[ 869], 40.00th=[ 877], 50.00th=[ 877], 60.00th=[ 877], | 70.00th=[ 4933], 80.00th=[ 4933], 90.00th=[ 4933], 95.00th=[ 4933], | 99.00th=[ 4933], 99.50th=[ 4933], 99.90th=[ 4933], 99.95th=[ 4933], | 99.99th=[ 4933] bw ( KiB/s): min= 7968, max= 8094, per=100.00%, avg=8031.00, stdev=89.10, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=66.67%, >=2000=33.33% cpu : usr=0.04%, sys=2.22%, ctx=51, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1817KiB/s (1860kB/s), 463KiB/s-1363KiB/s (474kB/s-1395kB/s), io=16.0MiB (16.8MB), run=8841-9018msec WRITE: bw=3706KiB/s (3795kB/s), 927KiB/s-1827KiB/s (949kB/s-1871kB/s), io=32.0MiB (33.6MB), run=6726-8841msec