== sanity test 398b: DIO and buffer IO race ============== 12:18:54 (1772471934) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 8.42578 s, 6.0 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=183068: Mon Mar 2 12:21:41 2026 read: IOPS=10, BW=41.5KiB/s (42.5kB/s)(5992KiB/144382msec) clat (usec): min=108, max=1008.2k, avg=53677.91, stdev=42962.28 lat (usec): min=110, max=1008.2k, avg=53681.44, stdev=42961.51 clat percentiles (usec): | 1.00th=[ 169], 5.00th=[ 14222], 10.00th=[ 20579], | 20.00th=[ 27919], 30.00th=[ 33424], 40.00th=[ 39060], | 50.00th=[ 45876], 60.00th=[ 53216], 70.00th=[ 63701], | 80.00th=[ 74974], 90.00th=[ 90702], 95.00th=[ 113771], | 99.00th=[ 189793], 99.50th=[ 240124], 99.90th=[ 341836], | 99.95th=[1010828], 99.99th=[1010828] bw ( KiB/s): min= 5, max= 103, per=24.75%, avg=41.09, stdev=16.90, samples=283 iops : min= 1, max= 25, avg= 9.59, stdev= 4.26, samples=283 write: IOPS=10, BW=43.6KiB/s (44.7kB/s)(6296KiB/144382msec); 0 zone resets clat (usec): min=744, max=285080, avg=40220.86, stdev=40695.45 lat (usec): min=746, max=285083, avg=40228.84, stdev=40700.34 clat percentiles (usec): | 1.00th=[ 1074], 5.00th=[ 1303], 10.00th=[ 1614], 20.00th=[ 4228], | 30.00th=[ 8979], 40.00th=[ 19530], 50.00th=[ 28705], 60.00th=[ 40109], | 70.00th=[ 51119], 80.00th=[ 71828], 90.00th=[ 94897], 95.00th=[121111], | 99.00th=[173016], 99.50th=[191890], 99.90th=[242222], 99.95th=[283116], | 99.99th=[283116] bw ( KiB/s): min= 7, max= 119, per=24.90%, avg=43.32, stdev=20.18, samples=282 iops : min= 1, max= 29, avg=10.16, stdev= 5.06, samples=282 lat (usec) : 250=1.40%, 500=0.16%, 750=0.07%, 1000=0.42% lat (msec) : 2=5.66%, 4=4.00%, 10=6.22%, 20=7.39%, 50=36.82% lat (msec) : 100=29.49%, 250=8.14%, 500=0.20%, 2000=0.03% cpu : usr=0.07%, sys=4.27%, ctx=6535, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183070: Mon Mar 2 12:21:41 2026 read: IOPS=10, BW=41.4KiB/s (42.4kB/s)(5940KiB/143376msec) clat (usec): min=110, max=306332, avg=53746.93, stdev=35189.68 lat (usec): min=111, max=306334, avg=53758.18, stdev=35187.22 clat percentiles (usec): | 1.00th=[ 167], 5.00th=[ 14615], 10.00th=[ 20317], 20.00th=[ 27657], | 30.00th=[ 33817], 40.00th=[ 40109], 50.00th=[ 47973], 60.00th=[ 54789], | 70.00th=[ 63177], 80.00th=[ 74974], 90.00th=[ 93848], 95.00th=[115868], | 99.00th=[185598], 99.50th=[231736], 99.90th=[295699], 99.95th=[308282], | 99.99th=[308282] bw ( KiB/s): min= 5, max= 95, per=24.79%, avg=41.15, stdev=16.73, samples=280 iops : min= 1, max= 23, avg= 9.61, stdev= 4.21, samples=280 write: IOPS=11, BW=44.3KiB/s (45.3kB/s)(6348KiB/143376msec); 0 zone resets clat (usec): min=865, max=843638, avg=39665.83, stdev=45268.59 lat (usec): min=866, max=843640, avg=39669.57, stdev=45270.85 clat percentiles (usec): | 1.00th=[ 1090], 5.00th=[ 1270], 10.00th=[ 1500], 20.00th=[ 4293], | 30.00th=[ 8717], 40.00th=[ 19268], 50.00th=[ 29492], 60.00th=[ 39060], | 70.00th=[ 51119], 80.00th=[ 68682], 90.00th=[ 92799], 95.00th=[116917], | 99.00th=[179307], 99.50th=[206570], 99.90th=[417334], 99.95th=[843056], | 99.99th=[843056] bw ( KiB/s): min= 7, max= 119, per=25.28%, avg=43.99, stdev=18.60, samples=279 iops : min= 1, max= 29, avg=10.33, stdev= 4.68, samples=279 lat (usec) : 250=1.33%, 500=0.10%, 750=0.07%, 1000=0.10% lat (msec) : 2=6.77%, 4=3.16%, 10=6.77%, 20=7.39%, 50=35.71% lat (msec) : 100=30.63%, 250=7.68%, 500=0.26%, 1000=0.03% cpu : usr=0.08%, sys=4.43%, ctx=6571, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183071: Mon Mar 2 12:21:41 2026 read: IOPS=10, BW=41.8KiB/s (42.9kB/s)(6028KiB/144049msec) clat (usec): min=116, max=355041, avg=52576.15, stdev=34853.32 lat (usec): min=116, max=355044, avg=52582.64, stdev=34851.76 clat percentiles (usec): | 1.00th=[ 163], 5.00th=[ 12780], 10.00th=[ 19530], 20.00th=[ 26870], | 30.00th=[ 33817], 40.00th=[ 40109], 50.00th=[ 45876], 60.00th=[ 53216], | 70.00th=[ 62653], 80.00th=[ 73925], 90.00th=[ 93848], 95.00th=[109577], | 99.00th=[170918], 99.50th=[225444], 99.90th=[341836], 99.95th=[354419], | 99.99th=[354419] bw ( KiB/s): min= 7, max= 93, per=25.18%, avg=41.80, stdev=16.64, samples=279 iops : min= 1, max= 23, avg= 9.78, stdev= 4.19, samples=279 write: IOPS=10, BW=43.5KiB/s (44.5kB/s)(6260KiB/144049msec); 0 zone resets clat (usec): min=769, max=944321, avg=41014.50, stdev=47058.57 lat (usec): min=770, max=944322, avg=41019.00, stdev=47059.91 clat percentiles (usec): | 1.00th=[ 1090], 5.00th=[ 1270], 10.00th=[ 1532], 20.00th=[ 4178], | 30.00th=[ 9110], 40.00th=[ 18744], 50.00th=[ 28443], 60.00th=[ 39060], | 70.00th=[ 52691], 80.00th=[ 70779], 90.00th=[100140], 95.00th=[123208], | 99.00th=[173016], 99.50th=[185598], 99.90th=[291505], 99.95th=[943719], | 99.99th=[943719] bw ( KiB/s): min= 7, max= 103, per=25.01%, avg=43.52, stdev=19.04, samples=278 iops : min= 1, max= 25, avg=10.21, stdev= 4.80, samples=278 lat (usec) : 250=1.50%, 500=0.23%, 750=0.10%, 1000=0.23% lat (msec) : 2=6.25%, 4=3.55%, 10=6.28%, 20=8.14%, 50=35.71% lat (msec) : 100=29.49%, 250=8.33%, 500=0.16%, 1000=0.03% cpu : usr=0.07%, sys=4.32%, ctx=6398, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183072: Mon Mar 2 12:21:41 2026 read: IOPS=10, BW=42.9KiB/s (43.9kB/s)(6052KiB/141111msec) clat (usec): min=91, max=271254, avg=51402.25, stdev=32517.92 lat (usec): min=92, max=271256, avg=51404.66, stdev=32517.53 clat percentiles (usec): | 1.00th=[ 165], 5.00th=[ 10421], 10.00th=[ 19006], 20.00th=[ 26084], | 30.00th=[ 32113], 40.00th=[ 38536], 50.00th=[ 45351], 60.00th=[ 53216], | 70.00th=[ 62129], 80.00th=[ 72877], 90.00th=[ 91751], 95.00th=[110625], | 99.00th=[164627], 99.50th=[173016], 99.90th=[235930], 99.95th=[270533], | 99.99th=[270533] bw ( KiB/s): min= 7, max= 87, per=25.83%, avg=42.88, stdev=16.79, samples=275 iops : min= 1, max= 21, avg=10.04, stdev= 4.22, samples=275 write: IOPS=11, BW=44.2KiB/s (45.3kB/s)(6236KiB/141111msec); 0 zone resets clat (usec): min=681, max=843135, avg=40232.59, stdev=45939.03 lat (usec): min=682, max=843137, avg=40235.87, stdev=45939.38 clat percentiles (usec): | 1.00th=[ 1045], 5.00th=[ 1221], 10.00th=[ 1434], 20.00th=[ 3654], | 30.00th=[ 8160], 40.00th=[ 16188], 50.00th=[ 27395], 60.00th=[ 39584], | 70.00th=[ 53216], 80.00th=[ 70779], 90.00th=[ 99091], 95.00th=[122160], | 99.00th=[170918], 99.50th=[200279], 99.90th=[291505], 99.95th=[843056], | 99.99th=[843056] bw ( KiB/s): min= 7, max= 119, per=25.58%, avg=44.51, stdev=18.82, samples=273 iops : min= 1, max= 29, avg=10.46, stdev= 4.72, samples=273 lat (usec) : 100=0.07%, 250=1.40%, 500=0.29%, 750=0.20%, 1000=0.39% lat (msec) : 2=6.71%, 4=3.71%, 10=6.48%, 20=8.30%, 50=34.34% lat (msec) : 100=29.75%, 250=8.24%, 500=0.10%, 1000=0.03% cpu : usr=0.07%, sys=4.38%, ctx=6467, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=166KiB/s (170kB/s), 41.4KiB/s-42.9KiB/s (42.4kB/s-43.9kB/s), io=23.4MiB (24.6MB), run=141111-144382msec WRITE: bw=174KiB/s (178kB/s), 43.5KiB/s-44.3KiB/s (44.5kB/s-45.3kB/s), io=24.6MiB (25.7MB), run=141111-144382msec rand-rw: (groupid=0, jobs=1): err= 0: pid=183073: Mon Mar 2 12:22:26 2026 read: IOPS=7, BW=31.9KiB/s (32.7kB/s)(5992KiB/187679msec) clat (msec): min=5, max=1012, avg=50.27, stdev=51.66 lat (msec): min=5, max=1012, avg=50.28, stdev=51.66 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 15], 20.00th=[ 20], | 30.00th=[ 24], 40.00th=[ 29], 50.00th=[ 35], 60.00th=[ 42], | 70.00th=[ 53], 80.00th=[ 72], 90.00th=[ 109], 95.00th=[ 146], | 99.00th=[ 218], 99.50th=[ 243], 99.90th=[ 485], 99.95th=[ 1011], | 99.99th=[ 1011] bw ( KiB/s): min= 7, max= 152, per=25.74%, avg=32.43, stdev=22.93, samples=358 iops : min= 1, max= 38, avg= 7.42, stdev= 5.78, samples=358 write: IOPS=8, BW=33.5KiB/s (34.4kB/s)(6296KiB/187679msec); 0 zone resets clat (msec): min=11, max=483, avg=71.02, stdev=50.08 lat (msec): min=11, max=483, avg=71.03, stdev=50.08 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 21], 10.00th=[ 26], 20.00th=[ 32], | 30.00th=[ 39], 40.00th=[ 47], 50.00th=[ 58], 60.00th=[ 70], | 70.00th=[ 84], 80.00th=[ 103], 90.00th=[ 136], 95.00th=[ 167], | 99.00th=[ 255], 99.50th=[ 305], 99.90th=[ 422], 99.95th=[ 485], | 99.99th=[ 485] bw ( KiB/s): min= 7, max= 111, per=25.51%, avg=33.67, stdev=21.20, samples=362 iops : min= 1, max= 27, avg= 7.73, stdev= 5.32, samples=362 lat (msec) : 10=1.43%, 20=11.91%, 50=41.89%, 100=28.48%, 250=15.63% lat (msec) : 500=0.62%, 2000=0.03% cpu : usr=0.06%, sys=1.63%, ctx=4844, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183074: Mon Mar 2 12:22:26 2026 read: IOPS=7, BW=31.5KiB/s (32.2kB/s)(5940KiB/188711msec) clat (msec): min=5, max=884, avg=50.04, stdev=48.10 lat (msec): min=5, max=884, avg=50.05, stdev=48.10 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 12], 10.00th=[ 15], 20.00th=[ 20], | 30.00th=[ 24], 40.00th=[ 30], 50.00th=[ 35], 60.00th=[ 43], | 70.00th=[ 55], 80.00th=[ 72], 90.00th=[ 109], 95.00th=[ 136], | 99.00th=[ 218], 99.50th=[ 249], 99.90th=[ 430], 99.95th=[ 885], | 99.99th=[ 885] bw ( KiB/s): min= 7, max= 135, per=25.62%, avg=32.28, stdev=23.37, samples=356 iops : min= 1, max= 33, avg= 7.38, stdev= 5.86, samples=356 write: IOPS=8, BW=33.6KiB/s (34.4kB/s)(6348KiB/188711msec); 0 zone resets clat (msec): min=10, max=488, avg=71.76, stdev=51.23 lat (msec): min=10, max=488, avg=71.78, stdev=51.22 clat percentiles (msec): | 1.00th=[ 15], 5.00th=[ 21], 10.00th=[ 25], 20.00th=[ 33], | 30.00th=[ 39], 40.00th=[ 46], 50.00th=[ 58], 60.00th=[ 70], | 70.00th=[ 85], 80.00th=[ 106], 90.00th=[ 136], 95.00th=[ 171], | 99.00th=[ 264], 99.50th=[ 288], 99.90th=[ 409], 99.95th=[ 489], | 99.99th=[ 489] bw ( KiB/s): min= 7, max= 103, per=25.45%, avg=33.60, stdev=20.52, samples=366 iops : min= 1, max= 25, avg= 7.72, stdev= 5.17, samples=366 lat (msec) : 10=1.30%, 20=11.52%, 50=42.12%, 100=27.77%, 250=16.47% lat (msec) : 500=0.78%, 1000=0.03% cpu : usr=0.06%, sys=1.60%, ctx=4761, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183075: Mon Mar 2 12:22:26 2026 read: IOPS=7, BW=31.9KiB/s (32.6kB/s)(6028KiB/189112msec) clat (msec): min=5, max=369, avg=50.21, stdev=43.59 lat (msec): min=5, max=369, avg=50.22, stdev=43.59 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 15], 20.00th=[ 20], | 30.00th=[ 24], 40.00th=[ 29], 50.00th=[ 35], 60.00th=[ 43], | 70.00th=[ 56], 80.00th=[ 73], 90.00th=[ 110], 95.00th=[ 140], | 99.00th=[ 203], 99.50th=[ 236], 99.90th=[ 347], 99.95th=[ 372], | 99.99th=[ 372] bw ( KiB/s): min= 7, max= 144, per=25.59%, avg=32.25, stdev=22.36, samples=362 iops : min= 1, max= 36, avg= 7.37, stdev= 5.62, samples=362 write: IOPS=8, BW=33.1KiB/s (33.9kB/s)(6260KiB/189112msec); 0 zone resets clat (msec): min=11, max=907, avg=72.15, stdev=54.47 lat (msec): min=11, max=907, avg=72.15, stdev=54.47 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 21], 10.00th=[ 26], 20.00th=[ 33], | 30.00th=[ 39], 40.00th=[ 46], 50.00th=[ 56], 60.00th=[ 70], | 70.00th=[ 86], 80.00th=[ 108], 90.00th=[ 140], 95.00th=[ 165], | 99.00th=[ 249], 99.50th=[ 284], 99.90th=[ 456], 99.95th=[ 911], | 99.99th=[ 911] bw ( KiB/s): min= 7, max= 111, per=25.16%, avg=33.21, stdev=21.07, samples=365 iops : min= 1, max= 27, avg= 7.61, stdev= 5.30, samples=365 lat (msec) : 10=1.07%, 20=12.11%, 50=42.12%, 100=27.02%, 250=17.06% lat (msec) : 500=0.59%, 1000=0.03% cpu : usr=0.06%, sys=1.67%, ctx=4873, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183076: Mon Mar 2 12:22:26 2026 read: IOPS=7, BW=31.0KiB/s (32.7kB/s)(6052KiB/189374msec) clat (msec): min=6, max=496, avg=50.41, stdev=44.75 lat (msec): min=6, max=496, avg=50.41, stdev=44.75 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 15], 20.00th=[ 19], | 30.00th=[ 24], 40.00th=[ 28], 50.00th=[ 35], 60.00th=[ 44], | 70.00th=[ 56], 80.00th=[ 73], 90.00th=[ 112], 95.00th=[ 144], | 99.00th=[ 203], 99.50th=[ 224], 99.90th=[ 372], 99.95th=[ 498], | 99.99th=[ 498] bw ( KiB/s): min= 7, max= 183, per=25.86%, avg=32.59, stdev=23.03, samples=358 iops : min= 1, max= 45, avg= 7.46, stdev= 5.80, samples=358 write: IOPS=8, BW=32.9KiB/s (33.7kB/s)(6236KiB/189374msec); 0 zone resets clat (msec): min=9, max=877, avg=72.21, stdev=54.78 lat (msec): min=9, max=877, avg=72.21, stdev=54.78 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 22], 10.00th=[ 26], 20.00th=[ 33], | 30.00th=[ 39], 40.00th=[ 47], 50.00th=[ 56], 60.00th=[ 69], | 70.00th=[ 85], 80.00th=[ 106], 90.00th=[ 140], 95.00th=[ 171], | 99.00th=[ 253], 99.50th=[ 288], 99.90th=[ 384], 99.95th=[ 877], | 99.99th=[ 877] bw ( KiB/s): min= 7, max= 104, per=24.95%, avg=32.93, stdev=20.24, samples=365 iops : min= 1, max= 26, avg= 7.55, stdev= 5.09, samples=365 lat (msec) : 10=1.33%, 20=11.65%, 50=42.25%, 100=27.57%, 250=16.57% lat (msec) : 500=0.59%, 1000=0.03% cpu : usr=0.05%, sys=1.54%, ctx=4689, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=127KiB/s (130kB/s), 31.5KiB/s-31.0KiB/s (32.2kB/s-32.7kB/s), io=23.4MiB (24.6MB), run=187679-189374msec WRITE: bw=133KiB/s (136kB/s), 32.9KiB/s-33.6KiB/s (33.7kB/s-34.4kB/s), io=24.6MiB (25.7MB), run=187679-189374msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=183120: Mon Mar 2 12:23:16 2026 read: IOPS=10, BW=165KiB/s (169kB/s)(5920KiB/35972msec) clat (usec): min=121, max=238211, avg=49763.54, stdev=35536.04 lat (usec): min=123, max=238212, avg=49768.04, stdev=35537.16 clat percentiles (usec): | 1.00th=[ 163], 5.00th=[ 204], 10.00th=[ 3654], 20.00th=[ 24249], | 30.00th=[ 31851], 40.00th=[ 36963], 50.00th=[ 43254], 60.00th=[ 50070], | 70.00th=[ 59507], 80.00th=[ 72877], 90.00th=[ 92799], 95.00th=[123208], | 99.00th=[175113], 99.50th=[202376], 99.90th=[238027], 99.95th=[238027], | 99.99th=[238027] bw ( KiB/s): min= 61, max= 377, per=24.65%, avg=163.94, stdev=66.90, samples=70 iops : min= 3, max= 23, avg= 9.49, stdev= 4.23, samples=70 write: IOPS=11, BW=177KiB/s (181kB/s)(6368KiB/35972msec); 0 zone resets clat (usec): min=1546, max=268741, avg=43392.62, stdev=40437.73 lat (usec): min=1548, max=268743, avg=43438.42, stdev=40416.38 clat percentiles (usec): | 1.00th=[ 1876], 5.00th=[ 2606], 10.00th=[ 5014], 20.00th=[ 8979], | 30.00th=[ 15664], 40.00th=[ 22414], 50.00th=[ 34866], 60.00th=[ 44827], | 70.00th=[ 54789], 80.00th=[ 72877], 90.00th=[ 92799], 95.00th=[117965], | 99.00th=[189793], 99.50th=[223347], 99.90th=[270533], 99.95th=[270533], | 99.99th=[270533] bw ( KiB/s): min= 30, max= 318, per=25.32%, avg=177.26, stdev=70.93, samples=70 iops : min= 1, max= 19, avg=10.33, stdev= 4.45, samples=70 lat (usec) : 250=3.26%, 500=1.04%, 750=0.13% lat (msec) : 2=1.30%, 4=2.86%, 10=8.98%, 20=7.42%, 50=37.89% lat (msec) : 100=29.69%, 250=7.29%, 500=0.13% cpu : usr=0.08%, sys=5.71%, ctx=1853, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183121: Mon Mar 2 12:23:16 2026 read: IOPS=10, BW=171KiB/s (175kB/s)(5744KiB/33573msec) clat (usec): min=125, max=266000, avg=48314.46, stdev=33444.54 lat (usec): min=125, max=266002, avg=48316.33, stdev=33444.50 clat percentiles (usec): | 1.00th=[ 149], 5.00th=[ 200], 10.00th=[ 1811], 20.00th=[ 24249], | 30.00th=[ 30802], 40.00th=[ 36439], 50.00th=[ 42730], 60.00th=[ 50594], | 70.00th=[ 59507], 80.00th=[ 72877], 90.00th=[ 86508], 95.00th=[112722], | 99.00th=[152044], 99.50th=[166724], 99.90th=[265290], 99.95th=[265290], | 99.99th=[265290] bw ( KiB/s): min= 31, max= 415, per=25.67%, avg=170.74, stdev=76.20, samples=65 iops : min= 1, max= 25, avg= 9.91, stdev= 4.78, samples=65 write: IOPS=12, BW=195KiB/s (200kB/s)(6544KiB/33573msec); 0 zone resets clat (usec): min=1629, max=321945, avg=39349.12, stdev=38440.03 lat (usec): min=1632, max=321948, avg=39353.06, stdev=38439.18 clat percentiles (usec): | 1.00th=[ 1762], 5.00th=[ 2114], 10.00th=[ 3490], 20.00th=[ 6456], | 30.00th=[ 12125], 40.00th=[ 21365], 50.00th=[ 30016], 60.00th=[ 38011], | 70.00th=[ 50070], 80.00th=[ 66847], 90.00th=[ 89654], 95.00th=[108528], | 99.00th=[154141], 99.50th=[173016], 99.90th=[320865], 99.95th=[320865], | 99.99th=[320865] bw ( KiB/s): min= 31, max= 381, per=27.70%, avg=193.92, stdev=69.96, samples=65 iops : min= 1, max= 23, avg=11.38, stdev= 4.45, samples=65 lat (usec) : 250=3.52%, 500=0.26%, 750=0.52%, 1000=0.13% lat (msec) : 2=2.21%, 4=4.56%, 10=7.94%, 20=8.46%, 50=37.37% lat (msec) : 100=28.78%, 250=5.99%, 500=0.26% cpu : usr=0.06%, sys=5.64%, ctx=1792, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183123: Mon Mar 2 12:23:16 2026 read: IOPS=11, BW=181KiB/s (185kB/s)(6256KiB/34568msec) clat (usec): min=136, max=211907, avg=49982.88, stdev=32996.63 lat (usec): min=136, max=211909, avg=50024.46, stdev=32991.23 clat percentiles (usec): | 1.00th=[ 165], 5.00th=[ 208], 10.00th=[ 11207], 20.00th=[ 26870], | 30.00th=[ 32637], 40.00th=[ 39060], 50.00th=[ 45351], 60.00th=[ 51643], | 70.00th=[ 61604], 80.00th=[ 70779], 90.00th=[ 87557], 95.00th=[104334], | 99.00th=[177210], 99.50th=[187696], 99.90th=[212861], 99.95th=[212861], | 99.99th=[212861] bw ( KiB/s): min= 62, max= 317, per=27.31%, avg=181.63, stdev=68.48, samples=67 iops : min= 3, max= 19, avg=10.61, stdev= 4.34, samples=67 write: IOPS=10, BW=174KiB/s (179kB/s)(6032KiB/34568msec); 0 zone resets clat (usec): min=1636, max=211980, avg=39139.72, stdev=37443.19 lat (usec): min=1642, max=211982, avg=39145.71, stdev=37443.38 clat percentiles (usec): | 1.00th=[ 1762], 5.00th=[ 2024], 10.00th=[ 3556], 20.00th=[ 7963], | 30.00th=[ 12780], 40.00th=[ 21365], 50.00th=[ 29230], 60.00th=[ 38011], | 70.00th=[ 49021], 80.00th=[ 63177], 90.00th=[ 88605], 95.00th=[114820], | 99.00th=[173016], 99.50th=[187696], 99.90th=[212861], 99.95th=[212861], | 99.99th=[212861] bw ( KiB/s): min= 31, max= 342, per=24.54%, avg=171.81, stdev=69.97, samples=67 iops : min= 1, max= 21, avg= 9.99, stdev= 4.42, samples=67 lat (usec) : 250=3.39%, 500=0.91%, 750=0.13%, 1000=0.13% lat (msec) : 2=2.47%, 4=2.99%, 10=7.94%, 20=7.16%, 50=38.80% lat (msec) : 100=29.04%, 250=7.03% cpu : usr=0.11%, sys=5.80%, ctx=1804, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183124: Mon Mar 2 12:23:16 2026 read: IOPS=11, BW=179KiB/s (183kB/s)(6032KiB/33739msec) clat (usec): min=155, max=208591, avg=48053.21, stdev=33907.55 lat (usec): min=156, max=208626, avg=48057.75, stdev=33908.82 clat percentiles (usec): | 1.00th=[ 167], 5.00th=[ 192], 10.00th=[ 258], 20.00th=[ 23725], | 30.00th=[ 32113], 40.00th=[ 37487], 50.00th=[ 44303], 60.00th=[ 51643], | 70.00th=[ 57934], 80.00th=[ 70779], 90.00th=[ 88605], 95.00th=[106431], | 99.00th=[160433], 99.50th=[206570], 99.90th=[208667], 99.95th=[208667], | 99.99th=[208667] bw ( KiB/s): min= 31, max= 406, per=27.39%, avg=182.12, stdev=68.95, samples=65 iops : min= 1, max= 25, avg=10.63, stdev= 4.36, samples=65 write: IOPS=11, BW=185KiB/s (190kB/s)(6256KiB/33739msec); 0 zone resets clat (usec): min=1522, max=180925, avg=38429.53, stdev=38702.37 lat (usec): min=1524, max=180926, avg=38434.16, stdev=38701.41 clat percentiles (usec): | 1.00th=[ 1729], 5.00th=[ 2089], 10.00th=[ 3032], 20.00th=[ 5669], | 30.00th=[ 10945], 40.00th=[ 18482], 50.00th=[ 27395], 60.00th=[ 35914], | 70.00th=[ 45351], 80.00th=[ 65274], 90.00th=[ 93848], 95.00th=[126354], | 99.00th=[166724], 99.50th=[179307], 99.90th=[181404], 99.95th=[181404], | 99.99th=[181404] bw ( KiB/s): min= 31, max= 407, per=26.55%, avg=185.88, stdev=75.01, samples=66 iops : min= 1, max= 25, avg=10.89, stdev= 4.70, samples=66 lat (usec) : 250=4.56%, 500=0.91%, 750=0.65%, 1000=0.13% lat (msec) : 2=2.34%, 4=5.99%, 10=7.16%, 20=8.20%, 50=36.20% lat (msec) : 100=26.95%, 250=6.90% cpu : usr=0.08%, sys=5.41%, ctx=1722, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=666KiB/s (682kB/s), 165KiB/s-181KiB/s (169kB/s-185kB/s), io=23.4MiB (24.5MB), run=33573-35972msec WRITE: bw=701KiB/s (717kB/s), 174KiB/s-195KiB/s (179kB/s-200kB/s), io=24.6MiB (25.8MB), run=33573-35972msec rand-rw: (groupid=0, jobs=1): err= 0: pid=183122: Mon Mar 2 12:23:26 2026 read: IOPS=8, BW=128KiB/s (132kB/s)(5920KiB/46086msec) clat (msec): min=4, max=219, avg=48.61, stdev=41.27 lat (msec): min=4, max=219, avg=48.61, stdev=41.27 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 15], 20.00th=[ 19], | 30.00th=[ 23], 40.00th=[ 28], 50.00th=[ 35], 60.00th=[ 42], | 70.00th=[ 51], 80.00th=[ 71], 90.00th=[ 111], 95.00th=[ 140], | 99.00th=[ 203], 99.50th=[ 207], 99.90th=[ 220], 99.95th=[ 220], | 99.99th=[ 220] bw ( KiB/s): min= 31, max= 415, per=24.90%, avg=128.73, stdev=84.55, samples=89 iops : min= 1, max= 25, avg= 7.25, stdev= 5.36, samples=89 write: IOPS=8, BW=138KiB/s (141kB/s)(6368KiB/46086msec); 0 zone resets clat (msec): min=15, max=305, avg=69.24, stdev=47.33 lat (msec): min=15, max=305, avg=69.25, stdev=47.33 clat percentiles (msec): | 1.00th=[ 20], 5.00th=[ 24], 10.00th=[ 27], 20.00th=[ 31], | 30.00th=[ 39], 40.00th=[ 44], 50.00th=[ 53], 60.00th=[ 67], | 70.00th=[ 83], 80.00th=[ 104], 90.00th=[ 138], 95.00th=[ 165], | 99.00th=[ 251], 99.50th=[ 288], 99.90th=[ 305], 99.95th=[ 305], | 99.99th=[ 305] bw ( KiB/s): min= 31, max= 448, per=25.88%, avg=140.80, stdev=80.97, samples=88 iops : min= 1, max= 28, avg= 8.01, stdev= 5.17, samples=88 lat (msec) : 10=1.69%, 20=10.81%, 50=45.44%, 100=25.26%, 250=16.41% lat (msec) : 500=0.39% cpu : usr=0.07%, sys=1.71%, ctx=1196, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183125: Mon Mar 2 12:23:26 2026 read: IOPS=7, BW=124KiB/s (127kB/s)(5744KiB/46291msec) clat (msec): min=8, max=320, avg=48.77, stdev=44.81 lat (msec): min=8, max=320, avg=48.77, stdev=44.81 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 14], 10.00th=[ 16], 20.00th=[ 21], | 30.00th=[ 24], 40.00th=[ 28], 50.00th=[ 32], 60.00th=[ 40], | 70.00th=[ 50], 80.00th=[ 70], 90.00th=[ 101], 95.00th=[ 148], | 99.00th=[ 222], 99.50th=[ 245], 99.90th=[ 321], 99.95th=[ 321], | 99.99th=[ 321] bw ( KiB/s): min= 23, max= 447, per=24.66%, avg=127.51, stdev=82.99, samples=87 iops : min= 1, max= 27, avg= 7.17, stdev= 5.23, samples=87 write: IOPS=8, BW=141KiB/s (145kB/s)(6544KiB/46291msec); 0 zone resets clat (msec): min=9, max=252, avg=69.64, stdev=43.21 lat (msec): min=9, max=252, avg=69.64, stdev=43.21 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 22], 10.00th=[ 27], 20.00th=[ 34], | 30.00th=[ 42], 40.00th=[ 49], 50.00th=[ 57], 60.00th=[ 68], | 70.00th=[ 84], 80.00th=[ 103], 90.00th=[ 132], 95.00th=[ 153], | 99.00th=[ 203], 99.50th=[ 213], 99.90th=[ 253], 99.95th=[ 253], | 99.99th=[ 253] bw ( KiB/s): min= 30, max= 512, per=25.58%, avg=139.16, stdev=82.59, samples=90 iops : min= 1, max= 32, avg= 7.91, stdev= 5.28, samples=90 lat (msec) : 10=0.78%, 20=10.29%, 50=43.75%, 100=29.56%, 250=15.23% lat (msec) : 500=0.39% cpu : usr=0.06%, sys=1.74%, ctx=1196, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183126: Mon Mar 2 12:23:26 2026 read: IOPS=8, BW=137KiB/s (140kB/s)(6256KiB/45657msec) clat (msec): min=7, max=316, avg=48.11, stdev=41.04 lat (msec): min=7, max=316, avg=48.12, stdev=41.04 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 16], 20.00th=[ 21], | 30.00th=[ 24], 40.00th=[ 29], 50.00th=[ 35], 60.00th=[ 41], | 70.00th=[ 51], 80.00th=[ 67], 90.00th=[ 106], 95.00th=[ 133], | 99.00th=[ 186], 99.50th=[ 268], 99.90th=[ 317], 99.95th=[ 317], | 99.99th=[ 317] bw ( KiB/s): min= 31, max= 448, per=27.31%, avg=141.21, stdev=92.55, samples=87 iops : min= 1, max= 28, avg= 8.03, stdev= 5.86, samples=87 write: IOPS=8, BW=132KiB/s (135kB/s)(6032KiB/45657msec); 0 zone resets clat (msec): min=11, max=291, avg=69.47, stdev=44.18 lat (msec): min=11, max=291, avg=69.50, stdev=44.19 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 22], 10.00th=[ 27], 20.00th=[ 35], | 30.00th=[ 41], 40.00th=[ 48], 50.00th=[ 59], 60.00th=[ 67], | 70.00th=[ 80], 80.00th=[ 99], 90.00th=[ 131], 95.00th=[ 161], | 99.00th=[ 213], 99.50th=[ 288], 99.90th=[ 292], 99.95th=[ 292], | 99.99th=[ 292] bw ( KiB/s): min= 23, max= 384, per=24.06%, avg=130.89, stdev=74.60, samples=89 iops : min= 1, max= 24, avg= 7.38, stdev= 4.75, samples=89 lat (msec) : 10=1.17%, 20=10.42%, 50=44.27%, 100=29.04%, 250=14.58% lat (msec) : 500=0.52% cpu : usr=0.06%, sys=1.89%, ctx=1239, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183127: Mon Mar 2 12:23:26 2026 read: IOPS=8, BW=132KiB/s (135kB/s)(6032KiB/45840msec) clat (msec): min=6, max=221, avg=46.71, stdev=38.38 lat (msec): min=6, max=221, avg=46.71, stdev=38.38 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 12], 10.00th=[ 15], 20.00th=[ 21], | 30.00th=[ 24], 40.00th=[ 28], 50.00th=[ 32], 60.00th=[ 39], | 70.00th=[ 51], 80.00th=[ 66], 90.00th=[ 106], 95.00th=[ 142], | 99.00th=[ 182], 99.50th=[ 186], 99.90th=[ 222], 99.95th=[ 222], | 99.99th=[ 222] bw ( KiB/s): min= 31, max= 576, per=26.06%, avg=134.75, stdev=85.23, samples=88 iops : min= 1, max= 36, avg= 7.62, stdev= 5.44, samples=88 write: IOPS=8, BW=136KiB/s (140kB/s)(6256KiB/45840msec); 0 zone resets clat (msec): min=15, max=305, avg=71.72, stdev=44.86 lat (msec): min=15, max=305, avg=71.74, stdev=44.86 clat percentiles (msec): | 1.00th=[ 19], 5.00th=[ 24], 10.00th=[ 29], 20.00th=[ 35], | 30.00th=[ 42], 40.00th=[ 48], 50.00th=[ 59], 60.00th=[ 71], | 70.00th=[ 86], 80.00th=[ 106], 90.00th=[ 132], 95.00th=[ 165], | 99.00th=[ 203], 99.50th=[ 239], 99.90th=[ 305], 99.95th=[ 305], | 99.99th=[ 305] bw ( KiB/s): min= 31, max= 441, per=25.08%, avg=136.44, stdev=77.13, samples=90 iops : min= 1, max= 27, avg= 7.74, stdev= 4.91, samples=90 lat (msec) : 10=0.91%, 20=9.64%, 50=44.92%, 100=26.82%, 250=17.58% lat (msec) : 500=0.13% cpu : usr=0.05%, sys=1.70%, ctx=1208, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=517KiB/s (530kB/s), 124KiB/s-137KiB/s (127kB/s-140kB/s), io=23.4MiB (24.5MB), run=45657-46291msec WRITE: bw=544KiB/s (557kB/s), 132KiB/s-141KiB/s (135kB/s-145kB/s), io=24.6MiB (25.8MB), run=45657-46291msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=183140: Mon Mar 2 12:23:47 2026 read: IOPS=2, BW=2054KiB/s (2104kB/s)(7168KiB/3489msec) clat (msec): min=131, max=359, avg=257.17, stdev=74.42 lat (msec): min=131, max=359, avg=257.18, stdev=74.42 clat percentiles (msec): | 1.00th=[ 132], 5.00th=[ 132], 10.00th=[ 132], 20.00th=[ 199], | 30.00th=[ 253], 40.00th=[ 253], 50.00th=[ 271], 60.00th=[ 279], | 70.00th=[ 279], 80.00th=[ 309], 90.00th=[ 359], 95.00th=[ 359], | 99.00th=[ 359], 99.50th=[ 359], 99.90th=[ 359], 99.95th=[ 359], | 99.99th=[ 359] bw ( KiB/s): min= 1777, max= 3813, per=82.95%, avg=2661.00, stdev=933.27, samples=4 iops : min= 1, max= 3, avg= 1.75, stdev= 0.96, samples=4 write: IOPS=1, BW=1467KiB/s (1503kB/s)(5120KiB/3489msec); 0 zone resets clat (msec): min=203, max=515, avg=309.36, stdev=120.32 lat (msec): min=203, max=515, avg=310.79, stdev=120.18 clat percentiles (msec): | 1.00th=[ 205], 5.00th=[ 205], 10.00th=[ 205], 20.00th=[ 205], | 30.00th=[ 257], 40.00th=[ 257], 50.00th=[ 268], 60.00th=[ 268], | 70.00th=[ 305], 80.00th=[ 305], 90.00th=[ 514], 95.00th=[ 514], | 99.00th=[ 514], 99.50th=[ 514], 99.90th=[ 514], 99.95th=[ 514], | 99.99th=[ 514] bw ( KiB/s): min= 1777, max= 3785, per=53.07%, avg=2383.25, stdev=940.83, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (msec) : 250=25.00%, 500=66.67%, 750=8.33% cpu : usr=0.03%, sys=13.22%, ctx=149, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183141: Mon Mar 2 12:23:47 2026 read: IOPS=0, BW=363KiB/s (372kB/s)(2048KiB/5639msec) clat (msec): min=10, max=241, avg=126.14, stdev=163.21 lat (msec): min=10, max=241, avg=126.14, stdev=163.21 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 11], 10.00th=[ 11], 20.00th=[ 11], | 30.00th=[ 11], 40.00th=[ 11], 50.00th=[ 11], 60.00th=[ 243], | 70.00th=[ 243], 80.00th=[ 243], 90.00th=[ 243], 95.00th=[ 243], | 99.00th=[ 243], 99.50th=[ 243], 99.90th=[ 243], 99.95th=[ 243], | 99.99th=[ 243] bw ( KiB/s): min= 1572, max= 2027, per=56.09%, avg=1799.50, stdev=321.73, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1816KiB/s (1860kB/s)(10.0MiB/5639msec); 0 zone resets clat (msec): min=247, max=1606, avg=523.39, stdev=433.37 lat (msec): min=247, max=1606, avg=523.61, stdev=433.30 clat percentiles (msec): | 1.00th=[ 247], 5.00th=[ 247], 10.00th=[ 247], 20.00th=[ 264], | 30.00th=[ 284], 40.00th=[ 300], 50.00th=[ 305], 60.00th=[ 342], | 70.00th=[ 418], 80.00th=[ 535], 90.00th=[ 936], 95.00th=[ 1603], | 99.00th=[ 1603], 99.50th=[ 1603], 99.90th=[ 1603], 99.95th=[ 1603], | 99.99th=[ 1603] bw ( KiB/s): min= 1906, max= 4055, per=65.72%, avg=2951.50, stdev=1095.78, samples=6 iops : min= 1, max= 3, avg= 2.00, stdev= 1.10, samples=6 lat (msec) : 20=8.33%, 250=16.67%, 500=50.00%, 750=8.33%, 1000=8.33% lat (msec) : 2000=8.33% cpu : usr=0.07%, sys=9.95%, ctx=140, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183142: Mon Mar 2 12:23:47 2026 read: IOPS=1, BW=1420KiB/s (1454kB/s)(6144KiB/4328msec) clat (msec): min=2, max=735, avg=282.07, stdev=273.70 lat (msec): min=2, max=735, avg=282.07, stdev=273.70 clat percentiles (msec): | 1.00th=[ 3], 5.00th=[ 3], 10.00th=[ 3], 20.00th=[ 10], | 30.00th=[ 10], 40.00th=[ 249], 50.00th=[ 249], 60.00th=[ 292], | 70.00th=[ 405], 80.00th=[ 405], 90.00th=[ 735], 95.00th=[ 735], | 99.00th=[ 735], 99.50th=[ 735], 99.90th=[ 735], 99.95th=[ 735], | 99.99th=[ 735] bw ( KiB/s): min= 1906, max= 5829, per=100.00%, avg=3221.00, stdev=2258.62, samples=3 iops : min= 1, max= 5, avg= 2.33, stdev= 2.31, samples=3 write: IOPS=1, BW=1420KiB/s (1454kB/s)(6144KiB/4328msec); 0 zone resets clat (msec): min=280, max=680, avg=433.82, stdev=187.24 lat (msec): min=281, max=681, avg=434.10, stdev=187.10 clat percentiles (msec): | 1.00th=[ 279], 5.00th=[ 279], 10.00th=[ 279], 20.00th=[ 296], | 30.00th=[ 296], 40.00th=[ 334], 50.00th=[ 334], 60.00th=[ 342], | 70.00th=[ 667], 80.00th=[ 667], 90.00th=[ 684], 95.00th=[ 684], | 99.00th=[ 684], 99.50th=[ 684], 99.90th=[ 684], 99.95th=[ 684], | 99.99th=[ 684] bw ( KiB/s): min= 1556, max= 1943, per=40.41%, avg=1814.80, stdev=157.42, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 lat (msec) : 4=8.33%, 10=8.33%, 250=8.33%, 500=50.00%, 750=25.00% cpu : usr=0.07%, sys=11.62%, ctx=207, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183145: Mon Mar 2 12:23:47 2026 read: IOPS=0, BW=802KiB/s (821kB/s)(5120KiB/6384msec) clat (usec): min=1449, max=258286, avg=103405.57, stdev=138758.07 lat (usec): min=1451, max=258288, avg=103407.62, stdev=138757.67 clat percentiles (usec): | 1.00th=[ 1450], 5.00th=[ 1450], 10.00th=[ 1450], 20.00th=[ 1450], | 30.00th=[ 2212], 40.00th=[ 2212], 50.00th=[ 2573], 60.00th=[ 2573], | 70.00th=[252707], 80.00th=[252707], 90.00th=[258999], 95.00th=[258999], | 99.00th=[258999], 99.50th=[258999], 99.90th=[258999], 99.95th=[258999], | 99.99th=[258999] bw ( KiB/s): min= 3938, max= 4023, per=100.00%, avg=3980.50, stdev=60.10, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1123KiB/s (1150kB/s)(7168KiB/6384msec); 0 zone resets clat (msec): min=213, max=1565, avg=771.11, stdev=509.19 lat (msec): min=213, max=1565, avg=771.34, stdev=509.24 clat percentiles (msec): | 1.00th=[ 213], 5.00th=[ 213], 10.00th=[ 213], 20.00th=[ 253], | 30.00th=[ 472], 40.00th=[ 472], 50.00th=[ 667], 60.00th=[ 1062], | 70.00th=[ 1062], 80.00th=[ 1167], 90.00th=[ 1569], 95.00th=[ 1569], | 99.00th=[ 1569], 99.50th=[ 1569], 99.90th=[ 1569], 99.95th=[ 1569], | 99.99th=[ 1569] bw ( KiB/s): min= 1777, max= 4071, per=52.45%, avg=2355.60, stdev=964.24, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 lat (msec) : 2=8.33%, 4=16.67%, 250=8.33%, 500=33.33%, 750=8.33% lat (msec) : 2000=25.00% cpu : usr=0.06%, sys=6.19%, ctx=120, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3208KiB/s (3285kB/s), 363KiB/s-2054KiB/s (372kB/s-2104kB/s), io=20.0MiB (20.0MB), run=3489-6384msec WRITE: bw=4491KiB/s (4599kB/s), 1123KiB/s-1816KiB/s (1150kB/s-1860kB/s), io=28.0MiB (29.4MB), run=3489-6384msec rand-rw: (groupid=0, jobs=1): err= 0: pid=183143: Mon Mar 2 12:23:47 2026 read: IOPS=1, BW=1630KiB/s (1669kB/s)(7168KiB/4397msec) clat (msec): min=125, max=953, avg=370.43, stdev=304.27 lat (msec): min=125, max=953, avg=370.43, stdev=304.27 clat percentiles (msec): | 1.00th=[ 126], 5.00th=[ 126], 10.00th=[ 126], 20.00th=[ 180], | 30.00th=[ 220], 40.00th=[ 220], 50.00th=[ 232], 60.00th=[ 259], | 70.00th=[ 259], 80.00th=[ 625], 90.00th=[ 953], 95.00th=[ 953], | 99.00th=[ 953], 99.50th=[ 953], 99.90th=[ 953], 99.95th=[ 953], | 99.99th=[ 953] bw ( KiB/s): min= 1882, max= 4087, per=75.10%, avg=2368.00, stdev=962.25, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 write: IOPS=1, BW=1164KiB/s (1192kB/s)(5120KiB/4397msec); 0 zone resets clat (msec): min=139, max=453, avg=269.25, stdev=145.94 lat (msec): min=139, max=453, avg=269.60, stdev=145.81 clat percentiles (msec): | 1.00th=[ 140], 5.00th=[ 140], 10.00th=[ 140], 20.00th=[ 140], | 30.00th=[ 157], 40.00th=[ 157], 50.00th=[ 199], 60.00th=[ 199], | 70.00th=[ 401], 80.00th=[ 401], 90.00th=[ 456], 95.00th=[ 456], | 99.00th=[ 456], 99.50th=[ 456], 99.90th=[ 456], 99.95th=[ 456], | 99.99th=[ 456] bw ( KiB/s): min= 1892, max= 5763, per=73.04%, avg=3224.67, stdev=2199.18, samples=3 iops : min= 1, max= 5, avg= 2.33, stdev= 2.31, samples=3 lat (msec) : 250=58.33%, 500=25.00%, 750=8.33%, 1000=8.33% cpu : usr=0.00%, sys=3.43%, ctx=82, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183144: Mon Mar 2 12:23:47 2026 read: IOPS=0, BW=315KiB/s (323kB/s)(2048KiB/6494msec) clat (msec): min=131, max=372, avg=252.19, stdev=170.29 lat (msec): min=131, max=372, avg=252.19, stdev=170.29 clat percentiles (msec): | 1.00th=[ 132], 5.00th=[ 132], 10.00th=[ 132], 20.00th=[ 132], | 30.00th=[ 132], 40.00th=[ 132], 50.00th=[ 132], 60.00th=[ 372], | 70.00th=[ 372], 80.00th=[ 372], 90.00th=[ 372], 95.00th=[ 372], | 99.00th=[ 372], 99.50th=[ 372], 99.90th=[ 372], 99.95th=[ 372], | 99.99th=[ 372] bw ( KiB/s): min= 1924, max= 1980, per=61.91%, avg=1952.00, stdev=39.60, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1577KiB/s (1615kB/s)(10.0MiB/6494msec); 0 zone resets clat (msec): min=136, max=1542, avg=553.28, stdev=488.34 lat (msec): min=137, max=1545, avg=553.71, stdev=488.97 clat percentiles (msec): | 1.00th=[ 138], 5.00th=[ 138], 10.00th=[ 138], 20.00th=[ 138], | 30.00th=[ 249], 40.00th=[ 271], 50.00th=[ 355], 60.00th=[ 430], | 70.00th=[ 460], 80.00th=[ 642], 90.00th=[ 1318], 95.00th=[ 1536], | 99.00th=[ 1536], 99.50th=[ 1536], 99.90th=[ 1536], 99.95th=[ 1536], | 99.99th=[ 1536] bw ( KiB/s): min= 1892, max= 6035, per=68.12%, avg=3007.50, stdev=1706.51, samples=6 iops : min= 1, max= 5, avg= 2.17, stdev= 1.60, samples=6 lat (msec) : 250=33.33%, 500=41.67%, 750=8.33%, 2000=16.67% cpu : usr=0.00%, sys=4.22%, ctx=96, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183146: Mon Mar 2 12:23:47 2026 read: IOPS=1, BW=1160KiB/s (1188kB/s)(6144KiB/5295msec) clat (msec): min=79, max=1384, avg=337.18, stdev=514.22 lat (msec): min=79, max=1384, avg=337.18, stdev=514.22 clat percentiles (msec): | 1.00th=[ 80], 5.00th=[ 80], 10.00th=[ 80], 20.00th=[ 112], | 30.00th=[ 112], 40.00th=[ 120], 50.00th=[ 120], 60.00th=[ 148], | 70.00th=[ 182], 80.00th=[ 182], 90.00th=[ 1385], 95.00th=[ 1385], | 99.00th=[ 1385], 99.50th=[ 1385], 99.90th=[ 1385], 99.95th=[ 1385], | 99.99th=[ 1385] bw ( KiB/s): min= 1980, max= 4087, per=100.00%, avg=3358.00, stdev=1194.05, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 write: IOPS=1, BW=1160KiB/s (1188kB/s)(6144KiB/5295msec); 0 zone resets clat (msec): min=156, max=1279, avg=475.90, stdev=416.50 lat (msec): min=156, max=1279, avg=476.01, stdev=416.51 clat percentiles (msec): | 1.00th=[ 157], 5.00th=[ 157], 10.00th=[ 157], 20.00th=[ 220], | 30.00th=[ 220], 40.00th=[ 245], 50.00th=[ 245], 60.00th=[ 456], | 70.00th=[ 498], 80.00th=[ 498], 90.00th=[ 1284], 95.00th=[ 1284], | 99.00th=[ 1284], 99.50th=[ 1284], 99.90th=[ 1284], 99.95th=[ 1284], | 99.99th=[ 1284] bw ( KiB/s): min= 1892, max= 3961, per=53.22%, avg=2349.60, stdev=902.62, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 lat (msec) : 100=8.33%, 250=58.33%, 500=16.67%, 2000=16.67% cpu : usr=0.00%, sys=3.46%, ctx=98, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183147: Mon Mar 2 12:23:47 2026 read: IOPS=0, BW=826KiB/s (846kB/s)(5120KiB/6199msec) clat (msec): min=130, max=616, avg=367.28, stdev=229.66 lat (msec): min=130, max=616, avg=367.28, stdev=229.66 clat percentiles (msec): | 1.00th=[ 131], 5.00th=[ 131], 10.00th=[ 131], 20.00th=[ 131], | 30.00th=[ 132], 40.00th=[ 132], 50.00th=[ 397], 60.00th=[ 397], | 70.00th=[ 558], 80.00th=[ 558], 90.00th=[ 617], 95.00th=[ 617], | 99.00th=[ 617], 99.50th=[ 617], 99.90th=[ 617], 99.95th=[ 617], | 99.99th=[ 617] bw ( KiB/s): min= 1921, max= 2019, per=62.82%, avg=1980.75, stdev=42.93, samples=4 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=4 write: IOPS=1, BW=1156KiB/s (1184kB/s)(7168KiB/6199msec); 0 zone resets clat (msec): min=128, max=1081, avg=610.51, stdev=397.09 lat (msec): min=129, max=1081, avg=610.63, stdev=397.11 clat percentiles (msec): | 1.00th=[ 129], 5.00th=[ 129], 10.00th=[ 129], 20.00th=[ 163], | 30.00th=[ 321], 40.00th=[ 321], 50.00th=[ 776], 60.00th=[ 818], | 70.00th=[ 818], 80.00th=[ 978], 90.00th=[ 1083], 95.00th=[ 1083], | 99.00th=[ 1083], 99.50th=[ 1083], 99.90th=[ 1083], 99.95th=[ 1083], | 99.99th=[ 1083] bw ( KiB/s): min= 1924, max= 4087, per=56.34%, avg=2487.50, stdev=1067.09, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (msec) : 250=33.33%, 500=16.67%, 750=16.67%, 1000=25.00%, 2000=8.33% cpu : usr=0.00%, sys=2.40%, ctx=64, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3154KiB/s (3229kB/s), 315KiB/s-1630KiB/s (323kB/s-1669kB/s), io=20.0MiB (20.0MB), run=4397-6494msec WRITE: bw=4415KiB/s (4521kB/s), 1156KiB/s-1577KiB/s (1184kB/s-1615kB/s), io=28.0MiB (29.4MB), run=4397-6494msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=183157: Mon Mar 2 12:24:06 2026 read: IOPS=1, BW=4234KiB/s (4336kB/s)(12.0MiB/2902msec) clat (msec): min=769, max=1001, avg=910.55, stdev=123.67 lat (msec): min=769, max=1001, avg=910.55, stdev=123.67 clat percentiles (msec): | 1.00th=[ 768], 5.00th=[ 768], 10.00th=[ 768], 20.00th=[ 768], | 30.00th=[ 768], 40.00th=[ 961], 50.00th=[ 961], 60.00th=[ 961], | 70.00th=[ 1003], 80.00th=[ 1003], 90.00th=[ 1003], 95.00th=[ 1003], | 99.00th=[ 1003], 99.50th=[ 1003], 99.90th=[ 1003], 99.95th=[ 1003], | 99.99th=[ 1003] bw ( KiB/s): min= 8143, max= 8159, per=100.00%, avg=8151.00, stdev=11.31, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=66.67%, 2000=33.33% cpu : usr=0.00%, sys=14.41%, ctx=343, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183158: Mon Mar 2 12:24:06 2026 read: IOPS=0, BW=1500KiB/s (1536kB/s)(4096KiB/2730msec) clat (nsec): min=956888k, max=956888k, avg=956887542.00, stdev= 0.00 lat (nsec): min=956889k, max=956889k, avg=956889195.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 961], 5.00th=[ 961], 10.00th=[ 961], 20.00th=[ 961], | 30.00th=[ 961], 40.00th=[ 961], 50.00th=[ 961], 60.00th=[ 961], | 70.00th=[ 961], 80.00th=[ 961], 90.00th=[ 961], 95.00th=[ 961], | 99.00th=[ 961], 99.50th=[ 961], 99.90th=[ 961], 99.95th=[ 961], | 99.99th=[ 961] bw ( KiB/s): min= 8159, max= 8159, per=100.00%, avg=8159.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=3001KiB/s (3073kB/s)(8192KiB/2730msec); 0 zone resets clat (msec): min=742, max=871, avg=807.23, stdev=91.43 lat (msec): min=742, max=872, avg=807.78, stdev=91.77 clat percentiles (msec): | 1.00th=[ 743], 5.00th=[ 743], 10.00th=[ 743], 20.00th=[ 743], | 30.00th=[ 743], 40.00th=[ 743], 50.00th=[ 743], 60.00th=[ 869], | 70.00th=[ 869], 80.00th=[ 869], 90.00th=[ 869], 95.00th=[ 869], | 99.00th=[ 869], 99.50th=[ 869], 99.90th=[ 869], 99.95th=[ 869], | 99.99th=[ 869] bw ( KiB/s): min= 8143, max= 8143, per=91.48%, avg=8143.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, 1000=66.67% cpu : usr=0.00%, sys=6.49%, ctx=84, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183159: Mon Mar 2 12:24:06 2026 write: IOPS=0, BW=3338KiB/s (3418kB/s)(12.0MiB/3681msec); 0 zone resets clat (msec): min=922, max=1477, avg=1186.27, stdev=278.49 lat (msec): min=922, max=1477, avg=1187.02, stdev=278.31 clat percentiles (msec): | 1.00th=[ 919], 5.00th=[ 919], 10.00th=[ 919], 20.00th=[ 919], | 30.00th=[ 919], 40.00th=[ 1167], 50.00th=[ 1167], 60.00th=[ 1167], | 70.00th=[ 1485], 80.00th=[ 1485], 90.00th=[ 1485], 95.00th=[ 1485], | 99.00th=[ 1485], 99.50th=[ 1485], 99.90th=[ 1485], 99.95th=[ 1485], | 99.99th=[ 1485] bw ( KiB/s): min= 7968, max= 8062, per=90.05%, avg=8015.00, stdev=66.47, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=33.33%, 2000=66.67% cpu : usr=0.00%, sys=6.44%, ctx=144, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183160: Mon Mar 2 12:24:06 2026 write: IOPS=1, BW=4565KiB/s (4674kB/s)(12.0MiB/2692msec); 0 zone resets clat (msec): min=263, max=1922, avg=862.83, stdev=920.77 lat (msec): min=264, max=1923, avg=863.93, stdev=920.43 clat percentiles (msec): | 1.00th=[ 264], 5.00th=[ 264], 10.00th=[ 264], 20.00th=[ 264], | 30.00th=[ 264], 40.00th=[ 401], 50.00th=[ 401], 60.00th=[ 401], | 70.00th=[ 1921], 80.00th=[ 1921], 90.00th=[ 1921], 95.00th=[ 1921], | 99.00th=[ 1921], 99.50th=[ 1921], 99.90th=[ 1921], 99.95th=[ 1921], | 99.99th=[ 1921] bw ( KiB/s): min= 6781, max= 8159, per=83.92%, avg=7470.00, stdev=974.39, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=66.67%, 2000=33.33% cpu : usr=0.00%, sys=4.38%, ctx=90, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5646KiB/s (5781kB/s), 1500KiB/s-4234KiB/s (1536kB/s-4336kB/s), io=16.0MiB (16.8MB), run=2730-2902msec WRITE: bw=8902KiB/s (9116kB/s), 3001KiB/s-4565KiB/s (3073kB/s-4674kB/s), io=32.0MiB (33.6MB), run=2692-3681msec rand-rw: (groupid=0, jobs=1): err= 0: pid=183161: Mon Mar 2 12:24:06 2026 read: IOPS=0, BW=3794KiB/s (3885kB/s)(12.0MiB/3239msec) clat (msec): min=411, max=1628, avg=1077.91, stdev=616.66 lat (msec): min=411, max=1628, avg=1077.91, stdev=616.66 clat percentiles (msec): | 1.00th=[ 414], 5.00th=[ 414], 10.00th=[ 414], 20.00th=[ 414], | 30.00th=[ 414], 40.00th=[ 1200], 50.00th=[ 1200], 60.00th=[ 1200], | 70.00th=[ 1636], 80.00th=[ 1636], 90.00th=[ 1636], 95.00th=[ 1636], | 99.00th=[ 1636], 99.50th=[ 1636], 99.90th=[ 1636], 99.95th=[ 1636], | 99.99th=[ 1636] bw ( KiB/s): min= 8143, max= 8159, per=100.00%, avg=8151.00, stdev=11.31, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.00%, sys=3.21%, ctx=38, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183162: Mon Mar 2 12:24:06 2026 read: IOPS=0, BW=1283KiB/s (1314kB/s)(4096KiB/3192msec) clat (nsec): min=1541.3M, max=1541.3M, avg=1541259820.00, stdev= 0.00 lat (nsec): min=1541.3M, max=1541.3M, avg=1541262918.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1536], 5.00th=[ 1536], 10.00th=[ 1536], 20.00th=[ 1536], | 30.00th=[ 1536], 40.00th=[ 1536], 50.00th=[ 1536], 60.00th=[ 1536], | 70.00th=[ 1536], 80.00th=[ 1536], 90.00th=[ 1536], 95.00th=[ 1536], | 99.00th=[ 1536], 99.50th=[ 1536], 99.90th=[ 1536], 99.95th=[ 1536], | 99.99th=[ 1536] bw ( KiB/s): min= 8143, max= 8143, per=100.00%, avg=8143.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2566KiB/s (2628kB/s)(8192KiB/3192msec); 0 zone resets clat (msec): min=625, max=1019, avg=822.35, stdev=278.41 lat (msec): min=626, max=1019, avg=822.94, stdev=278.23 clat percentiles (msec): | 1.00th=[ 625], 5.00th=[ 625], 10.00th=[ 625], 20.00th=[ 625], | 30.00th=[ 625], 40.00th=[ 625], 50.00th=[ 625], 60.00th=[ 1020], | 70.00th=[ 1020], 80.00th=[ 1020], 90.00th=[ 1020], 95.00th=[ 1020], | 99.00th=[ 1020], 99.50th=[ 1020], 99.90th=[ 1020], 99.95th=[ 1020], | 99.99th=[ 1020] bw ( KiB/s): min= 8110, max= 8110, per=79.01%, avg=8110.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, 2000=66.67% cpu : usr=0.00%, sys=3.79%, ctx=51, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183163: Mon Mar 2 12:24:06 2026 write: IOPS=0, BW=3995KiB/s (4091kB/s)(12.0MiB/3076msec); 0 zone resets clat (msec): min=336, max=1392, avg=1019.10, stdev=591.92 lat (msec): min=337, max=1394, avg=1020.46, stdev=592.04 clat percentiles (msec): | 1.00th=[ 338], 5.00th=[ 338], 10.00th=[ 338], 20.00th=[ 338], | 30.00th=[ 338], 40.00th=[ 1334], 50.00th=[ 1334], 60.00th=[ 1334], | 70.00th=[ 1401], 80.00th=[ 1401], 90.00th=[ 1401], 95.00th=[ 1401], | 99.00th=[ 1401], 99.50th=[ 1401], 99.90th=[ 1401], 99.95th=[ 1401], | 99.99th=[ 1401] bw ( KiB/s): min= 8192, max= 8192, per=79.81%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.33%, sys=3.61%, ctx=62, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183164: Mon Mar 2 12:24:06 2026 write: IOPS=1, BW=4381KiB/s (4486kB/s)(12.0MiB/2805msec); 0 zone resets clat (msec): min=242, max=2164, avg=909.76, stdev=1087.58 lat (msec): min=243, max=2167, avg=911.06, stdev=1089.05 clat percentiles (msec): | 1.00th=[ 243], 5.00th=[ 243], 10.00th=[ 243], 20.00th=[ 243], | 30.00th=[ 243], 40.00th=[ 321], 50.00th=[ 321], 60.00th=[ 321], | 70.00th=[ 2165], 80.00th=[ 2165], 90.00th=[ 2165], 95.00th=[ 2165], | 99.00th=[ 2165], 99.50th=[ 2165], 99.90th=[ 2165], 99.95th=[ 2165], | 99.99th=[ 2165] bw ( KiB/s): min=12860, max=12860, per=100.00%, avg=12860.00, stdev= 0.00, samples=1 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 500=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=4.46%, ctx=74, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5058KiB/s (5180kB/s), 1283KiB/s-3794KiB/s (1314kB/s-3885kB/s), io=16.0MiB (16.8MB), run=3192-3239msec WRITE: bw=10.0MiB/s (10.5MB/s), 2566KiB/s-4381KiB/s (2628kB/s-4486kB/s), io=32.0MiB (33.6MB), run=2805-3192msec