== sanity test 398b: DIO and buffer IO race ============== 22:42:46 (1789353766) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 3.05018 s, 16.5 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=153748: Sun Sep 13 22:43:54 2026 read: IOPS=26, BW=104KiB/s (107kB/s)(5992KiB/57373msec) clat (usec): min=34, max=740026, avg=19504.35, stdev=22386.43 lat (usec): min=35, max=740027, avg=19505.37, stdev=22386.47 clat percentiles (usec): | 1.00th=[ 72], 5.00th=[ 174], 10.00th=[ 7963], 20.00th=[ 10159], | 30.00th=[ 12125], 40.00th=[ 14091], 50.00th=[ 16712], 60.00th=[ 19530], | 70.00th=[ 22676], 80.00th=[ 26870], 90.00th=[ 33424], 95.00th=[ 40109], | 99.00th=[ 64750], 99.50th=[ 76022], 99.90th=[139461], 99.95th=[742392], | 99.99th=[742392] bw ( KiB/s): min= 13, max= 192, per=25.15%, avg=104.13, stdev=29.34, samples=114 iops : min= 3, max= 48, avg=25.61, stdev= 7.34, samples=114 write: IOPS=27, BW=110KiB/s (112kB/s)(6296KiB/57373msec); 0 zone resets clat (usec): min=939, max=113310, avg=17782.24, stdev=14844.75 lat (usec): min=939, max=113311, avg=17785.97, stdev=14845.35 clat percentiles (usec): | 1.00th=[ 1221], 5.00th=[ 2114], 10.00th=[ 2802], 20.00th=[ 4359], | 30.00th=[ 6915], 40.00th=[ 10945], 50.00th=[ 14615], 60.00th=[ 18482], | 70.00th=[ 22938], 80.00th=[ 28967], 90.00th=[ 36963], 95.00th=[ 43779], | 99.00th=[ 64750], 99.50th=[ 78119], 99.90th=[110625], 99.95th=[113771], | 99.99th=[113771] bw ( KiB/s): min= 39, max= 223, per=25.42%, avg=110.33, stdev=32.59, samples=113 iops : min= 9, max= 55, avg=27.16, stdev= 8.12, samples=113 lat (usec) : 50=0.10%, 100=0.98%, 250=1.69%, 500=0.07%, 750=0.07% lat (usec) : 1000=0.10% lat (msec) : 2=2.08%, 4=7.19%, 10=15.98%, 20=34.96%, 50=34.11% lat (msec) : 100=2.44%, 250=0.20%, 750=0.03% cpu : usr=0.11%, sys=23.43%, ctx=8446, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=153749: Sun Sep 13 22:43:54 2026 read: IOPS=26, BW=106KiB/s (108kB/s)(5940KiB/56285msec) clat (usec): min=19, max=114957, avg=18631.42, stdev=11617.37 lat (usec): min=19, max=114958, avg=18632.67, stdev=11617.50 clat percentiles (usec): | 1.00th=[ 61], 5.00th=[ 196], 10.00th=[ 8225], 20.00th=[ 10421], | 30.00th=[ 12256], 40.00th=[ 14222], 50.00th=[ 16450], 60.00th=[ 19268], | 70.00th=[ 22414], 80.00th=[ 26346], 90.00th=[ 31851], 95.00th=[ 37487], | 99.00th=[ 64226], 99.50th=[ 73925], 99.90th=[108528], 99.95th=[114820], | 99.99th=[114820] bw ( KiB/s): min= 6, max= 192, per=25.48%, avg=105.50, stdev=31.48, samples=111 iops : min= 1, max= 48, avg=25.95, stdev= 7.85, samples=111 write: IOPS=28, BW=113KiB/s (115kB/s)(6348KiB/56285msec); 0 zone resets clat (usec): min=826, max=685431, avg=17942.35, stdev=22623.22 lat (usec): min=827, max=685432, avg=17946.14, stdev=22623.14 clat percentiles (usec): | 1.00th=[ 1237], 5.00th=[ 2147], 10.00th=[ 2868], 20.00th=[ 4146], | 30.00th=[ 6456], 40.00th=[ 10683], 50.00th=[ 13960], 60.00th=[ 17957], | 70.00th=[ 22938], 80.00th=[ 27919], 90.00th=[ 36439], 95.00th=[ 45351], | 99.00th=[ 71828], 99.50th=[ 81265], 99.90th=[135267], 99.95th=[683672], | 99.99th=[683672] bw ( KiB/s): min= 6, max= 175, per=25.89%, avg=112.36, stdev=32.30, samples=111 iops : min= 1, max= 43, avg=27.68, stdev= 8.05, samples=111 lat (usec) : 20=0.03%, 50=0.29%, 100=0.81%, 250=1.43%, 500=0.23% lat (usec) : 750=0.07%, 1000=0.10% lat (msec) : 2=2.25%, 4=7.45%, 10=15.69%, 20=35.06%, 50=33.92% lat (msec) : 100=2.47%, 250=0.16%, 750=0.03% cpu : usr=0.13%, sys=23.68%, ctx=8318, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=153750: Sun Sep 13 22:43:54 2026 read: IOPS=26, BW=104KiB/s (107kB/s)(6028KiB/57896msec) clat (usec): min=36, max=92951, avg=19013.27, stdev=11083.69 lat (usec): min=37, max=92952, avg=19014.49, stdev=11083.63 clat percentiles (usec): | 1.00th=[ 76], 5.00th=[ 212], 10.00th=[ 8356], 20.00th=[10814], | 30.00th=[12780], 40.00th=[14746], 50.00th=[17171], 60.00th=[19792], | 70.00th=[22676], 80.00th=[26608], 90.00th=[32900], 95.00th=[38536], | 99.00th=[56361], 99.50th=[67634], 99.90th=[84411], 99.95th=[92799], | 99.99th=[92799] bw ( KiB/s): min= 31, max= 248, per=25.31%, avg=104.79, stdev=32.25, samples=114 iops : min= 7, max= 62, avg=25.78, stdev= 8.07, samples=114 write: IOPS=27, BW=108KiB/s (111kB/s)(6260KiB/57896msec); 0 zone resets clat (usec): min=858, max=715099, avg=18594.46, stdev=24052.94 lat (usec): min=859, max=715100, avg=18595.78, stdev=24052.97 clat percentiles (usec): | 1.00th=[ 1205], 5.00th=[ 2147], 10.00th=[ 2900], 20.00th=[ 4228], | 30.00th=[ 6456], 40.00th=[ 11076], 50.00th=[ 14484], 60.00th=[ 18482], | 70.00th=[ 23200], 80.00th=[ 28705], 90.00th=[ 38536], 95.00th=[ 46924], | 99.00th=[ 74974], 99.50th=[ 99091], 99.90th=[196084], 99.95th=[717226], | 99.99th=[717226] bw ( KiB/s): min= 31, max= 280, per=25.08%, avg=108.86, stdev=35.36, samples=114 iops : min= 7, max= 70, avg=26.80, stdev= 8.87, samples=114 lat (usec) : 50=0.20%, 100=0.81%, 250=1.63%, 500=0.10%, 1000=0.10% lat (msec) : 2=2.21%, 4=7.32%, 10=14.49%, 20=35.19%, 50=35.32% lat (msec) : 100=2.41%, 250=0.20%, 750=0.03% cpu : usr=0.13%, sys=23.37%, ctx=8417, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=153751: Sun Sep 13 22:43:54 2026 read: IOPS=26, BW=107KiB/s (110kB/s)(6052KiB/56549msec) clat (usec): min=38, max=682660, avg=19320.27, stdev=20953.39 lat (usec): min=39, max=682660, avg=19321.37, stdev=20953.40 clat percentiles (usec): | 1.00th=[ 66], 5.00th=[ 145], 10.00th=[ 7832], 20.00th=[ 10683], | 30.00th=[ 12387], 40.00th=[ 14353], 50.00th=[ 16712], 60.00th=[ 19530], | 70.00th=[ 22152], 80.00th=[ 26346], 90.00th=[ 32900], 95.00th=[ 39060], | 99.00th=[ 60031], 99.50th=[ 81265], 99.90th=[135267], 99.95th=[683672], | 99.99th=[683672] bw ( KiB/s): min= 56, max= 166, per=26.00%, avg=107.65, stdev=25.84, samples=111 iops : min= 14, max= 41, avg=26.49, stdev= 6.46, samples=111 write: IOPS=27, BW=110KiB/s (113kB/s)(6236KiB/56549msec); 0 zone resets clat (usec): min=831, max=139908, avg=17433.67, stdev=15245.57 lat (usec): min=832, max=139909, avg=17435.15, stdev=15245.55 clat percentiles (usec): | 1.00th=[ 1319], 5.00th=[ 2278], 10.00th=[ 2835], 20.00th=[ 4080], | 30.00th=[ 6194], 40.00th=[ 10552], 50.00th=[ 14484], 60.00th=[ 18220], | 70.00th=[ 22676], 80.00th=[ 27919], 90.00th=[ 35914], 95.00th=[ 44827], | 99.00th=[ 66847], 99.50th=[ 92799], 99.90th=[128451], 99.95th=[139461], | 99.99th=[139461] bw ( KiB/s): min= 26, max= 200, per=25.33%, avg=109.91, stdev=32.14, samples=112 iops : min= 6, max= 50, avg=27.05, stdev= 8.03, samples=112 lat (usec) : 50=0.20%, 100=0.85%, 250=2.12%, 500=0.10%, 1000=0.07% lat (msec) : 2=1.76%, 4=8.01%, 10=14.88%, 20=35.22%, 50=34.24% lat (msec) : 100=2.31%, 250=0.23%, 750=0.03% cpu : usr=0.11%, sys=23.43%, ctx=8415, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=415KiB/s (425kB/s), 104KiB/s-107KiB/s (107kB/s-110kB/s), io=23.4MiB (24.6MB), run=56285-57896msec WRITE: bw=434KiB/s (445kB/s), 108KiB/s-113KiB/s (111kB/s-115kB/s), io=24.6MiB (25.7MB), run=56285-57896msec fio: pid=153744, err=5/file:backend.c:481, func=full resid, error=Input/output error rand-rw: (groupid=0, jobs=1): err= 0: pid=153743: Sun Sep 13 22:44:30 2026 read: IOPS=15, BW=63.2KiB/s (64.7kB/s)(5992KiB/94812msec) clat (msec): min=3, max=748, avg=17.26, stdev=23.82 lat (msec): min=3, max=748, avg=17.26, stdev=23.82 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 6], 10.00th=[ 6], 20.00th=[ 8], | 30.00th=[ 9], 40.00th=[ 11], 50.00th=[ 13], 60.00th=[ 15], | 70.00th=[ 18], 80.00th=[ 24], 90.00th=[ 34], 95.00th=[ 43], | 99.00th=[ 73], 99.50th=[ 106], 99.90th=[ 174], 99.95th=[ 751], | 99.99th=[ 751] bw ( KiB/s): min= 7, max= 184, per=25.23%, avg=63.08, stdev=35.73, samples=187 iops : min= 1, max= 46, avg=15.43, stdev= 9.05, samples=187 write: IOPS=16, BW=66.4KiB/s (67.0kB/s)(6296KiB/94812msec); 0 zone resets clat (msec): min=16, max=179, avg=43.66, stdev=21.80 lat (msec): min=16, max=179, avg=43.66, stdev=21.80 clat percentiles (msec): | 1.00th=[ 20], 5.00th=[ 22], 10.00th=[ 24], 20.00th=[ 28], | 30.00th=[ 31], 40.00th=[ 33], 50.00th=[ 37], 60.00th=[ 42], | 70.00th=[ 48], 80.00th=[ 60], 90.00th=[ 74], 95.00th=[ 86], | 99.00th=[ 120], 99.50th=[ 138], 99.90th=[ 171], 99.95th=[ 180], | 99.99th=[ 180] bw ( KiB/s): min= 8, max= 152, per=25.41%, avg=66.33, stdev=29.08, samples=187 iops : min= 2, max= 38, avg=16.25, stdev= 7.40, samples=187 lat (msec) : 4=0.10%, 10=17.29%, 20=20.74%, 50=46.48%, 100=13.90% lat (msec) : 250=1.46%, 750=0.03% cpu : usr=0.11%, sys=7.91%, ctx=6225, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 5 (file:backend.c:481, func=full resid, error=Input/output error): pid=153744: Sun Sep 13 22:44:30 2026 read: IOPS=15, BW=61.0KiB/s (63.5kB/s)(5688KiB/91761msec) clat (msec): min=4, max=696, avg=17.61, stdev=23.27 lat (msec): min=4, max=696, avg=17.61, stdev=23.27 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 6], 10.00th=[ 7], 20.00th=[ 8], | 30.00th=[ 9], 40.00th=[ 12], 50.00th=[ 13], 60.00th=[ 15], | 70.00th=[ 18], 80.00th=[ 24], 90.00th=[ 34], 95.00th=[ 45], | 99.00th=[ 71], 99.50th=[ 107], 99.90th=[ 150], 99.95th=[ 701], | 99.99th=[ 701] bw ( KiB/s): min= 7, max= 168, per=24.85%, avg=62.12, stdev=34.23, samples=180 iops : min= 1, max= 42, avg=15.18, stdev= 8.65, samples=180 write: IOPS=16, BW=65.3KiB/s (66.9kB/s)(5992KiB/91761msec); 0 zone resets clat (msec): min=17, max=262, avg=44.39, stdev=22.28 lat (msec): min=17, max=262, avg=44.39, stdev=22.28 clat percentiles (msec): | 1.00th=[ 20], 5.00th=[ 23], 10.00th=[ 25], 20.00th=[ 28], | 30.00th=[ 32], 40.00th=[ 34], 50.00th=[ 38], 60.00th=[ 43], | 70.00th=[ 50], 80.00th=[ 59], 90.00th=[ 73], 95.00th=[ 85], | 99.00th=[ 117], 99.50th=[ 130], 99.90th=[ 245], 99.95th=[ 264], | 99.99th=[ 264] bw ( KiB/s): min= 23, max= 128, per=25.04%, avg=65.35, stdev=27.39, samples=181 iops : min= 5, max= 32, avg=15.99, stdev= 7.00, samples=181 lat (msec) : 10=16.98%, 20=20.23%, 50=45.87%, 100=15.41%, 250=1.40% lat (msec) : 500=0.03%, 750=0.03% cpu : usr=0.11%, sys=7.91%, ctx=5783, majf=0, minf=19 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1423,1498,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=153745: Sun Sep 13 22:44:30 2026 read: IOPS=15, BW=63.6KiB/s (65.2kB/s)(6028KiB/94733msec) clat (msec): min=3, max=145, avg=17.22, stdev=15.06 lat (msec): min=3, max=145, avg=17.22, stdev=15.06 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 6], 10.00th=[ 7], 20.00th=[ 8], | 30.00th=[ 10], 40.00th=[ 11], 50.00th=[ 13], 60.00th=[ 15], | 70.00th=[ 17], 80.00th=[ 23], 90.00th=[ 36], 95.00th=[ 47], | 99.00th=[ 74], 99.50th=[ 103], 99.90th=[ 142], 99.95th=[ 146], | 99.99th=[ 146] bw ( KiB/s): min= 7, max= 160, per=25.47%, avg=63.67, stdev=35.33, samples=187 iops : min= 1, max= 40, avg=15.58, stdev= 8.97, samples=187 write: IOPS=16, BW=66.1KiB/s (67.7kB/s)(6260KiB/94733msec); 0 zone resets clat (msec): min=16, max=712, avg=43.80, stdev=28.21 lat (msec): min=16, max=712, avg=43.81, stdev=28.21 clat percentiles (msec): | 1.00th=[ 20], 5.00th=[ 22], 10.00th=[ 24], 20.00th=[ 27], | 30.00th=[ 30], 40.00th=[ 33], 50.00th=[ 36], 60.00th=[ 42], | 70.00th=[ 49], 80.00th=[ 58], 90.00th=[ 74], 95.00th=[ 87], | 99.00th=[ 126], 99.50th=[ 148], 99.90th=[ 245], 99.95th=[ 709], | 99.99th=[ 709] bw ( KiB/s): min= 23, max= 136, per=25.32%, avg=66.07, stdev=29.64, samples=187 iops : min= 5, max= 34, avg=16.18, stdev= 7.55, samples=187 lat (msec) : 4=0.07%, 10=16.83%, 20=21.52%, 50=45.44%, 100=14.78% lat (msec) : 250=1.33%, 750=0.03% cpu : usr=0.11%, sys=7.92%, ctx=6183, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=153746: Sun Sep 13 22:44:30 2026 read: IOPS=16, BW=64.1KiB/s (65.7kB/s)(6052KiB/94350msec) clat (msec): min=3, max=206, avg=17.22, stdev=15.13 lat (msec): min=3, max=206, avg=17.22, stdev=15.13 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 6], 10.00th=[ 6], 20.00th=[ 8], | 30.00th=[ 10], 40.00th=[ 11], 50.00th=[ 13], 60.00th=[ 16], | 70.00th=[ 18], 80.00th=[ 24], 90.00th=[ 34], 95.00th=[ 45], | 99.00th=[ 71], 99.50th=[ 93], 99.90th=[ 161], 99.95th=[ 207], | 99.99th=[ 207] bw ( KiB/s): min= 7, max= 176, per=25.57%, avg=63.94, stdev=34.71, samples=186 iops : min= 1, max= 44, avg=15.65, stdev= 8.81, samples=186 write: IOPS=16, BW=66.1KiB/s (67.7kB/s)(6236KiB/94350msec); 0 zone resets clat (msec): min=15, max=710, avg=43.66, stdev=26.90 lat (msec): min=15, max=710, avg=43.66, stdev=26.90 clat percentiles (msec): | 1.00th=[ 20], 5.00th=[ 22], 10.00th=[ 24], 20.00th=[ 28], | 30.00th=[ 31], 40.00th=[ 34], 50.00th=[ 37], 60.00th=[ 42], | 70.00th=[ 48], 80.00th=[ 58], 90.00th=[ 72], 95.00th=[ 84], | 99.00th=[ 108], 99.50th=[ 123], 99.90th=[ 259], 99.95th=[ 709], | 99.99th=[ 709] bw ( KiB/s): min= 23, max= 136, per=25.31%, avg=66.05, stdev=28.39, samples=186 iops : min= 5, max= 34, avg=16.18, stdev= 7.24, samples=186 lat (msec) : 4=0.10%, 10=16.67%, 20=21.42%, 50=46.03%, 100=14.78% lat (msec) : 250=0.94%, 500=0.03%, 750=0.03% cpu : usr=0.10%, sys=8.03%, ctx=6215, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=251KiB/s (257kB/s), 61.0KiB/s-64.1KiB/s (63.5kB/s-65.7kB/s), io=23.2MiB (24.3MB), run=91761-94812msec WRITE: bw=261KiB/s (268kB/s), 65.3KiB/s-66.4KiB/s (66.9kB/s-67.0kB/s), io=24.2MiB (25.4MB), run=91761-94812msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=153780: Sun Sep 13 22:44:49 2026 read: IOPS=27, BW=443KiB/s (454kB/s)(5920KiB/13349msec) clat (usec): min=36, max=135998, avg=18597.64, stdev=13382.67 lat (usec): min=37, max=135999, avg=18598.48, stdev=13382.69 clat percentiles (usec): | 1.00th=[ 56], 5.00th=[ 118], 10.00th=[ 237], 20.00th=[ 10683], | 30.00th=[ 12911], 40.00th=[ 14877], 50.00th=[ 17171], 60.00th=[ 19792], | 70.00th=[ 22676], 80.00th=[ 25560], 90.00th=[ 30278], 95.00th=[ 35390], | 99.00th=[ 65799], 99.50th=[116917], 99.90th=[135267], 99.95th=[135267], | 99.99th=[135267] bw ( KiB/s): min= 287, max= 669, per=24.69%, avg=435.00, stdev=97.77, samples=26 iops : min= 17, max= 41, avg=26.69, stdev= 6.15, samples=26 write: IOPS=29, BW=477KiB/s (488kB/s)(6368KiB/13349msec); 0 zone resets clat (usec): min=1067, max=96273, avg=16153.36, stdev=13174.55 lat (usec): min=1068, max=96276, avg=16154.86, stdev=13174.60 clat percentiles (usec): | 1.00th=[ 1549], 5.00th=[ 3359], 10.00th=[ 4293], 20.00th=[ 5342], | 30.00th=[ 6915], 40.00th=[ 9503], 50.00th=[12780], 60.00th=[16450], | 70.00th=[20055], 80.00th=[24773], 90.00th=[32375], 95.00th=[40633], | 99.00th=[58983], 99.50th=[93848], 99.90th=[95945], 99.95th=[95945], | 99.99th=[95945] bw ( KiB/s): min= 224, max= 701, per=25.42%, avg=471.23, stdev=118.22, samples=26 iops : min= 14, max= 43, avg=28.96, stdev= 7.32, samples=26 lat (usec) : 50=0.26%, 100=0.91%, 250=3.65% lat (msec) : 2=0.78%, 4=2.73%, 10=21.48%, 20=35.42%, 50=32.68% lat (msec) : 100=1.82%, 250=0.26% cpu : usr=0.13%, sys=28.07%, ctx=2388, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=153782: Sun Sep 13 22:44:49 2026 read: IOPS=27, BW=436KiB/s (446kB/s)(5744KiB/13185msec) clat (usec): min=39, max=118311, avg=18788.49, stdev=11769.40 lat (usec): min=41, max=118312, avg=18789.57, stdev=11769.33 clat percentiles (usec): | 1.00th=[ 61], 5.00th=[ 118], 10.00th=[ 8160], 20.00th=[ 11469], | 30.00th=[ 13304], 40.00th=[ 15139], 50.00th=[ 17171], 60.00th=[ 19792], | 70.00th=[ 22414], 80.00th=[ 25822], 90.00th=[ 30802], 95.00th=[ 36963], | 99.00th=[ 57410], 99.50th=[ 71828], 99.90th=[117965], 99.95th=[117965], | 99.99th=[117965] bw ( KiB/s): min= 191, max= 603, per=24.69%, avg=435.08, stdev=89.83, samples=26 iops : min= 11, max= 37, avg=26.69, stdev= 5.79, samples=26 write: IOPS=31, BW=496KiB/s (508kB/s)(6544KiB/13185msec); 0 zone resets clat (usec): min=1185, max=119571, avg=15574.23, stdev=13485.75 lat (usec): min=1186, max=119573, avg=15575.77, stdev=13485.78 clat percentiles (usec): | 1.00th=[ 1647], 5.00th=[ 3261], 10.00th=[ 4146], 20.00th=[ 4948], | 30.00th=[ 6587], 40.00th=[ 9503], 50.00th=[ 12256], 60.00th=[ 15270], | 70.00th=[ 19530], 80.00th=[ 23462], 90.00th=[ 31851], 95.00th=[ 39584], | 99.00th=[ 61080], 99.50th=[ 74974], 99.90th=[120062], 99.95th=[120062], | 99.99th=[120062] bw ( KiB/s): min= 288, max= 832, per=26.68%, avg=494.62, stdev=144.42, samples=26 iops : min= 18, max= 52, avg=30.42, stdev= 9.07, samples=26 lat (usec) : 50=0.13%, 100=1.30%, 250=1.95% lat (msec) : 2=1.43%, 4=3.65%, 10=21.74%, 20=36.20%, 50=31.64% lat (msec) : 100=1.56%, 250=0.39% cpu : usr=0.17%, sys=28.41%, ctx=2362, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=153783: Sun Sep 13 22:44:49 2026 read: IOPS=28, BW=460KiB/s (471kB/s)(6256KiB/13592msec) clat (usec): min=49, max=138418, avg=19162.91, stdev=13106.33 lat (usec): min=50, max=138419, avg=19163.87, stdev=13106.35 clat percentiles (usec): | 1.00th=[ 63], 5.00th=[ 121], 10.00th=[ 7963], 20.00th=[ 11076], | 30.00th=[ 13435], 40.00th=[ 15270], 50.00th=[ 16909], 60.00th=[ 20055], | 70.00th=[ 23200], 80.00th=[ 25560], 90.00th=[ 31589], 95.00th=[ 36439], | 99.00th=[ 60031], 99.50th=[105382], 99.90th=[139461], 99.95th=[139461], | 99.99th=[139461] bw ( KiB/s): min= 223, max= 672, per=25.96%, avg=457.42, stdev=119.66, samples=26 iops : min= 13, max= 42, avg=28.12, stdev= 7.60, samples=26 write: IOPS=27, BW=444KiB/s (454kB/s)(6032KiB/13592msec); 0 zone resets clat (usec): min=1196, max=91246, avg=15936.49, stdev=12452.64 lat (usec): min=1197, max=91271, avg=15938.32, stdev=12453.14 clat percentiles (usec): | 1.00th=[ 1467], 5.00th=[ 2868], 10.00th=[ 4178], 20.00th=[ 5145], | 30.00th=[ 6783], 40.00th=[ 9241], 50.00th=[12780], 60.00th=[16712], | 70.00th=[20055], 80.00th=[25035], 90.00th=[31851], 95.00th=[39584], | 99.00th=[54789], 99.50th=[57410], 99.90th=[91751], 99.95th=[91751], | 99.99th=[91751] bw ( KiB/s): min= 222, max= 608, per=23.12%, avg=428.58, stdev=108.39, samples=26 iops : min= 13, max= 38, avg=26.31, stdev= 6.88, samples=26 lat (usec) : 50=0.13%, 100=0.91%, 250=3.26%, 500=0.13% lat (msec) : 2=1.43%, 4=2.73%, 10=19.66%, 20=35.94%, 50=34.11% lat (msec) : 100=1.43%, 250=0.26% cpu : usr=0.12%, sys=27.19%, ctx=2352, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=153784: Sun Sep 13 22:44:49 2026 read: IOPS=28, BW=462KiB/s (473kB/s)(6032KiB/13046msec) clat (usec): min=37, max=128620, avg=17929.81, stdev=12982.38 lat (usec): min=38, max=128621, avg=17931.13, stdev=12982.61 clat percentiles (usec): | 1.00th=[ 65], 5.00th=[ 103], 10.00th=[ 133], 20.00th=[ 10159], | 30.00th=[ 12387], 40.00th=[ 15008], 50.00th=[ 16909], 60.00th=[ 19006], | 70.00th=[ 21890], 80.00th=[ 24773], 90.00th=[ 28705], 95.00th=[ 35914], | 99.00th=[ 64226], 99.50th=[111674], 99.90th=[128451], 99.95th=[128451], | 99.99th=[128451] bw ( KiB/s): min= 256, max= 672, per=25.79%, avg=454.44, stdev=90.47, samples=25 iops : min= 16, max= 42, avg=27.92, stdev= 5.71, samples=25 write: IOPS=29, BW=480KiB/s (491kB/s)(6256KiB/13046msec); 0 zone resets clat (usec): min=1434, max=82344, avg=15875.88, stdev=13127.75 lat (usec): min=1435, max=82346, avg=15877.36, stdev=13127.80 clat percentiles (usec): | 1.00th=[ 1942], 5.00th=[ 3359], 10.00th=[ 3884], 20.00th=[ 4948], | 30.00th=[ 6063], 40.00th=[ 9241], 50.00th=[12518], 60.00th=[15664], | 70.00th=[19792], 80.00th=[23987], 90.00th=[34341], 95.00th=[42730], | 99.00th=[60556], 99.50th=[80217], 99.90th=[82314], 99.95th=[82314], | 99.99th=[82314] bw ( KiB/s): min= 288, max= 640, per=25.64%, avg=475.44, stdev=106.96, samples=25 iops : min= 18, max= 40, avg=29.24, stdev= 6.64, samples=25 lat (usec) : 50=0.13%, 100=1.82%, 250=3.91%, 500=0.13% lat (msec) : 2=0.65%, 4=5.21%, 10=19.27%, 20=35.81%, 50=31.12% lat (msec) : 100=1.69%, 250=0.26% cpu : usr=0.11%, sys=27.91%, ctx=2296, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1762KiB/s (1805kB/s), 436KiB/s-462KiB/s (446kB/s-473kB/s), io=23.4MiB (24.5MB), run=13046-13592msec WRITE: bw=1854KiB/s (1899kB/s), 444KiB/s-496KiB/s (454kB/s-508kB/s), io=24.6MiB (25.8MB), run=13046-13592msec rand-rw: (groupid=0, jobs=1): err= 0: pid=153785: Sun Sep 13 22:44:58 2026 read: IOPS=16, BW=263KiB/s (269kB/s)(5920KiB/22505msec) clat (msec): min=3, max=147, avg=17.33, stdev=15.77 lat (msec): min=3, max=147, avg=17.33, stdev=15.77 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 6], 10.00th=[ 6], 20.00th=[ 8], | 30.00th=[ 10], 40.00th=[ 12], 50.00th=[ 13], 60.00th=[ 15], | 70.00th=[ 17], 80.00th=[ 24], 90.00th=[ 34], 95.00th=[ 44], | 99.00th=[ 87], 99.50th=[ 96], 99.90th=[ 148], 99.95th=[ 148], | 99.99th=[ 148] bw ( KiB/s): min= 32, max= 512, per=24.13%, avg=256.70, stdev=116.22, samples=44 iops : min= 2, max= 32, avg=15.61, stdev= 7.38, samples=44 write: IOPS=17, BW=283KiB/s (290kB/s)(6368KiB/22505msec); 0 zone resets clat (msec): min=14, max=162, avg=40.13, stdev=20.30 lat (msec): min=14, max=162, avg=40.13, stdev=20.30 clat percentiles (msec): | 1.00th=[ 18], 5.00th=[ 22], 10.00th=[ 24], 20.00th=[ 26], | 30.00th=[ 29], 40.00th=[ 32], 50.00th=[ 34], 60.00th=[ 38], | 70.00th=[ 44], 80.00th=[ 51], 90.00th=[ 67], 95.00th=[ 79], | 99.00th=[ 134], 99.50th=[ 148], 99.90th=[ 163], 99.95th=[ 163], | 99.99th=[ 163] bw ( KiB/s): min= 127, max= 512, per=24.97%, avg=279.36, stdev=116.62, samples=44 iops : min= 7, max= 32, avg=17.02, stdev= 7.40, samples=44 lat (msec) : 4=0.26%, 10=15.23%, 20=22.27%, 50=49.61%, 100=11.72% lat (msec) : 250=0.91% cpu : usr=0.08%, sys=9.32%, ctx=1696, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=153786: Sun Sep 13 22:44:58 2026 read: IOPS=16, BW=257KiB/s (263kB/s)(5744KiB/22354msec) clat (msec): min=4, max=113, avg=16.99, stdev=15.61 lat (msec): min=4, max=113, avg=16.99, stdev=15.61 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 6], 10.00th=[ 7], 20.00th=[ 8], | 30.00th=[ 9], 40.00th=[ 11], 50.00th=[ 12], 60.00th=[ 14], | 70.00th=[ 17], 80.00th=[ 24], 90.00th=[ 36], 95.00th=[ 52], | 99.00th=[ 83], 99.50th=[ 111], 99.90th=[ 113], 99.95th=[ 113], | 99.99th=[ 113] bw ( KiB/s): min= 32, max= 574, per=24.11%, avg=256.52, stdev=134.34, samples=44 iops : min= 2, max= 35, avg=15.59, stdev= 8.49, samples=44 write: IOPS=18, BW=293KiB/s (300kB/s)(6544KiB/22354msec); 0 zone resets clat (msec): min=16, max=135, avg=39.48, stdev=18.48 lat (msec): min=16, max=135, avg=39.48, stdev=18.48 clat percentiles (msec): | 1.00th=[ 19], 5.00th=[ 21], 10.00th=[ 23], 20.00th=[ 25], | 30.00th=[ 29], 40.00th=[ 31], 50.00th=[ 34], 60.00th=[ 39], | 70.00th=[ 44], 80.00th=[ 52], 90.00th=[ 63], 95.00th=[ 77], | 99.00th=[ 110], 99.50th=[ 126], 99.90th=[ 136], 99.95th=[ 136], | 99.99th=[ 136] bw ( KiB/s): min= 127, max= 541, per=26.01%, avg=291.02, stdev=110.77, samples=44 iops : min= 7, max= 33, avg=17.77, stdev= 7.04, samples=44 lat (msec) : 10=18.10%, 20=19.92%, 50=47.79%, 100=13.28%, 250=0.91% cpu : usr=0.09%, sys=9.35%, ctx=1624, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=153787: Sun Sep 13 22:44:58 2026 read: IOPS=17, BW=281KiB/s (288kB/s)(6256KiB/22229msec) clat (usec): min=3593, max=90169, avg=16660.16, stdev=13222.32 lat (usec): min=3594, max=90169, avg=16661.29, stdev=13222.25 clat percentiles (usec): | 1.00th=[ 4817], 5.00th=[ 5538], 10.00th=[ 6652], 20.00th=[ 7963], | 30.00th=[ 9372], 40.00th=[11076], 50.00th=[12387], 60.00th=[13960], | 70.00th=[16450], 80.00th=[22414], 90.00th=[32113], 95.00th=[45351], | 99.00th=[70779], 99.50th=[81265], 99.90th=[89654], 99.95th=[89654], | 99.99th=[89654] bw ( KiB/s): min= 95, max= 672, per=26.58%, avg=282.84, stdev=143.31, samples=44 iops : min= 5, max= 42, avg=17.25, stdev= 9.04, samples=44 write: IOPS=16, BW=271KiB/s (278kB/s)(6032KiB/22229msec); 0 zone resets clat (msec): min=16, max=163, avg=41.60, stdev=19.54 lat (msec): min=16, max=163, avg=41.60, stdev=19.54 clat percentiles (msec): | 1.00th=[ 19], 5.00th=[ 22], 10.00th=[ 25], 20.00th=[ 27], | 30.00th=[ 30], 40.00th=[ 34], 50.00th=[ 37], 60.00th=[ 41], | 70.00th=[ 46], 80.00th=[ 52], 90.00th=[ 66], 95.00th=[ 78], | 99.00th=[ 129], 99.50th=[ 142], 99.90th=[ 165], 99.95th=[ 165], | 99.99th=[ 165] bw ( KiB/s): min= 127, max= 448, per=24.16%, avg=270.36, stdev=100.86, samples=44 iops : min= 7, max= 28, avg=16.48, stdev= 6.43, samples=44 lat (msec) : 4=0.13%, 10=16.67%, 20=23.83%, 50=46.09%, 100=12.24% lat (msec) : 250=1.04% cpu : usr=0.09%, sys=9.66%, ctx=1735, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=153788: Sun Sep 13 22:44:58 2026 read: IOPS=16, BW=270KiB/s (277kB/s)(6032KiB/22302msec) clat (msec): min=4, max=118, avg=17.39, stdev=14.91 lat (msec): min=4, max=118, avg=17.40, stdev=14.91 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 6], 10.00th=[ 7], 20.00th=[ 8], | 30.00th=[ 9], 40.00th=[ 11], 50.00th=[ 13], 60.00th=[ 15], | 70.00th=[ 18], 80.00th=[ 23], 90.00th=[ 38], 95.00th=[ 50], | 99.00th=[ 74], 99.50th=[ 90], 99.90th=[ 118], 99.95th=[ 118], | 99.99th=[ 118] bw ( KiB/s): min= 95, max= 608, per=25.25%, avg=268.61, stdev=130.97, samples=44 iops : min= 5, max= 38, avg=16.36, stdev= 8.33, samples=44 write: IOPS=17, BW=281KiB/s (287kB/s)(6256KiB/22302msec); 0 zone resets clat (msec): min=16, max=133, avg=39.88, stdev=18.64 lat (msec): min=16, max=133, avg=39.88, stdev=18.64 clat percentiles (msec): | 1.00th=[ 18], 5.00th=[ 22], 10.00th=[ 24], 20.00th=[ 27], | 30.00th=[ 30], 40.00th=[ 32], 50.00th=[ 35], 60.00th=[ 39], | 70.00th=[ 43], 80.00th=[ 50], 90.00th=[ 62], 95.00th=[ 81], | 99.00th=[ 117], 99.50th=[ 133], 99.90th=[ 134], 99.95th=[ 134], | 99.99th=[ 134] bw ( KiB/s): min= 127, max= 480, per=25.02%, avg=279.95, stdev=111.95, samples=44 iops : min= 7, max= 30, avg=17.07, stdev= 7.10, samples=44 lat (msec) : 10=17.97%, 20=21.35%, 50=48.31%, 100=11.20%, 250=1.17% cpu : usr=0.12%, sys=9.17%, ctx=1650, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1064KiB/s (1090kB/s), 257KiB/s-281KiB/s (263kB/s-288kB/s), io=23.4MiB (24.5MB), run=22229-22505msec WRITE: bw=1120KiB/s (1147kB/s), 271KiB/s-293KiB/s (278kB/s-300kB/s), io=24.6MiB (25.8MB), run=22229-22505msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=153796: Sun Sep 13 22:45:07 2026 read: IOPS=2, BW=3063KiB/s (3137kB/s)(7168KiB/2340msec) clat (msec): min=42, max=409, avg=168.54, stdev=148.80 lat (msec): min=42, max=409, avg=168.54, stdev=148.80 clat percentiles (msec): | 1.00th=[ 43], 5.00th=[ 43], 10.00th=[ 43], 20.00th=[ 52], | 30.00th=[ 52], 40.00th=[ 52], 50.00th=[ 97], 60.00th=[ 201], | 70.00th=[ 201], 80.00th=[ 330], 90.00th=[ 409], 95.00th=[ 409], | 99.00th=[ 409], 99.50th=[ 409], 99.90th=[ 409], 99.95th=[ 409], | 99.99th=[ 409] bw ( KiB/s): min= 1903, max= 5154, per=47.31%, avg=2787.00, stdev=1579.43, samples=4 iops : min= 1, max= 5, avg= 2.25, stdev= 1.89, samples=4 write: IOPS=2, BW=2188KiB/s (2241kB/s)(5120KiB/2340msec); 0 zone resets clat (msec): min=103, max=402, avg=229.67, stdev=123.12 lat (msec): min=103, max=402, avg=229.74, stdev=123.13 clat percentiles (msec): | 1.00th=[ 104], 5.00th=[ 104], 10.00th=[ 104], 20.00th=[ 104], | 30.00th=[ 129], 40.00th=[ 129], 50.00th=[ 218], 60.00th=[ 218], | 70.00th=[ 296], 80.00th=[ 296], 90.00th=[ 401], 95.00th=[ 401], | 99.00th=[ 401], 99.50th=[ 401], 99.90th=[ 401], 99.95th=[ 401], | 99.99th=[ 401] bw ( KiB/s): min= 1718, max= 3806, per=30.60%, avg=2524.00, stdev=1122.44, samples=3 iops : min= 1, max= 3, avg= 2.00, stdev= 1.00, samples=3 lat (msec) : 50=8.33%, 100=25.00%, 250=33.33%, 500=33.33% cpu : usr=0.09%, sys=13.55%, ctx=69, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=153797: Sun Sep 13 22:45:07 2026 read: IOPS=0, BW=673KiB/s (689kB/s)(2048KiB/3042msec) clat (usec): min=41251, max=64253, avg=52752.51, stdev=16264.91 lat (usec): min=41254, max=64255, avg=52754.69, stdev=16264.32 clat percentiles (usec): | 1.00th=[41157], 5.00th=[41157], 10.00th=[41157], 20.00th=[41157], | 30.00th=[41157], 40.00th=[41157], 50.00th=[41157], 60.00th=[64226], | 70.00th=[64226], 80.00th=[64226], 90.00th=[64226], 95.00th=[64226], | 99.00th=[64226], 99.50th=[64226], 99.90th=[64226], 99.95th=[64226], | 99.99th=[64226] bw ( KiB/s): min= 1718, max= 2048, per=31.96%, avg=1883.00, stdev=233.35, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 write: IOPS=3, BW=3366KiB/s (3447kB/s)(10.0MiB/3042msec); 0 zone resets clat (msec): min=96, max=478, avg=289.94, stdev=126.95 lat (msec): min=96, max=478, avg=290.02, stdev=126.96 clat percentiles (msec): | 1.00th=[ 97], 5.00th=[ 97], 10.00th=[ 97], 20.00th=[ 138], | 30.00th=[ 159], 40.00th=[ 262], 50.00th=[ 305], 60.00th=[ 309], | 70.00th=[ 338], 80.00th=[ 409], 90.00th=[ 409], 95.00th=[ 481], | 99.00th=[ 481], 99.50th=[ 481], 99.90th=[ 481], 99.95th=[ 481], | 99.99th=[ 481] bw ( KiB/s): min= 1718, max= 4087, per=38.05%, avg=3138.00, stdev=1156.37, samples=5 iops : min= 1, max= 3, avg= 2.40, stdev= 0.89, samples=5 lat (msec) : 50=8.33%, 100=16.67%, 250=16.67%, 500=58.33% cpu : usr=0.00%, sys=18.38%, ctx=124, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=153798: Sun Sep 13 22:45:07 2026 read: IOPS=1, BW=1858KiB/s (1903kB/s)(6144KiB/3306msec) clat (msec): min=90, max=314, avg=203.50, stdev=91.08 lat (msec): min=90, max=314, avg=203.50, stdev=91.08 clat percentiles (msec): | 1.00th=[ 90], 5.00th=[ 90], 10.00th=[ 90], 20.00th=[ 118], | 30.00th=[ 118], 40.00th=[ 192], 50.00th=[ 192], 60.00th=[ 209], | 70.00th=[ 296], 80.00th=[ 296], 90.00th=[ 313], 95.00th=[ 313], | 99.00th=[ 313], 99.50th=[ 313], 99.90th=[ 313], 99.95th=[ 313], | 99.99th=[ 313] bw ( KiB/s): min= 2048, max= 4031, per=55.93%, avg=3295.00, stdev=1085.78, samples=3 iops : min= 2, max= 3, avg= 2.67, stdev= 0.58, samples=3 write: IOPS=1, BW=1858KiB/s (1903kB/s)(6144KiB/3306msec); 0 zone resets clat (msec): min=160, max=510, avg=329.33, stdev=143.98 lat (msec): min=160, max=510, avg=329.40, stdev=143.98 clat percentiles (msec): | 1.00th=[ 161], 5.00th=[ 161], 10.00th=[ 161], 20.00th=[ 207], | 30.00th=[ 207], 40.00th=[ 262], 50.00th=[ 262], 60.00th=[ 359], | 70.00th=[ 477], 80.00th=[ 477], 90.00th=[ 510], 95.00th=[ 510], | 99.00th=[ 510], 99.50th=[ 510], 99.90th=[ 510], 99.95th=[ 510], | 99.99th=[ 510] bw ( KiB/s): min= 1721, max= 2048, per=23.80%, avg=1963.00, stdev=130.93, samples=6 iops : min= 1, max= 2, avg= 1.33, stdev= 0.52, samples=6 lat (msec) : 100=8.33%, 250=41.67%, 500=41.67%, 750=8.33% cpu : usr=0.00%, sys=15.07%, ctx=147, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=153799: Sun Sep 13 22:45:07 2026 read: IOPS=1, BW=1473KiB/s (1508kB/s)(5120KiB/3476msec) clat (msec): min=55, max=375, avg=192.87, stdev=127.58 lat (msec): min=55, max=375, avg=192.87, stdev=127.58 clat percentiles (msec): | 1.00th=[ 56], 5.00th=[ 56], 10.00th=[ 56], 20.00th=[ 56], | 30.00th=[ 111], 40.00th=[ 111], 50.00th=[ 161], 60.00th=[ 161], | 70.00th=[ 264], 80.00th=[ 264], 90.00th=[ 376], 95.00th=[ 376], | 99.00th=[ 376], 99.50th=[ 376], 99.90th=[ 376], 99.95th=[ 376], | 99.99th=[ 376] bw ( KiB/s): min= 2048, max= 6047, per=68.71%, avg=4047.50, stdev=2827.72, samples=2 iops : min= 2, max= 5, avg= 3.50, stdev= 2.12, samples=2 write: IOPS=2, BW=2062KiB/s (2112kB/s)(7168KiB/3476msec); 0 zone resets clat (msec): min=96, max=519, avg=351.13, stdev=154.75 lat (msec): min=96, max=519, avg=351.21, stdev=154.76 clat percentiles (msec): | 1.00th=[ 97], 5.00th=[ 97], 10.00th=[ 97], 20.00th=[ 230], | 30.00th=[ 305], 40.00th=[ 305], 50.00th=[ 351], 60.00th=[ 460], | 70.00th=[ 460], 80.00th=[ 502], 90.00th=[ 518], 95.00th=[ 518], | 99.00th=[ 518], 99.50th=[ 518], 99.90th=[ 518], 99.95th=[ 518], | 99.99th=[ 518] bw ( KiB/s): min= 1723, max= 2048, per=23.68%, avg=1953.00, stdev=142.78, samples=5 iops : min= 1, max= 2, avg= 1.40, stdev= 0.55, samples=5 lat (msec) : 100=16.67%, 250=25.00%, 500=41.67%, 750=16.67% cpu : usr=0.03%, sys=15.42%, ctx=136, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5892KiB/s (6033kB/s), 673KiB/s-3063KiB/s (689kB/s-3137kB/s), io=20.0MiB (20.0MB), run=2340-3476msec WRITE: bw=8249KiB/s (8447kB/s), 1858KiB/s-3366KiB/s (1903kB/s-3447kB/s), io=28.0MiB (29.4MB), run=2340-3476msec rand-rw: (groupid=0, jobs=1): err= 0: pid=153801: Sun Sep 13 22:45:07 2026 read: IOPS=2, BW=2188KiB/s (2241kB/s)(7168KiB/3276msec) clat (usec): min=542, max=277772, avg=167526.28, stdev=87025.94 lat (usec): min=543, max=277773, avg=167527.70, stdev=87025.92 clat percentiles (usec): | 1.00th=[ 545], 5.00th=[ 545], 10.00th=[ 545], 20.00th=[123208], | 30.00th=[168821], 40.00th=[168821], 50.00th=[198181], 60.00th=[198181], | 70.00th=[198181], 80.00th=[206570], 90.00th=[278922], 95.00th=[278922], | 99.00th=[278922], 99.50th=[278922], 99.90th=[278922], 99.95th=[278922], | 99.99th=[278922] bw ( KiB/s): min= 2019, max= 5215, per=48.59%, avg=2832.50, stdev=1588.39, samples=4 iops : min= 1, max= 5, avg= 2.50, stdev= 1.73, samples=4 write: IOPS=1, BW=1563KiB/s (1600kB/s)(5120KiB/3276msec); 0 zone resets clat (msec): min=114, max=950, avg=405.68, stdev=377.75 lat (msec): min=114, max=950, avg=405.74, stdev=377.74 clat percentiles (msec): | 1.00th=[ 115], 5.00th=[ 115], 10.00th=[ 115], 20.00th=[ 115], | 30.00th=[ 138], 40.00th=[ 138], 50.00th=[ 171], 60.00th=[ 171], | 70.00th=[ 659], 80.00th=[ 659], 90.00th=[ 953], 95.00th=[ 953], | 99.00th=[ 953], 99.50th=[ 953], 99.90th=[ 953], 99.95th=[ 953], | 99.99th=[ 953] bw ( KiB/s): min= 1996, max= 6144, per=41.61%, avg=3396.00, stdev=2379.98, samples=3 iops : min= 1, max= 6, avg= 3.00, stdev= 2.65, samples=3 lat (usec) : 750=8.33% lat (msec) : 250=66.67%, 500=8.33%, 750=8.33%, 1000=8.33% cpu : usr=0.00%, sys=40.06%, ctx=905, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=153802: Sun Sep 13 22:45:07 2026 read: IOPS=0, BW=590KiB/s (604kB/s)(2048KiB/3472msec) clat (msec): min=138, max=367, avg=253.02, stdev=161.61 lat (msec): min=138, max=367, avg=253.02, stdev=161.61 clat percentiles (msec): | 1.00th=[ 140], 5.00th=[ 140], 10.00th=[ 140], 20.00th=[ 140], | 30.00th=[ 140], 40.00th=[ 140], 50.00th=[ 140], 60.00th=[ 368], | 70.00th=[ 368], 80.00th=[ 368], 90.00th=[ 368], 95.00th=[ 368], | 99.00th=[ 368], 99.50th=[ 368], 99.90th=[ 368], 99.95th=[ 368], | 99.99th=[ 368] bw ( KiB/s): min= 1715, max= 2048, per=32.28%, avg=1881.50, stdev=235.47, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 write: IOPS=2, BW=2949KiB/s (3020kB/s)(10.0MiB/3472msec); 0 zone resets clat (msec): min=168, max=566, avg=293.88, stdev=130.55 lat (msec): min=168, max=567, avg=293.97, stdev=130.55 clat percentiles (msec): | 1.00th=[ 169], 5.00th=[ 169], 10.00th=[ 169], 20.00th=[ 178], | 30.00th=[ 186], 40.00th=[ 213], 50.00th=[ 234], 60.00th=[ 247], | 70.00th=[ 347], 80.00th=[ 384], 90.00th=[ 418], 95.00th=[ 567], | 99.00th=[ 567], 99.50th=[ 567], 99.90th=[ 567], 99.95th=[ 567], | 99.99th=[ 567] bw ( KiB/s): min= 1715, max= 4096, per=32.51%, avg=2653.00, stdev=1085.27, samples=6 iops : min= 1, max= 4, avg= 2.17, stdev= 1.17, samples=6 lat (msec) : 250=58.33%, 500=33.33%, 750=8.33% cpu : usr=0.00%, sys=45.49%, ctx=555, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=153803: Sun Sep 13 22:45:07 2026 read: IOPS=2, BW=2394KiB/s (2452kB/s)(6144KiB/2566msec) clat (usec): min=575, max=271104, avg=94957.35, stdev=118848.08 lat (usec): min=576, max=271105, avg=94958.37, stdev=118848.07 clat percentiles (usec): | 1.00th=[ 578], 5.00th=[ 578], 10.00th=[ 578], 20.00th=[ 644], | 30.00th=[ 644], 40.00th=[ 824], 50.00th=[ 824], 60.00th=[ 88605], | 70.00th=[208667], 80.00th=[208667], 90.00th=[270533], 95.00th=[270533], | 99.00th=[270533], 99.50th=[270533], 99.90th=[270533], 99.95th=[270533], | 99.99th=[270533] bw ( KiB/s): min= 2048, max= 8078, per=86.86%, avg=5063.00, stdev=4263.85, samples=2 iops : min= 2, max= 7, avg= 4.50, stdev= 3.54, samples=2 write: IOPS=2, BW=2394KiB/s (2452kB/s)(6144KiB/2566msec); 0 zone resets clat (msec): min=135, max=480, avg=317.71, stdev=147.90 lat (msec): min=135, max=480, avg=317.77, stdev=147.91 clat percentiles (msec): | 1.00th=[ 136], 5.00th=[ 136], 10.00th=[ 136], 20.00th=[ 155], | 30.00th=[ 155], 40.00th=[ 300], 50.00th=[ 300], 60.00th=[ 380], | 70.00th=[ 456], 80.00th=[ 456], 90.00th=[ 481], 95.00th=[ 481], | 99.00th=[ 481], 99.50th=[ 481], 99.90th=[ 481], 99.95th=[ 481], | 99.99th=[ 481] bw ( KiB/s): min= 1718, max= 4039, per=30.18%, avg=2463.25, stdev=1061.96, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 0.82, samples=4 lat (usec) : 750=16.67%, 1000=8.33% lat (msec) : 100=8.33%, 250=25.00%, 500=41.67% cpu : usr=0.00%, sys=39.65%, ctx=502, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=153804: Sun Sep 13 22:45:07 2026 read: IOPS=1, BW=1457KiB/s (1492kB/s)(5120KiB/3513msec) clat (usec): min=562, max=242592, avg=114484.29, stdev=117849.39 lat (usec): min=563, max=242593, avg=114485.19, stdev=117849.24 clat percentiles (usec): | 1.00th=[ 562], 5.00th=[ 562], 10.00th=[ 562], 20.00th=[ 562], | 30.00th=[ 619], 40.00th=[ 619], 50.00th=[100140], 60.00th=[100140], | 70.00th=[227541], 80.00th=[227541], 90.00th=[242222], 95.00th=[242222], | 99.00th=[242222], 99.50th=[242222], 99.90th=[242222], 99.95th=[242222], | 99.99th=[242222] bw ( KiB/s): min= 8192, max= 8192, per=100.00%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 8, max= 8, avg= 8.00, stdev= 0.00, samples=1 write: IOPS=1, BW=2040KiB/s (2089kB/s)(7168KiB/3513msec); 0 zone resets clat (msec): min=87, max=581, avg=404.95, stdev=186.22 lat (msec): min=87, max=581, avg=405.02, stdev=186.22 clat percentiles (msec): | 1.00th=[ 88], 5.00th=[ 88], 10.00th=[ 88], 20.00th=[ 271], | 30.00th=[ 330], 40.00th=[ 330], 50.00th=[ 435], 60.00th=[ 558], | 70.00th=[ 558], 80.00th=[ 575], 90.00th=[ 584], 95.00th=[ 584], | 99.00th=[ 584], 99.50th=[ 584], 99.90th=[ 584], 99.95th=[ 584], | 99.99th=[ 584] bw ( KiB/s): min= 1703, max= 2048, per=24.05%, avg=1962.80, stdev=146.86, samples=5 iops : min= 1, max= 2, avg= 1.40, stdev= 0.55, samples=5 lat (usec) : 750=16.67% lat (msec) : 100=8.33%, 250=25.00%, 500=25.00%, 750=25.00% cpu : usr=0.03%, sys=29.67%, ctx=335, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5830KiB/s (5970kB/s), 590KiB/s-2394KiB/s (604kB/s-2452kB/s), io=20.0MiB (20.0MB), run=2566-3513msec WRITE: bw=8162KiB/s (8358kB/s), 1563KiB/s-2949KiB/s (1600kB/s-3020kB/s), io=28.0MiB (29.4MB), run=2566-3513msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=153809: Sun Sep 13 22:45:15 2026 read: IOPS=1, BW=7380KiB/s (7557kB/s)(12.0MiB/1665msec) clat (msec): min=478, max=583, avg=522.47, stdev=54.53 lat (msec): min=478, max=583, avg=522.47, stdev=54.53 clat percentiles (msec): | 1.00th=[ 477], 5.00th=[ 477], 10.00th=[ 477], 20.00th=[ 477], | 30.00th=[ 477], 40.00th=[ 506], 50.00th=[ 506], 60.00th=[ 506], | 70.00th=[ 584], 80.00th=[ 584], 90.00th=[ 584], 95.00th=[ 584], | 99.00th=[ 584], 99.50th=[ 584], 99.90th=[ 584], 99.95th=[ 584], | 99.99th=[ 584] bw ( KiB/s): min= 8192, max= 8192, per=83.25%, avg=8192.00, stdev= 0.00, samples=2 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 750=66.67% cpu : usr=0.00%, sys=55.65%, ctx=1857, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=153810: Sun Sep 13 22:45:15 2026 read: IOPS=0, BW=2966KiB/s (3037kB/s)(4096KiB/1381msec) clat (nsec): min=505966k, max=505966k, avg=505966045.00, stdev= 0.00 lat (nsec): min=505968k, max=505968k, avg=505967915.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 506], 5.00th=[ 506], 10.00th=[ 506], 20.00th=[ 506], | 30.00th=[ 506], 40.00th=[ 506], 50.00th=[ 506], 60.00th=[ 506], | 70.00th=[ 506], 80.00th=[ 506], 90.00th=[ 506], 95.00th=[ 506], | 99.00th=[ 506], 99.50th=[ 506], 99.90th=[ 506], 99.95th=[ 506], | 99.99th=[ 506] bw ( KiB/s): min= 8192, max= 8192, per=83.25%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 write: IOPS=1, BW=5932KiB/s (6074kB/s)(8192KiB/1381msec); 0 zone resets clat (msec): min=182, max=594, avg=388.15, stdev=291.33 lat (msec): min=182, max=594, avg=388.41, stdev=291.22 clat percentiles (msec): | 1.00th=[ 182], 5.00th=[ 182], 10.00th=[ 182], 20.00th=[ 182], | 30.00th=[ 182], 40.00th=[ 182], 50.00th=[ 182], 60.00th=[ 592], | 70.00th=[ 592], 80.00th=[ 592], 90.00th=[ 592], 95.00th=[ 592], | 99.00th=[ 592], 99.50th=[ 592], 99.90th=[ 592], 99.95th=[ 592], | 99.99th=[ 592] bw ( KiB/s): min= 8192, max= 8192, per=47.55%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 750=66.67% cpu : usr=0.07%, sys=29.57%, ctx=374, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=153811: Sun Sep 13 22:45:15 2026 write: IOPS=1, BW=6461KiB/s (6616kB/s)(12.0MiB/1902msec); 0 zone resets clat (msec): min=259, max=924, avg=599.03, stdev=332.35 lat (msec): min=260, max=924, avg=599.33, stdev=332.35 clat percentiles (msec): | 1.00th=[ 259], 5.00th=[ 259], 10.00th=[ 259], 20.00th=[ 259], | 30.00th=[ 259], 40.00th=[ 617], 50.00th=[ 617], 60.00th=[ 617], | 70.00th=[ 927], 80.00th=[ 927], 90.00th=[ 927], 95.00th=[ 927], | 99.00th=[ 927], 99.50th=[ 927], 99.90th=[ 927], 99.95th=[ 927], | 99.99th=[ 927] bw ( KiB/s): min= 8192, max= 8192, per=47.55%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 750=33.33%, 1000=33.33% cpu : usr=0.05%, sys=20.78%, ctx=77, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=153813: Sun Sep 13 22:45:15 2026 write: IOPS=1, BW=7216KiB/s (7389kB/s)(12.0MiB/1703msec); 0 zone resets clat (msec): min=134, max=1287, avg=533.02, stdev=654.08 lat (msec): min=135, max=1288, avg=533.29, stdev=654.09 clat percentiles (msec): | 1.00th=[ 136], 5.00th=[ 136], 10.00th=[ 136], 20.00th=[ 136], | 30.00th=[ 136], 40.00th=[ 178], 50.00th=[ 178], 60.00th=[ 178], | 70.00th=[ 1284], 80.00th=[ 1284], 90.00th=[ 1284], 95.00th=[ 1284], | 99.00th=[ 1284], 99.50th=[ 1284], 99.90th=[ 1284], 99.95th=[ 1284], | 99.99th=[ 1284] bw ( KiB/s): min=16031, max=16031, per=93.05%, avg=16031.00, stdev= 0.00, samples=1 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=1 lat (msec) : 250=66.67%, 2000=33.33% cpu : usr=0.06%, sys=15.10%, ctx=72, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=9840KiB/s (10.1MB/s), 2966KiB/s-7380KiB/s (3037kB/s-7557kB/s), io=16.0MiB (16.8MB), run=1381-1665msec WRITE: bw=16.8MiB/s (17.6MB/s), 5932KiB/s-7216KiB/s (6074kB/s-7389kB/s), io=32.0MiB (33.6MB), run=1381-1902msec rand-rw: (groupid=0, jobs=1): err= 0: pid=153814: Sun Sep 13 22:45:16 2026 read: IOPS=1, BW=6194KiB/s (6342kB/s)(12.0MiB/1984msec) clat (msec): min=141, max=1048, avg=655.84, stdev=465.57 lat (msec): min=141, max=1048, avg=655.84, stdev=465.57 clat percentiles (msec): | 1.00th=[ 142], 5.00th=[ 142], 10.00th=[ 142], 20.00th=[ 142], | 30.00th=[ 142], 40.00th=[ 776], 50.00th=[ 776], 60.00th=[ 776], | 70.00th=[ 1053], 80.00th=[ 1053], 90.00th=[ 1053], 95.00th=[ 1053], | 99.00th=[ 1053], 99.50th=[ 1053], 99.90th=[ 1053], 99.95th=[ 1053], | 99.99th=[ 1053] bw ( KiB/s): min= 8143, max= 8143, per=98.61%, avg=8143.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=12.30%, ctx=65, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=153815: Sun Sep 13 22:45:16 2026 read: IOPS=0, BW=2350KiB/s (2406kB/s)(4096KiB/1743msec) clat (nsec): min=552702k, max=552702k, avg=552702131.00, stdev= 0.00 lat (nsec): min=552703k, max=552703k, avg=552703353.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 550], 5.00th=[ 550], 10.00th=[ 550], 20.00th=[ 550], | 30.00th=[ 550], 40.00th=[ 550], 50.00th=[ 550], 60.00th=[ 550], | 70.00th=[ 550], 80.00th=[ 550], 90.00th=[ 550], 95.00th=[ 550], | 99.00th=[ 550], 99.50th=[ 550], 99.90th=[ 550], 99.95th=[ 550], | 99.99th=[ 550] bw ( KiB/s): min= 8143, max= 8143, per=98.61%, avg=8143.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=1, BW=4700KiB/s (4813kB/s)(8192KiB/1743msec); 0 zone resets clat (msec): min=405, max=764, avg=585.36, stdev=253.76 lat (msec): min=406, max=765, avg=585.72, stdev=253.81 clat percentiles (msec): | 1.00th=[ 405], 5.00th=[ 405], 10.00th=[ 405], 20.00th=[ 405], | 30.00th=[ 405], 40.00th=[ 405], 50.00th=[ 405], 60.00th=[ 768], | 70.00th=[ 768], 80.00th=[ 768], 90.00th=[ 768], 95.00th=[ 768], | 99.00th=[ 768], 99.50th=[ 768], 99.90th=[ 768], 99.95th=[ 768], | 99.99th=[ 768] bw ( KiB/s): min= 8143, max= 8143, per=51.22%, avg=8143.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 750=33.33%, 1000=33.33% cpu : usr=0.00%, sys=15.04%, ctx=67, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=153816: Sun Sep 13 22:45:16 2026 write: IOPS=1, BW=5962KiB/s (6105kB/s)(12.0MiB/2061msec); 0 zone resets clat (msec): min=73, max=1347, avg=681.36, stdev=638.75 lat (msec): min=74, max=1347, avg=681.60, stdev=638.82 clat percentiles (msec): | 1.00th=[ 74], 5.00th=[ 74], 10.00th=[ 74], 20.00th=[ 74], | 30.00th=[ 74], 40.00th=[ 625], 50.00th=[ 625], 60.00th=[ 625], | 70.00th=[ 1351], 80.00th=[ 1351], 90.00th=[ 1351], 95.00th=[ 1351], | 99.00th=[ 1351], 99.50th=[ 1351], 99.90th=[ 1351], 99.95th=[ 1351], | 99.99th=[ 1351] bw ( KiB/s): min= 8192, max= 8192, per=51.53%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 100=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.00%, sys=12.67%, ctx=53, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=153817: Sun Sep 13 22:45:16 2026 write: IOPS=1, BW=7062KiB/s (7232kB/s)(12.0MiB/1740msec); 0 zone resets clat (msec): min=172, max=1164, avg=572.90, stdev=522.75 lat (msec): min=173, max=1164, avg=573.23, stdev=522.73 clat percentiles (msec): | 1.00th=[ 174], 5.00th=[ 174], 10.00th=[ 174], 20.00th=[ 174], | 30.00th=[ 174], 40.00th=[ 380], 50.00th=[ 380], 60.00th=[ 380], | 70.00th=[ 1167], 80.00th=[ 1167], 90.00th=[ 1167], 95.00th=[ 1167], | 99.00th=[ 1167], 99.50th=[ 1167], 99.90th=[ 1167], 99.95th=[ 1167], | 99.99th=[ 1167] bw ( KiB/s): min=11100, max=11100, per=69.82%, avg=11100.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 500=33.33%, 2000=33.33% cpu : usr=0.17%, sys=14.84%, ctx=60, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=8258KiB/s (8456kB/s), 2350KiB/s-6194KiB/s (2406kB/s-6342kB/s), io=16.0MiB (16.8MB), run=1743-1984msec WRITE: bw=15.5MiB/s (16.3MB/s), 4700KiB/s-7062KiB/s (4813kB/s-7232kB/s), io=32.0MiB (33.6MB), run=1740-2061msec