== sanity test 398b: DIO and buffer IO race ============== 22:00:26 (1788919226) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 4.26674 s, 11.8 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=151409: Tue Sep 8 22:01:48 2026 read: IOPS=21, BW=87.9KiB/s (90.0kB/s)(5992KiB/68146msec) clat (usec): min=30, max=721205, avg=22524.10, stdev=23042.47 lat (usec): min=31, max=721206, avg=22526.02, stdev=23042.32 clat percentiles (usec): | 1.00th=[ 55], 5.00th=[ 106], 10.00th=[ 8717], 20.00th=[ 11731], | 30.00th=[ 14091], 40.00th=[ 16909], 50.00th=[ 19530], 60.00th=[ 23200], | 70.00th=[ 26608], 80.00th=[ 31851], 90.00th=[ 39060], 95.00th=[ 46400], | 99.00th=[ 71828], 99.50th=[ 90702], 99.90th=[125305], 99.95th=[717226], | 99.99th=[717226] bw ( KiB/s): min= 31, max= 184, per=25.16%, avg=87.80, stdev=27.67, samples=134 iops : min= 7, max= 46, avg=21.39, stdev= 7.01, samples=134 write: IOPS=23, BW=92.4KiB/s (94.6kB/s)(6296KiB/68146msec); 0 zone resets clat (usec): min=1108, max=185579, avg=21688.05, stdev=20193.85 lat (usec): min=1109, max=185580, avg=21689.81, stdev=20194.22 clat percentiles (usec): | 1.00th=[ 1369], 5.00th=[ 2008], 10.00th=[ 2409], 20.00th=[ 3851], | 30.00th=[ 5932], 40.00th=[ 11994], 50.00th=[ 17695], 60.00th=[ 22414], | 70.00th=[ 28705], 80.00th=[ 36439], 90.00th=[ 47449], 95.00th=[ 57410], | 99.00th=[ 90702], 99.50th=[105382], 99.90th=[183501], 99.95th=[185598], | 99.99th=[185598] bw ( KiB/s): min= 31, max= 192, per=25.23%, avg=92.35, stdev=29.76, samples=134 iops : min= 7, max= 48, avg=22.51, stdev= 7.51, samples=134 lat (usec) : 50=0.26%, 100=2.05%, 250=1.17%, 500=0.13%, 750=0.10% lat (msec) : 2=2.51%, 4=8.17%, 10=11.52%, 20=27.15%, 50=41.05% lat (msec) : 100=5.44%, 250=0.42%, 750=0.03% cpu : usr=0.12%, sys=14.00%, ctx=7756, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=151410: Tue Sep 8 22:01:48 2026 read: IOPS=21, BW=87.8KiB/s (89.9kB/s)(5940KiB/67666msec) clat (usec): min=36, max=726567, avg=23335.28, stdev=25232.70 lat (usec): min=37, max=726568, avg=23337.77, stdev=25232.50 clat percentiles (usec): | 1.00th=[ 58], 5.00th=[ 113], 10.00th=[ 8848], 20.00th=[ 12125], | 30.00th=[ 14484], 40.00th=[ 16712], 50.00th=[ 19268], 60.00th=[ 22676], | 70.00th=[ 26608], 80.00th=[ 31851], 90.00th=[ 40633], 95.00th=[ 47973], | 99.00th=[ 94897], 99.50th=[107480], 99.90th=[233833], 99.95th=[725615], | 99.99th=[725615] bw ( KiB/s): min= 30, max= 152, per=25.15%, avg=87.77, stdev=26.72, samples=133 iops : min= 7, max= 38, avg=21.37, stdev= 6.73, samples=133 write: IOPS=23, BW=93.8KiB/s (96.1kB/s)(6348KiB/67666msec); 0 zone resets clat (usec): min=1125, max=121602, avg=20620.72, stdev=18745.25 lat (usec): min=1126, max=121603, avg=20626.97, stdev=18748.50 clat percentiles (usec): | 1.00th=[ 1352], 5.00th=[ 1811], 10.00th=[ 2507], 20.00th=[ 3949], | 30.00th=[ 6325], 40.00th=[ 12125], 50.00th=[ 16581], 60.00th=[ 20841], | 70.00th=[ 26346], 80.00th=[ 33817], 90.00th=[ 45876], 95.00th=[ 55837], | 99.00th=[ 88605], 99.50th=[ 96994], 99.90th=[117965], 99.95th=[121111], | 99.99th=[121111] bw ( KiB/s): min= 23, max= 184, per=25.54%, avg=93.46, stdev=29.54, samples=133 iops : min= 5, max= 46, avg=22.80, stdev= 7.45, samples=133 lat (usec) : 50=0.13%, 100=1.99%, 250=1.20%, 500=0.10%, 750=0.03% lat (usec) : 1000=0.03% lat (msec) : 2=3.39%, 4=7.26%, 10=11.17%, 20=29.79%, 50=38.77% lat (msec) : 100=5.57%, 250=0.55%, 750=0.03% cpu : usr=0.10%, sys=14.00%, ctx=7854, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=151411: Tue Sep 8 22:01:48 2026 read: IOPS=21, BW=87.8KiB/s (89.9kB/s)(6028KiB/68672msec) clat (usec): min=38, max=727690, avg=22323.15, stdev=22942.41 lat (usec): min=39, max=727691, avg=22324.62, stdev=22942.49 clat percentiles (usec): | 1.00th=[ 53], 5.00th=[ 101], 10.00th=[ 8979], 20.00th=[ 12125], | 30.00th=[ 14353], 40.00th=[ 16712], 50.00th=[ 19268], 60.00th=[ 22152], | 70.00th=[ 26084], 80.00th=[ 31065], 90.00th=[ 39584], 95.00th=[ 46400], | 99.00th=[ 67634], 99.50th=[ 80217], 99.90th=[168821], 99.95th=[725615], | 99.99th=[725615] bw ( KiB/s): min= 31, max= 191, per=25.10%, avg=87.59, stdev=27.37, samples=135 iops : min= 7, max= 47, avg=21.33, stdev= 6.90, samples=135 write: IOPS=22, BW=91.2KiB/s (93.3kB/s)(6260KiB/68672msec); 0 zone resets clat (usec): min=962, max=150465, avg=22208.56, stdev=20391.09 lat (usec): min=963, max=150465, avg=22210.88, stdev=20391.34 clat percentiles (usec): | 1.00th=[ 1303], 5.00th=[ 1860], 10.00th=[ 2606], 20.00th=[ 4047], | 30.00th=[ 6980], 40.00th=[ 13304], 50.00th=[ 17433], 60.00th=[ 21890], | 70.00th=[ 28705], 80.00th=[ 36439], 90.00th=[ 49021], 95.00th=[ 59507], | 99.00th=[ 93848], 99.50th=[115868], 99.90th=[143655], 99.95th=[149947], | 99.99th=[149947] bw ( KiB/s): min= 31, max= 207, per=24.82%, avg=90.86, stdev=28.51, samples=135 iops : min= 7, max= 51, avg=22.15, stdev= 7.19, samples=135 lat (usec) : 50=0.23%, 100=2.15%, 250=0.94%, 500=0.03%, 1000=0.03% lat (msec) : 2=3.35%, 4=6.74%, 10=10.42%, 20=29.98%, 50=39.75% lat (msec) : 100=5.89%, 250=0.46%, 750=0.03% cpu : usr=0.10%, sys=13.90%, ctx=8005, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=151412: Tue Sep 8 22:01:48 2026 read: IOPS=22, BW=88.7KiB/s (90.8kB/s)(6052KiB/68245msec) clat (usec): min=35, max=727866, avg=22524.52, stdev=23569.67 lat (usec): min=36, max=727867, avg=22526.20, stdev=23569.80 clat percentiles (usec): | 1.00th=[ 59], 5.00th=[ 108], 10.00th=[ 8455], 20.00th=[ 12125], | 30.00th=[ 14353], 40.00th=[ 16188], 50.00th=[ 19006], 60.00th=[ 22676], | 70.00th=[ 26870], 80.00th=[ 31851], 90.00th=[ 39060], 95.00th=[ 45351], | 99.00th=[ 68682], 99.50th=[100140], 99.90th=[166724], 99.95th=[725615], | 99.99th=[725615] bw ( KiB/s): min= 23, max= 159, per=25.30%, avg=88.31, stdev=25.36, samples=134 iops : min= 5, max= 39, avg=21.51, stdev= 6.37, samples=134 write: IOPS=22, BW=91.4KiB/s (93.6kB/s)(6236KiB/68245msec); 0 zone resets clat (usec): min=1098, max=214463, avg=21743.68, stdev=19398.50 lat (usec): min=1099, max=214464, avg=21745.45, stdev=19398.66 clat percentiles (usec): | 1.00th=[ 1369], 5.00th=[ 2040], 10.00th=[ 2671], 20.00th=[ 4424], | 30.00th=[ 7439], 40.00th=[ 13435], 50.00th=[ 17695], 60.00th=[ 22676], | 70.00th=[ 27919], 80.00th=[ 35390], 90.00th=[ 46924], 95.00th=[ 56361], | 99.00th=[ 82314], 99.50th=[100140], 99.90th=[125305], 99.95th=[214959], | 99.99th=[214959] bw ( KiB/s): min= 31, max= 176, per=24.91%, avg=91.19, stdev=29.01, samples=134 iops : min= 7, max= 44, avg=22.23, stdev= 7.35, samples=134 lat (usec) : 50=0.16%, 100=2.02%, 250=1.30%, 500=0.16%, 750=0.03% lat (usec) : 1000=0.03% lat (msec) : 2=2.47%, 4=6.74%, 10=10.87%, 20=29.65%, 50=41.11% lat (msec) : 100=4.92%, 250=0.49%, 750=0.03% cpu : usr=0.14%, sys=13.84%, ctx=7945, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=350KiB/s (358kB/s), 87.8KiB/s-88.7KiB/s (89.9kB/s-90.8kB/s), io=23.4MiB (24.6MB), run=67666-68672msec WRITE: bw=366KiB/s (375kB/s), 91.2KiB/s-93.8KiB/s (93.3kB/s-96.1kB/s), io=24.6MiB (25.7MB), run=67666-68672msec fio: pid=151414, err=5/file:backend.c:481, func=full resid, error=Input/output error rand-rw: (groupid=0, jobs=1): err= 5 (file:backend.c:481, func=full resid, error=Input/output error): pid=151414: Tue Sep 8 22:02:50 2026 read: IOPS=10, BW=40.8KiB/s (41.8kB/s)(3932KiB/96282msec) clat (msec): min=4, max=762, avg=23.10, stdev=31.71 lat (msec): min=4, max=762, avg=23.10, stdev=31.71 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 7], 10.00th=[ 7], 20.00th=[ 9], | 30.00th=[ 10], 40.00th=[ 12], 50.00th=[ 15], 60.00th=[ 19], | 70.00th=[ 25], 80.00th=[ 34], 90.00th=[ 48], 95.00th=[ 61], | 99.00th=[ 120], 99.50th=[ 144], 99.90th=[ 760], 99.95th=[ 760], | 99.99th=[ 760] bw ( KiB/s): min= 7, max= 127, per=24.42%, avg=41.03, stdev=25.93, samples=187 iops : min= 1, max= 31, avg= 9.75, stdev= 6.54, samples=187 write: IOPS=10, BW=43.1KiB/s (44.1kB/s)(4148KiB/96282msec); 0 zone resets clat (msec): min=22, max=226, avg=70.88, stdev=32.31 lat (msec): min=22, max=226, avg=70.88, stdev=32.31 clat percentiles (msec): | 1.00th=[ 28], 5.00th=[ 34], 10.00th=[ 37], 20.00th=[ 43], | 30.00th=[ 49], 40.00th=[ 57], 50.00th=[ 65], 60.00th=[ 73], | 70.00th=[ 84], 80.00th=[ 95], 90.00th=[ 115], 95.00th=[ 132], | 99.00th=[ 169], 99.50th=[ 194], 99.90th=[ 222], 99.95th=[ 226], | 99.99th=[ 226] bw ( KiB/s): min= 7, max= 95, per=24.26%, avg=42.69, stdev=19.45, samples=190 iops : min= 1, max= 23, avg=10.16, stdev= 4.92, samples=190 lat (msec) : 10=15.93%, 20=14.60%, 50=29.89%, 100=30.48%, 250=9.01% lat (msec) : 1000=0.05% cpu : usr=0.07%, sys=3.47%, ctx=3368, majf=0, minf=20 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=984,1037,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=151415: Tue Sep 8 22:02:50 2026 read: IOPS=11, BW=45.5KiB/s (46.6kB/s)(5940KiB/130605msec) clat (msec): min=4, max=742, avg=20.00, stdev=26.24 lat (msec): min=4, max=742, avg=20.00, stdev=26.24 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 7], 10.00th=[ 8], 20.00th=[ 9], | 30.00th=[ 10], 40.00th=[ 12], 50.00th=[ 15], 60.00th=[ 17], | 70.00th=[ 21], 80.00th=[ 26], 90.00th=[ 39], 95.00th=[ 54], | 99.00th=[ 101], 99.50th=[ 121], 99.90th=[ 259], 99.95th=[ 743], | 99.99th=[ 743] bw ( KiB/s): min= 7, max= 127, per=27.31%, avg=45.88, stdev=26.94, samples=255 iops : min= 1, max= 31, avg=10.99, stdev= 6.81, samples=255 write: IOPS=12, BW=48.6KiB/s (49.8kB/s)(6348KiB/130605msec); 0 zone resets clat (msec): min=22, max=256, avg=63.52, stdev=29.38 lat (msec): min=22, max=256, avg=63.52, stdev=29.38 clat percentiles (msec): | 1.00th=[ 28], 5.00th=[ 33], 10.00th=[ 36], 20.00th=[ 41], | 30.00th=[ 46], 40.00th=[ 51], 50.00th=[ 56], 60.00th=[ 63], | 70.00th=[ 71], 80.00th=[ 84], 90.00th=[ 101], 95.00th=[ 120], | 99.00th=[ 169], 99.50th=[ 205], 99.90th=[ 230], 99.95th=[ 257], | 99.99th=[ 257] bw ( KiB/s): min= 7, max= 96, per=27.45%, avg=48.31, stdev=19.89, samples=259 iops : min= 1, max= 24, avg=11.59, stdev= 5.04, samples=259 lat (msec) : 10=15.07%, 20=18.85%, 50=31.90%, 100=28.58%, 250=5.50% lat (msec) : 500=0.07%, 750=0.03% cpu : usr=0.08%, sys=3.59%, ctx=5936, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=151416: Tue Sep 8 22:02:50 2026 read: IOPS=11, BW=46.3KiB/s (47.4kB/s)(6028KiB/130262msec) clat (msec): min=4, max=154, avg=19.93, stdev=16.77 lat (msec): min=4, max=154, avg=19.93, stdev=16.77 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 7], 10.00th=[ 8], 20.00th=[ 9], | 30.00th=[ 11], 40.00th=[ 13], 50.00th=[ 16], 60.00th=[ 18], | 70.00th=[ 21], 80.00th=[ 27], 90.00th=[ 40], 95.00th=[ 52], | 99.00th=[ 84], 99.50th=[ 106], 99.90th=[ 148], 99.95th=[ 155], | 99.99th=[ 155] bw ( KiB/s): min= 7, max= 152, per=27.61%, avg=46.39, stdev=26.83, samples=256 iops : min= 1, max= 38, avg=11.12, stdev= 6.76, samples=256 write: IOPS=12, BW=48.1KiB/s (49.2kB/s)(6260KiB/130262msec); 0 zone resets clat (msec): min=23, max=863, avg=63.99, stdev=35.37 lat (msec): min=23, max=863, avg=63.99, stdev=35.37 clat percentiles (msec): | 1.00th=[ 28], 5.00th=[ 33], 10.00th=[ 36], 20.00th=[ 41], | 30.00th=[ 45], 40.00th=[ 50], 50.00th=[ 56], 60.00th=[ 63], | 70.00th=[ 71], 80.00th=[ 84], 90.00th=[ 106], 95.00th=[ 124], | 99.00th=[ 159], 99.50th=[ 180], 99.90th=[ 239], 99.95th=[ 860], | 99.99th=[ 860] bw ( KiB/s): min= 7, max= 96, per=27.24%, avg=47.95, stdev=20.06, samples=257 iops : min= 1, max= 24, avg=11.51, stdev= 5.09, samples=257 lat (msec) : 10=13.51%, 20=19.92%, 50=33.82%, 100=26.50%, 250=6.22% lat (msec) : 1000=0.03% cpu : usr=0.06%, sys=3.62%, ctx=5942, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=151417: Tue Sep 8 22:02:50 2026 read: IOPS=11, BW=46.4KiB/s (47.5kB/s)(6052KiB/130475msec) clat (msec): min=4, max=255, avg=19.52, stdev=17.83 lat (msec): min=4, max=255, avg=19.52, stdev=17.83 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 7], 10.00th=[ 8], 20.00th=[ 9], | 30.00th=[ 10], 40.00th=[ 13], 50.00th=[ 15], 60.00th=[ 17], | 70.00th=[ 20], 80.00th=[ 26], 90.00th=[ 39], 95.00th=[ 52], | 99.00th=[ 84], 99.50th=[ 102], 99.90th=[ 201], 99.95th=[ 255], | 99.99th=[ 255] bw ( KiB/s): min= 7, max= 167, per=28.34%, avg=47.61, stdev=27.68, samples=250 iops : min= 1, max= 41, avg=11.42, stdev= 6.97, samples=250 write: IOPS=11, BW=47.8KiB/s (48.9kB/s)(6236KiB/130475msec); 0 zone resets clat (msec): min=21, max=813, avg=64.69, stdev=35.01 lat (msec): min=21, max=813, avg=64.70, stdev=35.01 clat percentiles (msec): | 1.00th=[ 28], 5.00th=[ 33], 10.00th=[ 37], 20.00th=[ 42], | 30.00th=[ 47], 40.00th=[ 52], 50.00th=[ 56], 60.00th=[ 63], | 70.00th=[ 72], 80.00th=[ 84], 90.00th=[ 104], 95.00th=[ 122], | 99.00th=[ 176], 99.50th=[ 203], 99.90th=[ 259], 99.95th=[ 810], | 99.99th=[ 810] bw ( KiB/s): min= 15, max= 96, per=26.94%, avg=47.42, stdev=18.84, samples=258 iops : min= 3, max= 24, avg=11.37, stdev= 4.79, samples=258 lat (msec) : 10=14.94%, 20=19.89%, 50=30.89%, 100=28.32%, 250=5.86% lat (msec) : 500=0.07%, 1000=0.03% cpu : usr=0.06%, sys=3.63%, ctx=5893, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=168KiB/s (172kB/s), 40.8KiB/s-46.4KiB/s (41.8kB/s-47.5kB/s), io=21.4MiB (22.5MB), run=96282-130605msec WRITE: bw=176KiB/s (180kB/s), 43.1KiB/s-48.6KiB/s (44.1kB/s-49.8kB/s), io=22.5MiB (23.5MB), run=96282-130605msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=151472: Tue Sep 8 22:03:11 2026 read: IOPS=25, BW=402KiB/s (411kB/s)(5920KiB/14739msec) clat (usec): min=47, max=108486, avg=19781.18, stdev=16338.12 lat (usec): min=47, max=108487, avg=19782.06, stdev=16338.17 clat percentiles (usec): | 1.00th=[ 49], 5.00th=[ 65], 10.00th=[ 87], 20.00th=[ 135], | 30.00th=[ 12518], 40.00th=[ 15926], 50.00th=[ 18744], 60.00th=[ 21890], | 70.00th=[ 25035], 80.00th=[ 30802], 90.00th=[ 39060], 95.00th=[ 46924], | 99.00th=[ 77071], 99.50th=[ 94897], 99.90th=[108528], 99.95th=[108528], | 99.99th=[108528] bw ( KiB/s): min= 192, max= 601, per=25.76%, avg=399.52, stdev=105.60, samples=29 iops : min= 12, max= 37, avg=24.31, stdev= 6.57, samples=29 write: IOPS=27, BW=432KiB/s (442kB/s)(6368KiB/14739msec); 0 zone resets clat (usec): min=1730, max=107539, avg=18590.20, stdev=16899.09 lat (usec): min=1732, max=107540, avg=18600.63, stdev=16894.32 clat percentiles (usec): | 1.00th=[ 1893], 5.00th=[ 2769], 10.00th=[ 3556], 20.00th=[ 4883], | 30.00th=[ 6587], 40.00th=[ 9634], 50.00th=[ 13173], 60.00th=[ 18482], | 70.00th=[ 21890], 80.00th=[ 31327], 90.00th=[ 41681], 95.00th=[ 50594], | 99.00th=[ 91751], 99.50th=[101188], 99.90th=[107480], 99.95th=[107480], | 99.99th=[107480] bw ( KiB/s): min= 157, max= 670, per=26.50%, avg=432.41, stdev=139.62, samples=29 iops : min= 9, max= 41, avg=26.38, stdev= 8.68, samples=29 lat (usec) : 50=0.52%, 100=5.73%, 250=4.56%, 500=0.39%, 750=0.26% lat (msec) : 2=0.78%, 4=5.73%, 10=15.49%, 20=25.91%, 50=36.07% lat (msec) : 100=4.17%, 250=0.39% cpu : usr=0.12%, sys=18.25%, ctx=1974, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=151473: Tue Sep 8 22:03:11 2026 read: IOPS=23, BW=372KiB/s (381kB/s)(5744KiB/15435msec) clat (usec): min=44, max=201574, avg=21431.62, stdev=17730.43 lat (usec): min=45, max=201575, avg=21432.53, stdev=17730.43 clat percentiles (usec): | 1.00th=[ 49], 5.00th=[ 74], 10.00th=[ 101], 20.00th=[ 9896], | 30.00th=[ 14222], 40.00th=[ 17171], 50.00th=[ 19530], 60.00th=[ 22938], | 70.00th=[ 27395], 80.00th=[ 32113], 90.00th=[ 38536], 95.00th=[ 46400], | 99.00th=[ 69731], 99.50th=[103285], 99.90th=[202376], 99.95th=[202376], | 99.99th=[202376] bw ( KiB/s): min= 63, max= 640, per=23.82%, avg=369.47, stdev=119.46, samples=30 iops : min= 3, max= 40, avg=22.43, stdev= 7.47, samples=30 write: IOPS=26, BW=424KiB/s (434kB/s)(6544KiB/15435msec); 0 zone resets clat (usec): min=1645, max=122226, avg=18857.96, stdev=19317.01 lat (usec): min=1646, max=122228, avg=18859.64, stdev=19317.03 clat percentiles (usec): | 1.00th=[ 1795], 5.00th=[ 2606], 10.00th=[ 3359], 20.00th=[ 4359], | 30.00th=[ 5735], 40.00th=[ 8848], 50.00th=[ 12518], 60.00th=[ 17433], | 70.00th=[ 22938], 80.00th=[ 29754], 90.00th=[ 41157], 95.00th=[ 52167], | 99.00th=[ 99091], 99.50th=[107480], 99.90th=[122160], 99.95th=[122160], | 99.99th=[122160] bw ( KiB/s): min= 223, max= 761, per=25.43%, avg=414.97, stdev=117.02, samples=30 iops : min= 13, max= 47, avg=25.30, stdev= 7.34, samples=30 lat (usec) : 50=0.52%, 100=3.91%, 250=3.39%, 500=0.26%, 750=0.13% lat (usec) : 1000=0.13% lat (msec) : 2=1.04%, 4=7.68%, 10=15.76%, 20=26.56%, 50=35.55% lat (msec) : 100=4.30%, 250=0.78% cpu : usr=0.15%, sys=18.08%, ctx=2003, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=151474: Tue Sep 8 22:03:11 2026 read: IOPS=25, BW=410KiB/s (420kB/s)(6256KiB/15240msec) clat (usec): min=40, max=116183, avg=21477.03, stdev=15995.94 lat (usec): min=40, max=116183, avg=21477.96, stdev=15995.97 clat percentiles (usec): | 1.00th=[ 49], 5.00th=[ 78], 10.00th=[ 99], 20.00th=[ 330], | 30.00th=[ 14353], 40.00th=[ 17171], 50.00th=[ 20317], 60.00th=[ 24249], | 70.00th=[ 28967], 80.00th=[ 33817], 90.00th=[ 40633], 95.00th=[ 47973], | 99.00th=[ 66323], 99.50th=[ 76022], 99.90th=[115868], 99.95th=[115868], | 99.99th=[115868] bw ( KiB/s): min= 252, max= 860, per=26.62%, avg=412.90, stdev=142.98, samples=30 iops : min= 15, max= 53, avg=25.17, stdev= 8.99, samples=30 write: IOPS=24, BW=396KiB/s (405kB/s)(6032KiB/15240msec); 0 zone resets clat (usec): min=1542, max=102670, avg=18110.82, stdev=16794.80 lat (usec): min=1542, max=102670, avg=18112.63, stdev=16794.82 clat percentiles (msec): | 1.00th=[ 3], 5.00th=[ 3], 10.00th=[ 4], 20.00th=[ 5], | 30.00th=[ 7], 40.00th=[ 9], 50.00th=[ 13], 60.00th=[ 19], | 70.00th=[ 23], 80.00th=[ 30], 90.00th=[ 40], 95.00th=[ 49], | 99.00th=[ 89], 99.50th=[ 100], 99.90th=[ 103], 99.95th=[ 103], | 99.99th=[ 103] bw ( KiB/s): min= 159, max= 576, per=24.00%, avg=391.63, stdev=120.06, samples=30 iops : min= 9, max= 36, avg=23.83, stdev= 7.56, samples=30 lat (usec) : 50=0.65%, 100=4.56%, 250=4.82%, 500=0.52% lat (msec) : 2=0.39%, 4=6.38%, 10=15.23%, 20=23.83%, 50=39.45% lat (msec) : 100=3.91%, 250=0.26% cpu : usr=0.10%, sys=17.76%, ctx=1972, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=151475: Tue Sep 8 22:03:11 2026 read: IOPS=25, BW=402KiB/s (411kB/s)(6032KiB/15020msec) clat (usec): min=39, max=182409, avg=19498.90, stdev=17176.10 lat (usec): min=40, max=182410, avg=19499.74, stdev=17176.11 clat percentiles (usec): | 1.00th=[ 52], 5.00th=[ 62], 10.00th=[ 77], 20.00th=[ 122], | 30.00th=[ 11994], 40.00th=[ 15533], 50.00th=[ 19530], 60.00th=[ 22676], | 70.00th=[ 26608], 80.00th=[ 31065], 90.00th=[ 38011], 95.00th=[ 43779], | 99.00th=[ 66847], 99.50th=[ 88605], 99.90th=[181404], 99.95th=[181404], | 99.99th=[181404] bw ( KiB/s): min= 96, max= 637, per=25.27%, avg=391.93, stdev=129.71, samples=29 iops : min= 6, max= 39, avg=23.83, stdev= 8.19, samples=29 write: IOPS=26, BW=417KiB/s (427kB/s)(6256KiB/15020msec); 0 zone resets clat (usec): min=1710, max=160770, avg=19529.33, stdev=19736.44 lat (usec): min=1711, max=160773, avg=19537.68, stdev=19734.02 clat percentiles (msec): | 1.00th=[ 3], 5.00th=[ 4], 10.00th=[ 4], 20.00th=[ 5], | 30.00th=[ 7], 40.00th=[ 9], 50.00th=[ 13], 60.00th=[ 18], | 70.00th=[ 25], 80.00th=[ 34], 90.00th=[ 45], 95.00th=[ 53], | 99.00th=[ 96], 99.50th=[ 111], 99.90th=[ 161], 99.95th=[ 161], | 99.99th=[ 161] bw ( KiB/s): min= 160, max= 604, per=25.16%, avg=410.66, stdev=110.15, samples=29 iops : min= 10, max= 37, avg=25.00, stdev= 6.87, samples=29 lat (usec) : 50=0.26%, 100=7.42%, 250=4.43%, 500=0.13%, 1000=0.26% lat (msec) : 2=0.26%, 4=5.86%, 10=16.80%, 20=23.31%, 50=36.72% lat (msec) : 100=4.04%, 250=0.52% cpu : usr=0.13%, sys=17.74%, ctx=1943, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1552KiB/s (1589kB/s), 372KiB/s-410KiB/s (381kB/s-420kB/s), io=23.4MiB (24.5MB), run=14739-15435msec WRITE: bw=1633KiB/s (1672kB/s), 396KiB/s-432KiB/s (405kB/s-442kB/s), io=24.6MiB (25.8MB), run=14739-15435msec rand-rw: (groupid=0, jobs=1): err= 0: pid=151467: Tue Sep 8 22:03:29 2026 read: IOPS=11, BW=179KiB/s (183kB/s)(5920KiB/33113msec) clat (msec): min=5, max=187, avg=20.06, stdev=18.60 lat (msec): min=5, max=187, avg=20.06, stdev=18.60 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 7], 10.00th=[ 8], 20.00th=[ 9], | 30.00th=[ 11], 40.00th=[ 12], 50.00th=[ 13], 60.00th=[ 15], | 70.00th=[ 20], 80.00th=[ 28], 90.00th=[ 43], 95.00th=[ 58], | 99.00th=[ 92], 99.50th=[ 94], 99.90th=[ 188], 99.95th=[ 188], | 99.99th=[ 188] bw ( KiB/s): min= 31, max= 416, per=24.22%, avg=175.12, stdev=91.33, samples=65 iops : min= 1, max= 26, avg=10.34, stdev= 5.81, samples=65 write: IOPS=12, BW=192KiB/s (197kB/s)(6368KiB/33113msec); 0 zone resets clat (msec): min=25, max=271, avg=64.28, stdev=27.88 lat (msec): min=25, max=271, avg=64.29, stdev=27.88 clat percentiles (msec): | 1.00th=[ 30], 5.00th=[ 34], 10.00th=[ 39], 20.00th=[ 44], | 30.00th=[ 48], 40.00th=[ 53], 50.00th=[ 59], 60.00th=[ 65], | 70.00th=[ 72], 80.00th=[ 81], 90.00th=[ 100], 95.00th=[ 109], | 99.00th=[ 163], 99.50th=[ 220], 99.90th=[ 271], 99.95th=[ 271], | 99.99th=[ 271] bw ( KiB/s): min= 31, max= 352, per=25.08%, avg=190.89, stdev=77.80, samples=65 iops : min= 1, max= 22, avg=11.32, stdev= 4.92, samples=65 lat (msec) : 10=13.67%, 20=20.57%, 50=28.39%, 100=32.29%, 250=4.95% lat (msec) : 500=0.13% cpu : usr=0.07%, sys=4.12%, ctx=1518, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=151468: Tue Sep 8 22:03:29 2026 read: IOPS=11, BW=176KiB/s (180kB/s)(5744KiB/32619msec) clat (msec): min=5, max=109, avg=18.63, stdev=16.22 lat (msec): min=5, max=109, avg=18.63, stdev=16.22 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 7], 10.00th=[ 8], 20.00th=[ 9], | 30.00th=[ 10], 40.00th=[ 11], 50.00th=[ 13], 60.00th=[ 15], | 70.00th=[ 19], 80.00th=[ 24], 90.00th=[ 38], 95.00th=[ 53], | 99.00th=[ 88], 99.50th=[ 101], 99.90th=[ 110], 99.95th=[ 110], | 99.99th=[ 110] bw ( KiB/s): min= 31, max= 479, per=24.60%, avg=177.86, stdev=105.94, samples=63 iops : min= 1, max= 29, avg=10.52, stdev= 6.73, samples=63 write: IOPS=12, BW=201KiB/s (205kB/s)(6544KiB/32619msec); 0 zone resets clat (msec): min=24, max=203, avg=63.16, stdev=25.67 lat (msec): min=24, max=203, avg=63.16, stdev=25.66 clat percentiles (msec): | 1.00th=[ 30], 5.00th=[ 34], 10.00th=[ 40], 20.00th=[ 44], | 30.00th=[ 48], 40.00th=[ 53], 50.00th=[ 57], 60.00th=[ 62], | 70.00th=[ 69], 80.00th=[ 77], 90.00th=[ 100], 95.00th=[ 118], | 99.00th=[ 146], 99.50th=[ 155], 99.90th=[ 205], 99.95th=[ 205], | 99.99th=[ 205] bw ( KiB/s): min= 63, max= 351, per=26.25%, avg=199.77, stdev=72.55, samples=64 iops : min= 3, max= 21, avg=11.89, stdev= 4.61, samples=64 lat (msec) : 10=14.71%, 20=19.01%, 50=27.86%, 100=32.94%, 250=5.47% cpu : usr=0.09%, sys=4.03%, ctx=1529, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=151469: Tue Sep 8 22:03:29 2026 read: IOPS=12, BW=196KiB/s (200kB/s)(6256KiB/31963msec) clat (msec): min=5, max=121, avg=18.93, stdev=16.33 lat (msec): min=5, max=121, avg=18.93, stdev=16.33 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 7], 10.00th=[ 8], 20.00th=[ 9], | 30.00th=[ 10], 40.00th=[ 12], 50.00th=[ 13], 60.00th=[ 16], | 70.00th=[ 19], 80.00th=[ 26], 90.00th=[ 37], 95.00th=[ 56], | 99.00th=[ 92], 99.50th=[ 106], 99.90th=[ 122], 99.95th=[ 122], | 99.99th=[ 122] bw ( KiB/s): min= 31, max= 509, per=27.24%, avg=196.97, stdev=113.76, samples=63 iops : min= 1, max= 31, avg=11.71, stdev= 7.20, samples=63 write: IOPS=11, BW=189KiB/s (193kB/s)(6032KiB/31963msec); 0 zone resets clat (msec): min=26, max=271, avg=65.02, stdev=29.04 lat (msec): min=26, max=271, avg=65.02, stdev=29.04 clat percentiles (msec): | 1.00th=[ 33], 5.00th=[ 36], 10.00th=[ 40], 20.00th=[ 44], | 30.00th=[ 49], 40.00th=[ 53], 50.00th=[ 58], 60.00th=[ 64], | 70.00th=[ 71], 80.00th=[ 80], 90.00th=[ 96], 95.00th=[ 120], | 99.00th=[ 171], 99.50th=[ 211], 99.90th=[ 271], 99.95th=[ 271], | 99.99th=[ 271] bw ( KiB/s): min= 64, max= 319, per=24.69%, avg=187.89, stdev=67.52, samples=63 iops : min= 4, max= 19, avg=11.14, stdev= 4.31, samples=63 lat (msec) : 10=15.49%, 20=21.74%, 50=26.95%, 100=30.99%, 250=4.69% lat (msec) : 500=0.13% cpu : usr=0.08%, sys=4.10%, ctx=1504, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=151470: Tue Sep 8 22:03:29 2026 read: IOPS=11, BW=183KiB/s (188kB/s)(6032KiB/32924msec) clat (msec): min=4, max=188, avg=18.93, stdev=18.04 lat (msec): min=4, max=188, avg=18.93, stdev=18.04 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 8], 20.00th=[ 9], | 30.00th=[ 11], 40.00th=[ 12], 50.00th=[ 13], 60.00th=[ 15], | 70.00th=[ 18], 80.00th=[ 24], 90.00th=[ 41], 95.00th=[ 57], | 99.00th=[ 83], 99.50th=[ 105], 99.90th=[ 188], 99.95th=[ 188], | 99.99th=[ 188] bw ( KiB/s): min= 31, max= 416, per=25.51%, avg=184.44, stdev=106.62, samples=64 iops : min= 1, max= 26, avg=10.92, stdev= 6.75, samples=64 write: IOPS=11, BW=190KiB/s (195kB/s)(6256KiB/32924msec); 0 zone resets clat (msec): min=25, max=245, avg=65.74, stdev=29.42 lat (msec): min=25, max=245, avg=65.75, stdev=29.43 clat percentiles (msec): | 1.00th=[ 29], 5.00th=[ 35], 10.00th=[ 39], 20.00th=[ 45], | 30.00th=[ 50], 40.00th=[ 54], 50.00th=[ 58], 60.00th=[ 65], | 70.00th=[ 73], 80.00th=[ 84], 90.00th=[ 102], 95.00th=[ 123], | 99.00th=[ 167], 99.50th=[ 232], 99.90th=[ 247], 99.95th=[ 247], | 99.99th=[ 247] bw ( KiB/s): min= 63, max= 352, per=24.90%, avg=189.46, stdev=73.87, samples=65 iops : min= 3, max= 22, avg=11.23, stdev= 4.71, samples=65 lat (msec) : 10=14.58%, 20=22.40%, 50=25.78%, 100=31.64%, 250=5.60% cpu : usr=0.07%, sys=4.10%, ctx=1590, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=723KiB/s (741kB/s), 176KiB/s-196KiB/s (180kB/s-200kB/s), io=23.4MiB (24.5MB), run=31963-33113msec WRITE: bw=761KiB/s (779kB/s), 189KiB/s-201KiB/s (193kB/s-205kB/s), io=24.6MiB (25.8MB), run=31963-33113msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=151484: Tue Sep 8 22:03:37 2026 read: IOPS=2, BW=2873KiB/s (2942kB/s)(7168KiB/2495msec) clat (msec): min=64, max=356, avg=135.15, stdev=103.90 lat (msec): min=64, max=356, avg=135.16, stdev=103.90 clat percentiles (msec): | 1.00th=[ 65], 5.00th=[ 65], 10.00th=[ 65], 20.00th=[ 70], | 30.00th=[ 73], 40.00th=[ 73], 50.00th=[ 97], 60.00th=[ 121], | 70.00th=[ 121], 80.00th=[ 167], 90.00th=[ 355], 95.00th=[ 355], | 99.00th=[ 355], 99.50th=[ 355], 99.90th=[ 355], 99.95th=[ 355], | 99.99th=[ 355] bw ( KiB/s): min= 4023, max= 5475, per=74.09%, avg=4749.00, stdev=1026.72, samples=2 iops : min= 3, max= 5, avg= 4.00, stdev= 1.41, samples=2 write: IOPS=2, BW=2052KiB/s (2101kB/s)(5120KiB/2495msec); 0 zone resets clat (msec): min=166, max=651, avg=298.26, stdev=199.70 lat (msec): min=166, max=651, avg=298.32, stdev=199.69 clat percentiles (msec): | 1.00th=[ 167], 5.00th=[ 167], 10.00th=[ 167], 20.00th=[ 167], | 30.00th=[ 205], 40.00th=[ 205], 50.00th=[ 224], 60.00th=[ 224], | 70.00th=[ 247], 80.00th=[ 247], 90.00th=[ 651], 95.00th=[ 651], | 99.00th=[ 651], 99.50th=[ 651], 99.90th=[ 651], 99.95th=[ 651], | 99.99th=[ 651] bw ( KiB/s): min= 1825, max= 4055, per=29.45%, avg=2642.67, stdev=1228.19, samples=3 iops : min= 1, max= 3, avg= 2.00, stdev= 1.00, samples=3 lat (msec) : 100=33.33%, 250=50.00%, 500=8.33%, 750=8.33% cpu : usr=0.00%, sys=12.55%, ctx=95, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=151485: Tue Sep 8 22:03:37 2026 read: IOPS=0, BW=659KiB/s (675kB/s)(2048KiB/3107msec) clat (msec): min=48, max=162, avg=105.86, stdev=80.66 lat (msec): min=48, max=162, avg=105.86, stdev=80.66 clat percentiles (msec): | 1.00th=[ 50], 5.00th=[ 50], 10.00th=[ 50], 20.00th=[ 50], | 30.00th=[ 50], 40.00th=[ 50], 50.00th=[ 50], 60.00th=[ 163], | 70.00th=[ 163], 80.00th=[ 163], 90.00th=[ 163], 95.00th=[ 163], | 99.00th=[ 163], 99.50th=[ 163], 99.90th=[ 163], 99.95th=[ 163], | 99.99th=[ 163] bw ( KiB/s): min= 1815, max= 2027, per=29.97%, avg=1921.00, stdev=149.91, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=3, BW=3296KiB/s (3375kB/s)(10.0MiB/3107msec); 0 zone resets clat (msec): min=110, max=725, avg=288.23, stdev=184.04 lat (msec): min=110, max=726, avg=288.32, stdev=184.06 clat percentiles (msec): | 1.00th=[ 110], 5.00th=[ 110], 10.00th=[ 110], 20.00th=[ 122], | 30.00th=[ 171], 40.00th=[ 192], 50.00th=[ 207], 60.00th=[ 268], | 70.00th=[ 305], 80.00th=[ 363], 90.00th=[ 422], 95.00th=[ 726], | 99.00th=[ 726], 99.50th=[ 726], 99.90th=[ 726], 99.95th=[ 726], | 99.99th=[ 726] bw ( KiB/s): min= 1815, max= 6131, per=33.64%, avg=3018.50, stdev=1747.59, samples=6 iops : min= 1, max= 5, avg= 2.17, stdev= 1.83, samples=6 lat (msec) : 50=8.33%, 250=50.00%, 500=33.33%, 750=8.33% cpu : usr=0.00%, sys=15.52%, ctx=188, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=151486: Tue Sep 8 22:03:37 2026 read: IOPS=1, BW=2041KiB/s (2090kB/s)(6144KiB/3010msec) clat (msec): min=65, max=508, avg=189.71, stdev=161.71 lat (msec): min=65, max=508, avg=189.71, stdev=161.71 clat percentiles (msec): | 1.00th=[ 66], 5.00th=[ 66], 10.00th=[ 66], 20.00th=[ 104], | 30.00th=[ 104], 40.00th=[ 115], 50.00th=[ 115], 60.00th=[ 167], | 70.00th=[ 180], 80.00th=[ 180], 90.00th=[ 510], 95.00th=[ 510], | 99.00th=[ 510], 99.50th=[ 510], 99.90th=[ 510], 99.95th=[ 510], | 99.99th=[ 510] bw ( KiB/s): min= 2011, max= 4055, per=42.19%, avg=2704.67, stdev=1169.57, samples=3 iops : min= 1, max= 3, avg= 2.00, stdev= 1.00, samples=3 write: IOPS=1, BW=2041KiB/s (2090kB/s)(6144KiB/3010msec); 0 zone resets clat (msec): min=108, max=532, avg=305.10, stdev=146.35 lat (msec): min=109, max=532, avg=305.22, stdev=146.33 clat percentiles (msec): | 1.00th=[ 109], 5.00th=[ 109], 10.00th=[ 109], 20.00th=[ 230], | 30.00th=[ 230], 40.00th=[ 239], 50.00th=[ 239], 60.00th=[ 342], | 70.00th=[ 380], 80.00th=[ 380], 90.00th=[ 531], 95.00th=[ 531], | 99.00th=[ 531], 99.50th=[ 531], 99.90th=[ 531], 99.95th=[ 531], | 99.99th=[ 531] bw ( KiB/s): min= 2011, max= 3605, per=28.47%, avg=2554.67, stdev=909.80, samples=3 iops : min= 1, max= 3, avg= 2.00, stdev= 1.00, samples=3 lat (msec) : 100=8.33%, 250=58.33%, 500=16.67%, 750=16.67% cpu : usr=0.00%, sys=12.46%, ctx=133, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=151487: Tue Sep 8 22:03:37 2026 read: IOPS=1, BW=1603KiB/s (1641kB/s)(5120KiB/3195msec) clat (msec): min=46, max=755, avg=277.53, stdev=281.62 lat (msec): min=46, max=755, avg=277.53, stdev=281.62 clat percentiles (msec): | 1.00th=[ 46], 5.00th=[ 46], 10.00th=[ 46], 20.00th=[ 46], | 30.00th=[ 116], 40.00th=[ 116], 50.00th=[ 184], 60.00th=[ 184], | 70.00th=[ 288], 80.00th=[ 288], 90.00th=[ 760], 95.00th=[ 760], | 99.00th=[ 760], 99.50th=[ 760], 99.90th=[ 760], 99.95th=[ 760], | 99.99th=[ 760] bw ( KiB/s): min= 4063, max= 4096, per=63.64%, avg=4079.50, stdev=23.33, samples=2 iops : min= 3, max= 4, avg= 3.50, stdev= 0.71, samples=2 write: IOPS=2, BW=2244KiB/s (2297kB/s)(7168KiB/3195msec); 0 zone resets clat (msec): min=101, max=552, avg=251.19, stdev=169.16 lat (msec): min=101, max=552, avg=251.26, stdev=169.17 clat percentiles (msec): | 1.00th=[ 102], 5.00th=[ 102], 10.00th=[ 102], 20.00th=[ 123], | 30.00th=[ 138], 40.00th=[ 138], 50.00th=[ 194], 60.00th=[ 239], | 70.00th=[ 239], 80.00th=[ 414], 90.00th=[ 550], 95.00th=[ 550], | 99.00th=[ 550], 99.50th=[ 550], 99.90th=[ 550], 99.95th=[ 550], | 99.99th=[ 550] bw ( KiB/s): min= 3618, max= 4087, per=43.56%, avg=3909.33, stdev=254.32, samples=3 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=3 lat (msec) : 50=8.33%, 250=58.33%, 500=16.67%, 750=8.33%, 1000=8.33% cpu : usr=0.00%, sys=10.05%, ctx=175, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=6410KiB/s (6564kB/s), 659KiB/s-2873KiB/s (675kB/s-2942kB/s), io=20.0MiB (20.0MB), run=2495-3195msec WRITE: bw=8974KiB/s (9189kB/s), 2041KiB/s-3296KiB/s (2090kB/s-3375kB/s), io=28.0MiB (29.4MB), run=2495-3195msec rand-rw: (groupid=0, jobs=1): err= 0: pid=151489: Tue Sep 8 22:03:38 2026 read: IOPS=2, BW=2860KiB/s (2929kB/s)(7168KiB/2506msec) clat (usec): min=625, max=285184, avg=139658.71, stdev=102312.97 lat (usec): min=626, max=285185, avg=139659.91, stdev=102313.12 clat percentiles (usec): | 1.00th=[ 627], 5.00th=[ 627], 10.00th=[ 627], 20.00th=[ 17957], | 30.00th=[127402], 40.00th=[127402], 50.00th=[152044], 60.00th=[183501], | 70.00th=[183501], 80.00th=[212861], 90.00th=[283116], 95.00th=[283116], | 99.00th=[283116], 99.50th=[283116], 99.90th=[283116], 99.95th=[283116], | 99.99th=[283116] bw ( KiB/s): min= 2019, max= 4096, per=48.90%, avg=3253.00, stdev=1092.31, samples=3 iops : min= 1, max= 4, avg= 2.67, stdev= 1.53, samples=3 write: IOPS=1, BW=2043KiB/s (2092kB/s)(5120KiB/2506msec); 0 zone resets clat (msec): min=158, max=496, avg=280.44, stdev=146.06 lat (msec): min=158, max=496, avg=280.53, stdev=146.05 clat percentiles (msec): | 1.00th=[ 159], 5.00th=[ 159], 10.00th=[ 159], 20.00th=[ 159], | 30.00th=[ 188], 40.00th=[ 188], 50.00th=[ 194], 60.00th=[ 194], | 70.00th=[ 368], 80.00th=[ 368], 90.00th=[ 498], 95.00th=[ 498], | 99.00th=[ 498], 99.50th=[ 498], 99.90th=[ 498], 99.95th=[ 498], | 99.99th=[ 498] bw ( KiB/s): min= 2048, max= 4055, per=32.76%, avg=3051.50, stdev=1419.16, samples=2 iops : min= 2, max= 3, avg= 2.50, stdev= 0.71, samples=2 lat (usec) : 750=8.33% lat (msec) : 20=8.33%, 250=58.33%, 500=25.00% cpu : usr=0.04%, sys=34.77%, ctx=318, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=151490: Tue Sep 8 22:03:38 2026 read: IOPS=0, BW=665KiB/s (681kB/s)(2048KiB/3078msec) clat (msec): min=21, max=128, avg=75.04, stdev=75.02 lat (msec): min=21, max=128, avg=75.04, stdev=75.02 clat percentiles (msec): | 1.00th=[ 22], 5.00th=[ 22], 10.00th=[ 22], 20.00th=[ 22], | 30.00th=[ 22], 40.00th=[ 22], 50.00th=[ 22], 60.00th=[ 129], | 70.00th=[ 129], 80.00th=[ 129], 90.00th=[ 129], 95.00th=[ 129], | 99.00th=[ 129], 99.50th=[ 129], 99.90th=[ 129], 99.95th=[ 129], | 99.99th=[ 129] bw ( KiB/s): min= 1822, max= 2027, per=28.93%, avg=1924.50, stdev=144.96, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=3, BW=3327KiB/s (3407kB/s)(10.0MiB/3078msec); 0 zone resets clat (msec): min=119, max=465, avg=286.07, stdev=128.55 lat (msec): min=119, max=465, avg=286.19, stdev=128.51 clat percentiles (msec): | 1.00th=[ 120], 5.00th=[ 120], 10.00th=[ 120], 20.00th=[ 140], | 30.00th=[ 180], 40.00th=[ 205], 50.00th=[ 236], 60.00th=[ 296], | 70.00th=[ 384], 80.00th=[ 388], 90.00th=[ 451], 95.00th=[ 464], | 99.00th=[ 464], 99.50th=[ 464], 99.90th=[ 464], 99.95th=[ 464], | 99.99th=[ 464] bw ( KiB/s): min= 2027, max= 4096, per=32.76%, avg=3051.25, stdev=1173.71, samples=4 iops : min= 1, max= 4, avg= 2.25, stdev= 1.50, samples=4 lat (msec) : 50=8.33%, 250=50.00%, 500=41.67% cpu : usr=0.00%, sys=34.16%, ctx=412, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=151491: Tue Sep 8 22:03:38 2026 read: IOPS=2, BW=2691KiB/s (2756kB/s)(6144KiB/2283msec) clat (usec): min=499, max=215456, avg=89249.38, stdev=100946.38 lat (usec): min=501, max=215458, avg=89250.61, stdev=100946.30 clat percentiles (usec): | 1.00th=[ 498], 5.00th=[ 498], 10.00th=[ 498], 20.00th=[ 644], | 30.00th=[ 644], 40.00th=[ 28181], 50.00th=[ 28181], 60.00th=[ 77071], | 70.00th=[212861], 80.00th=[212861], 90.00th=[214959], 95.00th=[214959], | 99.00th=[214959], 99.50th=[214959], 99.90th=[214959], 99.95th=[214959], | 99.99th=[214959] bw ( KiB/s): min= 2027, max= 6059, per=60.77%, avg=4043.00, stdev=2851.05, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 write: IOPS=2, BW=2691KiB/s (2756kB/s)(6144KiB/2283msec); 0 zone resets clat (msec): min=153, max=524, avg=279.19, stdev=142.84 lat (msec): min=153, max=524, avg=279.28, stdev=142.81 clat percentiles (msec): | 1.00th=[ 155], 5.00th=[ 155], 10.00th=[ 155], 20.00th=[ 155], | 30.00th=[ 155], 40.00th=[ 220], 50.00th=[ 220], 60.00th=[ 266], | 70.00th=[ 359], 80.00th=[ 359], 90.00th=[ 527], 95.00th=[ 527], | 99.00th=[ 527], 99.50th=[ 527], 99.90th=[ 527], 99.95th=[ 527], | 99.99th=[ 527] bw ( KiB/s): min= 1858, max= 4039, per=26.76%, avg=2493.00, stdev=1034.17, samples=4 iops : min= 1, max= 3, avg= 1.75, stdev= 0.96, samples=4 lat (usec) : 500=8.33%, 750=8.33% lat (msec) : 50=8.33%, 100=8.33%, 250=41.67%, 500=16.67%, 750=8.33% cpu : usr=0.00%, sys=37.23%, ctx=411, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=151492: Tue Sep 8 22:03:38 2026 read: IOPS=2, BW=2122KiB/s (2173kB/s)(5120KiB/2413msec) clat (usec): min=430, max=202649, avg=48011.43, stdev=87766.27 lat (usec): min=431, max=202651, avg=48012.53, stdev=87766.43 clat percentiles (usec): | 1.00th=[ 433], 5.00th=[ 433], 10.00th=[ 433], 20.00th=[ 433], | 30.00th=[ 594], 40.00th=[ 594], 50.00th=[ 758], 60.00th=[ 758], | 70.00th=[ 35390], 80.00th=[ 35390], 90.00th=[202376], 95.00th=[202376], | 99.00th=[202376], 99.50th=[202376], 99.90th=[202376], 99.95th=[202376], | 99.99th=[202376] bw ( KiB/s): min= 8110, max= 8110, per=100.00%, avg=8110.00, stdev= 0.00, samples=1 iops : min= 7, max= 7, avg= 7.00, stdev= 0.00, samples=1 write: IOPS=2, BW=2971KiB/s (3042kB/s)(7168KiB/2413msec); 0 zone resets clat (msec): min=122, max=490, avg=307.26, stdev=165.88 lat (msec): min=122, max=491, avg=307.32, stdev=165.88 clat percentiles (msec): | 1.00th=[ 123], 5.00th=[ 123], 10.00th=[ 123], 20.00th=[ 126], | 30.00th=[ 165], 40.00th=[ 165], 50.00th=[ 347], 60.00th=[ 430], | 70.00th=[ 430], 80.00th=[ 472], 90.00th=[ 493], 95.00th=[ 493], | 99.00th=[ 493], 99.50th=[ 493], 99.90th=[ 493], 99.95th=[ 493], | 99.99th=[ 493] bw ( KiB/s): min= 1812, max= 4096, per=28.37%, avg=2642.33, stdev=1263.16, samples=3 iops : min= 1, max= 4, avg= 2.00, stdev= 1.73, samples=3 lat (usec) : 500=8.33%, 750=8.33%, 1000=8.33% lat (msec) : 50=8.33%, 250=33.33%, 500=33.33% cpu : usr=0.00%, sys=32.75%, ctx=231, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=6654KiB/s (6813kB/s), 665KiB/s-2860KiB/s (681kB/s-2929kB/s), io=20.0MiB (20.0MB), run=2283-3078msec WRITE: bw=9315KiB/s (9539kB/s), 2043KiB/s-3327KiB/s (2092kB/s-3407kB/s), io=28.0MiB (29.4MB), run=2283-3078msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=151499: Tue Sep 8 22:03:46 2026 read: IOPS=1, BW=7062KiB/s (7232kB/s)(12.0MiB/1740msec) clat (msec): min=135, max=841, avg=538.92, stdev=363.80 lat (msec): min=135, max=841, avg=538.92, stdev=363.80 clat percentiles (msec): | 1.00th=[ 136], 5.00th=[ 136], 10.00th=[ 136], 20.00th=[ 136], | 30.00th=[ 136], 40.00th=[ 642], 50.00th=[ 642], 60.00th=[ 642], | 70.00th=[ 844], 80.00th=[ 844], 90.00th=[ 844], 95.00th=[ 844], | 99.00th=[ 844], 99.50th=[ 844], 99.90th=[ 844], 99.95th=[ 844], | 99.99th=[ 844] bw ( KiB/s): min= 8159, max= 8159, per=88.55%, avg=8159.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 750=33.33%, 1000=33.33% cpu : usr=0.00%, sys=14.03%, ctx=66, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=151500: Tue Sep 8 22:03:46 2026 read: IOPS=0, BW=2304KiB/s (2359kB/s)(4096KiB/1778msec) clat (nsec): min=484712k, max=484712k, avg=484712332.00, stdev= 0.00 lat (nsec): min=484714k, max=484714k, avg=484713884.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 485], 5.00th=[ 485], 10.00th=[ 485], 20.00th=[ 485], | 30.00th=[ 485], 40.00th=[ 485], 50.00th=[ 485], 60.00th=[ 485], | 70.00th=[ 485], 80.00th=[ 485], 90.00th=[ 485], 95.00th=[ 485], | 99.00th=[ 485], 99.50th=[ 485], 99.90th=[ 485], 99.95th=[ 485], | 99.99th=[ 485] bw ( KiB/s): min= 5744, max= 5744, per=62.34%, avg=5744.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=1, BW=4607KiB/s (4718kB/s)(8192KiB/1778msec); 0 zone resets clat (msec): min=450, max=723, avg=587.01, stdev=192.79 lat (msec): min=450, max=723, avg=587.33, stdev=192.80 clat percentiles (msec): | 1.00th=[ 451], 5.00th=[ 451], 10.00th=[ 451], 20.00th=[ 451], | 30.00th=[ 451], 40.00th=[ 451], 50.00th=[ 451], 60.00th=[ 726], | 70.00th=[ 726], 80.00th=[ 726], 90.00th=[ 726], 95.00th=[ 726], | 99.00th=[ 726], 99.50th=[ 726], 99.90th=[ 726], 99.95th=[ 726], | 99.99th=[ 726] bw ( KiB/s): min= 8159, max= 8159, per=54.56%, avg=8159.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=66.67%, 750=33.33% cpu : usr=0.06%, sys=15.19%, ctx=76, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=151501: Tue Sep 8 22:03:46 2026 write: IOPS=1, BW=5608KiB/s (5743kB/s)(12.0MiB/2191msec); 0 zone resets clat (msec): min=115, max=1586, avg=688.77, stdev=787.27 lat (msec): min=117, max=1586, avg=689.42, stdev=787.01 clat percentiles (msec): | 1.00th=[ 116], 5.00th=[ 116], 10.00th=[ 116], 20.00th=[ 116], | 30.00th=[ 116], 40.00th=[ 363], 50.00th=[ 363], 60.00th=[ 363], | 70.00th=[ 1586], 80.00th=[ 1586], 90.00th=[ 1586], 95.00th=[ 1586], | 99.00th=[ 1586], 99.50th=[ 1586], 99.90th=[ 1586], 99.95th=[ 1586], | 99.99th=[ 1586] bw ( KiB/s): min= 7656, max= 7656, per=51.19%, avg=7656.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 500=33.33%, 2000=33.33% cpu : usr=0.00%, sys=12.60%, ctx=50, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=151502: Tue Sep 8 22:03:46 2026 write: IOPS=1, BW=7964KiB/s (8155kB/s)(12.0MiB/1543msec); 0 zone resets clat (msec): min=137, max=975, avg=480.09, stdev=439.59 lat (msec): min=138, max=976, avg=480.46, stdev=439.67 clat percentiles (msec): | 1.00th=[ 138], 5.00th=[ 138], 10.00th=[ 138], 20.00th=[ 138], | 30.00th=[ 138], 40.00th=[ 326], 50.00th=[ 326], 60.00th=[ 326], | 70.00th=[ 978], 80.00th=[ 978], 90.00th=[ 978], 95.00th=[ 978], | 99.00th=[ 978], 99.50th=[ 978], 99.90th=[ 978], 99.95th=[ 978], | 99.99th=[ 978] bw ( KiB/s): min=11603, max=11603, per=77.59%, avg=11603.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 500=33.33%, 1000=33.33% cpu : usr=0.00%, sys=16.86%, ctx=65, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=9215KiB/s (9436kB/s), 2304KiB/s-7062KiB/s (2359kB/s-7232kB/s), io=16.0MiB (16.8MB), run=1740-1778msec WRITE: bw=14.6MiB/s (15.3MB/s), 4607KiB/s-7964KiB/s (4718kB/s-8155kB/s), io=32.0MiB (33.6MB), run=1543-2191msec rand-rw: (groupid=0, jobs=1): err= 0: pid=151503: Tue Sep 8 22:03:46 2026 read: IOPS=2, BW=8727KiB/s (8937kB/s)(12.0MiB/1408msec) clat (msec): min=410, max=527, avg=460.50, stdev=60.49 lat (msec): min=410, max=527, avg=460.50, stdev=60.49 clat percentiles (msec): | 1.00th=[ 409], 5.00th=[ 409], 10.00th=[ 409], 20.00th=[ 409], | 30.00th=[ 409], 40.00th=[ 443], 50.00th=[ 443], 60.00th=[ 443], | 70.00th=[ 527], 80.00th=[ 527], 90.00th=[ 527], 95.00th=[ 527], | 99.00th=[ 527], 99.50th=[ 527], 99.90th=[ 527], 99.95th=[ 527], | 99.99th=[ 527] bw ( KiB/s): min= 6370, max= 7699, per=60.45%, avg=7034.50, stdev=939.74, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=66.67%, 750=33.33% cpu : usr=0.00%, sys=43.00%, ctx=1377, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=151504: Tue Sep 8 22:03:46 2026 read: IOPS=0, BW=3005KiB/s (3077kB/s)(4096KiB/1363msec) clat (nsec): min=443841k, max=443841k, avg=443841079.00, stdev= 0.00 lat (nsec): min=443844k, max=443844k, avg=443843779.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 443], 5.00th=[ 443], 10.00th=[ 443], 20.00th=[ 443], | 30.00th=[ 443], 40.00th=[ 443], 50.00th=[ 443], 60.00th=[ 443], | 70.00th=[ 443], 80.00th=[ 443], 90.00th=[ 443], 95.00th=[ 443], | 99.00th=[ 443], 99.50th=[ 443], 99.90th=[ 443], 99.95th=[ 443], | 99.99th=[ 443] bw ( KiB/s): min= 5962, max= 5962, per=51.24%, avg=5962.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=1, BW=6010KiB/s (6155kB/s)(8192KiB/1363msec); 0 zone resets clat (msec): min=293, max=588, avg=441.21, stdev=208.93 lat (msec): min=293, max=589, avg=441.52, stdev=208.98 clat percentiles (msec): | 1.00th=[ 292], 5.00th=[ 292], 10.00th=[ 292], 20.00th=[ 292], | 30.00th=[ 292], 40.00th=[ 292], 50.00th=[ 292], 60.00th=[ 592], | 70.00th=[ 592], 80.00th=[ 592], 90.00th=[ 592], 95.00th=[ 592], | 99.00th=[ 592], 99.50th=[ 592], 99.90th=[ 592], 99.95th=[ 592], | 99.99th=[ 592] bw ( KiB/s): min= 7699, max= 7699, per=46.52%, avg=7699.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=66.67%, 750=33.33% cpu : usr=0.00%, sys=27.83%, ctx=800, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=151505: Tue Sep 8 22:03:46 2026 write: IOPS=1, BW=6206KiB/s (6355kB/s)(12.0MiB/1980msec); 0 zone resets clat (msec): min=187, max=1238, avg=653.09, stdev=536.08 lat (msec): min=187, max=1239, avg=653.31, stdev=536.16 clat percentiles (msec): | 1.00th=[ 188], 5.00th=[ 188], 10.00th=[ 188], 20.00th=[ 188], | 30.00th=[ 188], 40.00th=[ 535], 50.00th=[ 535], 60.00th=[ 535], | 70.00th=[ 1234], 80.00th=[ 1234], 90.00th=[ 1234], 95.00th=[ 1234], | 99.00th=[ 1234], 99.50th=[ 1234], 99.90th=[ 1234], 99.95th=[ 1234], | 99.99th=[ 1234] bw ( KiB/s): min= 8192, max= 8192, per=49.50%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.05%, sys=13.54%, ctx=59, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=151506: Tue Sep 8 22:03:46 2026 write: IOPS=1, BW=7038KiB/s (7207kB/s)(12.0MiB/1746msec); 0 zone resets clat (msec): min=391, max=668, avg=572.83, stdev=157.02 lat (msec): min=391, max=668, avg=573.11, stdev=157.03 clat percentiles (msec): | 1.00th=[ 393], 5.00th=[ 393], 10.00th=[ 393], 20.00th=[ 393], | 30.00th=[ 393], 40.00th=[ 659], 50.00th=[ 659], 60.00th=[ 659], | 70.00th=[ 667], 80.00th=[ 667], 90.00th=[ 667], 95.00th=[ 667], | 99.00th=[ 667], 99.50th=[ 667], 99.90th=[ 667], 99.95th=[ 667], | 99.99th=[ 667] bw ( KiB/s): min= 6501, max= 7699, per=42.90%, avg=7100.00, stdev=847.11, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 750=66.67% cpu : usr=0.06%, sys=17.99%, ctx=124, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=11.4MiB/s (11.9MB/s), 3005KiB/s-8727KiB/s (3077kB/s-8937kB/s), io=16.0MiB (16.8MB), run=1363-1408msec WRITE: bw=16.2MiB/s (16.9MB/s), 6010KiB/s-7038KiB/s (6155kB/s-7207kB/s), io=32.0MiB (33.6MB), run=1363-1980msec