== sanity test 398b: DIO and buffer IO race ============== 10:21:52 (1782483712) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 2.89329 s, 17.4 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=146401: Fri Jun 26 10:22:59 2026 read: IOPS=26, BW=105KiB/s (107kB/s)(5992KiB/57118msec) clat (usec): min=34, max=707715, avg=19440.67, stdev=22253.62 lat (usec): min=34, max=707718, avg=19445.59, stdev=22253.54 clat percentiles (usec): | 1.00th=[ 53], 5.00th=[ 98], 10.00th=[ 7308], 20.00th=[ 10421], | 30.00th=[ 12387], 40.00th=[ 14353], 50.00th=[ 16450], 60.00th=[ 19530], | 70.00th=[ 23200], 80.00th=[ 27395], 90.00th=[ 32900], 95.00th=[ 39584], | 99.00th=[ 56886], 99.50th=[ 72877], 99.90th=[219153], 99.95th=[708838], | 99.99th=[708838] bw ( KiB/s): min= 13, max= 175, per=25.39%, avg=104.59, stdev=30.00, samples=113 iops : min= 3, max= 43, avg=25.71, stdev= 7.47, samples=113 write: IOPS=27, BW=110KiB/s (113kB/s)(6296KiB/57118msec); 0 zone resets clat (usec): min=773, max=138399, avg=17675.61, stdev=15878.27 lat (usec): min=774, max=138401, avg=17677.10, stdev=15878.24 clat percentiles (usec): | 1.00th=[ 1090], 5.00th=[ 1631], 10.00th=[ 2212], 20.00th=[ 3130], | 30.00th=[ 5276], 40.00th=[ 10028], 50.00th=[ 14091], 60.00th=[ 18744], | 70.00th=[ 22676], 80.00th=[ 28705], 90.00th=[ 39584], 95.00th=[ 48497], | 99.00th=[ 69731], 99.50th=[ 78119], 99.90th=[ 94897], 99.95th=[137364], | 99.99th=[137364] bw ( KiB/s): min= 48, max= 207, per=25.78%, avg=111.11, stdev=34.07, samples=112 iops : min= 12, max= 51, avg=27.34, stdev= 8.51, samples=112 lat (usec) : 50=0.42%, 100=2.08%, 250=0.94%, 500=0.10%, 750=0.07% lat (usec) : 1000=0.23% lat (msec) : 2=4.04%, 4=8.72%, 10=12.83%, 20=32.62%, 50=34.70% lat (msec) : 100=3.09%, 250=0.13%, 750=0.03% cpu : usr=0.10%, sys=15.88%, ctx=7763, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146402: Fri Jun 26 10:22:59 2026 read: IOPS=26, BW=104KiB/s (107kB/s)(5940KiB/57072msec) clat (usec): min=33, max=221921, avg=19334.43, stdev=14605.52 lat (usec): min=34, max=221921, avg=19335.52, stdev=14605.51 clat percentiles (usec): | 1.00th=[ 51], 5.00th=[ 102], 10.00th=[ 7308], 20.00th=[ 10421], | 30.00th=[ 12125], 40.00th=[ 14353], 50.00th=[ 16712], 60.00th=[ 19268], | 70.00th=[ 22414], 80.00th=[ 26870], 90.00th=[ 34866], 95.00th=[ 42206], | 99.00th=[ 61604], 99.50th=[ 69731], 99.90th=[206570], 99.95th=[221250], | 99.99th=[221250] bw ( KiB/s): min= 6, max= 176, per=25.18%, avg=103.74, stdev=31.31, samples=113 iops : min= 1, max= 44, avg=25.50, stdev= 7.87, samples=113 write: IOPS=27, BW=111KiB/s (114kB/s)(6348KiB/57072msec); 0 zone resets clat (usec): min=702, max=650478, avg=17777.75, stdev=22721.69 lat (usec): min=704, max=650480, avg=17780.76, stdev=22721.23 clat percentiles (usec): | 1.00th=[ 1057], 5.00th=[ 1516], 10.00th=[ 2180], 20.00th=[ 3261], | 30.00th=[ 5014], 40.00th=[ 9896], 50.00th=[ 13960], 60.00th=[ 17695], | 70.00th=[ 22152], 80.00th=[ 28443], 90.00th=[ 38536], 95.00th=[ 46924], | 99.00th=[ 73925], 99.50th=[ 88605], 99.90th=[164627], 99.95th=[650118], | 99.99th=[650118] bw ( KiB/s): min= 6, max= 200, per=25.67%, avg=110.63, stdev=36.90, samples=113 iops : min= 1, max= 50, avg=27.21, stdev= 9.21, samples=113 lat (usec) : 50=0.46%, 100=1.95%, 250=0.75%, 500=0.10%, 750=0.07% lat (usec) : 1000=0.33% lat (msec) : 2=3.94%, 4=8.40%, 10=13.41%, 20=34.54%, 50=32.88% lat (msec) : 100=2.93%, 250=0.23%, 750=0.03% cpu : usr=0.11%, sys=15.74%, ctx=7677, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146403: Fri Jun 26 10:22:59 2026 read: IOPS=25, BW=104KiB/s (106kB/s)(6028KiB/58215msec) clat (usec): min=27, max=675761, avg=19076.01, stdev=21861.82 lat (usec): min=27, max=675761, avg=19077.16, stdev=21861.78 clat percentiles (usec): | 1.00th=[ 49], 5.00th=[ 97], 10.00th=[ 7373], 20.00th=[ 9765], | 30.00th=[ 11731], 40.00th=[ 13435], 50.00th=[ 15664], 60.00th=[ 18744], | 70.00th=[ 21890], 80.00th=[ 26084], 90.00th=[ 33424], 95.00th=[ 40633], | 99.00th=[ 58983], 99.50th=[ 72877], 99.90th=[227541], 99.95th=[675283], | 99.99th=[675283] bw ( KiB/s): min= 31, max= 191, per=25.03%, avg=103.12, stdev=32.19, samples=114 iops : min= 7, max= 47, avg=25.33, stdev= 8.07, samples=114 write: IOPS=26, BW=108KiB/s (110kB/s)(6260KiB/58215msec); 0 zone resets clat (usec): min=667, max=138587, avg=18730.79, stdev=17242.81 lat (usec): min=668, max=138588, avg=18732.27, stdev=17243.00 clat percentiles (usec): | 1.00th=[ 1020], 5.00th=[ 1467], 10.00th=[ 2147], 20.00th=[ 3326], | 30.00th=[ 5669], 40.00th=[ 10683], 50.00th=[ 15270], 60.00th=[ 19792], | 70.00th=[ 24511], 80.00th=[ 30540], 90.00th=[ 40633], 95.00th=[ 50070], | 99.00th=[ 77071], 99.50th=[ 99091], 99.90th=[127402], 99.95th=[139461], | 99.99th=[139461] bw ( KiB/s): min= 16, max= 263, per=24.60%, avg=106.02, stdev=32.38, samples=115 iops : min= 4, max= 65, avg=26.06, stdev= 8.08, samples=115 lat (usec) : 50=0.59%, 100=1.99%, 250=0.65%, 500=0.03%, 750=0.10% lat (usec) : 1000=0.36% lat (msec) : 2=4.13%, 4=7.85%, 10=14.26%, 20=32.29%, 50=33.98% lat (msec) : 100=3.45%, 250=0.29%, 750=0.03% cpu : usr=0.07%, sys=15.45%, ctx=7751, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146404: Fri Jun 26 10:22:59 2026 read: IOPS=26, BW=105KiB/s (108kB/s)(6052KiB/57384msec) clat (usec): min=31, max=124706, avg=18405.05, stdev=12530.50 lat (usec): min=32, max=124707, avg=18406.15, stdev=12530.55 clat percentiles (usec): | 1.00th=[ 46], 5.00th=[ 85], 10.00th=[ 6521], 20.00th=[ 9896], | 30.00th=[ 11994], 40.00th=[ 14091], 50.00th=[ 16319], 60.00th=[ 18744], | 70.00th=[ 22152], 80.00th=[ 26084], 90.00th=[ 32900], 95.00th=[ 38536], | 99.00th=[ 59507], 99.50th=[ 79168], 99.90th=[123208], 99.95th=[124257], | 99.99th=[124257] bw ( KiB/s): min= 48, max= 208, per=25.98%, avg=107.05, stdev=30.71, samples=112 iops : min= 12, max= 52, avg=26.32, stdev= 7.68, samples=112 write: IOPS=27, BW=109KiB/s (111kB/s)(6236KiB/57384msec); 0 zone resets clat (usec): min=659, max=743966, avg=18838.39, stdev=25363.26 lat (usec): min=659, max=743968, avg=18839.77, stdev=25363.33 clat percentiles (usec): | 1.00th=[ 1106], 5.00th=[ 1483], 10.00th=[ 2114], 20.00th=[ 3294], | 30.00th=[ 5342], 40.00th=[ 10159], 50.00th=[ 13698], 60.00th=[ 17957], | 70.00th=[ 23725], 80.00th=[ 30540], 90.00th=[ 41157], 95.00th=[ 52167], | 99.00th=[ 81265], 99.50th=[ 86508], 99.90th=[185598], 99.95th=[742392], | 99.99th=[742392] bw ( KiB/s): min= 23, max= 183, per=25.28%, avg=108.97, stdev=30.90, samples=113 iops : min= 5, max= 45, avg=26.80, stdev= 7.74, samples=113 lat (usec) : 50=0.75%, 100=2.12%, 250=0.91%, 500=0.03%, 750=0.10% lat (usec) : 1000=0.29% lat (msec) : 2=4.30%, 4=7.68%, 10=14.06%, 20=33.40%, 50=32.62% lat (msec) : 100=3.48%, 250=0.23%, 750=0.03% cpu : usr=0.13%, sys=15.70%, ctx=7748, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=412KiB/s (422kB/s), 104KiB/s-105KiB/s (106kB/s-108kB/s), io=23.4MiB (24.6MB), run=57072-58215msec WRITE: bw=432KiB/s (442kB/s), 108KiB/s-111KiB/s (110kB/s-114kB/s), io=24.6MiB (25.7MB), run=57072-58215msec fio: pid=146397, err=5/file:backend.c:481, func=full resid, error=Input/output error rand-rw: (groupid=0, jobs=1): err= 0: pid=146396: Fri Jun 26 10:23:41 2026 read: IOPS=14, BW=59.8KiB/s (61.2kB/s)(5992KiB/100180msec) clat (msec): min=3, max=714, avg=16.22, stdev=24.26 lat (msec): min=3, max=714, avg=16.23, stdev=24.26 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 5], 10.00th=[ 6], 20.00th=[ 7], | 30.00th=[ 8], 40.00th=[ 9], 50.00th=[ 11], 60.00th=[ 13], | 70.00th=[ 16], 80.00th=[ 22], 90.00th=[ 35], 95.00th=[ 47], | 99.00th=[ 83], 99.50th=[ 102], 99.90th=[ 194], 99.95th=[ 718], | 99.99th=[ 718] bw ( KiB/s): min= 7, max= 200, per=27.33%, avg=59.85, stdev=36.48, samples=197 iops : min= 1, max= 50, avg=14.57, stdev= 9.22, samples=197 write: IOPS=15, BW=62.8KiB/s (64.4kB/s)(6296KiB/100180msec); 0 zone resets clat (msec): min=12, max=230, avg=48.04, stdev=26.73 lat (msec): min=12, max=230, avg=48.04, stdev=26.73 clat percentiles (msec): | 1.00th=[ 18], 5.00th=[ 21], 10.00th=[ 23], 20.00th=[ 28], | 30.00th=[ 31], 40.00th=[ 35], 50.00th=[ 40], 60.00th=[ 46], | 70.00th=[ 55], 80.00th=[ 68], 90.00th=[ 85], 95.00th=[ 102], | 99.00th=[ 130], 99.50th=[ 153], 99.90th=[ 226], 99.95th=[ 232], | 99.99th=[ 232] bw ( KiB/s): min= 7, max= 144, per=27.33%, avg=62.58, stdev=31.13, samples=198 iops : min= 1, max= 36, avg=15.25, stdev= 7.90, samples=198 lat (msec) : 4=0.98%, 10=22.85%, 20=16.41%, 50=40.17%, 100=16.57% lat (msec) : 250=2.99%, 750=0.03% cpu : usr=0.09%, sys=4.70%, ctx=5899, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 5 (file:backend.c:481, func=full resid, error=Input/output error): pid=146397: Fri Jun 26 10:23:41 2026 read: IOPS=12, BW=49.4KiB/s (50.6kB/s)(3908KiB/79038msec) clat (msec): min=3, max=673, avg=19.77, stdev=27.08 lat (msec): min=3, max=673, avg=19.77, stdev=27.08 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 6], 10.00th=[ 6], 20.00th=[ 8], | 30.00th=[ 9], 40.00th=[ 11], 50.00th=[ 13], 60.00th=[ 16], | 70.00th=[ 21], 80.00th=[ 29], 90.00th=[ 42], 95.00th=[ 55], | 99.00th=[ 89], 99.50th=[ 93], 99.90th=[ 676], 99.95th=[ 676], | 99.99th=[ 676] bw ( KiB/s): min= 7, max= 152, per=22.68%, avg=49.67, stdev=31.13, samples=155 iops : min= 1, max= 38, avg=11.97, stdev= 7.84, samples=155 write: IOPS=13, BW=53.2KiB/s (54.5kB/s)(4208KiB/79038msec); 0 zone resets clat (msec): min=17, max=229, avg=56.55, stdev=27.15 lat (msec): min=17, max=229, avg=56.55, stdev=27.15 clat percentiles (msec): | 1.00th=[ 22], 5.00th=[ 26], 10.00th=[ 29], 20.00th=[ 34], | 30.00th=[ 38], 40.00th=[ 44], 50.00th=[ 50], 60.00th=[ 58], | 70.00th=[ 68], 80.00th=[ 78], 90.00th=[ 94], 95.00th=[ 106], | 99.00th=[ 140], 99.50th=[ 153], 99.90th=[ 203], 99.95th=[ 230], | 99.99th=[ 230] bw ( KiB/s): min= 7, max= 120, per=23.21%, avg=53.15, stdev=24.69, samples=156 iops : min= 1, max= 30, avg=12.84, stdev= 6.24, samples=156 lat (msec) : 4=0.20%, 10=18.23%, 20=14.68%, 50=38.18%, 100=24.73% lat (msec) : 250=3.89%, 750=0.05% cpu : usr=0.06%, sys=4.38%, ctx=3478, majf=0, minf=21 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=978,1052,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146398: Fri Jun 26 10:23:41 2026 read: IOPS=15, BW=60.5KiB/s (61.9kB/s)(6028KiB/99707msec) clat (msec): min=3, max=188, avg=16.37, stdev=15.77 lat (msec): min=3, max=188, avg=16.38, stdev=15.77 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 5], 10.00th=[ 6], 20.00th=[ 7], | 30.00th=[ 8], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 14], | 70.00th=[ 17], 80.00th=[ 24], 90.00th=[ 37], 95.00th=[ 46], | 99.00th=[ 77], 99.50th=[ 92], 99.90th=[ 150], 99.95th=[ 188], | 99.99th=[ 188] bw ( KiB/s): min= 7, max= 175, per=27.73%, avg=60.72, stdev=35.77, samples=196 iops : min= 1, max= 43, avg=14.79, stdev= 9.03, samples=196 write: IOPS=15, BW=62.8KiB/s (64.3kB/s)(6260KiB/99707msec); 0 zone resets clat (msec): min=15, max=710, avg=47.78, stdev=31.52 lat (msec): min=15, max=710, avg=47.78, stdev=31.52 clat percentiles (msec): | 1.00th=[ 18], 5.00th=[ 21], 10.00th=[ 24], 20.00th=[ 27], | 30.00th=[ 31], 40.00th=[ 35], 50.00th=[ 39], 60.00th=[ 45], | 70.00th=[ 54], 80.00th=[ 66], 90.00th=[ 85], 95.00th=[ 101], | 99.00th=[ 138], 99.50th=[ 155], 99.90th=[ 232], 99.95th=[ 709], | 99.99th=[ 709] bw ( KiB/s): min= 7, max= 152, per=27.34%, avg=62.62, stdev=32.28, samples=197 iops : min= 1, max= 38, avg=15.26, stdev= 8.19, samples=197 lat (msec) : 4=0.85%, 10=21.42%, 20=17.35%, 50=41.41%, 100=16.21% lat (msec) : 250=2.73%, 750=0.03% cpu : usr=0.09%, sys=4.78%, ctx=5847, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146399: Fri Jun 26 10:23:41 2026 read: IOPS=15, BW=60.7KiB/s (62.2kB/s)(6052KiB/99704msec) clat (msec): min=3, max=170, avg=15.68, stdev=15.72 lat (msec): min=3, max=170, avg=15.68, stdev=15.72 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 5], 10.00th=[ 6], 20.00th=[ 7], | 30.00th=[ 8], 40.00th=[ 9], 50.00th=[ 11], 60.00th=[ 13], | 70.00th=[ 16], 80.00th=[ 22], 90.00th=[ 34], 95.00th=[ 45], | 99.00th=[ 78], 99.50th=[ 102], 99.90th=[ 146], 99.95th=[ 171], | 99.99th=[ 171] bw ( KiB/s): min= 7, max= 184, per=28.45%, avg=62.31, stdev=37.32, samples=192 iops : min= 1, max= 46, avg=15.19, stdev= 9.45, samples=192 write: IOPS=15, BW=62.5KiB/s (64.0kB/s)(6236KiB/99704msec); 0 zone resets clat (msec): min=14, max=765, avg=48.57, stdev=32.59 lat (msec): min=14, max=765, avg=48.57, stdev=32.59 clat percentiles (msec): | 1.00th=[ 18], 5.00th=[ 21], 10.00th=[ 24], 20.00th=[ 28], | 30.00th=[ 31], 40.00th=[ 35], 50.00th=[ 40], 60.00th=[ 47], | 70.00th=[ 56], 80.00th=[ 67], 90.00th=[ 85], 95.00th=[ 100], | 99.00th=[ 146], 99.50th=[ 174], 99.90th=[ 234], 99.95th=[ 768], | 99.99th=[ 768] bw ( KiB/s): min= 15, max= 144, per=27.24%, avg=62.38, stdev=30.78, samples=197 iops : min= 3, max= 36, avg=15.20, stdev= 7.81, samples=197 lat (msec) : 4=0.55%, 10=23.57%, 20=15.82%, 50=40.56%, 100=16.80% lat (msec) : 250=2.67%, 1000=0.03% cpu : usr=0.08%, sys=4.72%, ctx=5848, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=219KiB/s (225kB/s), 49.4KiB/s-60.7KiB/s (50.6kB/s-62.2kB/s), io=21.5MiB (22.5MB), run=79038-100180msec WRITE: bw=230KiB/s (235kB/s), 53.2KiB/s-62.8KiB/s (54.5kB/s-64.4kB/s), io=22.5MiB (23.6MB), run=79038-100180msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=146439: Fri Jun 26 10:24:01 2026 read: IOPS=27, BW=436KiB/s (446kB/s)(5920KiB/13592msec) clat (usec): min=55, max=90975, avg=19076.65, stdev=13102.61 lat (usec): min=56, max=90976, avg=19077.67, stdev=13102.60 clat percentiles (usec): | 1.00th=[ 64], 5.00th=[ 111], 10.00th=[ 151], 20.00th=[10290], | 30.00th=[13304], 40.00th=[15533], 50.00th=[17171], 60.00th=[20317], | 70.00th=[23725], 80.00th=[27657], 90.00th=[33817], 95.00th=[40109], | 99.00th=[67634], 99.50th=[76022], 99.90th=[90702], 99.95th=[90702], | 99.99th=[90702] bw ( KiB/s): min= 287, max= 640, per=25.59%, avg=428.35, stdev=101.98, samples=26 iops : min= 17, max= 40, avg=26.23, stdev= 6.53, samples=26 write: IOPS=29, BW=469KiB/s (480kB/s)(6368KiB/13592msec); 0 zone resets clat (usec): min=1337, max=122807, avg=16344.11, stdev=14744.97 lat (usec): min=1338, max=122808, avg=16345.89, stdev=14744.96 clat percentiles (usec): | 1.00th=[ 1532], 5.00th=[ 2024], 10.00th=[ 3261], 20.00th=[ 4424], | 30.00th=[ 5866], 40.00th=[ 8848], 50.00th=[ 12125], 60.00th=[ 15139], | 70.00th=[ 20055], 80.00th=[ 25822], 90.00th=[ 35914], 95.00th=[ 44827], | 99.00th=[ 60556], 99.50th=[ 86508], 99.90th=[123208], 99.95th=[123208], | 99.99th=[123208] bw ( KiB/s): min= 224, max= 672, per=26.61%, avg=468.65, stdev=125.95, samples=26 iops : min= 14, max= 42, avg=28.77, stdev= 7.84, samples=26 lat (usec) : 100=1.82%, 250=3.65%, 500=0.65% lat (msec) : 2=2.47%, 4=6.51%, 10=15.63%, 20=33.98%, 50=32.55% lat (msec) : 100=2.60%, 250=0.13% cpu : usr=0.16%, sys=21.29%, ctx=2127, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146440: Fri Jun 26 10:24:01 2026 read: IOPS=25, BW=401KiB/s (411kB/s)(5744KiB/14308msec) clat (usec): min=45, max=201092, avg=20803.44, stdev=16886.31 lat (usec): min=46, max=201093, avg=20805.64, stdev=16887.55 clat percentiles (usec): | 1.00th=[ 54], 5.00th=[ 93], 10.00th=[ 5473], 20.00th=[ 11338], | 30.00th=[ 13042], 40.00th=[ 15270], 50.00th=[ 17957], 60.00th=[ 20841], | 70.00th=[ 25297], 80.00th=[ 28967], 90.00th=[ 35914], 95.00th=[ 43779], | 99.00th=[ 71828], 99.50th=[117965], 99.90th=[200279], 99.95th=[200279], | 99.99th=[200279] bw ( KiB/s): min= 52, max= 606, per=23.94%, avg=400.68, stdev=138.15, samples=28 iops : min= 3, max= 37, avg=24.50, stdev= 8.48, samples=28 write: IOPS=28, BW=457KiB/s (468kB/s)(6544KiB/14308msec); 0 zone resets clat (usec): min=1332, max=84380, avg=16524.07, stdev=15654.40 lat (usec): min=1334, max=84382, avg=16525.79, stdev=15654.40 clat percentiles (usec): | 1.00th=[ 1467], 5.00th=[ 2245], 10.00th=[ 3326], 20.00th=[ 4293], | 30.00th=[ 5669], 40.00th=[ 8094], 50.00th=[11600], 60.00th=[15008], | 70.00th=[19792], 80.00th=[25297], 90.00th=[37487], 95.00th=[48497], | 99.00th=[76022], 99.50th=[83362], 99.90th=[84411], 99.95th=[84411], | 99.99th=[84411] bw ( KiB/s): min= 224, max= 768, per=25.90%, avg=456.11, stdev=124.41, samples=28 iops : min= 14, max= 48, avg=27.96, stdev= 7.66, samples=28 lat (usec) : 50=0.26%, 100=2.34%, 250=1.69%, 1000=0.13% lat (msec) : 2=1.69%, 4=6.64%, 10=17.97%, 20=33.33%, 50=31.90% lat (msec) : 100=3.78%, 250=0.26% cpu : usr=0.12%, sys=20.52%, ctx=2110, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146441: Fri Jun 26 10:24:01 2026 read: IOPS=28, BW=451KiB/s (462kB/s)(6256KiB/13869msec) clat (usec): min=34, max=128014, avg=19792.26, stdev=13738.25 lat (usec): min=34, max=128016, avg=19793.41, stdev=13738.24 clat percentiles (usec): | 1.00th=[ 42], 5.00th=[ 88], 10.00th=[ 174], 20.00th=[ 11076], | 30.00th=[ 13435], 40.00th=[ 15401], 50.00th=[ 17957], 60.00th=[ 21365], | 70.00th=[ 24511], 80.00th=[ 27132], 90.00th=[ 33162], 95.00th=[ 40109], | 99.00th=[ 64226], 99.50th=[ 98042], 99.90th=[128451], 99.95th=[128451], | 99.99th=[128451] bw ( KiB/s): min= 288, max= 669, per=27.00%, avg=452.04, stdev=94.16, samples=27 iops : min= 18, max= 41, avg=27.70, stdev= 5.91, samples=27 write: IOPS=27, BW=435KiB/s (445kB/s)(6032KiB/13869msec); 0 zone resets clat (usec): min=1300, max=96886, avg=16117.43, stdev=13758.04 lat (usec): min=1302, max=96889, avg=16119.40, stdev=13758.04 clat percentiles (usec): | 1.00th=[ 1467], 5.00th=[ 2474], 10.00th=[ 3359], 20.00th=[ 4555], | 30.00th=[ 6194], 40.00th=[ 9110], 50.00th=[12125], 60.00th=[15533], | 70.00th=[20579], 80.00th=[26608], 90.00th=[34341], 95.00th=[42730], | 99.00th=[62129], 99.50th=[79168], 99.90th=[96994], 99.95th=[96994], | 99.99th=[96994] bw ( KiB/s): min= 128, max= 702, per=24.33%, avg=428.48, stdev=122.48, samples=27 iops : min= 8, max= 43, avg=26.22, stdev= 7.50, samples=27 lat (usec) : 50=0.78%, 100=2.21%, 250=2.34%, 500=0.26% lat (msec) : 2=1.82%, 4=5.86%, 10=15.10%, 20=34.11%, 50=34.90% lat (msec) : 100=2.47%, 250=0.13% cpu : usr=0.12%, sys=21.03%, ctx=2193, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146442: Fri Jun 26 10:24:01 2026 read: IOPS=26, BW=431KiB/s (441kB/s)(6032KiB/14009msec) clat (usec): min=52, max=102887, avg=19024.59, stdev=13199.54 lat (usec): min=53, max=102888, avg=19025.54, stdev=13199.55 clat percentiles (usec): | 1.00th=[ 62], 5.00th=[ 85], 10.00th=[ 116], 20.00th=[ 10683], | 30.00th=[ 13829], 40.00th=[ 15795], 50.00th=[ 17433], 60.00th=[ 20055], | 70.00th=[ 22676], 80.00th=[ 27395], 90.00th=[ 34866], 95.00th=[ 42730], | 99.00th=[ 64226], 99.50th=[ 71828], 99.90th=[103285], 99.95th=[103285], | 99.99th=[103285] bw ( KiB/s): min= 160, max= 573, per=25.37%, avg=424.70, stdev=111.21, samples=27 iops : min= 10, max= 35, avg=26.00, stdev= 6.79, samples=27 write: IOPS=27, BW=447KiB/s (457kB/s)(6256KiB/14009msec); 0 zone resets clat (usec): min=1148, max=169062, avg=17308.86, stdev=16014.19 lat (usec): min=1150, max=169065, avg=17310.99, stdev=16014.32 clat percentiles (usec): | 1.00th=[ 1614], 5.00th=[ 2802], 10.00th=[ 3654], 20.00th=[ 5014], | 30.00th=[ 6980], 40.00th=[ 9765], 50.00th=[ 13173], 60.00th=[ 16909], | 70.00th=[ 20579], 80.00th=[ 27132], 90.00th=[ 36963], 95.00th=[ 44303], | 99.00th=[ 65799], 99.50th=[100140], 99.90th=[168821], 99.95th=[168821], | 99.99th=[168821] bw ( KiB/s): min= 224, max= 734, per=25.23%, avg=444.37, stdev=116.45, samples=27 iops : min= 14, max= 45, avg=27.22, stdev= 7.21, samples=27 lat (usec) : 100=3.52%, 250=3.52%, 750=0.13% lat (msec) : 2=0.65%, 4=6.12%, 10=16.28%, 20=34.11%, 50=33.07% lat (msec) : 100=2.34%, 250=0.26% cpu : usr=0.09%, sys=20.67%, ctx=2199, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1674KiB/s (1714kB/s), 401KiB/s-451KiB/s (411kB/s-462kB/s), io=23.4MiB (24.5MB), run=13592-14308msec WRITE: bw=1761KiB/s (1804kB/s), 435KiB/s-469KiB/s (445kB/s-480kB/s), io=24.6MiB (25.8MB), run=13592-14308msec rand-rw: (groupid=0, jobs=1): err= 0: pid=146434: Fri Jun 26 10:24:11 2026 read: IOPS=15, BW=249KiB/s (255kB/s)(5920KiB/23786msec) clat (msec): min=4, max=153, avg=16.76, stdev=17.10 lat (msec): min=4, max=153, avg=16.76, stdev=17.10 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 6], 10.00th=[ 6], 20.00th=[ 7], | 30.00th=[ 8], 40.00th=[ 9], 50.00th=[ 10], 60.00th=[ 13], | 70.00th=[ 17], 80.00th=[ 24], 90.00th=[ 37], 95.00th=[ 52], | 99.00th=[ 83], 99.50th=[ 91], 99.90th=[ 155], 99.95th=[ 155], | 99.99th=[ 155] bw ( KiB/s): min= 63, max= 670, per=25.32%, avg=248.36, stdev=137.84, samples=47 iops : min= 3, max= 41, avg=15.09, stdev= 8.72, samples=47 write: IOPS=16, BW=268KiB/s (274kB/s)(6368KiB/23786msec); 0 zone resets clat (msec): min=16, max=207, avg=44.04, stdev=24.17 lat (msec): min=16, max=207, avg=44.05, stdev=24.17 clat percentiles (msec): | 1.00th=[ 18], 5.00th=[ 21], 10.00th=[ 24], 20.00th=[ 27], | 30.00th=[ 31], 40.00th=[ 33], 50.00th=[ 37], 60.00th=[ 43], | 70.00th=[ 50], 80.00th=[ 57], 90.00th=[ 73], 95.00th=[ 87], | 99.00th=[ 144], 99.50th=[ 180], 99.90th=[ 209], 99.95th=[ 209], | 99.99th=[ 209] bw ( KiB/s): min= 63, max= 544, per=25.96%, avg=267.96, stdev=130.19, samples=47 iops : min= 3, max= 34, avg=16.30, stdev= 8.36, samples=47 lat (msec) : 10=24.61%, 20=14.71%, 50=42.97%, 100=16.15%, 250=1.56% cpu : usr=0.08%, sys=6.28%, ctx=1456, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146435: Fri Jun 26 10:24:11 2026 read: IOPS=14, BW=235KiB/s (241kB/s)(5744KiB/24402msec) clat (msec): min=3, max=122, avg=16.34, stdev=17.66 lat (msec): min=3, max=122, avg=16.34, stdev=17.66 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 5], 10.00th=[ 6], 20.00th=[ 7], | 30.00th=[ 7], 40.00th=[ 8], 50.00th=[ 9], 60.00th=[ 12], | 70.00th=[ 16], 80.00th=[ 22], 90.00th=[ 39], 95.00th=[ 58], | 99.00th=[ 89], 99.50th=[ 116], 99.90th=[ 123], 99.95th=[ 123], | 99.99th=[ 123] bw ( KiB/s): min= 31, max= 608, per=24.33%, avg=238.68, stdev=145.48, samples=47 iops : min= 1, max= 38, avg=14.49, stdev= 9.25, samples=47 write: IOPS=16, BW=268KiB/s (275kB/s)(6544KiB/24402msec); 0 zone resets clat (msec): min=13, max=202, avg=45.20, stdev=26.18 lat (msec): min=13, max=202, avg=45.20, stdev=26.18 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 21], 10.00th=[ 23], 20.00th=[ 26], | 30.00th=[ 30], 40.00th=[ 33], 50.00th=[ 37], 60.00th=[ 43], | 70.00th=[ 51], 80.00th=[ 63], 90.00th=[ 79], 95.00th=[ 96], | 99.00th=[ 136], 99.50th=[ 171], 99.90th=[ 203], 99.95th=[ 203], | 99.99th=[ 203] bw ( KiB/s): min= 63, max= 512, per=25.64%, avg=264.56, stdev=132.60, samples=48 iops : min= 3, max= 32, avg=16.10, stdev= 8.49, samples=48 lat (msec) : 4=0.65%, 10=25.65%, 20=12.24%, 50=42.06%, 100=16.80% lat (msec) : 250=2.60% cpu : usr=0.06%, sys=6.13%, ctx=1560, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146436: Fri Jun 26 10:24:11 2026 read: IOPS=16, BW=261KiB/s (267kB/s)(6256KiB/23968msec) clat (msec): min=3, max=101, avg=17.09, stdev=18.03 lat (msec): min=3, max=101, avg=17.09, stdev=18.03 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 5], 10.00th=[ 6], 20.00th=[ 7], | 30.00th=[ 7], 40.00th=[ 9], 50.00th=[ 10], 60.00th=[ 12], | 70.00th=[ 16], 80.00th=[ 25], 90.00th=[ 44], 95.00th=[ 57], | 99.00th=[ 88], 99.50th=[ 93], 99.90th=[ 103], 99.95th=[ 103], | 99.99th=[ 103] bw ( KiB/s): min= 62, max= 832, per=26.82%, avg=263.06, stdev=169.34, samples=47 iops : min= 3, max= 52, avg=16.00, stdev=10.74, samples=47 write: IOPS=15, BW=252KiB/s (258kB/s)(6032KiB/23968msec); 0 zone resets clat (msec): min=17, max=199, avg=45.77, stdev=26.51 lat (msec): min=17, max=199, avg=45.77, stdev=26.51 clat percentiles (msec): | 1.00th=[ 18], 5.00th=[ 22], 10.00th=[ 24], 20.00th=[ 27], | 30.00th=[ 30], 40.00th=[ 33], 50.00th=[ 36], 60.00th=[ 42], | 70.00th=[ 51], 80.00th=[ 63], 90.00th=[ 84], 95.00th=[ 100], | 99.00th=[ 161], 99.50th=[ 180], 99.90th=[ 201], 99.95th=[ 201], | 99.99th=[ 201] bw ( KiB/s): min= 94, max= 448, per=24.10%, avg=248.74, stdev=129.98, samples=47 iops : min= 5, max= 28, avg=15.11, stdev= 8.32, samples=47 lat (msec) : 4=0.39%, 10=26.69%, 20=12.63%, 50=41.80%, 100=16.02% lat (msec) : 250=2.47% cpu : usr=0.08%, sys=6.25%, ctx=1526, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146437: Fri Jun 26 10:24:11 2026 read: IOPS=15, BW=249KiB/s (255kB/s)(6032KiB/24225msec) clat (msec): min=3, max=115, avg=16.85, stdev=17.76 lat (msec): min=3, max=115, avg=16.85, stdev=17.76 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 5], 10.00th=[ 6], 20.00th=[ 7], | 30.00th=[ 7], 40.00th=[ 8], 50.00th=[ 10], 60.00th=[ 12], | 70.00th=[ 16], 80.00th=[ 24], 90.00th=[ 41], 95.00th=[ 56], | 99.00th=[ 100], 99.50th=[ 108], 99.90th=[ 115], 99.95th=[ 115], | 99.99th=[ 115] bw ( KiB/s): min= 63, max= 608, per=24.81%, avg=243.34, stdev=137.50, samples=47 iops : min= 3, max= 38, avg=14.77, stdev= 8.82, samples=47 write: IOPS=16, BW=258KiB/s (264kB/s)(6256KiB/24225msec); 0 zone resets clat (msec): min=14, max=152, avg=45.53, stdev=25.65 lat (msec): min=14, max=152, avg=45.53, stdev=25.65 clat percentiles (msec): | 1.00th=[ 18], 5.00th=[ 22], 10.00th=[ 24], 20.00th=[ 27], | 30.00th=[ 30], 40.00th=[ 33], 50.00th=[ 37], 60.00th=[ 42], | 70.00th=[ 50], 80.00th=[ 61], 90.00th=[ 83], 95.00th=[ 102], | 99.00th=[ 140], 99.50th=[ 148], 99.90th=[ 153], 99.95th=[ 153], | 99.99th=[ 153] bw ( KiB/s): min= 63, max= 480, per=24.64%, avg=254.28, stdev=131.53, samples=47 iops : min= 3, max= 30, avg=15.45, stdev= 8.41, samples=47 lat (msec) : 4=0.26%, 10=26.43%, 20=11.72%, 50=44.01%, 100=14.32% lat (msec) : 250=3.26% cpu : usr=0.09%, sys=6.09%, ctx=1521, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=982KiB/s (1005kB/s), 235KiB/s-261KiB/s (241kB/s-267kB/s), io=23.4MiB (24.5MB), run=23786-24402msec WRITE: bw=1033KiB/s (1057kB/s), 252KiB/s-268KiB/s (258kB/s-275kB/s), io=24.6MiB (25.8MB), run=23786-24402msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=146452: Fri Jun 26 10:24:22 2026 read: IOPS=1, BW=1482KiB/s (1517kB/s)(7168KiB/4838msec) clat (msec): min=51, max=1995, avg=555.80, stdev=810.63 lat (msec): min=51, max=1995, avg=555.80, stdev=810.63 clat percentiles (msec): | 1.00th=[ 52], 5.00th=[ 52], 10.00th=[ 52], 20.00th=[ 56], | 30.00th=[ 67], 40.00th=[ 67], 50.00th=[ 93], 60.00th=[ 190], | 70.00th=[ 190], 80.00th=[ 1435], 90.00th=[ 1989], 95.00th=[ 1989], | 99.00th=[ 1989], 99.50th=[ 1989], 99.90th=[ 1989], 99.95th=[ 1989], | 99.99th=[ 1989] bw ( KiB/s): min= 2015, max= 4039, per=63.81%, avg=2536.25, stdev=1001.94, samples=4 iops : min= 1, max= 3, avg= 1.75, stdev= 0.96, samples=4 write: IOPS=1, BW=1058KiB/s (1084kB/s)(5120KiB/4838msec); 0 zone resets clat (msec): min=56, max=442, avg=170.92, stdev=154.42 lat (msec): min=56, max=442, avg=171.00, stdev=154.42 clat percentiles (msec): | 1.00th=[ 57], 5.00th=[ 57], 10.00th=[ 57], 20.00th=[ 57], | 30.00th=[ 102], 40.00th=[ 102], 50.00th=[ 121], 60.00th=[ 121], | 70.00th=[ 134], 80.00th=[ 134], 90.00th=[ 443], 95.00th=[ 443], | 99.00th=[ 443], 99.50th=[ 443], 99.90th=[ 443], 99.95th=[ 443], | 99.99th=[ 443] bw ( KiB/s): min= 2019, max= 2043, per=36.49%, avg=2031.00, stdev=16.97, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 100=41.67%, 250=33.33%, 500=8.33%, 2000=16.67% cpu : usr=0.02%, sys=6.86%, ctx=79, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146454: Fri Jun 26 10:24:22 2026 read: IOPS=0, BW=407KiB/s (416kB/s)(2048KiB/5038msec) clat (usec): min=48364, max=80179, avg=64272.25, stdev=22496.36 lat (usec): min=48367, max=80180, avg=64274.28, stdev=22495.20 clat percentiles (usec): | 1.00th=[48497], 5.00th=[48497], 10.00th=[48497], 20.00th=[48497], | 30.00th=[48497], 40.00th=[48497], 50.00th=[48497], 60.00th=[80217], | 70.00th=[80217], 80.00th=[80217], 90.00th=[80217], 95.00th=[80217], | 99.00th=[80217], 99.50th=[80217], 99.90th=[80217], 99.95th=[80217], | 99.99th=[80217] bw ( KiB/s): min= 1973, max= 2043, per=50.52%, avg=2008.00, stdev=49.50, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=2033KiB/s (2081kB/s)(10.0MiB/5038msec); 0 zone resets clat (msec): min=78, max=2682, avg=488.13, stdev=791.30 lat (msec): min=78, max=2682, avg=488.21, stdev=791.31 clat percentiles (msec): | 1.00th=[ 80], 5.00th=[ 80], 10.00th=[ 80], 20.00th=[ 106], | 30.00th=[ 111], 40.00th=[ 136], 50.00th=[ 178], 60.00th=[ 275], | 70.00th=[ 305], 80.00th=[ 334], 90.00th=[ 676], 95.00th=[ 2668], | 99.00th=[ 2668], 99.50th=[ 2668], 99.90th=[ 2668], 99.95th=[ 2668], | 99.99th=[ 2668] bw ( KiB/s): min= 2015, max= 6083, per=54.62%, avg=3040.00, stdev=2028.70, samples=4 iops : min= 1, max= 5, avg= 2.00, stdev= 2.00, samples=4 lat (msec) : 50=8.33%, 100=16.67%, 250=33.33%, 500=25.00%, 750=8.33% lat (msec) : >=2000=8.33% cpu : usr=0.02%, sys=6.15%, ctx=274, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146456: Fri Jun 26 10:24:22 2026 read: IOPS=1, BW=1193KiB/s (1221kB/s)(6144KiB/5151msec) clat (msec): min=78, max=615, avg=257.40, stdev=203.51 lat (msec): min=78, max=615, avg=257.40, stdev=203.51 clat percentiles (msec): | 1.00th=[ 80], 5.00th=[ 80], 10.00th=[ 80], 20.00th=[ 113], | 30.00th=[ 113], 40.00th=[ 171], 50.00th=[ 171], 60.00th=[ 190], | 70.00th=[ 376], 80.00th=[ 376], 90.00th=[ 617], 95.00th=[ 617], | 99.00th=[ 617], 99.50th=[ 617], 99.90th=[ 617], 99.95th=[ 617], | 99.99th=[ 617] bw ( KiB/s): min= 2015, max= 2048, per=51.08%, avg=2030.40, stdev=14.55, samples=5 iops : min= 1, max= 2, avg= 1.20, stdev= 0.45, samples=5 write: IOPS=1, BW=1193KiB/s (1221kB/s)(6144KiB/5151msec); 0 zone resets clat (msec): min=98, max=2633, avg=599.13, stdev=1001.70 lat (msec): min=98, max=2633, avg=599.20, stdev=1001.70 clat percentiles (msec): | 1.00th=[ 100], 5.00th=[ 100], 10.00th=[ 100], 20.00th=[ 125], | 30.00th=[ 125], 40.00th=[ 174], 50.00th=[ 174], 60.00th=[ 178], | 70.00th=[ 388], 80.00th=[ 388], 90.00th=[ 2635], 95.00th=[ 2635], | 99.00th=[ 2635], 99.50th=[ 2635], 99.90th=[ 2635], 99.95th=[ 2635], | 99.99th=[ 2635] bw ( KiB/s): min= 2015, max= 3856, per=42.99%, avg=2393.00, stdev=817.94, samples=5 iops : min= 1, max= 3, avg= 1.60, stdev= 0.89, samples=5 lat (msec) : 100=16.67%, 250=50.00%, 500=16.67%, 750=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=5.92%, ctx=208, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146458: Fri Jun 26 10:24:22 2026 read: IOPS=1, BW=1041KiB/s (1066kB/s)(5120KiB/4918msec) clat (msec): min=56, max=367, avg=191.73, stdev=129.15 lat (msec): min=56, max=367, avg=191.73, stdev=129.15 clat percentiles (msec): | 1.00th=[ 57], 5.00th=[ 57], 10.00th=[ 57], 20.00th=[ 57], | 30.00th=[ 80], 40.00th=[ 80], 50.00th=[ 194], 60.00th=[ 194], | 70.00th=[ 262], 80.00th=[ 262], 90.00th=[ 368], 95.00th=[ 368], | 99.00th=[ 368], 99.50th=[ 368], 99.90th=[ 368], 99.95th=[ 368], | 99.99th=[ 368] bw ( KiB/s): min= 2043, max= 6059, per=100.00%, avg=4051.00, stdev=2839.74, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 write: IOPS=1, BW=1458KiB/s (1492kB/s)(7168KiB/4918msec); 0 zone resets clat (msec): min=98, max=2598, avg=561.17, stdev=907.39 lat (msec): min=98, max=2598, avg=561.26, stdev=907.40 clat percentiles (msec): | 1.00th=[ 100], 5.00th=[ 100], 10.00th=[ 100], 20.00th=[ 136], | 30.00th=[ 144], 40.00th=[ 144], 50.00th=[ 153], 60.00th=[ 384], | 70.00th=[ 384], 80.00th=[ 418], 90.00th=[ 2601], 95.00th=[ 2601], | 99.00th=[ 2601], 99.50th=[ 2601], 99.90th=[ 2601], 99.95th=[ 2601], | 99.99th=[ 2601] bw ( KiB/s): min= 2015, max= 2043, per=36.40%, avg=2026.00, stdev=12.38, samples=4 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=4 lat (msec) : 100=25.00%, 250=33.33%, 500=33.33%, >=2000=8.33% cpu : usr=0.02%, sys=7.91%, ctx=287, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3976KiB/s (4071kB/s), 407KiB/s-1482KiB/s (416kB/s-1517kB/s), io=20.0MiB (20.0MB), run=4838-5151msec WRITE: bw=5566KiB/s (5700kB/s), 1058KiB/s-2033KiB/s (1084kB/s-2081kB/s), io=28.0MiB (29.4MB), run=4838-5151msec rand-rw: (groupid=0, jobs=1): err= 0: pid=146453: Fri Jun 26 10:24:22 2026 read: IOPS=1, BW=1816KiB/s (1859kB/s)(7168KiB/3948msec) clat (usec): min=550, max=1439.4k, avg=430012.65, stdev=596254.60 lat (usec): min=551, max=1439.4k, avg=430014.04, stdev=596254.64 clat percentiles (usec): | 1.00th=[ 553], 5.00th=[ 553], 10.00th=[ 553], | 20.00th=[ 38011], 30.00th=[ 70779], 40.00th=[ 70779], | 50.00th=[ 137364], 60.00th=[ 185598], 70.00th=[ 185598], | 80.00th=[1132463], 90.00th=[1434452], 95.00th=[1434452], | 99.00th=[1434452], 99.50th=[1434452], 99.90th=[1434452], | 99.95th=[1434452], 99.99th=[1434452] bw ( KiB/s): min= 2011, max= 5763, per=81.85%, avg=3274.00, stdev=2155.62, samples=3 iops : min= 1, max= 5, avg= 2.67, stdev= 2.08, samples=3 write: IOPS=1, BW=1297KiB/s (1328kB/s)(5120KiB/3948msec); 0 zone resets clat (msec): min=63, max=246, avg=181.08, stdev=69.70 lat (msec): min=63, max=246, avg=181.13, stdev=69.69 clat percentiles (msec): | 1.00th=[ 64], 5.00th=[ 64], 10.00th=[ 64], 20.00th=[ 64], | 30.00th=[ 188], 40.00th=[ 188], 50.00th=[ 194], 60.00th=[ 194], | 70.00th=[ 213], 80.00th=[ 213], 90.00th=[ 247], 95.00th=[ 247], | 99.00th=[ 247], 99.50th=[ 247], 99.90th=[ 247], 99.95th=[ 247], | 99.99th=[ 247] bw ( KiB/s): min= 1921, max= 4023, per=53.07%, avg=2972.00, stdev=1486.34, samples=2 iops : min= 1, max= 3, avg= 2.00, stdev= 1.41, samples=2 lat (usec) : 750=8.33% lat (msec) : 50=8.33%, 100=16.67%, 250=50.00%, 2000=16.67% cpu : usr=0.00%, sys=26.81%, ctx=1405, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146455: Fri Jun 26 10:24:22 2026 read: IOPS=0, BW=400KiB/s (410kB/s)(2048KiB/5120msec) clat (usec): min=593, max=145984, avg=73289.29, stdev=102807.10 lat (usec): min=594, max=145988, avg=73291.50, stdev=102808.51 clat percentiles (usec): | 1.00th=[ 594], 5.00th=[ 594], 10.00th=[ 594], 20.00th=[ 594], | 30.00th=[ 594], 40.00th=[ 594], 50.00th=[ 594], 60.00th=[145753], | 70.00th=[145753], 80.00th=[145753], 90.00th=[145753], 95.00th=[145753], | 99.00th=[145753], 99.50th=[145753], 99.90th=[145753], 99.95th=[145753], | 99.99th=[145753] bw ( KiB/s): min= 2003, max= 2007, per=50.12%, avg=2005.00, stdev= 2.83, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=2000KiB/s (2048kB/s)(10.0MiB/5120msec); 0 zone resets clat (msec): min=109, max=2675, avg=486.83, stdev=780.13 lat (msec): min=109, max=2675, avg=486.89, stdev=780.13 clat percentiles (msec): | 1.00th=[ 109], 5.00th=[ 109], 10.00th=[ 109], 20.00th=[ 121], | 30.00th=[ 123], 40.00th=[ 167], 50.00th=[ 182], 60.00th=[ 228], | 70.00th=[ 393], 80.00th=[ 414], 90.00th=[ 468], 95.00th=[ 2668], | 99.00th=[ 2668], 99.50th=[ 2668], 99.90th=[ 2668], 99.95th=[ 2668], | 99.99th=[ 2668] bw ( KiB/s): min= 1921, max= 6144, per=64.65%, avg=3620.40, stdev=1744.36, samples=5 iops : min= 1, max= 6, avg= 2.80, stdev= 2.05, samples=5 lat (usec) : 750=8.33% lat (msec) : 250=58.33%, 500=25.00%, >=2000=8.33% cpu : usr=0.00%, sys=22.09%, ctx=400, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146457: Fri Jun 26 10:24:22 2026 read: IOPS=1, BW=1485KiB/s (1521kB/s)(6144KiB/4137msec) clat (usec): min=501, max=203287, avg=34825.20, stdev=82537.20 lat (usec): min=502, max=203288, avg=34826.11, stdev=82536.96 clat percentiles (usec): | 1.00th=[ 502], 5.00th=[ 502], 10.00th=[ 502], 20.00th=[ 545], | 30.00th=[ 545], 40.00th=[ 562], 50.00th=[ 562], 60.00th=[ 668], | 70.00th=[ 3392], 80.00th=[ 3392], 90.00th=[202376], 95.00th=[202376], | 99.00th=[202376], 99.50th=[202376], 99.90th=[202376], 99.95th=[202376], | 99.99th=[202376] bw ( KiB/s): min= 3842, max= 4023, per=98.31%, avg=3932.50, stdev=127.99, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1485KiB/s (1521kB/s)(6144KiB/4137msec); 0 zone resets clat (msec): min=99, max=2923, avg=642.67, stdev=1120.97 lat (msec): min=99, max=2923, avg=642.73, stdev=1120.99 clat percentiles (msec): | 1.00th=[ 101], 5.00th=[ 101], 10.00th=[ 101], 20.00th=[ 133], | 30.00th=[ 133], 40.00th=[ 153], 50.00th=[ 153], 60.00th=[ 188], | 70.00th=[ 359], 80.00th=[ 359], 90.00th=[ 2937], 95.00th=[ 2937], | 99.00th=[ 2937], 99.50th=[ 2937], 99.90th=[ 2937], 99.95th=[ 2937], | 99.99th=[ 2937] bw ( KiB/s): min= 1921, max= 2756, per=39.81%, avg=2229.33, stdev=458.32, samples=3 iops : min= 1, max= 2, avg= 1.33, stdev= 0.58, samples=3 lat (usec) : 750=33.33% lat (msec) : 4=8.33%, 100=8.33%, 250=33.33%, 500=8.33%, >=2000=8.33% cpu : usr=0.05%, sys=17.84%, ctx=119, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146459: Fri Jun 26 10:24:22 2026 read: IOPS=1, BW=1170KiB/s (1198kB/s)(5120KiB/4375msec) clat (usec): min=313, max=220268, avg=44380.37, stdev=98324.45 lat (usec): min=313, max=220269, avg=44381.25, stdev=98324.76 clat percentiles (usec): | 1.00th=[ 314], 5.00th=[ 314], 10.00th=[ 314], 20.00th=[ 314], | 30.00th=[ 388], 40.00th=[ 388], 50.00th=[ 396], 60.00th=[ 396], | 70.00th=[ 537], 80.00th=[ 537], 90.00th=[221250], 95.00th=[221250], | 99.00th=[221250], 99.50th=[221250], 99.90th=[221250], 99.95th=[221250], | 99.99th=[221250] bw ( KiB/s): min= 7876, max= 7876, per=100.00%, avg=7876.00, stdev= 0.00, samples=1 iops : min= 7, max= 7, avg= 7.00, stdev= 0.00, samples=1 write: IOPS=1, BW=1638KiB/s (1678kB/s)(7168KiB/4375msec); 0 zone resets clat (msec): min=84, max=2759, avg=575.18, stdev=969.34 lat (msec): min=84, max=2759, avg=575.24, stdev=969.33 clat percentiles (msec): | 1.00th=[ 85], 5.00th=[ 85], 10.00th=[ 85], 20.00th=[ 124], | 30.00th=[ 142], 40.00th=[ 142], 50.00th=[ 251], 60.00th=[ 257], | 70.00th=[ 257], 80.00th=[ 409], 90.00th=[ 2769], 95.00th=[ 2769], | 99.00th=[ 2769], 99.50th=[ 2769], 99.90th=[ 2769], 99.95th=[ 2769], | 99.99th=[ 2769] bw ( KiB/s): min= 1387, max= 4023, per=50.31%, avg=2817.25, stdev=1361.22, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 1.15, samples=4 lat (usec) : 500=25.00%, 750=8.33% lat (msec) : 100=8.33%, 250=25.00%, 500=25.00%, >=2000=8.33% cpu : usr=0.02%, sys=19.96%, ctx=130, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4000KiB/s (4096kB/s), 400KiB/s-1816KiB/s (410kB/s-1859kB/s), io=20.0MiB (20.0MB), run=3948-5120msec WRITE: bw=5600KiB/s (5734kB/s), 1297KiB/s-2000KiB/s (1328kB/s-2048kB/s), io=28.0MiB (29.4MB), run=3948-5120msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=146466: Fri Jun 26 10:24:30 2026 read: IOPS=2, BW=8740KiB/s (8949kB/s)(12.0MiB/1406msec) clat (msec): min=409, max=509, avg=453.20, stdev=50.81 lat (msec): min=409, max=509, avg=453.20, stdev=50.81 clat percentiles (msec): | 1.00th=[ 409], 5.00th=[ 409], 10.00th=[ 409], 20.00th=[ 409], | 30.00th=[ 409], 40.00th=[ 443], 50.00th=[ 443], 60.00th=[ 443], | 70.00th=[ 510], 80.00th=[ 510], 90.00th=[ 510], 95.00th=[ 510], | 99.00th=[ 510], 99.50th=[ 510], 99.90th=[ 510], 99.95th=[ 510], | 99.99th=[ 510] bw ( KiB/s): min= 5634, max= 8159, per=84.87%, avg=6896.50, stdev=1785.44, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=66.67%, 750=33.33% cpu : usr=0.07%, sys=48.54%, ctx=2056, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146467: Fri Jun 26 10:24:30 2026 read: IOPS=0, BW=2032KiB/s (2081kB/s)(4096KiB/2016msec) clat (nsec): min=415106k, max=415106k, avg=415105960.00, stdev= 0.00 lat (nsec): min=415108k, max=415108k, avg=415108190.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 414], 5.00th=[ 414], 10.00th=[ 414], 20.00th=[ 414], | 30.00th=[ 414], 40.00th=[ 414], 50.00th=[ 414], 60.00th=[ 414], | 70.00th=[ 414], 80.00th=[ 414], 90.00th=[ 414], 95.00th=[ 414], | 99.00th=[ 414], 99.50th=[ 414], 99.90th=[ 414], 99.95th=[ 414], | 99.99th=[ 414] bw ( KiB/s): min= 6059, max= 6059, per=74.56%, avg=6059.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=4063KiB/s (4161kB/s)(8192KiB/2016msec); 0 zone resets clat (msec): min=552, max=999, avg=776.04, stdev=316.41 lat (msec): min=552, max=1000, avg=776.39, stdev=316.35 clat percentiles (msec): | 1.00th=[ 550], 5.00th=[ 550], 10.00th=[ 550], 20.00th=[ 550], | 30.00th=[ 550], 40.00th=[ 550], 50.00th=[ 550], 60.00th=[ 1003], | 70.00th=[ 1003], 80.00th=[ 1003], 90.00th=[ 1003], 95.00th=[ 1003], | 99.00th=[ 1003], 99.50th=[ 1003], 99.90th=[ 1003], 99.95th=[ 1003], | 99.99th=[ 1003] bw ( KiB/s): min= 8159, max= 8159, per=50.20%, avg=8159.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 750=33.33%, 1000=33.33% cpu : usr=0.00%, sys=15.43%, ctx=978, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146468: Fri Jun 26 10:24:30 2026 write: IOPS=1, BW=6585KiB/s (6743kB/s)(12.0MiB/1866msec); 0 zone resets clat (msec): min=321, max=1134, avg=602.71, stdev=460.56 lat (msec): min=322, max=1135, avg=603.25, stdev=460.88 clat percentiles (msec): | 1.00th=[ 321], 5.00th=[ 321], 10.00th=[ 321], 20.00th=[ 321], | 30.00th=[ 321], 40.00th=[ 351], 50.00th=[ 351], 60.00th=[ 351], | 70.00th=[ 1133], 80.00th=[ 1133], 90.00th=[ 1133], 95.00th=[ 1133], | 99.00th=[ 1133], 99.50th=[ 1133], 99.90th=[ 1133], 99.95th=[ 1133], | 99.99th=[ 1133] bw ( KiB/s): min=11010, max=11010, per=67.74%, avg=11010.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 500=66.67%, 2000=33.33% cpu : usr=0.00%, sys=17.86%, ctx=88, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146470: Fri Jun 26 10:24:30 2026 write: IOPS=1, BW=6095KiB/s (6242kB/s)(12.0MiB/2016msec); 0 zone resets clat (msec): min=198, max=1260, avg=641.32, stdev=552.61 lat (msec): min=199, max=1261, avg=641.62, stdev=552.71 clat percentiles (msec): | 1.00th=[ 199], 5.00th=[ 199], 10.00th=[ 199], 20.00th=[ 199], | 30.00th=[ 199], 40.00th=[ 464], 50.00th=[ 464], 60.00th=[ 464], | 70.00th=[ 1267], 80.00th=[ 1267], 90.00th=[ 1267], 95.00th=[ 1267], | 99.00th=[ 1267], 99.50th=[ 1267], 99.90th=[ 1267], 99.95th=[ 1267], | 99.99th=[ 1267] bw ( KiB/s): min= 6177, max= 6177, per=38.01%, avg=6177.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 500=33.33%, 2000=33.33% cpu : usr=0.05%, sys=15.48%, ctx=82, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=8127KiB/s (8322kB/s), 2032KiB/s-8740KiB/s (2081kB/s-8949kB/s), io=16.0MiB (16.8MB), run=1406-2016msec WRITE: bw=15.9MiB/s (16.6MB/s), 4063KiB/s-6585KiB/s (4161kB/s-6743kB/s), io=32.0MiB (33.6MB), run=1866-2016msec rand-rw: (groupid=0, jobs=1): err= 0: pid=146469: Fri Jun 26 10:24:30 2026 read: IOPS=1, BW=7407KiB/s (7585kB/s)(12.0MiB/1659msec) clat (msec): min=459, max=559, avg=521.62, stdev=54.44 lat (msec): min=459, max=559, avg=521.63, stdev=54.44 clat percentiles (msec): | 1.00th=[ 460], 5.00th=[ 460], 10.00th=[ 460], 20.00th=[ 460], | 30.00th=[ 460], 40.00th=[ 550], 50.00th=[ 550], 60.00th=[ 550], | 70.00th=[ 558], 80.00th=[ 558], 90.00th=[ 558], 95.00th=[ 558], | 99.00th=[ 558], 99.50th=[ 558], 99.90th=[ 558], 99.95th=[ 558], | 99.99th=[ 558] bw ( KiB/s): min= 5885, max= 5885, per=75.91%, avg=5885.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 750=66.67% cpu : usr=0.00%, sys=15.74%, ctx=93, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146471: Fri Jun 26 10:24:30 2026 read: IOPS=0, BW=1938KiB/s (1985kB/s)(4096KiB/2113msec) clat (nsec): min=697873k, max=697873k, avg=697873220.00, stdev= 0.00 lat (nsec): min=697875k, max=697875k, avg=697874938.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 701], 5.00th=[ 701], 10.00th=[ 701], 20.00th=[ 701], | 30.00th=[ 701], 40.00th=[ 701], 50.00th=[ 701], 60.00th=[ 701], | 70.00th=[ 701], 80.00th=[ 701], 90.00th=[ 701], 95.00th=[ 701], | 99.00th=[ 701], 99.50th=[ 701], 99.90th=[ 701], 99.95th=[ 701], | 99.99th=[ 701] bw ( KiB/s): min= 8192, max= 8192, per=100.00%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 write: IOPS=0, BW=3877KiB/s (3970kB/s)(8192KiB/2113msec); 0 zone resets clat (msec): min=631, max=693, avg=662.58, stdev=43.87 lat (msec): min=632, max=693, avg=663.40, stdev=43.16 clat percentiles (msec): | 1.00th=[ 634], 5.00th=[ 634], 10.00th=[ 634], 20.00th=[ 634], | 30.00th=[ 634], 40.00th=[ 634], 50.00th=[ 634], 60.00th=[ 693], | 70.00th=[ 693], 80.00th=[ 693], 90.00th=[ 693], 95.00th=[ 693], | 99.00th=[ 693], 99.50th=[ 693], 99.90th=[ 693], 99.95th=[ 693], | 99.99th=[ 693] bw ( KiB/s): min= 8192, max= 8192, per=52.83%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 750=100.00% cpu : usr=0.00%, sys=10.75%, ctx=79, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146472: Fri Jun 26 10:24:30 2026 write: IOPS=1, BW=6113KiB/s (6260kB/s)(12.0MiB/2010msec); 0 zone resets clat (msec): min=302, max=849, avg=662.25, stdev=311.64 lat (msec): min=302, max=850, avg=662.62, stdev=311.61 clat percentiles (msec): | 1.00th=[ 305], 5.00th=[ 305], 10.00th=[ 305], 20.00th=[ 305], | 30.00th=[ 305], 40.00th=[ 835], 50.00th=[ 835], 60.00th=[ 835], | 70.00th=[ 852], 80.00th=[ 852], 90.00th=[ 852], 95.00th=[ 852], | 99.00th=[ 852], 99.50th=[ 852], 99.90th=[ 852], 99.95th=[ 852], | 99.99th=[ 852] bw ( KiB/s): min= 8192, max= 8192, per=52.83%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 1000=66.67% cpu : usr=0.10%, sys=12.79%, ctx=81, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146473: Fri Jun 26 10:24:30 2026 write: IOPS=1, BW=7314KiB/s (7490kB/s)(12.0MiB/1680msec); 0 zone resets clat (msec): min=183, max=737, avg=527.79, stdev=300.22 lat (msec): min=184, max=737, avg=528.13, stdev=300.17 clat percentiles (msec): | 1.00th=[ 184], 5.00th=[ 184], 10.00th=[ 184], 20.00th=[ 184], | 30.00th=[ 184], 40.00th=[ 659], 50.00th=[ 659], 60.00th=[ 659], | 70.00th=[ 735], 80.00th=[ 735], 90.00th=[ 735], 95.00th=[ 735], | 99.00th=[ 735], 99.50th=[ 735], 99.90th=[ 735], 99.95th=[ 735], | 99.99th=[ 735] bw ( KiB/s): min= 8192, max= 8192, per=52.83%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 750=66.67% cpu : usr=0.00%, sys=15.43%, ctx=193, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=7754KiB/s (7940kB/s), 1938KiB/s-7407KiB/s (1985kB/s-7585kB/s), io=16.0MiB (16.8MB), run=1659-2113msec WRITE: bw=15.1MiB/s (15.9MB/s), 3877KiB/s-7314KiB/s (3970kB/s-7490kB/s), io=32.0MiB (33.6MB), run=1680-2113msec