== sanity test 398b: DIO and buffer IO race ============== 10:19:33 (1782483573) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 3.04276 s, 16.5 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=146496: Fri Jun 26 10:20:40 2026 read: IOPS=26, BW=104KiB/s (107kB/s)(5992KiB/57342msec) clat (usec): min=34, max=688005, avg=18931.31, stdev=21560.52 lat (usec): min=34, max=688007, avg=18934.25, stdev=21560.03 clat percentiles (usec): | 1.00th=[ 54], 5.00th=[ 126], 10.00th=[ 8094], 20.00th=[ 10421], | 30.00th=[ 11863], 40.00th=[ 13960], 50.00th=[ 16712], 60.00th=[ 19006], | 70.00th=[ 21890], 80.00th=[ 25297], 90.00th=[ 31327], 95.00th=[ 37487], | 99.00th=[ 57410], 99.50th=[ 72877], 99.90th=[248513], 99.95th=[692061], | 99.99th=[692061] bw ( KiB/s): min= 40, max= 199, per=25.20%, avg=105.34, stdev=32.24, samples=113 iops : min= 10, max= 49, avg=25.89, stdev= 8.07, samples=113 write: IOPS=27, BW=110KiB/s (112kB/s)(6296KiB/57342msec); 0 zone resets clat (usec): min=810, max=152101, avg=18285.81, stdev=16654.85 lat (usec): min=810, max=152103, avg=18288.62, stdev=16655.28 clat percentiles (usec): | 1.00th=[ 1057], 5.00th=[ 1795], 10.00th=[ 2507], 20.00th=[ 3884], | 30.00th=[ 7111], 40.00th=[ 11076], 50.00th=[ 14484], 60.00th=[ 18482], | 70.00th=[ 22676], 80.00th=[ 29230], 90.00th=[ 39060], 95.00th=[ 47973], | 99.00th=[ 77071], 99.50th=[100140], 99.90th=[135267], 99.95th=[152044], | 99.99th=[152044] bw ( KiB/s): min= 39, max= 223, per=25.23%, avg=110.50, stdev=30.98, samples=113 iops : min= 9, max= 55, avg=27.19, stdev= 7.82, samples=113 lat (usec) : 50=0.33%, 100=1.37%, 250=1.11%, 500=0.20%, 1000=0.33% lat (msec) : 2=2.90%, 4=7.45%, 10=14.06%, 20=35.55%, 50=33.79% lat (msec) : 100=2.57%, 250=0.33%, 750=0.03% cpu : usr=0.11%, sys=17.42%, ctx=7989, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146497: Fri Jun 26 10:20:40 2026 read: IOPS=26, BW=107KiB/s (110kB/s)(5940KiB/55305msec) clat (usec): min=44, max=140288, avg=17977.51, stdev=11873.24 lat (usec): min=44, max=140289, avg=17980.28, stdev=11872.32 clat percentiles (usec): | 1.00th=[ 54], 5.00th=[ 121], 10.00th=[ 7963], 20.00th=[ 10159], | 30.00th=[ 11994], 40.00th=[ 13698], 50.00th=[ 16057], 60.00th=[ 17957], | 70.00th=[ 20841], 80.00th=[ 24773], 90.00th=[ 30540], 95.00th=[ 36963], | 99.00th=[ 60031], 99.50th=[ 76022], 99.90th=[120062], 99.95th=[139461], | 99.99th=[139461] bw ( KiB/s): min= 6, max= 176, per=25.74%, avg=107.59, stdev=31.61, samples=109 iops : min= 1, max= 44, avg=26.47, stdev= 7.93, samples=109 write: IOPS=28, BW=115KiB/s (118kB/s)(6348KiB/55305msec); 0 zone resets clat (usec): min=744, max=670804, avg=17902.80, stdev=23109.87 lat (usec): min=744, max=670805, avg=17907.68, stdev=23109.71 clat percentiles (usec): | 1.00th=[ 1090], 5.00th=[ 1680], 10.00th=[ 2311], 20.00th=[ 3490], | 30.00th=[ 6063], 40.00th=[ 10814], 50.00th=[ 13960], 60.00th=[ 17957], | 70.00th=[ 22414], 80.00th=[ 28443], 90.00th=[ 36963], 95.00th=[ 45876], | 99.00th=[ 70779], 99.50th=[ 77071], 99.90th=[227541], 99.95th=[666895], | 99.99th=[666895] bw ( KiB/s): min= 48, max= 219, per=26.40%, avg=115.62, stdev=30.90, samples=108 iops : min= 12, max= 54, avg=28.47, stdev= 7.74, samples=108 lat (usec) : 50=0.20%, 100=1.69%, 250=1.04%, 500=0.10%, 750=0.03% lat (usec) : 1000=0.33% lat (msec) : 2=3.71%, 4=7.78%, 10=14.16%, 20=36.88%, 50=31.25% lat (msec) : 100=2.60%, 250=0.20%, 750=0.03% cpu : usr=0.14%, sys=17.65%, ctx=7858, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146498: Fri Jun 26 10:20:40 2026 read: IOPS=26, BW=106KiB/s (109kB/s)(6028KiB/56853msec) clat (usec): min=35, max=139443, avg=18577.10, stdev=12765.91 lat (usec): min=35, max=139444, avg=18578.22, stdev=12765.93 clat percentiles (usec): | 1.00th=[ 55], 5.00th=[ 167], 10.00th=[ 7963], 20.00th=[ 10159], | 30.00th=[ 11994], 40.00th=[ 14091], 50.00th=[ 16057], 60.00th=[ 18220], | 70.00th=[ 21627], 80.00th=[ 25560], 90.00th=[ 32113], 95.00th=[ 39584], | 99.00th=[ 66847], 99.50th=[ 79168], 99.90th=[135267], 99.95th=[139461], | 99.99th=[139461] bw ( KiB/s): min= 48, max= 223, per=25.56%, avg=106.86, stdev=29.52, samples=112 iops : min= 12, max= 55, avg=26.28, stdev= 7.37, samples=112 write: IOPS=27, BW=110KiB/s (113kB/s)(6260KiB/56853msec); 0 zone resets clat (usec): min=919, max=675772, avg=18304.34, stdev=23024.18 lat (usec): min=921, max=675772, avg=18306.72, stdev=23024.49 clat percentiles (usec): | 1.00th=[ 1221], 5.00th=[ 1827], 10.00th=[ 2442], 20.00th=[ 3654], | 30.00th=[ 6325], 40.00th=[ 10421], 50.00th=[ 14222], 60.00th=[ 18482], | 70.00th=[ 23200], 80.00th=[ 29754], 90.00th=[ 38536], 95.00th=[ 46924], | 99.00th=[ 70779], 99.50th=[ 82314], 99.90th=[147850], 99.95th=[675283], | 99.99th=[675283] bw ( KiB/s): min= 13, max= 224, per=25.08%, avg=109.83, stdev=32.06, samples=113 iops : min= 3, max= 56, avg=27.03, stdev= 8.10, samples=113 lat (usec) : 50=0.29%, 100=1.46%, 250=0.81%, 500=0.07%, 750=0.03% lat (usec) : 1000=0.07% lat (msec) : 2=2.99%, 4=8.37%, 10=15.30%, 20=35.12%, 50=32.49% lat (msec) : 100=2.70%, 250=0.26%, 750=0.03% cpu : usr=0.13%, sys=17.34%, ctx=7901, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146499: Fri Jun 26 10:20:40 2026 read: IOPS=27, BW=109KiB/s (111kB/s)(6052KiB/55774msec) clat (usec): min=36, max=240601, avg=19004.58, stdev=14204.75 lat (usec): min=36, max=240602, avg=19008.43, stdev=14203.60 clat percentiles (usec): | 1.00th=[ 56], 5.00th=[ 129], 10.00th=[ 7963], 20.00th=[ 10552], | 30.00th=[ 12387], 40.00th=[ 14353], 50.00th=[ 16450], 60.00th=[ 18744], | 70.00th=[ 22152], 80.00th=[ 26084], 90.00th=[ 32900], 95.00th=[ 39060], | 99.00th=[ 64226], 99.50th=[ 98042], 99.90th=[175113], 99.95th=[240124], | 99.99th=[240124] bw ( KiB/s): min= 32, max= 192, per=26.09%, avg=109.07, stdev=28.74, samples=109 iops : min= 8, max= 48, avg=26.83, stdev= 7.25, samples=109 write: IOPS=27, BW=112KiB/s (114kB/s)(6236KiB/55774msec); 0 zone resets clat (usec): min=740, max=713495, avg=17185.00, stdev=22913.50 lat (usec): min=741, max=713497, avg=17186.36, stdev=22913.52 clat percentiles (usec): | 1.00th=[ 1172], 5.00th=[ 1762], 10.00th=[ 2442], 20.00th=[ 3523], | 30.00th=[ 5866], 40.00th=[ 9503], 50.00th=[ 13173], 60.00th=[ 17433], | 70.00th=[ 21627], 80.00th=[ 27395], 90.00th=[ 35914], 95.00th=[ 44827], | 99.00th=[ 63701], 99.50th=[ 74974], 99.90th=[119014], 99.95th=[717226], | 99.99th=[717226] bw ( KiB/s): min= 23, max= 175, per=25.71%, avg=112.61, stdev=30.05, samples=109 iops : min= 5, max= 43, avg=27.72, stdev= 7.50, samples=109 lat (usec) : 50=0.26%, 100=1.50%, 250=1.11%, 500=0.07%, 750=0.03% lat (usec) : 1000=0.10% lat (msec) : 2=3.12%, 4=8.43%, 10=14.78%, 20=36.04%, 50=32.23% lat (msec) : 100=1.99%, 250=0.33%, 750=0.03% cpu : usr=0.13%, sys=17.75%, ctx=7887, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=419KiB/s (429kB/s), 104KiB/s-109KiB/s (107kB/s-111kB/s), io=23.4MiB (24.6MB), run=55305-57342msec WRITE: bw=438KiB/s (449kB/s), 110KiB/s-115KiB/s (112kB/s-118kB/s), io=24.6MiB (25.7MB), run=55305-57342msec fio: pid=146493, err=5/file:backend.c:481, func=full resid, error=Input/output error rand-rw: (groupid=0, jobs=1): err= 0: pid=146492: Fri Jun 26 10:21:20 2026 read: IOPS=15, BW=61.4KiB/s (62.9kB/s)(5992KiB/97525msec) clat (msec): min=3, max=683, avg=16.34, stdev=23.15 lat (msec): min=3, max=683, avg=16.34, stdev=23.15 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 6], 10.00th=[ 6], 20.00th=[ 7], | 30.00th=[ 8], 40.00th=[ 9], 50.00th=[ 11], 60.00th=[ 13], | 70.00th=[ 16], 80.00th=[ 22], 90.00th=[ 33], 95.00th=[ 47], | 99.00th=[ 82], 99.50th=[ 96], 99.90th=[ 211], 99.95th=[ 684], | 99.99th=[ 684] bw ( KiB/s): min= 7, max= 184, per=26.30%, avg=61.54, stdev=37.16, samples=193 iops : min= 1, max= 46, avg=15.01, stdev= 9.36, samples=193 write: IOPS=16, BW=64.6KiB/s (66.1kB/s)(6296KiB/97525msec); 0 zone resets clat (msec): min=15, max=230, avg=46.27, stdev=24.39 lat (msec): min=15, max=230, avg=46.27, stdev=24.39 clat percentiles (msec): | 1.00th=[ 18], 5.00th=[ 22], 10.00th=[ 24], 20.00th=[ 28], | 30.00th=[ 31], 40.00th=[ 35], 50.00th=[ 40], 60.00th=[ 45], | 70.00th=[ 52], 80.00th=[ 63], 90.00th=[ 80], 95.00th=[ 95], | 99.00th=[ 129], 99.50th=[ 157], 99.90th=[ 188], 99.95th=[ 232], | 99.99th=[ 232] bw ( KiB/s): min= 15, max= 136, per=26.35%, avg=64.56, stdev=29.50, samples=193 iops : min= 3, max= 34, avg=15.77, stdev= 7.46, samples=193 lat (msec) : 4=0.13%, 10=22.59%, 20=16.93%, 50=41.93%, 100=16.41% lat (msec) : 250=1.99%, 750=0.03% cpu : usr=0.09%, sys=5.41%, ctx=5713, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 5 (file:backend.c:481, func=full resid, error=Input/output error): pid=146493: Fri Jun 26 10:21:20 2026 read: IOPS=14, BW=56.2KiB/s (57.6kB/s)(4824KiB/85829msec) clat (msec): min=3, max=676, avg=17.82, stdev=24.22 lat (msec): min=3, max=676, avg=17.83, stdev=24.22 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 6], 10.00th=[ 6], 20.00th=[ 8], | 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 12], 60.00th=[ 15], | 70.00th=[ 19], 80.00th=[ 26], 90.00th=[ 37], 95.00th=[ 50], | 99.00th=[ 74], 99.50th=[ 86], 99.90th=[ 146], 99.95th=[ 676], | 99.99th=[ 676] bw ( KiB/s): min= 8, max= 176, per=24.22%, avg=56.68, stdev=33.40, samples=167 iops : min= 2, max= 44, avg=13.79, stdev= 8.42, samples=167 write: IOPS=14, BW=59.6KiB/s (61.0kB/s)(5116KiB/85829msec); 0 zone resets clat (msec): min=15, max=252, avg=50.12, stdev=26.15 lat (msec): min=15, max=252, avg=50.12, stdev=26.15 clat percentiles (msec): | 1.00th=[ 20], 5.00th=[ 24], 10.00th=[ 26], 20.00th=[ 30], | 30.00th=[ 34], 40.00th=[ 39], 50.00th=[ 44], 60.00th=[ 51], | 70.00th=[ 57], 80.00th=[ 68], 90.00th=[ 83], 95.00th=[ 102], | 99.00th=[ 140], 99.50th=[ 163], 99.90th=[ 230], 99.95th=[ 253], | 99.99th=[ 253] bw ( KiB/s): min= 23, max= 136, per=24.29%, avg=59.50, stdev=26.87, samples=169 iops : min= 5, max= 34, avg=14.49, stdev= 6.80, samples=169 lat (msec) : 4=0.16%, 10=20.31%, 20=15.29%, 50=41.59%, 100=19.83% lat (msec) : 250=2.70%, 500=0.04%, 750=0.04% cpu : usr=0.12%, sys=5.15%, ctx=4491, majf=0, minf=19 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1207,1279,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146494: Fri Jun 26 10:21:20 2026 read: IOPS=15, BW=61.0KiB/s (63.5kB/s)(6028KiB/97277msec) clat (msec): min=3, max=142, avg=16.49, stdev=14.61 lat (msec): min=3, max=142, avg=16.49, stdev=14.61 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 5], 10.00th=[ 6], 20.00th=[ 7], | 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 12], 60.00th=[ 14], | 70.00th=[ 17], 80.00th=[ 24], 90.00th=[ 34], 95.00th=[ 44], | 99.00th=[ 74], 99.50th=[ 89], 99.90th=[ 129], 99.95th=[ 142], | 99.99th=[ 142] bw ( KiB/s): min= 7, max= 167, per=26.61%, avg=62.28, stdev=33.75, samples=191 iops : min= 1, max= 41, avg=15.20, stdev= 8.47, samples=191 write: IOPS=16, BW=64.4KiB/s (65.9kB/s)(6260KiB/97277msec); 0 zone resets clat (msec): min=15, max=725, avg=46.14, stdev=29.21 lat (msec): min=15, max=725, avg=46.14, stdev=29.21 clat percentiles (msec): | 1.00th=[ 19], 5.00th=[ 22], 10.00th=[ 24], 20.00th=[ 28], | 30.00th=[ 32], 40.00th=[ 35], 50.00th=[ 39], 60.00th=[ 44], | 70.00th=[ 52], 80.00th=[ 62], 90.00th=[ 81], 95.00th=[ 90], | 99.00th=[ 121], 99.50th=[ 140], 99.90th=[ 257], 99.95th=[ 726], | 99.99th=[ 726] bw ( KiB/s): min= 23, max= 134, per=26.24%, avg=64.29, stdev=29.43, samples=192 iops : min= 5, max= 33, avg=15.70, stdev= 7.46, samples=192 lat (msec) : 4=0.39%, 10=19.99%, 20=18.07%, 50=43.91%, 100=15.89% lat (msec) : 250=1.69%, 500=0.03%, 750=0.03% cpu : usr=0.11%, sys=5.46%, ctx=5719, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146495: Fri Jun 26 10:21:20 2026 read: IOPS=15, BW=62.4KiB/s (63.9kB/s)(6052KiB/97056msec) clat (msec): min=3, max=139, avg=15.84, stdev=14.76 lat (msec): min=3, max=139, avg=15.84, stdev=14.76 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 6], 10.00th=[ 6], 20.00th=[ 7], | 30.00th=[ 8], 40.00th=[ 9], 50.00th=[ 11], 60.00th=[ 13], | 70.00th=[ 16], 80.00th=[ 22], 90.00th=[ 35], 95.00th=[ 46], | 99.00th=[ 77], 99.50th=[ 95], 99.90th=[ 126], 99.95th=[ 140], | 99.99th=[ 140] bw ( KiB/s): min= 7, max= 184, per=26.83%, avg=62.79, stdev=36.59, samples=191 iops : min= 1, max= 46, avg=15.32, stdev= 9.23, samples=191 write: IOPS=16, BW=64.3KiB/s (65.8kB/s)(6236KiB/97056msec); 0 zone resets clat (msec): min=15, max=706, avg=46.74, stdev=29.42 lat (msec): min=15, max=706, avg=46.74, stdev=29.42 clat percentiles (msec): | 1.00th=[ 18], 5.00th=[ 21], 10.00th=[ 24], 20.00th=[ 28], | 30.00th=[ 32], 40.00th=[ 36], 50.00th=[ 40], 60.00th=[ 45], | 70.00th=[ 53], 80.00th=[ 64], 90.00th=[ 80], 95.00th=[ 94], | 99.00th=[ 125], 99.50th=[ 140], 99.90th=[ 230], 99.95th=[ 709], | 99.99th=[ 709] bw ( KiB/s): min= 8, max= 134, per=26.22%, avg=64.24, stdev=29.29, samples=192 iops : min= 2, max= 33, avg=15.69, stdev= 7.41, samples=192 lat (msec) : 4=0.39%, 10=22.49%, 20=17.51%, 50=41.28%, 100=16.24% lat (msec) : 250=2.05%, 750=0.03% cpu : usr=0.10%, sys=5.47%, ctx=5802, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=235KiB/s (240kB/s), 56.2KiB/s-62.4KiB/s (57.6kB/s-63.9kB/s), io=22.4MiB (23.4MB), run=85829-97525msec WRITE: bw=245KiB/s (251kB/s), 59.6KiB/s-64.6KiB/s (61.0kB/s-66.1kB/s), io=23.3MiB (24.5MB), run=85829-97525msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=146527: Fri Jun 26 10:21:41 2026 read: IOPS=25, BW=407KiB/s (417kB/s)(5920KiB/14541msec) clat (usec): min=42, max=126274, avg=21112.76, stdev=14505.43 lat (usec): min=43, max=126276, avg=21114.51, stdev=14505.25 clat percentiles (usec): | 1.00th=[ 52], 5.00th=[ 122], 10.00th=[ 8848], 20.00th=[ 11994], | 30.00th=[ 13960], 40.00th=[ 16188], 50.00th=[ 18744], 60.00th=[ 21627], | 70.00th=[ 24511], 80.00th=[ 29492], 90.00th=[ 36439], 95.00th=[ 42730], | 99.00th=[ 77071], 99.50th=[117965], 99.90th=[126354], 99.95th=[126354], | 99.99th=[126354] bw ( KiB/s): min= 192, max= 600, per=25.86%, avg=404.96, stdev=107.88, samples=28 iops : min= 12, max= 37, avg=24.86, stdev= 6.70, samples=28 write: IOPS=27, BW=438KiB/s (448kB/s)(6368KiB/14541msec); 0 zone resets clat (usec): min=1548, max=63654, avg=16833.53, stdev=11744.85 lat (usec): min=1550, max=63657, avg=16836.03, stdev=11744.98 clat percentiles (usec): | 1.00th=[ 1991], 5.00th=[ 3490], 10.00th=[ 4359], 20.00th=[ 6194], | 30.00th=[ 8455], 40.00th=[11338], 50.00th=[14353], 60.00th=[17433], | 70.00th=[21103], 80.00th=[26084], 90.00th=[33162], 95.00th=[41681], | 99.00th=[52167], 99.50th=[55837], 99.90th=[63701], 99.95th=[63701], | 99.99th=[63701] bw ( KiB/s): min= 189, max= 640, per=26.72%, avg=440.39, stdev=119.89, samples=28 iops : min= 11, max= 40, avg=27.07, stdev= 7.61, samples=28 lat (usec) : 50=0.39%, 100=1.17%, 250=2.21%, 500=0.13% lat (msec) : 2=0.52%, 4=3.91%, 10=15.36%, 20=36.98%, 50=36.98% lat (msec) : 100=2.08%, 250=0.26% cpu : usr=0.15%, sys=25.76%, ctx=2393, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146529: Fri Jun 26 10:21:41 2026 read: IOPS=24, BW=388KiB/s (397kB/s)(5744KiB/14799msec) clat (usec): min=49, max=99105, avg=20547.81, stdev=12235.87 lat (usec): min=51, max=99106, avg=20548.90, stdev=12235.77 clat percentiles (usec): | 1.00th=[ 71], 5.00th=[ 113], 10.00th=[ 8979], 20.00th=[12125], | 30.00th=[14615], 40.00th=[16909], 50.00th=[19006], 60.00th=[21627], | 70.00th=[24773], 80.00th=[27395], 90.00th=[34341], 95.00th=[43254], | 99.00th=[57934], 99.50th=[68682], 99.90th=[99091], 99.95th=[99091], | 99.99th=[99091] bw ( KiB/s): min= 128, max= 608, per=24.53%, avg=384.07, stdev=112.44, samples=29 iops : min= 8, max= 38, avg=23.52, stdev= 7.09, samples=29 write: IOPS=27, BW=442KiB/s (453kB/s)(6544KiB/14799msec); 0 zone resets clat (usec): min=1281, max=129006, avg=17931.61, stdev=14136.01 lat (usec): min=1283, max=129008, avg=17933.47, stdev=14136.11 clat percentiles (usec): | 1.00th=[ 1582], 5.00th=[ 3425], 10.00th=[ 4080], 20.00th=[ 5735], | 30.00th=[ 8455], 40.00th=[ 11600], 50.00th=[ 14615], 60.00th=[ 18744], | 70.00th=[ 23200], 80.00th=[ 27395], 90.00th=[ 35390], 95.00th=[ 45876], | 99.00th=[ 58459], 99.50th=[ 70779], 99.90th=[129500], 99.95th=[129500], | 99.99th=[129500] bw ( KiB/s): min= 256, max= 636, per=26.27%, avg=432.93, stdev=97.66, samples=29 iops : min= 16, max= 39, avg=26.59, stdev= 6.07, samples=29 lat (usec) : 50=0.13%, 100=1.56%, 250=1.69%, 500=0.13% lat (msec) : 2=0.91%, 4=4.30%, 10=15.63%, 20=34.90%, 50=37.76% lat (msec) : 100=2.86%, 250=0.13% cpu : usr=0.11%, sys=25.34%, ctx=2499, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146531: Fri Jun 26 10:21:41 2026 read: IOPS=25, BW=409KiB/s (419kB/s)(6256KiB/15286msec) clat (usec): min=32, max=67032, avg=20066.07, stdev=11452.63 lat (usec): min=33, max=67033, avg=20085.43, stdev=11468.47 clat percentiles (usec): | 1.00th=[ 61], 5.00th=[ 120], 10.00th=[ 7111], 20.00th=[11207], | 30.00th=[14353], 40.00th=[16712], 50.00th=[19006], 60.00th=[21365], | 70.00th=[24511], 80.00th=[28967], 90.00th=[33817], 95.00th=[40633], | 99.00th=[53740], 99.50th=[65274], 99.90th=[66847], 99.95th=[66847], | 99.99th=[66847] bw ( KiB/s): min= 128, max= 736, per=25.82%, avg=404.37, stdev=134.04, samples=30 iops : min= 8, max= 46, avg=24.83, stdev= 8.39, samples=30 write: IOPS=24, BW=395KiB/s (404kB/s)(6032KiB/15286msec); 0 zone resets clat (usec): min=1298, max=121350, avg=19444.72, stdev=15864.54 lat (usec): min=1300, max=121352, avg=19447.06, stdev=15864.60 clat percentiles (usec): | 1.00th=[ 1647], 5.00th=[ 2966], 10.00th=[ 4228], 20.00th=[ 5342], | 30.00th=[ 8848], 40.00th=[ 12256], 50.00th=[ 15664], 60.00th=[ 20055], | 70.00th=[ 24511], 80.00th=[ 30278], 90.00th=[ 38536], 95.00th=[ 51643], | 99.00th=[ 77071], 99.50th=[ 85459], 99.90th=[121111], 99.95th=[121111], | 99.99th=[121111] bw ( KiB/s): min= 191, max= 704, per=23.32%, avg=384.23, stdev=117.86, samples=30 iops : min= 11, max= 44, avg=23.57, stdev= 7.51, samples=30 lat (usec) : 50=0.13%, 100=1.04%, 250=2.86%, 500=0.13% lat (msec) : 2=0.78%, 4=3.78%, 10=16.41%, 20=31.90%, 50=39.84% lat (msec) : 100=2.99%, 250=0.13% cpu : usr=0.10%, sys=24.01%, ctx=2645, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146533: Fri Jun 26 10:21:41 2026 read: IOPS=26, BW=417KiB/s (427kB/s)(6032KiB/14474msec) clat (usec): min=43, max=136997, avg=20757.15, stdev=15420.67 lat (usec): min=44, max=136998, avg=20758.32, stdev=15420.66 clat percentiles (usec): | 1.00th=[ 74], 5.00th=[ 113], 10.00th=[ 161], 20.00th=[ 12256], | 30.00th=[ 14353], 40.00th=[ 16450], 50.00th=[ 18744], 60.00th=[ 21627], | 70.00th=[ 24511], 80.00th=[ 28705], 90.00th=[ 34866], 95.00th=[ 40633], | 99.00th=[ 94897], 99.50th=[125305], 99.90th=[137364], 99.95th=[137364], | 99.99th=[137364] bw ( KiB/s): min= 254, max= 542, per=26.76%, avg=419.04, stdev=84.38, samples=28 iops : min= 15, max= 33, avg=25.75, stdev= 5.25, samples=28 write: IOPS=27, BW=432KiB/s (443kB/s)(6256KiB/14474msec); 0 zone resets clat (usec): min=1620, max=79614, avg=16801.08, stdev=12976.76 lat (usec): min=1623, max=79616, avg=16802.99, stdev=12976.70 clat percentiles (usec): | 1.00th=[ 2008], 5.00th=[ 3163], 10.00th=[ 4178], 20.00th=[ 5276], | 30.00th=[ 7308], 40.00th=[10290], 50.00th=[13566], 60.00th=[16581], | 70.00th=[21627], 80.00th=[27395], 90.00th=[34866], 95.00th=[41157], | 99.00th=[57934], 99.50th=[73925], 99.90th=[79168], 99.95th=[79168], | 99.99th=[79168] bw ( KiB/s): min= 160, max= 704, per=26.38%, avg=434.82, stdev=118.21, samples=28 iops : min= 10, max= 44, avg=26.75, stdev= 7.42, samples=28 lat (usec) : 50=0.13%, 100=1.82%, 250=3.78%, 500=0.13%, 1000=0.13% lat (msec) : 2=0.52%, 4=4.04%, 10=16.15%, 20=34.77%, 50=36.20% lat (msec) : 100=1.95%, 250=0.39% cpu : usr=0.19%, sys=24.87%, ctx=2386, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1567KiB/s (1605kB/s), 388KiB/s-417KiB/s (397kB/s-427kB/s), io=23.4MiB (24.5MB), run=14474-15286msec WRITE: bw=1649KiB/s (1688kB/s), 395KiB/s-442KiB/s (404kB/s-453kB/s), io=24.6MiB (25.8MB), run=14474-15286msec rand-rw: (groupid=0, jobs=1): err= 0: pid=146528: Fri Jun 26 10:21:49 2026 read: IOPS=16, BW=264KiB/s (270kB/s)(5920KiB/22420msec) clat (usec): min=4260, max=93016, avg=16826.16, stdev=13293.54 lat (usec): min=4262, max=93018, avg=16827.37, stdev=13293.53 clat percentiles (usec): | 1.00th=[ 4555], 5.00th=[ 5014], 10.00th=[ 5932], 20.00th=[ 6915], | 30.00th=[ 8717], 40.00th=[10028], 50.00th=[12649], 60.00th=[15139], | 70.00th=[18744], 80.00th=[22414], 90.00th=[34341], 95.00th=[49021], | 99.00th=[65274], 99.50th=[74974], 99.90th=[92799], 99.95th=[92799], | 99.99th=[92799] bw ( KiB/s): min= 32, max= 636, per=24.73%, avg=259.45, stdev=136.02, samples=44 iops : min= 2, max= 39, avg=15.66, stdev= 8.55, samples=44 write: IOPS=17, BW=284KiB/s (291kB/s)(6368KiB/22420msec); 0 zone resets clat (msec): min=16, max=195, avg=40.43, stdev=21.25 lat (msec): min=16, max=195, avg=40.43, stdev=21.25 clat percentiles (msec): | 1.00th=[ 18], 5.00th=[ 21], 10.00th=[ 22], 20.00th=[ 25], | 30.00th=[ 28], 40.00th=[ 31], 50.00th=[ 35], 60.00th=[ 39], | 70.00th=[ 45], 80.00th=[ 54], 90.00th=[ 65], 95.00th=[ 81], | 99.00th=[ 131], 99.50th=[ 146], 99.90th=[ 197], 99.95th=[ 197], | 99.99th=[ 197] bw ( KiB/s): min= 127, max= 512, per=25.56%, avg=282.20, stdev=121.56, samples=44 iops : min= 7, max= 32, avg=17.09, stdev= 7.66, samples=44 lat (msec) : 10=19.14%, 20=18.75%, 50=48.44%, 100=12.50%, 250=1.17% cpu : usr=0.08%, sys=9.13%, ctx=1630, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146530: Fri Jun 26 10:21:49 2026 read: IOPS=15, BW=252KiB/s (258kB/s)(5744KiB/22814msec) clat (msec): min=3, max=104, avg=16.68, stdev=15.97 lat (msec): min=3, max=104, avg=16.69, stdev=15.97 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 5], 10.00th=[ 6], 20.00th=[ 7], | 30.00th=[ 8], 40.00th=[ 10], 50.00th=[ 12], 60.00th=[ 14], | 70.00th=[ 17], 80.00th=[ 23], 90.00th=[ 34], 95.00th=[ 54], | 99.00th=[ 87], 99.50th=[ 103], 99.90th=[ 105], 99.95th=[ 105], | 99.99th=[ 105] bw ( KiB/s): min= 32, max= 736, per=23.75%, avg=249.18, stdev=156.60, samples=45 iops : min= 2, max= 46, avg=15.02, stdev= 9.80, samples=45 write: IOPS=17, BW=287KiB/s (294kB/s)(6544KiB/22814msec); 0 zone resets clat (msec): min=13, max=164, avg=41.05, stdev=22.87 lat (msec): min=13, max=164, avg=41.05, stdev=22.87 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 19], 10.00th=[ 21], 20.00th=[ 24], | 30.00th=[ 28], 40.00th=[ 32], 50.00th=[ 35], 60.00th=[ 40], | 70.00th=[ 45], 80.00th=[ 56], 90.00th=[ 71], 95.00th=[ 90], | 99.00th=[ 120], 99.50th=[ 144], 99.90th=[ 165], 99.95th=[ 165], | 99.99th=[ 165] bw ( KiB/s): min= 95, max= 608, per=25.62%, avg=282.84, stdev=129.88, samples=45 iops : min= 5, max= 38, avg=17.13, stdev= 8.19, samples=45 lat (msec) : 4=0.78%, 10=19.79%, 20=20.18%, 50=43.75%, 100=13.80% lat (msec) : 250=1.69% cpu : usr=0.11%, sys=8.68%, ctx=1588, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146532: Fri Jun 26 10:21:49 2026 read: IOPS=17, BW=279KiB/s (286kB/s)(6256KiB/22401msec) clat (msec): min=4, max=102, avg=17.07, stdev=14.36 lat (msec): min=4, max=102, avg=17.08, stdev=14.36 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 6], 10.00th=[ 7], 20.00th=[ 8], | 30.00th=[ 9], 40.00th=[ 11], 50.00th=[ 13], 60.00th=[ 15], | 70.00th=[ 18], 80.00th=[ 24], 90.00th=[ 37], 95.00th=[ 50], | 99.00th=[ 71], 99.50th=[ 85], 99.90th=[ 103], 99.95th=[ 103], | 99.99th=[ 103] bw ( KiB/s): min= 95, max= 736, per=26.69%, avg=279.98, stdev=160.49, samples=44 iops : min= 5, max= 46, avg=16.95, stdev=10.06, samples=44 write: IOPS=16, BW=269KiB/s (276kB/s)(6032KiB/22401msec); 0 zone resets clat (msec): min=15, max=161, avg=41.46, stdev=22.18 lat (msec): min=15, max=161, avg=41.46, stdev=22.18 clat percentiles (msec): | 1.00th=[ 18], 5.00th=[ 20], 10.00th=[ 22], 20.00th=[ 25], | 30.00th=[ 28], 40.00th=[ 32], 50.00th=[ 36], 60.00th=[ 40], | 70.00th=[ 47], 80.00th=[ 54], 90.00th=[ 67], 95.00th=[ 87], | 99.00th=[ 127], 99.50th=[ 142], 99.90th=[ 161], 99.95th=[ 161], | 99.99th=[ 161] bw ( KiB/s): min= 96, max= 512, per=24.05%, avg=265.52, stdev=114.50, samples=44 iops : min= 6, max= 32, avg=16.05, stdev= 7.22, samples=44 lat (msec) : 10=20.31%, 20=20.96%, 50=43.62%, 100=13.41%, 250=1.69% cpu : usr=0.10%, sys=9.22%, ctx=1659, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146534: Fri Jun 26 10:21:49 2026 read: IOPS=16, BW=267KiB/s (273kB/s)(6032KiB/22619msec) clat (usec): min=3454, max=92306, avg=17252.79, stdev=14720.24 lat (usec): min=3455, max=92306, avg=17253.99, stdev=14720.17 clat percentiles (usec): | 1.00th=[ 3982], 5.00th=[ 5014], 10.00th=[ 5800], 20.00th=[ 6980], | 30.00th=[ 8094], 40.00th=[ 9896], 50.00th=[11994], 60.00th=[14615], | 70.00th=[18482], 80.00th=[24773], 90.00th=[34341], 95.00th=[50070], | 99.00th=[76022], 99.50th=[88605], 99.90th=[92799], 99.95th=[92799], | 99.99th=[92799] bw ( KiB/s): min= 95, max= 672, per=24.84%, avg=260.55, stdev=141.03, samples=44 iops : min= 5, max= 42, avg=15.73, stdev= 8.92, samples=44 write: IOPS=17, BW=277KiB/s (283kB/s)(6256KiB/22619msec); 0 zone resets clat (msec): min=14, max=191, avg=41.02, stdev=22.62 lat (msec): min=14, max=191, avg=41.02, stdev=22.62 clat percentiles (msec): | 1.00th=[ 18], 5.00th=[ 20], 10.00th=[ 22], 20.00th=[ 25], | 30.00th=[ 28], 40.00th=[ 31], 50.00th=[ 34], 60.00th=[ 39], | 70.00th=[ 45], 80.00th=[ 55], 90.00th=[ 72], 95.00th=[ 86], | 99.00th=[ 118], 99.50th=[ 148], 99.90th=[ 192], 99.95th=[ 192], | 99.99th=[ 192] bw ( KiB/s): min= 63, max= 512, per=24.64%, avg=272.05, stdev=127.88, samples=44 iops : min= 3, max= 32, avg=16.45, stdev= 8.04, samples=44 lat (msec) : 4=0.52%, 10=19.14%, 20=18.88%, 50=47.14%, 100=13.41% lat (msec) : 250=0.91% cpu : usr=0.07%, sys=8.89%, ctx=1639, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1050KiB/s (1075kB/s), 252KiB/s-279KiB/s (258kB/s-286kB/s), io=23.4MiB (24.5MB), run=22401-22814msec WRITE: bw=1105KiB/s (1131kB/s), 269KiB/s-287KiB/s (276kB/s-294kB/s), io=24.6MiB (25.8MB), run=22401-22814msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=146544: Fri Jun 26 10:22:00 2026 read: IOPS=1, BW=1791KiB/s (1834kB/s)(7168KiB/4003msec) clat (msec): min=58, max=618, avg=198.72, stdev=193.07 lat (msec): min=58, max=618, avg=198.72, stdev=193.07 clat percentiles (msec): | 1.00th=[ 59], 5.00th=[ 59], 10.00th=[ 59], 20.00th=[ 91], | 30.00th=[ 91], 40.00th=[ 91], 50.00th=[ 142], 60.00th=[ 178], | 70.00th=[ 178], 80.00th=[ 215], 90.00th=[ 617], 95.00th=[ 617], | 99.00th=[ 617], 99.50th=[ 617], 99.90th=[ 617], 99.95th=[ 617], | 99.99th=[ 617] bw ( KiB/s): min= 1818, max= 5251, per=93.35%, avg=3721.67, stdev=1746.84, samples=3 iops : min= 1, max= 5, avg= 3.33, stdev= 2.08, samples=3 write: IOPS=1, BW=1279KiB/s (1310kB/s)(5120KiB/4003msec); 0 zone resets clat (msec): min=89, max=1640, avg=510.01, stdev=649.13 lat (msec): min=89, max=1640, avg=510.07, stdev=649.13 clat percentiles (msec): | 1.00th=[ 90], 5.00th=[ 90], 10.00th=[ 90], 20.00th=[ 90], | 30.00th=[ 117], 40.00th=[ 117], 50.00th=[ 236], 60.00th=[ 236], | 70.00th=[ 468], 80.00th=[ 468], 90.00th=[ 1636], 95.00th=[ 1636], | 99.00th=[ 1636], 99.50th=[ 1636], 99.90th=[ 1636], 99.95th=[ 1636], | 99.99th=[ 1636] bw ( KiB/s): min= 2048, max= 5919, per=71.36%, avg=3983.50, stdev=2737.21, samples=2 iops : min= 2, max= 5, avg= 3.50, stdev= 2.12, samples=2 lat (msec) : 100=33.33%, 250=41.67%, 500=8.33%, 750=8.33%, 2000=8.33% cpu : usr=0.00%, sys=9.07%, ctx=119, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146545: Fri Jun 26 10:22:00 2026 read: IOPS=0, BW=408KiB/s (418kB/s)(2048KiB/5022msec) clat (msec): min=74, max=594, avg=334.54, stdev=367.63 lat (msec): min=74, max=594, avg=334.54, stdev=367.63 clat percentiles (msec): | 1.00th=[ 75], 5.00th=[ 75], 10.00th=[ 75], 20.00th=[ 75], | 30.00th=[ 75], 40.00th=[ 75], 50.00th=[ 75], 60.00th=[ 592], | 70.00th=[ 592], 80.00th=[ 592], 90.00th=[ 592], 95.00th=[ 592], | 99.00th=[ 592], 99.50th=[ 592], 99.90th=[ 592], 99.95th=[ 592], | 99.99th=[ 592] bw ( KiB/s): min= 1726, max= 2048, per=47.33%, avg=1887.00, stdev=227.69, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 write: IOPS=1, BW=2039KiB/s (2088kB/s)(10.0MiB/5022msec); 0 zone resets clat (msec): min=59, max=1303, avg=429.69, stdev=390.17 lat (msec): min=59, max=1303, avg=429.77, stdev=390.17 clat percentiles (msec): | 1.00th=[ 59], 5.00th=[ 59], 10.00th=[ 59], 20.00th=[ 102], | 30.00th=[ 129], 40.00th=[ 169], 50.00th=[ 305], 60.00th=[ 326], | 70.00th=[ 493], 80.00th=[ 609], 90.00th=[ 802], 95.00th=[ 1301], | 99.00th=[ 1301], 99.50th=[ 1301], 99.90th=[ 1301], 99.95th=[ 1301], | 99.99th=[ 1301] bw ( KiB/s): min= 1818, max= 6144, per=57.88%, avg=3230.80, stdev=1872.79, samples=5 iops : min= 1, max= 6, avg= 3.00, stdev= 2.00, samples=5 lat (msec) : 100=16.67%, 250=25.00%, 500=25.00%, 750=16.67%, 1000=8.33% lat (msec) : 2000=8.33% cpu : usr=0.02%, sys=10.50%, ctx=122, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146546: Fri Jun 26 10:22:00 2026 read: IOPS=1, BW=1639KiB/s (1679kB/s)(6144KiB/3748msec) clat (msec): min=101, max=860, avg=297.31, stdev=306.20 lat (msec): min=101, max=860, avg=297.31, stdev=306.20 clat percentiles (msec): | 1.00th=[ 103], 5.00th=[ 103], 10.00th=[ 103], 20.00th=[ 112], | 30.00th=[ 112], 40.00th=[ 117], 50.00th=[ 117], 60.00th=[ 144], | 70.00th=[ 447], 80.00th=[ 447], 90.00th=[ 860], 95.00th=[ 860], | 99.00th=[ 860], 99.50th=[ 860], 99.90th=[ 860], 99.95th=[ 860], | 99.99th=[ 860] bw ( KiB/s): min= 2048, max= 5919, per=83.73%, avg=3338.33, stdev=2234.92, samples=3 iops : min= 2, max= 5, avg= 3.00, stdev= 1.73, samples=3 write: IOPS=1, BW=1639KiB/s (1679kB/s)(6144KiB/3748msec); 0 zone resets clat (msec): min=73, max=1159, avg=325.51, stdev=419.13 lat (msec): min=73, max=1160, avg=325.59, stdev=419.12 clat percentiles (msec): | 1.00th=[ 74], 5.00th=[ 74], 10.00th=[ 74], 20.00th=[ 105], | 30.00th=[ 105], 40.00th=[ 109], 50.00th=[ 109], 60.00th=[ 176], | 70.00th=[ 330], 80.00th=[ 330], 90.00th=[ 1167], 95.00th=[ 1167], | 99.00th=[ 1167], 99.50th=[ 1167], 99.90th=[ 1167], 99.95th=[ 1167], | 99.99th=[ 1167] bw ( KiB/s): min= 2048, max= 3946, per=51.59%, avg=2879.75, stdev=979.32, samples=4 iops : min= 2, max= 3, avg= 2.50, stdev= 0.58, samples=4 lat (msec) : 100=8.33%, 250=58.33%, 500=16.67%, 1000=8.33%, 2000=8.33% cpu : usr=0.05%, sys=8.94%, ctx=67, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146547: Fri Jun 26 10:22:00 2026 read: IOPS=0, BW=997KiB/s (1021kB/s)(5120KiB/5136msec) clat (msec): min=20, max=1524, avg=535.97, stdev=602.36 lat (msec): min=20, max=1524, avg=535.97, stdev=602.36 clat percentiles (msec): | 1.00th=[ 21], 5.00th=[ 21], 10.00th=[ 21], 20.00th=[ 21], | 30.00th=[ 84], 40.00th=[ 84], 50.00th=[ 485], 60.00th=[ 485], | 70.00th=[ 567], 80.00th=[ 567], 90.00th=[ 1519], 95.00th=[ 1519], | 99.00th=[ 1519], 99.50th=[ 1519], 99.90th=[ 1519], 99.95th=[ 1519], | 99.99th=[ 1519] bw ( KiB/s): min= 2048, max= 2048, per=51.37%, avg=2048.00, stdev= 0.00, samples=2 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1396KiB/s (1429kB/s)(7168KiB/5136msec); 0 zone resets clat (msec): min=48, max=1328, avg=340.67, stdev=457.17 lat (msec): min=48, max=1328, avg=340.75, stdev=457.17 clat percentiles (msec): | 1.00th=[ 48], 5.00th=[ 48], 10.00th=[ 48], 20.00th=[ 58], | 30.00th=[ 75], 40.00th=[ 75], 50.00th=[ 144], 60.00th=[ 326], | 70.00th=[ 326], 80.00th=[ 405], 90.00th=[ 1334], 95.00th=[ 1334], | 99.00th=[ 1334], 99.50th=[ 1334], 99.90th=[ 1334], 99.95th=[ 1334], | 99.99th=[ 1334] bw ( KiB/s): min= 1753, max= 3946, per=44.89%, avg=2505.67, stdev=1247.79, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (msec) : 50=16.67%, 100=25.00%, 250=8.33%, 500=25.00%, 750=8.33% lat (msec) : 2000=16.67% cpu : usr=0.00%, sys=7.24%, ctx=216, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3988KiB/s (4083kB/s), 408KiB/s-1791KiB/s (418kB/s-1834kB/s), io=20.0MiB (20.0MB), run=3748-5136msec WRITE: bw=5583KiB/s (5717kB/s), 1279KiB/s-2039KiB/s (1310kB/s-2088kB/s), io=28.0MiB (29.4MB), run=3748-5136msec rand-rw: (groupid=0, jobs=1): err= 0: pid=146549: Fri Jun 26 10:22:00 2026 read: IOPS=1, BW=1772KiB/s (1814kB/s)(7168KiB/4046msec) clat (usec): min=628, max=1124.2k, avg=268057.00, stdev=386308.55 lat (usec): min=629, max=1124.2k, avg=268058.49, stdev=386308.61 clat percentiles (usec): | 1.00th=[ 627], 5.00th=[ 627], 10.00th=[ 627], | 20.00th=[ 98042], 30.00th=[ 103285], 40.00th=[ 103285], | 50.00th=[ 131597], 60.00th=[ 141558], 70.00th=[ 141558], | 80.00th=[ 278922], 90.00th=[1132463], 95.00th=[1132463], | 99.00th=[1132463], 99.50th=[1132463], 99.90th=[1132463], | 99.95th=[1132463], 99.99th=[1132463] bw ( KiB/s): min= 1681, max= 4096, per=71.94%, avg=2977.00, stdev=1300.17, samples=4 iops : min= 1, max= 4, avg= 2.50, stdev= 1.73, samples=4 write: IOPS=1, BW=1265KiB/s (1296kB/s)(5120KiB/4046msec); 0 zone resets clat (msec): min=95, max=1426, avg=412.32, stdev=568.51 lat (msec): min=95, max=1426, avg=412.40, stdev=568.51 clat percentiles (msec): | 1.00th=[ 96], 5.00th=[ 96], 10.00th=[ 96], 20.00th=[ 96], | 30.00th=[ 150], 40.00th=[ 150], 50.00th=[ 169], 60.00th=[ 169], | 70.00th=[ 222], 80.00th=[ 222], 90.00th=[ 1435], 95.00th=[ 1435], | 99.00th=[ 1435], 99.50th=[ 1435], 99.90th=[ 1435], 99.95th=[ 1435], | 99.99th=[ 1435] bw ( KiB/s): min= 2048, max= 4096, per=47.14%, avg=2730.67, stdev=1182.41, samples=3 iops : min= 2, max= 4, avg= 2.67, stdev= 1.15, samples=3 lat (usec) : 750=8.33% lat (msec) : 100=16.67%, 250=50.00%, 500=8.33%, 2000=16.67% cpu : usr=0.00%, sys=32.56%, ctx=1174, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146550: Fri Jun 26 10:22:00 2026 read: IOPS=0, BW=429KiB/s (439kB/s)(2048KiB/4778msec) clat (msec): min=215, max=217, avg=216.71, stdev= 1.42 lat (msec): min=215, max=217, avg=216.71, stdev= 1.43 clat percentiles (msec): | 1.00th=[ 215], 5.00th=[ 215], 10.00th=[ 215], 20.00th=[ 215], | 30.00th=[ 215], 40.00th=[ 215], 50.00th=[ 215], 60.00th=[ 218], | 70.00th=[ 218], 80.00th=[ 218], 90.00th=[ 218], 95.00th=[ 218], | 99.00th=[ 218], 99.50th=[ 218], 99.90th=[ 218], 99.95th=[ 218], | 99.99th=[ 218] bw ( KiB/s): min= 1659, max= 2035, per=44.64%, avg=1847.00, stdev=265.87, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2143KiB/s (2195kB/s)(10.0MiB/4778msec); 0 zone resets clat (msec): min=104, max=1515, avg=429.88, stdev=423.83 lat (msec): min=104, max=1516, avg=429.96, stdev=423.82 clat percentiles (msec): | 1.00th=[ 105], 5.00th=[ 105], 10.00th=[ 105], 20.00th=[ 106], | 30.00th=[ 148], 40.00th=[ 155], 50.00th=[ 268], 60.00th=[ 368], | 70.00th=[ 514], 80.00th=[ 558], 90.00th=[ 567], 95.00th=[ 1519], | 99.00th=[ 1519], 99.50th=[ 1519], 99.90th=[ 1519], 99.95th=[ 1519], | 99.99th=[ 1519] bw ( KiB/s): min= 1957, max= 6144, per=52.68%, avg=3051.83, stdev=1728.25, samples=6 iops : min= 1, max= 6, avg= 2.50, stdev= 2.07, samples=6 lat (msec) : 250=50.00%, 500=16.67%, 750=25.00%, 2000=8.33% cpu : usr=0.02%, sys=26.36%, ctx=598, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146551: Fri Jun 26 10:22:00 2026 read: IOPS=1, BW=1318KiB/s (1350kB/s)(6144KiB/4662msec) clat (msec): min=119, max=683, avg=300.03, stdev=201.64 lat (msec): min=119, max=683, avg=300.03, stdev=201.64 clat percentiles (msec): | 1.00th=[ 121], 5.00th=[ 121], 10.00th=[ 121], 20.00th=[ 153], | 30.00th=[ 153], 40.00th=[ 271], 50.00th=[ 271], 60.00th=[ 271], | 70.00th=[ 305], 80.00th=[ 305], 90.00th=[ 684], 95.00th=[ 684], | 99.00th=[ 684], 99.50th=[ 684], 99.90th=[ 684], 99.95th=[ 684], | 99.99th=[ 684] bw ( KiB/s): min= 1957, max= 2048, per=48.91%, avg=2023.80, stdev=38.11, samples=5 iops : min= 1, max= 2, avg= 1.40, stdev= 0.55, samples=5 write: IOPS=1, BW=1318KiB/s (1350kB/s)(6144KiB/4662msec); 0 zone resets clat (msec): min=184, max=1386, avg=459.85, stdev=461.96 lat (msec): min=184, max=1386, avg=459.93, stdev=461.96 clat percentiles (msec): | 1.00th=[ 184], 5.00th=[ 184], 10.00th=[ 184], 20.00th=[ 218], | 30.00th=[ 218], 40.00th=[ 232], 50.00th=[ 232], 60.00th=[ 321], | 70.00th=[ 418], 80.00th=[ 418], 90.00th=[ 1385], 95.00th=[ 1385], | 99.00th=[ 1385], 99.50th=[ 1385], 99.90th=[ 1385], 99.95th=[ 1385], | 99.99th=[ 1385] bw ( KiB/s): min= 1678, max= 2048, per=33.94%, avg=1966.17, stdev=145.23, samples=6 iops : min= 1, max= 2, avg= 1.33, stdev= 0.52, samples=6 lat (msec) : 250=41.67%, 500=41.67%, 750=8.33%, 2000=8.33% cpu : usr=0.00%, sys=36.07%, ctx=1018, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146552: Fri Jun 26 10:22:00 2026 read: IOPS=1, BW=1035KiB/s (1059kB/s)(5120KiB/4949msec) clat (msec): min=85, max=734, avg=300.58, stdev=287.94 lat (msec): min=85, max=734, avg=300.59, stdev=287.94 clat percentiles (msec): | 1.00th=[ 86], 5.00th=[ 86], 10.00th=[ 86], 20.00th=[ 86], | 30.00th=[ 108], 40.00th=[ 108], 50.00th=[ 115], 60.00th=[ 115], | 70.00th=[ 460], 80.00th=[ 460], 90.00th=[ 735], 95.00th=[ 735], | 99.00th=[ 735], 99.50th=[ 735], 99.90th=[ 735], 99.95th=[ 735], | 99.99th=[ 735] bw ( KiB/s): min= 2035, max= 5873, per=95.55%, avg=3954.00, stdev=2713.88, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 write: IOPS=1, BW=1448KiB/s (1483kB/s)(7168KiB/4949msec); 0 zone resets clat (msec): min=183, max=1149, avg=474.13, stdev=330.98 lat (msec): min=183, max=1149, avg=474.23, stdev=330.98 clat percentiles (msec): | 1.00th=[ 184], 5.00th=[ 184], 10.00th=[ 184], 20.00th=[ 268], | 30.00th=[ 300], 40.00th=[ 300], 50.00th=[ 313], 60.00th=[ 506], | 70.00th=[ 506], 80.00th=[ 600], 90.00th=[ 1150], 95.00th=[ 1150], | 99.00th=[ 1150], 99.50th=[ 1150], 99.90th=[ 1150], 99.95th=[ 1150], | 99.99th=[ 1150] bw ( KiB/s): min= 2031, max= 4096, per=44.12%, avg=2555.75, stdev=1026.86, samples=4 iops : min= 1, max= 4, avg= 2.25, stdev= 1.26, samples=4 lat (msec) : 100=8.33%, 250=25.00%, 500=33.33%, 750=25.00%, 2000=8.33% cpu : usr=0.02%, sys=33.47%, ctx=1094, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4138KiB/s (4238kB/s), 429KiB/s-1772KiB/s (439kB/s-1814kB/s), io=20.0MiB (20.0MB), run=4046-4949msec WRITE: bw=5793KiB/s (5933kB/s), 1265KiB/s-2143KiB/s (1296kB/s-2195kB/s), io=28.0MiB (29.4MB), run=4046-4949msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=146562: Fri Jun 26 10:22:08 2026 read: IOPS=1, BW=7232KiB/s (7406kB/s)(12.0MiB/1699msec) clat (msec): min=507, max=588, avg=536.06, stdev=45.57 lat (msec): min=507, max=588, avg=536.06, stdev=45.57 clat percentiles (msec): | 1.00th=[ 506], 5.00th=[ 506], 10.00th=[ 506], 20.00th=[ 506], | 30.00th=[ 506], 40.00th=[ 514], 50.00th=[ 514], 60.00th=[ 514], | 70.00th=[ 592], 80.00th=[ 592], 90.00th=[ 592], 95.00th=[ 592], | 99.00th=[ 592], 99.50th=[ 592], 99.90th=[ 592], 99.95th=[ 592], | 99.99th=[ 592] bw ( KiB/s): min= 8175, max= 8192, per=100.00%, avg=8183.50, stdev=12.02, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 750=100.00% cpu : usr=0.00%, sys=51.12%, ctx=2248, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146563: Fri Jun 26 10:22:08 2026 read: IOPS=0, BW=2033KiB/s (2082kB/s)(4096KiB/2015msec) clat (nsec): min=511381k, max=511381k, avg=511380701.00, stdev= 0.00 lat (nsec): min=511383k, max=511383k, avg=511383145.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 510], 5.00th=[ 510], 10.00th=[ 510], 20.00th=[ 510], | 30.00th=[ 510], 40.00th=[ 510], 50.00th=[ 510], 60.00th=[ 510], | 70.00th=[ 510], 80.00th=[ 510], 90.00th=[ 510], 95.00th=[ 510], | 99.00th=[ 510], 99.50th=[ 510], 99.90th=[ 510], 99.95th=[ 510], | 99.99th=[ 510] bw ( KiB/s): min= 8192, max= 8192, per=100.00%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 write: IOPS=0, BW=4066KiB/s (4163kB/s)(8192KiB/2015msec); 0 zone resets clat (msec): min=427, max=998, avg=712.95, stdev=404.33 lat (msec): min=427, max=999, avg=713.30, stdev=404.11 clat percentiles (msec): | 1.00th=[ 426], 5.00th=[ 426], 10.00th=[ 426], 20.00th=[ 426], | 30.00th=[ 426], 40.00th=[ 426], 50.00th=[ 426], 60.00th=[ 1003], | 70.00th=[ 1003], 80.00th=[ 1003], 90.00th=[ 1003], 95.00th=[ 1003], | 99.00th=[ 1003], 99.50th=[ 1003], 99.90th=[ 1003], 99.95th=[ 1003], | 99.99th=[ 1003] bw ( KiB/s): min= 8175, max= 8175, per=55.59%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 750=33.33%, 1000=33.33% cpu : usr=0.05%, sys=19.36%, ctx=963, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146564: Fri Jun 26 10:22:08 2026 write: IOPS=1, BW=5515KiB/s (5648kB/s)(12.0MiB/2228msec); 0 zone resets clat (msec): min=381, max=975, avg=734.98, stdev=312.87 lat (msec): min=381, max=975, avg=735.25, stdev=312.85 clat percentiles (msec): | 1.00th=[ 380], 5.00th=[ 380], 10.00th=[ 380], 20.00th=[ 380], | 30.00th=[ 380], 40.00th=[ 852], 50.00th=[ 852], 60.00th=[ 852], | 70.00th=[ 978], 80.00th=[ 978], 90.00th=[ 978], 95.00th=[ 978], | 99.00th=[ 978], 99.50th=[ 978], 99.90th=[ 978], 99.95th=[ 978], | 99.99th=[ 978] bw ( KiB/s): min= 8192, max= 8192, per=55.70%, avg=8192.00, stdev= 0.00, samples=2 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 1000=66.67% cpu : usr=0.00%, sys=12.48%, ctx=53, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146565: Fri Jun 26 10:22:08 2026 write: IOPS=1, BW=6614KiB/s (6772kB/s)(12.0MiB/1858msec); 0 zone resets clat (msec): min=202, max=853, avg=586.95, stdev=341.33 lat (msec): min=202, max=853, avg=587.40, stdev=341.32 clat percentiles (msec): | 1.00th=[ 203], 5.00th=[ 203], 10.00th=[ 203], 20.00th=[ 203], | 30.00th=[ 203], 40.00th=[ 709], 50.00th=[ 709], 60.00th=[ 709], | 70.00th=[ 852], 80.00th=[ 852], 90.00th=[ 852], 95.00th=[ 852], | 99.00th=[ 852], 99.50th=[ 852], 99.90th=[ 852], 99.95th=[ 852], | 99.99th=[ 852] bw ( KiB/s): min= 8192, max= 8192, per=55.70%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 750=33.33%, 1000=33.33% cpu : usr=0.05%, sys=16.69%, ctx=254, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=8131KiB/s (8326kB/s), 2033KiB/s-7232KiB/s (2082kB/s-7406kB/s), io=16.0MiB (16.8MB), run=1699-2015msec WRITE: bw=14.4MiB/s (15.1MB/s), 4066KiB/s-6614KiB/s (4163kB/s-6772kB/s), io=32.0MiB (33.6MB), run=1858-2228msec rand-rw: (groupid=0, jobs=1): err= 0: pid=146557: Fri Jun 26 10:22:09 2026 read: IOPS=1, BW=7224KiB/s (7397kB/s)(12.0MiB/1701msec) clat (msec): min=256, max=958, avg=548.84, stdev=365.50 lat (msec): min=256, max=958, avg=548.84, stdev=365.50 clat percentiles (msec): | 1.00th=[ 257], 5.00th=[ 257], 10.00th=[ 257], 20.00th=[ 257], | 30.00th=[ 257], 40.00th=[ 430], 50.00th=[ 430], 60.00th=[ 430], | 70.00th=[ 961], 80.00th=[ 961], 90.00th=[ 961], 95.00th=[ 961], | 99.00th=[ 961], 99.50th=[ 961], 99.90th=[ 961], 99.95th=[ 961], | 99.99th=[ 961] bw ( KiB/s): min= 7406, max= 8192, per=100.00%, avg=7799.00, stdev=555.79, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 500=66.67%, 1000=33.33% cpu : usr=0.00%, sys=19.41%, ctx=123, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146558: Fri Jun 26 10:22:09 2026 read: IOPS=0, BW=1530KiB/s (1567kB/s)(4096KiB/2677msec) clat (nsec): min=680604k, max=680604k, avg=680604407.00, stdev= 0.00 lat (nsec): min=680608k, max=680608k, avg=680607698.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 684], 5.00th=[ 684], 10.00th=[ 684], 20.00th=[ 684], | 30.00th=[ 684], 40.00th=[ 684], 50.00th=[ 684], 60.00th=[ 684], | 70.00th=[ 684], 80.00th=[ 684], 90.00th=[ 684], 95.00th=[ 684], | 99.00th=[ 684], 99.50th=[ 684], 99.90th=[ 684], 99.95th=[ 684], | 99.99th=[ 684] bw ( KiB/s): min= 8192, max= 8192, per=100.00%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 write: IOPS=0, BW=3060KiB/s (3134kB/s)(8192KiB/2677msec); 0 zone resets clat (msec): min=559, max=1365, avg=962.58, stdev=569.77 lat (msec): min=559, max=1365, avg=962.80, stdev=569.66 clat percentiles (msec): | 1.00th=[ 558], 5.00th=[ 558], 10.00th=[ 558], 20.00th=[ 558], | 30.00th=[ 558], 40.00th=[ 558], 50.00th=[ 558], 60.00th=[ 1368], | 70.00th=[ 1368], 80.00th=[ 1368], 90.00th=[ 1368], 95.00th=[ 1368], | 99.00th=[ 1368], 99.50th=[ 1368], 99.90th=[ 1368], 99.95th=[ 1368], | 99.99th=[ 1368] bw ( KiB/s): min= 8192, max= 8192, per=67.20%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 750=66.67%, 2000=33.33% cpu : usr=0.04%, sys=11.29%, ctx=58, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146559: Fri Jun 26 10:22:09 2026 write: IOPS=1, BW=4571KiB/s (4681kB/s)(12.0MiB/2688msec); 0 zone resets clat (msec): min=236, max=1581, avg=874.22, stdev=675.26 lat (msec): min=236, max=1581, avg=874.61, stdev=675.30 clat percentiles (msec): | 1.00th=[ 236], 5.00th=[ 236], 10.00th=[ 236], 20.00th=[ 236], | 30.00th=[ 236], 40.00th=[ 802], 50.00th=[ 802], 60.00th=[ 802], | 70.00th=[ 1586], 80.00th=[ 1586], 90.00th=[ 1586], 95.00th=[ 1586], | 99.00th=[ 1586], 99.50th=[ 1586], 99.90th=[ 1586], 99.95th=[ 1586], | 99.99th=[ 1586] bw ( KiB/s): min= 8015, max= 8192, per=66.48%, avg=8103.50, stdev=125.16, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 250=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.04%, sys=14.70%, ctx=82, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146560: Fri Jun 26 10:22:09 2026 write: IOPS=1, BW=5024KiB/s (5144kB/s)(12.0MiB/2446msec); 0 zone resets clat (msec): min=217, max=1911, avg=791.88, stdev=970.12 lat (msec): min=218, max=1912, avg=792.24, stdev=970.09 clat percentiles (msec): | 1.00th=[ 218], 5.00th=[ 218], 10.00th=[ 218], 20.00th=[ 218], | 30.00th=[ 218], 40.00th=[ 247], 50.00th=[ 247], 60.00th=[ 247], | 70.00th=[ 1905], 80.00th=[ 1905], 90.00th=[ 1905], 95.00th=[ 1905], | 99.00th=[ 1905], 99.50th=[ 1905], 99.90th=[ 1905], 99.95th=[ 1905], | 99.99th=[ 1905] bw ( KiB/s): min= 7393, max= 7393, per=60.65%, avg=7393.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=66.67%, 2000=33.33% cpu : usr=0.00%, sys=18.24%, ctx=105, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=6120KiB/s (6267kB/s), 1530KiB/s-7224KiB/s (1567kB/s-7397kB/s), io=16.0MiB (16.8MB), run=1701-2677msec WRITE: bw=11.9MiB/s (12.5MB/s), 3060KiB/s-5024KiB/s (3134kB/s-5144kB/s), io=32.0MiB (33.6MB), run=2446-2688msec