== sanity test 398b: DIO and buffer IO race ============== 12:06:08 (1790957168) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 3.35419 s, 15.0 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144760: Fri Oct 2 12:07:28 2026 read: IOPS=21, BW=86.6KiB/s (88.7kB/s)(5992KiB/69200msec) clat (usec): min=36, max=255832, avg=22064.83, stdev=17138.76 lat (usec): min=36, max=255833, avg=22066.34, stdev=17138.83 clat percentiles (usec): | 1.00th=[ 58], 5.00th=[ 103], 10.00th=[ 8160], 20.00th=[ 11600], | 30.00th=[ 13829], 40.00th=[ 15926], 50.00th=[ 18744], 60.00th=[ 22414], | 70.00th=[ 26870], 80.00th=[ 32113], 90.00th=[ 39584], 95.00th=[ 46924], | 99.00th=[ 72877], 99.50th=[ 96994], 99.90th=[254804], 99.95th=[254804], | 99.99th=[254804] bw ( KiB/s): min= 31, max= 160, per=25.00%, avg=86.51, stdev=27.82, samples=136 iops : min= 7, max= 40, avg=21.10, stdev= 7.00, samples=136 write: IOPS=22, BW=90.0KiB/s (93.2kB/s)(6296KiB/69200msec); 0 zone resets clat (usec): min=720, max=699885, avg=22773.07, stdev=27863.29 lat (usec): min=720, max=699886, avg=22776.81, stdev=27862.98 clat percentiles (usec): | 1.00th=[ 1221], 5.00th=[ 1647], 10.00th=[ 2278], 20.00th=[ 3884], | 30.00th=[ 6849], 40.00th=[ 13042], 50.00th=[ 17957], 60.00th=[ 22938], | 70.00th=[ 28443], 80.00th=[ 36963], 90.00th=[ 49546], 95.00th=[ 60031], | 99.00th=[ 85459], 99.50th=[107480], 99.90th=[358613], 99.95th=[700449], | 99.99th=[700449] bw ( KiB/s): min= 31, max= 174, per=25.07%, avg=91.01, stdev=26.31, samples=136 iops : min= 7, max= 43, avg=22.22, stdev= 6.60, samples=136 lat (usec) : 50=0.23%, 100=2.05%, 250=1.60%, 500=0.13%, 750=0.03% lat (usec) : 1000=0.10% lat (msec) : 2=3.94%, 4=6.54%, 10=9.93%, 20=29.88%, 50=38.90% lat (msec) : 100=6.15%, 250=0.36%, 500=0.13%, 750=0.03% cpu : usr=0.13%, sys=13.44%, ctx=7641, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144761: Fri Oct 2 12:07:28 2026 read: IOPS=22, BW=88.2KiB/s (90.3kB/s)(5940KiB/67367msec) clat (usec): min=35, max=720628, avg=22164.11, stdev=23948.15 lat (usec): min=35, max=720629, avg=22165.46, stdev=23948.12 clat percentiles (usec): | 1.00th=[ 60], 5.00th=[ 122], 10.00th=[ 8848], 20.00th=[ 11994], | 30.00th=[ 13829], 40.00th=[ 15926], 50.00th=[ 18220], 60.00th=[ 21365], | 70.00th=[ 25822], 80.00th=[ 31065], 90.00th=[ 38536], 95.00th=[ 47449], | 99.00th=[ 73925], 99.50th=[ 92799], 99.90th=[252707], 99.95th=[717226], | 99.99th=[717226] bw ( KiB/s): min= 23, max= 176, per=25.54%, avg=88.38, stdev=28.68, samples=133 iops : min= 5, max= 44, avg=21.57, stdev= 7.20, samples=133 write: IOPS=23, BW=94.2KiB/s (96.5kB/s)(6348KiB/67367msec); 0 zone resets clat (usec): min=999, max=224750, avg=21531.68, stdev=20507.75 lat (usec): min=1001, max=224751, avg=21535.99, stdev=20507.99 clat percentiles (usec): | 1.00th=[ 1287], 5.00th=[ 1762], 10.00th=[ 2343], 20.00th=[ 3687], | 30.00th=[ 5932], 40.00th=[ 11469], 50.00th=[ 17171], 60.00th=[ 22414], | 70.00th=[ 28705], 80.00th=[ 35914], 90.00th=[ 46400], 95.00th=[ 58983], | 99.00th=[ 86508], 99.50th=[107480], 99.90th=[170918], 99.95th=[225444], | 99.99th=[225444] bw ( KiB/s): min= 31, max= 167, per=26.03%, avg=94.48, stdev=28.42, samples=133 iops : min= 7, max= 41, avg=23.09, stdev= 7.12, samples=133 lat (usec) : 50=0.23%, 100=1.76%, 250=1.37%, 500=0.16%, 1000=0.03% lat (msec) : 2=3.55%, 4=7.94%, 10=10.81%, 20=30.14%, 50=37.99% lat (msec) : 100=5.60%, 250=0.36%, 500=0.03%, 750=0.03% cpu : usr=0.15%, sys=13.68%, ctx=7519, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144762: Fri Oct 2 12:07:28 2026 read: IOPS=22, BW=88.7KiB/s (90.8kB/s)(6028KiB/67946msec) clat (usec): min=36, max=325851, avg=21810.56, stdev=16748.66 lat (usec): min=37, max=325853, avg=21813.05, stdev=16749.01 clat percentiles (usec): | 1.00th=[ 60], 5.00th=[ 110], 10.00th=[ 8717], 20.00th=[ 11731], | 30.00th=[ 13960], 40.00th=[ 16057], 50.00th=[ 18482], 60.00th=[ 21627], | 70.00th=[ 25297], 80.00th=[ 30278], 90.00th=[ 39060], 95.00th=[ 46924], | 99.00th=[ 70779], 99.50th=[ 94897], 99.90th=[160433], 99.95th=[325059], | 99.99th=[325059] bw ( KiB/s): min= 39, max= 159, per=25.66%, avg=88.78, stdev=25.95, samples=134 iops : min= 9, max= 39, avg=21.67, stdev= 6.49, samples=134 write: IOPS=23, BW=92.1KiB/s (94.3kB/s)(6260KiB/67946msec); 0 zone resets clat (usec): min=1067, max=709088, avg=22241.07, stdev=26518.69 lat (usec): min=1067, max=709089, avg=22243.71, stdev=26518.80 clat percentiles (usec): | 1.00th=[ 1237], 5.00th=[ 1762], 10.00th=[ 2409], 20.00th=[ 3785], | 30.00th=[ 6063], 40.00th=[ 11994], 50.00th=[ 17695], 60.00th=[ 22676], | 70.00th=[ 28443], 80.00th=[ 36963], 90.00th=[ 49546], 95.00th=[ 59507], | 99.00th=[ 81265], 99.50th=[ 98042], 99.90th=[191890], 99.95th=[708838], | 99.99th=[708838] bw ( KiB/s): min= 7, max= 160, per=25.41%, avg=92.25, stdev=27.64, samples=134 iops : min= 1, max= 40, avg=22.53, stdev= 6.93, samples=134 lat (usec) : 50=0.20%, 100=1.86%, 250=1.56%, 500=0.10%, 750=0.03% lat (usec) : 1000=0.07% lat (msec) : 2=3.48%, 4=7.45%, 10=10.22%, 20=29.75%, 50=38.44% lat (msec) : 100=6.48%, 250=0.29%, 500=0.03%, 750=0.03% cpu : usr=0.14%, sys=13.58%, ctx=7606, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144763: Fri Oct 2 12:07:28 2026 read: IOPS=22, BW=88.1KiB/s (90.2kB/s)(6052KiB/68693msec) clat (usec): min=36, max=711656, avg=22841.71, stdev=26157.63 lat (usec): min=36, max=711657, avg=22845.90, stdev=26157.90 clat percentiles (usec): | 1.00th=[ 57], 5.00th=[ 92], 10.00th=[ 8094], 20.00th=[ 11731], | 30.00th=[ 14091], 40.00th=[ 16188], 50.00th=[ 19268], 60.00th=[ 22414], | 70.00th=[ 26870], 80.00th=[ 32113], 90.00th=[ 40109], 95.00th=[ 46924], | 99.00th=[ 71828], 99.50th=[109577], 99.90th=[383779], 99.95th=[708838], | 99.99th=[708838] bw ( KiB/s): min= 31, max= 184, per=25.39%, avg=87.84, stdev=28.41, samples=135 iops : min= 7, max= 46, avg=21.43, stdev= 7.14, samples=135 write: IOPS=22, BW=90.8KiB/s (92.0kB/s)(6236KiB/68693msec); 0 zone resets clat (usec): min=964, max=121623, avg=21717.07, stdev=19782.74 lat (usec): min=965, max=121624, avg=21719.21, stdev=19782.53 clat percentiles (usec): | 1.00th=[ 1237], 5.00th=[ 1713], 10.00th=[ 2343], 20.00th=[ 3654], | 30.00th=[ 6194], 40.00th=[ 11731], 50.00th=[ 17171], 60.00th=[ 22414], | 70.00th=[ 28443], 80.00th=[ 36963], 90.00th=[ 49021], 95.00th=[ 60031], | 99.00th=[ 85459], 99.50th=[ 99091], 99.90th=[115868], 99.95th=[121111], | 99.99th=[121111] bw ( KiB/s): min= 23, max= 167, per=24.99%, avg=90.73, stdev=27.18, samples=135 iops : min= 5, max= 41, avg=22.15, stdev= 6.86, samples=135 lat (usec) : 50=0.23%, 100=2.51%, 250=0.94%, 500=0.16%, 750=0.13% lat (usec) : 1000=0.03% lat (msec) : 2=3.97%, 4=6.97%, 10=10.68%, 20=28.48%, 50=39.36% lat (msec) : 100=5.99%, 250=0.46%, 500=0.07%, 750=0.03% cpu : usr=0.12%, sys=13.65%, ctx=7703, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=347KiB/s (355kB/s), 86.6KiB/s-88.7KiB/s (88.7kB/s-90.8kB/s), io=23.4MiB (24.6MB), run=67367-69200msec WRITE: bw=363KiB/s (372kB/s), 90.8KiB/s-94.2KiB/s (92.0kB/s-96.5kB/s), io=24.6MiB (25.7MB), run=67367-69200msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144765: Fri Oct 2 12:08:36 2026 read: IOPS=10, BW=43.6KiB/s (44.7kB/s)(5992KiB/137403msec) clat (msec): min=4, max=746, avg=19.36, stdev=26.00 lat (msec): min=4, max=746, avg=19.36, stdev=26.00 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 7], 10.00th=[ 8], 20.00th=[ 9], | 30.00th=[ 10], 40.00th=[ 11], 50.00th=[ 12], 60.00th=[ 14], | 70.00th=[ 18], 80.00th=[ 25], 90.00th=[ 41], 95.00th=[ 57], | 99.00th=[ 94], 99.50th=[ 113], 99.90th=[ 153], 99.95th=[ 751], | 99.99th=[ 751] bw ( KiB/s): min= 7, max= 135, per=25.31%, avg=44.04, stdev=26.76, samples=267 iops : min= 1, max= 33, avg=10.48, stdev= 6.74, samples=267 write: IOPS=11, BW=45.8KiB/s (46.9kB/s)(6296KiB/137403msec); 0 zone resets clat (msec): min=26, max=390, avg=68.81, stdev=30.75 lat (msec): min=26, max=390, avg=68.81, stdev=30.75 clat percentiles (msec): | 1.00th=[ 32], 5.00th=[ 36], 10.00th=[ 40], 20.00th=[ 46], | 30.00th=[ 52], 40.00th=[ 57], 50.00th=[ 63], 60.00th=[ 69], | 70.00th=[ 77], 80.00th=[ 89], 90.00th=[ 105], 95.00th=[ 125], | 99.00th=[ 167], 99.50th=[ 201], 99.90th=[ 317], 99.95th=[ 393], | 99.99th=[ 393] bw ( KiB/s): min= 7, max= 96, per=24.95%, avg=45.40, stdev=18.13, samples=272 iops : min= 1, max= 24, avg=10.82, stdev= 4.60, samples=272 lat (msec) : 10=17.55%, 20=18.72%, 50=23.21%, 100=33.98%, 250=6.35% lat (msec) : 500=0.16%, 750=0.03% cpu : usr=0.08%, sys=2.80%, ctx=5481, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144766: Fri Oct 2 12:08:36 2026 read: IOPS=10, BW=43.2KiB/s (44.2kB/s)(5940KiB/137509msec) clat (msec): min=5, max=747, avg=18.59, stdev=25.24 lat (msec): min=5, max=747, avg=18.60, stdev=25.24 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 7], 10.00th=[ 8], 20.00th=[ 9], | 30.00th=[ 10], 40.00th=[ 11], 50.00th=[ 13], 60.00th=[ 14], | 70.00th=[ 17], 80.00th=[ 24], 90.00th=[ 39], 95.00th=[ 51], | 99.00th=[ 84], 99.50th=[ 95], 99.90th=[ 224], 99.95th=[ 751], | 99.99th=[ 751] bw ( KiB/s): min= 7, max= 150, per=25.11%, avg=43.69, stdev=26.45, samples=267 iops : min= 1, max= 37, avg=10.39, stdev= 6.64, samples=267 write: IOPS=11, BW=46.2KiB/s (47.3kB/s)(6348KiB/137510msec); 0 zone resets clat (msec): min=22, max=342, avg=69.18, stdev=31.06 lat (msec): min=22, max=342, avg=69.18, stdev=31.06 clat percentiles (msec): | 1.00th=[ 30], 5.00th=[ 36], 10.00th=[ 40], 20.00th=[ 46], | 30.00th=[ 52], 40.00th=[ 57], 50.00th=[ 63], 60.00th=[ 69], | 70.00th=[ 78], 80.00th=[ 88], 90.00th=[ 108], 95.00th=[ 126], | 99.00th=[ 171], 99.50th=[ 209], 99.90th=[ 317], 99.95th=[ 342], | 99.99th=[ 342] bw ( KiB/s): min= 15, max= 87, per=25.14%, avg=45.75, stdev=17.55, samples=272 iops : min= 3, max= 21, avg=10.90, stdev= 4.45, samples=272 lat (msec) : 10=16.31%, 20=20.21%, 50=23.80%, 100=32.85%, 250=6.64% lat (msec) : 500=0.16%, 750=0.03% cpu : usr=0.07%, sys=2.80%, ctx=5482, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144767: Fri Oct 2 12:08:36 2026 read: IOPS=10, BW=43.9KiB/s (45.0kB/s)(6028KiB/137169msec) clat (msec): min=4, max=199, avg=19.23, stdev=18.16 lat (msec): min=4, max=199, avg=19.23, stdev=18.16 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 7], 10.00th=[ 8], 20.00th=[ 9], | 30.00th=[ 10], 40.00th=[ 11], 50.00th=[ 13], 60.00th=[ 15], | 70.00th=[ 19], 80.00th=[ 27], 90.00th=[ 42], 95.00th=[ 56], | 99.00th=[ 92], 99.50th=[ 109], 99.90th=[ 150], 99.95th=[ 199], | 99.99th=[ 199] bw ( KiB/s): min= 7, max= 127, per=25.34%, avg=44.10, stdev=25.05, samples=269 iops : min= 1, max= 31, avg=10.49, stdev= 6.31, samples=269 write: IOPS=11, BW=45.6KiB/s (46.7kB/s)(6260KiB/137169msec); 0 zone resets clat (msec): min=25, max=826, avg=69.06, stdev=34.96 lat (msec): min=25, max=826, avg=69.06, stdev=34.97 clat percentiles (msec): | 1.00th=[ 31], 5.00th=[ 37], 10.00th=[ 40], 20.00th=[ 47], | 30.00th=[ 51], 40.00th=[ 56], 50.00th=[ 62], 60.00th=[ 67], | 70.00th=[ 78], 80.00th=[ 89], 90.00th=[ 106], 95.00th=[ 121], | 99.00th=[ 163], 99.50th=[ 188], 99.90th=[ 393], 99.95th=[ 827], | 99.99th=[ 827] bw ( KiB/s): min= 15, max= 88, per=24.86%, avg=45.25, stdev=17.94, samples=272 iops : min= 3, max= 22, avg=10.78, stdev= 4.54, samples=272 lat (msec) : 10=15.98%, 20=19.86%, 50=24.45%, 100=32.58%, 250=7.00% lat (msec) : 500=0.10%, 1000=0.03% cpu : usr=0.08%, sys=2.81%, ctx=5432, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144768: Fri Oct 2 12:08:36 2026 read: IOPS=11, BW=44.3KiB/s (45.3kB/s)(6052KiB/136673msec) clat (msec): min=4, max=223, avg=18.51, stdev=17.48 lat (msec): min=4, max=223, avg=18.51, stdev=17.48 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 7], 10.00th=[ 8], 20.00th=[ 9], | 30.00th=[ 10], 40.00th=[ 11], 50.00th=[ 13], 60.00th=[ 14], | 70.00th=[ 18], 80.00th=[ 25], 90.00th=[ 41], 95.00th=[ 52], | 99.00th=[ 79], 99.50th=[ 102], 99.90th=[ 199], 99.95th=[ 224], | 99.99th=[ 224] bw ( KiB/s): min= 7, max= 128, per=25.92%, avg=45.10, stdev=25.69, samples=264 iops : min= 1, max= 32, avg=10.75, stdev= 6.45, samples=264 write: IOPS=11, BW=45.6KiB/s (46.7kB/s)(6236KiB/136673msec); 0 zone resets clat (msec): min=24, max=786, avg=69.63, stdev=34.10 lat (msec): min=24, max=786, avg=69.64, stdev=34.10 clat percentiles (msec): | 1.00th=[ 31], 5.00th=[ 36], 10.00th=[ 40], 20.00th=[ 47], | 30.00th=[ 53], 40.00th=[ 57], 50.00th=[ 63], 60.00th=[ 70], | 70.00th=[ 78], 80.00th=[ 89], 90.00th=[ 105], 95.00th=[ 124], | 99.00th=[ 167], 99.50th=[ 205], 99.90th=[ 257], 99.95th=[ 785], | 99.99th=[ 785] bw ( KiB/s): min= 15, max= 95, per=24.86%, avg=45.25, stdev=17.34, samples=271 iops : min= 3, max= 23, avg=10.78, stdev= 4.40, samples=271 lat (msec) : 10=16.57%, 20=19.99%, 50=23.57%, 100=33.20%, 250=6.61% lat (msec) : 500=0.03%, 1000=0.03% cpu : usr=0.08%, sys=2.80%, ctx=5430, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=175KiB/s (179kB/s), 43.2KiB/s-44.3KiB/s (44.2kB/s-45.3kB/s), io=23.4MiB (24.6MB), run=136673-137509msec WRITE: bw=183KiB/s (187kB/s), 45.6KiB/s-46.2KiB/s (46.7kB/s-47.3kB/s), io=24.6MiB (25.7MB), run=136673-137510msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144800: Fri Oct 2 12:09:01 2026 read: IOPS=22, BW=358KiB/s (367kB/s)(5920KiB/16518msec) clat (usec): min=38, max=138567, avg=21926.21, stdev=17459.30 lat (usec): min=38, max=138569, avg=21927.40, stdev=17459.37 clat percentiles (usec): | 1.00th=[ 49], 5.00th=[ 77], 10.00th=[ 100], 20.00th=[ 9765], | 30.00th=[ 14222], 40.00th=[ 16909], 50.00th=[ 20841], 60.00th=[ 23725], | 70.00th=[ 28443], 80.00th=[ 32637], 90.00th=[ 39584], 95.00th=[ 48497], | 99.00th=[ 86508], 99.50th=[127402], 99.90th=[139461], 99.95th=[139461], | 99.99th=[139461] bw ( KiB/s): min= 159, max= 608, per=26.20%, avg=352.97, stdev=130.15, samples=32 iops : min= 9, max= 38, avg=21.41, stdev= 8.17, samples=32 write: IOPS=24, BW=386KiB/s (395kB/s)(6368KiB/16518msec); 0 zone resets clat (usec): min=1729, max=130765, avg=20634.23, stdev=20007.85 lat (usec): min=1731, max=130768, avg=20638.48, stdev=20008.91 clat percentiles (usec): | 1.00th=[ 1909], 5.00th=[ 2769], 10.00th=[ 3392], 20.00th=[ 4621], | 30.00th=[ 6587], 40.00th=[ 9503], 50.00th=[ 14484], 60.00th=[ 19792], | 70.00th=[ 25035], 80.00th=[ 32113], 90.00th=[ 49546], 95.00th=[ 58983], | 99.00th=[ 88605], 99.50th=[116917], 99.90th=[130548], 99.95th=[130548], | 99.99th=[130548] bw ( KiB/s): min= 112, max= 669, per=27.18%, avg=385.16, stdev=117.69, samples=32 iops : min= 7, max= 41, avg=23.44, stdev= 7.33, samples=32 lat (usec) : 50=0.52%, 100=4.30%, 250=2.99%, 500=0.39%, 750=0.39% lat (usec) : 1000=0.13% lat (msec) : 2=0.78%, 4=7.42%, 10=13.80%, 20=23.70%, 50=38.80% lat (msec) : 100=5.99%, 250=0.78% cpu : usr=0.14%, sys=16.02%, ctx=1906, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144801: Fri Oct 2 12:09:01 2026 read: IOPS=20, BW=323KiB/s (331kB/s)(5744KiB/17781msec) clat (usec): min=40, max=185863, avg=22998.97, stdev=17062.79 lat (usec): min=40, max=185955, avg=23000.40, stdev=17065.24 clat percentiles (usec): | 1.00th=[ 61], 5.00th=[ 87], 10.00th=[ 118], 20.00th=[ 12125], | 30.00th=[ 15401], 40.00th=[ 18744], 50.00th=[ 21365], 60.00th=[ 25297], | 70.00th=[ 28967], 80.00th=[ 33162], 90.00th=[ 40633], 95.00th=[ 49546], | 99.00th=[ 65799], 99.50th=[107480], 99.90th=[185598], 99.95th=[185598], | 99.99th=[185598] bw ( KiB/s): min= 27, max= 662, per=23.85%, avg=321.26, stdev=136.75, samples=35 iops : min= 1, max= 41, avg=19.46, stdev= 8.65, samples=35 write: IOPS=23, BW=368KiB/s (377kB/s)(6544KiB/17781msec); 0 zone resets clat (usec): min=1411, max=169744, avg=22659.25, stdev=25760.90 lat (usec): min=1414, max=169747, avg=22661.70, stdev=25760.97 clat percentiles (usec): | 1.00th=[ 1614], 5.00th=[ 2343], 10.00th=[ 2933], 20.00th=[ 4424], | 30.00th=[ 6521], 40.00th=[ 10945], 50.00th=[ 14353], 60.00th=[ 18482], | 70.00th=[ 24773], 80.00th=[ 36963], 90.00th=[ 51119], 95.00th=[ 74974], | 99.00th=[126354], 99.50th=[137364], 99.90th=[168821], 99.95th=[168821], | 99.99th=[168821] bw ( KiB/s): min= 111, max= 701, per=25.80%, avg=365.60, stdev=148.67, samples=35 iops : min= 6, max= 43, avg=22.23, stdev= 9.37, samples=35 lat (usec) : 50=0.13%, 100=3.12%, 250=3.26%, 500=0.13%, 750=0.13% lat (msec) : 2=1.69%, 4=7.03%, 10=13.02%, 20=26.69%, 50=36.85% lat (msec) : 100=6.38%, 250=1.56% cpu : usr=0.12%, sys=14.95%, ctx=1858, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144802: Fri Oct 2 12:09:01 2026 read: IOPS=23, BW=384KiB/s (393kB/s)(6256KiB/16307msec) clat (usec): min=35, max=104604, avg=24142.56, stdev=17380.22 lat (usec): min=35, max=104605, avg=24145.92, stdev=17379.12 clat percentiles (usec): | 1.00th=[ 46], 5.00th=[ 70], 10.00th=[ 112], 20.00th=[ 12911], | 30.00th=[ 15926], 40.00th=[ 18744], 50.00th=[ 22414], 60.00th=[ 25035], | 70.00th=[ 29230], 80.00th=[ 33817], 90.00th=[ 42206], 95.00th=[ 57934], | 99.00th=[ 86508], 99.50th=[101188], 99.90th=[104334], 99.95th=[104334], | 99.99th=[104334] bw ( KiB/s): min= 256, max= 605, per=28.60%, avg=385.22, stdev=80.31, samples=32 iops : min= 16, max= 37, avg=23.44, stdev= 4.91, samples=32 write: IOPS=23, BW=370KiB/s (379kB/s)(6032KiB/16307msec); 0 zone resets clat (usec): min=1486, max=90250, avg=18053.50, stdev=17050.70 lat (usec): min=1488, max=90252, avg=18055.76, stdev=17050.72 clat percentiles (usec): | 1.00th=[ 1598], 5.00th=[ 2089], 10.00th=[ 2900], 20.00th=[ 4293], | 30.00th=[ 5866], 40.00th=[ 7767], 50.00th=[11076], 60.00th=[17171], | 70.00th=[22676], 80.00th=[32900], 90.00th=[41681], 95.00th=[51643], | 99.00th=[73925], 99.50th=[89654], 99.90th=[90702], 99.95th=[90702], | 99.99th=[90702] bw ( KiB/s): min= 63, max= 736, per=25.79%, avg=365.38, stdev=138.42, samples=32 iops : min= 3, max= 46, avg=22.19, stdev= 8.72, samples=32 lat (usec) : 50=0.65%, 100=3.91%, 250=2.21%, 750=0.13% lat (msec) : 2=1.82%, 4=6.25%, 10=15.49%, 20=24.22%, 50=39.19% lat (msec) : 100=5.86%, 250=0.26% cpu : usr=0.16%, sys=15.77%, ctx=1878, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144803: Fri Oct 2 12:09:01 2026 read: IOPS=22, BW=361KiB/s (370kB/s)(6032KiB/16706msec) clat (usec): min=41, max=156416, avg=22837.62, stdev=18876.05 lat (usec): min=41, max=156417, avg=22838.82, stdev=18876.05 clat percentiles (usec): | 1.00th=[ 52], 5.00th=[ 77], 10.00th=[ 102], 20.00th=[ 10421], | 30.00th=[ 14222], 40.00th=[ 17433], 50.00th=[ 20317], 60.00th=[ 23987], | 70.00th=[ 27657], 80.00th=[ 33817], 90.00th=[ 41681], 95.00th=[ 52167], | 99.00th=[ 98042], 99.50th=[117965], 99.90th=[156238], 99.95th=[156238], | 99.99th=[156238] bw ( KiB/s): min= 28, max= 640, per=26.61%, avg=358.45, stdev=120.42, samples=33 iops : min= 1, max= 40, avg=21.76, stdev= 7.64, samples=33 write: IOPS=23, BW=374KiB/s (383kB/s)(6256KiB/16706msec); 0 zone resets clat (usec): min=1386, max=147547, avg=20106.26, stdev=19863.00 lat (usec): min=1388, max=147550, avg=20108.90, stdev=19862.76 clat percentiles (usec): | 1.00th=[ 1549], 5.00th=[ 2311], 10.00th=[ 2868], 20.00th=[ 4424], | 30.00th=[ 6783], 40.00th=[ 9241], 50.00th=[ 14353], 60.00th=[ 20055], | 70.00th=[ 25297], 80.00th=[ 31065], 90.00th=[ 45351], 95.00th=[ 52167], | 99.00th=[100140], 99.50th=[126354], 99.90th=[147850], 99.95th=[147850], | 99.99th=[147850] bw ( KiB/s): min= 112, max= 608, per=26.43%, avg=374.52, stdev=106.96, samples=33 iops : min= 7, max= 38, avg=22.79, stdev= 6.70, samples=33 lat (usec) : 50=0.26%, 100=4.43%, 250=2.99%, 500=0.39%, 1000=0.13% lat (msec) : 2=2.08%, 4=6.90%, 10=13.02%, 20=24.48%, 50=39.06% lat (msec) : 100=5.34%, 250=0.91% cpu : usr=0.13%, sys=15.56%, ctx=1899, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1347KiB/s (1379kB/s), 323KiB/s-384KiB/s (331kB/s-393kB/s), io=23.4MiB (24.5MB), run=16307-17781msec WRITE: bw=1417KiB/s (1451kB/s), 368KiB/s-386KiB/s (377kB/s-395kB/s), io=24.6MiB (25.8MB), run=16307-17781msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144804: Fri Oct 2 12:09:18 2026 read: IOPS=10, BW=172KiB/s (176kB/s)(5920KiB/34464msec) clat (msec): min=5, max=182, avg=22.10, stdev=19.19 lat (msec): min=5, max=182, avg=22.10, stdev=19.19 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 11], | 30.00th=[ 12], 40.00th=[ 14], 50.00th=[ 17], 60.00th=[ 19], | 70.00th=[ 22], 80.00th=[ 28], 90.00th=[ 46], 95.00th=[ 66], | 99.00th=[ 87], 99.50th=[ 117], 99.90th=[ 182], 99.95th=[ 182], | 99.99th=[ 182] bw ( KiB/s): min= 31, max= 415, per=24.82%, avg=170.25, stdev=91.19, samples=68 iops : min= 1, max= 25, avg=10.04, stdev= 5.83, samples=68 write: IOPS=11, BW=185KiB/s (189kB/s)(6368KiB/34464msec); 0 zone resets clat (msec): min=26, max=174, avg=65.81, stdev=26.63 lat (msec): min=26, max=174, avg=65.82, stdev=26.63 clat percentiles (msec): | 1.00th=[ 29], 5.00th=[ 35], 10.00th=[ 39], 20.00th=[ 44], | 30.00th=[ 48], 40.00th=[ 54], 50.00th=[ 61], 60.00th=[ 67], | 70.00th=[ 74], 80.00th=[ 86], 90.00th=[ 103], 95.00th=[ 118], | 99.00th=[ 155], 99.50th=[ 157], 99.90th=[ 176], 99.95th=[ 176], | 99.99th=[ 176] bw ( KiB/s): min= 63, max= 320, per=25.48%, avg=183.97, stdev=70.24, samples=68 iops : min= 3, max= 20, avg=10.91, stdev= 4.46, samples=68 lat (msec) : 10=9.38%, 20=22.27%, 50=29.17%, 100=33.07%, 250=6.12% cpu : usr=0.10%, sys=3.66%, ctx=1490, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144805: Fri Oct 2 12:09:18 2026 read: IOPS=10, BW=165KiB/s (169kB/s)(5744KiB/34899msec) clat (msec): min=5, max=109, avg=20.64, stdev=17.58 lat (msec): min=5, max=109, avg=20.64, stdev=17.58 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 8], 10.00th=[ 8], 20.00th=[ 9], | 30.00th=[ 11], 40.00th=[ 12], 50.00th=[ 15], 60.00th=[ 18], | 70.00th=[ 21], 80.00th=[ 29], 90.00th=[ 43], 95.00th=[ 55], | 99.00th=[ 96], 99.50th=[ 109], 99.90th=[ 110], 99.95th=[ 110], | 99.99th=[ 110] bw ( KiB/s): min= 29, max= 447, per=23.82%, avg=163.38, stdev=103.15, samples=69 iops : min= 1, max= 27, avg= 9.61, stdev= 6.50, samples=69 write: IOPS=11, BW=188KiB/s (192kB/s)(6544KiB/34899msec); 0 zone resets clat (msec): min=23, max=218, avg=66.83, stdev=31.00 lat (msec): min=23, max=218, avg=66.84, stdev=31.00 clat percentiles (msec): | 1.00th=[ 33], 5.00th=[ 36], 10.00th=[ 40], 20.00th=[ 45], | 30.00th=[ 49], 40.00th=[ 54], 50.00th=[ 58], 60.00th=[ 63], | 70.00th=[ 70], 80.00th=[ 87], 90.00th=[ 110], 95.00th=[ 133], | 99.00th=[ 178], 99.50th=[ 188], 99.90th=[ 220], 99.95th=[ 220], | 99.99th=[ 220] bw ( KiB/s): min= 63, max= 320, per=25.74%, avg=185.86, stdev=72.43, samples=69 iops : min= 3, max= 20, avg=11.03, stdev= 4.66, samples=69 lat (msec) : 10=12.89%, 20=19.53%, 50=28.91%, 100=30.73%, 250=7.94% cpu : usr=0.10%, sys=3.48%, ctx=1508, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144806: Fri Oct 2 12:09:18 2026 read: IOPS=11, BW=183KiB/s (188kB/s)(6256KiB/34166msec) clat (msec): min=5, max=116, avg=21.77, stdev=18.78 lat (msec): min=5, max=116, avg=21.77, stdev=18.78 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 10], | 30.00th=[ 11], 40.00th=[ 13], 50.00th=[ 15], 60.00th=[ 19], | 70.00th=[ 23], 80.00th=[ 31], 90.00th=[ 45], 95.00th=[ 58], | 99.00th=[ 102], 99.50th=[ 111], 99.90th=[ 116], 99.95th=[ 116], | 99.99th=[ 116] bw ( KiB/s): min= 31, max= 480, per=27.29%, avg=187.20, stdev=106.79, samples=66 iops : min= 1, max= 30, avg=11.11, stdev= 6.81, samples=66 write: IOPS=11, BW=177KiB/s (181kB/s)(6032KiB/34166msec); 0 zone resets clat (msec): min=28, max=216, avg=67.54, stdev=30.42 lat (msec): min=28, max=216, avg=67.54, stdev=30.42 clat percentiles (msec): | 1.00th=[ 31], 5.00th=[ 37], 10.00th=[ 40], 20.00th=[ 45], | 30.00th=[ 51], 40.00th=[ 54], 50.00th=[ 59], 60.00th=[ 65], | 70.00th=[ 72], 80.00th=[ 86], 90.00th=[ 112], 95.00th=[ 132], | 99.00th=[ 184], 99.50th=[ 205], 99.90th=[ 218], 99.95th=[ 218], | 99.99th=[ 218] bw ( KiB/s): min= 63, max= 288, per=24.15%, avg=174.33, stdev=68.94, samples=67 iops : min= 3, max= 18, avg=10.30, stdev= 4.41, samples=67 lat (msec) : 10=11.85%, 20=20.70%, 50=29.30%, 100=31.25%, 250=6.90% cpu : usr=0.07%, sys=3.59%, ctx=1475, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144807: Fri Oct 2 12:09:18 2026 read: IOPS=10, BW=174KiB/s (178kB/s)(6032KiB/34686msec) clat (msec): min=5, max=123, avg=20.85, stdev=18.16 lat (msec): min=5, max=123, avg=20.85, stdev=18.16 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 7], 10.00th=[ 8], 20.00th=[ 10], | 30.00th=[ 11], 40.00th=[ 13], 50.00th=[ 15], 60.00th=[ 18], | 70.00th=[ 21], 80.00th=[ 27], 90.00th=[ 43], 95.00th=[ 61], | 99.00th=[ 106], 99.50th=[ 115], 99.90th=[ 125], 99.95th=[ 125], | 99.99th=[ 125] bw ( KiB/s): min= 32, max= 448, per=26.04%, avg=178.64, stdev=97.59, samples=67 iops : min= 2, max= 28, avg=10.58, stdev= 6.21, samples=67 write: IOPS=11, BW=180KiB/s (185kB/s)(6256KiB/34686msec); 0 zone resets clat (msec): min=24, max=233, avg=68.25, stdev=32.18 lat (msec): min=24, max=233, avg=68.26, stdev=32.18 clat percentiles (msec): | 1.00th=[ 30], 5.00th=[ 36], 10.00th=[ 40], 20.00th=[ 44], | 30.00th=[ 49], 40.00th=[ 54], 50.00th=[ 59], 60.00th=[ 65], | 70.00th=[ 73], 80.00th=[ 88], 90.00th=[ 115], 95.00th=[ 140], | 99.00th=[ 169], 99.50th=[ 220], 99.90th=[ 234], 99.95th=[ 234], | 99.99th=[ 234] bw ( KiB/s): min= 62, max= 351, per=24.98%, avg=180.35, stdev=75.30, samples=69 iops : min= 3, max= 21, avg=10.68, stdev= 4.79, samples=69 lat (msec) : 10=10.29%, 20=23.83%, 50=28.26%, 100=30.08%, 250=7.55% cpu : usr=0.10%, sys=3.58%, ctx=1464, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=686KiB/s (703kB/s), 165KiB/s-183KiB/s (169kB/s-188kB/s), io=23.4MiB (24.5MB), run=34166-34899msec WRITE: bw=722KiB/s (739kB/s), 177KiB/s-188KiB/s (181kB/s-192kB/s), io=24.6MiB (25.8MB), run=34166-34899msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144818: Fri Oct 2 12:09:27 2026 read: IOPS=2, BW=2682KiB/s (2746kB/s)(7168KiB/2673msec) clat (usec): min=833, max=262085, avg=163999.80, stdev=88892.24 lat (usec): min=835, max=262086, avg=164001.32, stdev=88891.89 clat percentiles (usec): | 1.00th=[ 832], 5.00th=[ 832], 10.00th=[ 832], 20.00th=[115868], | 30.00th=[141558], 40.00th=[141558], 50.00th=[173016], 60.00th=[212861], | 70.00th=[212861], 80.00th=[240124], 90.00th=[261096], 95.00th=[261096], | 99.00th=[261096], 99.50th=[261096], 99.90th=[261096], 99.95th=[261096], | 99.99th=[261096] bw ( KiB/s): min= 2027, max= 5324, per=46.98%, avg=2860.50, stdev=1642.36, samples=4 iops : min= 1, max= 5, avg= 2.25, stdev= 1.89, samples=4 write: IOPS=1, BW=1915KiB/s (1961kB/s)(5120KiB/2673msec); 0 zone resets clat (msec): min=174, max=422, avg=295.60, stdev=88.70 lat (msec): min=174, max=422, avg=295.67, stdev=88.67 clat percentiles (msec): | 1.00th=[ 176], 5.00th=[ 176], 10.00th=[ 176], 20.00th=[ 176], | 30.00th=[ 284], 40.00th=[ 284], 50.00th=[ 284], 60.00th=[ 284], | 70.00th=[ 313], 80.00th=[ 313], 90.00th=[ 422], 95.00th=[ 422], | 99.00th=[ 422], 99.50th=[ 422], 99.90th=[ 422], 99.95th=[ 422], | 99.99th=[ 422] bw ( KiB/s): min= 2043, max= 4096, per=32.01%, avg=2729.00, stdev=1183.86, samples=3 iops : min= 1, max= 4, avg= 2.33, stdev= 1.53, samples=3 lat (usec) : 1000=8.33% lat (msec) : 250=50.00%, 500=41.67% cpu : usr=0.00%, sys=39.48%, ctx=515, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144819: Fri Oct 2 12:09:27 2026 read: IOPS=0, BW=613KiB/s (628kB/s)(2048KiB/3341msec) clat (msec): min=153, max=221, avg=187.54, stdev=48.25 lat (msec): min=153, max=221, avg=187.54, stdev=48.25 clat percentiles (msec): | 1.00th=[ 155], 5.00th=[ 155], 10.00th=[ 155], 20.00th=[ 155], | 30.00th=[ 155], 40.00th=[ 155], 50.00th=[ 155], 60.00th=[ 222], | 70.00th=[ 222], 80.00th=[ 222], 90.00th=[ 222], 95.00th=[ 222], | 99.00th=[ 222], 99.50th=[ 222], 99.90th=[ 222], 99.95th=[ 222], | 99.99th=[ 222] bw ( KiB/s): min= 1780, max= 2027, per=31.26%, avg=1903.50, stdev=174.66, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=3065KiB/s (3139kB/s)(10.0MiB/3341msec); 0 zone resets clat (msec): min=130, max=673, avg=295.43, stdev=150.69 lat (msec): min=130, max=673, avg=295.52, stdev=150.70 clat percentiles (msec): | 1.00th=[ 131], 5.00th=[ 131], 10.00th=[ 131], 20.00th=[ 167], | 30.00th=[ 184], 40.00th=[ 262], 50.00th=[ 275], 60.00th=[ 279], | 70.00th=[ 309], 80.00th=[ 334], 90.00th=[ 342], 95.00th=[ 676], | 99.00th=[ 676], 99.50th=[ 676], 99.90th=[ 676], 99.95th=[ 676], | 99.99th=[ 676] bw ( KiB/s): min= 2048, max= 6144, per=43.12%, avg=3676.40, stdev=1710.58, samples=5 iops : min= 2, max= 6, avg= 3.20, stdev= 1.64, samples=5 lat (msec) : 250=41.67%, 500=50.00%, 750=8.33% cpu : usr=0.00%, sys=39.37%, ctx=276, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144820: Fri Oct 2 12:09:27 2026 read: IOPS=2, BW=2190KiB/s (2243kB/s)(6144KiB/2805msec) clat (usec): min=741, max=290537, avg=188344.67, stdev=106005.94 lat (usec): min=742, max=290538, avg=188345.94, stdev=106005.96 clat percentiles (usec): | 1.00th=[ 742], 5.00th=[ 742], 10.00th=[ 742], 20.00th=[149947], | 30.00th=[149947], 40.00th=[193987], 50.00th=[193987], 60.00th=[212861], | 70.00th=[278922], 80.00th=[278922], 90.00th=[291505], 95.00th=[291505], | 99.00th=[291505], 99.50th=[291505], 99.90th=[291505], 99.95th=[291505], | 99.99th=[291505] bw ( KiB/s): min= 2048, max= 4087, per=55.78%, avg=3396.67, stdev=1168.09, samples=3 iops : min= 2, max= 3, avg= 2.67, stdev= 0.58, samples=3 write: IOPS=2, BW=2190KiB/s (2243kB/s)(6144KiB/2805msec); 0 zone resets clat (msec): min=165, max=434, avg=271.71, stdev=112.95 lat (msec): min=165, max=434, avg=271.81, stdev=113.00 clat percentiles (msec): | 1.00th=[ 165], 5.00th=[ 165], 10.00th=[ 165], 20.00th=[ 197], | 30.00th=[ 197], 40.00th=[ 213], 50.00th=[ 213], 60.00th=[ 228], | 70.00th=[ 393], 80.00th=[ 393], 90.00th=[ 435], 95.00th=[ 435], | 99.00th=[ 435], 99.50th=[ 435], 99.90th=[ 435], 99.95th=[ 435], | 99.99th=[ 435] bw ( KiB/s): min= 1759, max= 4096, per=35.07%, avg=2989.50, stdev=1259.65, samples=4 iops : min= 1, max= 4, avg= 2.50, stdev= 1.29, samples=4 lat (usec) : 750=8.33% lat (msec) : 250=58.33%, 500=33.33% cpu : usr=0.04%, sys=32.81%, ctx=468, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144821: Fri Oct 2 12:09:27 2026 read: IOPS=1, BW=1522KiB/s (1559kB/s)(5120KiB/3363msec) clat (usec): min=431, max=355842, avg=140083.25, stdev=148067.48 lat (usec): min=432, max=355843, avg=140084.61, stdev=148067.17 clat percentiles (usec): | 1.00th=[ 433], 5.00th=[ 433], 10.00th=[ 433], 20.00th=[ 433], | 30.00th=[ 537], 40.00th=[ 537], 50.00th=[162530], 60.00th=[162530], | 70.00th=[181404], 80.00th=[181404], 90.00th=[354419], 95.00th=[354419], | 99.00th=[354419], 99.50th=[354419], 99.90th=[354419], 99.95th=[354419], | 99.99th=[354419] bw ( KiB/s): min= 2027, max= 6144, per=67.10%, avg=4085.50, stdev=2911.16, samples=2 iops : min= 1, max= 6, avg= 3.50, stdev= 3.54, samples=2 write: IOPS=2, BW=2131KiB/s (2183kB/s)(7168KiB/3363msec); 0 zone resets clat (msec): min=208, max=454, avg=366.23, stdev=85.93 lat (msec): min=208, max=454, avg=366.31, stdev=85.91 clat percentiles (msec): | 1.00th=[ 209], 5.00th=[ 209], 10.00th=[ 209], 20.00th=[ 313], | 30.00th=[ 342], 40.00th=[ 342], 50.00th=[ 393], 60.00th=[ 422], | 70.00th=[ 422], 80.00th=[ 435], 90.00th=[ 456], 95.00th=[ 456], | 99.00th=[ 456], 99.50th=[ 456], 99.90th=[ 456], 99.95th=[ 456], | 99.99th=[ 456] bw ( KiB/s): min= 1750, max= 2048, per=23.31%, avg=1987.40, stdev=132.73, samples=5 iops : min= 1, max= 2, avg= 1.60, stdev= 0.55, samples=5 lat (usec) : 500=8.33%, 750=8.33% lat (msec) : 250=25.00%, 500=58.33% cpu : usr=0.00%, sys=29.09%, ctx=537, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=6090KiB/s (6236kB/s), 613KiB/s-2682KiB/s (628kB/s-2746kB/s), io=20.0MiB (20.0MB), run=2673-3363msec WRITE: bw=8526KiB/s (8730kB/s), 1915KiB/s-3065KiB/s (1961kB/s-3139kB/s), io=28.0MiB (29.4MB), run=2673-3363msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144823: Fri Oct 2 12:09:27 2026 read: IOPS=2, BW=2292KiB/s (2347kB/s)(7168KiB/3128msec) clat (msec): min=64, max=213, avg=149.77, stdev=58.43 lat (msec): min=64, max=213, avg=149.77, stdev=58.43 clat percentiles (msec): | 1.00th=[ 65], 5.00th=[ 65], 10.00th=[ 65], 20.00th=[ 94], | 30.00th=[ 136], 40.00th=[ 136], 50.00th=[ 138], 60.00th=[ 199], | 70.00th=[ 199], 80.00th=[ 209], 90.00th=[ 213], 95.00th=[ 213], | 99.00th=[ 213], 99.50th=[ 213], 99.90th=[ 213], 99.95th=[ 213], | 99.99th=[ 213] bw ( KiB/s): min= 4039, max= 5466, per=87.01%, avg=4752.50, stdev=1009.04, samples=2 iops : min= 3, max= 5, avg= 4.00, stdev= 1.41, samples=2 write: IOPS=1, BW=1637KiB/s (1676kB/s)(5120KiB/3128msec); 0 zone resets clat (msec): min=277, max=544, avg=377.97, stdev=113.17 lat (msec): min=277, max=545, avg=378.12, stdev=113.21 clat percentiles (msec): | 1.00th=[ 279], 5.00th=[ 279], 10.00th=[ 279], 20.00th=[ 279], | 30.00th=[ 288], 40.00th=[ 288], 50.00th=[ 342], 60.00th=[ 342], | 70.00th=[ 439], 80.00th=[ 439], 90.00th=[ 542], 95.00th=[ 542], | 99.00th=[ 542], 99.50th=[ 542], 99.90th=[ 542], 99.95th=[ 542], | 99.99th=[ 542] bw ( KiB/s): min= 2035, max= 3828, per=34.44%, avg=2634.00, stdev=1034.04, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (msec) : 100=16.67%, 250=41.67%, 500=33.33%, 750=8.33% cpu : usr=0.00%, sys=13.56%, ctx=323, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144824: Fri Oct 2 12:09:27 2026 read: IOPS=0, BW=580KiB/s (593kB/s)(2048KiB/3534msec) clat (msec): min=113, max=408, avg=260.53, stdev=208.58 lat (msec): min=113, max=408, avg=260.53, stdev=208.58 clat percentiles (msec): | 1.00th=[ 113], 5.00th=[ 113], 10.00th=[ 113], 20.00th=[ 113], | 30.00th=[ 113], 40.00th=[ 113], 50.00th=[ 113], 60.00th=[ 409], | 70.00th=[ 409], 80.00th=[ 409], 90.00th=[ 409], 95.00th=[ 409], | 99.00th=[ 409], 99.50th=[ 409], 99.90th=[ 409], 99.95th=[ 409], | 99.99th=[ 409] bw ( KiB/s): min= 1932, max= 2039, per=36.35%, avg=1985.50, stdev=75.66, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2898KiB/s (2967kB/s)(10.0MiB/3534msec); 0 zone resets clat (msec): min=85, max=646, avg=282.69, stdev=177.74 lat (msec): min=85, max=646, avg=282.84, stdev=177.77 clat percentiles (msec): | 1.00th=[ 86], 5.00th=[ 86], 10.00th=[ 86], 20.00th=[ 97], | 30.00th=[ 111], 40.00th=[ 182], 50.00th=[ 257], 60.00th=[ 305], | 70.00th=[ 309], 80.00th=[ 397], 90.00th=[ 439], 95.00th=[ 651], | 99.00th=[ 651], 99.50th=[ 651], 99.90th=[ 651], 99.95th=[ 651], | 99.99th=[ 651] bw ( KiB/s): min= 1914, max= 4039, per=38.75%, avg=2963.00, stdev=1144.72, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 1.15, samples=4 lat (msec) : 100=16.67%, 250=25.00%, 500=50.00%, 750=8.33% cpu : usr=0.06%, sys=15.11%, ctx=123, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144825: Fri Oct 2 12:09:27 2026 read: IOPS=1, BW=1735KiB/s (1776kB/s)(6144KiB/3542msec) clat (msec): min=44, max=556, avg=218.19, stdev=187.77 lat (msec): min=44, max=556, avg=218.20, stdev=187.77 clat percentiles (msec): | 1.00th=[ 45], 5.00th=[ 45], 10.00th=[ 45], 20.00th=[ 70], | 30.00th=[ 70], 40.00th=[ 150], 50.00th=[ 150], 60.00th=[ 203], | 70.00th=[ 284], 80.00th=[ 284], 90.00th=[ 558], 95.00th=[ 558], | 99.00th=[ 558], 99.50th=[ 558], 99.90th=[ 558], 99.95th=[ 558], | 99.99th=[ 558] bw ( KiB/s): min= 1932, max= 3828, per=52.73%, avg=2880.00, stdev=1340.67, samples=2 iops : min= 1, max= 3, avg= 2.00, stdev= 1.41, samples=2 write: IOPS=1, BW=1735KiB/s (1776kB/s)(6144KiB/3542msec); 0 zone resets clat (msec): min=57, max=656, avg=345.05, stdev=225.92 lat (msec): min=57, max=656, avg=345.17, stdev=225.91 clat percentiles (msec): | 1.00th=[ 58], 5.00th=[ 58], 10.00th=[ 58], 20.00th=[ 171], | 30.00th=[ 171], 40.00th=[ 241], 50.00th=[ 241], 60.00th=[ 443], | 70.00th=[ 502], 80.00th=[ 502], 90.00th=[ 659], 95.00th=[ 659], | 99.00th=[ 659], 99.50th=[ 659], 99.90th=[ 659], 99.95th=[ 659], | 99.99th=[ 659] bw ( KiB/s): min= 1932, max= 4079, per=35.00%, avg=2676.67, stdev=1215.24, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (msec) : 50=8.33%, 100=16.67%, 250=33.33%, 500=16.67%, 750=25.00% cpu : usr=0.00%, sys=11.78%, ctx=144, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144826: Fri Oct 2 12:09:27 2026 read: IOPS=1, BW=1366KiB/s (1398kB/s)(5120KiB/3749msec) clat (msec): min=32, max=539, avg=255.82, stdev=187.36 lat (msec): min=32, max=539, avg=255.82, stdev=187.36 clat percentiles (msec): | 1.00th=[ 33], 5.00th=[ 33], 10.00th=[ 33], 20.00th=[ 33], | 30.00th=[ 174], 40.00th=[ 174], 50.00th=[ 230], 60.00th=[ 230], | 70.00th=[ 305], 80.00th=[ 305], 90.00th=[ 542], 95.00th=[ 542], | 99.00th=[ 542], 99.50th=[ 542], 99.90th=[ 542], 99.95th=[ 542], | 99.99th=[ 542] bw ( KiB/s): min= 1914, max= 3864, per=47.73%, avg=2607.00, stdev=1090.50, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 write: IOPS=1, BW=1912KiB/s (1958kB/s)(7168KiB/3749msec); 0 zone resets clat (msec): min=68, max=706, avg=328.65, stdev=260.41 lat (msec): min=69, max=706, avg=328.88, stdev=260.30 clat percentiles (msec): | 1.00th=[ 69], 5.00th=[ 69], 10.00th=[ 69], 20.00th=[ 106], | 30.00th=[ 130], 40.00th=[ 130], 50.00th=[ 224], 60.00th=[ 456], | 70.00th=[ 456], 80.00th=[ 609], 90.00th=[ 709], 95.00th=[ 709], | 99.00th=[ 709], 99.50th=[ 709], 99.90th=[ 709], 99.95th=[ 709], | 99.99th=[ 709] bw ( KiB/s): min= 1914, max= 4087, per=39.49%, avg=3019.75, stdev=1205.88, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 1.15, samples=4 lat (msec) : 50=8.33%, 100=8.33%, 250=41.67%, 500=16.67%, 750=25.00% cpu : usr=0.03%, sys=11.13%, ctx=120, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5463KiB/s (5594kB/s), 580KiB/s-2292KiB/s (593kB/s-2347kB/s), io=20.0MiB (20.0MB), run=3128-3749msec WRITE: bw=7648KiB/s (7831kB/s), 1637KiB/s-2898KiB/s (1676kB/s-2967kB/s), io=28.0MiB (29.4MB), run=3128-3749msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144837: Fri Oct 2 12:09:35 2026 read: IOPS=1, BW=6481KiB/s (6637kB/s)(12.0MiB/1896msec) clat (msec): min=405, max=711, avg=592.38, stdev=164.17 lat (msec): min=405, max=711, avg=592.39, stdev=164.18 clat percentiles (msec): | 1.00th=[ 405], 5.00th=[ 405], 10.00th=[ 405], 20.00th=[ 405], | 30.00th=[ 405], 40.00th=[ 659], 50.00th=[ 659], 60.00th=[ 659], | 70.00th=[ 709], 80.00th=[ 709], 90.00th=[ 709], 95.00th=[ 709], | 99.00th=[ 709], 99.50th=[ 709], 99.90th=[ 709], 99.95th=[ 709], | 99.99th=[ 709] bw ( KiB/s): min=16351, max=16351, per=100.00%, avg=16351.00, stdev= 0.00, samples=1 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 750=66.67% cpu : usr=0.00%, sys=10.29%, ctx=75, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144838: Fri Oct 2 12:09:35 2026 read: IOPS=0, BW=1985KiB/s (2033kB/s)(4096KiB/2063msec) clat (nsec): min=399123k, max=399123k, avg=399122518.00, stdev= 0.00 lat (nsec): min=399125k, max=399125k, avg=399125288.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 401], 5.00th=[ 401], 10.00th=[ 401], 20.00th=[ 401], | 30.00th=[ 401], 40.00th=[ 401], 50.00th=[ 401], 60.00th=[ 401], | 70.00th=[ 401], 80.00th=[ 401], 90.00th=[ 401], 95.00th=[ 401], | 99.00th=[ 401], 99.50th=[ 401], 99.90th=[ 401], 99.95th=[ 401], | 99.99th=[ 401] bw ( KiB/s): min= 6059, max= 6059, per=76.30%, avg=6059.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=3971KiB/s (4066kB/s)(8192KiB/2063msec); 0 zone resets clat (msec): min=710, max=863, avg=787.04, stdev=108.33 lat (msec): min=710, max=863, avg=787.29, stdev=108.42 clat percentiles (msec): | 1.00th=[ 709], 5.00th=[ 709], 10.00th=[ 709], 20.00th=[ 709], | 30.00th=[ 709], 40.00th=[ 709], 50.00th=[ 709], 60.00th=[ 860], | 70.00th=[ 860], 80.00th=[ 860], 90.00th=[ 860], 95.00th=[ 860], | 99.00th=[ 860], 99.50th=[ 860], 99.90th=[ 860], 99.95th=[ 860], | 99.99th=[ 860] bw ( KiB/s): min= 8159, max= 8159, per=52.51%, avg=8159.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 750=33.33%, 1000=33.33% cpu : usr=0.00%, sys=8.92%, ctx=53, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144839: Fri Oct 2 12:09:35 2026 write: IOPS=1, BW=5826KiB/s (5966kB/s)(12.0MiB/2109msec); 0 zone resets clat (msec): min=245, max=943, avg=662.80, stdev=368.48 lat (msec): min=246, max=943, avg=663.87, stdev=368.23 clat percentiles (msec): | 1.00th=[ 247], 5.00th=[ 247], 10.00th=[ 247], 20.00th=[ 247], | 30.00th=[ 247], 40.00th=[ 802], 50.00th=[ 802], 60.00th=[ 802], | 70.00th=[ 944], 80.00th=[ 944], 90.00th=[ 944], 95.00th=[ 944], | 99.00th=[ 944], 99.50th=[ 944], 99.90th=[ 944], 99.95th=[ 944], | 99.99th=[ 944] bw ( KiB/s): min= 8175, max= 8175, per=52.62%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 1000=66.67% cpu : usr=0.00%, sys=14.42%, ctx=120, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144840: Fri Oct 2 12:09:35 2026 write: IOPS=1, BW=6400KiB/s (6554kB/s)(12.0MiB/1920msec); 0 zone resets clat (msec): min=318, max=1120, avg=630.79, stdev=429.54 lat (msec): min=319, max=1120, avg=631.09, stdev=429.46 clat percentiles (msec): | 1.00th=[ 317], 5.00th=[ 317], 10.00th=[ 317], 20.00th=[ 317], | 30.00th=[ 317], 40.00th=[ 456], 50.00th=[ 456], 60.00th=[ 456], | 70.00th=[ 1116], 80.00th=[ 1116], 90.00th=[ 1116], 95.00th=[ 1116], | 99.00th=[ 1116], 99.50th=[ 1116], 99.90th=[ 1116], 99.95th=[ 1116], | 99.99th=[ 1116] bw ( KiB/s): min= 6095, max= 8175, per=45.92%, avg=7135.00, stdev=1470.78, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=66.67%, 2000=33.33% cpu : usr=0.00%, sys=11.10%, ctx=67, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=7942KiB/s (8132kB/s), 1985KiB/s-6481KiB/s (2033kB/s-6637kB/s), io=16.0MiB (16.8MB), run=1896-2063msec WRITE: bw=15.2MiB/s (15.9MB/s), 3971KiB/s-6400KiB/s (4066kB/s-6554kB/s), io=32.0MiB (33.6MB), run=1920-2109msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144833: Fri Oct 2 12:09:35 2026 read: IOPS=1, BW=6502KiB/s (6658kB/s)(12.0MiB/1890msec) clat (msec): min=514, max=685, avg=615.39, stdev=89.44 lat (msec): min=514, max=685, avg=615.40, stdev=89.44 clat percentiles (msec): | 1.00th=[ 514], 5.00th=[ 514], 10.00th=[ 514], 20.00th=[ 514], | 30.00th=[ 514], 40.00th=[ 642], 50.00th=[ 642], 60.00th=[ 642], | 70.00th=[ 684], 80.00th=[ 684], 90.00th=[ 684], 95.00th=[ 684], | 99.00th=[ 684], 99.50th=[ 684], 99.90th=[ 684], 99.95th=[ 684], | 99.99th=[ 684] bw ( KiB/s): min= 8192, max= 8192, per=94.51%, avg=8192.00, stdev= 0.00, samples=2 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=2 lat (msec) : 750=100.00% cpu : usr=0.05%, sys=31.50%, ctx=552, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144834: Fri Oct 2 12:09:35 2026 read: IOPS=0, BW=2533KiB/s (2594kB/s)(4096KiB/1617msec) clat (nsec): min=411309k, max=411309k, avg=411308654.00, stdev= 0.00 lat (nsec): min=411311k, max=411311k, avg=411310904.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 414], 5.00th=[ 414], 10.00th=[ 414], 20.00th=[ 414], | 30.00th=[ 414], 40.00th=[ 414], 50.00th=[ 414], 60.00th=[ 414], | 70.00th=[ 414], 80.00th=[ 414], 90.00th=[ 414], 95.00th=[ 414], | 99.00th=[ 414], 99.50th=[ 414], 99.90th=[ 414], 99.95th=[ 414], | 99.99th=[ 414] bw ( KiB/s): min= 6390, max= 6390, per=73.72%, avg=6390.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=1, BW=5066KiB/s (5188kB/s)(8192KiB/1617msec); 0 zone resets clat (msec): min=566, max=605, avg=586.21, stdev=27.27 lat (msec): min=567, max=607, avg=587.24, stdev=28.07 clat percentiles (msec): | 1.00th=[ 567], 5.00th=[ 567], 10.00th=[ 567], 20.00th=[ 567], | 30.00th=[ 567], 40.00th=[ 567], 50.00th=[ 567], 60.00th=[ 609], | 70.00th=[ 609], 80.00th=[ 609], 90.00th=[ 609], 95.00th=[ 609], | 99.00th=[ 609], 99.50th=[ 609], 99.90th=[ 609], 99.95th=[ 609], | 99.99th=[ 609] bw ( KiB/s): min= 8192, max= 8192, per=64.35%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 750=66.67% cpu : usr=0.06%, sys=12.44%, ctx=431, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144835: Fri Oct 2 12:09:35 2026 write: IOPS=1, BW=4774KiB/s (4888kB/s)(12.0MiB/2574msec); 0 zone resets clat (msec): min=155, max=1668, avg=846.53, stdev=764.90 lat (msec): min=155, max=1669, avg=847.00, stdev=765.13 clat percentiles (msec): | 1.00th=[ 157], 5.00th=[ 157], 10.00th=[ 157], 20.00th=[ 157], | 30.00th=[ 157], 40.00th=[ 718], 50.00th=[ 718], 60.00th=[ 718], | 70.00th=[ 1670], 80.00th=[ 1670], 90.00th=[ 1670], 95.00th=[ 1670], | 99.00th=[ 1670], 99.50th=[ 1670], 99.90th=[ 1670], 99.95th=[ 1670], | 99.99th=[ 1670] bw ( KiB/s): min= 8175, max= 8175, per=64.22%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.04%, sys=6.80%, ctx=75, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144836: Fri Oct 2 12:09:35 2026 write: IOPS=1, BW=5196KiB/s (5320kB/s)(12.0MiB/2365msec); 0 zone resets clat (msec): min=203, max=1383, avg=748.99, stdev=595.33 lat (msec): min=203, max=1384, avg=749.33, stdev=595.45 clat percentiles (msec): | 1.00th=[ 205], 5.00th=[ 205], 10.00th=[ 205], 20.00th=[ 205], | 30.00th=[ 205], 40.00th=[ 659], 50.00th=[ 659], 60.00th=[ 659], | 70.00th=[ 1385], 80.00th=[ 1385], 90.00th=[ 1385], 95.00th=[ 1385], | 99.00th=[ 1385], 99.50th=[ 1385], 99.90th=[ 1385], 99.95th=[ 1385], | 99.99th=[ 1385] bw ( KiB/s): min= 8192, max= 8192, per=64.35%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.00%, sys=8.84%, ctx=98, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=8669KiB/s (8877kB/s), 2533KiB/s-6502KiB/s (2594kB/s-6658kB/s), io=16.0MiB (16.8MB), run=1617-1890msec WRITE: bw=12.4MiB/s (13.0MB/s), 4774KiB/s-5196KiB/s (4888kB/s-5320kB/s), io=32.0MiB (33.6MB), run=1617-2574msec