== sanity test 398b: DIO and buffer IO race ============== 15:42:53 (1789587773) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 5.90676 s, 8.5 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=145142: Wed Sep 16 15:45:17 2026 read: IOPS=11, BW=47.9KiB/s (49.1kB/s)(5992KiB/124970msec) clat (usec): min=29, max=817062, avg=39693.68, stdev=35030.74 lat (usec): min=29, max=817063, avg=39694.82, stdev=35030.74 clat percentiles (usec): | 1.00th=[ 50], 5.00th=[ 59], 10.00th=[ 5014], 20.00th=[ 18744], | 30.00th=[ 23462], 40.00th=[ 28443], 50.00th=[ 33817], 60.00th=[ 40109], | 70.00th=[ 47973], 80.00th=[ 57934], 90.00th=[ 74974], 95.00th=[ 88605], | 99.00th=[143655], 99.50th=[168821], 99.90th=[325059], 99.95th=[817890], | 99.99th=[817890] bw ( KiB/s): min= 7, max= 110, per=24.78%, avg=47.34, stdev=21.73, samples=247 iops : min= 1, max= 27, avg=11.20, stdev= 5.47, samples=247 write: IOPS=12, BW=50.4KiB/s (51.6kB/s)(6296KiB/124970msec); 0 zone resets clat (usec): min=981, max=529330, avg=41333.07, stdev=43798.02 lat (usec): min=982, max=529331, avg=41337.69, stdev=43798.36 clat percentiles (usec): | 1.00th=[ 1090], 5.00th=[ 1205], 10.00th=[ 1696], 20.00th=[ 4424], | 30.00th=[ 9372], 40.00th=[ 21627], 50.00th=[ 30540], 60.00th=[ 41157], | 70.00th=[ 53216], 80.00th=[ 69731], 90.00th=[ 94897], 95.00th=[121111], | 99.00th=[200279], 99.50th=[219153], 99.90th=[379585], 99.95th=[530580], | 99.99th=[530580] bw ( KiB/s): min= 7, max= 135, per=24.86%, avg=49.72, stdev=21.47, samples=247 iops : min= 1, max= 33, avg=11.79, stdev= 5.36, samples=247 lat (usec) : 50=0.55%, 100=3.74%, 250=0.20%, 500=0.07%, 750=0.07% lat (usec) : 1000=0.03% lat (msec) : 2=5.89%, 4=3.81%, 10=6.35%, 20=9.96%, 50=39.19% lat (msec) : 100=24.32%, 250=5.66%, 500=0.10%, 750=0.03%, 1000=0.03% cpu : usr=0.07%, sys=4.81%, ctx=6397, majf=0, minf=19 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145143: Wed Sep 16 15:45:17 2026 read: IOPS=12, BW=48.0KiB/s (49.2kB/s)(5940KiB/123698msec) clat (usec): min=30, max=346159, avg=39297.99, stdev=29010.45 lat (usec): min=30, max=346160, avg=39304.60, stdev=29012.81 clat percentiles (usec): | 1.00th=[ 49], 5.00th=[ 59], 10.00th=[ 6521], 20.00th=[ 18482], | 30.00th=[ 23200], 40.00th=[ 27919], 50.00th=[ 33817], 60.00th=[ 40109], | 70.00th=[ 48497], 80.00th=[ 60031], 90.00th=[ 74974], 95.00th=[ 90702], | 99.00th=[121111], 99.50th=[139461], 99.90th=[267387], 99.95th=[346031], | 99.99th=[346031] bw ( KiB/s): min= 7, max= 103, per=24.77%, avg=47.32, stdev=21.11, samples=244 iops : min= 1, max= 25, avg=11.19, stdev= 5.29, samples=244 write: IOPS=12, BW=51.3KiB/s (52.6kB/s)(6348KiB/123698msec); 0 zone resets clat (usec): min=908, max=812258, avg=40903.66, stdev=47480.32 lat (usec): min=908, max=812260, avg=40906.09, stdev=47480.72 clat percentiles (usec): | 1.00th=[ 1090], 5.00th=[ 1205], 10.00th=[ 1450], 20.00th=[ 4178], | 30.00th=[ 9896], 40.00th=[ 20317], 50.00th=[ 30278], 60.00th=[ 40109], | 70.00th=[ 51119], 80.00th=[ 69731], 90.00th=[ 94897], 95.00th=[117965], | 99.00th=[173016], 99.50th=[200279], 99.90th=[666895], 99.95th=[809501], | 99.99th=[809501] bw ( KiB/s): min= 7, max= 118, per=25.35%, avg=50.70, stdev=22.06, samples=243 iops : min= 1, max= 29, avg=12.05, stdev= 5.55, samples=243 lat (usec) : 50=0.68%, 100=3.68%, 250=0.20%, 500=0.07%, 750=0.07% lat (usec) : 1000=0.13% lat (msec) : 2=6.58%, 4=3.58%, 10=5.92%, 20=10.81%, 50=38.83% lat (msec) : 100=23.44%, 250=5.83%, 500=0.13%, 750=0.03%, 1000=0.03% cpu : usr=0.08%, sys=4.94%, ctx=6422, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145144: Wed Sep 16 15:45:17 2026 read: IOPS=12, BW=48.0KiB/s (49.2kB/s)(6028KiB/125485msec) clat (usec): min=35, max=472358, avg=40001.54, stdev=31234.13 lat (usec): min=35, max=472359, avg=40002.69, stdev=31234.13 clat percentiles (usec): | 1.00th=[ 49], 5.00th=[ 59], 10.00th=[ 6980], 20.00th=[ 18220], | 30.00th=[ 23200], 40.00th=[ 27919], 50.00th=[ 33817], 60.00th=[ 40109], | 70.00th=[ 49546], 80.00th=[ 58983], 90.00th=[ 78119], 95.00th=[ 94897], | 99.00th=[139461], 99.50th=[162530], 99.90th=[196084], 99.95th=[471860], | 99.99th=[471860] bw ( KiB/s): min= 7, max= 142, per=25.08%, avg=47.90, stdev=22.16, samples=246 iops : min= 1, max= 35, avg=11.34, stdev= 5.56, samples=246 write: IOPS=12, BW=49.9KiB/s (51.1kB/s)(6260KiB/125485msec); 0 zone resets clat (usec): min=911, max=715564, avg=41369.68, stdev=47080.20 lat (usec): min=912, max=715566, avg=41373.87, stdev=47080.65 clat percentiles (usec): | 1.00th=[ 1074], 5.00th=[ 1188], 10.00th=[ 1467], 20.00th=[ 3851], | 30.00th=[ 8291], 40.00th=[ 18744], 50.00th=[ 28705], 60.00th=[ 40109], | 70.00th=[ 52691], 80.00th=[ 68682], 90.00th=[ 99091], 95.00th=[124257], | 99.00th=[196084], 99.50th=[227541], 99.90th=[375391], 99.95th=[717226], | 99.99th=[717226] bw ( KiB/s): min= 7, max= 173, per=24.65%, avg=49.29, stdev=22.90, samples=248 iops : min= 1, max= 43, avg=11.68, stdev= 5.77, samples=248 lat (usec) : 50=0.68%, 100=3.84%, 250=0.20%, 500=0.03%, 1000=0.26% lat (msec) : 2=6.38%, 4=3.81%, 10=6.35%, 20=10.90%, 50=36.46% lat (msec) : 100=24.12%, 250=6.80%, 500=0.13%, 750=0.03% cpu : usr=0.07%, sys=5.00%, ctx=6488, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145145: Wed Sep 16 15:45:17 2026 read: IOPS=12, BW=48.5KiB/s (49.6kB/s)(6052KiB/124897msec) clat (usec): min=32, max=766197, avg=40858.10, stdev=36273.37 lat (usec): min=32, max=766198, avg=40860.46, stdev=36272.45 clat percentiles (usec): | 1.00th=[ 49], 5.00th=[ 57], 10.00th=[ 94], 20.00th=[ 18220], | 30.00th=[ 22938], 40.00th=[ 28967], 50.00th=[ 34341], 60.00th=[ 41157], | 70.00th=[ 49546], 80.00th=[ 59507], 90.00th=[ 79168], 95.00th=[100140], | 99.00th=[145753], 99.50th=[177210], 99.90th=[246416], 99.95th=[767558], | 99.99th=[767558] bw ( KiB/s): min= 7, max= 127, per=25.40%, avg=48.52, stdev=20.76, samples=244 iops : min= 1, max= 31, avg=11.49, stdev= 5.22, samples=244 write: IOPS=12, BW=49.9KiB/s (51.1kB/s)(6236KiB/124897msec); 0 zone resets clat (usec): min=934, max=662761, avg=40145.60, stdev=42864.87 lat (usec): min=936, max=662761, avg=40151.18, stdev=42864.68 clat percentiles (usec): | 1.00th=[ 1074], 5.00th=[ 1221], 10.00th=[ 1549], 20.00th=[ 4146], | 30.00th=[ 8717], 40.00th=[ 19006], 50.00th=[ 29230], 60.00th=[ 42206], | 70.00th=[ 54264], 80.00th=[ 67634], 90.00th=[ 91751], 95.00th=[115868], | 99.00th=[166724], 99.50th=[193987], 99.90th=[367002], 99.95th=[666895], | 99.99th=[666895] bw ( KiB/s): min= 7, max= 127, per=24.65%, avg=49.30, stdev=21.59, samples=247 iops : min= 1, max= 31, avg=11.70, stdev= 5.42, samples=247 lat (usec) : 50=0.59%, 100=4.46%, 250=0.26%, 500=0.03%, 750=0.03% lat (usec) : 1000=0.10% lat (msec) : 2=6.32%, 4=3.71%, 10=6.18%, 20=10.48%, 50=36.78% lat (msec) : 100=24.51%, 250=6.38%, 500=0.10%, 750=0.03%, 1000=0.03% cpu : usr=0.07%, sys=5.15%, ctx=6508, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=191KiB/s (196kB/s), 47.9KiB/s-48.5KiB/s (49.1kB/s-49.6kB/s), io=23.4MiB (24.6MB), run=123698-125485msec WRITE: bw=200KiB/s (205kB/s), 49.9KiB/s-51.3KiB/s (51.1kB/s-52.6kB/s), io=24.6MiB (25.7MB), run=123698-125485msec rand-rw: (groupid=0, jobs=1): err= 0: pid=145147: Wed Sep 16 15:47:32 2026 read: IOPS=5, BW=23.1KiB/s (23.7kB/s)(5992KiB/259023msec) clat (msec): min=5, max=828, avg=34.33, stdev=40.74 lat (msec): min=5, max=828, avg=34.33, stdev=40.74 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 13], | 30.00th=[ 15], 40.00th=[ 18], 50.00th=[ 22], 60.00th=[ 26], | 70.00th=[ 33], 80.00th=[ 46], 90.00th=[ 78], 95.00th=[ 106], | 99.00th=[ 182], 99.50th=[ 213], 99.90th=[ 388], 99.95th=[ 827], | 99.99th=[ 827] bw ( KiB/s): min= 7, max= 103, per=28.06%, avg=25.82, stdev=17.73, samples=449 iops : min= 1, max= 25, avg= 5.82, stdev= 4.48, samples=449 write: IOPS=6, BW=24.3KiB/s (24.9kB/s)(6296KiB/259023msec); 0 zone resets clat (msec): min=35, max=694, avg=131.80, stdev=68.54 lat (msec): min=35, max=694, avg=131.81, stdev=68.54 clat percentiles (msec): | 1.00th=[ 44], 5.00th=[ 59], 10.00th=[ 68], 20.00th=[ 81], | 30.00th=[ 93], 40.00th=[ 104], 50.00th=[ 115], 60.00th=[ 129], | 70.00th=[ 148], 80.00th=[ 171], 90.00th=[ 213], 95.00th=[ 268], | 99.00th=[ 388], 99.50th=[ 435], 99.90th=[ 575], 99.95th=[ 693], | 99.99th=[ 693] bw ( KiB/s): min= 7, max= 63, per=25.12%, avg=24.11, stdev=11.14, samples=504 iops : min= 1, max= 15, avg= 5.39, stdev= 2.83, samples=504 lat (msec) : 10=4.52%, 20=18.49%, 50=18.10%, 100=23.70%, 250=32.13% lat (msec) : 500=2.93%, 750=0.10%, 1000=0.03% cpu : usr=0.05%, sys=1.09%, ctx=5173, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145148: Wed Sep 16 15:47:32 2026 read: IOPS=5, BW=23.0KiB/s (23.6kB/s)(5940KiB/257908msec) clat (msec): min=5, max=896, avg=33.05, stdev=41.09 lat (msec): min=5, max=896, avg=33.06, stdev=41.09 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 10], 20.00th=[ 13], | 30.00th=[ 15], 40.00th=[ 18], 50.00th=[ 21], 60.00th=[ 26], | 70.00th=[ 32], 80.00th=[ 43], 90.00th=[ 69], 95.00th=[ 103], | 99.00th=[ 169], 99.50th=[ 218], 99.90th=[ 384], 99.95th=[ 894], | 99.99th=[ 894] bw ( KiB/s): min= 7, max= 95, per=28.08%, avg=25.83, stdev=17.36, samples=445 iops : min= 1, max= 23, avg= 5.83, stdev= 4.37, samples=445 write: IOPS=6, BW=24.6KiB/s (25.2kB/s)(6348KiB/257908msec); 0 zone resets clat (msec): min=28, max=691, avg=131.50, stdev=67.28 lat (msec): min=28, max=691, avg=131.50, stdev=67.28 clat percentiles (msec): | 1.00th=[ 45], 5.00th=[ 59], 10.00th=[ 69], 20.00th=[ 81], | 30.00th=[ 91], 40.00th=[ 102], 50.00th=[ 113], 60.00th=[ 130], | 70.00th=[ 146], 80.00th=[ 174], 90.00th=[ 222], 95.00th=[ 262], | 99.00th=[ 372], 99.50th=[ 422], 99.90th=[ 489], 99.95th=[ 693], | 99.99th=[ 693] bw ( KiB/s): min= 7, max= 63, per=25.12%, avg=24.12, stdev=11.47, samples=508 iops : min= 1, max= 15, avg= 5.39, stdev= 2.92, samples=508 lat (msec) : 10=4.95%, 20=17.87%, 50=18.91%, 100=24.15%, 250=30.53% lat (msec) : 500=3.52%, 750=0.03%, 1000=0.03% cpu : usr=0.04%, sys=1.08%, ctx=5057, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145149: Wed Sep 16 15:47:32 2026 read: IOPS=5, BW=23.2KiB/s (23.8kB/s)(6028KiB/259677msec) clat (msec): min=4, max=351, avg=35.02, stdev=38.10 lat (msec): min=4, max=351, avg=35.02, stdev=38.10 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 14], | 30.00th=[ 16], 40.00th=[ 19], 50.00th=[ 23], 60.00th=[ 27], | 70.00th=[ 33], 80.00th=[ 46], 90.00th=[ 79], 95.00th=[ 109], | 99.00th=[ 184], 99.50th=[ 253], 99.90th=[ 347], 99.95th=[ 351], | 99.99th=[ 351] bw ( KiB/s): min= 7, max= 94, per=27.15%, avg=24.97, stdev=17.27, samples=466 iops : min= 1, max= 23, avg= 5.61, stdev= 4.37, samples=466 write: IOPS=6, BW=24.1KiB/s (24.7kB/s)(6260KiB/259677msec); 0 zone resets clat (msec): min=36, max=978, avg=132.14, stdev=69.40 lat (msec): min=36, max=978, avg=132.15, stdev=69.40 clat percentiles (msec): | 1.00th=[ 50], 5.00th=[ 61], 10.00th=[ 68], 20.00th=[ 81], | 30.00th=[ 92], 40.00th=[ 104], 50.00th=[ 117], 60.00th=[ 130], | 70.00th=[ 148], 80.00th=[ 174], 90.00th=[ 215], 95.00th=[ 257], | 99.00th=[ 368], 99.50th=[ 443], 99.90th=[ 625], 99.95th=[ 978], | 99.99th=[ 978] bw ( KiB/s): min= 7, max= 48, per=24.80%, avg=23.81, stdev=11.27, samples=507 iops : min= 1, max= 12, avg= 5.32, stdev= 2.85, samples=507 lat (msec) : 10=4.07%, 20=17.55%, 50=19.11%, 100=24.22%, 250=31.80% lat (msec) : 500=3.16%, 750=0.07%, 1000=0.03% cpu : usr=0.04%, sys=1.11%, ctx=5036, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145150: Wed Sep 16 15:47:32 2026 read: IOPS=5, BW=23.4KiB/s (23.0kB/s)(6052KiB/258242msec) clat (msec): min=5, max=318, avg=34.06, stdev=35.91 lat (msec): min=5, max=318, avg=34.06, stdev=35.91 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 14], | 30.00th=[ 16], 40.00th=[ 19], 50.00th=[ 22], 60.00th=[ 26], | 70.00th=[ 32], 80.00th=[ 46], 90.00th=[ 73], 95.00th=[ 108], | 99.00th=[ 178], 99.50th=[ 222], 99.90th=[ 317], 99.95th=[ 317], | 99.99th=[ 317] bw ( KiB/s): min= 7, max= 96, per=29.01%, avg=26.69, stdev=17.89, samples=439 iops : min= 1, max= 24, avg= 6.04, stdev= 4.51, samples=439 write: IOPS=6, BW=24.1KiB/s (24.7kB/s)(6236KiB/258242msec); 0 zone resets clat (msec): min=35, max=963, avg=132.51, stdev=70.52 lat (msec): min=35, max=963, avg=132.51, stdev=70.51 clat percentiles (msec): | 1.00th=[ 49], 5.00th=[ 61], 10.00th=[ 69], 20.00th=[ 81], | 30.00th=[ 92], 40.00th=[ 104], 50.00th=[ 115], 60.00th=[ 129], | 70.00th=[ 146], 80.00th=[ 171], 90.00th=[ 220], 95.00th=[ 268], | 99.00th=[ 380], 99.50th=[ 422], 99.90th=[ 592], 99.95th=[ 961], | 99.99th=[ 961] bw ( KiB/s): min= 7, max= 55, per=25.04%, avg=24.04, stdev=11.10, samples=500 iops : min= 1, max= 13, avg= 5.38, stdev= 2.83, samples=500 lat (msec) : 10=3.91%, 20=19.14%, 50=18.00%, 100=24.48%, 250=30.92% lat (msec) : 500=3.45%, 750=0.07%, 1000=0.03% cpu : usr=0.03%, sys=1.08%, ctx=5059, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=92.5KiB/s (94.7kB/s), 23.0KiB/s-23.4KiB/s (23.6kB/s-23.0kB/s), io=23.4MiB (24.6MB), run=257908-259677msec WRITE: bw=96.8KiB/s (99.1kB/s), 24.1KiB/s-24.6KiB/s (24.7kB/s-25.2kB/s), io=24.6MiB (25.7MB), run=257908-259677msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=145209: Wed Sep 16 15:48:22 2026 read: IOPS=10, BW=171KiB/s (175kB/s)(5920KiB/34671msec) clat (usec): min=37, max=295160, avg=45213.40, stdev=43547.65 lat (usec): min=37, max=295161, avg=45214.85, stdev=43547.67 clat percentiles (usec): | 1.00th=[ 41], 5.00th=[ 56], 10.00th=[ 65], 20.00th=[ 78], | 30.00th=[ 20841], 40.00th=[ 31851], 50.00th=[ 39584], 60.00th=[ 50070], | 70.00th=[ 58459], 80.00th=[ 73925], 90.00th=[ 91751], 95.00th=[116917], | 99.00th=[217056], 99.50th=[270533], 99.90th=[295699], 99.95th=[295699], | 99.99th=[295699] bw ( KiB/s): min= 31, max= 350, per=24.65%, avg=170.09, stdev=77.74, samples=66 iops : min= 1, max= 21, avg= 9.83, stdev= 4.88, samples=66 write: IOPS=11, BW=184KiB/s (188kB/s)(6368KiB/34671msec); 0 zone resets clat (usec): min=1434, max=384275, avg=43699.63, stdev=54036.15 lat (usec): min=1437, max=384277, avg=43707.23, stdev=54033.21 clat percentiles (usec): | 1.00th=[ 1532], 5.00th=[ 1893], 10.00th=[ 3228], 20.00th=[ 5080], | 30.00th=[ 9634], 40.00th=[ 15533], 50.00th=[ 23200], 60.00th=[ 36963], | 70.00th=[ 53740], 80.00th=[ 72877], 90.00th=[110625], 95.00th=[141558], | 99.00th=[274727], 99.50th=[358613], 99.90th=[383779], 99.95th=[383779], | 99.99th=[383779] bw ( KiB/s): min= 31, max= 446, per=25.44%, avg=184.67, stdev=97.21, samples=66 iops : min= 1, max= 27, avg=10.76, stdev= 6.11, samples=66 lat (usec) : 50=1.43%, 100=9.90%, 250=0.65%, 500=0.13%, 750=0.13% lat (msec) : 2=3.26%, 4=4.82%, 10=8.98%, 20=9.24%, 50=25.00% lat (msec) : 100=26.82%, 250=8.72%, 500=0.91% cpu : usr=0.06%, sys=4.57%, ctx=1420, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145210: Wed Sep 16 15:48:22 2026 read: IOPS=10, BW=172KiB/s (176kB/s)(5744KiB/33409msec) clat (usec): min=37, max=318830, avg=48921.28, stdev=41500.55 lat (usec): min=37, max=318831, avg=48935.27, stdev=41502.23 clat percentiles (usec): | 1.00th=[ 41], 5.00th=[ 60], 10.00th=[ 65], 20.00th=[ 1287], | 30.00th=[ 28967], 40.00th=[ 36439], 50.00th=[ 44827], 60.00th=[ 53216], | 70.00th=[ 63701], 80.00th=[ 74974], 90.00th=[ 90702], 95.00th=[112722], | 99.00th=[193987], 99.50th=[252707], 99.90th=[320865], 99.95th=[320865], | 99.99th=[320865] bw ( KiB/s): min= 21, max= 414, per=25.39%, avg=175.20, stdev=76.43, samples=64 iops : min= 1, max= 25, avg=10.17, stdev= 4.80, samples=64 write: IOPS=12, BW=196KiB/s (201kB/s)(6544KiB/33409msec); 0 zone resets clat (usec): min=1331, max=240813, avg=37642.54, stdev=44079.27 lat (usec): min=1334, max=240817, avg=37651.23, stdev=44077.10 clat percentiles (usec): | 1.00th=[ 1500], 5.00th=[ 1713], 10.00th=[ 2507], 20.00th=[ 4555], | 30.00th=[ 7242], 40.00th=[ 11863], 50.00th=[ 20579], 60.00th=[ 30278], | 70.00th=[ 44303], 80.00th=[ 66323], 90.00th=[100140], 95.00th=[133694], | 99.00th=[200279], 99.50th=[212861], 99.90th=[240124], 99.95th=[240124], | 99.99th=[240124] bw ( KiB/s): min= 42, max= 462, per=27.13%, avg=197.00, stdev=98.87, samples=65 iops : min= 2, max= 28, avg=11.52, stdev= 6.19, samples=65 lat (usec) : 50=0.91%, 100=7.16%, 250=1.17% lat (msec) : 2=4.04%, 4=5.08%, 10=9.77%, 20=9.11%, 50=27.73% lat (msec) : 100=26.69%, 250=8.07%, 500=0.26% cpu : usr=0.04%, sys=5.07%, ctx=1434, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145212: Wed Sep 16 15:48:22 2026 read: IOPS=11, BW=188KiB/s (192kB/s)(6256KiB/33293msec) clat (usec): min=33, max=288182, avg=45066.39, stdev=41054.51 lat (usec): min=33, max=288183, avg=45068.02, stdev=41054.13 clat percentiles (usec): | 1.00th=[ 38], 5.00th=[ 57], 10.00th=[ 62], 20.00th=[ 105], | 30.00th=[ 25297], 40.00th=[ 32375], 50.00th=[ 40633], 60.00th=[ 51119], | 70.00th=[ 57934], 80.00th=[ 69731], 90.00th=[ 89654], 95.00th=[111674], | 99.00th=[223347], 99.50th=[254804], 99.90th=[287310], 99.95th=[287310], | 99.99th=[287310] bw ( KiB/s): min= 62, max= 415, per=27.90%, avg=192.52, stdev=90.90, samples=64 iops : min= 3, max= 25, avg=11.27, stdev= 5.73, samples=64 write: IOPS=11, BW=181KiB/s (186kB/s)(6032KiB/33293msec); 0 zone resets clat (usec): min=1369, max=453043, avg=40444.64, stdev=45867.96 lat (usec): min=1371, max=453045, avg=40446.95, stdev=45867.96 clat percentiles (usec): | 1.00th=[ 1418], 5.00th=[ 1860], 10.00th=[ 2933], 20.00th=[ 5932], | 30.00th=[ 9896], 40.00th=[ 16909], 50.00th=[ 28967], 60.00th=[ 37487], | 70.00th=[ 48497], 80.00th=[ 68682], 90.00th=[ 98042], 95.00th=[111674], | 99.00th=[206570], 99.50th=[246416], 99.90th=[455082], 99.95th=[455082], | 99.99th=[455082] bw ( KiB/s): min= 31, max= 352, per=25.10%, avg=182.22, stdev=86.27, samples=65 iops : min= 1, max= 22, avg=10.60, stdev= 5.45, samples=65 lat (usec) : 50=1.69%, 100=8.46%, 250=1.04%, 500=0.39% lat (msec) : 2=3.39%, 4=3.91%, 10=8.46%, 20=7.29%, 50=29.82% lat (msec) : 100=27.34%, 250=7.81%, 500=0.39% cpu : usr=0.09%, sys=4.80%, ctx=1410, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145214: Wed Sep 16 15:48:22 2026 read: IOPS=11, BW=187KiB/s (192kB/s)(6032KiB/32191msec) clat (usec): min=37, max=236310, avg=48326.03, stdev=40127.02 lat (usec): min=37, max=236311, avg=48329.41, stdev=40129.25 clat percentiles (usec): | 1.00th=[ 41], 5.00th=[ 57], 10.00th=[ 64], 20.00th=[ 12125], | 30.00th=[ 26870], 40.00th=[ 34866], 50.00th=[ 43254], 60.00th=[ 52167], | 70.00th=[ 61080], 80.00th=[ 77071], 90.00th=[ 94897], 95.00th=[123208], | 99.00th=[181404], 99.50th=[227541], 99.90th=[235930], 99.95th=[235930], | 99.99th=[235930] bw ( KiB/s): min= 63, max= 413, per=27.16%, avg=187.40, stdev=70.19, samples=63 iops : min= 3, max= 25, avg=10.95, stdev= 4.42, samples=63 write: IOPS=12, BW=194KiB/s (199kB/s)(6256KiB/32191msec); 0 zone resets clat (usec): min=1387, max=477246, avg=35484.18, stdev=41353.61 lat (usec): min=1388, max=477250, avg=35486.91, stdev=41353.40 clat percentiles (usec): | 1.00th=[ 1467], 5.00th=[ 1696], 10.00th=[ 2114], 20.00th=[ 4686], | 30.00th=[ 7898], 40.00th=[ 14484], 50.00th=[ 22676], 60.00th=[ 32637], | 70.00th=[ 43779], 80.00th=[ 63701], 90.00th=[ 87557], 95.00th=[106431], | 99.00th=[149947], 99.50th=[212861], 99.90th=[476054], 99.95th=[476054], | 99.99th=[476054] bw ( KiB/s): min= 62, max= 447, per=26.83%, avg=194.78, stdev=95.66, samples=63 iops : min= 3, max= 27, avg=11.41, stdev= 6.06, samples=63 lat (usec) : 50=1.17%, 100=7.03%, 250=1.17%, 500=0.13% lat (msec) : 2=4.56%, 4=4.82%, 10=8.72%, 20=7.81%, 50=30.60% lat (msec) : 100=26.17%, 250=7.68%, 500=0.13% cpu : usr=0.07%, sys=5.19%, ctx=1372, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=691KiB/s (707kB/s), 171KiB/s-188KiB/s (175kB/s-192kB/s), io=23.4MiB (24.5MB), run=32191-34671msec WRITE: bw=727KiB/s (744kB/s), 181KiB/s-196KiB/s (186kB/s-201kB/s), io=24.6MiB (25.8MB), run=32191-34671msec rand-rw: (groupid=0, jobs=1): err= 0: pid=145207: Wed Sep 16 15:49:03 2026 read: IOPS=4, BW=78.1KiB/s (80.0kB/s)(5920KiB/75757msec) clat (msec): min=5, max=354, avg=42.36, stdev=45.75 lat (msec): min=5, max=354, avg=42.37, stdev=45.75 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 16], | 30.00th=[ 20], 40.00th=[ 23], 50.00th=[ 28], 60.00th=[ 32], | 70.00th=[ 40], 80.00th=[ 55], 90.00th=[ 94], 95.00th=[ 129], | 99.00th=[ 259], 99.50th=[ 309], 99.90th=[ 355], 99.95th=[ 355], | 99.99th=[ 355] bw ( KiB/s): min= 30, max= 319, per=28.41%, avg=89.77, stdev=54.60, samples=128 iops : min= 1, max= 19, avg= 4.85, stdev= 3.50, samples=128 write: IOPS=5, BW=84.1KiB/s (86.1kB/s)(6368KiB/75757msec); 0 zone resets clat (msec): min=37, max=505, avg=149.68, stdev=75.29 lat (msec): min=37, max=505, avg=149.68, stdev=75.29 clat percentiles (msec): | 1.00th=[ 53], 5.00th=[ 68], 10.00th=[ 77], 20.00th=[ 91], | 30.00th=[ 106], 40.00th=[ 120], 50.00th=[ 131], 60.00th=[ 148], | 70.00th=[ 167], 80.00th=[ 192], 90.00th=[ 253], 95.00th=[ 300], | 99.00th=[ 460], 99.50th=[ 498], 99.90th=[ 506], 99.95th=[ 506], | 99.99th=[ 506] bw ( KiB/s): min= 29, max= 191, per=25.93%, avg=86.10, stdev=39.23, samples=144 iops : min= 1, max= 11, avg= 4.60, stdev= 2.53, samples=144 lat (msec) : 10=1.56%, 20=14.45%, 50=22.27%, 100=18.75%, 250=37.24% lat (msec) : 500=5.60%, 750=0.13% cpu : usr=0.04%, sys=1.05%, ctx=1219, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145208: Wed Sep 16 15:49:03 2026 read: IOPS=4, BW=76.0KiB/s (77.8kB/s)(5744KiB/75577msec) clat (msec): min=6, max=230, avg=39.35, stdev=36.42 lat (msec): min=6, max=230, avg=39.35, stdev=36.42 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 14], 20.00th=[ 17], | 30.00th=[ 19], 40.00th=[ 22], 50.00th=[ 26], 60.00th=[ 32], | 70.00th=[ 40], 80.00th=[ 55], 90.00th=[ 82], 95.00th=[ 124], | 99.00th=[ 184], 99.50th=[ 215], 99.90th=[ 232], 99.95th=[ 232], | 99.99th=[ 232] bw ( KiB/s): min= 31, max= 318, per=29.78%, avg=94.12, stdev=58.27, samples=119 iops : min= 1, max= 19, avg= 5.13, stdev= 3.68, samples=119 write: IOPS=5, BW=86.6KiB/s (88.7kB/s)(6544KiB/75577msec); 0 zone resets clat (msec): min=40, max=580, avg=148.95, stdev=79.00 lat (msec): min=40, max=580, avg=148.96, stdev=79.00 clat percentiles (msec): | 1.00th=[ 52], 5.00th=[ 64], 10.00th=[ 77], 20.00th=[ 91], | 30.00th=[ 104], 40.00th=[ 116], 50.00th=[ 131], 60.00th=[ 144], | 70.00th=[ 163], 80.00th=[ 194], 90.00th=[ 255], 95.00th=[ 292], | 99.00th=[ 460], 99.50th=[ 523], 99.90th=[ 584], 99.95th=[ 584], | 99.99th=[ 584] bw ( KiB/s): min= 30, max= 191, per=26.49%, avg=87.95, stdev=40.41, samples=146 iops : min= 1, max= 11, avg= 4.73, stdev= 2.59, samples=146 lat (msec) : 10=1.56%, 20=14.84%, 50=20.57%, 100=21.09%, 250=36.07% lat (msec) : 500=5.47%, 750=0.39% cpu : usr=0.03%, sys=1.17%, ctx=1263, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145211: Wed Sep 16 15:49:03 2026 read: IOPS=5, BW=84.7KiB/s (86.8kB/s)(6256KiB/73823msec) clat (msec): min=6, max=475, avg=45.14, stdev=50.68 lat (msec): min=6, max=475, avg=45.14, stdev=50.68 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 12], 10.00th=[ 15], 20.00th=[ 17], | 30.00th=[ 20], 40.00th=[ 23], 50.00th=[ 28], 60.00th=[ 33], | 70.00th=[ 44], 80.00th=[ 63], 90.00th=[ 97], 95.00th=[ 140], | 99.00th=[ 257], 99.50th=[ 334], 99.90th=[ 477], 99.95th=[ 477], | 99.99th=[ 477] bw ( KiB/s): min= 29, max= 286, per=31.02%, avg=98.01, stdev=61.80, samples=126 iops : min= 1, max= 17, avg= 5.37, stdev= 3.92, samples=126 write: IOPS=5, BW=81.7KiB/s (83.7kB/s)(6032KiB/73823msec); 0 zone resets clat (msec): min=31, max=496, avg=148.65, stdev=76.36 lat (msec): min=31, max=496, avg=148.65, stdev=76.36 clat percentiles (msec): | 1.00th=[ 46], 5.00th=[ 66], 10.00th=[ 74], 20.00th=[ 92], | 30.00th=[ 102], 40.00th=[ 116], 50.00th=[ 131], 60.00th=[ 146], | 70.00th=[ 165], 80.00th=[ 194], 90.00th=[ 255], 95.00th=[ 313], | 99.00th=[ 426], 99.50th=[ 456], 99.90th=[ 498], 99.95th=[ 498], | 99.99th=[ 498] bw ( KiB/s): min= 29, max= 191, per=24.81%, avg=82.37, stdev=41.05, samples=144 iops : min= 1, max= 11, avg= 4.38, stdev= 2.66, samples=144 lat (msec) : 10=1.82%, 20=14.19%, 50=23.05%, 100=21.22%, 250=33.98% lat (msec) : 500=5.73% cpu : usr=0.06%, sys=1.19%, ctx=1356, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145213: Wed Sep 16 15:49:03 2026 read: IOPS=4, BW=79.8KiB/s (81.7kB/s)(6032KiB/75593msec) clat (msec): min=6, max=305, avg=42.24, stdev=44.80 lat (msec): min=6, max=305, avg=42.25, stdev=44.80 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 14], 20.00th=[ 17], | 30.00th=[ 20], 40.00th=[ 22], 50.00th=[ 26], 60.00th=[ 32], | 70.00th=[ 41], 80.00th=[ 56], 90.00th=[ 96], 95.00th=[ 144], | 99.00th=[ 262], 99.50th=[ 275], 99.90th=[ 305], 99.95th=[ 305], | 99.99th=[ 305] bw ( KiB/s): min= 30, max= 287, per=29.33%, avg=92.69, stdev=60.89, samples=127 iops : min= 1, max= 17, avg= 5.02, stdev= 3.85, samples=127 write: IOPS=5, BW=82.8KiB/s (84.7kB/s)(6256KiB/75593msec); 0 zone resets clat (msec): min=34, max=556, avg=151.61, stdev=80.44 lat (msec): min=34, max=556, avg=151.61, stdev=80.44 clat percentiles (msec): | 1.00th=[ 57], 5.00th=[ 68], 10.00th=[ 80], 20.00th=[ 95], | 30.00th=[ 106], 40.00th=[ 115], 50.00th=[ 127], 60.00th=[ 140], | 70.00th=[ 163], 80.00th=[ 203], 90.00th=[ 266], 95.00th=[ 309], | 99.00th=[ 439], 99.50th=[ 542], 99.90th=[ 558], 99.95th=[ 558], | 99.99th=[ 558] bw ( KiB/s): min= 30, max= 191, per=25.31%, avg=84.01, stdev=41.11, samples=146 iops : min= 1, max= 11, avg= 4.48, stdev= 2.67, samples=146 lat (msec) : 10=1.95%, 20=14.45%, 50=21.35%, 100=20.18%, 250=35.42% lat (msec) : 500=6.25%, 750=0.39% cpu : usr=0.04%, sys=1.17%, ctx=1206, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=316KiB/s (324kB/s), 76.0KiB/s-84.7KiB/s (77.8kB/s-86.8kB/s), io=23.4MiB (24.5MB), run=73823-75757msec WRITE: bw=333KiB/s (341kB/s), 81.7KiB/s-86.6KiB/s (83.7kB/s-88.7kB/s), io=24.6MiB (25.8MB), run=73823-75757msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=145231: Wed Sep 16 15:49:18 2026 read: IOPS=1, BW=1681KiB/s (1721kB/s)(7168KiB/4264msec) clat (usec): min=670, max=389520, avg=213836.89, stdev=127294.34 lat (usec): min=672, max=389522, avg=213853.39, stdev=127288.00 clat percentiles (usec): | 1.00th=[ 668], 5.00th=[ 668], 10.00th=[ 668], 20.00th=[160433], | 30.00th=[166724], 40.00th=[166724], 50.00th=[210764], 60.00th=[227541], | 70.00th=[227541], 80.00th=[337642], 90.00th=[387974], 95.00th=[387974], | 99.00th=[387974], 99.50th=[387974], 99.90th=[387974], 99.95th=[387974], | 99.99th=[387974] bw ( KiB/s): min= 1872, max= 3992, per=67.16%, avg=2377.40, stdev=905.06, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 write: IOPS=1, BW=1201KiB/s (1230kB/s)(5120KiB/4264msec); 0 zone resets clat (msec): min=261, max=963, avg=546.17, stdev=365.42 lat (msec): min=261, max=963, avg=546.59, stdev=365.13 clat percentiles (msec): | 1.00th=[ 262], 5.00th=[ 262], 10.00th=[ 262], 20.00th=[ 262], | 30.00th=[ 288], 40.00th=[ 288], 50.00th=[ 292], 60.00th=[ 292], | 70.00th=[ 927], 80.00th=[ 927], 90.00th=[ 961], 95.00th=[ 961], | 99.00th=[ 961], 99.50th=[ 961], 99.90th=[ 961], 99.95th=[ 961], | 99.99th=[ 961] bw ( KiB/s): min= 1872, max= 2043, per=39.92%, avg=1978.75, stdev=81.90, samples=4 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=4 lat (usec) : 750=8.33% lat (msec) : 250=33.33%, 500=41.67%, 1000=16.67% cpu : usr=0.00%, sys=10.88%, ctx=220, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145232: Wed Sep 16 15:49:18 2026 read: IOPS=0, BW=354KiB/s (363kB/s)(2048KiB/5784msec) clat (usec): min=486, max=154207, avg=77346.83, stdev=108696.85 lat (usec): min=487, max=154210, avg=77349.13, stdev=108698.23 clat percentiles (usec): | 1.00th=[ 486], 5.00th=[ 486], 10.00th=[ 486], 20.00th=[ 486], | 30.00th=[ 486], 40.00th=[ 486], 50.00th=[ 486], 60.00th=[154141], | 70.00th=[154141], 80.00th=[154141], 90.00th=[154141], 95.00th=[154141], | 99.00th=[154141], 99.50th=[154141], 99.90th=[154141], 99.95th=[154141], | 99.99th=[154141] bw ( KiB/s): min= 2003, max= 2003, per=56.58%, avg=2003.00, stdev= 0.00, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1770KiB/s (1813kB/s)(10.0MiB/5784msec); 0 zone resets clat (msec): min=71, max=1152, avg=552.71, stdev=326.90 lat (msec): min=71, max=1152, avg=552.80, stdev=326.87 clat percentiles (msec): | 1.00th=[ 72], 5.00th=[ 72], 10.00th=[ 72], 20.00th=[ 146], | 30.00th=[ 305], 40.00th=[ 439], 50.00th=[ 518], 60.00th=[ 667], | 70.00th=[ 676], 80.00th=[ 776], 90.00th=[ 785], 95.00th=[ 1150], | 99.00th=[ 1150], 99.50th=[ 1150], 99.90th=[ 1150], 99.95th=[ 1150], | 99.99th=[ 1150] bw ( KiB/s): min= 1885, max= 6144, per=51.85%, avg=2570.43, stdev=1576.60, samples=7 iops : min= 1, max= 6, avg= 1.71, stdev= 1.89, samples=7 lat (usec) : 500=8.33% lat (msec) : 100=8.33%, 250=16.67%, 500=16.67%, 750=25.00%, 1000=16.67% lat (msec) : 2000=8.33% cpu : usr=0.00%, sys=9.11%, ctx=171, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145233: Wed Sep 16 15:49:18 2026 read: IOPS=1, BW=1350KiB/s (1383kB/s)(6144KiB/4550msec) clat (usec): min=560, max=510698, avg=288012.85, stdev=175269.54 lat (usec): min=562, max=510699, avg=288014.27, stdev=175269.64 clat percentiles (usec): | 1.00th=[ 562], 5.00th=[ 562], 10.00th=[ 562], 20.00th=[221250], | 30.00th=[221250], 40.00th=[274727], 50.00th=[274727], 60.00th=[299893], | 70.00th=[417334], 80.00th=[417334], 90.00th=[509608], 95.00th=[509608], | 99.00th=[509608], 99.50th=[509608], 99.90th=[509608], 99.95th=[509608], | 99.99th=[509608] bw ( KiB/s): min= 1872, max= 4087, per=92.98%, avg=3291.33, stdev=1232.18, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 write: IOPS=1, BW=1350KiB/s (1383kB/s)(6144KiB/4550msec); 0 zone resets clat (msec): min=223, max=784, avg=452.31, stdev=193.67 lat (msec): min=223, max=785, avg=452.40, stdev=193.67 clat percentiles (msec): | 1.00th=[ 224], 5.00th=[ 224], 10.00th=[ 224], 20.00th=[ 300], | 30.00th=[ 300], 40.00th=[ 447], 50.00th=[ 447], 60.00th=[ 468], | 70.00th=[ 489], 80.00th=[ 489], 90.00th=[ 785], 95.00th=[ 785], | 99.00th=[ 785], 99.50th=[ 785], 99.90th=[ 785], 99.95th=[ 785], | 99.99th=[ 785] bw ( KiB/s): min= 1885, max= 4087, per=48.37%, avg=2397.60, stdev=946.47, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 lat (usec) : 750=8.33% lat (msec) : 250=16.67%, 500=58.33%, 750=8.33%, 1000=8.33% cpu : usr=0.00%, sys=9.87%, ctx=216, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145234: Wed Sep 16 15:49:18 2026 read: IOPS=1, BW=1253KiB/s (1283kB/s)(5120KiB/4087msec) clat (msec): min=4, max=382, avg=205.40, stdev=185.05 lat (msec): min=4, max=382, avg=205.41, stdev=185.05 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 5], 10.00th=[ 5], 20.00th=[ 5], | 30.00th=[ 9], 40.00th=[ 9], 50.00th=[ 284], 60.00th=[ 284], | 70.00th=[ 351], 80.00th=[ 351], 90.00th=[ 384], 95.00th=[ 384], | 99.00th=[ 384], 99.50th=[ 384], 99.90th=[ 384], 99.95th=[ 384], | 99.99th=[ 384] bw ( KiB/s): min= 1957, max= 5851, per=100.00%, avg=3904.00, stdev=2753.47, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 write: IOPS=1, BW=1754KiB/s (1796kB/s)(7168KiB/4087msec); 0 zone resets clat (msec): min=308, max=573, avg=419.79, stdev=106.86 lat (msec): min=308, max=573, avg=419.92, stdev=106.87 clat percentiles (msec): | 1.00th=[ 309], 5.00th=[ 309], 10.00th=[ 309], 20.00th=[ 321], | 30.00th=[ 330], 40.00th=[ 330], 50.00th=[ 409], 60.00th=[ 477], | 70.00th=[ 477], 80.00th=[ 523], 90.00th=[ 575], 95.00th=[ 575], | 99.00th=[ 575], 99.50th=[ 575], 99.90th=[ 575], 99.95th=[ 575], | 99.99th=[ 575] bw ( KiB/s): min= 1872, max= 4087, per=48.34%, avg=2396.40, stdev=947.43, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 lat (msec) : 10=16.67%, 500=66.67%, 750=16.67% cpu : usr=0.02%, sys=11.99%, ctx=158, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3541KiB/s (3626kB/s), 354KiB/s-1681KiB/s (363kB/s-1721kB/s), io=20.0MiB (20.0MB), run=4087-5784msec WRITE: bw=4957KiB/s (5076kB/s), 1201KiB/s-1770KiB/s (1230kB/s-1813kB/s), io=28.0MiB (29.4MB), run=4087-5784msec rand-rw: (groupid=0, jobs=1): err= 0: pid=145236: Wed Sep 16 15:49:19 2026 read: IOPS=1, BW=1509KiB/s (1545kB/s)(7168KiB/4750msec) clat (msec): min=100, max=833, avg=339.89, stdev=269.96 lat (msec): min=100, max=833, avg=339.89, stdev=269.96 clat percentiles (msec): | 1.00th=[ 102], 5.00th=[ 102], 10.00th=[ 102], 20.00th=[ 118], | 30.00th=[ 142], 40.00th=[ 142], 50.00th=[ 259], 60.00th=[ 388], | 70.00th=[ 388], 80.00th=[ 542], 90.00th=[ 835], 95.00th=[ 835], | 99.00th=[ 835], 99.50th=[ 835], 99.90th=[ 835], 99.95th=[ 835], | 99.99th=[ 835] bw ( KiB/s): min= 1861, max= 3828, per=76.91%, avg=2332.60, stdev=838.83, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 write: IOPS=1, BW=1078KiB/s (1104kB/s)(5120KiB/4750msec); 0 zone resets clat (msec): min=372, max=763, avg=473.61, stdev=164.41 lat (msec): min=372, max=763, avg=473.71, stdev=164.41 clat percentiles (msec): | 1.00th=[ 372], 5.00th=[ 372], 10.00th=[ 372], 20.00th=[ 372], | 30.00th=[ 380], 40.00th=[ 380], 50.00th=[ 418], 60.00th=[ 418], | 70.00th=[ 439], 80.00th=[ 439], 90.00th=[ 768], 95.00th=[ 768], | 99.00th=[ 768], 99.50th=[ 768], 99.90th=[ 768], 99.95th=[ 768], | 99.99th=[ 768] bw ( KiB/s): min= 1706, max= 2039, per=44.02%, avg=1869.50, stdev=136.06, samples=4 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=4 lat (msec) : 250=25.00%, 500=50.00%, 750=8.33%, 1000=16.67% cpu : usr=0.00%, sys=3.37%, ctx=86, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145237: Wed Sep 16 15:49:19 2026 read: IOPS=0, BW=303KiB/s (311kB/s)(2048KiB/6751msec) clat (msec): min=220, max=802, avg=511.82, stdev=411.29 lat (msec): min=220, max=802, avg=511.82, stdev=411.29 clat percentiles (msec): | 1.00th=[ 222], 5.00th=[ 222], 10.00th=[ 222], 20.00th=[ 222], | 30.00th=[ 222], 40.00th=[ 222], 50.00th=[ 222], 60.00th=[ 802], | 70.00th=[ 802], 80.00th=[ 802], 90.00th=[ 802], 95.00th=[ 802], | 99.00th=[ 802], 99.50th=[ 802], 99.90th=[ 802], 99.95th=[ 802], | 99.99th=[ 802] bw ( KiB/s): min= 2007, max= 2043, per=66.77%, avg=2025.00, stdev=25.46, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1517KiB/s (1553kB/s)(10.0MiB/6751msec); 0 zone resets clat (msec): min=205, max=1285, avg=560.63, stdev=355.53 lat (msec): min=205, max=1285, avg=560.76, stdev=355.53 clat percentiles (msec): | 1.00th=[ 207], 5.00th=[ 207], 10.00th=[ 207], 20.00th=[ 230], | 30.00th=[ 275], 40.00th=[ 275], 50.00th=[ 317], 60.00th=[ 735], | 70.00th=[ 743], 80.00th=[ 760], 90.00th=[ 785], 95.00th=[ 1284], | 99.00th=[ 1284], 99.50th=[ 1284], 99.90th=[ 1284], 99.95th=[ 1284], | 99.99th=[ 1284] bw ( KiB/s): min= 1861, max= 4055, per=53.37%, avg=2266.71, stdev=791.74, samples=7 iops : min= 1, max= 3, avg= 1.29, stdev= 0.76, samples=7 lat (msec) : 250=25.00%, 500=25.00%, 750=16.67%, 1000=25.00%, 2000=8.33% cpu : usr=0.00%, sys=3.20%, ctx=113, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145238: Wed Sep 16 15:49:19 2026 read: IOPS=1, BW=1058KiB/s (1084kB/s)(6144KiB/5805msec) clat (msec): min=161, max=749, avg=340.76, stdev=232.10 lat (msec): min=161, max=749, avg=340.76, stdev=232.10 clat percentiles (msec): | 1.00th=[ 163], 5.00th=[ 163], 10.00th=[ 163], 20.00th=[ 203], | 30.00th=[ 203], 40.00th=[ 218], 50.00th=[ 218], 60.00th=[ 224], | 70.00th=[ 489], 80.00th=[ 489], 90.00th=[ 751], 95.00th=[ 751], | 99.00th=[ 751], 99.50th=[ 751], 99.90th=[ 751], 99.95th=[ 751], | 99.99th=[ 751] bw ( KiB/s): min= 1872, max= 2043, per=65.25%, avg=1979.00, stdev=80.12, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 write: IOPS=1, BW=1058KiB/s (1084kB/s)(6144KiB/5805msec); 0 zone resets clat (msec): min=313, max=926, avg=612.32, stdev=231.70 lat (msec): min=313, max=926, avg=612.43, stdev=231.69 clat percentiles (msec): | 1.00th=[ 313], 5.00th=[ 313], 10.00th=[ 313], 20.00th=[ 510], | 30.00th=[ 510], 40.00th=[ 514], 50.00th=[ 514], 60.00th=[ 558], | 70.00th=[ 852], 80.00th=[ 852], 90.00th=[ 927], 95.00th=[ 927], | 99.00th=[ 927], 99.50th=[ 927], 99.90th=[ 927], 99.95th=[ 927], | 99.99th=[ 927] bw ( KiB/s): min= 1706, max= 2043, per=44.95%, avg=1909.00, stdev=133.64, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 lat (msec) : 250=33.33%, 500=16.67%, 750=33.33%, 1000=16.67% cpu : usr=0.02%, sys=3.02%, ctx=73, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145239: Wed Sep 16 15:49:19 2026 read: IOPS=0, BW=792KiB/s (811kB/s)(5120KiB/6465msec) clat (msec): min=136, max=767, avg=369.75, stdev=284.61 lat (msec): min=136, max=767, avg=369.75, stdev=284.61 clat percentiles (msec): | 1.00th=[ 138], 5.00th=[ 138], 10.00th=[ 138], 20.00th=[ 138], | 30.00th=[ 153], 40.00th=[ 153], 50.00th=[ 220], 60.00th=[ 220], | 70.00th=[ 575], 80.00th=[ 575], 90.00th=[ 768], 95.00th=[ 768], | 99.00th=[ 768], 99.50th=[ 768], 99.90th=[ 768], 99.95th=[ 768], | 99.99th=[ 768] bw ( KiB/s): min= 1706, max= 2043, per=64.42%, avg=1953.75, stdev=165.31, samples=4 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=4 write: IOPS=1, BW=1109KiB/s (1135kB/s)(7168KiB/6465msec); 0 zone resets clat (msec): min=238, max=1085, avg=648.10, stdev=363.44 lat (msec): min=238, max=1085, avg=648.26, stdev=363.49 clat percentiles (msec): | 1.00th=[ 239], 5.00th=[ 239], 10.00th=[ 239], 20.00th=[ 243], | 30.00th=[ 338], 40.00th=[ 338], 50.00th=[ 802], 60.00th=[ 869], | 70.00th=[ 869], 80.00th=[ 961], 90.00th=[ 1083], 95.00th=[ 1083], | 99.00th=[ 1083], 99.50th=[ 1083], 99.90th=[ 1083], 99.95th=[ 1083], | 99.99th=[ 1083] bw ( KiB/s): min= 1861, max= 4055, per=64.53%, avg=2740.40, stdev=1065.86, samples=5 iops : min= 1, max= 3, avg= 1.80, stdev= 1.10, samples=5 lat (msec) : 250=41.67%, 500=8.33%, 750=8.33%, 1000=33.33%, 2000=8.33% cpu : usr=0.00%, sys=2.63%, ctx=68, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3034KiB/s (3106kB/s), 303KiB/s-1509KiB/s (311kB/s-1545kB/s), io=20.0MiB (20.0MB), run=4750-6751msec WRITE: bw=4247KiB/s (4349kB/s), 1058KiB/s-1517KiB/s (1084kB/s-1553kB/s), io=28.0MiB (29.4MB), run=4750-6751msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=145251: Wed Sep 16 15:49:36 2026 read: IOPS=0, BW=3210KiB/s (3287kB/s)(12.0MiB/3828msec) clat (msec): min=794, max=1590, avg=1243.22, stdev=407.53 lat (msec): min=794, max=1590, avg=1243.23, stdev=407.53 clat percentiles (msec): | 1.00th=[ 793], 5.00th=[ 793], 10.00th=[ 793], 20.00th=[ 793], | 30.00th=[ 793], 40.00th=[ 1351], 50.00th=[ 1351], 60.00th=[ 1351], | 70.00th=[ 1586], 80.00th=[ 1586], 90.00th=[ 1586], 95.00th=[ 1586], | 99.00th=[ 1586], 99.50th=[ 1586], 99.90th=[ 1586], 99.95th=[ 1586], | 99.99th=[ 1586] bw ( KiB/s): min= 8143, max= 8192, per=100.00%, avg=8167.50, stdev=34.65, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 1000=33.33%, 2000=66.67% cpu : usr=0.00%, sys=10.90%, ctx=219, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145252: Wed Sep 16 15:49:36 2026 read: IOPS=0, BW=1141KiB/s (1168kB/s)(4096KiB/3591msec) clat (nsec): min=708443k, max=708443k, avg=708443467.00, stdev= 0.00 lat (nsec): min=708446k, max=708446k, avg=708445985.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 709], 5.00th=[ 709], 10.00th=[ 709], 20.00th=[ 709], | 30.00th=[ 709], 40.00th=[ 709], 50.00th=[ 709], 60.00th=[ 709], | 70.00th=[ 709], 80.00th=[ 709], 90.00th=[ 709], 95.00th=[ 709], | 99.00th=[ 709], 99.50th=[ 709], 99.90th=[ 709], 99.95th=[ 709], | 99.99th=[ 709] bw ( KiB/s): min= 8015, max= 8015, per=100.00%, avg=8015.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2281KiB/s (2336kB/s)(8192KiB/3591msec); 0 zone resets clat (msec): min=705, max=2067, avg=1386.30, stdev=962.78 lat (msec): min=705, max=2067, avg=1386.65, stdev=962.81 clat percentiles (msec): | 1.00th=[ 709], 5.00th=[ 709], 10.00th=[ 709], 20.00th=[ 709], | 30.00th=[ 709], 40.00th=[ 709], 50.00th=[ 709], 60.00th=[ 2072], | 70.00th=[ 2072], 80.00th=[ 2072], 90.00th=[ 2072], 95.00th=[ 2072], | 99.00th=[ 2072], 99.50th=[ 2072], 99.90th=[ 2072], 99.95th=[ 2072], | 99.99th=[ 2072] bw ( KiB/s): min= 8175, max= 8175, per=100.00%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=66.67%, >=2000=33.33% cpu : usr=0.00%, sys=2.31%, ctx=111, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145253: Wed Sep 16 15:49:36 2026 write: IOPS=0, BW=2477KiB/s (2536kB/s)(12.0MiB/4961msec); 0 zone resets clat (msec): min=535, max=3408, avg=1633.62, stdev=1551.22 lat (msec): min=536, max=3408, avg=1634.11, stdev=1551.33 clat percentiles (msec): | 1.00th=[ 535], 5.00th=[ 535], 10.00th=[ 535], 20.00th=[ 535], | 30.00th=[ 535], 40.00th=[ 961], 50.00th=[ 961], 60.00th=[ 961], | 70.00th=[ 3406], 80.00th=[ 3406], 90.00th=[ 3406], 95.00th=[ 3406], | 99.00th=[ 3406], 99.50th=[ 3406], 99.90th=[ 3406], 99.95th=[ 3406], | 99.99th=[ 3406] bw ( KiB/s): min= 8015, max= 8143, per=100.00%, avg=8079.00, stdev=90.51, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 1000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=2.20%, ctx=68, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145254: Wed Sep 16 15:49:36 2026 write: IOPS=0, BW=2209KiB/s (2262kB/s)(12.0MiB/5562msec); 0 zone resets clat (msec): min=1192, max=2606, avg=1797.11, stdev=729.18 lat (msec): min=1197, max=2609, avg=1802.54, stdev=727.31 clat percentiles (msec): | 1.00th=[ 1200], 5.00th=[ 1200], 10.00th=[ 1200], 20.00th=[ 1200], | 30.00th=[ 1200], 40.00th=[ 1586], 50.00th=[ 1586], 60.00th=[ 1586], | 70.00th=[ 2601], 80.00th=[ 2601], 90.00th=[ 2601], 95.00th=[ 2601], | 99.00th=[ 2601], 99.50th=[ 2601], 99.90th=[ 2601], 99.95th=[ 2601], | 99.99th=[ 2601] bw ( KiB/s): min= 8047, max= 8175, per=100.00%, avg=8111.00, stdev=90.51, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 2000=66.67%, >=2000=33.33% cpu : usr=0.07%, sys=3.58%, ctx=68, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4280KiB/s (4383kB/s), 1141KiB/s-3210KiB/s (1168kB/s-3287kB/s), io=16.0MiB (16.8MB), run=3591-3828msec WRITE: bw=5891KiB/s (6033kB/s), 2209KiB/s-2477KiB/s (2262kB/s-2536kB/s), io=32.0MiB (33.6MB), run=3591-5562msec rand-rw: (groupid=0, jobs=1): err= 0: pid=145247: Wed Sep 16 15:49:36 2026 read: IOPS=1, BW=5548KiB/s (5681kB/s)(12.0MiB/2215msec) clat (msec): min=289, max=1411, avg=723.66, stdev=602.44 lat (msec): min=289, max=1411, avg=723.66, stdev=602.44 clat percentiles (msec): | 1.00th=[ 292], 5.00th=[ 292], 10.00th=[ 292], 20.00th=[ 292], | 30.00th=[ 292], 40.00th=[ 468], 50.00th=[ 468], 60.00th=[ 468], | 70.00th=[ 1418], 80.00th=[ 1418], 90.00th=[ 1418], 95.00th=[ 1418], | 99.00th=[ 1418], 99.50th=[ 1418], 99.90th=[ 1418], 99.95th=[ 1418], | 99.99th=[ 1418] bw ( KiB/s): min= 6585, max= 7757, per=100.00%, avg=7171.00, stdev=828.73, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=66.67%, 2000=33.33% cpu : usr=0.05%, sys=5.47%, ctx=62, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145248: Wed Sep 16 15:49:36 2026 read: IOPS=0, BW=839KiB/s (859kB/s)(4096KiB/4880msec) clat (nsec): min=1024.9M, max=1024.9M, avg=1024933982.00, stdev= 0.00 lat (nsec): min=1024.9M, max=1024.9M, avg=1024936192.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1028], 5.00th=[ 1028], 10.00th=[ 1028], 20.00th=[ 1028], | 30.00th=[ 1028], 40.00th=[ 1028], 50.00th=[ 1028], 60.00th=[ 1028], | 70.00th=[ 1028], 80.00th=[ 1028], 90.00th=[ 1028], 95.00th=[ 1028], | 99.00th=[ 1028], 99.50th=[ 1028], 99.90th=[ 1028], 99.95th=[ 1028], | 99.99th=[ 1028] bw ( KiB/s): min= 7816, max= 7816, per=100.00%, avg=7816.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=1679KiB/s (1719kB/s)(8192KiB/4880msec); 0 zone resets clat (msec): min=608, max=3159, avg=1884.23, stdev=1803.59 lat (msec): min=609, max=3159, avg=1884.55, stdev=1803.63 clat percentiles (msec): | 1.00th=[ 609], 5.00th=[ 609], 10.00th=[ 609], 20.00th=[ 609], | 30.00th=[ 609], 40.00th=[ 609], 50.00th=[ 609], 60.00th=[ 3171], | 70.00th=[ 3171], 80.00th=[ 3171], 90.00th=[ 3171], 95.00th=[ 3171], | 99.00th=[ 3171], 99.50th=[ 3171], 99.90th=[ 3171], 99.95th=[ 3171], | 99.99th=[ 3171] bw ( KiB/s): min= 8110, max= 8110, per=100.00%, avg=8110.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=2.95%, ctx=45, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145249: Wed Sep 16 15:49:36 2026 write: IOPS=0, BW=2029KiB/s (2078kB/s)(12.0MiB/6056msec); 0 zone resets clat (msec): min=470, max=4567, avg=1962.66, stdev=2264.04 lat (msec): min=471, max=4568, avg=1963.07, stdev=2264.30 clat percentiles (msec): | 1.00th=[ 472], 5.00th=[ 472], 10.00th=[ 472], 20.00th=[ 472], | 30.00th=[ 472], 40.00th=[ 852], 50.00th=[ 852], 60.00th=[ 852], | 70.00th=[ 4597], 80.00th=[ 4597], 90.00th=[ 4597], 95.00th=[ 4597], | 99.00th=[ 4597], 99.50th=[ 4597], 99.90th=[ 4597], 99.95th=[ 4597], | 99.99th=[ 4597] bw ( KiB/s): min= 7876, max= 7876, per=100.00%, avg=7876.00, stdev= 0.00, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 1000=33.33%, >=2000=33.33% cpu : usr=0.12%, sys=2.39%, ctx=48, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145250: Wed Sep 16 15:49:36 2026 write: IOPS=0, BW=2460KiB/s (2519kB/s)(12.0MiB/4995msec); 0 zone resets clat (msec): min=592, max=3737, avg=1644.26, stdev=1813.04 lat (msec): min=601, max=3738, avg=1648.31, stdev=1810.02 clat percentiles (msec): | 1.00th=[ 592], 5.00th=[ 592], 10.00th=[ 592], 20.00th=[ 592], | 30.00th=[ 592], 40.00th=[ 600], 50.00th=[ 600], 60.00th=[ 600], | 70.00th=[ 3742], 80.00th=[ 3742], 90.00th=[ 3742], 95.00th=[ 3742], | 99.00th=[ 3742], 99.50th=[ 3742], 99.90th=[ 3742], 99.95th=[ 3742], | 99.99th=[ 3742] bw ( KiB/s): min= 5720, max= 8159, per=100.00%, avg=6939.50, stdev=1724.63, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=66.67%, >=2000=33.33% cpu : usr=0.02%, sys=2.28%, ctx=57, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3357KiB/s (3438kB/s), 839KiB/s-5548KiB/s (859kB/s-5681kB/s), io=16.0MiB (16.8MB), run=2215-4880msec WRITE: bw=5411KiB/s (5541kB/s), 1679KiB/s-2460KiB/s (1719kB/s-2519kB/s), io=32.0MiB (33.6MB), run=4880-6056msec