== sanity test 398b: DIO and buffer IO race ============== 21:48:48 (1783648128) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 2.99291 s, 16.8 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=191610: Thu Jul 9 21:49:54 2026 read: IOPS=26, BW=105KiB/s (108kB/s)(5992KiB/56895msec) clat (usec): min=42, max=105905, avg=20160.85, stdev=10689.35 lat (usec): min=44, max=105906, avg=20161.80, stdev=10689.34 clat percentiles (usec): | 1.00th=[ 115], 5.00th=[ 8586], 10.00th=[ 10028], 20.00th=[ 11994], | 30.00th=[ 13698], 40.00th=[ 15926], 50.00th=[ 18220], 60.00th=[ 20841], | 70.00th=[ 23462], 80.00th=[ 27395], 90.00th=[ 32637], 95.00th=[ 38536], | 99.00th=[ 53740], 99.50th=[ 64226], 99.90th=[ 99091], 99.95th=[105382], | 99.99th=[105382] bw ( KiB/s): min= 20, max= 159, per=25.06%, avg=104.99, stdev=28.56, samples=113 iops : min= 5, max= 39, avg=25.81, stdev= 7.19, samples=113 write: IOPS=27, BW=111KiB/s (113kB/s)(6296KiB/56895msec); 0 zone resets clat (usec): min=834, max=700584, avg=16764.23, stdev=21342.59 lat (usec): min=835, max=700585, avg=16765.41, stdev=21342.62 clat percentiles (usec): | 1.00th=[ 1237], 5.00th=[ 2573], 10.00th=[ 3261], 20.00th=[ 4686], | 30.00th=[ 7635], 40.00th=[ 10814], 50.00th=[ 13566], 60.00th=[ 16909], | 70.00th=[ 21103], 80.00th=[ 26346], 90.00th=[ 33162], 95.00th=[ 39584], | 99.00th=[ 54789], 99.50th=[ 62129], 99.90th=[128451], 99.95th=[700449], | 99.99th=[700449] bw ( KiB/s): min= 40, max= 191, per=25.39%, avg=111.22, stdev=31.33, samples=112 iops : min= 10, max= 47, avg=27.37, stdev= 7.84, samples=112 lat (usec) : 50=0.03%, 100=0.33%, 250=0.72%, 750=0.03%, 1000=0.16% lat (msec) : 2=1.11%, 4=7.19%, 10=14.52%, 20=37.83%, 50=36.62% lat (msec) : 100=1.37%, 250=0.07%, 750=0.03% cpu : usr=0.11%, sys=23.33%, ctx=9604, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=191611: Thu Jul 9 21:49:54 2026 read: IOPS=26, BW=106KiB/s (108kB/s)(5940KiB/56195msec) clat (usec): min=65, max=115674, avg=19961.05, stdev=10479.74 lat (usec): min=66, max=115676, avg=19962.41, stdev=10480.63 clat percentiles (usec): | 1.00th=[ 108], 5.00th=[ 8586], 10.00th=[ 10028], 20.00th=[ 11994], | 30.00th=[ 13829], 40.00th=[ 15795], 50.00th=[ 17957], 60.00th=[ 20317], | 70.00th=[ 23200], 80.00th=[ 26870], 90.00th=[ 32113], 95.00th=[ 38536], | 99.00th=[ 51119], 99.50th=[ 64750], 99.90th=[104334], 99.95th=[115868], | 99.99th=[115868] bw ( KiB/s): min= 6, max= 191, per=25.15%, avg=105.39, stdev=28.63, samples=111 iops : min= 1, max= 47, avg=25.91, stdev= 7.19, samples=111 write: IOPS=28, BW=113KiB/s (116kB/s)(6348KiB/56195msec); 0 zone resets clat (usec): min=765, max=710752, avg=16537.71, stdev=21762.83 lat (usec): min=765, max=710754, avg=16538.90, stdev=21762.82 clat percentiles (usec): | 1.00th=[ 1045], 5.00th=[ 2540], 10.00th=[ 3064], 20.00th=[ 4146], | 30.00th=[ 6390], 40.00th=[ 10683], 50.00th=[ 13173], 60.00th=[ 16057], | 70.00th=[ 19792], 80.00th=[ 26084], 90.00th=[ 34341], 95.00th=[ 40633], | 99.00th=[ 57410], 99.50th=[ 68682], 99.90th=[ 87557], 99.95th=[708838], | 99.99th=[708838] bw ( KiB/s): min= 6, max= 182, per=25.62%, avg=112.23, stdev=30.21, samples=111 iops : min= 1, max= 45, avg=27.62, stdev= 7.60, samples=111 lat (usec) : 100=0.36%, 250=0.49%, 500=0.03%, 1000=0.42% lat (msec) : 2=1.27%, 4=8.07%, 10=13.77%, 20=39.91%, 50=33.85% lat (msec) : 100=1.73%, 250=0.07%, 750=0.03% cpu : usr=0.12%, sys=23.22%, ctx=9386, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=191612: Thu Jul 9 21:49:54 2026 read: IOPS=26, BW=105KiB/s (108kB/s)(6028KiB/57177msec) clat (usec): min=45, max=108213, avg=20208.64, stdev=11476.74 lat (usec): min=46, max=108215, avg=20209.80, stdev=11476.95 clat percentiles (usec): | 1.00th=[ 103], 5.00th=[ 7832], 10.00th=[ 9503], 20.00th=[ 11469], | 30.00th=[ 13435], 40.00th=[ 15926], 50.00th=[ 18220], 60.00th=[ 20579], | 70.00th=[ 23200], 80.00th=[ 27395], 90.00th=[ 33817], 95.00th=[ 40633], | 99.00th=[ 61080], 99.50th=[ 67634], 99.90th=[105382], 99.95th=[108528], | 99.99th=[108528] bw ( KiB/s): min= 16, max= 168, per=25.24%, avg=105.74, stdev=29.04, samples=112 iops : min= 4, max= 42, avg=26.00, stdev= 7.33, samples=112 write: IOPS=27, BW=109KiB/s (112kB/s)(6260KiB/57177msec); 0 zone resets clat (usec): min=772, max=732494, avg=16875.34, stdev=21944.54 lat (usec): min=773, max=732495, avg=16879.06, stdev=21946.97 clat percentiles (usec): | 1.00th=[ 1221], 5.00th=[ 2376], 10.00th=[ 3032], 20.00th=[ 4490], | 30.00th=[ 7701], 40.00th=[ 11600], 50.00th=[ 13960], 60.00th=[ 17171], | 70.00th=[ 21103], 80.00th=[ 25822], 90.00th=[ 33424], 95.00th=[ 40633], | 99.00th=[ 52167], 99.50th=[ 62653], 99.90th=[ 98042], 99.95th=[734004], | 99.99th=[734004] bw ( KiB/s): min= 24, max= 199, per=25.01%, avg=109.54, stdev=29.02, samples=112 iops : min= 6, max= 49, avg=26.95, stdev= 7.26, samples=112 lat (usec) : 50=0.03%, 100=0.39%, 250=0.75%, 500=0.03%, 1000=0.16% lat (msec) : 2=1.73%, 4=7.13%, 10=13.83%, 20=38.28%, 50=35.81% lat (msec) : 100=1.76%, 250=0.07%, 750=0.03% cpu : usr=0.12%, sys=22.87%, ctx=9399, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=191613: Thu Jul 9 21:49:54 2026 read: IOPS=26, BW=106KiB/s (108kB/s)(6052KiB/57303msec) clat (usec): min=37, max=95688, avg=20336.74, stdev=10893.54 lat (usec): min=37, max=95690, avg=20338.82, stdev=10893.79 clat percentiles (usec): | 1.00th=[ 103], 5.00th=[ 8225], 10.00th=[ 9896], 20.00th=[11863], | 30.00th=[13829], 40.00th=[16057], 50.00th=[18220], 60.00th=[20841], | 70.00th=[23725], 80.00th=[27395], 90.00th=[33162], 95.00th=[40109], | 99.00th=[56886], 99.50th=[69731], 99.90th=[77071], 99.95th=[95945], | 99.99th=[95945] bw ( KiB/s): min= 8, max= 182, per=25.38%, avg=106.35, stdev=25.73, samples=113 iops : min= 2, max= 45, avg=26.15, stdev= 6.42, samples=113 write: IOPS=27, BW=109KiB/s (111kB/s)(6236KiB/57303msec); 0 zone resets clat (usec): min=726, max=727830, avg=16808.08, stdev=22066.20 lat (usec): min=727, max=727832, avg=16809.30, stdev=22066.21 clat percentiles (usec): | 1.00th=[ 1254], 5.00th=[ 2638], 10.00th=[ 3163], 20.00th=[ 4490], | 30.00th=[ 7439], 40.00th=[ 11338], 50.00th=[ 13960], 60.00th=[ 16712], | 70.00th=[ 20317], 80.00th=[ 25822], 90.00th=[ 33817], 95.00th=[ 41681], | 99.00th=[ 54264], 99.50th=[ 68682], 99.90th=[130548], 99.95th=[725615], | 99.99th=[725615] bw ( KiB/s): min= 32, max= 184, per=25.01%, avg=109.55, stdev=29.00, samples=113 iops : min= 8, max= 46, avg=26.95, stdev= 7.30, samples=113 lat (usec) : 50=0.07%, 100=0.39%, 250=0.55%, 750=0.03%, 1000=0.20% lat (msec) : 2=1.11%, 4=7.45%, 10=13.54%, 20=39.52%, 50=35.29% lat (msec) : 100=1.79%, 250=0.03%, 750=0.03% cpu : usr=0.09%, sys=23.16%, ctx=9608, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=419KiB/s (429kB/s), 105KiB/s-106KiB/s (108kB/s-108kB/s), io=23.4MiB (24.6MB), run=56195-57303msec WRITE: bw=439KiB/s (449kB/s), 109KiB/s-113KiB/s (111kB/s-116kB/s), io=24.6MiB (25.7MB), run=56195-57303msec rand-rw: (groupid=0, jobs=1): err= 0: pid=191615: Thu Jul 9 21:50:09 2026 read: IOPS=21, BW=84.0KiB/s (86.0kB/s)(5992KiB/71320msec) clat (msec): min=3, max=711, avg=20.61, stdev=23.13 lat (msec): min=3, max=711, avg=20.61, stdev=23.13 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 7], 10.00th=[ 8], 20.00th=[ 9], | 30.00th=[ 11], 40.00th=[ 14], 50.00th=[ 16], 60.00th=[ 19], | 70.00th=[ 23], 80.00th=[ 30], 90.00th=[ 41], 95.00th=[ 53], | 99.00th=[ 72], 99.50th=[ 82], 99.90th=[ 114], 99.95th=[ 709], | 99.99th=[ 709] bw ( KiB/s): min= 31, max= 247, per=25.35%, avg=84.41, stdev=43.44, samples=141 iops : min= 7, max= 61, avg=20.67, stdev=10.87, samples=141 write: IOPS=22, BW=88.3KiB/s (90.4kB/s)(6296KiB/71320msec); 0 zone resets clat (msec): min=5, max=123, avg=25.56, stdev=15.24 lat (msec): min=6, max=123, avg=25.56, stdev=15.24 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 12], 20.00th=[ 14], | 30.00th=[ 16], 40.00th=[ 18], 50.00th=[ 22], 60.00th=[ 25], | 70.00th=[ 30], 80.00th=[ 36], 90.00th=[ 47], 95.00th=[ 55], | 99.00th=[ 82], 99.50th=[ 91], 99.90th=[ 108], 99.95th=[ 124], | 99.99th=[ 124] bw ( KiB/s): min= 31, max= 224, per=25.41%, avg=88.67, stdev=42.42, samples=141 iops : min= 7, max= 56, avg=21.74, stdev=10.61, samples=141 lat (msec) : 4=0.03%, 10=14.58%, 20=40.98%, 50=37.89%, 100=6.35% lat (msec) : 250=0.13%, 750=0.03% cpu : usr=0.10%, sys=11.37%, ctx=6416, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=191616: Thu Jul 9 21:50:09 2026 read: IOPS=20, BW=82.8KiB/s (84.8kB/s)(5940KiB/71696msec) clat (msec): min=3, max=721, avg=19.77, stdev=23.21 lat (msec): min=3, max=721, avg=19.78, stdev=23.21 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 6], 10.00th=[ 7], 20.00th=[ 9], | 30.00th=[ 11], 40.00th=[ 13], 50.00th=[ 15], 60.00th=[ 18], | 70.00th=[ 22], 80.00th=[ 28], 90.00th=[ 40], 95.00th=[ 50], | 99.00th=[ 71], 99.50th=[ 77], 99.90th=[ 128], 99.95th=[ 718], | 99.99th=[ 718] bw ( KiB/s): min= 16, max= 256, per=24.92%, avg=82.99, stdev=45.18, samples=141 iops : min= 4, max= 64, avg=20.32, stdev=11.34, samples=141 write: IOPS=22, BW=88.5KiB/s (90.7kB/s)(6348KiB/71696msec); 0 zone resets clat (msec): min=6, max=151, avg=26.55, stdev=16.22 lat (msec): min=6, max=151, avg=26.55, stdev=16.22 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 12], 20.00th=[ 14], | 30.00th=[ 16], 40.00th=[ 19], 50.00th=[ 22], 60.00th=[ 27], | 70.00th=[ 31], 80.00th=[ 39], 90.00th=[ 48], 95.00th=[ 57], | 99.00th=[ 88], 99.50th=[ 99], 99.90th=[ 129], 99.95th=[ 153], | 99.99th=[ 153] bw ( KiB/s): min= 23, max= 216, per=25.34%, avg=88.44, stdev=41.96, samples=141 iops : min= 5, max= 54, avg=21.68, stdev=10.50, samples=141 lat (msec) : 4=0.10%, 10=15.53%, 20=39.58%, 50=38.25%, 100=6.22% lat (msec) : 250=0.29%, 750=0.03% cpu : usr=0.09%, sys=11.16%, ctx=6374, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=191617: Thu Jul 9 21:50:09 2026 read: IOPS=21, BW=84.2KiB/s (86.3kB/s)(6028KiB/71557msec) clat (msec): min=3, max=131, avg=20.14, stdev=15.15 lat (msec): min=3, max=131, avg=20.14, stdev=15.15 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 7], 10.00th=[ 8], 20.00th=[ 10], | 30.00th=[ 12], 40.00th=[ 14], 50.00th=[ 16], 60.00th=[ 18], | 70.00th=[ 22], 80.00th=[ 30], 90.00th=[ 42], 95.00th=[ 53], | 99.00th=[ 73], 99.50th=[ 80], 99.90th=[ 120], 99.95th=[ 132], | 99.99th=[ 132] bw ( KiB/s): min= 23, max= 246, per=25.36%, avg=84.45, stdev=42.62, samples=141 iops : min= 5, max= 61, avg=20.69, stdev=10.65, samples=141 write: IOPS=21, BW=87.5KiB/s (89.6kB/s)(6260KiB/71557msec); 0 zone resets clat (msec): min=5, max=720, avg=26.20, stdev=23.49 lat (msec): min=5, max=720, avg=26.20, stdev=23.49 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 12], 20.00th=[ 14], | 30.00th=[ 16], 40.00th=[ 18], 50.00th=[ 22], 60.00th=[ 26], | 70.00th=[ 31], 80.00th=[ 37], 90.00th=[ 46], 95.00th=[ 55], | 99.00th=[ 83], 99.50th=[ 102], 99.90th=[ 148], 99.95th=[ 718], | 99.99th=[ 718] bw ( KiB/s): min= 23, max= 232, per=25.11%, avg=87.65, stdev=42.81, samples=141 iops : min= 5, max= 58, avg=21.48, stdev=10.73, samples=141 lat (msec) : 4=0.07%, 10=13.61%, 20=42.64%, 50=37.17%, 100=6.12% lat (msec) : 250=0.36%, 750=0.03% cpu : usr=0.08%, sys=11.26%, ctx=6461, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=191618: Thu Jul 9 21:50:09 2026 read: IOPS=21, BW=84.1KiB/s (86.1kB/s)(6052KiB/71935msec) clat (usec): min=3920, max=99508, avg=19649.67, stdev=13927.83 lat (usec): min=3921, max=99509, avg=19650.73, stdev=13928.06 clat percentiles (usec): | 1.00th=[ 4883], 5.00th=[ 6063], 10.00th=[ 7177], 20.00th=[ 9110], | 30.00th=[11076], 40.00th=[13042], 50.00th=[15401], 60.00th=[18220], | 70.00th=[21890], 80.00th=[27657], 90.00th=[38536], 95.00th=[48497], | 99.00th=[70779], 99.50th=[77071], 99.90th=[96994], 99.95th=[99091], | 99.99th=[99091] bw ( KiB/s): min= 15, max= 239, per=25.34%, avg=84.37, stdev=43.80, samples=142 iops : min= 3, max= 59, avg=20.66, stdev=10.96, samples=142 write: IOPS=21, BW=86.7KiB/s (88.8kB/s)(6236KiB/71936msec); 0 zone resets clat (msec): min=6, max=724, avg=26.94, stdev=24.03 lat (msec): min=6, max=724, avg=26.94, stdev=24.03 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 12], 20.00th=[ 14], | 30.00th=[ 16], 40.00th=[ 19], 50.00th=[ 22], 60.00th=[ 26], | 70.00th=[ 31], 80.00th=[ 39], 90.00th=[ 48], 95.00th=[ 58], | 99.00th=[ 92], 99.50th=[ 102], 99.90th=[ 124], 99.95th=[ 726], | 99.99th=[ 726] bw ( KiB/s): min= 32, max= 232, per=24.89%, avg=86.85, stdev=40.41, samples=142 iops : min= 8, max= 58, avg=21.28, stdev=10.10, samples=142 lat (msec) : 4=0.03%, 10=14.13%, 20=40.89%, 50=38.61%, 100=6.09% lat (msec) : 250=0.23%, 750=0.03% cpu : usr=0.10%, sys=11.21%, ctx=6438, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=334KiB/s (342kB/s), 82.8KiB/s-84.2KiB/s (84.8kB/s-86.3kB/s), io=23.4MiB (24.6MB), run=71320-71935msec WRITE: bw=349KiB/s (358kB/s), 86.7KiB/s-88.5KiB/s (88.8kB/s-90.7kB/s), io=24.6MiB (25.7MB), run=71320-71936msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=191647: Thu Jul 9 21:50:33 2026 read: IOPS=21, BW=342KiB/s (351kB/s)(5920KiB/17293msec) clat (usec): min=50, max=86510, avg=23258.43, stdev=13207.25 lat (usec): min=51, max=86511, avg=23259.33, stdev=13207.28 clat percentiles (usec): | 1.00th=[ 77], 5.00th=[ 117], 10.00th=[ 8848], 20.00th=[13698], | 30.00th=[16450], 40.00th=[18744], 50.00th=[22152], 60.00th=[24773], | 70.00th=[28705], 80.00th=[33424], 90.00th=[39060], 95.00th=[44827], | 99.00th=[65274], 99.50th=[85459], 99.90th=[86508], 99.95th=[86508], | 99.99th=[86508] bw ( KiB/s): min= 159, max= 576, per=25.34%, avg=339.85, stdev=102.18, samples=34 iops : min= 9, max= 36, avg=20.62, stdev= 6.58, samples=34 write: IOPS=23, BW=368KiB/s (377kB/s)(6368KiB/17293msec); 0 zone resets clat (usec): min=1130, max=88795, avg=21796.52, stdev=15988.20 lat (usec): min=1130, max=88797, avg=21798.29, stdev=15987.94 clat percentiles (usec): | 1.00th=[ 1811], 5.00th=[ 3425], 10.00th=[ 4621], 20.00th=[ 6980], | 30.00th=[11076], 40.00th=[15533], 50.00th=[18482], 60.00th=[22414], | 70.00th=[27395], 80.00th=[33424], 90.00th=[43779], 95.00th=[51643], | 99.00th=[74974], 99.50th=[78119], 99.90th=[88605], 99.95th=[88605], | 99.99th=[88605] bw ( KiB/s): min= 127, max= 608, per=26.01%, avg=367.00, stdev=94.16, samples=34 iops : min= 7, max= 38, avg=22.32, stdev= 5.97, samples=34 lat (usec) : 100=1.30%, 250=2.60%, 1000=0.13% lat (msec) : 2=0.52%, 4=2.86%, 10=11.98%, 20=30.34%, 50=46.22% lat (msec) : 100=4.04% cpu : usr=0.09%, sys=19.99%, ctx=2552, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=191648: Thu Jul 9 21:50:33 2026 read: IOPS=20, BW=322KiB/s (329kB/s)(5744KiB/17854msec) clat (usec): min=38, max=112263, avg=24697.01, stdev=14862.47 lat (usec): min=39, max=112263, avg=24697.94, stdev=14862.46 clat percentiles (usec): | 1.00th=[ 80], 5.00th=[ 143], 10.00th=[ 10945], 20.00th=[ 13829], | 30.00th=[ 16909], 40.00th=[ 19530], 50.00th=[ 22676], 60.00th=[ 25822], | 70.00th=[ 28967], 80.00th=[ 34341], 90.00th=[ 41157], 95.00th=[ 49546], | 99.00th=[ 83362], 99.50th=[ 90702], 99.90th=[112722], 99.95th=[112722], | 99.99th=[112722] bw ( KiB/s): min= 159, max= 512, per=23.75%, avg=318.46, stdev=98.91, samples=35 iops : min= 9, max= 32, avg=19.26, stdev= 6.26, samples=35 write: IOPS=22, BW=367KiB/s (375kB/s)(6544KiB/17854msec); 0 zone resets clat (msec): min=2, max=111, avg=21.91, stdev=16.85 lat (msec): min=2, max=111, avg=21.91, stdev=16.85 clat percentiles (msec): | 1.00th=[ 3], 5.00th=[ 4], 10.00th=[ 6], 20.00th=[ 8], | 30.00th=[ 12], 40.00th=[ 14], 50.00th=[ 18], 60.00th=[ 23], | 70.00th=[ 28], 80.00th=[ 34], 90.00th=[ 44], 95.00th=[ 54], | 99.00th=[ 79], 99.50th=[ 105], 99.90th=[ 112], 99.95th=[ 112], | 99.99th=[ 112] bw ( KiB/s): min= 127, max= 576, per=25.38%, avg=358.14, stdev=110.64, samples=35 iops : min= 7, max= 36, avg=21.77, stdev= 7.00, samples=35 lat (usec) : 50=0.13%, 100=1.17%, 250=1.30%, 500=0.13% lat (msec) : 4=3.12%, 10=11.98%, 20=30.86%, 50=45.96%, 100=4.82% lat (msec) : 250=0.52% cpu : usr=0.06%, sys=19.95%, ctx=2618, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=191649: Thu Jul 9 21:50:33 2026 read: IOPS=23, BW=370KiB/s (379kB/s)(6256KiB/16911msec) clat (usec): min=34, max=103832, avg=23197.52, stdev=12664.94 lat (usec): min=35, max=103833, avg=23198.49, stdev=12664.97 clat percentiles (usec): | 1.00th=[ 63], 5.00th=[ 167], 10.00th=[ 11600], 20.00th=[ 14222], | 30.00th=[ 16712], 40.00th=[ 19006], 50.00th=[ 21365], 60.00th=[ 24249], | 70.00th=[ 27132], 80.00th=[ 31065], 90.00th=[ 38011], 95.00th=[ 45351], | 99.00th=[ 61080], 99.50th=[ 96994], 99.90th=[104334], 99.95th=[104334], | 99.99th=[104334] bw ( KiB/s): min= 189, max= 736, per=27.55%, avg=369.42, stdev=107.86, samples=33 iops : min= 11, max= 46, avg=22.45, stdev= 6.87, samples=33 write: IOPS=22, BW=357KiB/s (365kB/s)(6032KiB/16911msec); 0 zone resets clat (usec): min=1667, max=84971, avg=20754.13, stdev=15858.19 lat (usec): min=1669, max=84972, avg=20755.81, stdev=15858.19 clat percentiles (usec): | 1.00th=[ 2040], 5.00th=[ 3752], 10.00th=[ 4621], 20.00th=[ 6521], | 30.00th=[ 9896], 40.00th=[13042], 50.00th=[16581], 60.00th=[20317], | 70.00th=[25560], 80.00th=[33162], 90.00th=[43254], 95.00th=[53216], | 99.00th=[70779], 99.50th=[80217], 99.90th=[85459], 99.95th=[85459], | 99.99th=[85459] bw ( KiB/s): min= 192, max= 476, per=24.87%, avg=350.91, stdev=67.30, samples=33 iops : min= 12, max= 29, avg=21.30, stdev= 4.25, samples=33 lat (usec) : 50=0.26%, 100=1.04%, 250=1.43% lat (msec) : 2=0.26%, 4=2.99%, 10=12.89%, 20=32.42%, 50=44.14% lat (msec) : 100=4.43%, 250=0.13% cpu : usr=0.08%, sys=20.37%, ctx=2629, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=191650: Thu Jul 9 21:50:33 2026 read: IOPS=22, BW=365KiB/s (373kB/s)(6032KiB/16543msec) clat (usec): min=38, max=77324, avg=22983.32, stdev=13280.21 lat (usec): min=39, max=77325, avg=22988.19, stdev=13279.22 clat percentiles (usec): | 1.00th=[ 68], 5.00th=[ 103], 10.00th=[ 8356], 20.00th=[13304], | 30.00th=[15795], 40.00th=[19006], 50.00th=[21627], 60.00th=[25297], | 70.00th=[28705], 80.00th=[33424], 90.00th=[39060], 95.00th=[44827], | 99.00th=[65799], 99.50th=[70779], 99.90th=[77071], 99.95th=[77071], | 99.99th=[77071] bw ( KiB/s): min= 158, max= 608, per=26.63%, avg=357.16, stdev=105.49, samples=32 iops : min= 9, max= 38, avg=21.69, stdev= 6.77, samples=32 write: IOPS=23, BW=378KiB/s (387kB/s)(6256KiB/16543msec); 0 zone resets clat (usec): min=1433, max=94791, avg=20076.03, stdev=14701.95 lat (usec): min=1435, max=94792, avg=20078.04, stdev=14702.14 clat percentiles (usec): | 1.00th=[ 2008], 5.00th=[ 3818], 10.00th=[ 4817], 20.00th=[ 7242], | 30.00th=[10159], 40.00th=[13173], 50.00th=[16581], 60.00th=[20317], | 70.00th=[25035], 80.00th=[32113], 90.00th=[38536], 95.00th=[46924], | 99.00th=[66323], 99.50th=[85459], 99.90th=[94897], 99.95th=[94897], | 99.99th=[94897] bw ( KiB/s): min= 191, max= 670, per=26.51%, avg=374.00, stdev=119.13, samples=32 iops : min= 11, max= 41, avg=22.75, stdev= 7.62, samples=32 lat (usec) : 50=0.13%, 100=2.08%, 250=2.34% lat (msec) : 2=0.39%, 4=2.73%, 10=12.37%, 20=31.25%, 50=45.05% lat (msec) : 100=3.65% cpu : usr=0.10%, sys=20.89%, ctx=2512, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1342KiB/s (1374kB/s), 322KiB/s-370KiB/s (329kB/s-379kB/s), io=23.4MiB (24.5MB), run=16543-17854msec WRITE: bw=1411KiB/s (1445kB/s), 357KiB/s-378KiB/s (365kB/s-387kB/s), io=24.6MiB (25.8MB), run=16543-17854msec rand-rw: (groupid=0, jobs=1): err= 0: pid=191642: Thu Jul 9 21:50:35 2026 read: IOPS=17, BW=287KiB/s (294kB/s)(5920KiB/20636msec) clat (msec): min=3, max=112, avg=22.32, stdev=17.83 lat (msec): min=3, max=112, avg=22.32, stdev=17.83 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 6], 10.00th=[ 7], 20.00th=[ 9], | 30.00th=[ 12], 40.00th=[ 14], 50.00th=[ 17], 60.00th=[ 20], | 70.00th=[ 26], 80.00th=[ 33], 90.00th=[ 48], 95.00th=[ 63], | 99.00th=[ 79], 99.50th=[ 95], 99.90th=[ 113], 99.95th=[ 113], | 99.99th=[ 113] bw ( KiB/s): min= 95, max= 896, per=23.78%, avg=275.40, stdev=189.71, samples=40 iops : min= 5, max= 56, avg=16.70, stdev=11.95, samples=40 write: IOPS=19, BW=309KiB/s (316kB/s)(6368KiB/20636msec); 0 zone resets clat (msec): min=6, max=170, avg=30.92, stdev=22.02 lat (msec): min=6, max=170, avg=30.92, stdev=22.02 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 13], | 30.00th=[ 17], 40.00th=[ 21], 50.00th=[ 25], 60.00th=[ 31], | 70.00th=[ 38], 80.00th=[ 46], 90.00th=[ 61], 95.00th=[ 74], | 99.00th=[ 108], 99.50th=[ 116], 99.90th=[ 171], 99.95th=[ 171], | 99.99th=[ 171] bw ( KiB/s): min= 64, max= 960, per=24.26%, avg=295.75, stdev=180.51, samples=40 iops : min= 4, max= 60, avg=17.97, stdev=11.36, samples=40 lat (msec) : 4=0.26%, 10=16.93%, 20=32.81%, 50=37.50%, 100=11.59% lat (msec) : 250=0.91% cpu : usr=0.06%, sys=9.89%, ctx=1636, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=191643: Thu Jul 9 21:50:35 2026 read: IOPS=17, BW=278KiB/s (285kB/s)(5744KiB/20672msec) clat (msec): min=3, max=111, avg=22.25, stdev=17.60 lat (msec): min=3, max=111, avg=22.25, stdev=17.60 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 6], 10.00th=[ 7], 20.00th=[ 9], | 30.00th=[ 11], 40.00th=[ 14], 50.00th=[ 17], 60.00th=[ 21], | 70.00th=[ 26], 80.00th=[ 33], 90.00th=[ 48], 95.00th=[ 58], | 99.00th=[ 81], 99.50th=[ 96], 99.90th=[ 112], 99.95th=[ 112], | 99.99th=[ 112] bw ( KiB/s): min= 96, max= 864, per=24.08%, avg=278.80, stdev=183.99, samples=41 iops : min= 6, max= 54, avg=16.93, stdev=11.60, samples=41 write: IOPS=19, BW=317KiB/s (324kB/s)(6544KiB/20672msec); 0 zone resets clat (msec): min=6, max=177, avg=30.85, stdev=21.86 lat (msec): min=6, max=177, avg=30.85, stdev=21.86 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 9], 10.00th=[ 10], 20.00th=[ 12], | 30.00th=[ 16], 40.00th=[ 20], 50.00th=[ 25], 60.00th=[ 32], | 70.00th=[ 40], 80.00th=[ 47], 90.00th=[ 62], 95.00th=[ 70], | 99.00th=[ 96], 99.50th=[ 104], 99.90th=[ 178], 99.95th=[ 178], | 99.99th=[ 178] bw ( KiB/s): min= 127, max= 1088, per=25.88%, avg=315.46, stdev=210.84, samples=41 iops : min= 7, max= 68, avg=19.22, stdev=13.27, samples=41 lat (msec) : 4=0.65%, 10=17.58%, 20=32.29%, 50=36.46%, 100=12.37% lat (msec) : 250=0.65% cpu : usr=0.08%, sys=9.73%, ctx=1648, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=191644: Thu Jul 9 21:50:35 2026 read: IOPS=19, BW=309KiB/s (317kB/s)(6256KiB/20217msec) clat (usec): min=4413, max=83699, avg=21954.59, stdev=15957.07 lat (usec): min=4413, max=83700, avg=21955.51, stdev=15957.09 clat percentiles (usec): | 1.00th=[ 4752], 5.00th=[ 6063], 10.00th=[ 6915], 20.00th=[ 9634], | 30.00th=[11600], 40.00th=[13829], 50.00th=[16319], 60.00th=[19792], | 70.00th=[25297], 80.00th=[32637], 90.00th=[47449], 95.00th=[57934], | 99.00th=[70779], 99.50th=[77071], 99.90th=[83362], 99.95th=[83362], | 99.99th=[83362] bw ( KiB/s): min= 95, max= 1280, per=26.84%, avg=310.85, stdev=211.32, samples=40 iops : min= 5, max= 80, avg=18.92, stdev=13.34, samples=40 write: IOPS=18, BW=298KiB/s (306kB/s)(6032KiB/20217msec); 0 zone resets clat (msec): min=7, max=151, avg=30.67, stdev=20.07 lat (msec): min=7, max=151, avg=30.67, stdev=20.07 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 11], 20.00th=[ 14], | 30.00th=[ 17], 40.00th=[ 22], 50.00th=[ 27], 60.00th=[ 32], | 70.00th=[ 38], 80.00th=[ 45], 90.00th=[ 59], 95.00th=[ 69], | 99.00th=[ 101], 99.50th=[ 110], 99.90th=[ 153], 99.95th=[ 153], | 99.99th=[ 153] bw ( KiB/s): min= 96, max= 768, per=24.30%, avg=296.22, stdev=168.98, samples=40 iops : min= 6, max= 48, avg=18.00, stdev=10.58, samples=40 lat (msec) : 10=14.58%, 20=34.77%, 50=38.93%, 100=11.33%, 250=0.39% cpu : usr=0.08%, sys=10.22%, ctx=1691, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=191645: Thu Jul 9 21:50:35 2026 read: IOPS=18, BW=295KiB/s (303kB/s)(6032KiB/20415msec) clat (usec): min=4132, max=82913, avg=22182.85, stdev=16627.69 lat (usec): min=4132, max=82914, avg=22183.67, stdev=16627.69 clat percentiles (usec): | 1.00th=[ 4948], 5.00th=[ 5932], 10.00th=[ 6849], 20.00th=[ 8848], | 30.00th=[10814], 40.00th=[13435], 50.00th=[16057], 60.00th=[19530], | 70.00th=[25822], 80.00th=[35390], 90.00th=[48497], 95.00th=[59507], | 99.00th=[72877], 99.50th=[82314], 99.90th=[83362], 99.95th=[83362], | 99.99th=[83362] bw ( KiB/s): min= 32, max= 896, per=24.91%, avg=288.43, stdev=184.61, samples=40 iops : min= 2, max= 56, avg=17.53, stdev=11.59, samples=40 write: IOPS=19, BW=306KiB/s (314kB/s)(6256KiB/20415msec); 0 zone resets clat (msec): min=6, max=170, avg=30.73, stdev=21.06 lat (msec): min=6, max=170, avg=30.74, stdev=21.06 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 14], | 30.00th=[ 18], 40.00th=[ 21], 50.00th=[ 26], 60.00th=[ 32], | 70.00th=[ 37], 80.00th=[ 45], 90.00th=[ 58], 95.00th=[ 70], | 99.00th=[ 110], 99.50th=[ 116], 99.90th=[ 171], 99.95th=[ 171], | 99.99th=[ 171] bw ( KiB/s): min= 95, max= 928, per=24.83%, avg=302.70, stdev=181.73, samples=40 iops : min= 5, max= 58, avg=18.40, stdev=11.45, samples=40 lat (msec) : 10=16.41%, 20=33.20%, 50=38.41%, 100=11.07%, 250=0.91% cpu : usr=0.09%, sys=9.78%, ctx=1608, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1159KiB/s (1186kB/s), 278KiB/s-309KiB/s (285kB/s-317kB/s), io=23.4MiB (24.5MB), run=20217-20672msec WRITE: bw=1219KiB/s (1248kB/s), 298KiB/s-317KiB/s (306kB/s-324kB/s), io=24.6MiB (25.8MB), run=20217-20672msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=191659: Thu Jul 9 21:50:45 2026 read: IOPS=2, BW=2307KiB/s (2362kB/s)(7168KiB/3107msec) clat (msec): min=2, max=678, avg=235.31, stdev=216.38 lat (msec): min=2, max=678, avg=235.31, stdev=216.38 clat percentiles (msec): | 1.00th=[ 3], 5.00th=[ 3], 10.00th=[ 3], 20.00th=[ 131], | 30.00th=[ 155], 40.00th=[ 155], 50.00th=[ 161], 60.00th=[ 207], | 70.00th=[ 207], 80.00th=[ 313], 90.00th=[ 676], 95.00th=[ 676], | 99.00th=[ 676], 99.50th=[ 676], 99.90th=[ 676], 99.95th=[ 676], | 99.99th=[ 676] bw ( KiB/s): min= 1838, max= 5595, per=50.76%, avg=2878.75, stdev=1813.36, samples=4 iops : min= 1, max= 5, avg= 2.00, stdev= 2.00, samples=4 write: IOPS=1, BW=1648KiB/s (1687kB/s)(5120KiB/3107msec); 0 zone resets clat (msec): min=159, max=491, avg=282.04, stdev=132.81 lat (msec): min=159, max=491, avg=282.10, stdev=132.82 clat percentiles (msec): | 1.00th=[ 159], 5.00th=[ 159], 10.00th=[ 159], 20.00th=[ 159], | 30.00th=[ 192], 40.00th=[ 192], 50.00th=[ 241], 60.00th=[ 241], | 70.00th=[ 330], 80.00th=[ 330], 90.00th=[ 493], 95.00th=[ 493], | 99.00th=[ 493], 99.50th=[ 493], 99.90th=[ 493], 99.95th=[ 493], | 99.99th=[ 493] bw ( KiB/s): min= 2039, max= 3676, per=32.57%, avg=2586.00, stdev=943.97, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (msec) : 4=8.33%, 250=58.33%, 500=25.00%, 750=8.33% cpu : usr=0.00%, sys=48.68%, ctx=668, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=191660: Thu Jul 9 21:50:45 2026 read: IOPS=0, BW=606KiB/s (620kB/s)(2048KiB/3381msec) clat (usec): min=504, max=268343, avg=134423.90, stdev=189390.27 lat (usec): min=506, max=268345, avg=134425.71, stdev=189391.03 clat percentiles (usec): | 1.00th=[ 506], 5.00th=[ 506], 10.00th=[ 506], 20.00th=[ 506], | 30.00th=[ 506], 40.00th=[ 506], 50.00th=[ 506], 60.00th=[267387], | 70.00th=[267387], 80.00th=[267387], 90.00th=[267387], 95.00th=[267387], | 99.00th=[267387], 99.50th=[267387], 99.90th=[267387], 99.95th=[267387], | 99.99th=[267387] bw ( KiB/s): min= 1838, max= 1865, per=32.65%, avg=1851.50, stdev=19.09, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=3029KiB/s (3101kB/s)(10.0MiB/3381msec); 0 zone resets clat (msec): min=193, max=536, avg=304.34, stdev=110.41 lat (msec): min=193, max=536, avg=304.41, stdev=110.42 clat percentiles (msec): | 1.00th=[ 194], 5.00th=[ 194], 10.00th=[ 194], 20.00th=[ 222], | 30.00th=[ 230], 40.00th=[ 232], 50.00th=[ 266], 60.00th=[ 275], | 70.00th=[ 292], 80.00th=[ 347], 90.00th=[ 451], 95.00th=[ 535], | 99.00th=[ 535], 99.50th=[ 535], 99.90th=[ 535], 99.95th=[ 535], | 99.99th=[ 535] bw ( KiB/s): min= 2039, max= 6119, per=45.21%, avg=3589.60, stdev=1690.67, samples=5 iops : min= 1, max= 5, avg= 2.60, stdev= 1.67, samples=5 lat (usec) : 750=8.33% lat (msec) : 250=33.33%, 500=50.00%, 750=8.33% cpu : usr=0.00%, sys=53.55%, ctx=467, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=191661: Thu Jul 9 21:50:45 2026 read: IOPS=1, BW=1701KiB/s (1742kB/s)(6144KiB/3611msec) clat (usec): min=508, max=355295, avg=196160.43, stdev=135402.66 lat (usec): min=509, max=355297, avg=196161.51, stdev=135402.94 clat percentiles (usec): | 1.00th=[ 510], 5.00th=[ 510], 10.00th=[ 510], 20.00th=[120062], | 30.00th=[120062], 40.00th=[133694], 50.00th=[133694], 60.00th=[244319], | 70.00th=[320865], 80.00th=[320865], 90.00th=[354419], 95.00th=[354419], | 99.00th=[354419], 99.50th=[354419], 99.90th=[354419], 99.95th=[354419], | 99.99th=[354419] bw ( KiB/s): min= 3676, max= 4071, per=68.30%, avg=3873.50, stdev=279.31, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1701KiB/s (1742kB/s)(6144KiB/3611msec); 0 zone resets clat (msec): min=179, max=947, avg=402.45, stdev=338.28 lat (msec): min=179, max=947, avg=402.51, stdev=338.27 clat percentiles (msec): | 1.00th=[ 180], 5.00th=[ 180], 10.00th=[ 180], 20.00th=[ 186], | 30.00th=[ 186], 40.00th=[ 192], 50.00th=[ 192], 60.00th=[ 201], | 70.00th=[ 709], 80.00th=[ 709], 90.00th=[ 944], 95.00th=[ 944], | 99.00th=[ 944], 99.50th=[ 944], 99.90th=[ 944], 99.95th=[ 944], | 99.99th=[ 944] bw ( KiB/s): min= 2035, max= 3716, per=32.70%, avg=2596.67, stdev=969.37, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (usec) : 750=8.33% lat (msec) : 250=58.33%, 500=16.67%, 750=8.33%, 1000=8.33% cpu : usr=0.06%, sys=36.57%, ctx=556, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=191662: Thu Jul 9 21:50:45 2026 read: IOPS=1, BW=1746KiB/s (1788kB/s)(5120KiB/2933msec) clat (usec): min=509, max=428969, avg=148619.57, stdev=181999.40 lat (usec): min=510, max=428971, avg=148620.90, stdev=181999.53 clat percentiles (usec): | 1.00th=[ 510], 5.00th=[ 510], 10.00th=[ 510], 20.00th=[ 510], | 30.00th=[ 906], 40.00th=[ 906], 50.00th=[ 85459], 60.00th=[ 85459], | 70.00th=[227541], 80.00th=[227541], 90.00th=[429917], 95.00th=[429917], | 99.00th=[429917], 99.50th=[429917], 99.90th=[429917], 99.95th=[429917], | 99.99th=[429917] bw ( KiB/s): min= 7353, max= 7353, per=100.00%, avg=7353.00, stdev= 0.00, samples=1 iops : min= 7, max= 7, avg= 7.00, stdev= 0.00, samples=1 write: IOPS=2, BW=2444KiB/s (2503kB/s)(7168KiB/2933msec); 0 zone resets clat (msec): min=151, max=545, avg=298.48, stdev=136.13 lat (msec): min=151, max=545, avg=298.56, stdev=136.13 clat percentiles (msec): | 1.00th=[ 153], 5.00th=[ 153], 10.00th=[ 153], 20.00th=[ 186], | 30.00th=[ 203], 40.00th=[ 203], 50.00th=[ 300], 60.00th=[ 330], | 70.00th=[ 330], 80.00th=[ 372], 90.00th=[ 550], 95.00th=[ 550], | 99.00th=[ 550], 99.50th=[ 550], 99.90th=[ 550], 99.95th=[ 550], | 99.99th=[ 550] bw ( KiB/s): min= 1865, max= 4087, per=38.00%, avg=3017.50, stdev=1232.39, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 1.15, samples=4 lat (usec) : 750=8.33%, 1000=8.33% lat (msec) : 100=8.33%, 250=33.33%, 500=33.33%, 750=8.33% cpu : usr=0.00%, sys=52.83%, ctx=327, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5672KiB/s (5808kB/s), 606KiB/s-2307KiB/s (620kB/s-2362kB/s), io=20.0MiB (20.0MB), run=2933-3611msec WRITE: bw=7940KiB/s (8131kB/s), 1648KiB/s-3029KiB/s (1687kB/s-3101kB/s), io=28.0MiB (29.4MB), run=2933-3611msec rand-rw: (groupid=0, jobs=1): err= 0: pid=191663: Thu Jul 9 21:50:45 2026 read: IOPS=1, BW=1967KiB/s (2014kB/s)(7168KiB/3644msec) clat (msec): min=49, max=752, avg=316.61, stdev=259.52 lat (msec): min=49, max=752, avg=316.62, stdev=259.52 clat percentiles (msec): | 1.00th=[ 50], 5.00th=[ 50], 10.00th=[ 50], 20.00th=[ 138], | 30.00th=[ 140], 40.00th=[ 140], 50.00th=[ 178], 60.00th=[ 430], | 70.00th=[ 430], 80.00th=[ 535], 90.00th=[ 751], 95.00th=[ 751], | 99.00th=[ 751], 99.50th=[ 751], 99.90th=[ 751], 99.95th=[ 751], | 99.99th=[ 751] bw ( KiB/s): min= 1899, max= 4055, per=44.79%, avg=2391.00, stdev=931.93, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 write: IOPS=1, BW=1405KiB/s (1439kB/s)(5120KiB/3644msec); 0 zone resets clat (msec): min=62, max=401, avg=249.82, stdev=146.08 lat (msec): min=62, max=401, avg=249.90, stdev=146.09 clat percentiles (msec): | 1.00th=[ 63], 5.00th=[ 63], 10.00th=[ 63], 20.00th=[ 63], | 30.00th=[ 148], 40.00th=[ 148], 50.00th=[ 259], 60.00th=[ 259], | 70.00th=[ 380], 80.00th=[ 380], 90.00th=[ 401], 95.00th=[ 401], | 99.00th=[ 401], 99.50th=[ 401], 99.90th=[ 401], 99.95th=[ 401], | 99.99th=[ 401] bw ( KiB/s): min= 2019, max= 6119, per=45.32%, avg=3387.00, stdev=2365.98, samples=3 iops : min= 1, max= 5, avg= 2.33, stdev= 2.31, samples=3 lat (msec) : 50=8.33%, 100=8.33%, 250=33.33%, 500=33.33%, 750=8.33% lat (msec) : 1000=8.33% cpu : usr=0.03%, sys=19.74%, ctx=137, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=191664: Thu Jul 9 21:50:45 2026 read: IOPS=0, BW=552KiB/s (565kB/s)(2048KiB/3712msec) clat (msec): min=263, max=456, avg=360.32, stdev=136.52 lat (msec): min=263, max=456, avg=360.32, stdev=136.52 clat percentiles (msec): | 1.00th=[ 264], 5.00th=[ 264], 10.00th=[ 264], 20.00th=[ 264], | 30.00th=[ 264], 40.00th=[ 264], 50.00th=[ 264], 60.00th=[ 456], | 70.00th=[ 456], 80.00th=[ 456], 90.00th=[ 456], 95.00th=[ 456], | 99.00th=[ 456], 99.50th=[ 456], 99.90th=[ 456], 99.95th=[ 456], | 99.99th=[ 456] bw ( KiB/s): min= 2023, max= 2048, per=38.13%, avg=2035.50, stdev=17.68, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 write: IOPS=2, BW=2759KiB/s (2825kB/s)(10.0MiB/3712msec); 0 zone resets clat (msec): min=63, max=563, avg=280.97, stdev=199.88 lat (msec): min=63, max=563, avg=281.06, stdev=199.90 clat percentiles (msec): | 1.00th=[ 64], 5.00th=[ 64], 10.00th=[ 64], 20.00th=[ 66], | 30.00th=[ 68], 40.00th=[ 161], 50.00th=[ 203], 60.00th=[ 249], | 70.00th=[ 464], 80.00th=[ 472], 90.00th=[ 506], 95.00th=[ 567], | 99.00th=[ 567], 99.50th=[ 567], 99.90th=[ 567], 99.95th=[ 567], | 99.99th=[ 567] bw ( KiB/s): min= 1943, max= 6119, per=54.04%, avg=4039.00, stdev=1704.88, samples=4 iops : min= 1, max= 5, avg= 3.00, stdev= 1.63, samples=4 lat (msec) : 100=25.00%, 250=25.00%, 500=33.33%, 750=16.67% cpu : usr=0.05%, sys=14.52%, ctx=161, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=191665: Thu Jul 9 21:50:45 2026 read: IOPS=1, BW=1614KiB/s (1653kB/s)(6144KiB/3806msec) clat (msec): min=26, max=220, avg=114.80, stdev=71.59 lat (msec): min=26, max=220, avg=114.80, stdev=71.59 clat percentiles (msec): | 1.00th=[ 27], 5.00th=[ 27], 10.00th=[ 27], 20.00th=[ 75], | 30.00th=[ 75], 40.00th=[ 87], 50.00th=[ 87], 60.00th=[ 102], | 70.00th=[ 180], 80.00th=[ 180], 90.00th=[ 220], 95.00th=[ 220], | 99.00th=[ 220], 99.50th=[ 220], 99.90th=[ 220], 99.95th=[ 220], | 99.99th=[ 220] bw ( KiB/s): min= 4055, max= 4079, per=76.19%, avg=4067.00, stdev=16.97, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1614KiB/s (1653kB/s)(6144KiB/3806msec); 0 zone resets clat (msec): min=128, max=889, avg=516.81, stdev=300.11 lat (msec): min=128, max=889, avg=516.88, stdev=300.12 clat percentiles (msec): | 1.00th=[ 129], 5.00th=[ 129], 10.00th=[ 129], 20.00th=[ 197], | 30.00th=[ 197], 40.00th=[ 514], 50.00th=[ 514], 60.00th=[ 667], | 70.00th=[ 701], 80.00th=[ 701], 90.00th=[ 894], 95.00th=[ 894], | 99.00th=[ 894], 99.50th=[ 894], 99.90th=[ 894], 99.95th=[ 894], | 99.99th=[ 894] bw ( KiB/s): min= 2019, max= 4079, per=34.03%, avg=2543.25, stdev=1023.91, samples=4 iops : min= 1, max= 3, avg= 1.75, stdev= 0.96, samples=4 lat (msec) : 50=8.33%, 100=16.67%, 250=41.67%, 750=25.00%, 1000=8.33% cpu : usr=0.00%, sys=15.98%, ctx=288, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=191666: Thu Jul 9 21:50:45 2026 read: IOPS=1, BW=1335KiB/s (1367kB/s)(5120KiB/3836msec) clat (msec): min=24, max=531, avg=181.05, stdev=204.68 lat (msec): min=24, max=531, avg=181.06, stdev=204.68 clat percentiles (msec): | 1.00th=[ 25], 5.00th=[ 25], 10.00th=[ 25], 20.00th=[ 25], | 30.00th=[ 66], 40.00th=[ 66], 50.00th=[ 97], 60.00th=[ 97], | 70.00th=[ 188], 80.00th=[ 188], 90.00th=[ 531], 95.00th=[ 531], | 99.00th=[ 531], 99.50th=[ 531], 99.90th=[ 531], 99.95th=[ 531], | 99.99th=[ 531] bw ( KiB/s): min= 2023, max= 6119, per=76.26%, avg=4071.00, stdev=2896.31, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 write: IOPS=1, BW=1869KiB/s (1913kB/s)(7168KiB/3836msec); 0 zone resets clat (msec): min=44, max=1367, avg=393.14, stdev=470.84 lat (msec): min=44, max=1367, avg=393.24, stdev=470.81 clat percentiles (msec): | 1.00th=[ 45], 5.00th=[ 45], 10.00th=[ 45], 20.00th=[ 55], | 30.00th=[ 144], 40.00th=[ 144], 50.00th=[ 163], 60.00th=[ 422], | 70.00th=[ 422], 80.00th=[ 558], 90.00th=[ 1368], 95.00th=[ 1368], | 99.00th=[ 1368], 99.50th=[ 1368], 99.90th=[ 1368], 99.95th=[ 1368], | 99.99th=[ 1368] bw ( KiB/s): min= 2023, max= 4055, per=36.24%, avg=2708.67, stdev=1166.03, samples=3 iops : min= 1, max= 3, avg= 2.00, stdev= 1.00, samples=3 lat (msec) : 50=16.67%, 100=25.00%, 250=25.00%, 500=8.33%, 750=16.67% lat (msec) : 2000=8.33% cpu : usr=0.03%, sys=17.89%, ctx=183, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5339KiB/s (5467kB/s), 552KiB/s-1967KiB/s (565kB/s-2014kB/s), io=20.0MiB (20.0MB), run=3644-3836msec WRITE: bw=7474KiB/s (7654kB/s), 1405KiB/s-2759KiB/s (1439kB/s-2825kB/s), io=28.0MiB (29.4MB), run=3644-3836msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=191672: Thu Jul 9 21:50:53 2026 read: IOPS=2, BW=9002KiB/s (9218kB/s)(12.0MiB/1365msec) clat (msec): min=390, max=467, avg=433.61, stdev=39.50 lat (msec): min=390, max=467, avg=433.61, stdev=39.50 clat percentiles (msec): | 1.00th=[ 393], 5.00th=[ 393], 10.00th=[ 393], 20.00th=[ 393], | 30.00th=[ 393], 40.00th=[ 443], 50.00th=[ 443], 60.00th=[ 443], | 70.00th=[ 468], 80.00th=[ 468], 90.00th=[ 468], 95.00th=[ 468], | 99.00th=[ 468], 99.50th=[ 468], 99.90th=[ 468], 99.95th=[ 468], | 99.99th=[ 468] bw ( KiB/s): min= 7684, max= 8192, per=96.57%, avg=7938.00, stdev=359.21, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 500=100.00% cpu : usr=0.00%, sys=48.09%, ctx=1759, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=191673: Thu Jul 9 21:50:53 2026 read: IOPS=0, BW=2055KiB/s (2105kB/s)(4096KiB/1993msec) clat (nsec): min=398865k, max=398865k, avg=398865363.00, stdev= 0.00 lat (nsec): min=398868k, max=398868k, avg=398867733.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 401], 5.00th=[ 401], 10.00th=[ 401], 20.00th=[ 401], | 30.00th=[ 401], 40.00th=[ 401], 50.00th=[ 401], 60.00th=[ 401], | 70.00th=[ 401], 80.00th=[ 401], 90.00th=[ 401], 95.00th=[ 401], | 99.00th=[ 401], 99.50th=[ 401], 99.90th=[ 401], 99.95th=[ 401], | 99.99th=[ 401] bw ( KiB/s): min= 7501, max= 7501, per=91.25%, avg=7501.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=1, BW=4110KiB/s (4209kB/s)(8192KiB/1993msec); 0 zone resets clat (msec): min=704, max=821, avg=763.42, stdev=82.83 lat (msec): min=705, max=822, avg=763.72, stdev=82.83 clat percentiles (msec): | 1.00th=[ 709], 5.00th=[ 709], 10.00th=[ 709], 20.00th=[ 709], | 30.00th=[ 709], 40.00th=[ 709], 50.00th=[ 709], 60.00th=[ 818], | 70.00th=[ 818], 80.00th=[ 818], 90.00th=[ 818], 95.00th=[ 818], | 99.00th=[ 818], 99.50th=[ 818], 99.90th=[ 818], 99.95th=[ 818], | 99.99th=[ 818] bw ( KiB/s): min= 8143, max= 8143, per=54.85%, avg=8143.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 750=33.33%, 1000=33.33% cpu : usr=0.00%, sys=16.11%, ctx=439, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=191674: Thu Jul 9 21:50:53 2026 write: IOPS=1, BW=5568KiB/s (5701kB/s)(12.0MiB/2207msec); 0 zone resets clat (msec): min=107, max=1629, avg=712.99, stdev=807.12 lat (msec): min=107, max=1629, avg=713.29, stdev=807.14 clat percentiles (msec): | 1.00th=[ 108], 5.00th=[ 108], 10.00th=[ 108], 20.00th=[ 108], | 30.00th=[ 108], 40.00th=[ 401], 50.00th=[ 401], 60.00th=[ 401], | 70.00th=[ 1636], 80.00th=[ 1636], 90.00th=[ 1636], 95.00th=[ 1636], | 99.00th=[ 1636], 99.50th=[ 1636], 99.90th=[ 1636], 99.95th=[ 1636], | 99.99th=[ 1636] bw ( KiB/s): min= 8192, max= 8192, per=55.18%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 500=33.33%, 2000=33.33% cpu : usr=0.05%, sys=12.56%, ctx=58, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=191675: Thu Jul 9 21:50:53 2026 write: IOPS=1, BW=6752KiB/s (6914kB/s)(12.0MiB/1820msec); 0 zone resets clat (msec): min=314, max=1024, avg=588.15, stdev=382.08 lat (msec): min=314, max=1024, avg=588.51, stdev=382.02 clat percentiles (msec): | 1.00th=[ 313], 5.00th=[ 313], 10.00th=[ 313], 20.00th=[ 313], | 30.00th=[ 313], 40.00th=[ 426], 50.00th=[ 426], 60.00th=[ 426], | 70.00th=[ 1028], 80.00th=[ 1028], 90.00th=[ 1028], 95.00th=[ 1028], | 99.00th=[ 1028], 99.50th=[ 1028], 99.90th=[ 1028], 99.95th=[ 1028], | 99.99th=[ 1028] bw ( KiB/s): min= 7670, max= 8192, per=53.42%, avg=7931.00, stdev=369.11, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 500=66.67%, 2000=33.33% cpu : usr=0.11%, sys=14.46%, ctx=68, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=8221KiB/s (8418kB/s), 2055KiB/s-9002KiB/s (2105kB/s-9218kB/s), io=16.0MiB (16.8MB), run=1365-1993msec WRITE: bw=14.5MiB/s (15.2MB/s), 4110KiB/s-6752KiB/s (4209kB/s-6914kB/s), io=32.0MiB (33.6MB), run=1820-2207msec rand-rw: (groupid=0, jobs=1): err= 0: pid=191677: Thu Jul 9 21:50:53 2026 read: IOPS=2, BW=8937KiB/s (9151kB/s)(12.0MiB/1375msec) clat (msec): min=286, max=708, avg=449.51, stdev=226.47 lat (msec): min=286, max=708, avg=449.52, stdev=226.47 clat percentiles (msec): | 1.00th=[ 288], 5.00th=[ 288], 10.00th=[ 288], 20.00th=[ 288], | 30.00th=[ 288], 40.00th=[ 355], 50.00th=[ 355], 60.00th=[ 355], | 70.00th=[ 709], 80.00th=[ 709], 90.00th=[ 709], 95.00th=[ 709], | 99.00th=[ 709], 99.50th=[ 709], 99.90th=[ 709], 99.95th=[ 709], | 99.99th=[ 709] bw ( KiB/s): min= 7585, max= 7585, per=93.67%, avg=7585.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=66.67%, 750=33.33% cpu : usr=0.00%, sys=18.85%, ctx=64, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=191678: Thu Jul 9 21:50:53 2026 read: IOPS=0, BW=2025KiB/s (2073kB/s)(4096KiB/2023msec) clat (nsec): min=1257.7M, max=1257.7M, avg=1257705545.00, stdev= 0.00 lat (nsec): min=1257.7M, max=1257.7M, avg=1257707625.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1250], 5.00th=[ 1250], 10.00th=[ 1250], 20.00th=[ 1250], | 30.00th=[ 1250], 40.00th=[ 1250], 50.00th=[ 1250], 60.00th=[ 1250], | 70.00th=[ 1250], 80.00th=[ 1250], 90.00th=[ 1250], 95.00th=[ 1250], | 99.00th=[ 1250], 99.50th=[ 1250], 99.90th=[ 1250], 99.95th=[ 1250], | 99.99th=[ 1250] bw ( KiB/s): min= 8192, max= 8192, per=100.00%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 write: IOPS=0, BW=4049KiB/s (4147kB/s)(8192KiB/2023msec); 0 zone resets clat (msec): min=320, max=416, avg=368.36, stdev=68.14 lat (msec): min=320, max=416, avg=368.70, stdev=68.07 clat percentiles (msec): | 1.00th=[ 321], 5.00th=[ 321], 10.00th=[ 321], 20.00th=[ 321], | 30.00th=[ 321], 40.00th=[ 321], 50.00th=[ 321], 60.00th=[ 418], | 70.00th=[ 418], 80.00th=[ 418], 90.00th=[ 418], 95.00th=[ 418], | 99.00th=[ 418], 99.50th=[ 418], 99.90th=[ 418], 99.95th=[ 418], | 99.99th=[ 418] bw ( KiB/s): min= 8015, max= 8015, per=49.48%, avg=8015.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=66.67%, 2000=33.33% cpu : usr=0.00%, sys=10.04%, ctx=45, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=191679: Thu Jul 9 21:50:53 2026 write: IOPS=1, BW=6657KiB/s (6816kB/s)(12.0MiB/1846msec); 0 zone resets clat (msec): min=208, max=905, avg=608.33, stdev=360.05 lat (msec): min=208, max=906, avg=608.63, stdev=360.05 clat percentiles (msec): | 1.00th=[ 209], 5.00th=[ 209], 10.00th=[ 209], 20.00th=[ 209], | 30.00th=[ 209], 40.00th=[ 709], 50.00th=[ 709], 60.00th=[ 709], | 70.00th=[ 902], 80.00th=[ 902], 90.00th=[ 902], 95.00th=[ 902], | 99.00th=[ 902], 99.50th=[ 902], 99.90th=[ 902], 99.95th=[ 902], | 99.99th=[ 902] bw ( KiB/s): min= 8192, max= 8192, per=50.58%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 750=33.33%, 1000=33.33% cpu : usr=0.05%, sys=15.01%, ctx=50, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=191680: Thu Jul 9 21:50:53 2026 write: IOPS=1, BW=6614KiB/s (6772kB/s)(12.0MiB/1858msec); 0 zone resets clat (msec): min=471, max=713, avg=608.86, stdev=124.60 lat (msec): min=471, max=714, avg=609.14, stdev=124.69 clat percentiles (msec): | 1.00th=[ 472], 5.00th=[ 472], 10.00th=[ 472], 20.00th=[ 472], | 30.00th=[ 472], 40.00th=[ 642], 50.00th=[ 642], 60.00th=[ 642], | 70.00th=[ 718], 80.00th=[ 718], 90.00th=[ 718], 95.00th=[ 718], | 99.00th=[ 718], 99.50th=[ 718], 99.90th=[ 718], 99.95th=[ 718], | 99.99th=[ 718] bw ( KiB/s): min= 8192, max= 8192, per=50.58%, avg=8192.00, stdev= 0.00, samples=2 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 750=66.67% cpu : usr=0.00%, sys=15.67%, ctx=68, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=8099KiB/s (8293kB/s), 2025KiB/s-8937KiB/s (2073kB/s-9151kB/s), io=16.0MiB (16.8MB), run=1375-2023msec WRITE: bw=15.8MiB/s (16.6MB/s), 4049KiB/s-6657KiB/s (4147kB/s-6816kB/s), io=32.0MiB (33.6MB), run=1846-2023msec