== sanity test 398b: DIO and buffer IO race ============== 02:49:17 (1789368557) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 4.20255 s, 12.0 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=150980: Mon Sep 14 02:50:24 2026 read: IOPS=26, BW=108KiB/s (110kB/s)(5992KiB/55642msec) clat (usec): min=24, max=1183.7k, avg=19501.43, stdev=32427.86 lat (usec): min=24, max=1183.7k, avg=19502.19, stdev=32427.89 clat percentiles (usec): | 1.00th=[ 73], 5.00th=[ 215], 10.00th=[ 6915], | 20.00th=[ 9241], 30.00th=[ 11600], 40.00th=[ 14222], | 50.00th=[ 16909], 60.00th=[ 19792], 70.00th=[ 23200], | 80.00th=[ 27132], 90.00th=[ 33162], 95.00th=[ 39060], | 99.00th=[ 61604], 99.50th=[ 76022], 99.90th=[ 129500], | 99.95th=[1182794], 99.99th=[1182794] bw ( KiB/s): min= 7, max= 223, per=25.03%, avg=107.37, stdev=42.68, samples=109 iops : min= 1, max= 55, avg=26.42, stdev=10.76, samples=109 write: IOPS=28, BW=113KiB/s (116kB/s)(6296KiB/55642msec); 0 zone resets clat (usec): min=639, max=92478, avg=16567.70, stdev=13895.72 lat (usec): min=639, max=92479, avg=16568.50, stdev=13895.80 clat percentiles (usec): | 1.00th=[ 865], 5.00th=[ 2073], 10.00th=[ 2802], 20.00th=[ 4228], | 30.00th=[ 6390], 40.00th=[10159], 50.00th=[13435], 60.00th=[16909], | 70.00th=[21103], 80.00th=[26346], 90.00th=[35390], 95.00th=[43254], | 99.00th=[63701], 99.50th=[77071], 99.90th=[90702], 99.95th=[92799], | 99.99th=[92799] bw ( KiB/s): min= 8, max= 280, per=25.25%, avg=113.39, stdev=41.26, samples=108 iops : min= 2, max= 70, avg=27.94, stdev=10.41, samples=108 lat (usec) : 50=0.26%, 100=0.42%, 250=2.08%, 500=0.10%, 750=0.26% lat (usec) : 1000=0.46% lat (msec) : 2=1.63%, 4=7.36%, 10=18.98%, 20=32.36%, 50=34.18% lat (msec) : 100=1.82%, 250=0.07%, 2000=0.03% cpu : usr=0.09%, sys=28.24%, ctx=8951, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=150981: Mon Sep 14 02:50:24 2026 read: IOPS=26, BW=106KiB/s (109kB/s)(5940KiB/55917msec) clat (usec): min=23, max=131346, avg=18688.03, stdev=11887.38 lat (usec): min=23, max=131346, avg=18688.73, stdev=11887.42 clat percentiles (usec): | 1.00th=[ 78], 5.00th=[ 4293], 10.00th=[ 7177], 20.00th=[ 9503], | 30.00th=[ 11600], 40.00th=[ 14222], 50.00th=[ 16909], 60.00th=[ 19268], | 70.00th=[ 22414], 80.00th=[ 26346], 90.00th=[ 32900], 95.00th=[ 38536], | 99.00th=[ 57410], 99.50th=[ 68682], 99.90th=[108528], 99.95th=[131597], | 99.99th=[131597] bw ( KiB/s): min= 7, max= 191, per=25.03%, avg=107.37, stdev=36.93, samples=109 iops : min= 1, max= 47, avg=26.42, stdev= 9.32, samples=109 write: IOPS=28, BW=114KiB/s (116kB/s)(6348KiB/55917msec); 0 zone resets clat (usec): min=662, max=1171.5k, avg=17526.09, stdev=32120.45 lat (usec): min=662, max=1171.5k, avg=17526.97, stdev=32120.48 clat percentiles (usec): | 1.00th=[ 922], 5.00th=[ 2245], 10.00th=[ 3130], | 20.00th=[ 4883], 30.00th=[ 7242], 40.00th=[ 10290], | 50.00th=[ 13435], 60.00th=[ 16909], 70.00th=[ 21103], | 80.00th=[ 26870], 90.00th=[ 35390], 95.00th=[ 43254], | 99.00th=[ 60556], 99.50th=[ 79168], 99.90th=[ 115868], | 99.95th=[1166017], 99.99th=[1166017] bw ( KiB/s): min= 40, max= 288, per=25.43%, avg=114.17, stdev=39.97, samples=109 iops : min= 10, max= 72, avg=28.14, stdev=10.07, samples=109 lat (usec) : 50=0.23%, 100=0.49%, 250=1.20%, 500=0.20%, 750=0.20% lat (usec) : 1000=0.55% lat (msec) : 2=1.27%, 4=6.54%, 10=20.18%, 20=33.89%, 50=33.14% lat (msec) : 100=1.95%, 250=0.13%, 2000=0.03% cpu : usr=0.09%, sys=28.64%, ctx=9122, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=150983: Mon Sep 14 02:50:24 2026 read: IOPS=26, BW=108KiB/s (111kB/s)(6028KiB/55834msec) clat (usec): min=27, max=119687, avg=18829.70, stdev=12146.55 lat (usec): min=28, max=119688, avg=18830.49, stdev=12146.61 clat percentiles (usec): | 1.00th=[ 99], 5.00th=[ 277], 10.00th=[ 7308], 20.00th=[ 9503], | 30.00th=[ 11731], 40.00th=[ 14091], 50.00th=[ 16712], 60.00th=[ 19530], | 70.00th=[ 23200], 80.00th=[ 27395], 90.00th=[ 33817], 95.00th=[ 39584], | 99.00th=[ 55837], 99.50th=[ 66847], 99.90th=[119014], 99.95th=[120062], | 99.99th=[120062] bw ( KiB/s): min= 47, max= 248, per=25.77%, avg=110.57, stdev=37.60, samples=108 iops : min= 11, max= 62, avg=27.23, stdev= 9.49, samples=108 write: IOPS=28, BW=112KiB/s (115kB/s)(6260KiB/55834msec); 0 zone resets clat (usec): min=619, max=1210.5k, avg=17314.70, stdev=33036.58 lat (usec): min=620, max=1210.5k, avg=17315.63, stdev=33036.59 clat percentiles (usec): | 1.00th=[ 848], 5.00th=[ 2343], 10.00th=[ 2999], | 20.00th=[ 4686], 30.00th=[ 7111], 40.00th=[ 10290], | 50.00th=[ 13566], 60.00th=[ 17171], 70.00th=[ 21365], | 80.00th=[ 26608], 90.00th=[ 34341], 95.00th=[ 41157], | 99.00th=[ 56886], 99.50th=[ 69731], 99.90th=[ 124257], | 99.95th=[1216349], 99.99th=[1216349] bw ( KiB/s): min= 16, max= 256, per=25.29%, avg=113.54, stdev=41.22, samples=109 iops : min= 4, max= 64, avg=27.97, stdev=10.36, samples=109 lat (usec) : 50=0.13%, 100=0.39%, 250=1.89%, 500=0.26%, 750=0.20% lat (usec) : 1000=0.46% lat (msec) : 2=1.01%, 4=6.90%, 10=20.31%, 20=33.20%, 50=33.27% lat (msec) : 100=1.79%, 250=0.16%, 2000=0.03% cpu : usr=0.09%, sys=28.45%, ctx=9103, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=150985: Mon Sep 14 02:50:24 2026 read: IOPS=27, BW=109KiB/s (112kB/s)(6052KiB/55576msec) clat (usec): min=23, max=131415, avg=18586.91, stdev=12080.22 lat (usec): min=23, max=131416, avg=18587.62, stdev=12080.25 clat percentiles (usec): | 1.00th=[ 88], 5.00th=[ 4883], 10.00th=[ 7046], 20.00th=[ 9372], | 30.00th=[ 11338], 40.00th=[ 13698], 50.00th=[ 16188], 60.00th=[ 19268], | 70.00th=[ 22414], 80.00th=[ 26608], 90.00th=[ 33162], 95.00th=[ 39584], | 99.00th=[ 58459], 99.50th=[ 72877], 99.90th=[ 96994], 99.95th=[131597], | 99.99th=[131597] bw ( KiB/s): min= 55, max= 224, per=25.86%, avg=110.95, stdev=39.73, samples=107 iops : min= 13, max= 56, avg=27.32, stdev=10.06, samples=107 write: IOPS=28, BW=112KiB/s (115kB/s)(6236KiB/55576msec); 0 zone resets clat (usec): min=592, max=1208.0k, avg=17381.48, stdev=33340.15 lat (usec): min=592, max=1208.0k, avg=17384.35, stdev=33341.06 clat percentiles (usec): | 1.00th=[ 832], 5.00th=[ 2147], 10.00th=[ 2835], | 20.00th=[ 4146], 30.00th=[ 6521], 40.00th=[ 10028], | 50.00th=[ 13566], 60.00th=[ 17171], 70.00th=[ 21103], | 80.00th=[ 27132], 90.00th=[ 34866], 95.00th=[ 42206], | 99.00th=[ 60031], 99.50th=[ 81265], 99.90th=[ 137364], | 99.95th=[1216349], 99.99th=[1216349] bw ( KiB/s): min= 8, max= 222, per=25.29%, avg=113.55, stdev=42.07, samples=108 iops : min= 2, max= 55, avg=27.97, stdev=10.61, samples=108 lat (usec) : 50=0.26%, 100=0.65%, 250=1.11%, 500=0.07%, 750=0.33% lat (usec) : 1000=0.55% lat (msec) : 2=1.30%, 4=7.85%, 10=19.30%, 20=33.76%, 50=32.52% lat (msec) : 100=2.18%, 250=0.10%, 2000=0.03% cpu : usr=0.10%, sys=27.91%, ctx=8860, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=429KiB/s (440kB/s), 106KiB/s-109KiB/s (109kB/s-112kB/s), io=23.4MiB (24.6MB), run=55576-55917msec WRITE: bw=450KiB/s (460kB/s), 112KiB/s-114KiB/s (115kB/s-116kB/s), io=24.6MiB (25.7MB), run=55576-55917msec rand-rw: (groupid=0, jobs=1): err= 0: pid=150982: Mon Sep 14 02:50:48 2026 read: IOPS=18, BW=74.0KiB/s (76.8kB/s)(5992KiB/79938msec) clat (msec): min=2, max=1184, avg=15.91, stdev=34.30 lat (msec): min=2, max=1184, avg=15.92, stdev=34.30 clat percentiles (msec): | 1.00th=[ 3], 5.00th=[ 4], 10.00th=[ 4], 20.00th=[ 5], | 30.00th=[ 5], 40.00th=[ 6], 50.00th=[ 8], 60.00th=[ 13], | 70.00th=[ 18], 80.00th=[ 24], 90.00th=[ 38], 95.00th=[ 51], | 99.00th=[ 78], 99.50th=[ 83], 99.90th=[ 102], 99.95th=[ 1183], | 99.99th=[ 1183] bw ( KiB/s): min= 8, max= 224, per=25.30%, avg=75.90, stdev=46.64, samples=156 iops : min= 2, max= 56, avg=18.71, stdev=11.82, samples=156 write: IOPS=19, BW=78.8KiB/s (80.7kB/s)(6296KiB/79938msec); 0 zone resets clat (msec): min=11, max=168, avg=35.42, stdev=19.13 lat (msec): min=11, max=168, avg=35.42, stdev=19.13 clat percentiles (msec): | 1.00th=[ 14], 5.00th=[ 17], 10.00th=[ 19], 20.00th=[ 21], | 30.00th=[ 24], 40.00th=[ 27], 50.00th=[ 30], 60.00th=[ 35], | 70.00th=[ 40], 80.00th=[ 48], 90.00th=[ 61], 95.00th=[ 72], | 99.00th=[ 102], 99.50th=[ 127], 99.90th=[ 153], 99.95th=[ 169], | 99.99th=[ 169] bw ( KiB/s): min= 23, max= 200, per=25.39%, avg=79.74, stdev=43.08, samples=156 iops : min= 5, max= 50, avg=19.66, stdev=10.95, samples=156 lat (msec) : 4=8.72%, 10=18.85%, 20=17.74%, 50=43.16%, 100=10.90% lat (msec) : 250=0.59%, 2000=0.03% cpu : usr=0.07%, sys=8.69%, ctx=5872, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=150984: Mon Sep 14 02:50:48 2026 read: IOPS=18, BW=74.4KiB/s (76.2kB/s)(5940KiB/79796msec) clat (msec): min=2, max=1184, avg=15.70, stdev=34.52 lat (msec): min=2, max=1184, avg=15.70, stdev=34.52 clat percentiles (msec): | 1.00th=[ 3], 5.00th=[ 4], 10.00th=[ 4], 20.00th=[ 5], | 30.00th=[ 5], 40.00th=[ 6], 50.00th=[ 8], 60.00th=[ 12], | 70.00th=[ 17], 80.00th=[ 22], 90.00th=[ 35], 95.00th=[ 50], | 99.00th=[ 84], 99.50th=[ 95], 99.90th=[ 142], 99.95th=[ 1183], | 99.99th=[ 1183] bw ( KiB/s): min= 8, max= 208, per=25.21%, avg=75.63, stdev=44.90, samples=156 iops : min= 2, max= 52, avg=18.63, stdev=11.37, samples=156 write: IOPS=19, BW=79.6KiB/s (81.5kB/s)(6348KiB/79796msec); 0 zone resets clat (msec): min=12, max=166, avg=35.37, stdev=18.35 lat (msec): min=12, max=166, avg=35.37, stdev=18.35 clat percentiles (msec): | 1.00th=[ 15], 5.00th=[ 17], 10.00th=[ 19], 20.00th=[ 22], | 30.00th=[ 24], 40.00th=[ 27], 50.00th=[ 30], 60.00th=[ 35], | 70.00th=[ 40], 80.00th=[ 48], 90.00th=[ 60], 95.00th=[ 70], | 99.00th=[ 101], 99.50th=[ 129], 99.90th=[ 153], 99.95th=[ 167], | 99.99th=[ 167] bw ( KiB/s): min= 8, max= 192, per=25.59%, avg=80.34, stdev=42.71, samples=157 iops : min= 2, max= 48, avg=19.82, stdev=10.85, samples=157 lat (msec) : 4=7.68%, 10=19.17%, 20=17.51%, 50=44.43%, 100=10.51% lat (msec) : 250=0.65%, 2000=0.03% cpu : usr=0.08%, sys=8.75%, ctx=5797, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=150986: Mon Sep 14 02:50:48 2026 read: IOPS=18, BW=75.6KiB/s (77.4kB/s)(6028KiB/79787msec) clat (msec): min=2, max=156, avg=15.19, stdev=15.98 lat (msec): min=2, max=156, avg=15.19, stdev=15.98 clat percentiles (msec): | 1.00th=[ 3], 5.00th=[ 4], 10.00th=[ 4], 20.00th=[ 5], | 30.00th=[ 6], 40.00th=[ 7], 50.00th=[ 9], 60.00th=[ 14], | 70.00th=[ 18], 80.00th=[ 25], 90.00th=[ 35], 95.00th=[ 47], | 99.00th=[ 73], 99.50th=[ 94], 99.90th=[ 140], 99.95th=[ 157], | 99.99th=[ 157] bw ( KiB/s): min= 15, max= 224, per=25.64%, avg=76.92, stdev=44.47, samples=156 iops : min= 3, max= 56, avg=18.96, stdev=11.28, samples=156 write: IOPS=19, BW=78.5KiB/s (80.3kB/s)(6260KiB/79787msec); 0 zone resets clat (msec): min=12, max=1186, avg=36.14, stdev=34.51 lat (msec): min=12, max=1186, avg=36.14, stdev=34.51 clat percentiles (msec): | 1.00th=[ 15], 5.00th=[ 17], 10.00th=[ 19], 20.00th=[ 22], | 30.00th=[ 25], 40.00th=[ 27], 50.00th=[ 31], 60.00th=[ 34], | 70.00th=[ 39], 80.00th=[ 46], 90.00th=[ 61], 95.00th=[ 72], | 99.00th=[ 106], 99.50th=[ 130], 99.90th=[ 194], 99.95th=[ 1183], | 99.99th=[ 1183] bw ( KiB/s): min= 15, max= 184, per=25.25%, avg=79.28, stdev=41.65, samples=157 iops : min= 3, max= 46, avg=19.55, stdev=10.59, samples=157 lat (msec) : 4=7.71%, 10=18.75%, 20=17.02%, 50=46.00%, 100=9.83% lat (msec) : 250=0.65%, 2000=0.03% cpu : usr=0.06%, sys=8.75%, ctx=5796, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=150987: Mon Sep 14 02:50:48 2026 read: IOPS=19, BW=76.4KiB/s (78.2kB/s)(6052KiB/79242msec) clat (msec): min=2, max=157, avg=14.82, stdev=16.29 lat (msec): min=2, max=157, avg=14.82, stdev=16.29 clat percentiles (msec): | 1.00th=[ 3], 5.00th=[ 4], 10.00th=[ 4], 20.00th=[ 5], | 30.00th=[ 5], 40.00th=[ 6], 50.00th=[ 8], 60.00th=[ 12], | 70.00th=[ 17], 80.00th=[ 24], 90.00th=[ 35], 95.00th=[ 47], | 99.00th=[ 77], 99.50th=[ 90], 99.90th=[ 142], 99.95th=[ 159], | 99.99th=[ 159] bw ( KiB/s): min= 15, max= 248, per=26.07%, avg=78.22, stdev=47.00, samples=154 iops : min= 3, max= 62, avg=19.28, stdev=11.91, samples=154 write: IOPS=19, BW=78.7KiB/s (80.6kB/s)(6236KiB/79242msec); 0 zone resets clat (msec): min=12, max=1187, avg=36.23, stdev=34.44 lat (msec): min=12, max=1187, avg=36.23, stdev=34.44 clat percentiles (msec): | 1.00th=[ 15], 5.00th=[ 17], 10.00th=[ 19], 20.00th=[ 22], | 30.00th=[ 25], 40.00th=[ 28], 50.00th=[ 31], 60.00th=[ 35], | 70.00th=[ 40], 80.00th=[ 47], 90.00th=[ 60], 95.00th=[ 70], | 99.00th=[ 103], 99.50th=[ 129], 99.90th=[ 153], 99.95th=[ 1183], | 99.99th=[ 1183] bw ( KiB/s): min= 8, max= 192, per=25.33%, avg=79.53, stdev=41.47, samples=156 iops : min= 2, max= 48, avg=19.61, stdev=10.54, samples=156 lat (msec) : 4=8.50%, 10=18.85%, 20=17.19%, 50=44.99%, 100=9.77% lat (msec) : 250=0.68%, 2000=0.03% cpu : usr=0.08%, sys=8.74%, ctx=5858, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=300KiB/s (308kB/s), 74.4KiB/s-76.4KiB/s (76.2kB/s-78.2kB/s), io=23.4MiB (24.6MB), run=79242-79938msec WRITE: bw=314KiB/s (322kB/s), 78.5KiB/s-79.6KiB/s (80.3kB/s-81.5kB/s), io=24.6MiB (25.7MB), run=79242-79938msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=151018: Mon Sep 14 02:51:10 2026 read: IOPS=24, BW=391KiB/s (401kB/s)(5920KiB/15132msec) clat (usec): min=26, max=96607, avg=21000.35, stdev=13852.68 lat (usec): min=26, max=96608, avg=21001.21, stdev=13852.74 clat percentiles (usec): | 1.00th=[ 45], 5.00th=[ 122], 10.00th=[ 247], 20.00th=[11207], | 30.00th=[13960], 40.00th=[17171], 50.00th=[19006], 60.00th=[21627], | 70.00th=[25822], 80.00th=[30016], 90.00th=[37487], 95.00th=[45876], | 99.00th=[66323], 99.50th=[72877], 99.90th=[96994], 99.95th=[96994], | 99.99th=[96994] bw ( KiB/s): min= 223, max= 640, per=25.03%, avg=384.45, stdev=122.35, samples=29 iops : min= 13, max= 40, avg=23.34, stdev= 7.71, samples=29 write: IOPS=26, BW=421KiB/s (431kB/s)(6368KiB/15132msec); 0 zone resets clat (usec): min=1038, max=93055, avg=18366.38, stdev=13188.33 lat (usec): min=1039, max=93057, avg=18367.97, stdev=13188.04 clat percentiles (usec): | 1.00th=[ 1090], 5.00th=[ 3392], 10.00th=[ 4555], 20.00th=[ 6325], | 30.00th=[ 8291], 40.00th=[12518], 50.00th=[15926], 60.00th=[19006], | 70.00th=[23462], 80.00th=[28967], 90.00th=[36963], 95.00th=[41157], | 99.00th=[56886], 99.50th=[57934], 99.90th=[92799], 99.95th=[92799], | 99.99th=[92799] bw ( KiB/s): min= 95, max= 701, per=26.01%, avg=420.38, stdev=143.64, samples=29 iops : min= 5, max= 43, avg=25.59, stdev= 9.06, samples=29 lat (usec) : 50=0.78%, 100=0.78%, 250=3.26%, 500=0.65% lat (msec) : 2=1.43%, 4=2.47%, 10=16.02%, 20=33.20%, 50=38.28% lat (msec) : 100=3.12% cpu : usr=0.07%, sys=31.58%, ctx=2730, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=151019: Mon Sep 14 02:51:10 2026 read: IOPS=23, BW=368KiB/s (377kB/s)(5744KiB/15593msec) clat (usec): min=38, max=87725, avg=21285.94, stdev=13915.72 lat (usec): min=39, max=87726, avg=21286.66, stdev=13915.79 clat percentiles (usec): | 1.00th=[ 103], 5.00th=[ 133], 10.00th=[ 4883], 20.00th=[11076], | 30.00th=[14353], 40.00th=[16712], 50.00th=[19530], 60.00th=[21890], | 70.00th=[25822], 80.00th=[30802], 90.00th=[38011], 95.00th=[45876], | 99.00th=[68682], 99.50th=[80217], 99.90th=[87557], 99.95th=[87557], | 99.99th=[87557] bw ( KiB/s): min= 129, max= 637, per=23.80%, avg=365.60, stdev=150.26, samples=30 iops : min= 8, max= 39, avg=22.20, stdev= 9.37, samples=30 write: IOPS=26, BW=420KiB/s (430kB/s)(6544KiB/15593msec); 0 zone resets clat (usec): min=921, max=87484, avg=19213.00, stdev=14403.45 lat (usec): min=922, max=87486, avg=19214.35, stdev=14403.61 clat percentiles (usec): | 1.00th=[ 2704], 5.00th=[ 4228], 10.00th=[ 4686], 20.00th=[ 6521], | 30.00th=[ 9503], 40.00th=[11994], 50.00th=[15401], 60.00th=[19530], | 70.00th=[24249], 80.00th=[29754], 90.00th=[38011], 95.00th=[47449], | 99.00th=[68682], 99.50th=[70779], 99.90th=[87557], 99.95th=[87557], | 99.99th=[87557] bw ( KiB/s): min= 254, max= 800, per=25.46%, avg=411.40, stdev=138.04, samples=30 iops : min= 15, max= 50, avg=25.03, stdev= 8.76, samples=30 lat (usec) : 50=0.13%, 100=0.26%, 250=3.26%, 500=0.13%, 1000=0.26% lat (msec) : 2=0.65%, 4=1.69%, 10=18.49%, 20=32.55%, 50=38.80% lat (msec) : 100=3.78% cpu : usr=0.07%, sys=31.18%, ctx=2691, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=151020: Mon Sep 14 02:51:10 2026 read: IOPS=25, BW=404KiB/s (414kB/s)(6256KiB/15487msec) clat (usec): min=34, max=112945, avg=21262.86, stdev=14660.00 lat (usec): min=34, max=112947, avg=21290.08, stdev=14684.17 clat percentiles (usec): | 1.00th=[ 56], 5.00th=[ 125], 10.00th=[ 285], 20.00th=[ 10814], | 30.00th=[ 13435], 40.00th=[ 16057], 50.00th=[ 19006], 60.00th=[ 22414], | 70.00th=[ 27132], 80.00th=[ 30278], 90.00th=[ 38011], 95.00th=[ 47973], | 99.00th=[ 72877], 99.50th=[ 81265], 99.90th=[112722], 99.95th=[112722], | 99.99th=[112722] bw ( KiB/s): min= 159, max= 896, per=26.14%, avg=401.53, stdev=172.73, samples=30 iops : min= 9, max= 56, avg=24.43, stdev=10.82, samples=30 write: IOPS=24, BW=389KiB/s (399kB/s)(6032KiB/15487msec); 0 zone resets clat (usec): min=1083, max=104456, avg=18938.97, stdev=14877.23 lat (usec): min=1084, max=104456, avg=18940.26, stdev=14877.36 clat percentiles (usec): | 1.00th=[ 1385], 5.00th=[ 3884], 10.00th=[ 4621], 20.00th=[ 6456], | 30.00th=[ 8979], 40.00th=[ 11863], 50.00th=[ 15008], 60.00th=[ 19006], | 70.00th=[ 23462], 80.00th=[ 28705], 90.00th=[ 39060], 95.00th=[ 46924], | 99.00th=[ 77071], 99.50th=[ 83362], 99.90th=[104334], 99.95th=[104334], | 99.99th=[104334] bw ( KiB/s): min= 160, max= 701, per=23.54%, avg=380.37, stdev=127.38, samples=30 iops : min= 10, max= 43, avg=23.10, stdev= 8.01, samples=30 lat (usec) : 50=0.26%, 100=1.04%, 250=3.39%, 500=0.65% lat (msec) : 2=0.65%, 4=2.21%, 10=16.93%, 20=33.46%, 50=37.37% lat (msec) : 100=3.78%, 250=0.26% cpu : usr=0.07%, sys=30.25%, ctx=2658, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=151021: Mon Sep 14 02:51:10 2026 read: IOPS=24, BW=394KiB/s (403kB/s)(6032KiB/15321msec) clat (usec): min=30, max=102739, avg=20877.72, stdev=14219.94 lat (usec): min=30, max=102740, avg=20878.48, stdev=14219.98 clat percentiles (usec): | 1.00th=[ 94], 5.00th=[ 137], 10.00th=[ 223], 20.00th=[ 10945], | 30.00th=[ 14222], 40.00th=[ 16909], 50.00th=[ 19268], 60.00th=[ 21627], | 70.00th=[ 24773], 80.00th=[ 29754], 90.00th=[ 35914], 95.00th=[ 44303], | 99.00th=[ 77071], 99.50th=[ 94897], 99.90th=[102237], 99.95th=[102237], | 99.99th=[102237] bw ( KiB/s): min= 224, max= 670, per=25.40%, avg=390.20, stdev=118.63, samples=30 iops : min= 14, max= 41, avg=23.73, stdev= 7.42, samples=30 write: IOPS=25, BW=408KiB/s (418kB/s)(6256KiB/15321msec); 0 zone resets clat (usec): min=1024, max=87540, avg=18901.24, stdev=14880.22 lat (usec): min=1026, max=87541, avg=18902.54, stdev=14880.22 clat percentiles (usec): | 1.00th=[ 1303], 5.00th=[ 3818], 10.00th=[ 4621], 20.00th=[ 6194], | 30.00th=[ 8717], 40.00th=[11600], 50.00th=[13960], 60.00th=[18482], | 70.00th=[23725], 80.00th=[30016], 90.00th=[39584], 95.00th=[47449], | 99.00th=[65274], 99.50th=[82314], 99.90th=[87557], 99.95th=[87557], | 99.99th=[87557] bw ( KiB/s): min= 191, max= 730, per=25.05%, avg=404.83, stdev=134.12, samples=30 iops : min= 11, max= 45, avg=24.63, stdev= 8.39, samples=30 lat (usec) : 50=0.26%, 100=0.52%, 250=4.43%, 500=0.39% lat (msec) : 2=1.30%, 4=2.08%, 10=16.67%, 20=33.33%, 50=37.37% lat (msec) : 100=3.52%, 250=0.13% cpu : usr=0.11%, sys=30.61%, ctx=2675, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1536KiB/s (1573kB/s), 368KiB/s-404KiB/s (377kB/s-414kB/s), io=23.4MiB (24.5MB), run=15132-15593msec WRITE: bw=1616KiB/s (1655kB/s), 389KiB/s-421KiB/s (399kB/s-431kB/s), io=24.6MiB (25.8MB), run=15132-15593msec rand-rw: (groupid=0, jobs=1): err= 0: pid=151023: Mon Sep 14 02:51:17 2026 read: IOPS=16, BW=261KiB/s (267kB/s)(5920KiB/22690msec) clat (msec): min=3, max=169, avg=17.99, stdev=18.06 lat (msec): min=3, max=169, avg=17.99, stdev=18.06 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 5], 10.00th=[ 6], 20.00th=[ 8], | 30.00th=[ 9], 40.00th=[ 11], 50.00th=[ 12], 60.00th=[ 15], | 70.00th=[ 18], 80.00th=[ 24], 90.00th=[ 41], 95.00th=[ 57], | 99.00th=[ 92], 99.50th=[ 109], 99.90th=[ 169], 99.95th=[ 169], | 99.99th=[ 169] bw ( KiB/s): min= 64, max= 672, per=24.94%, avg=261.91, stdev=146.91, samples=45 iops : min= 4, max= 42, avg=16.00, stdev= 9.40, samples=45 write: IOPS=17, BW=281KiB/s (287kB/s)(6368KiB/22690msec); 0 zone resets clat (msec): min=15, max=165, avg=39.88, stdev=22.15 lat (msec): min=15, max=165, avg=39.88, stdev=22.15 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 20], 10.00th=[ 22], 20.00th=[ 26], | 30.00th=[ 28], 40.00th=[ 31], 50.00th=[ 33], 60.00th=[ 36], | 70.00th=[ 42], 80.00th=[ 51], 90.00th=[ 68], 95.00th=[ 83], | 99.00th=[ 130], 99.50th=[ 153], 99.90th=[ 167], 99.95th=[ 167], | 99.99th=[ 167] bw ( KiB/s): min= 96, max= 576, per=25.47%, avg=281.22, stdev=130.90, samples=45 iops : min= 6, max= 36, avg=17.20, stdev= 8.47, samples=45 lat (msec) : 4=2.08%, 10=15.89%, 20=20.96%, 50=47.66%, 100=11.33% lat (msec) : 250=2.08% cpu : usr=0.07%, sys=9.52%, ctx=1668, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=151024: Mon Sep 14 02:51:17 2026 read: IOPS=15, BW=252KiB/s (258kB/s)(5744KiB/22807msec) clat (msec): min=3, max=142, avg=17.76, stdev=16.92 lat (msec): min=3, max=142, avg=17.76, stdev=16.92 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 5], 10.00th=[ 5], 20.00th=[ 7], | 30.00th=[ 8], 40.00th=[ 10], 50.00th=[ 12], 60.00th=[ 15], | 70.00th=[ 20], 80.00th=[ 27], 90.00th=[ 39], 95.00th=[ 53], | 99.00th=[ 74], 99.50th=[ 99], 99.90th=[ 144], 99.95th=[ 144], | 99.99th=[ 144] bw ( KiB/s): min= 52, max= 672, per=23.82%, avg=250.16, stdev=153.54, samples=45 iops : min= 3, max= 42, avg=15.27, stdev= 9.80, samples=45 write: IOPS=17, BW=287KiB/s (294kB/s)(6544KiB/22807msec); 0 zone resets clat (msec): min=13, max=154, avg=39.79, stdev=21.21 lat (msec): min=13, max=154, avg=39.79, stdev=21.21 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 20], 10.00th=[ 21], 20.00th=[ 24], | 30.00th=[ 28], 40.00th=[ 31], 50.00th=[ 34], 60.00th=[ 39], | 70.00th=[ 44], 80.00th=[ 52], 90.00th=[ 68], 95.00th=[ 83], | 99.00th=[ 121], 99.50th=[ 129], 99.90th=[ 155], 99.95th=[ 155], | 99.99th=[ 155] bw ( KiB/s): min= 127, max= 608, per=25.74%, avg=284.16, stdev=131.55, samples=45 iops : min= 7, max= 38, avg=17.38, stdev= 8.50, samples=45 lat (msec) : 4=2.08%, 10=18.23%, 20=16.54%, 50=48.31%, 100=13.41% lat (msec) : 250=1.43% cpu : usr=0.08%, sys=9.34%, ctx=1657, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=151025: Mon Sep 14 02:51:17 2026 read: IOPS=17, BW=279KiB/s (286kB/s)(6256KiB/22387msec) clat (msec): min=3, max=170, avg=17.98, stdev=17.94 lat (msec): min=3, max=170, avg=17.98, stdev=17.94 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 5], 10.00th=[ 6], 20.00th=[ 7], | 30.00th=[ 9], 40.00th=[ 11], 50.00th=[ 12], 60.00th=[ 14], | 70.00th=[ 19], 80.00th=[ 27], 90.00th=[ 40], 95.00th=[ 52], | 99.00th=[ 95], 99.50th=[ 121], 99.90th=[ 171], 99.95th=[ 171], | 99.99th=[ 171] bw ( KiB/s): min= 94, max= 736, per=26.81%, avg=281.55, stdev=170.66, samples=44 iops : min= 5, max= 46, avg=17.20, stdev=10.89, samples=44 write: IOPS=16, BW=269KiB/s (276kB/s)(6032KiB/22387msec); 0 zone resets clat (msec): min=18, max=159, avg=40.56, stdev=20.01 lat (msec): min=18, max=159, avg=40.56, stdev=20.01 clat percentiles (msec): | 1.00th=[ 20], 5.00th=[ 21], 10.00th=[ 22], 20.00th=[ 26], | 30.00th=[ 29], 40.00th=[ 31], 50.00th=[ 35], 60.00th=[ 40], | 70.00th=[ 44], 80.00th=[ 54], 90.00th=[ 69], 95.00th=[ 81], | 99.00th=[ 113], 99.50th=[ 129], 99.90th=[ 161], 99.95th=[ 161], | 99.99th=[ 161] bw ( KiB/s): min= 128, max= 544, per=24.18%, avg=266.95, stdev=115.82, samples=44 iops : min= 8, max= 34, avg=16.30, stdev= 7.48, samples=44 lat (msec) : 4=1.56%, 10=18.88%, 20=17.71%, 50=47.53%, 100=13.02% lat (msec) : 250=1.30% cpu : usr=0.07%, sys=9.83%, ctx=1687, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=151026: Mon Sep 14 02:51:17 2026 read: IOPS=16, BW=268KiB/s (274kB/s)(6032KiB/22518msec) clat (msec): min=3, max=141, avg=18.28, stdev=18.10 lat (msec): min=3, max=141, avg=18.28, stdev=18.10 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 5], 10.00th=[ 6], 20.00th=[ 7], | 30.00th=[ 9], 40.00th=[ 11], 50.00th=[ 13], 60.00th=[ 15], | 70.00th=[ 20], 80.00th=[ 26], 90.00th=[ 41], 95.00th=[ 57], | 99.00th=[ 93], 99.50th=[ 118], 99.90th=[ 142], 99.95th=[ 142], | 99.99th=[ 142] bw ( KiB/s): min= 94, max= 608, per=24.90%, avg=261.45, stdev=138.75, samples=44 iops : min= 5, max= 38, avg=15.95, stdev= 8.89, samples=44 write: IOPS=17, BW=278KiB/s (284kB/s)(6256KiB/22518msec); 0 zone resets clat (msec): min=15, max=154, avg=39.64, stdev=20.88 lat (msec): min=15, max=154, avg=39.65, stdev=20.88 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 20], 10.00th=[ 22], 20.00th=[ 24], | 30.00th=[ 27], 40.00th=[ 31], 50.00th=[ 33], 60.00th=[ 38], | 70.00th=[ 43], 80.00th=[ 53], 90.00th=[ 68], 95.00th=[ 80], | 99.00th=[ 118], 99.50th=[ 138], 99.90th=[ 155], 99.95th=[ 155], | 99.99th=[ 155] bw ( KiB/s): min= 95, max= 576, per=24.92%, avg=275.14, stdev=130.30, samples=44 iops : min= 5, max= 36, avg=16.82, stdev= 8.41, samples=44 lat (msec) : 4=1.69%, 10=17.19%, 20=20.18%, 50=45.96%, 100=13.41% lat (msec) : 250=1.56% cpu : usr=0.06%, sys=9.58%, ctx=1672, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1050KiB/s (1075kB/s), 252KiB/s-279KiB/s (258kB/s-286kB/s), io=23.4MiB (24.5MB), run=22387-22807msec WRITE: bw=1105KiB/s (1131kB/s), 269KiB/s-287KiB/s (276kB/s-294kB/s), io=24.6MiB (25.8MB), run=22387-22807msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=151034: Mon Sep 14 02:51:26 2026 read: IOPS=2, BW=2570KiB/s (2632kB/s)(7168KiB/2789msec) clat (usec): min=534, max=545529, avg=170566.13, stdev=180322.29 lat (usec): min=535, max=545530, avg=170567.18, stdev=180322.37 clat percentiles (usec): | 1.00th=[ 537], 5.00th=[ 537], 10.00th=[ 537], 20.00th=[ 63177], | 30.00th=[ 81265], 40.00th=[ 81265], 50.00th=[114820], 60.00th=[162530], | 70.00th=[162530], 80.00th=[225444], 90.00th=[549454], 95.00th=[549454], | 99.00th=[549454], 99.50th=[549454], 99.90th=[549454], 99.95th=[549454], | 99.99th=[549454] bw ( KiB/s): min= 1703, max= 6095, per=48.34%, avg=2957.50, stdev=2097.03, samples=4 iops : min= 1, max= 5, avg= 2.25, stdev= 1.89, samples=4 write: IOPS=1, BW=1836KiB/s (1880kB/s)(5120KiB/2789msec); 0 zone resets clat (msec): min=119, max=503, avg=310.91, stdev=143.44 lat (msec): min=119, max=503, avg=310.96, stdev=143.45 clat percentiles (msec): | 1.00th=[ 120], 5.00th=[ 120], 10.00th=[ 120], 20.00th=[ 120], | 30.00th=[ 243], 40.00th=[ 243], 50.00th=[ 317], 60.00th=[ 317], | 70.00th=[ 376], 80.00th=[ 376], 90.00th=[ 502], 95.00th=[ 502], | 99.00th=[ 502], 99.50th=[ 502], 99.90th=[ 502], 99.95th=[ 502], | 99.99th=[ 502] bw ( KiB/s): min= 1984, max= 3683, per=29.96%, avg=2566.00, stdev=967.64, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (usec) : 750=8.33% lat (msec) : 100=16.67%, 250=41.67%, 500=16.67%, 750=16.67% cpu : usr=0.00%, sys=39.42%, ctx=1265, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=151035: Mon Sep 14 02:51:26 2026 read: IOPS=0, BW=612KiB/s (627kB/s)(2048KiB/3347msec) clat (msec): min=123, max=198, avg=161.33, stdev=53.20 lat (msec): min=123, max=198, avg=161.33, stdev=53.20 clat percentiles (msec): | 1.00th=[ 124], 5.00th=[ 124], 10.00th=[ 124], 20.00th=[ 124], | 30.00th=[ 124], 40.00th=[ 124], 50.00th=[ 124], 60.00th=[ 199], | 70.00th=[ 199], 80.00th=[ 199], 90.00th=[ 199], 95.00th=[ 199], | 99.00th=[ 199], 99.50th=[ 199], 99.90th=[ 199], 99.95th=[ 199], | 99.99th=[ 199] bw ( KiB/s): min= 1712, max= 1984, per=30.21%, avg=1848.00, stdev=192.33, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=3059KiB/s (3133kB/s)(10.0MiB/3347msec); 0 zone resets clat (msec): min=129, max=760, avg=301.36, stdev=242.00 lat (msec): min=129, max=760, avg=301.43, stdev=241.99 clat percentiles (msec): | 1.00th=[ 130], 5.00th=[ 130], 10.00th=[ 130], 20.00th=[ 138], | 30.00th=[ 155], 40.00th=[ 161], 50.00th=[ 167], 60.00th=[ 178], | 70.00th=[ 209], 80.00th=[ 418], 90.00th=[ 709], 95.00th=[ 760], | 99.00th=[ 760], 99.50th=[ 760], 99.90th=[ 760], 99.95th=[ 760], | 99.99th=[ 760] bw ( KiB/s): min= 1841, max= 8159, per=53.00%, avg=4539.75, stdev=2633.53, samples=4 iops : min= 1, max= 7, avg= 3.75, stdev= 2.50, samples=4 lat (msec) : 250=75.00%, 500=8.33%, 750=8.33%, 1000=8.33% cpu : usr=0.03%, sys=42.83%, ctx=328, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=151036: Mon Sep 14 02:51:26 2026 read: IOPS=2, BW=2289KiB/s (2344kB/s)(6144KiB/2684msec) clat (usec): min=402, max=270146, avg=78178.40, stdev=106202.50 lat (usec): min=403, max=270148, avg=78179.58, stdev=106203.02 clat percentiles (usec): | 1.00th=[ 404], 5.00th=[ 404], 10.00th=[ 404], 20.00th=[ 486], | 30.00th=[ 486], 40.00th=[ 668], 50.00th=[ 668], 60.00th=[ 81265], | 70.00th=[115868], 80.00th=[115868], 90.00th=[270533], 95.00th=[270533], | 99.00th=[270533], 99.50th=[270533], 99.90th=[270533], 99.95th=[270533], | 99.99th=[270533] bw ( KiB/s): min= 1984, max= 4096, per=53.19%, avg=3254.33, stdev=1119.35, samples=3 iops : min= 1, max= 4, avg= 2.67, stdev= 1.53, samples=3 write: IOPS=2, BW=2289KiB/s (2344kB/s)(6144KiB/2684msec); 0 zone resets clat (msec): min=135, max=769, avg=362.78, stdev=242.39 lat (msec): min=135, max=769, avg=362.85, stdev=242.38 clat percentiles (msec): | 1.00th=[ 136], 5.00th=[ 136], 10.00th=[ 136], 20.00th=[ 142], | 30.00th=[ 142], 40.00th=[ 245], 50.00th=[ 245], 60.00th=[ 422], | 70.00th=[ 464], 80.00th=[ 464], 90.00th=[ 768], 95.00th=[ 768], | 99.00th=[ 768], 99.50th=[ 768], 99.90th=[ 768], 99.95th=[ 768], | 99.99th=[ 768] bw ( KiB/s): min= 1841, max= 3436, per=27.17%, avg=2327.25, stdev=744.21, samples=4 iops : min= 1, max= 3, avg= 1.75, stdev= 0.96, samples=4 lat (usec) : 500=16.67%, 750=8.33% lat (msec) : 100=8.33%, 250=33.33%, 500=25.00%, 1000=8.33% cpu : usr=0.00%, sys=32.61%, ctx=316, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=151037: Mon Sep 14 02:51:26 2026 read: IOPS=1, BW=2013KiB/s (2062kB/s)(5120KiB/2543msec) clat (usec): min=499, max=194685, avg=124540.50, stdev=86945.20 lat (usec): min=499, max=194686, avg=124541.46, stdev=86945.54 clat percentiles (usec): | 1.00th=[ 498], 5.00th=[ 498], 10.00th=[ 498], 20.00th=[ 498], | 30.00th=[ 65274], 40.00th=[ 65274], 50.00th=[177210], 60.00th=[177210], | 70.00th=[185598], 80.00th=[185598], 90.00th=[193987], 95.00th=[193987], | 99.00th=[193987], 99.50th=[193987], 99.90th=[193987], 99.95th=[193987], | 99.99th=[193987] bw ( KiB/s): min= 2048, max= 5525, per=61.89%, avg=3786.50, stdev=2458.61, samples=2 iops : min= 2, max= 5, avg= 3.50, stdev= 2.12, samples=2 write: IOPS=2, BW=2819KiB/s (2886kB/s)(7168KiB/2543msec); 0 zone resets clat (msec): min=135, max=644, avg=270.66, stdev=171.30 lat (msec): min=135, max=644, avg=270.71, stdev=171.29 clat percentiles (msec): | 1.00th=[ 136], 5.00th=[ 136], 10.00th=[ 136], 20.00th=[ 174], | 30.00th=[ 192], 40.00th=[ 192], 50.00th=[ 228], 60.00th=[ 255], | 70.00th=[ 255], 80.00th=[ 268], 90.00th=[ 642], 95.00th=[ 642], | 99.00th=[ 642], 99.50th=[ 642], 99.90th=[ 642], 99.95th=[ 642], | 99.99th=[ 642] bw ( KiB/s): min= 1712, max= 4063, per=33.58%, avg=2876.50, stdev=1169.14, samples=4 iops : min= 1, max= 3, avg= 2.25, stdev= 0.96, samples=4 lat (usec) : 500=8.33% lat (msec) : 100=8.33%, 250=58.33%, 500=16.67%, 750=8.33% cpu : usr=0.00%, sys=47.60%, ctx=657, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=6119KiB/s (6266kB/s), 612KiB/s-2570KiB/s (627kB/s-2632kB/s), io=20.0MiB (20.0MB), run=2543-3347msec WRITE: bw=8566KiB/s (8772kB/s), 1836KiB/s-3059KiB/s (1880kB/s-3133kB/s), io=28.0MiB (29.4MB), run=2543-3347msec rand-rw: (groupid=0, jobs=1): err= 0: pid=151039: Mon Sep 14 02:51:27 2026 read: IOPS=1, BW=1988KiB/s (2036kB/s)(7168KiB/3606msec) clat (msec): min=30, max=1133, avg=424.19, stdev=404.79 lat (msec): min=30, max=1133, avg=424.19, stdev=404.79 clat percentiles (msec): | 1.00th=[ 31], 5.00th=[ 31], 10.00th=[ 31], 20.00th=[ 65], | 30.00th=[ 68], 40.00th=[ 68], 50.00th=[ 477], 60.00th=[ 550], | 70.00th=[ 550], 80.00th=[ 651], 90.00th=[ 1133], 95.00th=[ 1133], | 99.00th=[ 1133], 99.50th=[ 1133], 99.90th=[ 1133], 99.95th=[ 1133], | 99.99th=[ 1133] bw ( KiB/s): min= 1689, max= 4031, per=43.21%, avg=2454.00, stdev=1064.87, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 0.82, samples=4 write: IOPS=1, BW=1420KiB/s (1454kB/s)(5120KiB/3606msec); 0 zone resets clat (msec): min=63, max=220, avg=123.71, stdev=60.70 lat (msec): min=63, max=221, avg=123.79, stdev=60.71 clat percentiles (msec): | 1.00th=[ 64], 5.00th=[ 64], 10.00th=[ 64], 20.00th=[ 64], | 30.00th=[ 86], 40.00th=[ 86], 50.00th=[ 115], 60.00th=[ 115], | 70.00th=[ 136], 80.00th=[ 136], 90.00th=[ 222], 95.00th=[ 222], | 99.00th=[ 222], 99.50th=[ 222], 99.90th=[ 222], 99.95th=[ 222], | 99.99th=[ 222] bw ( KiB/s): min= 2048, max= 2048, per=25.76%, avg=2048.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 50=8.33%, 100=33.33%, 250=25.00%, 500=8.33%, 750=16.67% lat (msec) : 2000=8.33% cpu : usr=0.08%, sys=8.68%, ctx=74, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=151040: Mon Sep 14 02:51:27 2026 read: IOPS=0, BW=576KiB/s (590kB/s)(2048KiB/3554msec) clat (msec): min=151, max=255, avg=203.58, stdev=73.69 lat (msec): min=151, max=255, avg=203.58, stdev=73.69 clat percentiles (msec): | 1.00th=[ 153], 5.00th=[ 153], 10.00th=[ 153], 20.00th=[ 153], | 30.00th=[ 153], 40.00th=[ 153], 50.00th=[ 153], 60.00th=[ 255], | 70.00th=[ 255], 80.00th=[ 255], 90.00th=[ 255], 95.00th=[ 255], | 99.00th=[ 255], 99.50th=[ 255], 99.90th=[ 255], 99.95th=[ 255], | 99.99th=[ 255] bw ( KiB/s): min= 1729, max= 2048, per=33.25%, avg=1888.50, stdev=225.57, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 write: IOPS=2, BW=2881KiB/s (2950kB/s)(10.0MiB/3554msec); 0 zone resets clat (msec): min=69, max=1078, avg=306.77, stdev=322.69 lat (msec): min=69, max=1078, avg=306.85, stdev=322.68 clat percentiles (msec): | 1.00th=[ 70], 5.00th=[ 70], 10.00th=[ 70], 20.00th=[ 83], | 30.00th=[ 103], 40.00th=[ 161], 50.00th=[ 165], 60.00th=[ 182], | 70.00th=[ 197], 80.00th=[ 380], 90.00th=[ 651], 95.00th=[ 1083], | 99.00th=[ 1083], 99.50th=[ 1083], 99.90th=[ 1083], 99.95th=[ 1083], | 99.99th=[ 1083] bw ( KiB/s): min= 2015, max= 4096, per=38.45%, avg=3057.50, stdev=1184.84, samples=4 iops : min= 1, max= 4, avg= 2.50, stdev= 1.29, samples=4 lat (msec) : 100=16.67%, 250=50.00%, 500=16.67%, 750=8.33%, 2000=8.33% cpu : usr=0.03%, sys=17.25%, ctx=160, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=151041: Mon Sep 14 02:51:27 2026 read: IOPS=1, BW=1883KiB/s (1928kB/s)(6144KiB/3263msec) clat (msec): min=73, max=415, avg=227.21, stdev=152.60 lat (msec): min=73, max=415, avg=227.21, stdev=152.60 clat percentiles (msec): | 1.00th=[ 74], 5.00th=[ 74], 10.00th=[ 74], 20.00th=[ 99], | 30.00th=[ 99], 40.00th=[ 107], 50.00th=[ 107], 60.00th=[ 300], | 70.00th=[ 372], 80.00th=[ 372], 90.00th=[ 418], 95.00th=[ 418], | 99.00th=[ 418], 99.50th=[ 418], 99.90th=[ 418], 99.95th=[ 418], | 99.99th=[ 418] bw ( KiB/s): min= 2048, max= 4096, per=59.72%, avg=3391.67, stdev=1164.10, samples=3 iops : min= 2, max= 4, avg= 3.00, stdev= 1.00, samples=3 write: IOPS=1, BW=1883KiB/s (1928kB/s)(6144KiB/3263msec); 0 zone resets clat (msec): min=82, max=1078, avg=303.11, stdev=387.91 lat (msec): min=82, max=1078, avg=303.17, stdev=387.91 clat percentiles (msec): | 1.00th=[ 83], 5.00th=[ 83], 10.00th=[ 83], 20.00th=[ 97], | 30.00th=[ 97], 40.00th=[ 104], 50.00th=[ 104], 60.00th=[ 163], | 70.00th=[ 296], 80.00th=[ 296], 90.00th=[ 1083], 95.00th=[ 1083], | 99.00th=[ 1083], 99.50th=[ 1083], 99.90th=[ 1083], 99.95th=[ 1083], | 99.99th=[ 1083] bw ( KiB/s): min= 2015, max= 3459, per=30.05%, avg=2389.25, stdev=713.30, samples=4 iops : min= 1, max= 3, avg= 1.75, stdev= 0.96, samples=4 lat (msec) : 100=33.33%, 250=25.00%, 500=33.33%, 2000=8.33% cpu : usr=0.00%, sys=11.40%, ctx=397, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=151042: Mon Sep 14 02:51:27 2026 read: IOPS=1, BW=1635KiB/s (1675kB/s)(5120KiB/3131msec) clat (msec): min=86, max=281, avg=146.57, stdev=79.30 lat (msec): min=86, max=281, avg=146.57, stdev=79.30 clat percentiles (msec): | 1.00th=[ 87], 5.00th=[ 87], 10.00th=[ 87], 20.00th=[ 87], | 30.00th=[ 97], 40.00th=[ 97], 50.00th=[ 118], 60.00th=[ 118], | 70.00th=[ 150], 80.00th=[ 150], 90.00th=[ 284], 95.00th=[ 284], | 99.00th=[ 284], 99.50th=[ 284], 99.90th=[ 284], 99.95th=[ 284], | 99.99th=[ 284] bw ( KiB/s): min= 4096, max= 4096, per=72.13%, avg=4096.00, stdev= 0.00, samples=2 iops : min= 4, max= 4, avg= 4.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2289KiB/s (2344kB/s)(7168KiB/3131msec); 0 zone resets clat (msec): min=117, max=943, avg=331.02, stdev=283.95 lat (msec): min=117, max=943, avg=331.08, stdev=283.94 clat percentiles (msec): | 1.00th=[ 117], 5.00th=[ 117], 10.00th=[ 117], 20.00th=[ 155], | 30.00th=[ 192], 40.00th=[ 192], 50.00th=[ 251], 60.00th=[ 275], | 70.00th=[ 275], 80.00th=[ 384], 90.00th=[ 944], 95.00th=[ 944], | 99.00th=[ 944], 99.50th=[ 944], 99.90th=[ 944], 99.95th=[ 944], | 99.99th=[ 944] bw ( KiB/s): min= 1726, max= 6047, per=43.68%, avg=3473.00, stdev=2005.47, samples=4 iops : min= 1, max= 5, avg= 2.75, stdev= 1.71, samples=4 lat (msec) : 100=16.67%, 250=41.67%, 500=33.33%, 1000=8.33% cpu : usr=0.00%, sys=20.00%, ctx=142, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5679KiB/s (5816kB/s), 576KiB/s-1988KiB/s (590kB/s-2036kB/s), io=20.0MiB (20.0MB), run=3131-3606msec WRITE: bw=7951KiB/s (8142kB/s), 1420KiB/s-2881KiB/s (1454kB/s-2950kB/s), io=28.0MiB (29.4MB), run=3131-3606msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=151047: Mon Sep 14 02:51:36 2026 read: IOPS=1, BW=5161KiB/s (5285kB/s)(12.0MiB/2381msec) clat (msec): min=581, max=1057, avg=792.81, stdev=242.89 lat (msec): min=581, max=1057, avg=792.81, stdev=242.89 clat percentiles (msec): | 1.00th=[ 584], 5.00th=[ 584], 10.00th=[ 584], 20.00th=[ 584], | 30.00th=[ 584], 40.00th=[ 743], 50.00th=[ 743], 60.00th=[ 743], | 70.00th=[ 1062], 80.00th=[ 1062], 90.00th=[ 1062], 95.00th=[ 1062], | 99.00th=[ 1062], 99.50th=[ 1062], 99.90th=[ 1062], 99.95th=[ 1062], | 99.99th=[ 1062] bw ( KiB/s): min= 7599, max= 8192, per=100.00%, avg=7895.50, stdev=419.31, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 750=66.67%, 2000=33.33% cpu : usr=0.00%, sys=48.66%, ctx=2395, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=151048: Mon Sep 14 02:51:36 2026 read: IOPS=0, BW=1537KiB/s (1574kB/s)(4096KiB/2665msec) clat (nsec): min=594580k, max=594580k, avg=594580194.00, stdev= 0.00 lat (nsec): min=594582k, max=594582k, avg=594581962.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 592], 5.00th=[ 592], 10.00th=[ 592], 20.00th=[ 592], | 30.00th=[ 592], 40.00th=[ 592], 50.00th=[ 592], 60.00th=[ 592], | 70.00th=[ 592], 80.00th=[ 592], 90.00th=[ 592], 95.00th=[ 592], | 99.00th=[ 592], 99.50th=[ 592], 99.90th=[ 592], 99.95th=[ 592], | 99.99th=[ 592] bw ( KiB/s): min= 7599, max= 7599, per=100.00%, avg=7599.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=3074KiB/s (3148kB/s)(8192KiB/2665msec); 0 zone resets clat (msec): min=776, max=1281, avg=1028.96, stdev=357.22 lat (msec): min=776, max=1281, avg=1029.27, stdev=357.21 clat percentiles (msec): | 1.00th=[ 776], 5.00th=[ 776], 10.00th=[ 776], 20.00th=[ 776], | 30.00th=[ 776], 40.00th=[ 776], 50.00th=[ 776], 60.00th=[ 1284], | 70.00th=[ 1284], 80.00th=[ 1284], 90.00th=[ 1284], 95.00th=[ 1284], | 99.00th=[ 1284], 99.50th=[ 1284], 99.90th=[ 1284], 99.95th=[ 1284], | 99.99th=[ 1284] bw ( KiB/s): min= 8015, max= 8015, per=66.61%, avg=8015.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.04%, sys=23.42%, ctx=723, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=151049: Mon Sep 14 02:51:36 2026 write: IOPS=1, BW=4513KiB/s (4621kB/s)(12.0MiB/2723msec); 0 zone resets clat (msec): min=461, max=1299, avg=900.33, stdev=420.61 lat (msec): min=461, max=1300, avg=900.66, stdev=420.56 clat percentiles (msec): | 1.00th=[ 460], 5.00th=[ 460], 10.00th=[ 460], 20.00th=[ 460], | 30.00th=[ 460], 40.00th=[ 944], 50.00th=[ 944], 60.00th=[ 944], | 70.00th=[ 1301], 80.00th=[ 1301], 90.00th=[ 1301], 95.00th=[ 1301], | 99.00th=[ 1301], 99.50th=[ 1301], 99.90th=[ 1301], 99.95th=[ 1301], | 99.99th=[ 1301] bw ( KiB/s): min= 7599, max= 7641, per=63.33%, avg=7620.00, stdev=29.70, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=24.21%, ctx=105, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=151050: Mon Sep 14 02:51:36 2026 write: IOPS=1, BW=4606KiB/s (4716kB/s)(12.0MiB/2668msec); 0 zone resets clat (msec): min=467, max=1488, avg=888.44, stdev=533.80 lat (msec): min=468, max=1489, avg=888.76, stdev=533.82 clat percentiles (msec): | 1.00th=[ 468], 5.00th=[ 468], 10.00th=[ 468], 20.00th=[ 468], | 30.00th=[ 468], 40.00th=[ 709], 50.00th=[ 709], 60.00th=[ 709], | 70.00th=[ 1485], 80.00th=[ 1485], 90.00th=[ 1485], 95.00th=[ 1485], | 99.00th=[ 1485], 99.50th=[ 1485], 99.90th=[ 1485], 99.95th=[ 1485], | 99.99th=[ 1485] bw ( KiB/s): min= 7831, max= 8015, per=65.84%, avg=7923.00, stdev=130.11, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.00%, sys=19.50%, ctx=243, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=6148KiB/s (6295kB/s), 1537KiB/s-5161KiB/s (1574kB/s-5285kB/s), io=16.0MiB (16.8MB), run=2381-2665msec WRITE: bw=11.8MiB/s (12.3MB/s), 3074KiB/s-4606KiB/s (3148kB/s-4716kB/s), io=32.0MiB (33.6MB), run=2665-2723msec rand-rw: (groupid=0, jobs=1): err= 0: pid=151052: Mon Sep 14 02:51:37 2026 read: IOPS=1, BW=4513KiB/s (4621kB/s)(12.0MiB/2723msec) clat (msec): min=218, max=1283, avg=906.79, stdev=596.64 lat (msec): min=218, max=1283, avg=906.79, stdev=596.64 clat percentiles (msec): | 1.00th=[ 220], 5.00th=[ 220], 10.00th=[ 220], 20.00th=[ 220], | 30.00th=[ 220], 40.00th=[ 1217], 50.00th=[ 1217], 60.00th=[ 1217], | 70.00th=[ 1284], 80.00th=[ 1284], 90.00th=[ 1284], 95.00th=[ 1284], | 99.00th=[ 1284], 99.50th=[ 1284], 99.90th=[ 1284], 99.95th=[ 1284], | 99.99th=[ 1284] bw ( KiB/s): min= 8143, max= 8143, per=100.00%, avg=8143.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 2000=66.67% cpu : usr=0.00%, sys=13.70%, ctx=49, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=151053: Mon Sep 14 02:51:37 2026 read: IOPS=0, BW=1317KiB/s (1349kB/s)(4096KiB/3109msec) clat (nsec): min=953833k, max=953833k, avg=953833059.00, stdev= 0.00 lat (nsec): min=953847k, max=953847k, avg=953847121.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 953], 5.00th=[ 953], 10.00th=[ 953], 20.00th=[ 953], | 30.00th=[ 953], 40.00th=[ 953], 50.00th=[ 953], 60.00th=[ 953], | 70.00th=[ 953], 80.00th=[ 953], 90.00th=[ 953], 95.00th=[ 953], | 99.00th=[ 953], 99.50th=[ 953], 99.90th=[ 953], 99.95th=[ 953], | 99.99th=[ 953] bw ( KiB/s): min= 8143, max= 8143, per=100.00%, avg=8143.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2635KiB/s (2698kB/s)(8192KiB/3109msec); 0 zone resets clat (msec): min=1044, max=1108, avg=1076.47, stdev=45.30 lat (msec): min=1044, max=1108, avg=1076.62, stdev=45.30 clat percentiles (msec): | 1.00th=[ 1045], 5.00th=[ 1045], 10.00th=[ 1045], 20.00th=[ 1045], | 30.00th=[ 1045], 40.00th=[ 1045], 50.00th=[ 1045], 60.00th=[ 1116], | 70.00th=[ 1116], 80.00th=[ 1116], 90.00th=[ 1116], 95.00th=[ 1116], | 99.00th=[ 1116], 99.50th=[ 1116], 99.90th=[ 1116], 99.95th=[ 1116], | 99.99th=[ 1116] bw ( KiB/s): min= 8175, max= 8175, per=77.57%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 1000=33.33%, 2000=66.67% cpu : usr=0.00%, sys=14.80%, ctx=104, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=151054: Mon Sep 14 02:51:37 2026 write: IOPS=0, BW=4008KiB/s (4104kB/s)(12.0MiB/3066msec); 0 zone resets clat (msec): min=187, max=1918, avg=1020.85, stdev=867.71 lat (msec): min=187, max=1919, avg=1021.13, stdev=867.63 clat percentiles (msec): | 1.00th=[ 188], 5.00th=[ 188], 10.00th=[ 188], 20.00th=[ 188], | 30.00th=[ 188], 40.00th=[ 961], 50.00th=[ 961], 60.00th=[ 961], | 70.00th=[ 1921], 80.00th=[ 1921], 90.00th=[ 1921], 95.00th=[ 1921], | 99.00th=[ 1921], 99.50th=[ 1921], 99.90th=[ 1921], 99.95th=[ 1921], | 99.99th=[ 1921] bw ( KiB/s): min= 8175, max= 8175, per=77.57%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.03%, sys=14.45%, ctx=70, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=151055: Mon Sep 14 02:51:37 2026 write: IOPS=1, BW=4283KiB/s (4386kB/s)(12.0MiB/2869msec); 0 zone resets clat (msec): min=245, max=2070, avg=955.23, stdev=977.73 lat (msec): min=245, max=2070, avg=955.51, stdev=977.72 clat percentiles (msec): | 1.00th=[ 245], 5.00th=[ 245], 10.00th=[ 245], 20.00th=[ 245], | 30.00th=[ 245], 40.00th=[ 550], 50.00th=[ 550], 60.00th=[ 550], | 70.00th=[ 2072], 80.00th=[ 2072], 90.00th=[ 2072], 95.00th=[ 2072], | 99.00th=[ 2072], 99.50th=[ 2072], 99.90th=[ 2072], 99.95th=[ 2072], | 99.99th=[ 2072] bw ( KiB/s): min= 5712, max= 8192, per=65.96%, avg=6952.00, stdev=1753.62, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 250=33.33%, 750=33.33%, >=2000=33.33% cpu : usr=0.07%, sys=20.22%, ctx=198, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5270KiB/s (5396kB/s), 1317KiB/s-4513KiB/s (1349kB/s-4621kB/s), io=16.0MiB (16.8MB), run=2723-3109msec WRITE: bw=10.3MiB/s (10.8MB/s), 2635KiB/s-4283KiB/s (2698kB/s-4386kB/s), io=32.0MiB (33.6MB), run=2869-3109msec