== sanity test 398b: DIO and buffer IO race ============== 01:24:26 (1788585866) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 7.63325 s, 6.6 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144327: Sat Sep 5 01:27:02 2026 read: IOPS=11, BW=44.8KiB/s (45.9kB/s)(5992KiB/133687msec) clat (usec): min=34, max=463314, avg=42782.61, stdev=38458.70 lat (usec): min=35, max=463316, avg=42787.81, stdev=38459.10 clat percentiles (usec): | 1.00th=[ 49], 5.00th=[ 59], 10.00th=[ 76], 20.00th=[ 16909], | 30.00th=[ 23462], 40.00th=[ 29492], 50.00th=[ 35390], 60.00th=[ 42730], | 70.00th=[ 52167], 80.00th=[ 65274], 90.00th=[ 84411], 95.00th=[104334], | 99.00th=[168821], 99.50th=[223347], 99.90th=[455082], 99.95th=[463471], | 99.99th=[463471] bw ( KiB/s): min= 7, max= 135, per=24.92%, avg=44.60, stdev=19.70, samples=262 iops : min= 1, max= 33, avg=10.50, stdev= 4.97, samples=262 write: IOPS=11, BW=47.1KiB/s (48.2kB/s)(6296KiB/133687msec); 0 zone resets clat (usec): min=787, max=1084.0k, avg=43869.03, stdev=54802.92 lat (usec): min=789, max=1084.0k, avg=43870.85, stdev=54802.88 clat percentiles (usec): | 1.00th=[ 1037], 5.00th=[ 1156], 10.00th=[ 1303], | 20.00th=[ 3195], 30.00th=[ 7832], 40.00th=[ 17695], | 50.00th=[ 29492], 60.00th=[ 41681], 70.00th=[ 56361], | 80.00th=[ 74974], 90.00th=[ 103285], 95.00th=[ 137364], | 99.00th=[ 210764], 99.50th=[ 261096], 99.90th=[ 471860], | 99.95th=[1082131], 99.99th=[1082131] bw ( KiB/s): min= 7, max= 127, per=25.11%, avg=47.21, stdev=23.14, samples=260 iops : min= 1, max= 31, avg=11.15, stdev= 5.82, samples=260 lat (usec) : 50=0.81%, 100=4.72%, 250=0.29%, 500=0.16%, 750=0.07% lat (usec) : 1000=0.20% lat (msec) : 2=7.68%, 4=3.58%, 10=5.60%, 20=9.93%, 50=34.15% lat (msec) : 100=24.38%, 250=7.94%, 500=0.46%, 2000=0.03% cpu : usr=0.06%, sys=4.79%, ctx=6229, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144328: Sat Sep 5 01:27:02 2026 read: IOPS=11, BW=44.6KiB/s (45.7kB/s)(5940KiB/133140msec) clat (usec): min=29, max=594193, avg=41584.12, stdev=37395.85 lat (usec): min=29, max=594194, avg=41592.01, stdev=37393.46 clat percentiles (usec): | 1.00th=[ 45], 5.00th=[ 59], 10.00th=[ 85], 20.00th=[ 17433], | 30.00th=[ 23462], 40.00th=[ 28443], 50.00th=[ 34341], 60.00th=[ 41157], | 70.00th=[ 50070], 80.00th=[ 63177], 90.00th=[ 82314], 95.00th=[100140], | 99.00th=[147850], 99.50th=[183501], 99.90th=[517997], 99.95th=[591397], | 99.99th=[591397] bw ( KiB/s): min= 7, max= 111, per=24.96%, avg=44.67, stdev=20.91, samples=259 iops : min= 1, max= 27, avg=10.53, stdev= 5.29, samples=259 write: IOPS=11, BW=47.7KiB/s (48.8kB/s)(6348KiB/133140msec); 0 zone resets clat (usec): min=932, max=529845, avg=44608.80, stdev=50873.45 lat (usec): min=934, max=529847, avg=44618.73, stdev=50870.36 clat percentiles (usec): | 1.00th=[ 1057], 5.00th=[ 1156], 10.00th=[ 1319], 20.00th=[ 3326], | 30.00th=[ 7701], 40.00th=[ 19530], 50.00th=[ 31589], 60.00th=[ 43254], | 70.00th=[ 55837], 80.00th=[ 76022], 90.00th=[112722], 95.00th=[139461], | 99.00th=[208667], 99.50th=[248513], 99.90th=[509608], 99.95th=[530580], | 99.99th=[530580] bw ( KiB/s): min= 7, max= 128, per=25.21%, avg=47.40, stdev=23.83, samples=260 iops : min= 1, max= 32, avg=11.23, stdev= 6.01, samples=260 lat (usec) : 50=0.75%, 100=4.30%, 250=0.42%, 500=0.16%, 750=0.07% lat (usec) : 1000=0.16% lat (msec) : 2=7.91%, 4=3.65%, 10=5.70%, 20=9.34%, 50=35.22% lat (msec) : 100=23.31%, 250=8.63%, 500=0.26%, 750=0.13% cpu : usr=0.09%, sys=5.02%, ctx=6297, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144329: Sat Sep 5 01:27:02 2026 read: IOPS=11, BW=45.2KiB/s (46.3kB/s)(6028KiB/133307msec) clat (usec): min=33, max=479752, avg=41411.91, stdev=36744.66 lat (usec): min=33, max=479752, avg=41414.57, stdev=36743.73 clat percentiles (usec): | 1.00th=[ 49], 5.00th=[ 58], 10.00th=[ 76], 20.00th=[ 17957], | 30.00th=[ 23987], 40.00th=[ 29230], 50.00th=[ 34341], 60.00th=[ 41681], | 70.00th=[ 49546], 80.00th=[ 63177], 90.00th=[ 80217], 95.00th=[ 99091], | 99.00th=[154141], 99.50th=[179307], 99.90th=[476054], 99.95th=[480248], | 99.99th=[480248] bw ( KiB/s): min= 7, max= 111, per=24.97%, avg=44.70, stdev=21.16, samples=263 iops : min= 1, max= 27, avg=10.51, stdev= 5.32, samples=263 write: IOPS=11, BW=46.0KiB/s (48.1kB/s)(6260KiB/133307msec); 0 zone resets clat (usec): min=814, max=516970, avg=44929.78, stdev=50371.36 lat (usec): min=816, max=516972, avg=44933.44, stdev=50371.06 clat percentiles (usec): | 1.00th=[ 1029], 5.00th=[ 1172], 10.00th=[ 1385], 20.00th=[ 3818], | 30.00th=[ 7898], 40.00th=[ 18744], 50.00th=[ 31327], 60.00th=[ 44303], | 70.00th=[ 58459], 80.00th=[ 76022], 90.00th=[105382], 95.00th=[137364], | 99.00th=[223347], 99.50th=[274727], 99.90th=[421528], 99.95th=[517997], | 99.99th=[517997] bw ( KiB/s): min= 7, max= 111, per=24.74%, avg=46.52, stdev=21.71, samples=262 iops : min= 1, max= 27, avg=10.98, stdev= 5.47, samples=262 lat (usec) : 50=0.68%, 100=4.85%, 250=0.49%, 500=0.07%, 750=0.03% lat (usec) : 1000=0.39% lat (msec) : 2=6.71%, 4=3.35%, 10=6.48%, 20=9.31%, 50=35.16% lat (msec) : 100=24.19%, 250=7.91%, 500=0.36%, 750=0.03% cpu : usr=0.08%, sys=4.92%, ctx=6249, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144330: Sat Sep 5 01:27:02 2026 read: IOPS=11, BW=45.4KiB/s (46.5kB/s)(6052KiB/133227msec) clat (usec): min=34, max=389706, avg=41111.47, stdev=32914.79 lat (usec): min=35, max=389707, avg=41113.26, stdev=32914.54 clat percentiles (usec): | 1.00th=[ 46], 5.00th=[ 58], 10.00th=[ 83], 20.00th=[ 17695], | 30.00th=[ 23200], 40.00th=[ 28705], 50.00th=[ 34866], 60.00th=[ 42206], | 70.00th=[ 50070], 80.00th=[ 61604], 90.00th=[ 83362], 95.00th=[101188], | 99.00th=[143655], 99.50th=[181404], 99.90th=[291505], 99.95th=[387974], | 99.99th=[387974] bw ( KiB/s): min= 7, max= 127, per=25.42%, avg=45.51, stdev=21.17, samples=259 iops : min= 1, max= 31, avg=10.72, stdev= 5.32, samples=259 write: IOPS=11, BW=46.8KiB/s (47.9kB/s)(6236KiB/133227msec); 0 zone resets clat (usec): min=797, max=576887, avg=45168.22, stdev=55044.04 lat (usec): min=798, max=576888, avg=45177.37, stdev=55043.37 clat percentiles (usec): | 1.00th=[ 1057], 5.00th=[ 1156], 10.00th=[ 1303], 20.00th=[ 3884], | 30.00th=[ 9110], 40.00th=[ 18220], 50.00th=[ 31589], 60.00th=[ 42730], | 70.00th=[ 55313], 80.00th=[ 72877], 90.00th=[107480], 95.00th=[139461], | 99.00th=[240124], 99.50th=[329253], 99.90th=[566232], 99.95th=[574620], | 99.99th=[574620] bw ( KiB/s): min= 7, max= 108, per=24.53%, avg=46.12, stdev=21.49, samples=263 iops : min= 1, max= 27, avg=10.88, stdev= 5.40, samples=263 lat (usec) : 50=0.68%, 100=4.62%, 250=0.23%, 500=0.07%, 750=0.20% lat (usec) : 1000=0.29% lat (msec) : 2=6.74%, 4=3.39%, 10=5.99%, 20=10.74%, 50=35.16% lat (msec) : 100=23.63%, 250=7.71%, 500=0.46%, 750=0.10% cpu : usr=0.07%, sys=4.94%, ctx=6279, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=180KiB/s (184kB/s), 44.6KiB/s-45.4KiB/s (45.7kB/s-46.5kB/s), io=23.4MiB (24.6MB), run=133140-133687msec WRITE: bw=188KiB/s (193kB/s), 46.8KiB/s-47.7KiB/s (47.9kB/s-48.8kB/s), io=24.6MiB (25.7MB), run=133140-133687msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144332: Sat Sep 5 01:29:38 2026 read: IOPS=5, BW=20.8KiB/s (21.3kB/s)(5992KiB/288166msec) clat (msec): min=5, max=1182, avg=34.25, stdev=49.83 lat (msec): min=5, max=1182, avg=34.26, stdev=49.83 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 13], | 30.00th=[ 16], 40.00th=[ 18], 50.00th=[ 21], 60.00th=[ 25], | 70.00th=[ 31], 80.00th=[ 43], 90.00th=[ 71], 95.00th=[ 102], | 99.00th=[ 201], 99.50th=[ 288], 99.90th=[ 567], 99.95th=[ 1183], | 99.99th=[ 1183] bw ( KiB/s): min= 7, max= 103, per=29.26%, avg=23.99, stdev=17.12, samples=483 iops : min= 1, max= 25, avg= 5.40, stdev= 4.33, samples=483 write: IOPS=5, BW=21.8KiB/s (22.4kB/s)(6296KiB/288166msec); 0 zone resets clat (msec): min=34, max=659, avg=150.40, stdev=79.29 lat (msec): min=34, max=659, avg=150.40, stdev=79.29 clat percentiles (msec): | 1.00th=[ 51], 5.00th=[ 64], 10.00th=[ 74], 20.00th=[ 89], | 30.00th=[ 103], 40.00th=[ 116], 50.00th=[ 130], 60.00th=[ 150], | 70.00th=[ 169], 80.00th=[ 197], 90.00th=[ 259], 95.00th=[ 309], | 99.00th=[ 426], 99.50th=[ 502], 99.90th=[ 634], 99.95th=[ 659], | 99.99th=[ 659] bw ( KiB/s): min= 7, max= 55, per=25.23%, avg=21.70, stdev=10.52, samples=559 iops : min= 1, max= 13, avg= 4.82, stdev= 2.72, samples=559 lat (msec) : 10=4.33%, 20=18.98%, 50=18.16%, 100=19.17%, 250=33.40% lat (msec) : 500=5.63%, 750=0.29%, 2000=0.03% cpu : usr=0.04%, sys=0.98%, ctx=5179, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144333: Sat Sep 5 01:29:38 2026 read: IOPS=5, BW=20.5KiB/s (21.0kB/s)(5940KiB/289504msec) clat (msec): min=4, max=668, avg=34.24, stdev=42.89 lat (msec): min=4, max=668, avg=34.24, stdev=42.89 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 10], 10.00th=[ 11], 20.00th=[ 14], | 30.00th=[ 16], 40.00th=[ 19], 50.00th=[ 22], 60.00th=[ 26], | 70.00th=[ 32], 80.00th=[ 42], 90.00th=[ 74], 95.00th=[ 105], | 99.00th=[ 178], 99.50th=[ 213], 99.90th=[ 584], 99.95th=[ 667], | 99.99th=[ 667] bw ( KiB/s): min= 7, max= 102, per=29.31%, avg=24.04, stdev=16.74, samples=477 iops : min= 1, max= 25, avg= 5.42, stdev= 4.23, samples=477 write: IOPS=5, BW=21.9KiB/s (22.5kB/s)(6348KiB/289504msec); 0 zone resets clat (msec): min=34, max=834, avg=150.30, stdev=79.01 lat (msec): min=34, max=834, avg=150.31, stdev=79.01 clat percentiles (msec): | 1.00th=[ 47], 5.00th=[ 64], 10.00th=[ 73], 20.00th=[ 91], | 30.00th=[ 105], 40.00th=[ 117], 50.00th=[ 131], 60.00th=[ 146], | 70.00th=[ 169], 80.00th=[ 203], 90.00th=[ 255], 95.00th=[ 300], | 99.00th=[ 422], 99.50th=[ 493], 99.90th=[ 592], 99.95th=[ 835], | 99.99th=[ 835] bw ( KiB/s): min= 7, max= 64, per=25.20%, avg=21.68, stdev=10.50, samples=562 iops : min= 1, max= 16, avg= 4.81, stdev= 2.71, samples=562 lat (msec) : 10=3.78%, 20=18.55%, 50=18.59%, 100=19.01%, 250=34.57% lat (msec) : 500=5.24%, 750=0.23%, 1000=0.03% cpu : usr=0.04%, sys=1.00%, ctx=5115, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144334: Sat Sep 5 01:29:38 2026 read: IOPS=5, BW=20.9KiB/s (21.4kB/s)(6028KiB/288532msec) clat (msec): min=5, max=664, avg=35.76, stdev=41.42 lat (msec): min=5, max=664, avg=35.76, stdev=41.43 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 13], | 30.00th=[ 16], 40.00th=[ 18], 50.00th=[ 21], 60.00th=[ 27], | 70.00th=[ 33], 80.00th=[ 48], 90.00th=[ 82], 95.00th=[ 115], | 99.00th=[ 190], 99.50th=[ 230], 99.90th=[ 355], 99.95th=[ 667], | 99.99th=[ 667] bw ( KiB/s): min= 7, max= 104, per=28.66%, avg=23.50, stdev=17.05, samples=495 iops : min= 1, max= 26, avg= 5.27, stdev= 4.32, samples=495 write: IOPS=5, BW=21.7KiB/s (22.2kB/s)(6260KiB/288532msec); 0 zone resets clat (msec): min=37, max=688, avg=149.84, stdev=79.92 lat (msec): min=37, max=688, avg=149.84, stdev=79.92 clat percentiles (msec): | 1.00th=[ 49], 5.00th=[ 66], 10.00th=[ 75], 20.00th=[ 91], | 30.00th=[ 104], 40.00th=[ 114], 50.00th=[ 129], 60.00th=[ 146], | 70.00th=[ 167], 80.00th=[ 199], 90.00th=[ 251], 95.00th=[ 300], | 99.00th=[ 460], 99.50th=[ 531], 99.90th=[ 625], 99.95th=[ 693], | 99.99th=[ 693] bw ( KiB/s): min= 7, max= 56, per=25.09%, avg=21.58, stdev=10.68, samples=558 iops : min= 1, max= 14, avg= 4.79, stdev= 2.76, samples=558 lat (msec) : 10=4.33%, 20=18.42%, 50=17.55%, 100=19.60%, 250=34.80% lat (msec) : 500=4.98%, 750=0.33% cpu : usr=0.04%, sys=0.96%, ctx=5080, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144335: Sat Sep 5 01:29:38 2026 read: IOPS=5, BW=20.0KiB/s (21.5kB/s)(6052KiB/288393msec) clat (msec): min=5, max=430, avg=33.94, stdev=38.49 lat (msec): min=5, max=430, avg=33.94, stdev=38.49 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 13], | 30.00th=[ 16], 40.00th=[ 19], 50.00th=[ 22], 60.00th=[ 25], | 70.00th=[ 31], 80.00th=[ 43], 90.00th=[ 80], 95.00th=[ 106], | 99.00th=[ 180], 99.50th=[ 284], 99.90th=[ 388], 99.95th=[ 430], | 99.99th=[ 430] bw ( KiB/s): min= 7, max= 111, per=29.80%, avg=24.43, stdev=17.45, samples=479 iops : min= 1, max= 27, avg= 5.51, stdev= 4.42, samples=479 write: IOPS=5, BW=21.6KiB/s (22.1kB/s)(6236KiB/288393msec); 0 zone resets clat (msec): min=31, max=690, avg=151.96, stdev=78.91 lat (msec): min=31, max=690, avg=151.96, stdev=78.91 clat percentiles (msec): | 1.00th=[ 52], 5.00th=[ 66], 10.00th=[ 75], 20.00th=[ 91], | 30.00th=[ 107], 40.00th=[ 120], 50.00th=[ 134], 60.00th=[ 150], | 70.00th=[ 167], 80.00th=[ 199], 90.00th=[ 255], 95.00th=[ 309], | 99.00th=[ 456], 99.50th=[ 485], 99.90th=[ 676], 99.95th=[ 693], | 99.99th=[ 693] bw ( KiB/s): min= 7, max= 56, per=24.86%, avg=21.38, stdev=10.13, samples=561 iops : min= 1, max= 14, avg= 4.74, stdev= 2.63, samples=561 lat (msec) : 10=4.39%, 20=18.62%, 50=18.36%, 100=18.07%, 250=34.96% lat (msec) : 500=5.40%, 750=0.20% cpu : usr=0.04%, sys=0.97%, ctx=5079, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=82.9KiB/s (84.9kB/s), 20.5KiB/s-20.0KiB/s (21.0kB/s-21.5kB/s), io=23.4MiB (24.6MB), run=288166-289504msec WRITE: bw=86.8KiB/s (88.9kB/s), 21.6KiB/s-21.9KiB/s (22.1kB/s-22.5kB/s), io=24.6MiB (25.7MB), run=288166-289504msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144388: Sat Sep 5 01:30:10 2026 read: IOPS=16, BW=258KiB/s (265kB/s)(5920KiB/22919msec) clat (usec): min=33, max=168805, avg=31994.18, stdev=28182.83 lat (usec): min=33, max=168806, avg=31995.32, stdev=28182.81 clat percentiles (usec): | 1.00th=[ 42], 5.00th=[ 55], 10.00th=[ 59], 20.00th=[ 67], | 30.00th=[ 16450], 40.00th=[ 23725], 50.00th=[ 30278], 60.00th=[ 35914], | 70.00th=[ 44303], 80.00th=[ 52691], 90.00th=[ 65799], 95.00th=[ 74974], | 99.00th=[133694], 99.50th=[156238], 99.90th=[168821], 99.95th=[168821], | 99.99th=[168821] bw ( KiB/s): min= 94, max= 508, per=25.74%, avg=258.20, stdev=92.29, samples=45 iops : min= 5, max= 31, avg=15.47, stdev= 5.79, samples=45 write: IOPS=17, BW=278KiB/s (285kB/s)(6368KiB/22919msec); 0 zone resets clat (usec): min=1230, max=162346, avg=27398.23, stdev=30711.18 lat (usec): min=1232, max=162349, avg=27400.11, stdev=30711.23 clat percentiles (usec): | 1.00th=[ 1450], 5.00th=[ 1614], 10.00th=[ 1762], 20.00th=[ 3195], | 30.00th=[ 6128], 40.00th=[ 8848], 50.00th=[ 13829], 60.00th=[ 22676], | 70.00th=[ 34866], 80.00th=[ 50594], 90.00th=[ 73925], 95.00th=[ 86508], | 99.00th=[141558], 99.50th=[160433], 99.90th=[162530], 99.95th=[162530], | 99.99th=[162530] bw ( KiB/s): min= 126, max= 632, per=26.30%, avg=277.42, stdev=106.22, samples=45 iops : min= 7, max= 39, avg=16.67, stdev= 6.66, samples=45 lat (usec) : 50=1.30%, 100=10.55%, 250=0.78%, 500=0.13% lat (msec) : 2=6.77%, 4=5.21%, 10=10.16%, 20=10.42%, 50=33.07% lat (msec) : 100=19.01%, 250=2.60% cpu : usr=0.10%, sys=6.67%, ctx=1365, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144389: Sat Sep 5 01:30:10 2026 read: IOPS=15, BW=248KiB/s (254kB/s)(5744KiB/23134msec) clat (usec): min=38, max=259086, avg=32904.97, stdev=30769.86 lat (usec): min=38, max=259087, avg=32907.61, stdev=30771.76 clat percentiles (usec): | 1.00th=[ 41], 5.00th=[ 53], 10.00th=[ 59], 20.00th=[ 79], | 30.00th=[ 18744], 40.00th=[ 24249], 50.00th=[ 28967], 60.00th=[ 34341], | 70.00th=[ 43779], 80.00th=[ 53216], 90.00th=[ 67634], 95.00th=[ 80217], | 99.00th=[121111], 99.50th=[256902], 99.90th=[258999], 99.95th=[258999], | 99.99th=[258999] bw ( KiB/s): min= 63, max= 416, per=24.75%, avg=248.24, stdev=93.15, samples=45 iops : min= 3, max= 26, avg=14.84, stdev= 5.88, samples=45 write: IOPS=17, BW=283KiB/s (290kB/s)(6544KiB/23134msec); 0 zone resets clat (usec): min=1178, max=223123, avg=27316.82, stdev=31614.15 lat (usec): min=1180, max=223125, avg=27319.04, stdev=31614.30 clat percentiles (usec): | 1.00th=[ 1467], 5.00th=[ 1598], 10.00th=[ 1827], 20.00th=[ 3294], | 30.00th=[ 5407], 40.00th=[ 9372], 50.00th=[ 14877], 60.00th=[ 23200], | 70.00th=[ 33817], 80.00th=[ 50070], 90.00th=[ 71828], 95.00th=[ 85459], | 99.00th=[132645], 99.50th=[170918], 99.90th=[223347], 99.95th=[223347], | 99.99th=[223347] bw ( KiB/s): min= 63, max= 479, per=26.87%, avg=283.51, stdev=105.21, samples=45 iops : min= 3, max= 29, avg=17.04, stdev= 6.65, samples=45 lat (usec) : 50=1.82%, 100=8.20%, 250=0.91%, 750=0.13% lat (msec) : 2=6.38%, 4=5.99%, 10=10.55%, 20=10.68%, 50=33.46% lat (msec) : 100=19.53%, 250=2.08%, 500=0.26% cpu : usr=0.10%, sys=6.56%, ctx=1332, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144390: Sat Sep 5 01:30:10 2026 read: IOPS=16, BW=262KiB/s (268kB/s)(6256KiB/23872msec) clat (usec): min=25, max=161742, avg=29683.03, stdev=25545.50 lat (usec): min=25, max=161743, avg=29684.26, stdev=25545.54 clat percentiles (usec): | 1.00th=[ 37], 5.00th=[ 50], 10.00th=[ 58], 20.00th=[ 73], | 30.00th=[ 15533], 40.00th=[ 22676], 50.00th=[ 27395], 60.00th=[ 33817], | 70.00th=[ 42206], 80.00th=[ 49546], 90.00th=[ 60556], 95.00th=[ 71828], | 99.00th=[112722], 99.50th=[147850], 99.90th=[162530], 99.95th=[162530], | 99.99th=[162530] bw ( KiB/s): min= 124, max= 557, per=26.13%, avg=262.13, stdev=93.17, samples=46 iops : min= 7, max= 34, avg=15.70, stdev= 5.82, samples=46 write: IOPS=15, BW=253KiB/s (259kB/s)(6032KiB/23872msec); 0 zone resets clat (usec): min=1124, max=295869, avg=32046.61, stdev=35644.57 lat (usec): min=1126, max=295872, avg=32048.64, stdev=35644.54 clat percentiles (usec): | 1.00th=[ 1401], 5.00th=[ 1680], 10.00th=[ 2057], 20.00th=[ 3884], | 30.00th=[ 6915], 40.00th=[ 11469], 50.00th=[ 19792], 60.00th=[ 30278], | 70.00th=[ 41157], 80.00th=[ 58459], 90.00th=[ 78119], 95.00th=[ 91751], | 99.00th=[158335], 99.50th=[212861], 99.90th=[295699], 99.95th=[295699], | 99.99th=[295699] bw ( KiB/s): min= 95, max= 447, per=23.66%, avg=249.61, stdev=87.78, samples=46 iops : min= 5, max= 27, avg=14.91, stdev= 5.51, samples=46 lat (usec) : 50=2.60%, 100=9.90%, 250=0.13%, 500=0.52%, 750=0.13% lat (msec) : 2=4.82%, 4=5.47%, 10=8.85%, 20=10.16%, 50=35.94% lat (msec) : 100=19.14%, 250=2.21%, 500=0.13% cpu : usr=0.09%, sys=6.54%, ctx=1375, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144391: Sat Sep 5 01:30:10 2026 read: IOPS=16, BW=269KiB/s (276kB/s)(6032KiB/22400msec) clat (usec): min=28, max=142011, avg=29001.28, stdev=25836.90 lat (usec): min=28, max=142012, avg=29002.57, stdev=25836.89 clat percentiles (usec): | 1.00th=[ 39], 5.00th=[ 53], 10.00th=[ 59], 20.00th=[ 68], | 30.00th=[ 13304], 40.00th=[ 22152], 50.00th=[ 27395], 60.00th=[ 32637], | 70.00th=[ 39584], 80.00th=[ 49546], 90.00th=[ 63701], 95.00th=[ 72877], | 99.00th=[116917], 99.50th=[124257], 99.90th=[141558], 99.95th=[141558], | 99.99th=[141558] bw ( KiB/s): min= 31, max= 441, per=26.85%, avg=269.27, stdev=90.84, samples=44 iops : min= 1, max= 27, avg=16.16, stdev= 5.83, samples=44 write: IOPS=17, BW=279KiB/s (286kB/s)(6256KiB/22400msec); 0 zone resets clat (usec): min=1245, max=206792, avg=29100.64, stdev=33314.82 lat (usec): min=1246, max=206795, avg=29135.04, stdev=33302.97 clat percentiles (usec): | 1.00th=[ 1418], 5.00th=[ 1631], 10.00th=[ 1876], 20.00th=[ 3982], | 30.00th=[ 6456], 40.00th=[ 11076], 50.00th=[ 16319], 60.00th=[ 25822], | 70.00th=[ 35914], 80.00th=[ 50594], 90.00th=[ 68682], 95.00th=[ 92799], | 99.00th=[173016], 99.50th=[183501], 99.90th=[206570], 99.95th=[206570], | 99.99th=[206570] bw ( KiB/s): min= 126, max= 475, per=26.49%, avg=279.50, stdev=84.29, samples=44 iops : min= 7, max= 29, avg=16.82, stdev= 5.30, samples=44 lat (usec) : 50=1.69%, 100=11.46%, 250=0.39%, 500=0.13%, 750=0.13% lat (usec) : 1000=0.26% lat (msec) : 2=5.73%, 4=5.08%, 10=8.85%, 20=12.11%, 50=34.11% lat (msec) : 100=17.19%, 250=2.86% cpu : usr=0.12%, sys=6.37%, ctx=1302, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1003KiB/s (1027kB/s), 248KiB/s-269KiB/s (254kB/s-276kB/s), io=23.4MiB (24.5MB), run=22400-23872msec WRITE: bw=1056KiB/s (1081kB/s), 253KiB/s-283KiB/s (259kB/s-290kB/s), io=24.6MiB (25.8MB), run=22400-23872msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144393: Sat Sep 5 01:30:53 2026 read: IOPS=5, BW=89.0KiB/s (92.1kB/s)(5920KiB/65799msec) clat (msec): min=6, max=178, avg=31.68, stdev=28.81 lat (msec): min=6, max=178, avg=31.68, stdev=28.81 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 10], 10.00th=[ 11], 20.00th=[ 14], | 30.00th=[ 16], 40.00th=[ 19], 50.00th=[ 22], 60.00th=[ 27], | 70.00th=[ 33], 80.00th=[ 42], 90.00th=[ 65], 95.00th=[ 96], | 99.00th=[ 159], 99.50th=[ 178], 99.90th=[ 180], 99.95th=[ 180], | 99.99th=[ 180] bw ( KiB/s): min= 29, max= 479, per=28.12%, avg=102.09, stdev=68.86, samples=114 iops : min= 1, max= 29, avg= 5.69, stdev= 4.29, samples=114 write: IOPS=6, BW=96.8KiB/s (99.1kB/s)(6368KiB/65799msec); 0 zone resets clat (msec): min=43, max=373, avg=135.67, stdev=56.10 lat (msec): min=43, max=373, avg=135.67, stdev=56.10 clat percentiles (msec): | 1.00th=[ 52], 5.00th=[ 66], 10.00th=[ 77], 20.00th=[ 87], | 30.00th=[ 101], 40.00th=[ 111], 50.00th=[ 127], 60.00th=[ 140], | 70.00th=[ 157], 80.00th=[ 180], 90.00th=[ 215], 95.00th=[ 241], | 99.00th=[ 330], 99.50th=[ 347], 99.90th=[ 372], 99.95th=[ 372], | 99.99th=[ 372] bw ( KiB/s): min= 29, max= 192, per=25.22%, avg=96.34, stdev=37.71, samples=130 iops : min= 1, max= 12, avg= 5.32, stdev= 2.44, samples=130 lat (msec) : 10=2.47%, 20=19.14%, 50=20.18%, 100=19.79%, 250=36.59% lat (msec) : 500=1.82% cpu : usr=0.06%, sys=1.27%, ctx=1333, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144394: Sat Sep 5 01:30:53 2026 read: IOPS=5, BW=87.1KiB/s (89.2kB/s)(5744KiB/65950msec) clat (msec): min=6, max=199, avg=30.77, stdev=26.06 lat (msec): min=6, max=199, avg=30.77, stdev=26.06 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 15], | 30.00th=[ 17], 40.00th=[ 20], 50.00th=[ 23], 60.00th=[ 27], | 70.00th=[ 32], 80.00th=[ 40], 90.00th=[ 63], 95.00th=[ 91], | 99.00th=[ 134], 99.50th=[ 165], 99.90th=[ 199], 99.95th=[ 199], | 99.99th=[ 199] bw ( KiB/s): min= 29, max= 256, per=26.44%, avg=95.97, stdev=61.21, samples=117 iops : min= 1, max= 16, avg= 5.32, stdev= 3.88, samples=117 write: IOPS=6, BW=99.2KiB/s (102kB/s)(6544KiB/65950msec); 0 zone resets clat (msec): min=48, max=504, avg=134.12, stdev=57.89 lat (msec): min=48, max=504, avg=134.12, stdev=57.89 clat percentiles (msec): | 1.00th=[ 59], 5.00th=[ 68], 10.00th=[ 81], 20.00th=[ 89], | 30.00th=[ 101], 40.00th=[ 109], 50.00th=[ 120], 60.00th=[ 133], | 70.00th=[ 150], 80.00th=[ 174], 90.00th=[ 213], 95.00th=[ 236], | 99.00th=[ 330], 99.50th=[ 338], 99.90th=[ 506], 99.95th=[ 506], | 99.99th=[ 506] bw ( KiB/s): min= 29, max= 191, per=26.06%, avg=99.55, stdev=39.29, samples=129 iops : min= 1, max= 11, avg= 5.53, stdev= 2.53, samples=129 lat (msec) : 10=2.86%, 20=16.93%, 50=20.44%, 100=21.22%, 250=36.33% lat (msec) : 500=2.08%, 750=0.13% cpu : usr=0.06%, sys=1.18%, ctx=1335, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144395: Sat Sep 5 01:30:53 2026 read: IOPS=6, BW=99.6KiB/s (102kB/s)(6256KiB/62784msec) clat (msec): min=5, max=158, avg=28.71, stdev=23.62 lat (msec): min=5, max=158, avg=28.72, stdev=23.62 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 10], 10.00th=[ 11], 20.00th=[ 14], | 30.00th=[ 16], 40.00th=[ 19], 50.00th=[ 22], 60.00th=[ 25], | 70.00th=[ 30], 80.00th=[ 39], 90.00th=[ 59], 95.00th=[ 79], | 99.00th=[ 138], 99.50th=[ 159], 99.90th=[ 159], 99.95th=[ 159], | 99.99th=[ 159] bw ( KiB/s): min= 30, max= 383, per=29.91%, avg=108.58, stdev=73.05, samples=114 iops : min= 1, max= 23, avg= 6.11, stdev= 4.62, samples=114 write: IOPS=6, BW=96.1KiB/s (98.4kB/s)(6032KiB/62784msec); 0 zone resets clat (msec): min=42, max=493, avg=136.62, stdev=61.89 lat (msec): min=42, max=493, avg=136.63, stdev=61.89 clat percentiles (msec): | 1.00th=[ 58], 5.00th=[ 68], 10.00th=[ 78], 20.00th=[ 87], | 30.00th=[ 102], 40.00th=[ 111], 50.00th=[ 125], 60.00th=[ 136], | 70.00th=[ 150], 80.00th=[ 178], 90.00th=[ 215], 95.00th=[ 249], | 99.00th=[ 401], 99.50th=[ 430], 99.90th=[ 493], 99.95th=[ 493], | 99.99th=[ 493] bw ( KiB/s): min= 31, max= 192, per=25.25%, avg=96.46, stdev=36.91, samples=123 iops : min= 1, max= 12, avg= 5.33, stdev= 2.46, samples=123 lat (msec) : 10=3.39%, 20=19.66%, 50=22.14%, 100=19.14%, 250=33.46% lat (msec) : 500=2.21% cpu : usr=0.05%, sys=1.20%, ctx=1303, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144396: Sat Sep 5 01:30:53 2026 read: IOPS=5, BW=92.2KiB/s (94.5kB/s)(6032KiB/65397msec) clat (msec): min=7, max=380, avg=34.26, stdev=35.65 lat (msec): min=7, max=380, avg=34.26, stdev=35.65 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 15], | 30.00th=[ 17], 40.00th=[ 20], 50.00th=[ 22], 60.00th=[ 27], | 70.00th=[ 33], 80.00th=[ 45], 90.00th=[ 73], 95.00th=[ 113], | 99.00th=[ 155], 99.50th=[ 203], 99.90th=[ 380], 99.95th=[ 380], | 99.99th=[ 380] bw ( KiB/s): min= 29, max= 352, per=27.81%, avg=100.96, stdev=70.93, samples=117 iops : min= 1, max= 22, avg= 5.61, stdev= 4.53, samples=117 write: IOPS=5, BW=95.7KiB/s (97.0kB/s)(6256KiB/65397msec); 0 zone resets clat (msec): min=49, max=315, avg=134.10, stdev=53.17 lat (msec): min=49, max=315, avg=134.10, stdev=53.17 clat percentiles (msec): | 1.00th=[ 52], 5.00th=[ 64], 10.00th=[ 73], 20.00th=[ 88], | 30.00th=[ 101], 40.00th=[ 112], 50.00th=[ 126], 60.00th=[ 142], | 70.00th=[ 157], 80.00th=[ 178], 90.00th=[ 207], 95.00th=[ 232], | 99.00th=[ 296], 99.50th=[ 309], 99.90th=[ 317], 99.95th=[ 317], | 99.99th=[ 317] bw ( KiB/s): min= 31, max= 224, per=25.36%, avg=96.87, stdev=35.49, samples=127 iops : min= 1, max= 14, avg= 5.35, stdev= 2.32, samples=127 lat (msec) : 10=2.73%, 20=18.62%, 50=19.14%, 100=20.96%, 250=36.85% lat (msec) : 500=1.69% cpu : usr=0.04%, sys=1.22%, ctx=1305, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=363KiB/s (372kB/s), 87.1KiB/s-99.6KiB/s (89.2kB/s-102kB/s), io=23.4MiB (24.5MB), run=62784-65950msec WRITE: bw=382KiB/s (391kB/s), 95.7KiB/s-99.2KiB/s (97.0kB/s-102kB/s), io=24.6MiB (25.8MB), run=62784-65950msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144419: Sat Sep 5 01:31:09 2026 read: IOPS=2, BW=2398KiB/s (2456kB/s)(7168KiB/2989msec) clat (usec): min=774, max=321477, avg=129328.12, stdev=135011.37 lat (usec): min=775, max=321478, avg=129329.58, stdev=135011.47 clat percentiles (usec): | 1.00th=[ 775], 5.00th=[ 775], 10.00th=[ 775], 20.00th=[ 906], | 30.00th=[ 2278], 40.00th=[ 2278], 50.00th=[120062], 60.00th=[189793], | 70.00th=[189793], 80.00th=[270533], 90.00th=[320865], 95.00th=[320865], | 99.00th=[320865], 99.50th=[320865], 99.90th=[320865], 99.95th=[320865], | 99.99th=[320865] bw ( KiB/s): min= 1434, max= 4031, per=65.93%, avg=2863.25, stdev=1326.64, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 1.15, samples=4 write: IOPS=1, BW=1713KiB/s (1754kB/s)(5120KiB/2989msec); 0 zone resets clat (msec): min=224, max=434, avg=345.43, stdev=80.08 lat (msec): min=224, max=434, avg=345.51, stdev=80.11 clat percentiles (msec): | 1.00th=[ 224], 5.00th=[ 224], 10.00th=[ 224], 20.00th=[ 224], | 30.00th=[ 326], 40.00th=[ 326], 50.00th=[ 351], 60.00th=[ 351], | 70.00th=[ 397], 80.00th=[ 397], 90.00th=[ 435], 95.00th=[ 435], | 99.00th=[ 435], 99.50th=[ 435], 99.90th=[ 435], 99.95th=[ 435], | 99.99th=[ 435] bw ( KiB/s): min= 1815, max= 4071, per=43.10%, avg=2620.67, stdev=1258.60, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (usec) : 1000=16.67% lat (msec) : 4=8.33%, 250=25.00%, 500=50.00% cpu : usr=0.00%, sys=13.35%, ctx=181, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144420: Sat Sep 5 01:31:09 2026 read: IOPS=0, BW=434KiB/s (445kB/s)(2048KiB/4715msec) clat (msec): min=163, max=227, avg=195.25, stdev=45.35 lat (msec): min=163, max=227, avg=195.25, stdev=45.35 clat percentiles (msec): | 1.00th=[ 163], 5.00th=[ 163], 10.00th=[ 163], 20.00th=[ 163], | 30.00th=[ 163], 40.00th=[ 163], 50.00th=[ 163], 60.00th=[ 228], | 70.00th=[ 228], 80.00th=[ 228], 90.00th=[ 228], 95.00th=[ 228], | 99.00th=[ 228], 99.50th=[ 228], 99.90th=[ 228], 99.95th=[ 228], | 99.99th=[ 228] bw ( KiB/s): min= 1460, max= 2039, per=40.28%, avg=1749.50, stdev=409.41, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2172KiB/s (2224kB/s)(10.0MiB/4715msec); 0 zone resets clat (msec): min=150, max=870, avg=401.45, stdev=232.11 lat (msec): min=150, max=870, avg=401.53, stdev=232.09 clat percentiles (msec): | 1.00th=[ 150], 5.00th=[ 150], 10.00th=[ 150], 20.00th=[ 186], | 30.00th=[ 215], 40.00th=[ 236], 50.00th=[ 342], 60.00th=[ 359], | 70.00th=[ 443], 80.00th=[ 592], 90.00th=[ 625], 95.00th=[ 869], | 99.00th=[ 869], 99.50th=[ 869], 99.90th=[ 869], 99.95th=[ 869], | 99.99th=[ 869] bw ( KiB/s): min= 1815, max= 4071, per=45.72%, avg=2780.00, stdev=1159.16, samples=5 iops : min= 1, max= 3, avg= 1.80, stdev= 1.10, samples=5 lat (msec) : 250=50.00%, 500=25.00%, 750=16.67%, 1000=8.33% cpu : usr=0.00%, sys=12.37%, ctx=213, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144421: Sat Sep 5 01:31:09 2026 read: IOPS=1, BW=1902KiB/s (1947kB/s)(6144KiB/3231msec) clat (msec): min=16, max=416, avg=210.84, stdev=145.88 lat (msec): min=16, max=416, avg=210.84, stdev=145.88 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 17], 10.00th=[ 17], 20.00th=[ 73], | 30.00th=[ 73], 40.00th=[ 218], 50.00th=[ 218], 60.00th=[ 266], | 70.00th=[ 275], 80.00th=[ 275], 90.00th=[ 418], 95.00th=[ 418], | 99.00th=[ 418], 99.50th=[ 418], 99.90th=[ 418], 99.95th=[ 418], | 99.99th=[ 418] bw ( KiB/s): min= 1976, max= 3631, per=55.59%, avg=2414.25, stdev=811.54, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 write: IOPS=1, BW=1902KiB/s (1947kB/s)(6144KiB/3231msec); 0 zone resets clat (msec): min=124, max=580, avg=319.14, stdev=183.53 lat (msec): min=124, max=580, avg=319.24, stdev=183.52 clat percentiles (msec): | 1.00th=[ 125], 5.00th=[ 125], 10.00th=[ 125], 20.00th=[ 131], | 30.00th=[ 131], 40.00th=[ 253], 50.00th=[ 253], 60.00th=[ 368], | 70.00th=[ 460], 80.00th=[ 460], 90.00th=[ 584], 95.00th=[ 584], | 99.00th=[ 584], 99.50th=[ 584], 99.90th=[ 584], 99.95th=[ 584], | 99.99th=[ 584] bw ( KiB/s): min= 1815, max= 2925, per=36.14%, avg=2197.50, stdev=495.07, samples=4 iops : min= 1, max= 2, avg= 1.25, stdev= 0.50, samples=4 lat (msec) : 20=8.33%, 100=8.33%, 250=25.00%, 500=50.00%, 750=8.33% cpu : usr=0.03%, sys=14.37%, ctx=196, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144422: Sat Sep 5 01:31:09 2026 read: IOPS=1, BW=1297KiB/s (1328kB/s)(5120KiB/3948msec) clat (usec): min=521, max=269179, avg=136425.81, stdev=128449.25 lat (usec): min=522, max=269180, avg=136427.12, stdev=128448.85 clat percentiles (usec): | 1.00th=[ 523], 5.00th=[ 523], 10.00th=[ 523], 20.00th=[ 523], | 30.00th=[ 889], 40.00th=[ 889], 50.00th=[175113], 60.00th=[175113], | 70.00th=[235930], 80.00th=[235930], 90.00th=[270533], 95.00th=[270533], | 99.00th=[270533], 99.50th=[270533], 99.90th=[270533], 99.95th=[270533], | 99.99th=[270533] bw ( KiB/s): min= 8159, max= 8159, per=100.00%, avg=8159.00, stdev= 0.00, samples=1 iops : min= 7, max= 7, avg= 7.00, stdev= 0.00, samples=1 write: IOPS=1, BW=1816KiB/s (1859kB/s)(7168KiB/3948msec); 0 zone resets clat (msec): min=145, max=930, avg=434.78, stdev=308.47 lat (msec): min=145, max=930, avg=434.88, stdev=308.49 clat percentiles (msec): | 1.00th=[ 146], 5.00th=[ 146], 10.00th=[ 146], 20.00th=[ 209], | 30.00th=[ 209], 40.00th=[ 209], 50.00th=[ 245], 60.00th=[ 592], | 70.00th=[ 592], 80.00th=[ 718], 90.00th=[ 927], 95.00th=[ 927], | 99.00th=[ 927], 99.50th=[ 927], 99.90th=[ 927], 99.95th=[ 927], | 99.99th=[ 927] bw ( KiB/s): min= 1467, max= 6071, per=44.08%, avg=2680.60, stdev=1908.97, samples=5 iops : min= 1, max= 5, avg= 1.80, stdev= 1.79, samples=5 lat (usec) : 750=8.33%, 1000=8.33% lat (msec) : 250=50.00%, 500=8.33%, 750=16.67%, 1000=8.33% cpu : usr=0.05%, sys=11.50%, ctx=179, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4344KiB/s (4448kB/s), 434KiB/s-2398KiB/s (445kB/s-2456kB/s), io=20.0MiB (20.0MB), run=2989-4715msec WRITE: bw=6081KiB/s (6227kB/s), 1713KiB/s-2172KiB/s (1754kB/s-2224kB/s), io=28.0MiB (29.4MB), run=2989-4715msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144414: Sat Sep 5 01:31:09 2026 read: IOPS=2, BW=2201KiB/s (2254kB/s)(7168KiB/3257msec) clat (msec): min=74, max=391, avg=206.79, stdev=130.47 lat (msec): min=74, max=391, avg=206.79, stdev=130.47 clat percentiles (msec): | 1.00th=[ 74], 5.00th=[ 74], 10.00th=[ 74], 20.00th=[ 88], | 30.00th=[ 130], 40.00th=[ 130], 50.00th=[ 132], 60.00th=[ 317], | 70.00th=[ 317], 80.00th=[ 317], 90.00th=[ 393], 95.00th=[ 393], | 99.00th=[ 393], 99.50th=[ 393], 99.90th=[ 393], 99.95th=[ 393], | 99.99th=[ 393] bw ( KiB/s): min= 2027, max= 4173, per=59.96%, avg=2569.50, stdev=1069.02, samples=4 iops : min= 1, max= 4, avg= 1.75, stdev= 1.50, samples=4 write: IOPS=1, BW=1572KiB/s (1610kB/s)(5120KiB/3257msec); 0 zone resets clat (msec): min=259, max=498, avg=348.58, stdev=93.84 lat (msec): min=259, max=499, avg=348.67, stdev=93.82 clat percentiles (msec): | 1.00th=[ 259], 5.00th=[ 259], 10.00th=[ 259], 20.00th=[ 259], | 30.00th=[ 288], 40.00th=[ 288], 50.00th=[ 330], 60.00th=[ 330], | 70.00th=[ 368], 80.00th=[ 368], 90.00th=[ 498], 95.00th=[ 498], | 99.00th=[ 498], 99.50th=[ 498], 99.90th=[ 498], 99.95th=[ 498], | 99.99th=[ 498] bw ( KiB/s): min= 1391, max= 4063, per=41.57%, avg=2493.67, stdev=1395.79, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (msec) : 100=16.67%, 250=16.67%, 500=66.67% cpu : usr=0.00%, sys=4.05%, ctx=60, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144415: Sat Sep 5 01:31:09 2026 read: IOPS=0, BW=429KiB/s (439kB/s)(2048KiB/4779msec) clat (msec): min=85, max=390, avg=238.30, stdev=215.66 lat (msec): min=85, max=390, avg=238.30, stdev=215.66 clat percentiles (msec): | 1.00th=[ 86], 5.00th=[ 86], 10.00th=[ 86], 20.00th=[ 86], | 30.00th=[ 86], 40.00th=[ 86], 50.00th=[ 86], 60.00th=[ 393], | 70.00th=[ 393], 80.00th=[ 393], 90.00th=[ 393], 95.00th=[ 393], | 99.00th=[ 393], 99.50th=[ 393], 99.90th=[ 393], 99.95th=[ 393], | 99.99th=[ 393] bw ( KiB/s): min= 1395, max= 2007, per=39.70%, avg=1701.00, stdev=432.75, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2143KiB/s (2194kB/s)(10.0MiB/4779msec); 0 zone resets clat (msec): min=155, max=732, avg=413.87, stdev=229.57 lat (msec): min=155, max=732, avg=414.01, stdev=229.63 clat percentiles (msec): | 1.00th=[ 157], 5.00th=[ 157], 10.00th=[ 157], 20.00th=[ 188], | 30.00th=[ 224], 40.00th=[ 236], 50.00th=[ 243], 60.00th=[ 443], | 70.00th=[ 592], 80.00th=[ 642], 90.00th=[ 684], 95.00th=[ 735], | 99.00th=[ 735], 99.50th=[ 735], 99.90th=[ 735], 99.95th=[ 735], | 99.99th=[ 735] bw ( KiB/s): min= 1395, max= 4079, per=36.76%, avg=2205.50, stdev=788.85, samples=8 iops : min= 1, max= 3, avg= 1.25, stdev= 0.71, samples=8 lat (msec) : 100=8.33%, 250=41.67%, 500=16.67%, 750=33.33% cpu : usr=0.04%, sys=4.71%, ctx=108, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144416: Sat Sep 5 01:31:09 2026 read: IOPS=1, BW=1299KiB/s (1330kB/s)(6144KiB/4729msec) clat (msec): min=61, max=428, avg=230.87, stdev=147.33 lat (msec): min=61, max=428, avg=230.87, stdev=147.33 clat percentiles (msec): | 1.00th=[ 62], 5.00th=[ 62], 10.00th=[ 62], 20.00th=[ 138], | 30.00th=[ 138], 40.00th=[ 165], 50.00th=[ 165], 60.00th=[ 201], | 70.00th=[ 393], 80.00th=[ 393], 90.00th=[ 430], 95.00th=[ 430], | 99.00th=[ 430], 99.50th=[ 430], 99.90th=[ 430], 99.95th=[ 430], | 99.99th=[ 430] bw ( KiB/s): min= 2027, max= 4055, per=63.11%, avg=2704.33, stdev=1169.71, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 write: IOPS=1, BW=1299KiB/s (1330kB/s)(6144KiB/4729msec); 0 zone resets clat (msec): min=233, max=965, avg=468.56, stdev=263.30 lat (msec): min=233, max=965, avg=468.66, stdev=263.28 clat percentiles (msec): | 1.00th=[ 234], 5.00th=[ 234], 10.00th=[ 234], 20.00th=[ 317], | 30.00th=[ 317], 40.00th=[ 363], 50.00th=[ 363], 60.00th=[ 401], | 70.00th=[ 535], 80.00th=[ 535], 90.00th=[ 969], 95.00th=[ 969], | 99.00th=[ 969], 99.50th=[ 969], 99.90th=[ 969], 99.95th=[ 969], | 99.99th=[ 969] bw ( KiB/s): min= 2007, max= 4087, per=42.32%, avg=2539.00, stdev=1032.07, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (msec) : 100=8.33%, 250=33.33%, 500=41.67%, 750=8.33%, 1000=8.33% cpu : usr=0.02%, sys=4.34%, ctx=78, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144418: Sat Sep 5 01:31:09 2026 read: IOPS=1, BW=1397KiB/s (1431kB/s)(5120KiB/3664msec) clat (msec): min=79, max=699, avg=248.29, stdev=254.97 lat (msec): min=79, max=699, avg=248.29, stdev=254.97 clat percentiles (msec): | 1.00th=[ 81], 5.00th=[ 81], 10.00th=[ 81], 20.00th=[ 81], | 30.00th=[ 131], 40.00th=[ 131], 50.00th=[ 157], 60.00th=[ 157], | 70.00th=[ 176], 80.00th=[ 176], 90.00th=[ 701], 95.00th=[ 701], | 99.00th=[ 701], 99.50th=[ 701], 99.90th=[ 701], 99.95th=[ 701], | 99.99th=[ 701] bw ( KiB/s): min= 2007, max= 4063, per=62.99%, avg=2699.00, stdev=1181.30, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 write: IOPS=1, BW=1956KiB/s (2003kB/s)(7168KiB/3664msec); 0 zone resets clat (msec): min=211, max=652, avg=322.94, stdev=158.54 lat (msec): min=211, max=652, avg=323.02, stdev=158.54 clat percentiles (msec): | 1.00th=[ 211], 5.00th=[ 211], 10.00th=[ 211], 20.00th=[ 215], | 30.00th=[ 230], 40.00th=[ 230], 50.00th=[ 253], 60.00th=[ 313], | 70.00th=[ 313], 80.00th=[ 388], 90.00th=[ 651], 95.00th=[ 651], | 99.00th=[ 651], 99.50th=[ 651], 99.90th=[ 651], 99.95th=[ 651], | 99.99th=[ 651] bw ( KiB/s): min= 2007, max= 3011, per=37.91%, avg=2274.00, stdev=491.58, samples=4 iops : min= 1, max= 2, avg= 1.25, stdev= 0.50, samples=4 lat (msec) : 100=8.33%, 250=50.00%, 500=25.00%, 750=16.67% cpu : usr=0.03%, sys=3.77%, ctx=63, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4285KiB/s (4388kB/s), 429KiB/s-2201KiB/s (439kB/s-2254kB/s), io=20.0MiB (20.0MB), run=3257-4779msec WRITE: bw=6000KiB/s (6144kB/s), 1299KiB/s-2143KiB/s (1330kB/s-2194kB/s), io=28.0MiB (29.4MB), run=3257-4779msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144430: Sat Sep 5 01:31:21 2026 read: IOPS=1, BW=5146KiB/s (5269kB/s)(12.0MiB/2388msec) clat (msec): min=693, max=793, avg=743.26, stdev=49.65 lat (msec): min=693, max=793, avg=743.26, stdev=49.65 clat percentiles (msec): | 1.00th=[ 693], 5.00th=[ 693], 10.00th=[ 693], 20.00th=[ 693], | 30.00th=[ 693], 40.00th=[ 743], 50.00th=[ 743], 60.00th=[ 743], | 70.00th=[ 793], 80.00th=[ 793], 90.00th=[ 793], 95.00th=[ 793], | 99.00th=[ 793], 99.50th=[ 793], 99.90th=[ 793], 99.95th=[ 793], | 99.99th=[ 793] bw ( KiB/s): min= 7953, max= 8062, per=100.00%, avg=8007.50, stdev=77.07, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=66.67%, 1000=33.33% cpu : usr=0.00%, sys=12.74%, ctx=223, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144431: Sat Sep 5 01:31:21 2026 read: IOPS=0, BW=1546KiB/s (1583kB/s)(4096KiB/2650msec) clat (nsec): min=740446k, max=740446k, avg=740446412.00, stdev= 0.00 lat (nsec): min=740448k, max=740448k, avg=740447800.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 743], 5.00th=[ 743], 10.00th=[ 743], 20.00th=[ 743], | 30.00th=[ 743], 40.00th=[ 743], 50.00th=[ 743], 60.00th=[ 743], | 70.00th=[ 743], 80.00th=[ 743], 90.00th=[ 743], 95.00th=[ 743], | 99.00th=[ 743], 99.50th=[ 743], 99.90th=[ 743], 99.95th=[ 743], | 99.99th=[ 743] bw ( KiB/s): min= 7953, max= 7953, per=100.00%, avg=7953.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=3091KiB/s (3166kB/s)(8192KiB/2650msec); 0 zone resets clat (msec): min=457, max=1341, avg=899.80, stdev=625.09 lat (msec): min=458, max=1342, avg=900.22, stdev=625.10 clat percentiles (msec): | 1.00th=[ 460], 5.00th=[ 460], 10.00th=[ 460], 20.00th=[ 460], | 30.00th=[ 460], 40.00th=[ 460], 50.00th=[ 460], 60.00th=[ 1334], | 70.00th=[ 1334], 80.00th=[ 1334], 90.00th=[ 1334], 95.00th=[ 1334], | 99.00th=[ 1334], 99.50th=[ 1334], 99.90th=[ 1334], 99.95th=[ 1334], | 99.99th=[ 1334] bw ( KiB/s): min= 8062, max= 8062, per=65.20%, avg=8062.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.00%, sys=3.40%, ctx=73, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144433: Sat Sep 5 01:31:21 2026 write: IOPS=1, BW=4639KiB/s (4750kB/s)(12.0MiB/2649msec); 0 zone resets clat (msec): min=333, max=1344, avg=866.48, stdev=508.07 lat (msec): min=333, max=1345, avg=867.00, stdev=508.11 clat percentiles (msec): | 1.00th=[ 334], 5.00th=[ 334], 10.00th=[ 334], 20.00th=[ 334], | 30.00th=[ 334], 40.00th=[ 919], 50.00th=[ 919], 60.00th=[ 919], | 70.00th=[ 1351], 80.00th=[ 1351], 90.00th=[ 1351], 95.00th=[ 1351], | 99.00th=[ 1351], 99.50th=[ 1351], 99.90th=[ 1351], 99.95th=[ 1351], | 99.99th=[ 1351] bw ( KiB/s): min= 7937, max= 7937, per=64.19%, avg=7937.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=5.44%, ctx=54, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144435: Sat Sep 5 01:31:21 2026 write: IOPS=1, BW=5846KiB/s (5986kB/s)(12.0MiB/2102msec); 0 zone resets clat (msec): min=398, max=1184, avg=673.19, stdev=443.20 lat (msec): min=398, max=1184, avg=673.71, stdev=443.07 clat percentiles (msec): | 1.00th=[ 397], 5.00th=[ 397], 10.00th=[ 397], 20.00th=[ 397], | 30.00th=[ 397], 40.00th=[ 439], 50.00th=[ 439], 60.00th=[ 439], | 70.00th=[ 1183], 80.00th=[ 1183], 90.00th=[ 1183], 95.00th=[ 1183], | 99.00th=[ 1183], 99.50th=[ 1183], 99.90th=[ 1183], 99.95th=[ 1183], | 99.99th=[ 1183] bw ( KiB/s): min= 5595, max= 7937, per=54.72%, avg=6766.00, stdev=1656.04, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=66.67%, 2000=33.33% cpu : usr=0.00%, sys=4.85%, ctx=49, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=6183KiB/s (6331kB/s), 1546KiB/s-5146KiB/s (1583kB/s-5269kB/s), io=16.0MiB (16.8MB), run=2388-2650msec WRITE: bw=12.1MiB/s (12.7MB/s), 3091KiB/s-5846KiB/s (3166kB/s-5986kB/s), io=32.0MiB (33.6MB), run=2102-2650msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144432: Sat Sep 5 01:31:22 2026 read: IOPS=0, BW=3736KiB/s (3826kB/s)(12.0MiB/3289msec) clat (msec): min=162, max=1558, avg=1042.98, stdev=766.19 lat (msec): min=162, max=1558, avg=1042.99, stdev=766.19 clat percentiles (msec): | 1.00th=[ 163], 5.00th=[ 163], 10.00th=[ 163], 20.00th=[ 163], | 30.00th=[ 163], 40.00th=[ 1401], 50.00th=[ 1401], 60.00th=[ 1401], | 70.00th=[ 1552], 80.00th=[ 1552], 90.00th=[ 1552], 95.00th=[ 1552], | 99.00th=[ 1552], 99.50th=[ 1552], 99.90th=[ 1552], 99.95th=[ 1552], | 99.99th=[ 1552] bw ( KiB/s): min= 7801, max= 8159, per=100.00%, avg=7980.00, stdev=253.14, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 250=33.33%, 2000=66.67% cpu : usr=0.00%, sys=2.71%, ctx=39, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144434: Sat Sep 5 01:31:22 2026 read: IOPS=0, BW=1400KiB/s (1434kB/s)(4096KiB/2925msec) clat (nsec): min=990073k, max=990073k, avg=990072755.00, stdev= 0.00 lat (nsec): min=990076k, max=990076k, avg=990075792.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 995], 5.00th=[ 995], 10.00th=[ 995], 20.00th=[ 995], | 30.00th=[ 995], 40.00th=[ 995], 50.00th=[ 995], 60.00th=[ 995], | 70.00th=[ 995], 80.00th=[ 995], 90.00th=[ 995], 95.00th=[ 995], | 99.00th=[ 995], 99.50th=[ 995], 99.90th=[ 995], 99.95th=[ 995], | 99.99th=[ 995] bw ( KiB/s): min= 8143, max= 8143, per=100.00%, avg=8143.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2801KiB/s (2868kB/s)(8192KiB/2925msec); 0 zone resets clat (msec): min=353, max=1517, avg=935.75, stdev=823.18 lat (msec): min=354, max=1518, avg=936.22, stdev=823.23 clat percentiles (msec): | 1.00th=[ 355], 5.00th=[ 355], 10.00th=[ 355], 20.00th=[ 355], | 30.00th=[ 355], 40.00th=[ 355], 50.00th=[ 355], 60.00th=[ 1519], | 70.00th=[ 1519], 80.00th=[ 1519], 90.00th=[ 1519], 95.00th=[ 1519], | 99.00th=[ 1519], 99.50th=[ 1519], 99.90th=[ 1519], 99.95th=[ 1519], | 99.99th=[ 1519] bw ( KiB/s): min= 8159, max= 8159, per=75.92%, avg=8159.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=3.15%, ctx=43, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144436: Sat Sep 5 01:31:22 2026 write: IOPS=0, BW=4030KiB/s (4127kB/s)(12.0MiB/3049msec); 0 zone resets clat (msec): min=273, max=1293, avg=950.64, stdev=586.05 lat (msec): min=274, max=1294, avg=951.11, stdev=586.06 clat percentiles (msec): | 1.00th=[ 275], 5.00th=[ 275], 10.00th=[ 275], 20.00th=[ 275], | 30.00th=[ 275], 40.00th=[ 1284], 50.00th=[ 1284], 60.00th=[ 1284], | 70.00th=[ 1301], 80.00th=[ 1301], 90.00th=[ 1301], 95.00th=[ 1301], | 99.00th=[ 1301], 99.50th=[ 1301], 99.90th=[ 1301], 99.95th=[ 1301], | 99.99th=[ 1301] bw ( KiB/s): min= 8159, max= 8159, per=75.92%, avg=8159.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.03%, sys=3.18%, ctx=37, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144437: Sat Sep 5 01:31:22 2026 write: IOPS=1, BW=5024KiB/s (5144kB/s)(12.0MiB/2446msec); 0 zone resets clat (msec): min=607, max=972, avg=796.26, stdev=182.58 lat (msec): min=608, max=972, avg=796.69, stdev=182.49 clat percentiles (msec): | 1.00th=[ 609], 5.00th=[ 609], 10.00th=[ 609], 20.00th=[ 609], | 30.00th=[ 609], 40.00th=[ 810], 50.00th=[ 810], 60.00th=[ 810], | 70.00th=[ 969], 80.00th=[ 969], 90.00th=[ 969], 95.00th=[ 969], | 99.00th=[ 969], 99.50th=[ 969], 99.90th=[ 969], 99.95th=[ 969], | 99.99th=[ 969] bw ( KiB/s): min= 8110, max= 8143, per=75.62%, avg=8126.50, stdev=23.33, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 1000=66.67% cpu : usr=0.00%, sys=5.56%, ctx=60, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4981KiB/s (5101kB/s), 1400KiB/s-3736KiB/s (1434kB/s-3826kB/s), io=16.0MiB (16.8MB), run=2925-3289msec WRITE: bw=10.5MiB/s (11.0MB/s), 2801KiB/s-5024KiB/s (2868kB/s-5144kB/s), io=32.0MiB (33.6MB), run=2446-3049msec