== sanity test 398b: DIO and buffer IO race ============== 04:05:39 (1787472339) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 6.6212 s, 7.6 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=178750: Sun Aug 23 04:07:54 2026 read: IOPS=13, BW=52.2KiB/s (53.5kB/s)(5992KiB/114769msec) clat (usec): min=40, max=952801, avg=42465.98, stdev=35176.81 lat (usec): min=41, max=952802, avg=42469.38, stdev=35175.51 clat percentiles (usec): | 1.00th=[ 52], 5.00th=[ 10552], 10.00th=[ 16057], 20.00th=[ 21627], | 30.00th=[ 26084], 40.00th=[ 31065], 50.00th=[ 36963], 60.00th=[ 42730], | 70.00th=[ 50594], 80.00th=[ 60031], 90.00th=[ 73925], 95.00th=[ 88605], | 99.00th=[135267], 99.50th=[154141], 99.90th=[204473], 99.95th=[952108], | 99.99th=[952108] bw ( KiB/s): min= 5, max= 112, per=24.81%, avg=51.85, stdev=19.01, samples=225 iops : min= 1, max= 28, avg=12.30, stdev= 4.77, samples=225 write: IOPS=13, BW=54.9KiB/s (56.2kB/s)(6296KiB/114769msec); 0 zone resets clat (usec): min=1130, max=268864, avg=32161.68, stdev=32616.08 lat (usec): min=1131, max=268865, avg=32165.60, stdev=32614.52 clat percentiles (usec): | 1.00th=[ 1254], 5.00th=[ 1450], 10.00th=[ 2409], 20.00th=[ 4686], | 30.00th=[ 8717], 40.00th=[ 15139], 50.00th=[ 22938], 60.00th=[ 29754], | 70.00th=[ 41157], 80.00th=[ 54264], 90.00th=[ 78119], 95.00th=[101188], | 99.00th=[149947], 99.50th=[166724], 99.90th=[183501], 99.95th=[270533], | 99.99th=[270533] bw ( KiB/s): min= 7, max= 135, per=25.05%, avg=54.86, stdev=21.77, samples=224 iops : min= 1, max= 33, avg=13.06, stdev= 5.45, samples=224 lat (usec) : 50=0.42%, 100=1.33%, 250=0.10%, 500=0.07% lat (msec) : 2=4.33%, 4=4.56%, 10=8.11%, 20=13.02%, 50=41.15% lat (msec) : 100=22.62%, 250=4.23%, 500=0.03%, 1000=0.03% cpu : usr=0.06%, sys=5.78%, ctx=6859, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178751: Sun Aug 23 04:07:54 2026 read: IOPS=13, BW=52.2KiB/s (53.5kB/s)(5940KiB/113701msec) clat (usec): min=40, max=226483, avg=41741.50, stdev=26619.55 lat (usec): min=41, max=226484, avg=41743.85, stdev=26618.71 clat percentiles (usec): | 1.00th=[ 53], 5.00th=[ 11469], 10.00th=[ 16188], 20.00th=[ 21627], | 30.00th=[ 26084], 40.00th=[ 31327], 50.00th=[ 36439], 60.00th=[ 42730], | 70.00th=[ 50070], 80.00th=[ 58983], 90.00th=[ 72877], 95.00th=[ 88605], | 99.00th=[133694], 99.50th=[158335], 99.90th=[212861], 99.95th=[225444], | 99.99th=[225444] bw ( KiB/s): min= 7, max= 102, per=24.76%, avg=51.75, stdev=20.04, samples=224 iops : min= 1, max= 25, avg=12.24, stdev= 5.04, samples=224 write: IOPS=13, BW=55.8KiB/s (57.2kB/s)(6348KiB/113701msec); 0 zone resets clat (usec): min=1106, max=933625, avg=32256.74, stdev=39533.68 lat (usec): min=1106, max=933626, avg=32260.64, stdev=39533.74 clat percentiles (usec): | 1.00th=[ 1221], 5.00th=[ 1450], 10.00th=[ 2114], 20.00th=[ 4686], | 30.00th=[ 8029], 40.00th=[ 15139], 50.00th=[ 22676], 60.00th=[ 30016], | 70.00th=[ 40633], 80.00th=[ 54789], 90.00th=[ 76022], 95.00th=[ 93848], | 99.00th=[137364], 99.50th=[170918], 99.90th=[312476], 99.95th=[935330], | 99.99th=[935330] bw ( KiB/s): min= 7, max= 135, per=25.33%, avg=55.48, stdev=24.90, samples=223 iops : min= 1, max= 33, avg=13.18, stdev= 6.24, samples=223 lat (usec) : 50=0.29%, 100=1.24%, 250=0.07%, 500=0.16%, 1000=0.07% lat (msec) : 2=4.56%, 4=4.85%, 10=8.24%, 20=12.21%, 50=41.99% lat (msec) : 100=22.92%, 250=3.35%, 500=0.03%, 1000=0.03% cpu : usr=0.09%, sys=6.09%, ctx=6895, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178752: Sun Aug 23 04:07:54 2026 read: IOPS=13, BW=53.2KiB/s (54.5kB/s)(6028KiB/113283msec) clat (usec): min=27, max=228203, avg=42242.25, stdev=26712.23 lat (usec): min=27, max=228205, avg=42249.08, stdev=26713.74 clat percentiles (usec): | 1.00th=[ 53], 5.00th=[ 10683], 10.00th=[ 15533], 20.00th=[ 21627], | 30.00th=[ 26870], 40.00th=[ 32375], 50.00th=[ 38011], 60.00th=[ 43779], | 70.00th=[ 51119], 80.00th=[ 58459], 90.00th=[ 73925], 95.00th=[ 92799], | 99.00th=[126354], 99.50th=[156238], 99.90th=[221250], 99.95th=[227541], | 99.99th=[227541] bw ( KiB/s): min= 15, max= 111, per=25.35%, avg=52.99, stdev=19.85, samples=222 iops : min= 3, max= 27, avg=12.56, stdev= 4.97, samples=222 write: IOPS=13, BW=55.3KiB/s (56.6kB/s)(6260KiB/113283msec); 0 zone resets clat (usec): min=982, max=896007, avg=31398.21, stdev=37458.33 lat (usec): min=983, max=896010, avg=31407.16, stdev=37458.56 clat percentiles (usec): | 1.00th=[ 1221], 5.00th=[ 1434], 10.00th=[ 2114], 20.00th=[ 4424], | 30.00th=[ 8291], 40.00th=[ 15795], 50.00th=[ 23462], 60.00th=[ 30540], | 70.00th=[ 39060], 80.00th=[ 52167], 90.00th=[ 71828], 95.00th=[ 91751], | 99.00th=[143655], 99.50th=[154141], 99.90th=[235930], 99.95th=[893387], | 99.99th=[893387] bw ( KiB/s): min= 7, max= 142, per=25.12%, avg=55.01, stdev=23.02, samples=222 iops : min= 1, max= 35, avg=13.05, stdev= 5.79, samples=222 lat (usec) : 50=0.20%, 100=1.40%, 250=0.20%, 750=0.03%, 1000=0.03% lat (msec) : 2=4.95%, 4=4.65%, 10=7.42%, 20=12.92%, 50=42.02% lat (msec) : 100=22.33%, 250=3.81%, 1000=0.03% cpu : usr=0.08%, sys=5.77%, ctx=6879, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178753: Sun Aug 23 04:07:54 2026 read: IOPS=13, BW=53.4KiB/s (54.7kB/s)(6052KiB/113263msec) clat (usec): min=47, max=885890, avg=41268.93, stdev=33919.29 lat (usec): min=48, max=885892, avg=41271.03, stdev=33918.95 clat percentiles (usec): | 1.00th=[ 55], 5.00th=[ 11207], 10.00th=[ 15533], 20.00th=[ 20841], | 30.00th=[ 25560], 40.00th=[ 30540], 50.00th=[ 35914], 60.00th=[ 41157], | 70.00th=[ 47449], 80.00th=[ 57410], 90.00th=[ 73925], 95.00th=[ 89654], | 99.00th=[128451], 99.50th=[143655], 99.90th=[208667], 99.95th=[884999], | 99.99th=[884999] bw ( KiB/s): min= 7, max= 111, per=25.56%, avg=53.43, stdev=18.57, samples=221 iops : min= 1, max= 27, avg=12.69, stdev= 4.67, samples=221 write: IOPS=13, BW=55.1KiB/s (56.4kB/s)(6236KiB/113263msec); 0 zone resets clat (usec): min=1126, max=231060, avg=32293.10, stdev=32063.20 lat (usec): min=1129, max=231062, avg=32300.61, stdev=32061.52 clat percentiles (usec): | 1.00th=[ 1237], 5.00th=[ 1434], 10.00th=[ 2114], 20.00th=[ 4178], | 30.00th=[ 7701], 40.00th=[ 16909], 50.00th=[ 23725], 60.00th=[ 31589], | 70.00th=[ 42206], 80.00th=[ 55313], 90.00th=[ 73925], 95.00th=[ 94897], | 99.00th=[139461], 99.50th=[152044], 99.90th=[219153], 99.95th=[231736], | 99.99th=[231736] bw ( KiB/s): min= 7, max= 142, per=25.00%, avg=54.74, stdev=22.31, samples=222 iops : min= 1, max= 35, avg=13.02, stdev= 5.61, samples=222 lat (usec) : 50=0.16%, 100=1.50%, 250=0.10%, 500=0.07%, 750=0.03% lat (usec) : 1000=0.03% lat (msec) : 2=4.65%, 4=4.92%, 10=7.71%, 20=12.34%, 50=43.65% lat (msec) : 100=21.09%, 250=3.71%, 1000=0.03% cpu : usr=0.09%, sys=5.95%, ctx=6832, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=209KiB/s (214kB/s), 52.2KiB/s-53.4KiB/s (53.5kB/s-54.7kB/s), io=23.4MiB (24.6MB), run=113263-114769msec WRITE: bw=219KiB/s (224kB/s), 54.9KiB/s-55.8KiB/s (56.2kB/s-57.2kB/s), io=24.6MiB (25.7MB), run=113263-114769msec rand-rw: (groupid=0, jobs=1): err= 0: pid=178754: Sun Aug 23 04:08:33 2026 read: IOPS=9, BW=38.8KiB/s (39.7kB/s)(5992KiB/154494msec) clat (msec): min=5, max=965, avg=41.15, stdev=43.38 lat (msec): min=5, max=965, avg=41.16, stdev=43.38 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 17], | 30.00th=[ 21], 40.00th=[ 24], 50.00th=[ 28], 60.00th=[ 34], | 70.00th=[ 43], 80.00th=[ 58], 90.00th=[ 84], 95.00th=[ 117], | 99.00th=[ 190], 99.50th=[ 213], 99.90th=[ 309], 99.95th=[ 969], | 99.99th=[ 969] bw ( KiB/s): min= 7, max= 143, per=25.25%, avg=39.13, stdev=24.75, samples=298 iops : min= 1, max= 35, avg= 9.15, stdev= 6.20, samples=298 write: IOPS=10, BW=40.8KiB/s (41.7kB/s)(6296KiB/154494msec); 0 zone resets clat (msec): min=8, max=257, avg=58.73, stdev=38.39 lat (msec): min=8, max=257, avg=58.73, stdev=38.39 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 21], 10.00th=[ 24], 20.00th=[ 29], | 30.00th=[ 34], 40.00th=[ 40], 50.00th=[ 47], 60.00th=[ 56], | 70.00th=[ 68], 80.00th=[ 87], 90.00th=[ 112], 95.00th=[ 138], | 99.00th=[ 188], 99.50th=[ 205], 99.90th=[ 249], 99.95th=[ 257], | 99.99th=[ 257] bw ( KiB/s): min= 7, max= 119, per=25.15%, avg=40.75, stdev=23.13, samples=301 iops : min= 1, max= 29, avg= 9.54, stdev= 5.81, samples=301 lat (msec) : 10=2.15%, 20=14.71%, 50=47.72%, 100=24.41%, 250=10.81% lat (msec) : 500=0.16%, 1000=0.03% cpu : usr=0.06%, sys=2.34%, ctx=4953, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178755: Sun Aug 23 04:08:33 2026 read: IOPS=9, BW=38.4KiB/s (39.3kB/s)(5940KiB/154613msec) clat (msec): min=5, max=889, avg=40.16, stdev=40.95 lat (msec): min=5, max=889, avg=40.16, stdev=40.95 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 17], | 30.00th=[ 21], 40.00th=[ 24], 50.00th=[ 29], 60.00th=[ 34], | 70.00th=[ 43], 80.00th=[ 56], 90.00th=[ 84], 95.00th=[ 111], | 99.00th=[ 178], 99.50th=[ 203], 99.90th=[ 309], 99.95th=[ 894], | 99.99th=[ 894] bw ( KiB/s): min= 7, max= 159, per=25.45%, avg=39.45, stdev=25.91, samples=293 iops : min= 1, max= 39, avg= 9.23, stdev= 6.51, samples=293 write: IOPS=10, BW=41.1KiB/s (42.0kB/s)(6348KiB/154613msec); 0 zone resets clat (msec): min=13, max=379, avg=59.60, stdev=39.97 lat (msec): min=13, max=379, avg=59.60, stdev=39.97 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 21], 10.00th=[ 25], 20.00th=[ 30], | 30.00th=[ 35], 40.00th=[ 41], 50.00th=[ 47], 60.00th=[ 57], | 70.00th=[ 68], 80.00th=[ 85], 90.00th=[ 111], 95.00th=[ 138], | 99.00th=[ 209], 99.50th=[ 236], 99.90th=[ 296], 99.95th=[ 380], | 99.99th=[ 380] bw ( KiB/s): min= 7, max= 103, per=25.12%, avg=40.70, stdev=21.69, samples=303 iops : min= 1, max= 25, avg= 9.53, stdev= 5.46, samples=303 lat (msec) : 10=2.28%, 20=13.96%, 50=48.54%, 100=24.74%, 250=10.25% lat (msec) : 500=0.20%, 1000=0.03% cpu : usr=0.06%, sys=2.40%, ctx=5046, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178756: Sun Aug 23 04:08:33 2026 read: IOPS=9, BW=39.2KiB/s (40.1kB/s)(6028KiB/153842msec) clat (msec): min=5, max=309, avg=40.87, stdev=35.85 lat (msec): min=5, max=309, avg=40.87, stdev=35.85 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 18], | 30.00th=[ 21], 40.00th=[ 25], 50.00th=[ 29], 60.00th=[ 35], | 70.00th=[ 43], 80.00th=[ 56], 90.00th=[ 87], 95.00th=[ 115], | 99.00th=[ 182], 99.50th=[ 197], 99.90th=[ 279], 99.95th=[ 309], | 99.99th=[ 309] bw ( KiB/s): min= 7, max= 152, per=25.63%, avg=39.73, stdev=23.87, samples=296 iops : min= 1, max= 38, avg= 9.30, stdev= 6.01, samples=296 write: IOPS=10, BW=40.7KiB/s (41.7kB/s)(6260KiB/153842msec); 0 zone resets clat (msec): min=10, max=895, avg=58.68, stdev=44.66 lat (msec): min=10, max=895, avg=58.68, stdev=44.66 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 21], 10.00th=[ 24], 20.00th=[ 28], | 30.00th=[ 33], 40.00th=[ 39], 50.00th=[ 47], 60.00th=[ 56], | 70.00th=[ 67], 80.00th=[ 83], 90.00th=[ 112], 95.00th=[ 134], | 99.00th=[ 199], 99.50th=[ 247], 99.90th=[ 359], 99.95th=[ 894], | 99.99th=[ 894] bw ( KiB/s): min= 7, max= 118, per=25.13%, avg=40.71, stdev=22.95, samples=300 iops : min= 1, max= 29, avg= 9.54, stdev= 5.76, samples=300 lat (msec) : 10=1.66%, 20=14.58%, 50=48.73%, 100=25.03%, 250=9.73% lat (msec) : 500=0.23%, 1000=0.03% cpu : usr=0.07%, sys=2.36%, ctx=5010, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178757: Sun Aug 23 04:08:33 2026 read: IOPS=9, BW=39.2KiB/s (40.1kB/s)(6052KiB/154443msec) clat (msec): min=5, max=278, avg=40.71, stdev=35.67 lat (msec): min=5, max=278, avg=40.71, stdev=35.67 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 17], | 30.00th=[ 20], 40.00th=[ 24], 50.00th=[ 28], 60.00th=[ 34], | 70.00th=[ 43], 80.00th=[ 60], 90.00th=[ 91], 95.00th=[ 118], | 99.00th=[ 169], 99.50th=[ 194], 99.90th=[ 259], 99.95th=[ 279], | 99.99th=[ 279] bw ( KiB/s): min= 7, max= 143, per=25.53%, avg=39.56, stdev=23.52, samples=298 iops : min= 1, max= 35, avg= 9.26, stdev= 5.89, samples=298 write: IOPS=10, BW=40.4KiB/s (41.3kB/s)(6236KiB/154443msec); 0 zone resets clat (msec): min=12, max=920, avg=59.29, stdev=43.55 lat (msec): min=12, max=920, avg=59.30, stdev=43.55 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 21], 10.00th=[ 24], 20.00th=[ 29], | 30.00th=[ 34], 40.00th=[ 40], 50.00th=[ 47], 60.00th=[ 57], | 70.00th=[ 68], 80.00th=[ 86], 90.00th=[ 109], 95.00th=[ 134], | 99.00th=[ 194], 99.50th=[ 222], 99.90th=[ 255], 99.95th=[ 919], | 99.99th=[ 919] bw ( KiB/s): min= 7, max= 119, per=24.91%, avg=40.36, stdev=22.55, samples=301 iops : min= 1, max= 29, avg= 9.45, stdev= 5.66, samples=301 lat (msec) : 10=2.12%, 20=15.43%, 50=46.39%, 100=25.78%, 250=10.12% lat (msec) : 500=0.13%, 1000=0.03% cpu : usr=0.06%, sys=2.35%, ctx=5048, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=155KiB/s (159kB/s), 38.4KiB/s-39.2KiB/s (39.3kB/s-40.1kB/s), io=23.4MiB (24.6MB), run=153842-154613msec WRITE: bw=163KiB/s (167kB/s), 40.4KiB/s-41.1KiB/s (41.3kB/s-42.0kB/s), io=24.6MiB (25.7MB), run=153842-154613msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=178799: Sun Aug 23 04:09:14 2026 read: IOPS=12, BW=201KiB/s (206kB/s)(5920KiB/29402msec) clat (usec): min=45, max=217112, avg=42598.80, stdev=30489.27 lat (usec): min=45, max=217113, avg=42601.35, stdev=30491.01 clat percentiles (usec): | 1.00th=[ 50], 5.00th=[ 62], 10.00th=[ 6325], 20.00th=[ 21627], | 30.00th=[ 27657], 40.00th=[ 32113], 50.00th=[ 36963], 60.00th=[ 42206], | 70.00th=[ 50594], 80.00th=[ 60031], 90.00th=[ 77071], 95.00th=[100140], | 99.00th=[156238], 99.50th=[173016], 99.90th=[217056], 99.95th=[217056], | 99.99th=[217056] bw ( KiB/s): min= 31, max= 405, per=25.34%, avg=200.45, stdev=81.56, samples=58 iops : min= 1, max= 25, avg=11.78, stdev= 5.12, samples=58 write: IOPS=13, BW=217KiB/s (222kB/s)(6368KiB/29402msec); 0 zone resets clat (usec): min=1535, max=222935, avg=34181.94, stdev=33136.11 lat (usec): min=1537, max=222937, avg=34186.08, stdev=33137.94 clat percentiles (usec): | 1.00th=[ 1680], 5.00th=[ 2212], 10.00th=[ 4080], 20.00th=[ 7177], | 30.00th=[ 11469], 40.00th=[ 17695], 50.00th=[ 23987], 60.00th=[ 31589], | 70.00th=[ 43779], 80.00th=[ 55313], 90.00th=[ 80217], 95.00th=[100140], | 99.00th=[137364], 99.50th=[183501], 99.90th=[223347], 99.95th=[223347], | 99.99th=[223347] bw ( KiB/s): min= 31, max= 508, per=25.96%, avg=216.26, stdev=92.04, samples=58 iops : min= 1, max= 31, avg=12.79, stdev= 5.77, samples=58 lat (usec) : 50=0.52%, 100=3.65%, 250=0.39%, 500=0.13% lat (msec) : 2=1.56%, 4=3.12%, 10=9.64%, 20=12.11%, 50=40.89% lat (msec) : 100=23.05%, 250=4.95% cpu : usr=0.09%, sys=6.22%, ctx=1764, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178800: Sun Aug 23 04:09:14 2026 read: IOPS=12, BW=192KiB/s (197kB/s)(5744KiB/29852msec) clat (usec): min=50, max=271888, avg=44102.37, stdev=29234.92 lat (usec): min=50, max=271889, avg=44103.36, stdev=29234.93 clat percentiles (usec): | 1.00th=[ 56], 5.00th=[ 8586], 10.00th=[ 15926], 20.00th=[ 22414], | 30.00th=[ 28705], 40.00th=[ 34341], 50.00th=[ 40633], 60.00th=[ 45351], | 70.00th=[ 51643], 80.00th=[ 61080], 90.00th=[ 76022], 95.00th=[ 91751], | 99.00th=[160433], 99.50th=[177210], 99.90th=[270533], 99.95th=[270533], | 99.99th=[270533] bw ( KiB/s): min= 59, max= 441, per=24.33%, avg=192.46, stdev=79.24, samples=59 iops : min= 3, max= 27, avg=11.27, stdev= 4.98, samples=59 write: IOPS=13, BW=219KiB/s (224kB/s)(6544KiB/29852msec); 0 zone resets clat (usec): min=1507, max=165853, avg=34200.08, stdev=33120.81 lat (usec): min=1509, max=165855, avg=34201.90, stdev=33120.85 clat percentiles (usec): | 1.00th=[ 1795], 5.00th=[ 2442], 10.00th=[ 3294], 20.00th=[ 6063], | 30.00th=[ 10683], 40.00th=[ 17695], 50.00th=[ 23462], 60.00th=[ 33162], | 70.00th=[ 43254], 80.00th=[ 55313], 90.00th=[ 81265], 95.00th=[103285], | 99.00th=[149947], 99.50th=[162530], 99.90th=[166724], 99.95th=[166724], | 99.99th=[166724] bw ( KiB/s): min= 63, max= 504, per=26.17%, avg=218.02, stdev=94.33, samples=59 iops : min= 3, max= 31, avg=12.88, stdev= 5.98, samples=59 lat (usec) : 100=2.08% lat (msec) : 2=1.56%, 4=5.73%, 10=8.98%, 20=11.59%, 50=42.71% lat (msec) : 100=22.66%, 250=4.56%, 500=0.13% cpu : usr=0.05%, sys=6.37%, ctx=1820, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178801: Sun Aug 23 04:09:14 2026 read: IOPS=12, BW=207KiB/s (212kB/s)(6256KiB/30248msec) clat (usec): min=42, max=162559, avg=42077.72, stdev=25893.44 lat (usec): min=42, max=162561, avg=42090.42, stdev=25899.99 clat percentiles (usec): | 1.00th=[ 56], 5.00th=[ 104], 10.00th=[ 15533], 20.00th=[ 23200], | 30.00th=[ 28443], 40.00th=[ 33817], 50.00th=[ 38011], 60.00th=[ 42206], | 70.00th=[ 49021], 80.00th=[ 58459], 90.00th=[ 74974], 95.00th=[ 89654], | 99.00th=[129500], 99.50th=[152044], 99.90th=[162530], 99.95th=[162530], | 99.99th=[162530] bw ( KiB/s): min= 31, max= 413, per=25.71%, avg=203.34, stdev=80.84, samples=59 iops : min= 1, max= 25, avg=11.98, stdev= 5.05, samples=59 write: IOPS=12, BW=199KiB/s (204kB/s)(6032KiB/30248msec); 0 zone resets clat (usec): min=1707, max=242818, avg=36512.03, stdev=35408.81 lat (usec): min=1709, max=242821, avg=36513.85, stdev=35408.84 clat percentiles (usec): | 1.00th=[ 1827], 5.00th=[ 2212], 10.00th=[ 3392], 20.00th=[ 7111], | 30.00th=[ 11469], 40.00th=[ 20317], 50.00th=[ 27132], 60.00th=[ 34341], | 70.00th=[ 45876], 80.00th=[ 60556], 90.00th=[ 85459], 95.00th=[107480], | 99.00th=[158335], 99.50th=[229639], 99.90th=[242222], 99.95th=[242222], | 99.99th=[242222] bw ( KiB/s): min= 63, max= 378, per=23.06%, avg=192.10, stdev=72.53, samples=59 iops : min= 3, max= 23, avg=11.25, stdev= 4.55, samples=59 lat (usec) : 50=0.13%, 100=2.34%, 250=0.13%, 500=0.13% lat (msec) : 2=1.56%, 4=4.56%, 10=8.07%, 20=10.94%, 50=44.79% lat (msec) : 100=23.18%, 250=4.17% cpu : usr=0.08%, sys=5.98%, ctx=1800, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178802: Sun Aug 23 04:09:14 2026 read: IOPS=12, BW=204KiB/s (209kB/s)(6032KiB/29505msec) clat (usec): min=50, max=277708, avg=41879.99, stdev=29814.28 lat (usec): min=50, max=277709, avg=41881.05, stdev=29814.29 clat percentiles (usec): | 1.00th=[ 55], 5.00th=[ 62], 10.00th=[ 13173], 20.00th=[ 21627], | 30.00th=[ 26870], 40.00th=[ 31851], 50.00th=[ 36963], 60.00th=[ 42730], | 70.00th=[ 50070], 80.00th=[ 57410], 90.00th=[ 73925], 95.00th=[ 93848], | 99.00th=[152044], 99.50th=[196084], 99.90th=[278922], 99.95th=[278922], | 99.99th=[278922] bw ( KiB/s): min= 62, max= 380, per=25.58%, avg=202.36, stdev=74.27, samples=58 iops : min= 3, max= 23, avg=11.90, stdev= 4.69, samples=58 write: IOPS=13, BW=212KiB/s (217kB/s)(6256KiB/29505msec); 0 zone resets clat (usec): min=1640, max=280708, avg=35009.90, stdev=36286.54 lat (usec): min=1641, max=280710, avg=35012.67, stdev=36287.77 clat percentiles (usec): | 1.00th=[ 1729], 5.00th=[ 2008], 10.00th=[ 2704], 20.00th=[ 5932], | 30.00th=[ 10421], 40.00th=[ 16909], 50.00th=[ 24511], 60.00th=[ 34341], | 70.00th=[ 44303], 80.00th=[ 57934], 90.00th=[ 80217], 95.00th=[100140], | 99.00th=[154141], 99.50th=[235930], 99.90th=[278922], 99.95th=[278922], | 99.99th=[278922] bw ( KiB/s): min= 31, max= 467, per=25.30%, avg=210.76, stdev=98.44, samples=58 iops : min= 1, max= 29, avg=12.45, stdev= 6.22, samples=58 lat (usec) : 100=4.17% lat (msec) : 2=2.47%, 4=4.82%, 10=7.81%, 20=10.81%, 50=42.19% lat (msec) : 100=23.31%, 250=4.17%, 500=0.26% cpu : usr=0.07%, sys=6.27%, ctx=1774, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=792KiB/s (811kB/s), 192KiB/s-207KiB/s (197kB/s-212kB/s), io=23.4MiB (24.5MB), run=29402-30248msec WRITE: bw=833KiB/s (853kB/s), 199KiB/s-219KiB/s (204kB/s-224kB/s), io=24.6MiB (25.8MB), run=29402-30248msec rand-rw: (groupid=0, jobs=1): err= 0: pid=178793: Sun Aug 23 04:09:22 2026 read: IOPS=9, BW=152KiB/s (156kB/s)(5920KiB/38932msec) clat (msec): min=6, max=245, avg=40.99, stdev=33.56 lat (msec): min=6, max=245, avg=41.00, stdev=33.56 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 11], 10.00th=[ 14], 20.00th=[ 17], | 30.00th=[ 21], 40.00th=[ 24], 50.00th=[ 29], 60.00th=[ 35], | 70.00th=[ 46], 80.00th=[ 62], 90.00th=[ 88], 95.00th=[ 116], | 99.00th=[ 153], 99.50th=[ 161], 99.90th=[ 247], 99.95th=[ 247], | 99.99th=[ 247] bw ( KiB/s): min= 31, max= 447, per=24.12%, avg=148.37, stdev=95.43, samples=76 iops : min= 1, max= 27, avg= 8.46, stdev= 6.03, samples=76 write: IOPS=10, BW=164KiB/s (167kB/s)(6368KiB/38932msec); 0 zone resets clat (msec): min=12, max=297, avg=59.21, stdev=41.08 lat (msec): min=12, max=297, avg=59.21, stdev=41.08 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 20], 10.00th=[ 23], 20.00th=[ 28], | 30.00th=[ 33], 40.00th=[ 39], 50.00th=[ 45], 60.00th=[ 57], | 70.00th=[ 71], 80.00th=[ 88], 90.00th=[ 115], 95.00th=[ 138], | 99.00th=[ 205], 99.50th=[ 249], 99.90th=[ 296], 99.95th=[ 296], | 99.99th=[ 296] bw ( KiB/s): min= 31, max= 416, per=25.05%, avg=162.05, stdev=94.69, samples=76 iops : min= 1, max= 26, avg= 9.33, stdev= 5.99, samples=76 lat (msec) : 10=1.56%, 20=15.36%, 50=47.27%, 100=24.35%, 250=11.33% lat (msec) : 500=0.13% cpu : usr=0.03%, sys=2.37%, ctx=1270, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178794: Sun Aug 23 04:09:22 2026 read: IOPS=9, BW=148KiB/s (151kB/s)(5744KiB/38862msec) clat (msec): min=5, max=203, avg=39.75, stdev=33.49 lat (msec): min=5, max=203, avg=39.75, stdev=33.48 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 12], 20.00th=[ 16], | 30.00th=[ 19], 40.00th=[ 22], 50.00th=[ 28], 60.00th=[ 34], | 70.00th=[ 44], 80.00th=[ 60], 90.00th=[ 90], 95.00th=[ 116], | 99.00th=[ 163], 99.50th=[ 182], 99.90th=[ 203], 99.95th=[ 203], | 99.99th=[ 203] bw ( KiB/s): min= 31, max= 508, per=24.18%, avg=148.73, stdev=97.40, samples=75 iops : min= 1, max= 31, avg= 8.49, stdev= 6.16, samples=75 write: IOPS=10, BW=168KiB/s (172kB/s)(6544KiB/38862msec); 0 zone resets clat (msec): min=14, max=198, avg=59.69, stdev=36.39 lat (msec): min=14, max=198, avg=59.69, stdev=36.39 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 22], 10.00th=[ 25], 20.00th=[ 29], | 30.00th=[ 33], 40.00th=[ 40], 50.00th=[ 48], 60.00th=[ 58], | 70.00th=[ 75], 80.00th=[ 89], 90.00th=[ 113], 95.00th=[ 132], | 99.00th=[ 167], 99.50th=[ 169], 99.90th=[ 199], 99.95th=[ 199], | 99.99th=[ 199] bw ( KiB/s): min= 31, max= 416, per=25.74%, avg=166.57, stdev=95.95, samples=76 iops : min= 1, max= 26, avg= 9.61, stdev= 6.08, samples=76 lat (msec) : 10=1.69%, 20=15.89%, 50=45.70%, 100=25.52%, 250=11.20% cpu : usr=0.05%, sys=2.53%, ctx=1289, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178795: Sun Aug 23 04:09:22 2026 read: IOPS=10, BW=161KiB/s (165kB/s)(6256KiB/38795msec) clat (msec): min=6, max=245, avg=41.00, stdev=37.49 lat (msec): min=6, max=245, avg=41.00, stdev=37.49 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 16], | 30.00th=[ 19], 40.00th=[ 22], 50.00th=[ 27], 60.00th=[ 33], | 70.00th=[ 44], 80.00th=[ 59], 90.00th=[ 91], 95.00th=[ 121], | 99.00th=[ 174], 99.50th=[ 199], 99.90th=[ 245], 99.95th=[ 245], | 99.99th=[ 245] bw ( KiB/s): min= 31, max= 538, per=26.20%, avg=161.11, stdev=113.09, samples=76 iops : min= 1, max= 33, avg= 9.26, stdev= 7.17, samples=76 write: IOPS=9, BW=155KiB/s (159kB/s)(6032KiB/38795msec); 0 zone resets clat (msec): min=13, max=318, avg=60.20, stdev=44.39 lat (msec): min=13, max=318, avg=60.20, stdev=44.39 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 20], 10.00th=[ 22], 20.00th=[ 26], | 30.00th=[ 33], 40.00th=[ 37], 50.00th=[ 46], 60.00th=[ 56], | 70.00th=[ 70], 80.00th=[ 89], 90.00th=[ 121], 95.00th=[ 148], | 99.00th=[ 228], 99.50th=[ 309], 99.90th=[ 317], 99.95th=[ 317], | 99.99th=[ 317] bw ( KiB/s): min= 31, max= 448, per=23.61%, avg=152.78, stdev=93.34, samples=76 iops : min= 1, max= 28, avg= 8.74, stdev= 5.90, samples=76 lat (msec) : 10=1.95%, 20=18.62%, 50=43.88%, 100=23.96%, 250=11.20% lat (msec) : 500=0.39% cpu : usr=0.05%, sys=2.53%, ctx=1278, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178796: Sun Aug 23 04:09:22 2026 read: IOPS=9, BW=155KiB/s (159kB/s)(6032KiB/38939msec) clat (msec): min=7, max=267, avg=41.28, stdev=35.09 lat (msec): min=7, max=267, avg=41.28, stdev=35.09 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 14], 20.00th=[ 17], | 30.00th=[ 21], 40.00th=[ 24], 50.00th=[ 29], 60.00th=[ 35], | 70.00th=[ 43], 80.00th=[ 59], 90.00th=[ 95], 95.00th=[ 112], | 99.00th=[ 163], 99.50th=[ 232], 99.90th=[ 268], 99.95th=[ 268], | 99.99th=[ 268] bw ( KiB/s): min= 31, max= 444, per=25.06%, avg=154.13, stdev=98.54, samples=75 iops : min= 1, max= 27, avg= 8.83, stdev= 6.20, samples=75 write: IOPS=10, BW=161KiB/s (165kB/s)(6256KiB/38939msec); 0 zone resets clat (msec): min=13, max=323, avg=59.25, stdev=42.25 lat (msec): min=13, max=323, avg=59.25, stdev=42.25 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 20], 10.00th=[ 22], 20.00th=[ 27], | 30.00th=[ 33], 40.00th=[ 37], 50.00th=[ 43], 60.00th=[ 58], | 70.00th=[ 74], 80.00th=[ 91], 90.00th=[ 113], 95.00th=[ 140], | 99.00th=[ 211], 99.50th=[ 288], 99.90th=[ 326], 99.95th=[ 326], | 99.99th=[ 326] bw ( KiB/s): min= 31, max= 479, per=24.44%, avg=158.12, stdev=95.81, samples=76 iops : min= 1, max= 29, avg= 9.07, stdev= 6.06, samples=76 lat (msec) : 10=1.43%, 20=15.63%, 50=48.83%, 100=22.27%, 250=11.46% lat (msec) : 500=0.39% cpu : usr=0.06%, sys=2.38%, ctx=1274, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=615KiB/s (630kB/s), 148KiB/s-161KiB/s (151kB/s-165kB/s), io=23.4MiB (24.5MB), run=38795-38939msec WRITE: bw=647KiB/s (663kB/s), 155KiB/s-168KiB/s (159kB/s-172kB/s), io=24.6MiB (25.8MB), run=38795-38939msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=178816: Sun Aug 23 04:09:33 2026 read: IOPS=2, BW=2752KiB/s (2818kB/s)(7168KiB/2605msec) clat (usec): min=510, max=180408, avg=124669.83, stdev=61526.17 lat (usec): min=511, max=180409, avg=124671.16, stdev=61526.29 clat percentiles (usec): | 1.00th=[ 510], 5.00th=[ 510], 10.00th=[ 510], 20.00th=[ 88605], | 30.00th=[141558], 40.00th=[141558], 50.00th=[147850], 60.00th=[149947], | 70.00th=[149947], 80.00th=[162530], 90.00th=[181404], 95.00th=[181404], | 99.00th=[181404], 99.50th=[181404], 99.90th=[181404], 99.95th=[181404], | 99.99th=[181404] bw ( KiB/s): min= 4000, max= 4388, per=66.15%, avg=4194.00, stdev=274.36, samples=2 iops : min= 3, max= 4, avg= 3.50, stdev= 0.71, samples=2 write: IOPS=1, BW=1965KiB/s (2013kB/s)(5120KiB/2605msec); 0 zone resets clat (msec): min=108, max=624, avg=336.70, stdev=193.37 lat (msec): min=108, max=624, avg=336.82, stdev=193.37 clat percentiles (msec): | 1.00th=[ 109], 5.00th=[ 109], 10.00th=[ 109], 20.00th=[ 109], | 30.00th=[ 255], 40.00th=[ 255], 50.00th=[ 288], 60.00th=[ 288], | 70.00th=[ 409], 80.00th=[ 409], 90.00th=[ 625], 95.00th=[ 625], | 99.00th=[ 625], 99.50th=[ 625], 99.90th=[ 625], 99.95th=[ 625], | 99.99th=[ 625] bw ( KiB/s): min= 1462, max= 4047, per=31.03%, avg=2754.50, stdev=1827.87, samples=2 iops : min= 1, max= 3, avg= 2.00, stdev= 1.41, samples=2 lat (usec) : 750=8.33% lat (msec) : 100=8.33%, 250=50.00%, 500=25.00%, 750=8.33% cpu : usr=0.00%, sys=17.40%, ctx=248, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178817: Sun Aug 23 04:09:33 2026 read: IOPS=0, BW=634KiB/s (649kB/s)(2048KiB/3230msec) clat (msec): min=164, max=174, avg=169.45, stdev= 7.32 lat (msec): min=164, max=174, avg=169.45, stdev= 7.32 clat percentiles (msec): | 1.00th=[ 165], 5.00th=[ 165], 10.00th=[ 165], 20.00th=[ 165], | 30.00th=[ 165], 40.00th=[ 165], 50.00th=[ 165], 60.00th=[ 176], | 70.00th=[ 176], 80.00th=[ 176], 90.00th=[ 176], 95.00th=[ 176], | 99.00th=[ 176], 99.50th=[ 176], 99.90th=[ 176], 99.95th=[ 176], | 99.99th=[ 176] bw ( KiB/s): min= 2039, max= 2048, per=32.23%, avg=2043.50, stdev= 6.36, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 write: IOPS=3, BW=3170KiB/s (3246kB/s)(10.0MiB/3230msec); 0 zone resets clat (msec): min=86, max=549, avg=285.34, stdev=153.83 lat (msec): min=86, max=550, avg=285.44, stdev=153.78 clat percentiles (msec): | 1.00th=[ 87], 5.00th=[ 87], 10.00th=[ 87], 20.00th=[ 129], | 30.00th=[ 155], 40.00th=[ 188], 50.00th=[ 266], 60.00th=[ 288], | 70.00th=[ 317], 80.00th=[ 393], 90.00th=[ 485], 95.00th=[ 550], | 99.00th=[ 550], 99.50th=[ 550], 99.90th=[ 550], 99.95th=[ 550], | 99.99th=[ 550] bw ( KiB/s): min= 3813, max= 6047, per=50.46%, avg=4478.50, stdev=1050.53, samples=4 iops : min= 3, max= 5, avg= 3.50, stdev= 1.00, samples=4 lat (msec) : 100=8.33%, 250=41.67%, 500=41.67%, 750=8.33% cpu : usr=0.00%, sys=16.66%, ctx=145, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178818: Sun Aug 23 04:09:33 2026 read: IOPS=2, BW=2171KiB/s (2223kB/s)(6144KiB/2830msec) clat (usec): min=397, max=474323, avg=222577.46, stdev=165087.55 lat (usec): min=398, max=474324, avg=222578.87, stdev=165087.58 clat percentiles (usec): | 1.00th=[ 400], 5.00th=[ 400], 10.00th=[ 400], 20.00th=[ 93848], | 30.00th=[ 93848], 40.00th=[221250], 50.00th=[221250], 60.00th=[242222], | 70.00th=[304088], 80.00th=[304088], 90.00th=[476054], 95.00th=[476054], | 99.00th=[476054], 99.50th=[476054], 99.90th=[476054], 99.95th=[476054], | 99.99th=[476054] bw ( KiB/s): min= 1906, max= 4000, per=39.20%, avg=2485.00, stdev=1011.37, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 write: IOPS=2, BW=2171KiB/s (2223kB/s)(6144KiB/2830msec); 0 zone resets clat (msec): min=145, max=363, avg=226.90, stdev=77.72 lat (msec): min=145, max=363, avg=227.00, stdev=77.75 clat percentiles (msec): | 1.00th=[ 146], 5.00th=[ 146], 10.00th=[ 146], 20.00th=[ 161], | 30.00th=[ 161], 40.00th=[ 213], 50.00th=[ 213], 60.00th=[ 232], | 70.00th=[ 247], 80.00th=[ 247], 90.00th=[ 363], 95.00th=[ 363], | 99.00th=[ 363], 99.50th=[ 363], 99.90th=[ 363], 99.95th=[ 363], | 99.99th=[ 363] bw ( KiB/s): min= 1906, max= 4000, per=30.18%, avg=2678.50, stdev=966.56, samples=4 iops : min= 1, max= 3, avg= 1.75, stdev= 0.96, samples=4 lat (usec) : 500=8.33% lat (msec) : 100=8.33%, 250=58.33%, 500=25.00% cpu : usr=0.00%, sys=16.97%, ctx=217, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178819: Sun Aug 23 04:09:33 2026 read: IOPS=1, BW=1843KiB/s (1887kB/s)(5120KiB/2778msec) clat (usec): min=496, max=379530, avg=115698.23, stdev=170243.90 lat (usec): min=497, max=379531, avg=115699.11, stdev=170243.56 clat percentiles (usec): | 1.00th=[ 498], 5.00th=[ 498], 10.00th=[ 498], 20.00th=[ 498], | 30.00th=[ 709], 40.00th=[ 709], 50.00th=[ 734], 60.00th=[ 734], | 70.00th=[196084], 80.00th=[196084], 90.00th=[379585], 95.00th=[379585], | 99.00th=[379585], 99.50th=[379585], 99.90th=[379585], 99.95th=[379585], | 99.99th=[379585] bw ( KiB/s): min= 2000, max= 6071, per=63.65%, avg=4035.50, stdev=2878.63, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 write: IOPS=2, BW=2580KiB/s (2642kB/s)(7168KiB/2778msec); 0 zone resets clat (msec): min=96, max=498, avg=310.15, stdev=132.38 lat (msec): min=96, max=498, avg=310.33, stdev=132.34 clat percentiles (msec): | 1.00th=[ 96], 5.00th=[ 96], 10.00th=[ 96], 20.00th=[ 226], | 30.00th=[ 279], 40.00th=[ 279], 50.00th=[ 288], 60.00th=[ 372], | 70.00th=[ 372], 80.00th=[ 418], 90.00th=[ 498], 95.00th=[ 498], | 99.00th=[ 498], 99.50th=[ 498], 99.90th=[ 498], 99.95th=[ 498], | 99.99th=[ 498] bw ( KiB/s): min= 1539, max= 6000, per=32.27%, avg=2864.00, stdev=2100.44, samples=4 iops : min= 1, max= 5, avg= 2.00, stdev= 2.00, samples=4 lat (usec) : 500=8.33%, 750=16.67% lat (msec) : 100=8.33%, 250=16.67%, 500=50.00% cpu : usr=0.00%, sys=18.80%, ctx=168, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=6341KiB/s (6493kB/s), 634KiB/s-2752KiB/s (649kB/s-2818kB/s), io=20.0MiB (20.0MB), run=2605-3230msec WRITE: bw=8877KiB/s (9090kB/s), 1965KiB/s-3170KiB/s (2013kB/s-3246kB/s), io=28.0MiB (29.4MB), run=2605-3230msec rand-rw: (groupid=0, jobs=1): err= 0: pid=178821: Sun Aug 23 04:09:35 2026 read: IOPS=2, BW=2479KiB/s (2539kB/s)(7168KiB/2891msec) clat (msec): min=81, max=451, avg=190.86, stdev=124.13 lat (msec): min=81, max=451, avg=190.86, stdev=124.13 clat percentiles (msec): | 1.00th=[ 83], 5.00th=[ 83], 10.00th=[ 83], 20.00th=[ 102], | 30.00th=[ 138], 40.00th=[ 138], 50.00th=[ 163], 60.00th=[ 180], | 70.00th=[ 180], 80.00th=[ 224], 90.00th=[ 451], 95.00th=[ 451], | 99.00th=[ 451], 99.50th=[ 451], 99.90th=[ 451], 99.95th=[ 451], | 99.99th=[ 451] bw ( KiB/s): min= 1939, max= 3930, per=52.36%, avg=3199.67, stdev=1096.34, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 write: IOPS=1, BW=1771KiB/s (1814kB/s)(5120KiB/2891msec); 0 zone resets clat (msec): min=64, max=583, avg=296.41, stdev=252.07 lat (msec): min=65, max=584, avg=296.53, stdev=252.09 clat percentiles (msec): | 1.00th=[ 65], 5.00th=[ 65], 10.00th=[ 65], 20.00th=[ 65], | 30.00th=[ 87], 40.00th=[ 87], 50.00th=[ 197], 60.00th=[ 197], | 70.00th=[ 550], 80.00th=[ 550], 90.00th=[ 584], 95.00th=[ 584], | 99.00th=[ 584], 99.50th=[ 584], 99.90th=[ 584], 99.95th=[ 584], | 99.99th=[ 584] bw ( KiB/s): min= 2027, max= 6095, per=47.46%, avg=4061.00, stdev=2876.51, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 lat (msec) : 100=25.00%, 250=50.00%, 500=8.33%, 750=16.67% cpu : usr=0.00%, sys=6.89%, ctx=91, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178822: Sun Aug 23 04:09:35 2026 read: IOPS=0, BW=665KiB/s (680kB/s)(2048KiB/3082msec) clat (msec): min=245, max=584, avg=415.15, stdev=239.62 lat (msec): min=245, max=584, avg=415.15, stdev=239.62 clat percentiles (msec): | 1.00th=[ 247], 5.00th=[ 247], 10.00th=[ 247], 20.00th=[ 247], | 30.00th=[ 247], 40.00th=[ 247], 50.00th=[ 247], 60.00th=[ 584], | 70.00th=[ 584], 80.00th=[ 584], 90.00th=[ 584], 95.00th=[ 584], | 99.00th=[ 584], 99.50th=[ 584], 99.90th=[ 584], 99.95th=[ 584], | 99.99th=[ 584] bw ( KiB/s): min= 1939, max= 2031, per=32.48%, avg=1985.00, stdev=65.05, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=3, BW=3323KiB/s (3402kB/s)(10.0MiB/3082msec); 0 zone resets clat (msec): min=120, max=571, avg=222.32, stdev=133.49 lat (msec): min=120, max=572, avg=222.66, stdev=133.44 clat percentiles (msec): | 1.00th=[ 121], 5.00th=[ 121], 10.00th=[ 121], 20.00th=[ 142], | 30.00th=[ 163], 40.00th=[ 167], 50.00th=[ 174], 60.00th=[ 182], | 70.00th=[ 184], 80.00th=[ 205], 90.00th=[ 317], 95.00th=[ 575], | 99.00th=[ 575], 99.50th=[ 575], 99.90th=[ 575], 99.95th=[ 575], | 99.99th=[ 575] bw ( KiB/s): min= 1939, max= 4079, per=42.23%, avg=3613.20, stdev=937.79, samples=5 iops : min= 1, max= 3, avg= 2.60, stdev= 0.89, samples=5 lat (msec) : 250=75.00%, 500=8.33%, 750=16.67% cpu : usr=0.00%, sys=4.80%, ctx=67, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178823: Sun Aug 23 04:09:35 2026 read: IOPS=1, BW=2043KiB/s (2092kB/s)(6144KiB/3008msec) clat (msec): min=63, max=376, avg=167.05, stdev=125.35 lat (msec): min=63, max=376, avg=167.05, stdev=125.35 clat percentiles (msec): | 1.00th=[ 64], 5.00th=[ 64], 10.00th=[ 64], 20.00th=[ 77], | 30.00th=[ 77], 40.00th=[ 100], 50.00th=[ 100], 60.00th=[ 125], | 70.00th=[ 264], 80.00th=[ 264], 90.00th=[ 376], 95.00th=[ 376], | 99.00th=[ 376], 99.50th=[ 376], 99.90th=[ 376], 99.95th=[ 376], | 99.99th=[ 376] bw ( KiB/s): min= 4055, max= 4063, per=66.42%, avg=4059.00, stdev= 5.66, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 write: IOPS=1, BW=2043KiB/s (2092kB/s)(6144KiB/3008msec); 0 zone resets clat (msec): min=57, max=541, avg=326.73, stdev=174.76 lat (msec): min=57, max=541, avg=326.91, stdev=174.69 clat percentiles (msec): | 1.00th=[ 58], 5.00th=[ 58], 10.00th=[ 58], 20.00th=[ 213], | 30.00th=[ 213], 40.00th=[ 313], 50.00th=[ 313], 60.00th=[ 376], | 70.00th=[ 464], 80.00th=[ 464], 90.00th=[ 542], 95.00th=[ 542], | 99.00th=[ 542], 99.50th=[ 542], 99.90th=[ 542], 99.95th=[ 542], | 99.99th=[ 542] bw ( KiB/s): min= 1928, max= 2027, per=22.96%, avg=1964.75, stdev=44.30, samples=4 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=4 lat (msec) : 100=33.33%, 250=16.67%, 500=41.67%, 750=8.33% cpu : usr=0.00%, sys=8.51%, ctx=101, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178824: Sun Aug 23 04:09:35 2026 read: IOPS=1, BW=1528KiB/s (1565kB/s)(5120KiB/3351msec) clat (msec): min=75, max=361, avg=182.52, stdev=121.14 lat (msec): min=75, max=361, avg=182.52, stdev=121.14 clat percentiles (msec): | 1.00th=[ 77], 5.00th=[ 77], 10.00th=[ 77], 20.00th=[ 77], | 30.00th=[ 108], 40.00th=[ 108], 50.00th=[ 115], 60.00th=[ 115], | 70.00th=[ 255], 80.00th=[ 255], 90.00th=[ 363], 95.00th=[ 363], | 99.00th=[ 363], 99.50th=[ 363], 99.90th=[ 363], 99.95th=[ 363], | 99.99th=[ 363] bw ( KiB/s): min= 2031, max= 6119, per=66.68%, avg=4075.00, stdev=2890.65, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 write: IOPS=2, BW=2139KiB/s (2190kB/s)(7168KiB/3351msec); 0 zone resets clat (msec): min=74, max=653, avg=267.25, stdev=255.34 lat (msec): min=74, max=653, avg=267.39, stdev=255.29 clat percentiles (msec): | 1.00th=[ 74], 5.00th=[ 74], 10.00th=[ 74], 20.00th=[ 79], | 30.00th=[ 113], 40.00th=[ 113], 50.00th=[ 123], 60.00th=[ 215], | 70.00th=[ 215], 80.00th=[ 617], 90.00th=[ 651], 95.00th=[ 651], | 99.00th=[ 651], 99.50th=[ 651], 99.90th=[ 651], 99.95th=[ 651], | 99.99th=[ 651] bw ( KiB/s): min= 2031, max= 6083, per=39.56%, avg=3384.33, stdev=2337.12, samples=3 iops : min= 1, max= 5, avg= 2.33, stdev= 2.31, samples=3 lat (msec) : 100=25.00%, 250=41.67%, 500=16.67%, 750=16.67% cpu : usr=0.00%, sys=9.25%, ctx=159, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=6112KiB/s (6258kB/s), 665KiB/s-2479KiB/s (680kB/s-2539kB/s), io=20.0MiB (20.0MB), run=2891-3351msec WRITE: bw=8556KiB/s (8762kB/s), 1771KiB/s-3323KiB/s (1814kB/s-3402kB/s), io=28.0MiB (29.4MB), run=2891-3351msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=178830: Sun Aug 23 04:09:47 2026 read: IOPS=1, BW=5076KiB/s (5197kB/s)(12.0MiB/2421msec) clat (msec): min=711, max=825, avg=778.02, stdev=59.04 lat (msec): min=711, max=825, avg=778.02, stdev=59.04 clat percentiles (msec): | 1.00th=[ 709], 5.00th=[ 709], 10.00th=[ 709], 20.00th=[ 709], | 30.00th=[ 709], 40.00th=[ 802], 50.00th=[ 802], 60.00th=[ 802], | 70.00th=[ 827], 80.00th=[ 827], 90.00th=[ 827], 95.00th=[ 827], | 99.00th=[ 827], 99.50th=[ 827], 99.90th=[ 827], 99.95th=[ 827], | 99.99th=[ 827] bw ( KiB/s): min= 7787, max= 8110, per=100.00%, avg=7948.50, stdev=228.40, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 1000=66.67% cpu : usr=0.00%, sys=14.79%, ctx=313, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178831: Sun Aug 23 04:09:47 2026 read: IOPS=0, BW=1365KiB/s (1398kB/s)(4096KiB/3001msec) clat (nsec): min=618442k, max=618442k, avg=618442293.00, stdev= 0.00 lat (nsec): min=618445k, max=618445k, avg=618444705.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 617], 5.00th=[ 617], 10.00th=[ 617], 20.00th=[ 617], | 30.00th=[ 617], 40.00th=[ 617], 50.00th=[ 617], 60.00th=[ 617], | 70.00th=[ 617], 80.00th=[ 617], 90.00th=[ 617], 95.00th=[ 617], | 99.00th=[ 617], 99.50th=[ 617], 99.90th=[ 617], 99.95th=[ 617], | 99.99th=[ 617] bw ( KiB/s): min= 8110, max= 8110, per=100.00%, avg=8110.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2730KiB/s (2795kB/s)(8192KiB/3001msec); 0 zone resets clat (msec): min=822, max=1526, avg=1174.78, stdev=497.61 lat (msec): min=823, max=1526, avg=1175.09, stdev=497.60 clat percentiles (msec): | 1.00th=[ 827], 5.00th=[ 827], 10.00th=[ 827], 20.00th=[ 827], | 30.00th=[ 827], 40.00th=[ 827], 50.00th=[ 827], 60.00th=[ 1519], | 70.00th=[ 1519], 80.00th=[ 1519], 90.00th=[ 1519], 95.00th=[ 1519], | 99.00th=[ 1519], 99.50th=[ 1519], 99.90th=[ 1519], 99.95th=[ 1519], | 99.99th=[ 1519] bw ( KiB/s): min= 8078, max= 8078, per=73.98%, avg=8078.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=4.10%, ctx=70, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178832: Sun Aug 23 04:09:47 2026 write: IOPS=1, BW=4322KiB/s (4426kB/s)(12.0MiB/2843msec); 0 zone resets clat (msec): min=863, max=1009, avg=923.34, stdev=76.33 lat (msec): min=864, max=1012, avg=924.60, stdev=78.00 clat percentiles (msec): | 1.00th=[ 860], 5.00th=[ 860], 10.00th=[ 860], 20.00th=[ 860], | 30.00th=[ 860], 40.00th=[ 894], 50.00th=[ 894], 60.00th=[ 894], | 70.00th=[ 1011], 80.00th=[ 1011], 90.00th=[ 1011], 95.00th=[ 1011], | 99.00th=[ 1011], 99.50th=[ 1011], 99.90th=[ 1011], 99.95th=[ 1011], | 99.99th=[ 1011] bw ( KiB/s): min= 8110, max= 8159, per=74.50%, avg=8134.50, stdev=34.65, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=66.67%, 2000=33.33% cpu : usr=0.00%, sys=4.68%, ctx=72, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178833: Sun Aug 23 04:09:47 2026 write: IOPS=1, BW=5758KiB/s (5896kB/s)(12.0MiB/2134msec); 0 zone resets clat (msec): min=518, max=862, avg=702.79, stdev=173.61 lat (msec): min=519, max=863, avg=703.61, stdev=172.92 clat percentiles (msec): | 1.00th=[ 518], 5.00th=[ 518], 10.00th=[ 518], 20.00th=[ 518], | 30.00th=[ 518], 40.00th=[ 726], 50.00th=[ 726], 60.00th=[ 726], | 70.00th=[ 860], 80.00th=[ 860], 90.00th=[ 860], 95.00th=[ 860], | 99.00th=[ 860], 99.50th=[ 860], 99.90th=[ 860], 99.95th=[ 860], | 99.99th=[ 860] bw ( KiB/s): min= 7501, max= 7787, per=70.01%, avg=7644.00, stdev=202.23, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=66.67%, 1000=33.33% cpu : usr=0.00%, sys=5.39%, ctx=50, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5460KiB/s (5591kB/s), 1365KiB/s-5076KiB/s (1398kB/s-5197kB/s), io=16.0MiB (16.8MB), run=2421-3001msec WRITE: bw=10.7MiB/s (11.2MB/s), 2730KiB/s-5758KiB/s (2795kB/s-5896kB/s), io=32.0MiB (33.6MB), run=2134-3001msec rand-rw: (groupid=0, jobs=1): err= 0: pid=178835: Sun Aug 23 04:09:48 2026 read: IOPS=1, BW=4362KiB/s (4467kB/s)(12.0MiB/2817msec) clat (msec): min=875, max=962, avg=922.05, stdev=43.61 lat (msec): min=875, max=962, avg=922.05, stdev=43.61 clat percentiles (msec): | 1.00th=[ 877], 5.00th=[ 877], 10.00th=[ 877], 20.00th=[ 877], | 30.00th=[ 877], 40.00th=[ 927], 50.00th=[ 927], 60.00th=[ 927], | 70.00th=[ 961], 80.00th=[ 961], 90.00th=[ 961], 95.00th=[ 961], | 99.00th=[ 961], 99.50th=[ 961], 99.90th=[ 961], 99.95th=[ 961], | 99.99th=[ 961] bw ( KiB/s): min= 7892, max= 8175, per=100.00%, avg=8033.50, stdev=200.11, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=100.00% cpu : usr=0.00%, sys=3.44%, ctx=57, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178836: Sun Aug 23 04:09:48 2026 read: IOPS=0, BW=1343KiB/s (1376kB/s)(4096KiB/3049msec) clat (nsec): min=1294.6M, max=1294.6M, avg=1294611538.00, stdev= 0.00 lat (nsec): min=1294.6M, max=1294.6M, avg=1294613601.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1301], 5.00th=[ 1301], 10.00th=[ 1301], 20.00th=[ 1301], | 30.00th=[ 1301], 40.00th=[ 1301], 50.00th=[ 1301], 60.00th=[ 1301], | 70.00th=[ 1301], 80.00th=[ 1301], 90.00th=[ 1301], 95.00th=[ 1301], | 99.00th=[ 1301], 99.50th=[ 1301], 99.90th=[ 1301], 99.95th=[ 1301], | 99.99th=[ 1301] bw ( KiB/s): min= 8192, max= 8192, per=100.00%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2687KiB/s (2751kB/s)(8192KiB/3049msec); 0 zone resets clat (msec): min=743, max=904, avg=823.92, stdev=114.39 lat (msec): min=743, max=905, avg=824.28, stdev=114.48 clat percentiles (msec): | 1.00th=[ 743], 5.00th=[ 743], 10.00th=[ 743], 20.00th=[ 743], | 30.00th=[ 743], 40.00th=[ 743], 50.00th=[ 743], 60.00th=[ 902], | 70.00th=[ 902], 80.00th=[ 902], 90.00th=[ 902], 95.00th=[ 902], | 99.00th=[ 902], 99.50th=[ 902], 99.90th=[ 902], 99.95th=[ 902], | 99.99th=[ 902] bw ( KiB/s): min= 8143, max= 8143, per=75.77%, avg=8143.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=3.74%, ctx=49, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178837: Sun Aug 23 04:09:48 2026 write: IOPS=0, BW=4062KiB/s (4160kB/s)(12.0MiB/3025msec); 0 zone resets clat (msec): min=530, max=1512, avg=967.46, stdev=499.70 lat (msec): min=530, max=1512, avg=967.77, stdev=499.62 clat percentiles (msec): | 1.00th=[ 531], 5.00th=[ 531], 10.00th=[ 531], 20.00th=[ 531], | 30.00th=[ 531], 40.00th=[ 860], 50.00th=[ 860], 60.00th=[ 860], | 70.00th=[ 1519], 80.00th=[ 1519], 90.00th=[ 1519], 95.00th=[ 1519], | 99.00th=[ 1519], 99.50th=[ 1519], 99.90th=[ 1519], 99.95th=[ 1519], | 99.99th=[ 1519] bw ( KiB/s): min= 8143, max= 8175, per=75.92%, avg=8159.00, stdev=22.63, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=3.77%, ctx=55, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178838: Sun Aug 23 04:09:48 2026 write: IOPS=1, BW=4907KiB/s (5025kB/s)(12.0MiB/2504msec); 0 zone resets clat (msec): min=249, max=1206, avg=792.52, stdev=491.27 lat (msec): min=250, max=1207, avg=793.28, stdev=491.45 clat percentiles (msec): | 1.00th=[ 251], 5.00th=[ 251], 10.00th=[ 251], 20.00th=[ 251], | 30.00th=[ 251], 40.00th=[ 919], 50.00th=[ 919], 60.00th=[ 919], | 70.00th=[ 1200], 80.00th=[ 1200], 90.00th=[ 1200], 95.00th=[ 1200], | 99.00th=[ 1200], 99.50th=[ 1200], 99.90th=[ 1200], 99.95th=[ 1200], | 99.99th=[ 1200] bw ( KiB/s): min= 8192, max= 8192, per=76.23%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=3.36%, ctx=57, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5374KiB/s (5503kB/s), 1343KiB/s-4362KiB/s (1376kB/s-4467kB/s), io=16.0MiB (16.8MB), run=2817-3049msec WRITE: bw=10.5MiB/s (11.0MB/s), 2687KiB/s-4907KiB/s (2751kB/s-5025kB/s), io=32.0MiB (33.6MB), run=2504-3049msec