== sanity test 398b: DIO and buffer IO race ============== 08:04:34 (1785758674) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 5.55731 s, 9.1 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=145156: Mon Aug 3 08:06:57 2026 read: IOPS=11, BW=47.6KiB/s (48.7kB/s)(5992KiB/125873msec) clat (usec): min=33, max=1052.5k, avg=41201.65, stdev=39443.65 lat (usec): min=34, max=1052.5k, avg=41203.06, stdev=39443.66 clat percentiles (usec): | 1.00th=[ 50], 5.00th=[ 62], 10.00th=[ 11600], | 20.00th=[ 19530], 30.00th=[ 24249], 40.00th=[ 29492], | 50.00th=[ 35390], 60.00th=[ 41681], 70.00th=[ 48497], | 80.00th=[ 58459], 90.00th=[ 77071], 95.00th=[ 92799], | 99.00th=[ 141558], 99.50th=[ 196084], 99.90th=[ 252707], | 99.95th=[1052771], 99.99th=[1052771] bw ( KiB/s): min= 7, max= 104, per=25.02%, avg=47.28, stdev=20.22, samples=247 iops : min= 1, max= 26, avg=11.19, stdev= 5.12, samples=247 write: IOPS=12, BW=50.0KiB/s (51.2kB/s)(6296KiB/125873msec); 0 zone resets clat (usec): min=1016, max=350065, avg=40451.09, stdev=39409.37 lat (usec): min=1018, max=350066, avg=40454.40, stdev=39408.17 clat percentiles (usec): | 1.00th=[ 1254], 5.00th=[ 1516], 10.00th=[ 2376], 20.00th=[ 5145], | 30.00th=[ 9503], 40.00th=[ 20317], 50.00th=[ 31589], 60.00th=[ 42730], | 70.00th=[ 54789], 80.00th=[ 68682], 90.00th=[ 94897], 95.00th=[115868], | 99.00th=[168821], 99.50th=[187696], 99.90th=[295699], 99.95th=[350225], | 99.99th=[350225] bw ( KiB/s): min= 7, max= 111, per=25.21%, avg=49.91, stdev=21.93, samples=246 iops : min= 1, max= 27, avg=11.85, stdev= 5.53, samples=246 lat (usec) : 50=0.59%, 100=3.32%, 250=0.16%, 500=0.10%, 750=0.03% lat (msec) : 2=4.46%, 4=3.91%, 10=7.75%, 20=10.51%, 50=38.02% lat (msec) : 100=25.07%, 250=5.96%, 500=0.10%, 2000=0.03% cpu : usr=0.09%, sys=5.58%, ctx=6648, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145157: Mon Aug 3 08:06:57 2026 read: IOPS=11, BW=46.0KiB/s (48.1kB/s)(5940KiB/126465msec) clat (usec): min=31, max=426393, avg=41130.57, stdev=31824.10 lat (usec): min=31, max=426394, avg=41133.67, stdev=31822.82 clat percentiles (usec): | 1.00th=[ 51], 5.00th=[ 65], 10.00th=[ 10028], 20.00th=[ 19792], | 30.00th=[ 25035], 40.00th=[ 29754], 50.00th=[ 34866], 60.00th=[ 41157], | 70.00th=[ 50594], 80.00th=[ 61080], 90.00th=[ 77071], 95.00th=[ 93848], | 99.00th=[139461], 99.50th=[158335], 99.90th=[346031], 99.95th=[425722], | 99.99th=[425722] bw ( KiB/s): min= 7, max= 118, per=24.74%, avg=46.77, stdev=21.32, samples=248 iops : min= 1, max= 29, avg=11.06, stdev= 5.38, samples=248 write: IOPS=12, BW=50.2KiB/s (51.4kB/s)(6348KiB/126465msec); 0 zone resets clat (usec): min=1058, max=1020.1k, avg=40901.83, stdev=48456.23 lat (usec): min=1059, max=1020.1k, avg=40907.86, stdev=48454.00 clat percentiles (usec): | 1.00th=[ 1254], 5.00th=[ 1483], 10.00th=[ 2409], | 20.00th=[ 5342], 30.00th=[ 9896], 40.00th=[ 19530], | 50.00th=[ 29230], 60.00th=[ 40109], 70.00th=[ 52691], | 80.00th=[ 67634], 90.00th=[ 94897], 95.00th=[ 114820], | 99.00th=[ 179307], 99.50th=[ 217056], 99.90th=[ 574620], | 99.95th=[1019216], 99.99th=[1019216] bw ( KiB/s): min= 7, max= 164, per=25.39%, avg=50.28, stdev=21.63, samples=247 iops : min= 1, max= 41, avg=11.94, stdev= 5.46, samples=247 lat (usec) : 50=0.46%, 100=3.29%, 250=0.36%, 500=0.20%, 750=0.03% lat (usec) : 1000=0.07% lat (msec) : 2=4.13%, 4=4.39%, 10=7.49%, 20=10.25%, 50=37.79% lat (msec) : 100=25.29%, 250=5.96%, 500=0.23%, 750=0.03%, 2000=0.03% cpu : usr=0.08%, sys=5.65%, ctx=6705, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145158: Mon Aug 3 08:06:57 2026 read: IOPS=11, BW=47.7KiB/s (48.9kB/s)(6028KiB/126246msec) clat (usec): min=32, max=795254, avg=39981.88, stdev=35210.26 lat (usec): min=32, max=795255, avg=39999.55, stdev=35223.30 clat percentiles (usec): | 1.00th=[ 49], 5.00th=[ 63], 10.00th=[ 3458], 20.00th=[ 19006], | 30.00th=[ 24249], 40.00th=[ 28705], 50.00th=[ 34341], 60.00th=[ 40633], | 70.00th=[ 46924], 80.00th=[ 57934], 90.00th=[ 71828], 95.00th=[ 91751], | 99.00th=[145753], 99.50th=[196084], 99.90th=[261096], 99.95th=[792724], | 99.99th=[792724] bw ( KiB/s): min= 7, max= 104, per=25.10%, avg=47.43, stdev=20.51, samples=247 iops : min= 1, max= 26, avg=11.23, stdev= 5.17, samples=247 write: IOPS=12, BW=49.6KiB/s (50.8kB/s)(6260KiB/126246msec); 0 zone resets clat (usec): min=1096, max=497208, avg=41862.89, stdev=42270.45 lat (usec): min=1097, max=497210, avg=41866.86, stdev=42270.32 clat percentiles (usec): | 1.00th=[ 1254], 5.00th=[ 1483], 10.00th=[ 2474], 20.00th=[ 5014], | 30.00th=[ 9503], 40.00th=[ 20841], 50.00th=[ 31589], 60.00th=[ 41157], | 70.00th=[ 53740], 80.00th=[ 72877], 90.00th=[ 99091], 95.00th=[122160], | 99.00th=[170918], 99.50th=[200279], 99.90th=[278922], 99.95th=[497026], | 99.99th=[497026] bw ( KiB/s): min= 7, max= 112, per=24.75%, avg=49.00, stdev=19.61, samples=248 iops : min= 1, max= 28, avg=11.62, stdev= 4.95, samples=248 lat (usec) : 50=0.59%, 100=3.52%, 250=0.46%, 500=0.16%, 1000=0.10% lat (msec) : 2=4.07%, 4=4.43%, 10=7.32%, 20=10.61%, 50=38.12% lat (msec) : 100=24.22%, 250=6.28%, 500=0.10%, 1000=0.03% cpu : usr=0.08%, sys=5.57%, ctx=6714, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145159: Mon Aug 3 08:06:57 2026 read: IOPS=12, BW=48.2KiB/s (49.4kB/s)(6052KiB/125475msec) clat (usec): min=32, max=838569, avg=41477.92, stdev=37424.21 lat (usec): min=32, max=838570, avg=41485.52, stdev=37423.47 clat percentiles (usec): | 1.00th=[ 49], 5.00th=[ 62], 10.00th=[ 8586], 20.00th=[ 19006], | 30.00th=[ 24773], 40.00th=[ 30016], 50.00th=[ 35390], 60.00th=[ 41681], | 70.00th=[ 49546], 80.00th=[ 60556], 90.00th=[ 74974], 95.00th=[ 90702], | 99.00th=[147850], 99.50th=[193987], 99.90th=[375391], 99.95th=[834667], | 99.99th=[834667] bw ( KiB/s): min= 7, max= 103, per=25.57%, avg=48.32, stdev=19.53, samples=245 iops : min= 1, max= 25, avg=11.45, stdev= 4.92, samples=245 write: IOPS=12, BW=49.7KiB/s (50.9kB/s)(6236KiB/125475msec); 0 zone resets clat (usec): min=1175, max=417405, avg=39891.86, stdev=40172.02 lat (usec): min=1176, max=417407, avg=39897.30, stdev=40170.96 clat percentiles (usec): | 1.00th=[ 1254], 5.00th=[ 1401], 10.00th=[ 2180], 20.00th=[ 5145], | 30.00th=[ 8848], 40.00th=[ 19006], 50.00th=[ 31589], 60.00th=[ 41157], | 70.00th=[ 52167], 80.00th=[ 67634], 90.00th=[ 89654], 95.00th=[112722], | 99.00th=[175113], 99.50th=[200279], 99.90th=[254804], 99.95th=[417334], | 99.99th=[417334] bw ( KiB/s): min= 7, max= 119, per=25.03%, avg=49.55, stdev=20.09, samples=246 iops : min= 1, max= 29, avg=11.76, stdev= 5.04, samples=246 lat (usec) : 50=0.65%, 100=3.58%, 250=0.42%, 500=0.07%, 1000=0.07% lat (msec) : 2=4.75%, 4=3.68%, 10=7.68%, 20=10.32%, 50=38.25% lat (msec) : 100=25.07%, 250=5.24%, 500=0.20%, 1000=0.03% cpu : usr=0.08%, sys=5.64%, ctx=6777, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=190KiB/s (194kB/s), 46.0KiB/s-48.2KiB/s (48.1kB/s-49.4kB/s), io=23.4MiB (24.6MB), run=125475-126465msec WRITE: bw=199KiB/s (204kB/s), 49.6KiB/s-50.2KiB/s (50.8kB/s-51.4kB/s), io=24.6MiB (25.7MB), run=125475-126465msec rand-rw: (groupid=0, jobs=1): err= 0: pid=145160: Mon Aug 3 08:09:47 2026 read: IOPS=5, BW=20.2KiB/s (20.7kB/s)(5992KiB/295952msec) clat (msec): min=5, max=1116, avg=36.84, stdev=43.65 lat (msec): min=5, max=1116, avg=36.84, stdev=43.65 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 16], | 30.00th=[ 18], 40.00th=[ 21], 50.00th=[ 25], 60.00th=[ 30], | 70.00th=[ 37], 80.00th=[ 50], 90.00th=[ 79], 95.00th=[ 104], | 99.00th=[ 182], 99.50th=[ 213], 99.90th=[ 268], 99.95th=[ 1116], | 99.99th=[ 1116] bw ( KiB/s): min= 7, max= 79, per=28.93%, avg=23.14, stdev=14.94, samples=499 iops : min= 1, max= 19, avg= 5.15, stdev= 3.76, samples=499 write: IOPS=5, BW=21.3KiB/s (21.8kB/s)(6296KiB/295953msec); 0 zone resets clat (msec): min=40, max=611, avg=152.74, stdev=68.40 lat (msec): min=40, max=611, avg=152.74, stdev=68.40 clat percentiles (msec): | 1.00th=[ 54], 5.00th=[ 70], 10.00th=[ 82], 20.00th=[ 96], | 30.00th=[ 111], 40.00th=[ 124], 50.00th=[ 140], 60.00th=[ 157], | 70.00th=[ 178], 80.00th=[ 201], 90.00th=[ 241], 95.00th=[ 288], | 99.00th=[ 372], 99.50th=[ 414], 99.90th=[ 558], 99.95th=[ 609], | 99.99th=[ 609] bw ( KiB/s): min= 7, max= 48, per=24.92%, avg=20.93, stdev= 8.97, samples=577 iops : min= 1, max= 12, avg= 4.60, stdev= 2.31, samples=577 lat (msec) : 10=2.54%, 20=15.53%, 50=21.55%, 100=18.07%, 250=37.73% lat (msec) : 500=4.46%, 750=0.10%, 2000=0.03% cpu : usr=0.04%, sys=1.27%, ctx=5333, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145161: Mon Aug 3 08:09:47 2026 read: IOPS=5, BW=20.1KiB/s (20.6kB/s)(5940KiB/295872msec) clat (msec): min=5, max=851, avg=37.00, stdev=41.95 lat (msec): min=5, max=851, avg=37.00, stdev=41.95 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 12], 20.00th=[ 15], | 30.00th=[ 18], 40.00th=[ 22], 50.00th=[ 25], 60.00th=[ 30], | 70.00th=[ 37], 80.00th=[ 49], 90.00th=[ 74], 95.00th=[ 102], | 99.00th=[ 203], 99.50th=[ 251], 99.90th=[ 351], 99.95th=[ 852], | 99.99th=[ 852] bw ( KiB/s): min= 7, max= 88, per=28.71%, avg=22.97, stdev=15.68, samples=498 iops : min= 1, max= 22, avg= 5.12, stdev= 3.95, samples=498 write: IOPS=5, BW=21.5KiB/s (21.0kB/s)(6348KiB/295872msec); 0 zone resets clat (msec): min=31, max=661, avg=151.58, stdev=67.35 lat (msec): min=31, max=661, avg=151.59, stdev=67.35 clat percentiles (msec): | 1.00th=[ 53], 5.00th=[ 68], 10.00th=[ 82], 20.00th=[ 97], | 30.00th=[ 112], 40.00th=[ 123], 50.00th=[ 138], 60.00th=[ 155], | 70.00th=[ 174], 80.00th=[ 201], 90.00th=[ 241], 95.00th=[ 271], | 99.00th=[ 347], 99.50th=[ 430], 99.90th=[ 617], 99.95th=[ 659], | 99.99th=[ 659] bw ( KiB/s): min= 7, max= 47, per=25.22%, avg=21.19, stdev= 9.10, samples=575 iops : min= 1, max= 11, avg= 4.67, stdev= 2.34, samples=575 lat (msec) : 10=2.41%, 20=15.30%, 50=21.58%, 100=17.77%, 250=38.48% lat (msec) : 500=4.33%, 750=0.10%, 1000=0.03% cpu : usr=0.04%, sys=1.26%, ctx=5140, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145162: Mon Aug 3 08:09:47 2026 read: IOPS=5, BW=20.3KiB/s (20.8kB/s)(6028KiB/296638msec) clat (msec): min=6, max=345, avg=38.72, stdev=40.32 lat (msec): min=6, max=345, avg=38.72, stdev=40.32 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 16], | 30.00th=[ 19], 40.00th=[ 22], 50.00th=[ 26], 60.00th=[ 30], | 70.00th=[ 38], 80.00th=[ 52], 90.00th=[ 81], 95.00th=[ 113], | 99.00th=[ 228], 99.50th=[ 268], 99.90th=[ 309], 99.95th=[ 347], | 99.99th=[ 347] bw ( KiB/s): min= 7, max= 112, per=28.40%, avg=22.72, stdev=15.62, samples=511 iops : min= 1, max= 28, avg= 5.04, stdev= 3.95, samples=511 write: IOPS=5, BW=21.1KiB/s (21.6kB/s)(6260KiB/296638msec); 0 zone resets clat (msec): min=38, max=927, avg=151.99, stdev=68.07 lat (msec): min=38, max=927, avg=151.99, stdev=68.08 clat percentiles (msec): | 1.00th=[ 54], 5.00th=[ 70], 10.00th=[ 81], 20.00th=[ 97], | 30.00th=[ 112], 40.00th=[ 125], 50.00th=[ 140], 60.00th=[ 157], | 70.00th=[ 176], 80.00th=[ 199], 90.00th=[ 241], 95.00th=[ 279], | 99.00th=[ 342], 99.50th=[ 380], 99.90th=[ 659], 99.95th=[ 927], | 99.99th=[ 927] bw ( KiB/s): min= 7, max= 55, per=24.80%, avg=20.83, stdev= 9.23, samples=577 iops : min= 1, max= 13, avg= 4.58, stdev= 2.35, samples=577 lat (msec) : 10=1.99%, 20=15.82%, 50=21.52%, 100=17.51%, 250=38.80% lat (msec) : 500=4.26%, 750=0.07%, 1000=0.03% cpu : usr=0.04%, sys=1.25%, ctx=5170, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145163: Mon Aug 3 08:09:47 2026 read: IOPS=5, BW=20.5KiB/s (20.0kB/s)(6052KiB/295182msec) clat (msec): min=6, max=381, avg=37.22, stdev=36.31 lat (msec): min=6, max=381, avg=37.22, stdev=36.31 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 16], | 30.00th=[ 19], 40.00th=[ 22], 50.00th=[ 26], 60.00th=[ 30], | 70.00th=[ 36], 80.00th=[ 48], 90.00th=[ 79], 95.00th=[ 112], | 99.00th=[ 197], 99.50th=[ 218], 99.90th=[ 300], 99.95th=[ 384], | 99.99th=[ 384] bw ( KiB/s): min= 7, max= 87, per=29.49%, avg=23.59, stdev=15.74, samples=495 iops : min= 1, max= 21, avg= 5.28, stdev= 3.94, samples=495 write: IOPS=5, BW=21.1KiB/s (21.6kB/s)(6236KiB/295182msec); 0 zone resets clat (msec): min=43, max=817, avg=152.94, stdev=66.67 lat (msec): min=43, max=817, avg=152.94, stdev=66.67 clat percentiles (msec): | 1.00th=[ 54], 5.00th=[ 71], 10.00th=[ 83], 20.00th=[ 99], | 30.00th=[ 112], 40.00th=[ 126], 50.00th=[ 142], 60.00th=[ 157], | 70.00th=[ 178], 80.00th=[ 203], 90.00th=[ 236], 95.00th=[ 271], | 99.00th=[ 355], 99.50th=[ 384], 99.90th=[ 527], 99.95th=[ 818], | 99.99th=[ 818] bw ( KiB/s): min= 7, max= 48, per=24.82%, avg=20.85, stdev= 8.90, samples=574 iops : min= 1, max= 12, avg= 4.58, stdev= 2.29, samples=574 lat (msec) : 10=1.66%, 20=15.20%, 50=23.37%, 100=16.54%, 250=39.03% lat (msec) : 500=4.10%, 750=0.07%, 1000=0.03% cpu : usr=0.05%, sys=1.28%, ctx=5201, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=80.9KiB/s (82.9kB/s), 20.1KiB/s-20.5KiB/s (20.6kB/s-20.0kB/s), io=23.4MiB (24.6MB), run=295182-296638msec WRITE: bw=84.7KiB/s (86.8kB/s), 21.1KiB/s-21.5KiB/s (21.6kB/s-21.0kB/s), io=24.6MiB (25.7MB), run=295182-296638msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=145226: Mon Aug 3 08:10:36 2026 read: IOPS=11, BW=180KiB/s (184kB/s)(5920KiB/32927msec) clat (usec): min=39, max=415778, avg=46108.39, stdev=38693.84 lat (usec): min=39, max=415780, avg=46116.45, stdev=38691.02 clat percentiles (usec): | 1.00th=[ 49], 5.00th=[ 66], 10.00th=[ 76], 20.00th=[ 15533], | 30.00th=[ 30016], 40.00th=[ 36439], 50.00th=[ 42730], 60.00th=[ 49546], | 70.00th=[ 56886], 80.00th=[ 66847], 90.00th=[ 88605], 95.00th=[105382], | 99.00th=[175113], 99.50th=[212861], 99.90th=[417334], 99.95th=[417334], | 99.99th=[417334] bw ( KiB/s): min= 31, max= 500, per=27.12%, avg=181.17, stdev=90.80, samples=64 iops : min= 1, max= 31, avg=10.58, stdev= 5.76, samples=64 write: IOPS=12, BW=193KiB/s (198kB/s)(6368KiB/32927msec); 0 zone resets clat (usec): min=1803, max=354181, avg=39724.94, stdev=42654.57 lat (usec): min=1806, max=354183, avg=39748.56, stdev=42654.54 clat percentiles (usec): | 1.00th=[ 1942], 5.00th=[ 2606], 10.00th=[ 3916], 20.00th=[ 7111], | 30.00th=[ 10552], 40.00th=[ 15008], 50.00th=[ 26608], 60.00th=[ 39060], | 70.00th=[ 48497], 80.00th=[ 63701], 90.00th=[ 96994], 95.00th=[124257], | 99.00th=[185598], 99.50th=[217056], 99.90th=[354419], 99.95th=[354419], | 99.99th=[354419] bw ( KiB/s): min= 31, max= 414, per=27.84%, avg=195.72, stdev=82.39, samples=64 iops : min= 1, max= 25, avg=11.50, stdev= 5.22, samples=64 lat (usec) : 50=0.65%, 100=6.51%, 250=0.65%, 500=0.39%, 750=0.13% lat (msec) : 2=1.17%, 4=4.69%, 10=10.29%, 20=9.24%, 50=32.03% lat (msec) : 100=26.04%, 250=7.94%, 500=0.26% cpu : usr=0.10%, sys=5.97%, ctx=1545, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145227: Mon Aug 3 08:10:36 2026 read: IOPS=10, BW=164KiB/s (168kB/s)(5744KiB/35025msec) clat (usec): min=42, max=381668, avg=51676.53, stdev=44016.99 lat (usec): min=43, max=381669, avg=51678.18, stdev=44016.76 clat percentiles (usec): | 1.00th=[ 59], 5.00th=[ 69], 10.00th=[ 84], 20.00th=[ 23200], | 30.00th=[ 32113], 40.00th=[ 38536], 50.00th=[ 45876], 60.00th=[ 52167], | 70.00th=[ 62653], 80.00th=[ 73925], 90.00th=[ 95945], 95.00th=[113771], | 99.00th=[235930], 99.50th=[304088], 99.90th=[379585], 99.95th=[379585], | 99.99th=[379585] bw ( KiB/s): min= 28, max= 343, per=24.58%, avg=164.17, stdev=70.24, samples=69 iops : min= 1, max= 21, avg= 9.49, stdev= 4.43, samples=69 write: IOPS=11, BW=187KiB/s (191kB/s)(6544KiB/35025msec); 0 zone resets clat (usec): min=1696, max=273662, avg=40075.40, stdev=40523.75 lat (usec): min=1698, max=273665, avg=40088.99, stdev=40527.05 clat percentiles (usec): | 1.00th=[ 1811], 5.00th=[ 2311], 10.00th=[ 4490], 20.00th=[ 7963], | 30.00th=[ 11863], 40.00th=[ 17433], 50.00th=[ 24773], 60.00th=[ 35390], | 70.00th=[ 51643], 80.00th=[ 66323], 90.00th=[102237], 95.00th=[120062], | 99.00th=[156238], 99.50th=[179307], 99.90th=[274727], 99.95th=[274727], | 99.99th=[274727] bw ( KiB/s): min= 62, max= 510, per=26.53%, avg=186.51, stdev=93.50, samples=69 iops : min= 3, max= 31, avg=10.91, stdev= 5.90, samples=69 lat (usec) : 50=0.26%, 100=5.08%, 250=1.17%, 500=0.26%, 750=0.13% lat (msec) : 2=1.69%, 4=3.26%, 10=9.11%, 20=10.55%, 50=32.55% lat (msec) : 100=27.08%, 250=8.46%, 500=0.39% cpu : usr=0.07%, sys=5.82%, ctx=1660, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145228: Mon Aug 3 08:10:36 2026 read: IOPS=11, BW=188KiB/s (193kB/s)(6256KiB/33264msec) clat (usec): min=37, max=206820, avg=46353.78, stdev=36599.31 lat (usec): min=37, max=206822, avg=46359.14, stdev=36602.23 clat percentiles (usec): | 1.00th=[ 47], 5.00th=[ 64], 10.00th=[ 71], 20.00th=[ 824], | 30.00th=[ 30278], 40.00th=[ 35914], 50.00th=[ 41157], 60.00th=[ 49021], | 70.00th=[ 60031], 80.00th=[ 74974], 90.00th=[ 91751], 95.00th=[107480], | 99.00th=[170918], 99.50th=[204473], 99.90th=[206570], 99.95th=[206570], | 99.99th=[206570] bw ( KiB/s): min= 56, max= 380, per=28.26%, avg=188.77, stdev=80.02, samples=65 iops : min= 3, max= 23, avg=11.06, stdev= 5.05, samples=65 write: IOPS=11, BW=181KiB/s (186kB/s)(6032KiB/33264msec); 0 zone resets clat (usec): min=1691, max=348204, avg=39926.64, stdev=43679.66 lat (usec): min=1692, max=348206, avg=39938.99, stdev=43678.92 clat percentiles (usec): | 1.00th=[ 1926], 5.00th=[ 2737], 10.00th=[ 4228], 20.00th=[ 7046], | 30.00th=[ 11207], 40.00th=[ 15926], 50.00th=[ 25560], 60.00th=[ 34866], | 70.00th=[ 44827], 80.00th=[ 69731], 90.00th=[ 95945], 95.00th=[122160], | 99.00th=[202376], 99.50th=[221250], 99.90th=[350225], 99.95th=[350225], | 99.99th=[350225] bw ( KiB/s): min= 31, max= 416, per=25.51%, avg=179.35, stdev=89.89, samples=65 iops : min= 1, max= 26, avg=10.46, stdev= 5.73, samples=65 lat (usec) : 50=0.78%, 100=8.33%, 250=0.26%, 500=0.39%, 750=0.26% lat (usec) : 1000=0.26% lat (msec) : 2=0.78%, 4=3.39%, 10=9.90%, 20=8.85%, 50=33.72% lat (msec) : 100=25.26%, 250=7.68%, 500=0.13% cpu : usr=0.09%, sys=5.82%, ctx=1625, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145229: Mon Aug 3 08:10:36 2026 read: IOPS=10, BW=168KiB/s (172kB/s)(6032KiB/35844msec) clat (usec): min=32, max=232387, avg=49155.06, stdev=36261.37 lat (usec): min=32, max=232389, avg=49156.62, stdev=36261.40 clat percentiles (usec): | 1.00th=[ 45], 5.00th=[ 67], 10.00th=[ 85], 20.00th=[ 19268], | 30.00th=[ 31851], 40.00th=[ 40109], 50.00th=[ 46924], 60.00th=[ 53740], | 70.00th=[ 60556], 80.00th=[ 73925], 90.00th=[ 94897], 95.00th=[111674], | 99.00th=[181404], 99.50th=[198181], 99.90th=[231736], 99.95th=[231736], | 99.99th=[231736] bw ( KiB/s): min= 28, max= 382, per=25.13%, avg=167.90, stdev=78.50, samples=69 iops : min= 1, max= 23, avg= 9.72, stdev= 4.89, samples=69 write: IOPS=10, BW=175KiB/s (179kB/s)(6256KiB/35844msec); 0 zone resets clat (usec): min=1749, max=381603, avg=44056.41, stdev=51986.17 lat (usec): min=1751, max=381605, avg=44089.86, stdev=51968.28 clat percentiles (usec): | 1.00th=[ 1795], 5.00th=[ 2540], 10.00th=[ 4178], 20.00th=[ 7111], | 30.00th=[ 11076], 40.00th=[ 15795], 50.00th=[ 26608], 60.00th=[ 39584], | 70.00th=[ 52691], 80.00th=[ 67634], 90.00th=[108528], 95.00th=[154141], | 99.00th=[256902], 99.50th=[308282], 99.90th=[379585], 99.95th=[379585], | 99.99th=[379585] bw ( KiB/s): min= 31, max= 350, per=24.45%, avg=171.91, stdev=72.54, samples=70 iops : min= 1, max= 21, avg=10.00, stdev= 4.60, samples=70 lat (usec) : 50=0.78%, 100=5.21%, 250=1.43%, 500=0.13%, 1000=0.13% lat (msec) : 2=1.43%, 4=3.65%, 10=9.51%, 20=10.81%, 50=28.91% lat (msec) : 100=28.39%, 250=9.11%, 500=0.52% cpu : usr=0.08%, sys=5.69%, ctx=1634, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=668KiB/s (684kB/s), 164KiB/s-188KiB/s (168kB/s-193kB/s), io=23.4MiB (24.5MB), run=32927-35844msec WRITE: bw=703KiB/s (720kB/s), 175KiB/s-193KiB/s (179kB/s-198kB/s), io=24.6MiB (25.8MB), run=32927-35844msec rand-rw: (groupid=0, jobs=1): err= 0: pid=145221: Mon Aug 3 08:11:20 2026 read: IOPS=4, BW=73.5KiB/s (75.2kB/s)(5920KiB/80582msec) clat (msec): min=8, max=262, avg=50.69, stdev=42.30 lat (msec): min=8, max=262, avg=50.71, stdev=42.33 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 15], 10.00th=[ 17], 20.00th=[ 23], | 30.00th=[ 27], 40.00th=[ 31], 50.00th=[ 36], 60.00th=[ 42], | 70.00th=[ 52], 80.00th=[ 71], 90.00th=[ 105], 95.00th=[ 140], | 99.00th=[ 213], 99.50th=[ 232], 99.90th=[ 264], 99.95th=[ 264], | 99.99th=[ 264] bw ( KiB/s): min= 30, max= 256, per=28.45%, avg=83.93, stdev=50.46, samples=138 iops : min= 1, max= 16, avg= 4.45, stdev= 3.22, samples=138 write: IOPS=4, BW=79.0KiB/s (80.9kB/s)(6368KiB/80582msec); 0 zone resets clat (msec): min=45, max=408, avg=154.81, stdev=63.37 lat (msec): min=45, max=408, avg=154.81, stdev=63.37 clat percentiles (msec): | 1.00th=[ 56], 5.00th=[ 74], 10.00th=[ 85], 20.00th=[ 106], | 30.00th=[ 115], 40.00th=[ 128], 50.00th=[ 142], 60.00th=[ 159], | 70.00th=[ 180], 80.00th=[ 205], 90.00th=[ 241], 95.00th=[ 288], | 99.00th=[ 334], 99.50th=[ 405], 99.90th=[ 409], 99.95th=[ 409], | 99.99th=[ 409] bw ( KiB/s): min= 28, max= 192, per=25.87%, avg=80.21, stdev=32.54, samples=156 iops : min= 1, max= 12, avg= 4.23, stdev= 2.13, samples=156 lat (msec) : 10=0.13%, 20=7.55%, 50=25.65%, 100=18.10%, 250=44.01% lat (msec) : 500=4.56% cpu : usr=0.03%, sys=1.51%, ctx=1429, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145222: Mon Aug 3 08:11:20 2026 read: IOPS=4, BW=70.9KiB/s (72.6kB/s)(5744KiB/81048msec) clat (msec): min=9, max=337, avg=47.36, stdev=42.71 lat (msec): min=9, max=337, avg=47.37, stdev=42.71 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 14], 10.00th=[ 18], 20.00th=[ 22], | 30.00th=[ 27], 40.00th=[ 30], 50.00th=[ 34], 60.00th=[ 40], | 70.00th=[ 47], 80.00th=[ 58], 90.00th=[ 91], 95.00th=[ 138], | 99.00th=[ 234], 99.50th=[ 296], 99.90th=[ 338], 99.95th=[ 338], | 99.99th=[ 338] bw ( KiB/s): min= 28, max= 288, per=28.99%, avg=85.52, stdev=56.62, samples=132 iops : min= 1, max= 18, avg= 4.58, stdev= 3.57, samples=132 write: IOPS=5, BW=80.7KiB/s (82.7kB/s)(6544KiB/81048msec); 0 zone resets clat (msec): min=46, max=485, avg=156.34, stdev=70.88 lat (msec): min=46, max=485, avg=156.35, stdev=70.88 clat percentiles (msec): | 1.00th=[ 59], 5.00th=[ 73], 10.00th=[ 82], 20.00th=[ 99], | 30.00th=[ 113], 40.00th=[ 128], 50.00th=[ 142], 60.00th=[ 161], | 70.00th=[ 178], 80.00th=[ 203], 90.00th=[ 247], 95.00th=[ 292], | 99.00th=[ 397], 99.50th=[ 426], 99.90th=[ 485], 99.95th=[ 485], | 99.99th=[ 485] bw ( KiB/s): min= 30, max= 186, per=26.35%, avg=81.68, stdev=35.20, samples=157 iops : min= 1, max= 11, avg= 4.32, stdev= 2.27, samples=157 lat (msec) : 10=0.26%, 20=7.03%, 50=27.99%, 100=19.53%, 250=39.97% lat (msec) : 500=5.21% cpu : usr=0.05%, sys=1.55%, ctx=1374, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145223: Mon Aug 3 08:11:20 2026 read: IOPS=4, BW=78.3KiB/s (80.2kB/s)(6256KiB/79879msec) clat (msec): min=7, max=345, avg=48.19, stdev=45.33 lat (msec): min=7, max=345, avg=48.19, stdev=45.33 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 14], 10.00th=[ 17], 20.00th=[ 22], | 30.00th=[ 26], 40.00th=[ 30], 50.00th=[ 35], 60.00th=[ 40], | 70.00th=[ 49], 80.00th=[ 66], 90.00th=[ 89], 95.00th=[ 132], | 99.00th=[ 243], 99.50th=[ 334], 99.90th=[ 347], 99.95th=[ 347], | 99.99th=[ 347] bw ( KiB/s): min= 29, max= 317, per=28.94%, avg=85.37, stdev=55.76, samples=144 iops : min= 1, max= 19, avg= 4.56, stdev= 3.49, samples=144 write: IOPS=4, BW=75.5KiB/s (77.3kB/s)(6032KiB/79879msec); 0 zone resets clat (msec): min=48, max=456, avg=161.37, stdev=70.67 lat (msec): min=48, max=456, avg=161.40, stdev=70.68 clat percentiles (msec): | 1.00th=[ 59], 5.00th=[ 74], 10.00th=[ 86], 20.00th=[ 104], | 30.00th=[ 120], 40.00th=[ 136], 50.00th=[ 144], 60.00th=[ 163], | 70.00th=[ 184], 80.00th=[ 213], 90.00th=[ 255], 95.00th=[ 296], | 99.00th=[ 397], 99.50th=[ 418], 99.90th=[ 456], 99.95th=[ 456], | 99.99th=[ 456] bw ( KiB/s): min= 29, max= 160, per=24.75%, avg=76.71, stdev=31.20, samples=153 iops : min= 1, max= 10, avg= 4.01, stdev= 2.02, samples=153 lat (msec) : 10=0.78%, 20=8.20%, 50=27.60%, 100=19.14%, 250=38.41% lat (msec) : 500=5.86% cpu : usr=0.03%, sys=1.54%, ctx=1463, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145224: Mon Aug 3 08:11:20 2026 read: IOPS=4, BW=74.5KiB/s (76.3kB/s)(6032KiB/80941msec) clat (msec): min=8, max=266, avg=47.01, stdev=43.31 lat (msec): min=8, max=266, avg=47.01, stdev=43.31 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 14], 10.00th=[ 17], 20.00th=[ 21], | 30.00th=[ 25], 40.00th=[ 28], 50.00th=[ 32], 60.00th=[ 38], | 70.00th=[ 45], 80.00th=[ 57], 90.00th=[ 102], 95.00th=[ 150], | 99.00th=[ 228], 99.50th=[ 251], 99.90th=[ 268], 99.95th=[ 268], | 99.99th=[ 268] bw ( KiB/s): min= 29, max= 256, per=29.62%, avg=87.39, stdev=52.97, samples=135 iops : min= 1, max= 16, avg= 4.68, stdev= 3.38, samples=135 write: IOPS=4, BW=77.3KiB/s (79.1kB/s)(6256KiB/80941msec); 0 zone resets clat (msec): min=49, max=528, avg=161.25, stdev=72.50 lat (msec): min=49, max=528, avg=161.25, stdev=72.50 clat percentiles (msec): | 1.00th=[ 57], 5.00th=[ 75], 10.00th=[ 87], 20.00th=[ 106], | 30.00th=[ 117], 40.00th=[ 133], 50.00th=[ 146], 60.00th=[ 165], | 70.00th=[ 182], 80.00th=[ 211], 90.00th=[ 255], 95.00th=[ 292], | 99.00th=[ 418], 99.50th=[ 489], 99.90th=[ 527], 99.95th=[ 527], | 99.99th=[ 527] bw ( KiB/s): min= 30, max= 160, per=25.63%, avg=79.45, stdev=32.84, samples=155 iops : min= 1, max= 10, avg= 4.19, stdev= 2.14, samples=155 lat (msec) : 10=1.04%, 20=8.07%, 50=27.08%, 100=16.93%, 250=41.15% lat (msec) : 500=5.60%, 750=0.13% cpu : usr=0.04%, sys=1.49%, ctx=1486, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=296KiB/s (303kB/s), 70.9KiB/s-78.3KiB/s (72.6kB/s-80.2kB/s), io=23.4MiB (24.5MB), run=79879-81048msec WRITE: bw=311KiB/s (318kB/s), 75.5KiB/s-80.7KiB/s (77.3kB/s-82.7kB/s), io=24.6MiB (25.8MB), run=79879-81048msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=145250: Mon Aug 3 08:11:36 2026 read: IOPS=1, BW=1314KiB/s (1346kB/s)(7168KiB/5455msec) clat (msec): min=98, max=2492, avg=534.71, stdev=866.81 lat (msec): min=98, max=2492, avg=534.72, stdev=866.81 clat percentiles (msec): | 1.00th=[ 100], 5.00th=[ 100], 10.00th=[ 100], 20.00th=[ 146], | 30.00th=[ 203], 40.00th=[ 203], 50.00th=[ 209], 60.00th=[ 241], | 70.00th=[ 241], 80.00th=[ 355], 90.00th=[ 2500], 95.00th=[ 2500], | 99.00th=[ 2500], 99.50th=[ 2500], 99.90th=[ 2500], 99.95th=[ 2500], | 99.99th=[ 2500] bw ( KiB/s): min= 2048, max= 3953, per=86.45%, avg=2991.00, stdev=1088.99, samples=4 iops : min= 2, max= 3, avg= 2.50, stdev= 0.58, samples=4 write: IOPS=0, BW=939KiB/s (961kB/s)(5120KiB/5455msec); 0 zone resets clat (msec): min=162, max=480, avg=334.69, stdev=142.78 lat (msec): min=162, max=480, avg=334.78, stdev=142.82 clat percentiles (msec): | 1.00th=[ 163], 5.00th=[ 163], 10.00th=[ 163], 20.00th=[ 163], | 30.00th=[ 213], 40.00th=[ 213], 50.00th=[ 363], 60.00th=[ 363], | 70.00th=[ 456], 80.00th=[ 456], 90.00th=[ 481], 95.00th=[ 481], | 99.00th=[ 481], 99.50th=[ 481], 99.90th=[ 481], 99.95th=[ 481], | 99.99th=[ 481] bw ( KiB/s): min= 1924, max= 4079, per=51.65%, avg=2502.00, stdev=1052.64, samples=4 iops : min= 1, max= 3, avg= 1.75, stdev= 0.96, samples=4 lat (msec) : 100=8.33%, 250=50.00%, 500=33.33%, >=2000=8.33% cpu : usr=0.00%, sys=14.56%, ctx=744, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145251: Mon Aug 3 08:11:36 2026 read: IOPS=0, BW=346KiB/s (354kB/s)(2048KiB/5919msec) clat (msec): min=155, max=193, avg=174.18, stdev=27.02 lat (msec): min=155, max=193, avg=174.18, stdev=27.02 clat percentiles (msec): | 1.00th=[ 155], 5.00th=[ 155], 10.00th=[ 155], 20.00th=[ 155], | 30.00th=[ 155], 40.00th=[ 155], 50.00th=[ 155], 60.00th=[ 194], | 70.00th=[ 194], 80.00th=[ 194], 90.00th=[ 194], 95.00th=[ 194], | 99.00th=[ 194], 99.50th=[ 194], 99.90th=[ 194], 99.95th=[ 194], | 99.99th=[ 194] bw ( KiB/s): min= 2031, max= 2048, per=58.95%, avg=2039.50, stdev=12.02, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 write: IOPS=1, BW=1730KiB/s (1772kB/s)(10.0MiB/5919msec); 0 zone resets clat (msec): min=139, max=2702, avg=545.25, stdev=776.93 lat (msec): min=139, max=2702, avg=545.33, stdev=776.92 clat percentiles (msec): | 1.00th=[ 140], 5.00th=[ 140], 10.00th=[ 140], 20.00th=[ 203], | 30.00th=[ 224], 40.00th=[ 239], 50.00th=[ 249], 60.00th=[ 249], | 70.00th=[ 347], 80.00th=[ 351], 90.00th=[ 760], 95.00th=[ 2702], | 99.00th=[ 2702], 99.50th=[ 2702], 99.90th=[ 2702], 99.95th=[ 2702], | 99.99th=[ 2702] bw ( KiB/s): min= 1924, max= 6071, per=61.90%, avg=2998.67, stdev=1697.92, samples=6 iops : min= 1, max= 5, avg= 2.17, stdev= 1.60, samples=6 lat (msec) : 250=66.67%, 500=16.67%, 1000=8.33%, >=2000=8.33% cpu : usr=0.02%, sys=12.94%, ctx=244, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145252: Mon Aug 3 08:11:36 2026 read: IOPS=1, BW=1049KiB/s (1075kB/s)(6144KiB/5855msec) clat (usec): min=550, max=354944, avg=177259.14, stdev=142795.23 lat (usec): min=551, max=354945, avg=177260.36, stdev=142795.32 clat percentiles (usec): | 1.00th=[ 553], 5.00th=[ 553], 10.00th=[ 553], 20.00th=[ 9241], | 30.00th=[ 9241], 40.00th=[210764], 50.00th=[210764], 60.00th=[223347], | 70.00th=[265290], 80.00th=[265290], 90.00th=[354419], 95.00th=[354419], | 99.00th=[354419], 99.50th=[354419], 99.90th=[354419], 99.95th=[354419], | 99.99th=[354419] bw ( KiB/s): min= 1924, max= 4096, per=72.85%, avg=2520.50, stdev=1051.56, samples=4 iops : min= 1, max= 4, avg= 1.75, stdev= 1.50, samples=4 write: IOPS=1, BW=1049KiB/s (1075kB/s)(6144KiB/5855msec); 0 zone resets clat (msec): min=194, max=2980, avg=775.92, stdev=1090.60 lat (msec): min=194, max=2980, avg=775.99, stdev=1090.62 clat percentiles (msec): | 1.00th=[ 194], 5.00th=[ 194], 10.00th=[ 194], 20.00th=[ 266], | 30.00th=[ 266], 40.00th=[ 288], 50.00th=[ 288], 60.00th=[ 300], | 70.00th=[ 634], 80.00th=[ 634], 90.00th=[ 2970], 95.00th=[ 2970], | 99.00th=[ 2970], 99.50th=[ 2970], 99.90th=[ 2970], 99.95th=[ 2970], | 99.99th=[ 2970] bw ( KiB/s): min= 1924, max= 2048, per=41.51%, avg=2010.60, stdev=50.30, samples=5 iops : min= 1, max= 2, avg= 1.20, stdev= 0.45, samples=5 lat (usec) : 750=8.33% lat (msec) : 10=8.33%, 250=25.00%, 500=41.67%, 750=8.33%, >=2000=8.33% cpu : usr=0.02%, sys=10.95%, ctx=331, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145253: Mon Aug 3 08:11:36 2026 read: IOPS=1, BW=1072KiB/s (1098kB/s)(5120KiB/4775msec) clat (usec): min=596, max=302396, avg=129743.00, stdev=133278.19 lat (usec): min=598, max=302397, avg=129744.10, stdev=133277.90 clat percentiles (usec): | 1.00th=[ 594], 5.00th=[ 594], 10.00th=[ 594], 20.00th=[ 594], | 30.00th=[ 1045], 40.00th=[ 1045], 50.00th=[125305], 60.00th=[125305], | 70.00th=[219153], 80.00th=[219153], 90.00th=[304088], 95.00th=[304088], | 99.00th=[304088], 99.50th=[304088], 99.90th=[304088], 99.95th=[304088], | 99.99th=[304088] bw ( KiB/s): min= 2039, max= 5774, per=100.00%, avg=3906.50, stdev=2641.04, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 write: IOPS=1, BW=1501KiB/s (1537kB/s)(7168KiB/4775msec); 0 zone resets clat (msec): min=123, max=2510, avg=569.07, stdev=869.67 lat (msec): min=123, max=2510, avg=569.13, stdev=869.66 clat percentiles (msec): | 1.00th=[ 124], 5.00th=[ 124], 10.00th=[ 124], 20.00th=[ 148], | 30.00th=[ 150], 40.00th=[ 150], 50.00th=[ 201], 60.00th=[ 284], | 70.00th=[ 284], 80.00th=[ 567], 90.00th=[ 2500], 95.00th=[ 2500], | 99.00th=[ 2500], 99.50th=[ 2500], 99.90th=[ 2500], 99.95th=[ 2500], | 99.99th=[ 2500] bw ( KiB/s): min= 1424, max= 4079, per=58.01%, avg=2810.00, stdev=1331.96, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 1.15, samples=4 lat (usec) : 750=8.33% lat (msec) : 2=8.33%, 250=50.00%, 500=16.67%, 750=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=12.69%, ctx=106, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3460KiB/s (3543kB/s), 346KiB/s-1314KiB/s (354kB/s-1346kB/s), io=20.0MiB (20.0MB), run=4775-5919msec WRITE: bw=4844KiB/s (4960kB/s), 939KiB/s-1730KiB/s (961kB/s-1772kB/s), io=28.0MiB (29.4MB), run=4775-5919msec rand-rw: (groupid=0, jobs=1): err= 0: pid=145254: Mon Aug 3 08:11:37 2026 read: IOPS=1, BW=1048KiB/s (1073kB/s)(7168KiB/6838msec) clat (msec): min=91, max=2466, avg=779.20, stdev=926.36 lat (msec): min=91, max=2466, avg=779.21, stdev=926.35 clat percentiles (msec): | 1.00th=[ 92], 5.00th=[ 92], 10.00th=[ 92], 20.00th=[ 107], | 30.00th=[ 111], 40.00th=[ 111], 50.00th=[ 326], 60.00th=[ 726], | 70.00th=[ 726], 80.00th=[ 1620], 90.00th=[ 2467], 95.00th=[ 2467], | 99.00th=[ 2467], 99.50th=[ 2467], 99.90th=[ 2467], 99.95th=[ 2467], | 99.99th=[ 2467] bw ( KiB/s): min= 1928, max= 4096, per=83.66%, avg=2503.00, stdev=1062.80, samples=4 iops : min= 1, max= 4, avg= 1.75, stdev= 1.50, samples=4 write: IOPS=0, BW=749KiB/s (767kB/s)(5120KiB/6838msec); 0 zone resets clat (msec): min=155, max=454, avg=268.13, stdev=117.33 lat (msec): min=155, max=454, avg=268.24, stdev=117.33 clat percentiles (msec): | 1.00th=[ 155], 5.00th=[ 155], 10.00th=[ 155], 20.00th=[ 155], | 30.00th=[ 182], 40.00th=[ 182], 50.00th=[ 271], 60.00th=[ 271], | 70.00th=[ 279], 80.00th=[ 279], 90.00th=[ 456], 95.00th=[ 456], | 99.00th=[ 456], 99.50th=[ 456], 99.90th=[ 456], 99.95th=[ 456], | 99.99th=[ 456] bw ( KiB/s): min= 1928, max= 4096, per=71.90%, avg=3012.00, stdev=1533.01, samples=2 iops : min= 1, max= 4, avg= 2.50, stdev= 2.12, samples=2 lat (msec) : 100=8.33%, 250=33.33%, 500=33.33%, 750=8.33%, 2000=8.33% lat (msec) : >=2000=8.33% cpu : usr=0.01%, sys=2.87%, ctx=68, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145255: Mon Aug 3 08:11:37 2026 read: IOPS=0, BW=305KiB/s (313kB/s)(2048KiB/6707msec) clat (msec): min=153, max=201, avg=177.51, stdev=33.96 lat (msec): min=153, max=201, avg=177.51, stdev=33.96 clat percentiles (msec): | 1.00th=[ 155], 5.00th=[ 155], 10.00th=[ 155], 20.00th=[ 155], | 30.00th=[ 155], 40.00th=[ 155], 50.00th=[ 155], 60.00th=[ 203], | 70.00th=[ 203], 80.00th=[ 203], 90.00th=[ 203], 95.00th=[ 203], | 99.00th=[ 203], 99.50th=[ 203], 99.90th=[ 203], 99.95th=[ 203], | 99.99th=[ 203] bw ( KiB/s): min= 1416, max= 2048, per=57.89%, avg=1732.00, stdev=446.89, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 write: IOPS=1, BW=1527KiB/s (1563kB/s)(10.0MiB/6707msec); 0 zone resets clat (msec): min=142, max=3459, avg=620.72, stdev=1018.87 lat (msec): min=142, max=3459, avg=620.80, stdev=1018.87 clat percentiles (msec): | 1.00th=[ 144], 5.00th=[ 144], 10.00th=[ 144], 20.00th=[ 165], | 30.00th=[ 165], 40.00th=[ 178], 50.00th=[ 203], 60.00th=[ 264], | 70.00th=[ 330], 80.00th=[ 489], 90.00th=[ 818], 95.00th=[ 3473], | 99.00th=[ 3473], 99.50th=[ 3473], 99.90th=[ 3473], 99.95th=[ 3473], | 99.99th=[ 3473] bw ( KiB/s): min= 1924, max= 6144, per=63.65%, avg=2666.17, stdev=1704.40, samples=6 iops : min= 1, max= 6, avg= 2.00, stdev= 2.00, samples=6 lat (msec) : 250=58.33%, 500=25.00%, 1000=8.33%, >=2000=8.33% cpu : usr=0.01%, sys=4.09%, ctx=100, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145256: Mon Aug 3 08:11:37 2026 read: IOPS=0, BW=1021KiB/s (1046kB/s)(6144KiB/6016msec) clat (msec): min=93, max=526, avg=191.04, stdev=167.83 lat (msec): min=93, max=526, avg=191.05, stdev=167.83 clat percentiles (msec): | 1.00th=[ 94], 5.00th=[ 94], 10.00th=[ 94], 20.00th=[ 94], | 30.00th=[ 94], 40.00th=[ 104], 50.00th=[ 104], 60.00th=[ 157], | 70.00th=[ 171], 80.00th=[ 171], 90.00th=[ 527], 95.00th=[ 527], | 99.00th=[ 527], 99.50th=[ 527], 99.90th=[ 527], 99.95th=[ 527], | 99.99th=[ 527] bw ( KiB/s): min= 1858, max= 3992, per=100.00%, avg=3230.67, stdev=1191.13, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 write: IOPS=0, BW=1021KiB/s (1046kB/s)(6144KiB/6016msec); 0 zone resets clat (msec): min=127, max=2821, avg=807.53, stdev=1022.06 lat (msec): min=127, max=2821, avg=807.60, stdev=1022.06 clat percentiles (msec): | 1.00th=[ 128], 5.00th=[ 128], 10.00th=[ 128], 20.00th=[ 211], | 30.00th=[ 211], 40.00th=[ 317], 50.00th=[ 317], 60.00th=[ 489], | 70.00th=[ 885], 80.00th=[ 885], 90.00th=[ 2836], 95.00th=[ 2836], | 99.00th=[ 2836], 99.50th=[ 2836], 99.90th=[ 2836], 99.95th=[ 2836], | 99.99th=[ 2836] bw ( KiB/s): min= 1858, max= 4023, per=59.13%, avg=2477.00, stdev=1033.37, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (msec) : 100=16.67%, 250=41.67%, 500=16.67%, 750=8.33%, 1000=8.33% lat (msec) : >=2000=8.33% cpu : usr=0.03%, sys=3.87%, ctx=152, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145257: Mon Aug 3 08:11:37 2026 read: IOPS=0, BW=748KiB/s (766kB/s)(5120KiB/6843msec) clat (msec): min=92, max=555, avg=348.24, stdev=210.92 lat (msec): min=92, max=555, avg=348.24, stdev=210.92 clat percentiles (msec): | 1.00th=[ 93], 5.00th=[ 93], 10.00th=[ 93], 20.00th=[ 93], | 30.00th=[ 163], 40.00th=[ 163], 50.00th=[ 401], 60.00th=[ 401], | 70.00th=[ 531], 80.00th=[ 531], 90.00th=[ 558], 95.00th=[ 558], | 99.00th=[ 558], 99.50th=[ 558], 99.90th=[ 558], 99.95th=[ 558], | 99.99th=[ 558] bw ( KiB/s): min= 1992, max= 4096, per=90.64%, avg=2712.00, stdev=1198.91, samples=3 iops : min= 1, max= 4, avg= 2.33, stdev= 1.53, samples=3 write: IOPS=1, BW=1047KiB/s (1073kB/s)(7168KiB/6843msec); 0 zone resets clat (msec): min=153, max=3334, avg=716.83, stdev=1161.57 lat (msec): min=154, max=3334, avg=716.90, stdev=1161.58 clat percentiles (msec): | 1.00th=[ 155], 5.00th=[ 155], 10.00th=[ 155], 20.00th=[ 165], | 30.00th=[ 211], 40.00th=[ 211], 50.00th=[ 300], 60.00th=[ 321], | 70.00th=[ 321], 80.00th=[ 535], 90.00th=[ 3339], 95.00th=[ 3339], | 99.00th=[ 3339], 99.50th=[ 3339], 99.90th=[ 3339], 99.95th=[ 3339], | 99.99th=[ 3339] bw ( KiB/s): min= 1490, max= 4047, per=64.15%, avg=2687.20, stdev=1203.59, samples=5 iops : min= 1, max= 3, avg= 2.00, stdev= 1.00, samples=5 lat (msec) : 100=8.33%, 250=33.33%, 500=25.00%, 750=25.00%, >=2000=8.33% cpu : usr=0.00%, sys=3.65%, ctx=104, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2993KiB/s (3065kB/s), 305KiB/s-1048KiB/s (313kB/s-1073kB/s), io=20.0MiB (20.0MB), run=6016-6843msec WRITE: bw=4190KiB/s (4291kB/s), 749KiB/s-1527KiB/s (767kB/s-1563kB/s), io=28.0MiB (29.4MB), run=6016-6843msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=145269: Mon Aug 3 08:11:50 2026 read: IOPS=1, BW=4592KiB/s (4702kB/s)(12.0MiB/2676msec) clat (msec): min=700, max=908, avg=790.99, stdev=106.45 lat (msec): min=700, max=908, avg=790.99, stdev=106.45 clat percentiles (msec): | 1.00th=[ 701], 5.00th=[ 701], 10.00th=[ 701], 20.00th=[ 701], | 30.00th=[ 701], 40.00th=[ 768], 50.00th=[ 768], 60.00th=[ 768], | 70.00th=[ 911], 80.00th=[ 911], 90.00th=[ 911], 95.00th=[ 911], | 99.00th=[ 911], 99.50th=[ 911], 99.90th=[ 911], 99.95th=[ 911], | 99.99th=[ 911] bw ( KiB/s): min= 8047, max= 8192, per=100.00%, avg=8119.50, stdev=102.53, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 750=33.33%, 1000=66.67% cpu : usr=0.07%, sys=16.90%, ctx=243, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145270: Mon Aug 3 08:11:50 2026 read: IOPS=0, BW=1178KiB/s (1206kB/s)(4096KiB/3478msec) clat (nsec): min=1010.7M, max=1010.7M, avg=1010652704.00, stdev= 0.00 lat (nsec): min=1010.7M, max=1010.7M, avg=1010654917.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1011], 5.00th=[ 1011], 10.00th=[ 1011], 20.00th=[ 1011], | 30.00th=[ 1011], 40.00th=[ 1011], 50.00th=[ 1011], 60.00th=[ 1011], | 70.00th=[ 1011], 80.00th=[ 1011], 90.00th=[ 1011], 95.00th=[ 1011], | 99.00th=[ 1011], 99.50th=[ 1011], 99.90th=[ 1011], 99.95th=[ 1011], | 99.99th=[ 1011] bw ( KiB/s): min= 8047, max= 8047, per=100.00%, avg=8047.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2355KiB/s (2412kB/s)(8192KiB/3478msec); 0 zone resets clat (msec): min=1123, max=1253, avg=1188.23, stdev=92.21 lat (msec): min=1126, max=1253, avg=1190.29, stdev=89.72 clat percentiles (msec): | 1.00th=[ 1116], 5.00th=[ 1116], 10.00th=[ 1116], 20.00th=[ 1116], | 30.00th=[ 1116], 40.00th=[ 1116], 50.00th=[ 1116], 60.00th=[ 1250], | 70.00th=[ 1250], 80.00th=[ 1250], 90.00th=[ 1250], 95.00th=[ 1250], | 99.00th=[ 1250], 99.50th=[ 1250], 99.90th=[ 1250], 99.95th=[ 1250], | 99.99th=[ 1250] bw ( KiB/s): min= 8078, max= 8078, per=92.15%, avg=8078.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 2000=100.00% cpu : usr=0.00%, sys=3.22%, ctx=125, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145271: Mon Aug 3 08:11:50 2026 write: IOPS=0, BW=3287KiB/s (3366kB/s)(12.0MiB/3738msec); 0 zone resets clat (msec): min=656, max=1509, avg=1167.69, stdev=450.97 lat (msec): min=657, max=1512, avg=1168.99, stdev=451.97 clat percentiles (msec): | 1.00th=[ 659], 5.00th=[ 659], 10.00th=[ 659], 20.00th=[ 659], | 30.00th=[ 659], 40.00th=[ 1334], 50.00th=[ 1334], 60.00th=[ 1334], | 70.00th=[ 1502], 80.00th=[ 1502], 90.00th=[ 1502], 95.00th=[ 1502], | 99.00th=[ 1502], 99.50th=[ 1502], 99.90th=[ 1502], 99.95th=[ 1502], | 99.99th=[ 1502] bw ( KiB/s): min= 8159, max= 8192, per=93.26%, avg=8175.50, stdev=23.33, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 750=33.33%, 2000=66.67% cpu : usr=0.16%, sys=3.45%, ctx=43, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145272: Mon Aug 3 08:11:50 2026 write: IOPS=1, BW=4175KiB/s (4276kB/s)(12.0MiB/2943msec); 0 zone resets clat (msec): min=534, max=1203, avg=924.85, stdev=348.37 lat (msec): min=534, max=1204, avg=925.36, stdev=348.62 clat percentiles (msec): | 1.00th=[ 535], 5.00th=[ 535], 10.00th=[ 535], 20.00th=[ 535], | 30.00th=[ 535], 40.00th=[ 1036], 50.00th=[ 1036], 60.00th=[ 1036], | 70.00th=[ 1200], 80.00th=[ 1200], 90.00th=[ 1200], 95.00th=[ 1200], | 99.00th=[ 1200], 99.50th=[ 1200], 99.90th=[ 1200], 99.95th=[ 1200], | 99.99th=[ 1200] bw ( KiB/s): min= 8143, max= 8175, per=93.08%, avg=8159.00, stdev=22.63, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 2000=66.67% cpu : usr=0.00%, sys=4.86%, ctx=61, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4711KiB/s (4824kB/s), 1178KiB/s-4592KiB/s (1206kB/s-4702kB/s), io=16.0MiB (16.8MB), run=2676-3478msec WRITE: bw=8766KiB/s (8977kB/s), 2355KiB/s-4175KiB/s (2412kB/s-4276kB/s), io=32.0MiB (33.6MB), run=2943-3738msec rand-rw: (groupid=0, jobs=1): err= 0: pid=145264: Mon Aug 3 08:11:50 2026 read: IOPS=0, BW=4013KiB/s (4109kB/s)(12.0MiB/3062msec) clat (msec): min=655, max=1591, avg=983.65, stdev=526.68 lat (msec): min=655, max=1591, avg=983.66, stdev=526.68 clat percentiles (msec): | 1.00th=[ 659], 5.00th=[ 659], 10.00th=[ 659], 20.00th=[ 659], | 30.00th=[ 659], 40.00th=[ 701], 50.00th=[ 701], 60.00th=[ 701], | 70.00th=[ 1586], 80.00th=[ 1586], 90.00th=[ 1586], 95.00th=[ 1586], | 99.00th=[ 1586], 99.50th=[ 1586], 99.90th=[ 1586], 99.95th=[ 1586], | 99.99th=[ 1586] bw ( KiB/s): min= 8094, max= 8159, per=100.00%, avg=8126.50, stdev=45.96, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=66.67%, 2000=33.33% cpu : usr=0.00%, sys=3.72%, ctx=37, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145265: Mon Aug 3 08:11:50 2026 read: IOPS=0, BW=1015KiB/s (1039kB/s)(4096KiB/4036msec) clat (nsec): min=1442.2M, max=1442.2M, avg=1442243582.00, stdev= 0.00 lat (nsec): min=1442.2M, max=1442.2M, avg=1442245850.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1435], 5.00th=[ 1435], 10.00th=[ 1435], 20.00th=[ 1435], | 30.00th=[ 1435], 40.00th=[ 1435], 50.00th=[ 1435], 60.00th=[ 1435], | 70.00th=[ 1435], 80.00th=[ 1435], 90.00th=[ 1435], 95.00th=[ 1435], | 99.00th=[ 1435], 99.50th=[ 1435], 99.90th=[ 1435], 99.95th=[ 1435], | 99.99th=[ 1435] bw ( KiB/s): min= 8159, max= 8159, per=100.00%, avg=8159.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2030KiB/s (2078kB/s)(8192KiB/4036msec); 0 zone resets clat (msec): min=327, max=2215, avg=1271.30, stdev=1334.73 lat (msec): min=328, max=2215, avg=1271.78, stdev=1334.33 clat percentiles (msec): | 1.00th=[ 330], 5.00th=[ 330], 10.00th=[ 330], 20.00th=[ 330], | 30.00th=[ 330], 40.00th=[ 330], 50.00th=[ 330], 60.00th=[ 2232], | 70.00th=[ 2232], 80.00th=[ 2232], 90.00th=[ 2232], 95.00th=[ 2232], | 99.00th=[ 2232], 99.50th=[ 2232], 99.90th=[ 2232], 99.95th=[ 2232], | 99.99th=[ 2232] lat (msec) : 500=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.05%, sys=3.42%, ctx=86, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145266: Mon Aug 3 08:11:50 2026 write: IOPS=1, BW=5647KiB/s (5783kB/s)(12.0MiB/2176msec); 0 zone resets clat (msec): min=431, max=905, avg=706.15, stdev=246.13 lat (msec): min=438, max=906, avg=708.60, stdev=242.44 clat percentiles (msec): | 1.00th=[ 430], 5.00th=[ 430], 10.00th=[ 430], 20.00th=[ 430], | 30.00th=[ 430], 40.00th=[ 785], 50.00th=[ 785], 60.00th=[ 785], | 70.00th=[ 902], 80.00th=[ 902], 90.00th=[ 902], 95.00th=[ 902], | 99.00th=[ 902], 99.50th=[ 902], 99.90th=[ 902], 99.95th=[ 902], | 99.99th=[ 902] bw ( KiB/s): min= 6770, max= 8159, per=91.95%, avg=7464.50, stdev=982.17, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 1000=66.67% cpu : usr=0.05%, sys=5.56%, ctx=59, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145267: Mon Aug 3 08:11:50 2026 write: IOPS=1, BW=4911KiB/s (5029kB/s)(12.0MiB/2502msec); 0 zone resets clat (msec): min=495, max=1031, avg=786.22, stdev=270.87 lat (msec): min=496, max=1032, avg=786.56, stdev=270.80 clat percentiles (msec): | 1.00th=[ 498], 5.00th=[ 498], 10.00th=[ 498], 20.00th=[ 498], | 30.00th=[ 498], 40.00th=[ 835], 50.00th=[ 835], 60.00th=[ 835], | 70.00th=[ 1028], 80.00th=[ 1028], 90.00th=[ 1028], 95.00th=[ 1028], | 99.00th=[ 1028], 99.50th=[ 1028], 99.90th=[ 1028], 99.95th=[ 1028], | 99.99th=[ 1028] bw ( KiB/s): min= 8062, max= 8159, per=99.91%, avg=8110.50, stdev=68.59, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.08%, sys=4.36%, ctx=55, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4059KiB/s (4157kB/s), 1015KiB/s-4013KiB/s (1039kB/s-4109kB/s), io=16.0MiB (16.8MB), run=3062-4036msec WRITE: bw=8119KiB/s (8314kB/s), 2030KiB/s-5647KiB/s (2078kB/s-5783kB/s), io=32.0MiB (33.6MB), run=2176-4036msec