== sanity test 398b: DIO and buffer IO race ============== 03:07:09 (1787555229) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 5.72586 s, 8.8 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179027: Mon Aug 24 03:09:18 2026 read: IOPS=14, BW=56.1KiB/s (57.4kB/s)(5992KiB/106884msec) clat (usec): min=40, max=777988, avg=39864.10, stdev=34540.46 lat (usec): min=41, max=777990, avg=39866.42, stdev=34540.42 clat percentiles (usec): | 1.00th=[ 49], 5.00th=[ 82], 10.00th=[ 12387], 20.00th=[ 18482], | 30.00th=[ 23200], 40.00th=[ 28443], 50.00th=[ 33424], 60.00th=[ 39060], | 70.00th=[ 46400], 80.00th=[ 56886], 90.00th=[ 73925], 95.00th=[ 90702], | 99.00th=[145753], 99.50th=[198181], 99.90th=[278922], 99.95th=[775947], | 99.99th=[775947] bw ( KiB/s): min= 7, max= 131, per=25.35%, avg=55.78, stdev=21.36, samples=210 iops : min= 1, max= 32, avg=13.30, stdev= 5.39, samples=210 write: IOPS=14, BW=58.9KiB/s (60.3kB/s)(6296KiB/106884msec); 0 zone resets clat (usec): min=865, max=216749, avg=29749.74, stdev=32293.31 lat (usec): min=867, max=216751, avg=29757.73, stdev=32288.64 clat percentiles (usec): | 1.00th=[ 1012], 5.00th=[ 1123], 10.00th=[ 1254], 20.00th=[ 2474], | 30.00th=[ 5211], 40.00th=[ 13173], 50.00th=[ 20579], 60.00th=[ 28443], | 70.00th=[ 37487], 80.00th=[ 50594], 90.00th=[ 74974], 95.00th=[ 93848], | 99.00th=[147850], 99.50th=[166724], 99.90th=[191890], 99.95th=[217056], | 99.99th=[217056] bw ( KiB/s): min= 7, max= 184, per=25.60%, avg=58.88, stdev=27.92, samples=209 iops : min= 1, max= 46, avg=14.08, stdev= 7.06, samples=209 lat (usec) : 50=0.55%, 100=2.02%, 250=0.07%, 750=0.03%, 1000=0.29% lat (msec) : 2=8.59%, 4=4.43%, 10=6.58%, 20=14.06%, 50=40.23% lat (msec) : 100=19.34%, 250=3.74%, 500=0.03%, 1000=0.03% cpu : usr=0.08%, sys=5.47%, ctx=6256, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179028: Mon Aug 24 03:09:18 2026 read: IOPS=13, BW=54.5KiB/s (55.8kB/s)(5940KiB/108943msec) clat (usec): min=38, max=236947, avg=39550.91, stdev=28070.02 lat (usec): min=38, max=236949, avg=39553.33, stdev=28069.72 clat percentiles (usec): | 1.00th=[ 53], 5.00th=[ 6783], 10.00th=[ 13304], 20.00th=[ 18744], | 30.00th=[ 22938], 40.00th=[ 28443], 50.00th=[ 33424], 60.00th=[ 39060], | 70.00th=[ 47449], 80.00th=[ 55837], 90.00th=[ 73925], 95.00th=[ 89654], | 99.00th=[143655], 99.50th=[175113], 99.90th=[231736], 99.95th=[235930], | 99.99th=[235930] bw ( KiB/s): min= 7, max= 119, per=24.65%, avg=54.23, stdev=20.72, samples=214 iops : min= 1, max= 29, avg=12.91, stdev= 5.23, samples=214 write: IOPS=14, BW=58.3KiB/s (59.7kB/s)(6348KiB/108943msec); 0 zone resets clat (usec): min=799, max=866664, avg=31484.57, stdev=38991.06 lat (usec): min=801, max=866666, avg=31488.26, stdev=38991.01 clat percentiles (usec): | 1.00th=[ 1012], 5.00th=[ 1123], 10.00th=[ 1237], 20.00th=[ 2966], | 30.00th=[ 6259], 40.00th=[ 13304], 50.00th=[ 20841], 60.00th=[ 28967], | 70.00th=[ 39060], 80.00th=[ 54789], 90.00th=[ 77071], 95.00th=[ 98042], | 99.00th=[141558], 99.50th=[162530], 99.90th=[214959], 99.95th=[868221], | 99.99th=[868221] bw ( KiB/s): min= 7, max= 148, per=25.17%, avg=57.89, stdev=25.27, samples=214 iops : min= 1, max= 37, avg=13.83, stdev= 6.36, samples=214 lat (usec) : 50=0.20%, 100=1.79%, 250=0.23%, 500=0.03%, 1000=0.42% lat (msec) : 2=7.88%, 4=4.30%, 10=6.93%, 20=14.75%, 50=38.41% lat (msec) : 100=21.42%, 250=3.61%, 1000=0.03% cpu : usr=0.09%, sys=5.53%, ctx=6361, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179029: Mon Aug 24 03:09:18 2026 read: IOPS=14, BW=56.5KiB/s (57.9kB/s)(6028KiB/106665msec) clat (usec): min=41, max=287006, avg=39198.86, stdev=27954.45 lat (usec): min=42, max=287007, avg=39200.15, stdev=27954.45 clat percentiles (usec): | 1.00th=[ 51], 5.00th=[ 77], 10.00th=[ 12911], 20.00th=[ 18744], | 30.00th=[ 22676], 40.00th=[ 28181], 50.00th=[ 34341], 60.00th=[ 40109], | 70.00th=[ 47449], 80.00th=[ 56361], 90.00th=[ 71828], 95.00th=[ 88605], | 99.00th=[135267], 99.50th=[166724], 99.90th=[208667], 99.95th=[287310], | 99.99th=[287310] bw ( KiB/s): min= 15, max= 126, per=25.71%, avg=56.55, stdev=20.71, samples=208 iops : min= 3, max= 31, avg=13.49, stdev= 5.23, samples=208 write: IOPS=14, BW=58.7KiB/s (60.1kB/s)(6260KiB/106665msec); 0 zone resets clat (usec): min=680, max=923773, avg=30203.98, stdev=39349.08 lat (usec): min=681, max=923777, avg=30213.63, stdev=39344.42 clat percentiles (usec): | 1.00th=[ 1020], 5.00th=[ 1123], 10.00th=[ 1237], 20.00th=[ 2147], | 30.00th=[ 5014], 40.00th=[ 11731], 50.00th=[ 20579], 60.00th=[ 28705], | 70.00th=[ 38011], 80.00th=[ 51119], 90.00th=[ 73925], 95.00th=[ 95945], | 99.00th=[137364], 99.50th=[160433], 99.90th=[283116], 99.95th=[926942], | 99.99th=[926942] bw ( KiB/s): min= 7, max= 156, per=25.48%, avg=58.61, stdev=25.48, samples=208 iops : min= 1, max= 39, avg=14.01, stdev= 6.44, samples=208 lat (usec) : 50=0.36%, 100=2.28%, 250=0.07%, 500=0.07%, 750=0.07% lat (usec) : 1000=0.36% lat (msec) : 2=9.11%, 4=4.72%, 10=6.51%, 20=12.89%, 50=40.10% lat (msec) : 100=19.63%, 250=3.74%, 500=0.07%, 1000=0.03% cpu : usr=0.08%, sys=5.41%, ctx=6035, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179030: Mon Aug 24 03:09:18 2026 read: IOPS=13, BW=55.7KiB/s (57.0kB/s)(6052KiB/108695msec) clat (usec): min=33, max=296879, avg=39620.51, stdev=27998.25 lat (usec): min=33, max=296880, avg=39625.33, stdev=28000.36 clat percentiles (usec): | 1.00th=[ 50], 5.00th=[ 6915], 10.00th=[ 14353], 20.00th=[ 19006], | 30.00th=[ 23200], 40.00th=[ 28181], 50.00th=[ 34341], 60.00th=[ 40109], | 70.00th=[ 46924], 80.00th=[ 56361], 90.00th=[ 71828], 95.00th=[ 90702], | 99.00th=[139461], 99.50th=[154141], 99.90th=[252707], 99.95th=[295699], | 99.99th=[295699] bw ( KiB/s): min= 7, max= 119, per=25.23%, avg=55.50, stdev=21.82, samples=212 iops : min= 1, max= 29, avg=13.23, stdev= 5.51, samples=212 write: IOPS=14, BW=57.4KiB/s (58.7kB/s)(6236KiB/108695msec); 0 zone resets clat (usec): min=699, max=858706, avg=31026.16, stdev=38746.39 lat (usec): min=699, max=858708, avg=31027.70, stdev=38746.50 clat percentiles (usec): | 1.00th=[ 988], 5.00th=[ 1139], 10.00th=[ 1287], 20.00th=[ 2507], | 30.00th=[ 5604], 40.00th=[ 14484], 50.00th=[ 21890], 60.00th=[ 28967], | 70.00th=[ 38011], 80.00th=[ 53740], 90.00th=[ 74974], 95.00th=[ 92799], | 99.00th=[147850], 99.50th=[170918], 99.90th=[242222], 99.95th=[859833], | 99.99th=[859833] bw ( KiB/s): min= 7, max= 190, per=24.90%, avg=57.26, stdev=24.34, samples=212 iops : min= 1, max= 47, avg=13.67, stdev= 6.13, samples=212 lat (usec) : 50=0.52%, 100=1.73%, 250=0.07%, 750=0.07%, 1000=0.52% lat (msec) : 2=8.11%, 4=4.56%, 10=5.47%, 20=13.31%, 50=41.63% lat (msec) : 100=20.28%, 250=3.65%, 500=0.07%, 1000=0.03% cpu : usr=0.09%, sys=5.36%, ctx=6362, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=220KiB/s (226kB/s), 54.5KiB/s-56.5KiB/s (55.8kB/s-57.9kB/s), io=23.4MiB (24.6MB), run=106665-108943msec WRITE: bw=231KiB/s (236kB/s), 57.4KiB/s-58.9KiB/s (58.7kB/s-60.3kB/s), io=24.6MiB (25.7MB), run=106665-108943msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179022: Mon Aug 24 03:09:54 2026 read: IOPS=10, BW=41.6KiB/s (42.6kB/s)(5992KiB/143932msec) clat (msec): min=4, max=870, avg=37.49, stdev=41.84 lat (msec): min=4, max=870, avg=37.49, stdev=41.84 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 14], | 30.00th=[ 17], 40.00th=[ 21], 50.00th=[ 24], 60.00th=[ 29], | 70.00th=[ 39], 80.00th=[ 54], 90.00th=[ 82], 95.00th=[ 110], | 99.00th=[ 180], 99.50th=[ 207], 99.90th=[ 300], 99.95th=[ 869], | 99.99th=[ 869] bw ( KiB/s): min= 7, max= 143, per=25.10%, avg=41.66, stdev=28.12, samples=281 iops : min= 1, max= 35, avg= 9.78, stdev= 7.04, samples=281 write: IOPS=10, BW=43.7KiB/s (44.8kB/s)(6296KiB/143932msec); 0 zone resets clat (msec): min=7, max=308, avg=55.59, stdev=38.75 lat (msec): min=7, max=308, avg=55.59, stdev=38.75 clat percentiles (msec): | 1.00th=[ 15], 5.00th=[ 19], 10.00th=[ 22], 20.00th=[ 27], | 30.00th=[ 32], 40.00th=[ 36], 50.00th=[ 43], 60.00th=[ 52], | 70.00th=[ 65], 80.00th=[ 83], 90.00th=[ 108], 95.00th=[ 136], | 99.00th=[ 184], 99.50th=[ 209], 99.90th=[ 305], 99.95th=[ 309], | 99.99th=[ 309] bw ( KiB/s): min= 7, max= 127, per=25.15%, avg=43.76, stdev=26.54, samples=281 iops : min= 1, max= 31, avg=10.29, stdev= 6.65, samples=281 lat (msec) : 10=3.94%, 20=20.02%, 50=44.34%, 100=22.04%, 250=9.44% lat (msec) : 500=0.20%, 1000=0.03% cpu : usr=0.07%, sys=1.81%, ctx=4705, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179023: Mon Aug 24 03:09:54 2026 read: IOPS=10, BW=41.2KiB/s (42.2kB/s)(5940KiB/144213msec) clat (msec): min=5, max=946, avg=36.93, stdev=41.30 lat (msec): min=5, max=946, avg=36.93, stdev=41.30 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 11], 20.00th=[ 14], | 30.00th=[ 17], 40.00th=[ 20], 50.00th=[ 24], 60.00th=[ 29], | 70.00th=[ 39], 80.00th=[ 53], 90.00th=[ 83], 95.00th=[ 106], | 99.00th=[ 157], 99.50th=[ 203], 99.90th=[ 288], 99.95th=[ 944], | 99.99th=[ 944] bw ( KiB/s): min= 7, max= 135, per=24.85%, avg=41.24, stdev=28.84, samples=280 iops : min= 1, max= 33, avg= 9.66, stdev= 7.21, samples=280 write: IOPS=11, BW=44.0KiB/s (45.1kB/s)(6348KiB/144213msec); 0 zone resets clat (msec): min=8, max=329, avg=56.14, stdev=40.20 lat (msec): min=8, max=329, avg=56.14, stdev=40.21 clat percentiles (msec): | 1.00th=[ 15], 5.00th=[ 19], 10.00th=[ 22], 20.00th=[ 27], | 30.00th=[ 32], 40.00th=[ 36], 50.00th=[ 43], 60.00th=[ 51], | 70.00th=[ 64], 80.00th=[ 81], 90.00th=[ 111], 95.00th=[ 136], | 99.00th=[ 197], 99.50th=[ 243], 99.90th=[ 305], 99.95th=[ 330], | 99.99th=[ 330] bw ( KiB/s): min= 7, max= 127, per=25.11%, avg=43.69, stdev=26.39, samples=282 iops : min= 1, max= 31, avg=10.28, stdev= 6.60, samples=282 lat (msec) : 10=3.42%, 20=19.89%, 50=45.25%, 100=21.45%, 250=9.70% lat (msec) : 500=0.26%, 1000=0.03% cpu : usr=0.06%, sys=1.83%, ctx=4759, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179024: Mon Aug 24 03:09:54 2026 read: IOPS=10, BW=41.9KiB/s (42.9kB/s)(6028KiB/143754msec) clat (msec): min=5, max=298, avg=36.74, stdev=34.60 lat (msec): min=5, max=298, avg=36.75, stdev=34.60 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 14], | 30.00th=[ 17], 40.00th=[ 21], 50.00th=[ 25], 60.00th=[ 30], | 70.00th=[ 39], 80.00th=[ 52], 90.00th=[ 81], 95.00th=[ 112], | 99.00th=[ 174], 99.50th=[ 194], 99.90th=[ 224], 99.95th=[ 300], | 99.99th=[ 300] bw ( KiB/s): min= 7, max= 144, per=25.54%, avg=42.40, stdev=27.94, samples=277 iops : min= 1, max= 36, avg= 9.95, stdev= 6.99, samples=277 write: IOPS=10, BW=43.5KiB/s (44.6kB/s)(6260KiB/143754msec); 0 zone resets clat (msec): min=8, max=994, avg=56.27, stdev=47.61 lat (msec): min=8, max=994, avg=56.28, stdev=47.61 clat percentiles (msec): | 1.00th=[ 14], 5.00th=[ 18], 10.00th=[ 21], 20.00th=[ 26], | 30.00th=[ 31], 40.00th=[ 35], 50.00th=[ 42], 60.00th=[ 51], | 70.00th=[ 64], 80.00th=[ 81], 90.00th=[ 110], 95.00th=[ 136], | 99.00th=[ 201], 99.50th=[ 266], 99.90th=[ 330], 99.95th=[ 995], | 99.99th=[ 995] bw ( KiB/s): min= 7, max= 127, per=24.92%, avg=43.37, stdev=27.43, samples=281 iops : min= 1, max= 31, avg=10.20, stdev= 6.86, samples=281 lat (msec) : 10=3.94%, 20=19.21%, 50=46.06%, 100=20.74%, 250=9.73% lat (msec) : 500=0.29%, 1000=0.03% cpu : usr=0.07%, sys=1.80%, ctx=4778, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179025: Mon Aug 24 03:09:54 2026 read: IOPS=10, BW=41.9KiB/s (42.9kB/s)(6052KiB/144338msec) clat (msec): min=4, max=246, avg=36.16, stdev=33.90 lat (msec): min=4, max=246, avg=36.16, stdev=33.90 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 14], | 30.00th=[ 17], 40.00th=[ 20], 50.00th=[ 24], 60.00th=[ 30], | 70.00th=[ 37], 80.00th=[ 53], 90.00th=[ 83], 95.00th=[ 111], | 99.00th=[ 165], 99.50th=[ 184], 99.90th=[ 239], 99.95th=[ 247], | 99.99th=[ 247] bw ( KiB/s): min= 7, max= 143, per=25.84%, avg=42.90, stdev=28.48, samples=273 iops : min= 1, max= 35, avg=10.08, stdev= 7.11, samples=273 write: IOPS=10, BW=43.2KiB/s (44.2kB/s)(6236KiB/144338msec); 0 zone resets clat (msec): min=11, max=1004, avg=57.29, stdev=48.39 lat (msec): min=11, max=1004, avg=57.30, stdev=48.39 clat percentiles (msec): | 1.00th=[ 14], 5.00th=[ 19], 10.00th=[ 22], 20.00th=[ 27], | 30.00th=[ 31], 40.00th=[ 36], 50.00th=[ 42], 60.00th=[ 52], | 70.00th=[ 66], 80.00th=[ 84], 90.00th=[ 111], 95.00th=[ 138], | 99.00th=[ 226], 99.50th=[ 279], 99.90th=[ 317], 99.95th=[ 1003], | 99.99th=[ 1003] bw ( KiB/s): min= 7, max= 127, per=24.65%, avg=42.89, stdev=26.83, samples=282 iops : min= 1, max= 31, avg=10.08, stdev= 6.71, samples=282 lat (msec) : 10=3.87%, 20=20.31%, 50=44.63%, 100=21.39%, 250=9.47% lat (msec) : 500=0.29%, 2000=0.03% cpu : usr=0.06%, sys=1.80%, ctx=4727, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=166KiB/s (170kB/s), 41.2KiB/s-41.9KiB/s (42.2kB/s-42.9kB/s), io=23.4MiB (24.6MB), run=143754-144338msec WRITE: bw=174KiB/s (178kB/s), 43.2KiB/s-44.0KiB/s (44.2kB/s-45.1kB/s), io=24.6MiB (25.7MB), run=143754-144338msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179069: Mon Aug 24 03:10:29 2026 read: IOPS=13, BW=217KiB/s (222kB/s)(5920KiB/27248msec) clat (usec): min=40, max=174731, avg=38124.44, stdev=27350.19 lat (usec): min=40, max=174733, avg=38125.51, stdev=27350.21 clat percentiles (usec): | 1.00th=[ 48], 5.00th=[ 58], 10.00th=[ 243], 20.00th=[ 19268], | 30.00th=[ 24249], 40.00th=[ 29754], 50.00th=[ 33817], 60.00th=[ 39060], | 70.00th=[ 44827], 80.00th=[ 54789], 90.00th=[ 69731], 95.00th=[ 92799], | 99.00th=[137364], 99.50th=[164627], 99.90th=[175113], 99.95th=[175113], | 99.99th=[175113] bw ( KiB/s): min= 63, max= 447, per=25.13%, avg=215.36, stdev=79.59, samples=53 iops : min= 3, max= 27, avg=12.77, stdev= 4.99, samples=53 write: IOPS=14, BW=234KiB/s (239kB/s)(6368KiB/27248msec); 0 zone resets clat (usec): min=1250, max=177947, avg=32827.38, stdev=33528.44 lat (usec): min=1252, max=177949, avg=32832.96, stdev=33527.65 clat percentiles (usec): | 1.00th=[ 1418], 5.00th=[ 1778], 10.00th=[ 2573], 20.00th=[ 5407], | 30.00th=[ 8979], 40.00th=[ 13173], 50.00th=[ 21103], 60.00th=[ 29230], | 70.00th=[ 42206], 80.00th=[ 57934], 90.00th=[ 82314], 95.00th=[ 99091], | 99.00th=[147850], 99.50th=[164627], 99.90th=[177210], 99.95th=[177210], | 99.99th=[177210] bw ( KiB/s): min= 29, max= 479, per=25.96%, avg=234.15, stdev=87.89, samples=53 iops : min= 1, max= 29, avg=13.94, stdev= 5.49, samples=53 lat (usec) : 50=0.65%, 100=4.04%, 250=0.13%, 500=0.26%, 750=0.13% lat (msec) : 2=4.04%, 4=4.69%, 10=9.11%, 20=11.46%, 50=41.15% lat (msec) : 100=20.44%, 250=3.91% cpu : usr=0.06%, sys=6.03%, ctx=1563, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179070: Mon Aug 24 03:10:29 2026 read: IOPS=13, BW=211KiB/s (216kB/s)(5744KiB/27227msec) clat (usec): min=38, max=211254, avg=42085.73, stdev=29943.42 lat (usec): min=38, max=211255, avg=42086.81, stdev=29943.44 clat percentiles (usec): | 1.00th=[ 55], 5.00th=[ 62], 10.00th=[ 15926], 20.00th=[ 21890], | 30.00th=[ 25297], 40.00th=[ 31851], 50.00th=[ 36439], 60.00th=[ 42730], | 70.00th=[ 49021], 80.00th=[ 60556], 90.00th=[ 76022], 95.00th=[100140], | 99.00th=[139461], 99.50th=[206570], 99.90th=[210764], 99.95th=[210764], | 99.99th=[210764] bw ( KiB/s): min= 59, max= 445, per=24.53%, avg=210.25, stdev=77.82, samples=53 iops : min= 3, max= 27, avg=12.43, stdev= 4.92, samples=53 write: IOPS=15, BW=240KiB/s (246kB/s)(6544KiB/27227msec); 0 zone resets clat (usec): min=1186, max=208654, avg=29128.96, stdev=29120.60 lat (usec): min=1189, max=208656, avg=29131.13, stdev=29120.38 clat percentiles (usec): | 1.00th=[ 1369], 5.00th=[ 1729], 10.00th=[ 2180], 20.00th=[ 4883], | 30.00th=[ 8225], 40.00th=[ 12911], 50.00th=[ 19006], 60.00th=[ 28443], | 70.00th=[ 38536], 80.00th=[ 49021], 90.00th=[ 72877], 95.00th=[ 87557], | 99.00th=[117965], 99.50th=[120062], 99.90th=[208667], 99.95th=[208667], | 99.99th=[208667] bw ( KiB/s): min= 62, max= 479, per=26.34%, avg=237.55, stdev=96.44, samples=53 iops : min= 3, max= 29, avg=14.15, stdev= 6.04, samples=53 lat (usec) : 50=0.26%, 100=3.39% lat (msec) : 2=4.82%, 4=4.17%, 10=10.81%, 20=11.72%, 50=41.41% lat (msec) : 100=19.79%, 250=3.65% cpu : usr=0.08%, sys=6.18%, ctx=1637, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179071: Mon Aug 24 03:10:29 2026 read: IOPS=14, BW=224KiB/s (229kB/s)(6256KiB/27927msec) clat (usec): min=47, max=173883, avg=42325.39, stdev=28031.39 lat (usec): min=48, max=173884, avg=42326.83, stdev=28031.58 clat percentiles (usec): | 1.00th=[ 55], 5.00th=[ 65], 10.00th=[ 12125], 20.00th=[ 21627], | 30.00th=[ 26870], 40.00th=[ 32375], 50.00th=[ 38011], 60.00th=[ 44827], | 70.00th=[ 50070], 80.00th=[ 61080], 90.00th=[ 74974], 95.00th=[ 90702], | 99.00th=[139461], 99.50th=[168821], 99.90th=[173016], 99.95th=[173016], | 99.99th=[173016] bw ( KiB/s): min= 95, max= 383, per=26.24%, avg=224.85, stdev=80.56, samples=55 iops : min= 5, max= 23, avg=13.36, stdev= 5.09, samples=55 write: IOPS=13, BW=216KiB/s (221kB/s)(6032KiB/27927msec); 0 zone resets clat (usec): min=1035, max=231644, avg=29676.63, stdev=29593.18 lat (usec): min=1036, max=231646, avg=29684.85, stdev=29598.43 clat percentiles (usec): | 1.00th=[ 1319], 5.00th=[ 1680], 10.00th=[ 2606], 20.00th=[ 4621], | 30.00th=[ 8979], 40.00th=[ 15270], 50.00th=[ 23725], 60.00th=[ 29754], | 70.00th=[ 35390], 80.00th=[ 45351], 90.00th=[ 68682], 95.00th=[ 87557], | 99.00th=[126354], 99.50th=[175113], 99.90th=[231736], 99.95th=[231736], | 99.99th=[231736] bw ( KiB/s): min= 32, max= 414, per=23.77%, avg=214.44, stdev=92.66, samples=55 iops : min= 2, max= 25, avg=12.69, stdev= 5.79, samples=55 lat (usec) : 50=0.13%, 100=3.78%, 500=0.13% lat (msec) : 2=3.65%, 4=4.43%, 10=7.94%, 20=11.20%, 50=44.27% lat (msec) : 100=21.22%, 250=3.26% cpu : usr=0.06%, sys=5.77%, ctx=1661, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179072: Mon Aug 24 03:10:29 2026 read: IOPS=14, BW=231KiB/s (236kB/s)(6032KiB/26165msec) clat (usec): min=38, max=280367, avg=37548.96, stdev=30000.48 lat (usec): min=38, max=280368, avg=37550.52, stdev=29999.91 clat percentiles (usec): | 1.00th=[ 46], 5.00th=[ 59], 10.00th=[ 69], 20.00th=[ 17433], | 30.00th=[ 24249], 40.00th=[ 28705], 50.00th=[ 33817], 60.00th=[ 40633], | 70.00th=[ 45351], 80.00th=[ 52691], 90.00th=[ 68682], 95.00th=[ 84411], | 99.00th=[164627], 99.50th=[179307], 99.90th=[278922], 99.95th=[278922], | 99.99th=[278922] bw ( KiB/s): min= 63, max= 383, per=26.79%, avg=229.63, stdev=80.37, samples=51 iops : min= 3, max= 23, avg=13.65, stdev= 5.04, samples=51 write: IOPS=14, BW=239KiB/s (245kB/s)(6256KiB/26165msec); 0 zone resets clat (usec): min=1027, max=189396, avg=30264.97, stdev=32751.42 lat (usec): min=1029, max=189398, avg=30267.86, stdev=32752.30 clat percentiles (usec): | 1.00th=[ 1303], 5.00th=[ 1762], 10.00th=[ 2278], 20.00th=[ 4621], | 30.00th=[ 7242], 40.00th=[ 11731], 50.00th=[ 19006], 60.00th=[ 26084], | 70.00th=[ 38011], 80.00th=[ 53216], 90.00th=[ 69731], 95.00th=[ 94897], | 99.00th=[164627], 99.50th=[183501], 99.90th=[189793], 99.95th=[189793], | 99.99th=[189793] bw ( KiB/s): min= 63, max= 446, per=26.54%, avg=239.43, stdev=98.36, samples=51 iops : min= 3, max= 27, avg=14.27, stdev= 6.20, samples=51 lat (usec) : 50=0.78%, 100=5.86%, 250=0.26%, 500=0.13%, 750=0.13% lat (msec) : 2=4.04%, 4=5.73%, 10=9.64%, 20=10.29%, 50=39.71% lat (msec) : 100=19.92%, 250=3.39%, 500=0.13% cpu : usr=0.09%, sys=6.05%, ctx=1509, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=858KiB/s (878kB/s), 211KiB/s-231KiB/s (216kB/s-236kB/s), io=23.4MiB (24.5MB), run=26165-27927msec WRITE: bw=902KiB/s (924kB/s), 216KiB/s-240KiB/s (221kB/s-246kB/s), io=24.6MiB (25.8MB), run=26165-27927msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179074: Mon Aug 24 03:10:40 2026 read: IOPS=9, BW=159KiB/s (163kB/s)(5920KiB/37187msec) clat (msec): min=7, max=241, avg=40.05, stdev=35.04 lat (msec): min=7, max=241, avg=40.05, stdev=35.04 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 17], | 30.00th=[ 20], 40.00th=[ 23], 50.00th=[ 28], 60.00th=[ 34], | 70.00th=[ 43], 80.00th=[ 58], 90.00th=[ 90], 95.00th=[ 115], | 99.00th=[ 182], 99.50th=[ 239], 99.90th=[ 243], 99.95th=[ 243], | 99.99th=[ 243] bw ( KiB/s): min= 31, max= 480, per=25.34%, avg=161.14, stdev=97.50, samples=72 iops : min= 1, max= 30, avg= 9.35, stdev= 6.20, samples=72 write: IOPS=10, BW=171KiB/s (175kB/s)(6368KiB/37187msec); 0 zone resets clat (msec): min=13, max=241, avg=55.94, stdev=38.66 lat (msec): min=13, max=241, avg=55.94, stdev=38.66 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 21], 10.00th=[ 23], 20.00th=[ 28], | 30.00th=[ 32], 40.00th=[ 37], 50.00th=[ 43], 60.00th=[ 51], | 70.00th=[ 62], 80.00th=[ 81], 90.00th=[ 113], 95.00th=[ 136], | 99.00th=[ 203], 99.50th=[ 213], 99.90th=[ 243], 99.95th=[ 243], | 99.99th=[ 243] bw ( KiB/s): min= 31, max= 447, per=25.59%, avg=171.16, stdev=101.30, samples=73 iops : min= 1, max= 27, avg= 9.97, stdev= 6.42, samples=73 lat (msec) : 10=2.60%, 20=14.32%, 50=50.52%, 100=22.14%, 250=10.42% cpu : usr=0.05%, sys=1.98%, ctx=1220, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179075: Mon Aug 24 03:10:40 2026 read: IOPS=9, BW=153KiB/s (156kB/s)(5744KiB/37613msec) clat (msec): min=6, max=256, avg=39.01, stdev=36.59 lat (msec): min=6, max=256, avg=39.01, stdev=36.59 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 16], | 30.00th=[ 19], 40.00th=[ 22], 50.00th=[ 27], 60.00th=[ 33], | 70.00th=[ 43], 80.00th=[ 52], 90.00th=[ 82], 95.00th=[ 106], | 99.00th=[ 234], 99.50th=[ 245], 99.90th=[ 257], 99.95th=[ 257], | 99.99th=[ 257] bw ( KiB/s): min= 21, max= 512, per=25.08%, avg=159.54, stdev=101.41, samples=71 iops : min= 1, max= 32, avg= 9.25, stdev= 6.43, samples=71 write: IOPS=10, BW=174KiB/s (178kB/s)(6544KiB/37613msec); 0 zone resets clat (msec): min=12, max=337, avg=57.44, stdev=39.75 lat (msec): min=12, max=337, avg=57.44, stdev=39.75 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 20], 10.00th=[ 24], 20.00th=[ 29], | 30.00th=[ 33], 40.00th=[ 39], 50.00th=[ 45], 60.00th=[ 53], | 70.00th=[ 67], 80.00th=[ 84], 90.00th=[ 111], 95.00th=[ 132], | 99.00th=[ 184], 99.50th=[ 215], 99.90th=[ 338], 99.95th=[ 338], | 99.99th=[ 338] bw ( KiB/s): min= 31, max= 448, per=25.94%, avg=173.55, stdev=96.94, samples=74 iops : min= 1, max= 28, avg=10.12, stdev= 6.16, samples=74 lat (msec) : 10=1.69%, 20=16.15%, 50=49.09%, 100=23.44%, 250=9.38% lat (msec) : 500=0.26% cpu : usr=0.05%, sys=1.94%, ctx=1256, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179076: Mon Aug 24 03:10:40 2026 read: IOPS=10, BW=166KiB/s (170kB/s)(6256KiB/37613msec) clat (msec): min=5, max=270, avg=40.83, stdev=35.63 lat (msec): min=5, max=270, avg=40.83, stdev=35.63 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 16], | 30.00th=[ 20], 40.00th=[ 23], 50.00th=[ 28], 60.00th=[ 34], | 70.00th=[ 43], 80.00th=[ 62], 90.00th=[ 91], 95.00th=[ 116], | 99.00th=[ 163], 99.50th=[ 201], 99.90th=[ 271], 99.95th=[ 271], | 99.99th=[ 271] bw ( KiB/s): min= 31, max= 606, per=26.85%, avg=170.79, stdev=120.15, samples=72 iops : min= 1, max= 37, avg= 9.88, stdev= 7.62, samples=72 write: IOPS=10, BW=160KiB/s (164kB/s)(6032KiB/37613msec); 0 zone resets clat (msec): min=10, max=332, avg=57.10, stdev=41.38 lat (msec): min=10, max=332, avg=57.11, stdev=41.38 clat percentiles (msec): | 1.00th=[ 15], 5.00th=[ 19], 10.00th=[ 22], 20.00th=[ 28], | 30.00th=[ 33], 40.00th=[ 39], 50.00th=[ 45], 60.00th=[ 53], | 70.00th=[ 63], 80.00th=[ 77], 90.00th=[ 113], 95.00th=[ 148], | 99.00th=[ 213], 99.50th=[ 228], 99.90th=[ 334], 99.95th=[ 334], | 99.99th=[ 334] bw ( KiB/s): min= 30, max= 416, per=23.80%, avg=159.22, stdev=89.60, samples=73 iops : min= 1, max= 26, avg= 9.15, stdev= 5.66, samples=73 lat (msec) : 10=2.08%, 20=17.58%, 50=46.48%, 100=23.05%, 250=10.55% lat (msec) : 500=0.26% cpu : usr=0.05%, sys=1.98%, ctx=1256, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179077: Mon Aug 24 03:10:40 2026 read: IOPS=10, BW=163KiB/s (167kB/s)(6032KiB/37096msec) clat (msec): min=6, max=256, avg=40.88, stdev=35.69 lat (msec): min=6, max=256, avg=40.88, stdev=35.69 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 12], 20.00th=[ 15], | 30.00th=[ 20], 40.00th=[ 25], 50.00th=[ 29], 60.00th=[ 35], | 70.00th=[ 45], 80.00th=[ 61], 90.00th=[ 91], 95.00th=[ 112], | 99.00th=[ 184], 99.50th=[ 220], 99.90th=[ 257], 99.95th=[ 257], | 99.99th=[ 257] bw ( KiB/s): min= 31, max= 672, per=25.67%, avg=163.26, stdev=108.79, samples=72 iops : min= 1, max= 42, avg= 9.40, stdev= 6.85, samples=72 write: IOPS=10, BW=169KiB/s (173kB/s)(6256KiB/37096msec); 0 zone resets clat (msec): min=12, max=238, avg=55.14, stdev=36.04 lat (msec): min=12, max=238, avg=55.15, stdev=36.03 clat percentiles (msec): | 1.00th=[ 15], 5.00th=[ 19], 10.00th=[ 22], 20.00th=[ 28], | 30.00th=[ 33], 40.00th=[ 40], 50.00th=[ 47], 60.00th=[ 53], | 70.00th=[ 61], 80.00th=[ 79], 90.00th=[ 102], 95.00th=[ 121], | 99.00th=[ 205], 99.50th=[ 220], 99.90th=[ 239], 99.95th=[ 239], | 99.99th=[ 239] bw ( KiB/s): min= 31, max= 479, per=25.10%, avg=167.93, stdev=100.50, samples=73 iops : min= 1, max= 29, avg= 9.70, stdev= 6.37, samples=73 lat (msec) : 10=2.47%, 20=17.06%, 50=45.44%, 100=26.17%, 250=8.72% lat (msec) : 500=0.13% cpu : usr=0.05%, sys=1.94%, ctx=1170, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=637KiB/s (652kB/s), 153KiB/s-166KiB/s (156kB/s-170kB/s), io=23.4MiB (24.5MB), run=37096-37613msec WRITE: bw=670KiB/s (686kB/s), 160KiB/s-174KiB/s (164kB/s-178kB/s), io=24.6MiB (25.8MB), run=37096-37613msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179089: Mon Aug 24 03:10:59 2026 read: IOPS=1, BW=1460KiB/s (1495kB/s)(7168KiB/4911msec) clat (msec): min=7, max=1930, avg=418.41, stdev=671.60 lat (msec): min=7, max=1930, avg=418.41, stdev=671.60 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 8], 10.00th=[ 8], 20.00th=[ 142], | 30.00th=[ 171], 40.00th=[ 171], 50.00th=[ 190], 60.00th=[ 215], | 70.00th=[ 215], 80.00th=[ 271], 90.00th=[ 1938], 95.00th=[ 1938], | 99.00th=[ 1938], 99.50th=[ 1938], 99.90th=[ 1938], 99.95th=[ 1938], | 99.99th=[ 1938] bw ( KiB/s): min= 1980, max= 4063, per=87.42%, avg=2943.50, stdev=1084.80, samples=4 iops : min= 1, max= 3, avg= 2.25, stdev= 0.96, samples=4 write: IOPS=1, BW=1043KiB/s (1068kB/s)(5120KiB/4911msec); 0 zone resets clat (msec): min=140, max=738, avg=382.07, stdev=241.81 lat (msec): min=140, max=738, avg=382.14, stdev=241.81 clat percentiles (msec): | 1.00th=[ 140], 5.00th=[ 140], 10.00th=[ 140], 20.00th=[ 140], | 30.00th=[ 186], 40.00th=[ 186], 50.00th=[ 372], 60.00th=[ 372], | 70.00th=[ 477], 80.00th=[ 477], 90.00th=[ 743], 95.00th=[ 743], | 99.00th=[ 743], 99.50th=[ 743], 99.90th=[ 743], 99.95th=[ 743], | 99.99th=[ 743] bw ( KiB/s): min= 1684, max= 3961, per=51.52%, avg=2428.75, stdev=1034.82, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (msec) : 10=8.33%, 250=50.00%, 500=25.00%, 750=8.33%, 2000=8.33% cpu : usr=0.00%, sys=10.06%, ctx=375, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179090: Mon Aug 24 03:10:59 2026 read: IOPS=0, BW=337KiB/s (345kB/s)(2048KiB/6082msec) clat (msec): min=220, max=225, avg=223.16, stdev= 3.11 lat (msec): min=220, max=225, avg=223.17, stdev= 3.11 clat percentiles (msec): | 1.00th=[ 222], 5.00th=[ 222], 10.00th=[ 222], 20.00th=[ 222], | 30.00th=[ 222], 40.00th=[ 222], 50.00th=[ 222], 60.00th=[ 226], | 70.00th=[ 226], 80.00th=[ 226], 90.00th=[ 226], 95.00th=[ 226], | 99.00th=[ 226], 99.50th=[ 226], 99.90th=[ 226], 99.95th=[ 226], | 99.99th=[ 226] bw ( KiB/s): min= 1438, max= 1980, per=50.76%, avg=1709.00, stdev=383.25, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1684KiB/s (1724kB/s)(10.0MiB/6082msec); 0 zone resets clat (msec): min=149, max=2053, avg=524.56, stdev=590.93 lat (msec): min=149, max=2053, avg=524.66, stdev=590.92 clat percentiles (msec): | 1.00th=[ 150], 5.00th=[ 150], 10.00th=[ 150], 20.00th=[ 176], | 30.00th=[ 190], 40.00th=[ 279], 50.00th=[ 317], 60.00th=[ 338], | 70.00th=[ 359], 80.00th=[ 372], 90.00th=[ 1020], 95.00th=[ 2056], | 99.00th=[ 2056], 99.50th=[ 2056], 99.90th=[ 2056], 99.95th=[ 2056], | 99.99th=[ 2056] bw ( KiB/s): min= 1684, max= 5525, per=61.29%, avg=2889.17, stdev=1560.56, samples=6 iops : min= 1, max= 5, avg= 2.17, stdev= 1.83, samples=6 lat (msec) : 250=41.67%, 500=41.67%, 2000=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=9.16%, ctx=185, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179091: Mon Aug 24 03:10:59 2026 read: IOPS=1, BW=1212KiB/s (1241kB/s)(6144KiB/5068msec) clat (usec): min=640, max=359784, avg=219839.48, stdev=148856.17 lat (usec): min=641, max=359785, avg=219840.82, stdev=148856.15 clat percentiles (usec): | 1.00th=[ 644], 5.00th=[ 644], 10.00th=[ 644], 20.00th=[ 78119], | 30.00th=[ 78119], 40.00th=[227541], 50.00th=[227541], 60.00th=[320865], | 70.00th=[333448], 80.00th=[333448], 90.00th=[358613], 95.00th=[358613], | 99.00th=[358613], 99.50th=[358613], 99.90th=[358613], 99.95th=[358613], | 99.99th=[358613] bw ( KiB/s): min= 1684, max= 3696, per=70.17%, avg=2362.75, stdev=904.20, samples=4 iops : min= 1, max= 3, avg= 1.75, stdev= 0.96, samples=4 write: IOPS=1, BW=1212KiB/s (1241kB/s)(6144KiB/5068msec); 0 zone resets clat (msec): min=191, max=2164, avg=609.59, stdev=769.26 lat (msec): min=192, max=2165, avg=609.68, stdev=769.25 clat percentiles (msec): | 1.00th=[ 192], 5.00th=[ 192], 10.00th=[ 192], 20.00th=[ 213], | 30.00th=[ 213], 40.00th=[ 288], 50.00th=[ 288], 60.00th=[ 309], | 70.00th=[ 489], 80.00th=[ 489], 90.00th=[ 2165], 95.00th=[ 2165], | 99.00th=[ 2165], 99.50th=[ 2165], 99.90th=[ 2165], 99.95th=[ 2165], | 99.99th=[ 2165] bw ( KiB/s): min= 1684, max= 2048, per=40.77%, avg=1922.00, stdev=154.45, samples=5 iops : min= 1, max= 2, avg= 1.20, stdev= 0.45, samples=5 lat (usec) : 750=8.33% lat (msec) : 100=8.33%, 250=25.00%, 500=50.00%, >=2000=8.33% cpu : usr=0.00%, sys=10.36%, ctx=195, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179093: Mon Aug 24 03:10:59 2026 read: IOPS=0, BW=915KiB/s (937kB/s)(5120KiB/5598msec) clat (usec): min=909, max=225806, avg=110896.35, stdev=103472.91 lat (usec): min=911, max=225807, avg=110897.63, stdev=103472.80 clat percentiles (usec): | 1.00th=[ 914], 5.00th=[ 914], 10.00th=[ 914], 20.00th=[ 914], | 30.00th=[ 3032], 40.00th=[ 3032], 50.00th=[145753], 60.00th=[145753], | 70.00th=[179307], 80.00th=[179307], 90.00th=[225444], 95.00th=[225444], | 99.00th=[225444], 99.50th=[225444], 99.90th=[225444], 99.95th=[225444], | 99.99th=[225444] bw ( KiB/s): min= 7922, max= 7922, per=100.00%, avg=7922.00, stdev= 0.00, samples=1 iops : min= 7, max= 7, avg= 7.00, stdev= 0.00, samples=1 write: IOPS=1, BW=1280KiB/s (1311kB/s)(7168KiB/5598msec); 0 zone resets clat (msec): min=219, max=2329, avg=661.24, stdev=753.93 lat (msec): min=220, max=2329, avg=661.45, stdev=753.84 clat percentiles (msec): | 1.00th=[ 220], 5.00th=[ 220], 10.00th=[ 220], 20.00th=[ 266], | 30.00th=[ 275], 40.00th=[ 275], 50.00th=[ 355], 60.00th=[ 485], | 70.00th=[ 485], 80.00th=[ 701], 90.00th=[ 2333], 95.00th=[ 2333], | 99.00th=[ 2333], 99.50th=[ 2333], 99.90th=[ 2333], 99.95th=[ 2333], | 99.99th=[ 2333] bw ( KiB/s): min= 1684, max= 4079, per=62.67%, avg=2954.25, stdev=1282.90, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 1.15, samples=4 lat (usec) : 1000=8.33% lat (msec) : 4=8.33%, 250=33.33%, 500=33.33%, 750=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=8.38%, ctx=174, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3367KiB/s (3448kB/s), 337KiB/s-1460KiB/s (345kB/s-1495kB/s), io=20.0MiB (20.0MB), run=4911-6082msec WRITE: bw=4714KiB/s (4827kB/s), 1043KiB/s-1684KiB/s (1068kB/s-1724kB/s), io=28.0MiB (29.4MB), run=4911-6082msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179092: Mon Aug 24 03:10:59 2026 read: IOPS=1, BW=1388KiB/s (1421kB/s)(7168KiB/5164msec) clat (msec): min=96, max=1958, avg=512.95, stdev=731.56 lat (msec): min=96, max=1958, avg=512.95, stdev=731.56 clat percentiles (msec): | 1.00th=[ 96], 5.00th=[ 96], 10.00th=[ 96], 20.00th=[ 107], | 30.00th=[ 108], 40.00th=[ 108], 50.00th=[ 110], 60.00th=[ 140], | 70.00th=[ 140], 80.00th=[ 1083], 90.00th=[ 1955], 95.00th=[ 1955], | 99.00th=[ 1955], 99.50th=[ 1955], 99.90th=[ 1955], 99.95th=[ 1955], | 99.99th=[ 1955] bw ( KiB/s): min= 1973, max= 4047, per=96.75%, avg=3021.50, stdev=1179.74, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 1.15, samples=4 write: IOPS=0, BW=991KiB/s (1015kB/s)(5120KiB/5164msec); 0 zone resets clat (msec): min=142, max=627, avg=306.30, stdev=208.14 lat (msec): min=142, max=627, avg=306.40, stdev=208.14 clat percentiles (msec): | 1.00th=[ 144], 5.00th=[ 144], 10.00th=[ 144], 20.00th=[ 144], | 30.00th=[ 146], 40.00th=[ 146], 50.00th=[ 215], 60.00th=[ 215], | 70.00th=[ 401], 80.00th=[ 401], 90.00th=[ 625], 95.00th=[ 625], | 99.00th=[ 625], 99.50th=[ 625], 99.90th=[ 625], 99.95th=[ 625], | 99.99th=[ 625] bw ( KiB/s): min= 2003, max= 3946, per=57.20%, avg=2500.75, stdev=963.59, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (msec) : 100=8.33%, 250=58.33%, 500=8.33%, 750=8.33%, 2000=16.67% cpu : usr=0.02%, sys=2.58%, ctx=68, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179094: Mon Aug 24 03:10:59 2026 read: IOPS=0, BW=312KiB/s (320kB/s)(2048KiB/6557msec) clat (msec): min=166, max=700, avg=433.60, stdev=377.97 lat (msec): min=166, max=700, avg=433.60, stdev=377.97 clat percentiles (msec): | 1.00th=[ 167], 5.00th=[ 167], 10.00th=[ 167], 20.00th=[ 167], | 30.00th=[ 167], 40.00th=[ 167], 50.00th=[ 167], 60.00th=[ 701], | 70.00th=[ 701], 80.00th=[ 701], 90.00th=[ 701], 95.00th=[ 701], | 99.00th=[ 701], 99.50th=[ 701], 99.90th=[ 701], 99.95th=[ 701], | 99.99th=[ 701] bw ( KiB/s): min= 2023, max= 2035, per=64.97%, avg=2029.00, stdev= 8.49, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1562KiB/s (1599kB/s)(10.0MiB/6557msec); 0 zone resets clat (msec): min=133, max=2448, avg=555.47, stdev=687.26 lat (msec): min=133, max=2448, avg=555.58, stdev=687.26 clat percentiles (msec): | 1.00th=[ 134], 5.00th=[ 134], 10.00th=[ 134], 20.00th=[ 176], | 30.00th=[ 178], 40.00th=[ 264], 50.00th=[ 288], 60.00th=[ 414], | 70.00th=[ 489], 80.00th=[ 498], 90.00th=[ 676], 95.00th=[ 2433], | 99.00th=[ 2433], 99.50th=[ 2433], 99.90th=[ 2433], 99.95th=[ 2433], | 99.99th=[ 2433] bw ( KiB/s): min= 1973, max= 4079, per=61.67%, avg=2696.00, stdev=1059.14, samples=6 iops : min= 1, max= 3, avg= 1.67, stdev= 1.03, samples=6 lat (msec) : 250=33.33%, 500=41.67%, 750=16.67%, >=2000=8.33% cpu : usr=0.00%, sys=3.25%, ctx=108, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179095: Mon Aug 24 03:10:59 2026 read: IOPS=0, BW=1017KiB/s (1042kB/s)(6144KiB/6040msec) clat (msec): min=71, max=411, avg=228.58, stdev=142.87 lat (msec): min=71, max=411, avg=228.58, stdev=142.87 clat percentiles (msec): | 1.00th=[ 72], 5.00th=[ 72], 10.00th=[ 72], 20.00th=[ 127], | 30.00th=[ 127], 40.00th=[ 129], 50.00th=[ 129], 60.00th=[ 253], | 70.00th=[ 380], 80.00th=[ 380], 90.00th=[ 414], 95.00th=[ 414], | 99.00th=[ 414], 99.50th=[ 414], 99.90th=[ 414], 99.95th=[ 414], | 99.99th=[ 414] bw ( KiB/s): min= 2019, max= 4047, per=81.20%, avg=2536.00, stdev=1007.38, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 write: IOPS=0, BW=1017KiB/s (1042kB/s)(6144KiB/6040msec); 0 zone resets clat (msec): min=209, max=2601, avg=764.25, stdev=921.37 lat (msec): min=209, max=2602, avg=764.33, stdev=921.38 clat percentiles (msec): | 1.00th=[ 209], 5.00th=[ 209], 10.00th=[ 209], 20.00th=[ 253], | 30.00th=[ 253], 40.00th=[ 313], 50.00th=[ 313], 60.00th=[ 464], | 70.00th=[ 751], 80.00th=[ 751], 90.00th=[ 2601], 95.00th=[ 2601], | 99.00th=[ 2601], 99.50th=[ 2601], 99.90th=[ 2601], 99.95th=[ 2601], | 99.99th=[ 2601] bw ( KiB/s): min= 2023, max= 2043, per=46.56%, avg=2035.80, stdev= 7.69, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 lat (msec) : 100=8.33%, 250=25.00%, 500=50.00%, 750=8.33%, >=2000=8.33% cpu : usr=0.02%, sys=3.96%, ctx=94, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179096: Mon Aug 24 03:10:59 2026 read: IOPS=0, BW=787KiB/s (806kB/s)(5120KiB/6502msec) clat (msec): min=84, max=816, avg=327.92, stdev=308.49 lat (msec): min=84, max=816, avg=327.92, stdev=308.49 clat percentiles (msec): | 1.00th=[ 85], 5.00th=[ 85], 10.00th=[ 85], 20.00th=[ 85], | 30.00th=[ 129], 40.00th=[ 129], 50.00th=[ 161], 60.00th=[ 161], | 70.00th=[ 451], 80.00th=[ 451], 90.00th=[ 818], 95.00th=[ 818], | 99.00th=[ 818], 99.50th=[ 818], 99.90th=[ 818], 99.95th=[ 818], | 99.99th=[ 818] bw ( KiB/s): min= 2019, max= 4047, per=86.51%, avg=2701.67, stdev=1165.14, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 write: IOPS=1, BW=1102KiB/s (1129kB/s)(7168KiB/6502msec); 0 zone resets clat (msec): min=186, max=2295, avg=652.02, stdev=740.43 lat (msec): min=187, max=2295, avg=652.14, stdev=740.44 clat percentiles (msec): | 1.00th=[ 188], 5.00th=[ 188], 10.00th=[ 188], 20.00th=[ 207], | 30.00th=[ 351], 40.00th=[ 351], 50.00th=[ 409], 60.00th=[ 498], | 70.00th=[ 498], 80.00th=[ 617], 90.00th=[ 2299], 95.00th=[ 2299], | 99.00th=[ 2299], 99.50th=[ 2299], 99.90th=[ 2299], 99.95th=[ 2299], | 99.99th=[ 2299] bw ( KiB/s): min= 1973, max= 4039, per=55.23%, avg=2414.80, stdev=908.41, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 lat (msec) : 100=8.33%, 250=33.33%, 500=33.33%, 750=8.33%, 1000=8.33% lat (msec) : >=2000=8.33% cpu : usr=0.00%, sys=3.75%, ctx=93, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3123KiB/s (3198kB/s), 312KiB/s-1388KiB/s (320kB/s-1421kB/s), io=20.0MiB (20.0MB), run=5164-6557msec WRITE: bw=4373KiB/s (4478kB/s), 991KiB/s-1562KiB/s (1015kB/s-1599kB/s), io=28.0MiB (29.4MB), run=5164-6557msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179103: Mon Aug 24 03:11:14 2026 read: IOPS=1, BW=4755KiB/s (4870kB/s)(12.0MiB/2584msec) clat (msec): min=506, max=915, avg=765.70, stdev=225.53 lat (msec): min=506, max=915, avg=765.70, stdev=225.53 clat percentiles (msec): | 1.00th=[ 506], 5.00th=[ 506], 10.00th=[ 506], 20.00th=[ 506], | 30.00th=[ 506], 40.00th=[ 877], 50.00th=[ 877], 60.00th=[ 877], | 70.00th=[ 919], 80.00th=[ 919], 90.00th=[ 919], 95.00th=[ 919], | 99.00th=[ 919], 99.50th=[ 919], 99.90th=[ 919], 99.95th=[ 919], | 99.99th=[ 919] bw ( KiB/s): min= 7937, max= 8126, per=100.00%, avg=8031.50, stdev=133.64, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 1000=66.67% cpu : usr=0.00%, sys=11.07%, ctx=440, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179104: Mon Aug 24 03:11:14 2026 read: IOPS=0, BW=1117KiB/s (1144kB/s)(4096KiB/3667msec) clat (nsec): min=909335k, max=909335k, avg=909335343.00, stdev= 0.00 lat (nsec): min=909337k, max=909337k, avg=909337317.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 911], 5.00th=[ 911], 10.00th=[ 911], 20.00th=[ 911], | 30.00th=[ 911], 40.00th=[ 911], 50.00th=[ 911], 60.00th=[ 911], | 70.00th=[ 911], 80.00th=[ 911], 90.00th=[ 911], 95.00th=[ 911], | 99.00th=[ 911], 99.50th=[ 911], 99.90th=[ 911], 99.95th=[ 911], | 99.99th=[ 911] bw ( KiB/s): min= 8078, max= 8078, per=100.00%, avg=8078.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2234KiB/s (2288kB/s)(8192KiB/3667msec); 0 zone resets clat (msec): min=1323, max=1327, avg=1325.71, stdev= 2.76 lat (msec): min=1324, max=1328, avg=1326.08, stdev= 2.79 clat percentiles (msec): | 1.00th=[ 1318], 5.00th=[ 1318], 10.00th=[ 1318], 20.00th=[ 1318], | 30.00th=[ 1318], 40.00th=[ 1318], 50.00th=[ 1318], 60.00th=[ 1334], | 70.00th=[ 1334], 80.00th=[ 1334], 90.00th=[ 1334], 95.00th=[ 1334], | 99.00th=[ 1334], 99.50th=[ 1334], 99.90th=[ 1334], 99.95th=[ 1334], | 99.99th=[ 1334] bw ( KiB/s): min= 7742, max= 7742, per=86.65%, avg=7742.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 1000=33.33%, 2000=66.67% cpu : usr=0.00%, sys=4.80%, ctx=106, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179106: Mon Aug 24 03:11:14 2026 write: IOPS=0, BW=3458KiB/s (3541kB/s)(12.0MiB/3553msec); 0 zone resets clat (msec): min=481, max=1876, avg=1151.12, stdev=698.96 lat (msec): min=481, max=1878, avg=1152.26, stdev=700.18 clat percentiles (msec): | 1.00th=[ 481], 5.00th=[ 481], 10.00th=[ 481], 20.00th=[ 481], | 30.00th=[ 481], 40.00th=[ 1099], 50.00th=[ 1099], 60.00th=[ 1099], | 70.00th=[ 1871], 80.00th=[ 1871], 90.00th=[ 1871], 95.00th=[ 1871], | 99.00th=[ 1871], 99.50th=[ 1871], 99.90th=[ 1871], 99.95th=[ 1871], | 99.99th=[ 1871] bw ( KiB/s): min= 7937, max= 8015, per=89.27%, avg=7976.00, stdev=55.15, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.00%, sys=3.04%, ctx=44, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179107: Mon Aug 24 03:11:14 2026 write: IOPS=0, BW=3809KiB/s (3900kB/s)(12.0MiB/3226msec); 0 zone resets clat (msec): min=663, max=1722, avg=1061.92, stdev=576.46 lat (msec): min=664, max=1723, avg=1062.40, stdev=576.41 clat percentiles (msec): | 1.00th=[ 667], 5.00th=[ 667], 10.00th=[ 667], 20.00th=[ 667], | 30.00th=[ 667], 40.00th=[ 802], 50.00th=[ 802], 60.00th=[ 802], | 70.00th=[ 1720], 80.00th=[ 1720], 90.00th=[ 1720], 95.00th=[ 1720], | 99.00th=[ 1720], 99.50th=[ 1720], 99.90th=[ 1720], 99.95th=[ 1720], | 99.99th=[ 1720] bw ( KiB/s): min= 8078, max= 8126, per=90.68%, avg=8102.00, stdev=33.94, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=3.94%, ctx=52, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4468KiB/s (4575kB/s), 1117KiB/s-4755KiB/s (1144kB/s-4870kB/s), io=16.0MiB (16.8MB), run=2584-3667msec WRITE: bw=8936KiB/s (9150kB/s), 2234KiB/s-3809KiB/s (2288kB/s-3900kB/s), io=32.0MiB (33.6MB), run=3226-3667msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179105: Mon Aug 24 03:11:14 2026 read: IOPS=1, BW=4821KiB/s (4936kB/s)(12.0MiB/2549msec) clat (msec): min=679, max=969, avg=837.99, stdev=146.70 lat (msec): min=679, max=969, avg=837.99, stdev=146.71 clat percentiles (msec): | 1.00th=[ 684], 5.00th=[ 684], 10.00th=[ 684], 20.00th=[ 684], | 30.00th=[ 684], 40.00th=[ 869], 50.00th=[ 869], 60.00th=[ 869], | 70.00th=[ 969], 80.00th=[ 969], 90.00th=[ 969], 95.00th=[ 969], | 99.00th=[ 969], 99.50th=[ 969], 99.90th=[ 969], 99.95th=[ 969], | 99.99th=[ 969] bw ( KiB/s): min= 8015, max= 8078, per=100.00%, avg=8046.50, stdev=44.55, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 1000=66.67% cpu : usr=0.00%, sys=3.45%, ctx=45, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179108: Mon Aug 24 03:11:14 2026 read: IOPS=0, BW=1015KiB/s (1039kB/s)(4096KiB/4037msec) clat (nsec): min=2542.7M, max=2542.7M, avg=2542692948.00, stdev= 0.00 lat (nsec): min=2542.7M, max=2542.7M, avg=2542695475.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 2534], 5.00th=[ 2534], 10.00th=[ 2534], 20.00th=[ 2534], | 30.00th=[ 2534], 40.00th=[ 2534], 50.00th=[ 2534], 60.00th=[ 2534], | 70.00th=[ 2534], 80.00th=[ 2534], 90.00th=[ 2534], 95.00th=[ 2534], | 99.00th=[ 2534], 99.50th=[ 2534], 99.90th=[ 2534], 99.95th=[ 2534], | 99.99th=[ 2534] bw ( KiB/s): min= 7892, max= 7892, per=100.00%, avg=7892.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2029KiB/s (2078kB/s)(8192KiB/4037msec); 0 zone resets clat (msec): min=320, max=904, avg=612.21, stdev=412.68 lat (msec): min=320, max=906, avg=613.58, stdev=414.18 clat percentiles (msec): | 1.00th=[ 321], 5.00th=[ 321], 10.00th=[ 321], 20.00th=[ 321], | 30.00th=[ 321], 40.00th=[ 321], 50.00th=[ 321], 60.00th=[ 902], | 70.00th=[ 902], 80.00th=[ 902], 90.00th=[ 902], 95.00th=[ 902], | 99.00th=[ 902], 99.50th=[ 902], 99.90th=[ 902], 99.95th=[ 902], | 99.99th=[ 902] bw ( KiB/s): min= 7892, max= 7892, per=97.24%, avg=7892.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 1000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=2.21%, ctx=55, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179109: Mon Aug 24 03:11:14 2026 write: IOPS=0, BW=3107KiB/s (3182kB/s)(12.0MiB/3955msec); 0 zone resets clat (msec): min=239, max=2341, avg=1254.85, stdev=1052.58 lat (msec): min=239, max=2341, avg=1255.09, stdev=1052.57 clat percentiles (msec): | 1.00th=[ 241], 5.00th=[ 241], 10.00th=[ 241], 20.00th=[ 241], | 30.00th=[ 241], 40.00th=[ 1183], 50.00th=[ 1183], 60.00th=[ 1183], | 70.00th=[ 2333], 80.00th=[ 2333], 90.00th=[ 2333], 95.00th=[ 2333], | 99.00th=[ 2333], 99.50th=[ 2333], 99.90th=[ 2333], 99.95th=[ 2333], | 99.99th=[ 2333] bw ( KiB/s): min= 7861, max= 7861, per=96.86%, avg=7861.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.03%, sys=2.78%, ctx=59, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179110: Mon Aug 24 03:11:14 2026 write: IOPS=0, BW=3414KiB/s (3496kB/s)(12.0MiB/3599msec); 0 zone resets clat (msec): min=890, max=1271, avg=1125.05, stdev=205.35 lat (msec): min=890, max=1272, avg=1125.48, stdev=205.35 clat percentiles (msec): | 1.00th=[ 894], 5.00th=[ 894], 10.00th=[ 894], 20.00th=[ 894], | 30.00th=[ 894], 40.00th=[ 1217], 50.00th=[ 1217], 60.00th=[ 1217], | 70.00th=[ 1267], 80.00th=[ 1267], 90.00th=[ 1267], 95.00th=[ 1267], | 99.00th=[ 1267], 99.50th=[ 1267], 99.90th=[ 1267], 99.95th=[ 1267], | 99.99th=[ 1267] bw ( KiB/s): min= 7892, max= 7892, per=97.24%, avg=7892.00, stdev= 0.00, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=33.33%, 2000=66.67% cpu : usr=0.00%, sys=2.78%, ctx=41, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4058KiB/s (4156kB/s), 1015KiB/s-4821KiB/s (1039kB/s-4936kB/s), io=16.0MiB (16.8MB), run=2549-4037msec WRITE: bw=8117KiB/s (8312kB/s), 2029KiB/s-3414KiB/s (2078kB/s-3496kB/s), io=32.0MiB (33.6MB), run=3599-4037msec