== sanity test 398b: DIO and buffer IO race ============== 01:40:31 (1787377231) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 6.1215 s, 8.2 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=145160: Sat Aug 22 01:43:57 2026 read: IOPS=8, BW=32.7KiB/s (33.5kB/s)(5992KiB/183157msec) clat (usec): min=37, max=50940k, avg=78758.90, stdev=1315437.18 lat (usec): min=37, max=50940k, avg=78761.13, stdev=1315437.16 clat percentiles (usec): | 1.00th=[ 57], 5.00th=[ 74], 10.00th=[ 14091], | 20.00th=[ 21890], 30.00th=[ 27919], 40.00th=[ 32900], | 50.00th=[ 38011], 60.00th=[ 45351], 70.00th=[ 54264], | 80.00th=[ 63701], 90.00th=[ 82314], 95.00th=[ 99091], | 99.00th=[ 162530], 99.50th=[ 198181], 99.90th=[ 624952], | 99.95th=[17112761], 99.99th=[17112761] bw ( KiB/s): min= 7, max= 104, per=34.62%, avg=44.66, stdev=19.66, samples=261 iops : min= 1, max= 26, avg=10.53, stdev= 4.95, samples=261 write: IOPS=8, BW=34.4KiB/s (35.2kB/s)(6296KiB/183157msec); 0 zone resets clat (usec): min=613, max=436854, avg=41096.32, stdev=43196.83 lat (usec): min=613, max=436857, avg=41098.32, stdev=43196.87 clat percentiles (usec): | 1.00th=[ 1139], 5.00th=[ 1385], 10.00th=[ 2008], 20.00th=[ 4686], | 30.00th=[ 8979], 40.00th=[ 19792], 50.00th=[ 30278], 60.00th=[ 40633], | 70.00th=[ 52691], 80.00th=[ 69731], 90.00th=[ 93848], 95.00th=[120062], | 99.00th=[189793], 99.50th=[235930], 99.90th=[329253], 99.95th=[438305], | 99.99th=[438305] bw ( KiB/s): min= 7, max= 118, per=34.93%, avg=47.16, stdev=20.50, samples=260 iops : min= 1, max= 29, avg=11.16, stdev= 5.19, samples=260 lat (usec) : 50=0.29%, 100=3.03%, 250=0.39%, 500=0.20%, 750=0.07% lat (usec) : 1000=0.10% lat (msec) : 2=4.98%, 4=4.10%, 10=7.03%, 20=8.53%, 50=37.76% lat (msec) : 100=26.76%, 250=6.41%, 500=0.29%, 750=0.03%, >=2000=0.03% cpu : usr=0.06%, sys=3.78%, ctx=6574, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145161: Sat Aug 22 01:43:57 2026 read: IOPS=8, BW=32.2KiB/s (32.0kB/s)(5940KiB/184492msec) clat (usec): min=25, max=462465, avg=44417.76, stdev=33932.21 lat (usec): min=25, max=462466, avg=44420.06, stdev=33932.36 clat percentiles (usec): | 1.00th=[ 54], 5.00th=[ 79], 10.00th=[ 13173], 20.00th=[ 21365], | 30.00th=[ 26870], 40.00th=[ 32637], 50.00th=[ 38011], 60.00th=[ 45351], | 70.00th=[ 53216], 80.00th=[ 64226], 90.00th=[ 81265], 95.00th=[ 99091], | 99.00th=[147850], 99.50th=[219153], 99.90th=[350225], 99.95th=[463471], | 99.99th=[463471] bw ( KiB/s): min= 6, max= 119, per=34.02%, avg=43.89, stdev=20.22, samples=264 iops : min= 1, max= 29, avg=10.33, stdev= 5.09, samples=264 write: IOPS=8, BW=34.4KiB/s (35.2kB/s)(6348KiB/184492msec); 0 zone resets clat (usec): min=833, max=51012k, avg=74405.45, stdev=1280260.97 lat (usec): min=834, max=51012k, avg=74410.08, stdev=1280260.85 clat percentiles (usec): | 1.00th=[ 1045], 5.00th=[ 1287], 10.00th=[ 1860], | 20.00th=[ 5211], 30.00th=[ 10683], 40.00th=[ 20579], | 50.00th=[ 31327], 60.00th=[ 42730], 70.00th=[ 54789], | 80.00th=[ 72877], 90.00th=[ 96994], 95.00th=[ 125305], | 99.00th=[ 181404], 99.50th=[ 212861], 99.90th=[ 666895], | 99.95th=[17112761], 99.99th=[17112761] bw ( KiB/s): min= 6, max= 143, per=34.91%, avg=47.13, stdev=21.79, samples=263 iops : min= 1, max= 35, avg=11.14, stdev= 5.48, samples=263 lat (usec) : 50=0.33%, 100=2.73%, 250=0.29%, 500=0.07%, 1000=0.52% lat (msec) : 2=5.05%, 4=3.68%, 10=6.48%, 20=9.90%, 50=36.91% lat (msec) : 100=27.08%, 250=6.67%, 500=0.23%, 750=0.03%, >=2000=0.03% cpu : usr=0.07%, sys=3.76%, ctx=6604, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145162: Sat Aug 22 01:43:57 2026 read: IOPS=8, BW=32.5KiB/s (33.3kB/s)(6028KiB/185296msec) clat (usec): min=31, max=467901, avg=43730.79, stdev=34504.67 lat (usec): min=31, max=467903, avg=43734.54, stdev=34505.56 clat percentiles (usec): | 1.00th=[ 57], 5.00th=[ 76], 10.00th=[ 11076], 20.00th=[ 20317], | 30.00th=[ 25560], 40.00th=[ 30802], 50.00th=[ 36439], 60.00th=[ 44303], | 70.00th=[ 52691], 80.00th=[ 63177], 90.00th=[ 82314], 95.00th=[ 98042], | 99.00th=[164627], 99.50th=[206570], 99.90th=[325059], 99.95th=[467665], | 99.99th=[467665] bw ( KiB/s): min= 7, max= 111, per=34.41%, avg=44.38, stdev=19.11, samples=263 iops : min= 1, max= 27, avg=10.46, stdev= 4.82, samples=263 write: IOPS=8, BW=33.8KiB/s (34.6kB/s)(6260KiB/185296msec); 0 zone resets clat (usec): min=854, max=51007k, avg=75936.26, stdev=1289036.27 lat (usec): min=855, max=51007k, avg=75945.18, stdev=1289036.53 clat percentiles (usec): | 1.00th=[ 1172], 5.00th=[ 1401], 10.00th=[ 2024], | 20.00th=[ 5800], 30.00th=[ 11600], 40.00th=[ 22676], | 50.00th=[ 33817], 60.00th=[ 43779], 70.00th=[ 56886], | 80.00th=[ 71828], 90.00th=[ 96994], 95.00th=[ 122160], | 99.00th=[ 181404], 99.50th=[ 208667], 99.90th=[ 717226], | 99.95th=[17112761], 99.99th=[17112761] bw ( KiB/s): min= 7, max= 133, per=34.00%, avg=45.90, stdev=21.16, samples=264 iops : min= 1, max= 33, avg=10.84, stdev= 5.35, samples=264 lat (usec) : 50=0.26%, 100=3.06%, 250=0.68%, 500=0.10%, 750=0.03% lat (usec) : 1000=0.13% lat (msec) : 2=4.95%, 4=3.48%, 10=6.38%, 20=9.64%, 50=36.82% lat (msec) : 100=27.34%, 250=6.90%, 500=0.16%, 750=0.03%, >=2000=0.03% cpu : usr=0.06%, sys=3.75%, ctx=6674, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145163: Sat Aug 22 01:43:57 2026 read: IOPS=8, BW=32.6KiB/s (33.4kB/s)(6052KiB/185365msec) clat (usec): min=37, max=51164k, avg=77152.34, stdev=1314658.16 lat (usec): min=37, max=51164k, avg=77153.96, stdev=1314658.15 clat percentiles (usec): | 1.00th=[ 56], 5.00th=[ 74], 10.00th=[ 11600], | 20.00th=[ 20055], 30.00th=[ 25297], 40.00th=[ 31065], | 50.00th=[ 37487], 60.00th=[ 44827], 70.00th=[ 54264], | 80.00th=[ 64750], 90.00th=[ 80217], 95.00th=[ 95945], | 99.00th=[ 152044], 99.50th=[ 217056], 99.90th=[ 299893], | 99.95th=[17112761], 99.99th=[17112761] bw ( KiB/s): min= 7, max= 111, per=34.71%, avg=44.78, stdev=19.44, samples=261 iops : min= 1, max= 27, avg=10.56, stdev= 4.89, samples=261 write: IOPS=8, BW=33.6KiB/s (34.4kB/s)(6236KiB/185365msec); 0 zone resets clat (usec): min=814, max=787195, avg=43699.07, stdev=48385.51 lat (usec): min=816, max=787198, avg=43705.25, stdev=48384.55 clat percentiles (usec): | 1.00th=[ 1156], 5.00th=[ 1401], 10.00th=[ 1942], 20.00th=[ 4883], | 30.00th=[ 9896], 40.00th=[ 21890], 50.00th=[ 32375], 60.00th=[ 43254], | 70.00th=[ 56886], 80.00th=[ 72877], 90.00th=[ 99091], 95.00th=[123208], | 99.00th=[189793], 99.50th=[246416], 99.90th=[484443], 99.95th=[784335], | 99.99th=[784335] bw ( KiB/s): min= 7, max= 120, per=34.01%, avg=45.91, stdev=21.59, samples=263 iops : min= 1, max= 30, avg=10.84, stdev= 5.44, samples=263 lat (usec) : 50=0.20%, 100=3.52%, 250=0.39%, 500=0.03%, 750=0.03% lat (usec) : 1000=0.13% lat (msec) : 2=5.05%, 4=3.87%, 10=6.71%, 20=9.54%, 50=36.10% lat (msec) : 100=27.47%, 250=6.54%, 500=0.36%, 1000=0.03%, >=2000=0.03% cpu : usr=0.07%, sys=3.70%, ctx=6659, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=130KiB/s (133kB/s), 32.2KiB/s-32.7KiB/s (32.0kB/s-33.5kB/s), io=23.4MiB (24.6MB), run=183157-185365msec WRITE: bw=136KiB/s (139kB/s), 33.6KiB/s-34.4KiB/s (34.4kB/s-35.2kB/s), io=24.6MiB (25.7MB), run=183157-185365msec fio: pid=145157, err=5/file:backend.c:481, func=full resid, error=Input/output error rand-rw: (groupid=0, jobs=1): err= 0: pid=145155: Sat Aug 22 01:46:22 2026 read: IOPS=4, BW=18.2KiB/s (18.7kB/s)(5992KiB/328634msec) clat (msec): min=4, max=682, avg=40.25, stdev=39.15 lat (msec): min=4, max=682, avg=40.26, stdev=39.15 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 13], 20.00th=[ 16], | 30.00th=[ 20], 40.00th=[ 25], 50.00th=[ 30], 60.00th=[ 36], | 70.00th=[ 43], 80.00th=[ 54], 90.00th=[ 84], 95.00th=[ 114], | 99.00th=[ 178], 99.50th=[ 190], 99.90th=[ 468], 99.95th=[ 684], | 99.99th=[ 684] bw ( KiB/s): min= 7, max= 87, per=38.64%, avg=23.95, stdev=15.56, samples=483 iops : min= 1, max= 21, avg= 5.37, stdev= 3.94, samples=483 write: IOPS=4, BW=19.2KiB/s (19.6kB/s)(6296KiB/328634msec); 0 zone resets clat (msec): min=36, max=51217, avg=170.20, stdev=1289.34 lat (msec): min=36, max=51217, avg=170.20, stdev=1289.34 clat percentiles (msec): | 1.00th=[ 47], 5.00th=[ 61], 10.00th=[ 69], 20.00th=[ 82], | 30.00th=[ 94], 40.00th=[ 107], 50.00th=[ 122], 60.00th=[ 140], | 70.00th=[ 161], 80.00th=[ 184], 90.00th=[ 226], 95.00th=[ 271], | 99.00th=[ 363], 99.50th=[ 401], 99.90th=[ 642], 99.95th=[17113], | 99.99th=[17113] bw ( KiB/s): min= 7, max= 63, per=34.41%, avg=22.37, stdev=10.52, samples=541 iops : min= 1, max= 15, avg= 4.96, stdev= 2.69, samples=541 lat (msec) : 10=2.60%, 20=12.24%, 50=23.73%, 100=24.19%, 250=33.66% lat (msec) : 500=3.42%, 750=0.13%, >=2000=0.03% cpu : usr=0.04%, sys=1.08%, ctx=5764, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145156: Sat Aug 22 01:46:22 2026 read: IOPS=4, BW=17.9KiB/s (18.4kB/s)(5940KiB/331080msec) clat (msec): min=6, max=704, avg=39.82, stdev=40.08 lat (msec): min=6, max=704, avg=39.84, stdev=40.11 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 16], | 30.00th=[ 21], 40.00th=[ 25], 50.00th=[ 30], 60.00th=[ 36], | 70.00th=[ 43], 80.00th=[ 54], 90.00th=[ 78], 95.00th=[ 104], | 99.00th=[ 203], 99.50th=[ 222], 99.90th=[ 460], 99.95th=[ 709], | 99.99th=[ 709] bw ( KiB/s): min= 7, max= 111, per=39.19%, avg=24.30, stdev=15.86, samples=472 iops : min= 1, max= 27, avg= 5.45, stdev= 3.99, samples=472 write: IOPS=4, BW=19.2KiB/s (19.6kB/s)(6348KiB/331080msec); 0 zone resets clat (msec): min=26, max=50994, avg=171.07, stdev=1278.29 lat (msec): min=26, max=50994, avg=171.08, stdev=1278.29 clat percentiles (msec): | 1.00th=[ 48], 5.00th=[ 62], 10.00th=[ 72], 20.00th=[ 87], | 30.00th=[ 100], 40.00th=[ 111], 50.00th=[ 124], 60.00th=[ 142], | 70.00th=[ 157], 80.00th=[ 186], 90.00th=[ 230], 95.00th=[ 264], | 99.00th=[ 359], 99.50th=[ 430], 99.90th=[ 550], 99.95th=[17113], | 99.99th=[17113] bw ( KiB/s): min= 7, max= 63, per=34.35%, avg=22.33, stdev=10.26, samples=547 iops : min= 1, max= 15, avg= 4.96, stdev= 2.62, samples=547 lat (msec) : 10=2.28%, 20=12.14%, 50=23.86%, 100=23.37%, 250=34.83% lat (msec) : 500=3.39%, 750=0.10%, >=2000=0.03% cpu : usr=0.04%, sys=1.10%, ctx=5747, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 5 (file:backend.c:481, func=full resid, error=Input/output error): pid=145157: Sat Aug 22 01:46:22 2026 read: IOPS=3, BW=13.3KiB/s (13.6kB/s)(2816KiB/211354msec) clat (msec): min=6, max=404, avg=54.23, stdev=47.87 lat (msec): min=6, max=404, avg=54.24, stdev=47.88 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 14], 20.00th=[ 20], | 30.00th=[ 26], 40.00th=[ 33], 50.00th=[ 41], 60.00th=[ 51], | 70.00th=[ 63], 80.00th=[ 85], 90.00th=[ 108], 95.00th=[ 138], | 99.00th=[ 228], 99.50th=[ 305], 99.90th=[ 405], 99.95th=[ 405], | 99.99th=[ 405] bw ( KiB/s): min= 7, max= 103, per=31.46%, avg=19.51, stdev=13.71, samples=275 iops : min= 1, max= 25, avg= 4.22, stdev= 3.45, samples=275 write: IOPS=3, BW=13.6KiB/s (13.9kB/s)(2872KiB/211354msec); 0 zone resets clat (msec): min=36, max=51247, avg=240.66, stdev=1908.10 lat (msec): min=36, max=51247, avg=240.66, stdev=1908.10 clat percentiles (msec): | 1.00th=[ 50], 5.00th=[ 64], 10.00th=[ 80], 20.00th=[ 101], | 30.00th=[ 117], 40.00th=[ 136], 50.00th=[ 155], 60.00th=[ 174], | 70.00th=[ 199], 80.00th=[ 228], 90.00th=[ 288], 95.00th=[ 321], | 99.00th=[ 426], 99.50th=[ 527], 99.90th=[17113], 99.95th=[17113], | 99.99th=[17113] bw ( KiB/s): min= 7, max= 56, per=26.81%, avg=17.43, stdev= 9.82, samples=312 iops : min= 1, max= 14, avg= 3.70, stdev= 2.51, samples=312 lat (msec) : 10=1.76%, 20=8.43%, 50=20.03%, 100=23.33%, 250=37.81% lat (msec) : 500=8.29%, 750=0.14%, 1000=0.07%, >=2000=0.07% cpu : usr=0.03%, sys=0.76%, ctx=2068, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=705,718,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145158: Sat Aug 22 01:46:22 2026 read: IOPS=4, BW=18.4KiB/s (18.8kB/s)(6052KiB/329433msec) clat (msec): min=5, max=465, avg=40.51, stdev=38.51 lat (msec): min=5, max=465, avg=40.51, stdev=38.51 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 17], | 30.00th=[ 21], 40.00th=[ 25], 50.00th=[ 29], 60.00th=[ 35], | 70.00th=[ 43], 80.00th=[ 55], 90.00th=[ 81], 95.00th=[ 117], | 99.00th=[ 188], 99.50th=[ 255], 99.90th=[ 401], 99.95th=[ 464], | 99.99th=[ 464] bw ( KiB/s): min= 7, max= 80, per=39.50%, avg=24.49, stdev=16.37, samples=477 iops : min= 1, max= 20, avg= 5.51, stdev= 4.13, samples=477 write: IOPS=4, BW=18.9KiB/s (19.4kB/s)(6236KiB/329433msec); 0 zone resets clat (msec): min=34, max=51264, avg=171.68, stdev=1296.88 lat (msec): min=34, max=51264, avg=171.69, stdev=1296.88 clat percentiles (msec): | 1.00th=[ 48], 5.00th=[ 63], 10.00th=[ 72], 20.00th=[ 85], | 30.00th=[ 96], 40.00th=[ 109], 50.00th=[ 122], 60.00th=[ 138], | 70.00th=[ 157], 80.00th=[ 182], 90.00th=[ 228], 95.00th=[ 268], | 99.00th=[ 414], 99.50th=[ 464], 99.90th=[ 818], 99.95th=[17113], | 99.99th=[17113] bw ( KiB/s): min= 7, max= 55, per=34.06%, avg=22.14, stdev=10.00, samples=542 iops : min= 1, max= 13, avg= 4.91, stdev= 2.54, samples=542 lat (msec) : 10=2.44%, 20=12.14%, 50=23.80%, 100=24.54%, 250=33.43% lat (msec) : 500=3.42%, 750=0.16%, 1000=0.03%, >=2000=0.03% cpu : usr=0.04%, sys=1.06%, ctx=5747, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=62.8KiB/s (64.3kB/s), 13.3KiB/s-18.4KiB/s (13.6kB/s-18.8kB/s), io=20.3MiB (21.3MB), run=211354-331080msec WRITE: bw=65.7KiB/s (67.3kB/s), 13.6KiB/s-19.2KiB/s (13.9kB/s-19.6kB/s), io=21.2MiB (22.3MB), run=211354-331080msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=145231: Sat Aug 22 01:47:07 2026 read: IOPS=11, BW=182KiB/s (186kB/s)(5920KiB/32567msec) clat (usec): min=35, max=429945, avg=44635.42, stdev=41283.39 lat (usec): min=35, max=429947, avg=44647.06, stdev=41290.85 clat percentiles (usec): | 1.00th=[ 40], 5.00th=[ 61], 10.00th=[ 73], 20.00th=[ 121], | 30.00th=[ 24773], 40.00th=[ 33817], 50.00th=[ 40633], 60.00th=[ 50070], | 70.00th=[ 57410], 80.00th=[ 69731], 90.00th=[ 89654], 95.00th=[108528], | 99.00th=[162530], 99.50th=[235930], 99.90th=[429917], 99.95th=[429917], | 99.99th=[429917] bw ( KiB/s): min= 30, max= 383, per=25.29%, avg=184.39, stdev=75.27, samples=62 iops : min= 1, max= 23, avg=10.79, stdev= 4.82, samples=62 write: IOPS=12, BW=196KiB/s (200kB/s)(6368KiB/32567msec); 0 zone resets clat (usec): min=1336, max=264327, avg=39898.61, stdev=43853.12 lat (usec): min=1337, max=264329, avg=39904.20, stdev=43851.09 clat percentiles (usec): | 1.00th=[ 1516], 5.00th=[ 1860], 10.00th=[ 2376], 20.00th=[ 5014], | 30.00th=[ 8717], 40.00th=[ 15401], 50.00th=[ 25560], 60.00th=[ 36963], | 70.00th=[ 49021], 80.00th=[ 67634], 90.00th=[ 99091], 95.00th=[120062], | 99.00th=[198181], 99.50th=[212861], 99.90th=[265290], 99.95th=[265290], | 99.99th=[265290] bw ( KiB/s): min= 32, max= 382, per=25.84%, avg=198.23, stdev=78.86, samples=62 iops : min= 2, max= 23, avg=11.68, stdev= 4.93, samples=62 lat (usec) : 50=0.91%, 100=7.94%, 250=1.69%, 750=0.26% lat (msec) : 2=3.91%, 4=5.21%, 10=8.20%, 20=8.07%, 50=29.04% lat (msec) : 100=26.17%, 250=8.33%, 500=0.26% cpu : usr=0.08%, sys=5.72%, ctx=1429, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145232: Sat Aug 22 01:47:07 2026 read: IOPS=10, BW=176KiB/s (180kB/s)(5744KiB/32717msec) clat (usec): min=26, max=255856, avg=47942.46, stdev=39145.85 lat (usec): min=26, max=255857, avg=47943.88, stdev=39145.95 clat percentiles (usec): | 1.00th=[ 42], 5.00th=[ 57], 10.00th=[ 73], 20.00th=[ 14615], | 30.00th=[ 25822], 40.00th=[ 34866], 50.00th=[ 43254], 60.00th=[ 52691], | 70.00th=[ 61604], 80.00th=[ 74974], 90.00th=[ 95945], 95.00th=[122160], | 99.00th=[175113], 99.50th=[244319], 99.90th=[256902], 99.95th=[256902], | 99.99th=[256902] bw ( KiB/s): min= 63, max= 411, per=24.04%, avg=175.28, stdev=76.05, samples=64 iops : min= 3, max= 25, avg=10.23, stdev= 4.78, samples=64 write: IOPS=12, BW=200KiB/s (205kB/s)(6544KiB/32717msec); 0 zone resets clat (usec): min=1262, max=371940, avg=37369.68, stdev=42045.94 lat (usec): min=1263, max=371945, avg=37385.73, stdev=42037.03 clat percentiles (usec): | 1.00th=[ 1614], 5.00th=[ 1876], 10.00th=[ 2507], 20.00th=[ 5145], | 30.00th=[ 8586], 40.00th=[ 12256], 50.00th=[ 21365], 60.00th=[ 33162], | 70.00th=[ 47973], 80.00th=[ 67634], 90.00th=[ 95945], 95.00th=[116917], | 99.00th=[164627], 99.50th=[202376], 99.90th=[371196], 99.95th=[371196], | 99.99th=[371196] bw ( KiB/s): min= 31, max= 409, per=25.88%, avg=198.50, stdev=93.45, samples=64 iops : min= 1, max= 25, avg=11.69, stdev= 5.93, samples=64 lat (usec) : 50=1.30%, 100=4.95%, 250=1.56%, 500=0.13%, 1000=0.13% lat (msec) : 2=3.39%, 4=4.69%, 10=10.03%, 20=10.81%, 50=27.99% lat (msec) : 100=26.43%, 250=8.33%, 500=0.26% cpu : usr=0.07%, sys=5.74%, ctx=1470, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145233: Sat Aug 22 01:47:07 2026 read: IOPS=11, BW=191KiB/s (195kB/s)(6256KiB/32832msec) clat (usec): min=39, max=239092, avg=45296.70, stdev=38709.38 lat (usec): min=39, max=239094, avg=45298.49, stdev=38709.30 clat percentiles (usec): | 1.00th=[ 43], 5.00th=[ 59], 10.00th=[ 72], 20.00th=[ 251], | 30.00th=[ 25035], 40.00th=[ 34341], 50.00th=[ 40109], 60.00th=[ 47449], | 70.00th=[ 58459], 80.00th=[ 70779], 90.00th=[ 92799], 95.00th=[116917], | 99.00th=[179307], 99.50th=[204473], 99.90th=[240124], 99.95th=[240124], | 99.99th=[240124] bw ( KiB/s): min= 62, max= 478, per=26.00%, avg=189.52, stdev=94.46, samples=64 iops : min= 3, max= 29, avg=11.13, stdev= 5.97, samples=64 write: IOPS=11, BW=184KiB/s (188kB/s)(6032KiB/32832msec); 0 zone resets clat (usec): min=1389, max=349531, avg=39796.74, stdev=43033.69 lat (usec): min=1392, max=349536, avg=39811.45, stdev=43050.03 clat percentiles (usec): | 1.00th=[ 1532], 5.00th=[ 1827], 10.00th=[ 2409], 20.00th=[ 4948], | 30.00th=[ 8717], 40.00th=[ 14222], 50.00th=[ 25035], 60.00th=[ 35390], | 70.00th=[ 55837], 80.00th=[ 71828], 90.00th=[ 92799], 95.00th=[116917], | 99.00th=[170918], 99.50th=[225444], 99.90th=[350225], 99.95th=[350225], | 99.99th=[350225] bw ( KiB/s): min= 31, max= 495, per=23.40%, avg=179.50, stdev=98.47, samples=64 iops : min= 1, max= 30, avg=10.48, stdev= 6.20, samples=64 lat (usec) : 50=1.82%, 100=7.03%, 250=1.30%, 500=0.26%, 750=0.13% lat (msec) : 2=3.26%, 4=5.86%, 10=7.42%, 20=8.33%, 50=29.43% lat (msec) : 100=27.73%, 250=7.29%, 500=0.13% cpu : usr=0.10%, sys=5.54%, ctx=1445, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145234: Sat Aug 22 01:47:07 2026 read: IOPS=12, BW=195KiB/s (200kB/s)(6032KiB/30901msec) clat (usec): min=37, max=216690, avg=45094.87, stdev=38547.32 lat (usec): min=37, max=216691, avg=45098.69, stdev=38547.67 clat percentiles (usec): | 1.00th=[ 42], 5.00th=[ 61], 10.00th=[ 70], 20.00th=[ 135], | 30.00th=[ 22676], 40.00th=[ 32113], 50.00th=[ 39584], 60.00th=[ 49546], | 70.00th=[ 60556], 80.00th=[ 72877], 90.00th=[ 94897], 95.00th=[110625], | 99.00th=[166724], 99.50th=[198181], 99.90th=[217056], 99.95th=[217056], | 99.99th=[217056] bw ( KiB/s): min= 31, max= 412, per=26.47%, avg=192.98, stdev=85.47, samples=60 iops : min= 1, max= 25, avg=11.35, stdev= 5.41, samples=60 write: IOPS=12, BW=202KiB/s (207kB/s)(6256KiB/30901msec); 0 zone resets clat (usec): min=1056, max=221390, avg=34939.20, stdev=38441.12 lat (usec): min=1059, max=221393, avg=34955.53, stdev=38441.15 clat percentiles (usec): | 1.00th=[ 1598], 5.00th=[ 2024], 10.00th=[ 2933], 20.00th=[ 6063], | 30.00th=[ 8848], 40.00th=[ 12518], 50.00th=[ 17957], 60.00th=[ 28705], | 70.00th=[ 43779], 80.00th=[ 63177], 90.00th=[ 87557], 95.00th=[111674], | 99.00th=[168821], 99.50th=[202376], 99.90th=[221250], 99.95th=[221250], | 99.99th=[221250] bw ( KiB/s): min= 91, max= 452, per=26.24%, avg=201.23, stdev=85.96, samples=60 iops : min= 5, max= 28, avg=11.88, stdev= 5.44, samples=60 lat (usec) : 50=1.04%, 100=7.81%, 250=1.69%, 500=0.39%, 750=0.13% lat (msec) : 2=2.47%, 4=4.95%, 10=9.90%, 20=12.37%, 50=26.30% lat (msec) : 100=25.00%, 250=7.94% cpu : usr=0.12%, sys=5.83%, ctx=1415, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=730KiB/s (747kB/s), 176KiB/s-195KiB/s (180kB/s-200kB/s), io=23.4MiB (24.5MB), run=30901-32832msec WRITE: bw=768KiB/s (786kB/s), 184KiB/s-202KiB/s (188kB/s-207kB/s), io=24.6MiB (25.8MB), run=30901-32832msec rand-rw: (groupid=0, jobs=1): err= 0: pid=145236: Sat Aug 22 01:47:59 2026 read: IOPS=4, BW=72.1KiB/s (73.9kB/s)(5920KiB/82083msec) clat (msec): min=9, max=419, avg=45.51, stdev=45.52 lat (msec): min=9, max=419, avg=45.51, stdev=45.52 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 19], | 30.00th=[ 23], 40.00th=[ 27], 50.00th=[ 32], 60.00th=[ 39], | 70.00th=[ 48], 80.00th=[ 62], 90.00th=[ 90], 95.00th=[ 123], | 99.00th=[ 234], 99.50th=[ 384], 99.90th=[ 418], 99.95th=[ 418], | 99.99th=[ 418] bw ( KiB/s): min= 30, max= 320, per=29.84%, avg=85.93, stdev=55.35, samples=135 iops : min= 1, max= 20, avg= 4.61, stdev= 3.53, samples=135 write: IOPS=4, BW=77.6KiB/s (79.4kB/s)(6368KiB/82083msec); 0 zone resets clat (msec): min=54, max=516, avg=163.70, stdev=77.90 lat (msec): min=54, max=516, avg=163.70, stdev=77.90 clat percentiles (msec): | 1.00th=[ 62], 5.00th=[ 74], 10.00th=[ 86], 20.00th=[ 103], | 30.00th=[ 115], 40.00th=[ 130], 50.00th=[ 146], 60.00th=[ 161], | 70.00th=[ 182], 80.00th=[ 209], 90.00th=[ 288], 95.00th=[ 334], | 99.00th=[ 397], 99.50th=[ 443], 99.90th=[ 518], 99.95th=[ 518], | 99.99th=[ 518] bw ( KiB/s): min= 29, max= 160, per=25.53%, avg=77.34, stdev=34.35, samples=161 iops : min= 1, max= 10, avg= 4.07, stdev= 2.23, samples=161 lat (msec) : 10=0.39%, 20=11.07%, 50=23.31%, 100=19.66%, 250=38.15% lat (msec) : 500=7.29%, 750=0.13% cpu : usr=0.03%, sys=1.09%, ctx=1268, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145237: Sat Aug 22 01:47:59 2026 read: IOPS=4, BW=69.2KiB/s (70.9kB/s)(5744KiB/83008msec) clat (msec): min=6, max=313, avg=46.97, stdev=48.95 lat (msec): min=6, max=313, avg=46.98, stdev=48.95 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 19], | 30.00th=[ 23], 40.00th=[ 26], 50.00th=[ 32], 60.00th=[ 36], | 70.00th=[ 44], 80.00th=[ 56], 90.00th=[ 108], 95.00th=[ 161], | 99.00th=[ 268], 99.50th=[ 288], 99.90th=[ 313], 99.95th=[ 313], | 99.99th=[ 313] bw ( KiB/s): min= 29, max= 369, per=29.56%, avg=85.13, stdev=57.36, samples=133 iops : min= 1, max= 23, avg= 4.59, stdev= 3.66, samples=133 write: IOPS=4, BW=78.8KiB/s (80.7kB/s)(6544KiB/83008msec); 0 zone resets clat (msec): min=35, max=483, avg=161.51, stdev=77.00 lat (msec): min=35, max=483, avg=161.51, stdev=77.00 clat percentiles (msec): | 1.00th=[ 45], 5.00th=[ 71], 10.00th=[ 83], 20.00th=[ 100], | 30.00th=[ 115], 40.00th=[ 130], 50.00th=[ 142], 60.00th=[ 161], | 70.00th=[ 190], 80.00th=[ 213], 90.00th=[ 266], 95.00th=[ 321], | 99.00th=[ 426], 99.50th=[ 451], 99.90th=[ 485], 99.95th=[ 485], | 99.99th=[ 485] bw ( KiB/s): min= 30, max= 286, per=26.55%, avg=80.46, stdev=38.38, samples=160 iops : min= 1, max= 17, avg= 4.28, stdev= 2.47, samples=160 lat (msec) : 10=1.56%, 20=10.16%, 50=24.35%, 100=16.93%, 250=39.97% lat (msec) : 500=7.03% cpu : usr=0.05%, sys=1.09%, ctx=1310, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145238: Sat Aug 22 01:47:59 2026 read: IOPS=4, BW=77.8KiB/s (79.7kB/s)(6256KiB/80411msec) clat (msec): min=6, max=332, avg=42.47, stdev=40.86 lat (msec): min=6, max=332, avg=42.48, stdev=40.86 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 15], 20.00th=[ 18], | 30.00th=[ 22], 40.00th=[ 26], 50.00th=[ 30], 60.00th=[ 35], | 70.00th=[ 41], 80.00th=[ 54], 90.00th=[ 84], 95.00th=[ 133], | 99.00th=[ 211], 99.50th=[ 266], 99.90th=[ 334], 99.95th=[ 334], | 99.99th=[ 334] bw ( KiB/s): min= 30, max= 318, per=31.51%, avg=90.74, stdev=61.37, samples=136 iops : min= 1, max= 19, avg= 4.94, stdev= 3.87, samples=136 write: IOPS=4, BW=75.0KiB/s (76.8kB/s)(6032KiB/80411msec); 0 zone resets clat (msec): min=58, max=508, avg=169.06, stdev=81.73 lat (msec): min=58, max=508, avg=169.08, stdev=81.76 clat percentiles (msec): | 1.00th=[ 65], 5.00th=[ 75], 10.00th=[ 91], 20.00th=[ 103], | 30.00th=[ 120], 40.00th=[ 132], 50.00th=[ 146], 60.00th=[ 163], | 70.00th=[ 194], 80.00th=[ 222], 90.00th=[ 284], 95.00th=[ 334], | 99.00th=[ 439], 99.50th=[ 472], 99.90th=[ 510], 99.95th=[ 510], | 99.99th=[ 510] bw ( KiB/s): min= 31, max= 158, per=25.06%, avg=75.92, stdev=32.83, samples=156 iops : min= 1, max= 9, avg= 3.99, stdev= 2.13, samples=156 lat (msec) : 10=0.78%, 20=12.24%, 50=26.30%, 100=16.54%, 250=36.98% lat (msec) : 500=7.03%, 750=0.13% cpu : usr=0.05%, sys=1.32%, ctx=1375, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145239: Sat Aug 22 01:47:59 2026 read: IOPS=4, BW=74.2KiB/s (75.0kB/s)(6032KiB/81289msec) clat (msec): min=9, max=384, avg=46.18, stdev=47.05 lat (msec): min=9, max=384, avg=46.19, stdev=47.08 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 13], 10.00th=[ 14], 20.00th=[ 18], | 30.00th=[ 21], 40.00th=[ 25], 50.00th=[ 29], 60.00th=[ 36], | 70.00th=[ 46], 80.00th=[ 62], 90.00th=[ 102], 95.00th=[ 138], | 99.00th=[ 230], 99.50th=[ 292], 99.90th=[ 384], 99.95th=[ 384], | 99.99th=[ 384] bw ( KiB/s): min= 30, max= 287, per=29.45%, avg=84.82, stdev=56.81, samples=138 iops : min= 1, max= 17, avg= 4.56, stdev= 3.61, samples=138 write: IOPS=4, BW=76.0KiB/s (78.8kB/s)(6256KiB/81289msec); 0 zone resets clat (msec): min=55, max=552, avg=163.13, stdev=76.91 lat (msec): min=55, max=552, avg=163.14, stdev=76.91 clat percentiles (msec): | 1.00th=[ 62], 5.00th=[ 79], 10.00th=[ 89], 20.00th=[ 108], | 30.00th=[ 118], 40.00th=[ 130], 50.00th=[ 144], 60.00th=[ 159], | 70.00th=[ 178], 80.00th=[ 207], 90.00th=[ 268], 95.00th=[ 317], | 99.00th=[ 451], 99.50th=[ 550], 99.90th=[ 550], 99.95th=[ 550], | 99.99th=[ 550] bw ( KiB/s): min= 30, max= 160, per=26.03%, avg=78.88, stdev=35.98, samples=155 iops : min= 1, max= 10, avg= 4.17, stdev= 2.32, samples=155 lat (msec) : 10=0.13%, 20=13.02%, 50=22.66%, 100=16.28%, 250=40.62% lat (msec) : 500=7.03%, 750=0.26% cpu : usr=0.05%, sys=1.22%, ctx=1320, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=289KiB/s (295kB/s), 69.2KiB/s-77.8KiB/s (70.9kB/s-79.7kB/s), io=23.4MiB (24.5MB), run=80411-83008msec WRITE: bw=304KiB/s (311kB/s), 75.0KiB/s-78.8KiB/s (76.8kB/s-80.7kB/s), io=24.6MiB (25.8MB), run=80411-83008msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=145258: Sat Aug 22 01:48:16 2026 read: IOPS=1, BW=1652KiB/s (1692kB/s)(7168KiB/4339msec) clat (msec): min=124, max=324, avg=192.77, stdev=65.71 lat (msec): min=124, max=324, avg=192.77, stdev=65.71 clat percentiles (msec): | 1.00th=[ 125], 5.00th=[ 125], 10.00th=[ 125], 20.00th=[ 140], | 30.00th=[ 176], 40.00th=[ 176], 50.00th=[ 184], 60.00th=[ 186], | 70.00th=[ 186], 80.00th=[ 218], 90.00th=[ 326], 95.00th=[ 326], | 99.00th=[ 326], 99.50th=[ 326], 99.90th=[ 326], 99.95th=[ 326], | 99.99th=[ 326] bw ( KiB/s): min= 2031, max= 3778, per=81.41%, avg=2768.75, stdev=880.25, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 1.15, samples=4 write: IOPS=1, BW=1180KiB/s (1208kB/s)(5120KiB/4339msec); 0 zone resets clat (msec): min=274, max=987, avg=562.88, stdev=324.98 lat (msec): min=274, max=987, avg=562.98, stdev=324.97 clat percentiles (msec): | 1.00th=[ 275], 5.00th=[ 275], 10.00th=[ 275], 20.00th=[ 275], | 30.00th=[ 296], 40.00th=[ 296], 50.00th=[ 430], 60.00th=[ 430], | 70.00th=[ 827], 80.00th=[ 827], 90.00th=[ 986], 95.00th=[ 986], | 99.00th=[ 986], 99.50th=[ 986], 99.90th=[ 986], 99.95th=[ 986], | 99.99th=[ 986] bw ( KiB/s): min= 1992, max= 2048, per=42.61%, avg=2028.50, stdev=25.36, samples=4 iops : min= 1, max= 2, avg= 1.25, stdev= 0.50, samples=4 lat (msec) : 250=50.00%, 500=33.33%, 1000=16.67% cpu : usr=0.00%, sys=4.26%, ctx=82, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145259: Sat Aug 22 01:48:16 2026 read: IOPS=0, BW=340KiB/s (348kB/s)(2048KiB/6021msec) clat (msec): min=188, max=192, avg=190.37, stdev= 3.11 lat (msec): min=188, max=192, avg=190.37, stdev= 3.11 clat percentiles (msec): | 1.00th=[ 188], 5.00th=[ 188], 10.00th=[ 188], 20.00th=[ 188], | 30.00th=[ 188], 40.00th=[ 188], 50.00th=[ 188], 60.00th=[ 192], | 70.00th=[ 192], 80.00th=[ 192], 90.00th=[ 192], 95.00th=[ 192], | 99.00th=[ 192], 99.50th=[ 192], 99.90th=[ 192], 99.95th=[ 192], | 99.99th=[ 192] bw ( KiB/s): min= 1659, max= 2048, per=54.50%, avg=1853.50, stdev=275.06, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 write: IOPS=1, BW=1701KiB/s (1742kB/s)(10.0MiB/6021msec); 0 zone resets clat (msec): min=209, max=1670, avg=555.69, stdev=422.96 lat (msec): min=209, max=1670, avg=555.87, stdev=422.99 clat percentiles (msec): | 1.00th=[ 209], 5.00th=[ 209], 10.00th=[ 209], 20.00th=[ 236], | 30.00th=[ 338], 40.00th=[ 388], 50.00th=[ 443], 60.00th=[ 468], | 70.00th=[ 472], 80.00th=[ 575], 90.00th=[ 760], 95.00th=[ 1670], | 99.00th=[ 1670], 99.50th=[ 1670], 99.90th=[ 1670], 99.95th=[ 1670], | 99.99th=[ 1670] bw ( KiB/s): min= 1659, max= 4096, per=51.15%, avg=2435.43, stdev=886.07, samples=7 iops : min= 1, max= 4, avg= 1.71, stdev= 1.25, samples=7 lat (msec) : 250=33.33%, 500=41.67%, 750=8.33%, 1000=8.33%, 2000=8.33% cpu : usr=0.03%, sys=4.44%, ctx=77, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145260: Sat Aug 22 01:48:16 2026 read: IOPS=1, BW=1087KiB/s (1113kB/s)(6144KiB/5653msec) clat (msec): min=129, max=698, avg=364.99, stdev=196.35 lat (msec): min=129, max=698, avg=364.99, stdev=196.35 clat percentiles (msec): | 1.00th=[ 130], 5.00th=[ 130], 10.00th=[ 130], 20.00th=[ 245], | 30.00th=[ 245], 40.00th=[ 284], 50.00th=[ 284], 60.00th=[ 405], | 70.00th=[ 426], 80.00th=[ 426], 90.00th=[ 701], 95.00th=[ 701], | 99.00th=[ 701], 99.50th=[ 701], 99.90th=[ 701], 99.95th=[ 701], | 99.99th=[ 701] bw ( KiB/s): min= 2023, max= 2048, per=59.86%, avg=2036.00, stdev= 9.85, samples=5 iops : min= 1, max= 2, avg= 1.20, stdev= 0.45, samples=5 write: IOPS=1, BW=1087KiB/s (1113kB/s)(6144KiB/5653msec); 0 zone resets clat (msec): min=203, max=795, avg=551.74, stdev=226.28 lat (msec): min=203, max=795, avg=552.44, stdev=226.36 clat percentiles (msec): | 1.00th=[ 205], 5.00th=[ 205], 10.00th=[ 205], 20.00th=[ 451], | 30.00th=[ 451], 40.00th=[ 456], 50.00th=[ 456], 60.00th=[ 634], | 70.00th=[ 776], 80.00th=[ 776], 90.00th=[ 793], 95.00th=[ 793], | 99.00th=[ 793], 99.50th=[ 793], 99.90th=[ 793], 99.95th=[ 793], | 99.99th=[ 793] bw ( KiB/s): min= 1992, max= 3235, per=48.78%, avg=2322.25, stdev=608.78, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (msec) : 250=25.00%, 500=41.67%, 750=16.67%, 1000=16.67% cpu : usr=0.00%, sys=2.44%, ctx=67, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145261: Sat Aug 22 01:48:16 2026 read: IOPS=0, BW=1002KiB/s (1026kB/s)(5120KiB/5112msec) clat (msec): min=73, max=428, avg=220.34, stdev=165.13 lat (msec): min=73, max=428, avg=220.34, stdev=165.13 clat percentiles (msec): | 1.00th=[ 74], 5.00th=[ 74], 10.00th=[ 74], 20.00th=[ 74], | 30.00th=[ 91], 40.00th=[ 91], 50.00th=[ 144], 60.00th=[ 144], | 70.00th=[ 368], 80.00th=[ 368], 90.00th=[ 430], 95.00th=[ 430], | 99.00th=[ 430], 99.50th=[ 430], 99.90th=[ 430], 99.95th=[ 430], | 99.99th=[ 430] bw ( KiB/s): min= 1992, max= 6144, per=100.00%, avg=4068.00, stdev=2935.91, samples=2 iops : min= 1, max= 6, avg= 3.50, stdev= 3.54, samples=2 write: IOPS=1, BW=1402KiB/s (1436kB/s)(7168KiB/5112msec); 0 zone resets clat (msec): min=214, max=1072, avg=552.15, stdev=306.79 lat (msec): min=214, max=1072, avg=552.27, stdev=306.79 clat percentiles (msec): | 1.00th=[ 215], 5.00th=[ 215], 10.00th=[ 215], 20.00th=[ 372], | 30.00th=[ 384], 40.00th=[ 384], 50.00th=[ 393], 60.00th=[ 575], | 70.00th=[ 575], 80.00th=[ 860], 90.00th=[ 1070], 95.00th=[ 1070], | 99.00th=[ 1070], 99.50th=[ 1070], 99.90th=[ 1070], 99.95th=[ 1070], | 99.99th=[ 1070] bw ( KiB/s): min= 1617, max= 2043, per=40.04%, avg=1906.20, stdev=189.04, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 lat (msec) : 100=16.67%, 250=16.67%, 500=41.67%, 750=8.33%, 1000=8.33% lat (msec) : 2000=8.33% cpu : usr=0.00%, sys=3.68%, ctx=93, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3401KiB/s (3483kB/s), 340KiB/s-1652KiB/s (348kB/s-1692kB/s), io=20.0MiB (20.0MB), run=4339-6021msec WRITE: bw=4762KiB/s (4876kB/s), 1087KiB/s-1701KiB/s (1113kB/s-1742kB/s), io=28.0MiB (29.4MB), run=4339-6021msec rand-rw: (groupid=0, jobs=1): err= 0: pid=145263: Sat Aug 22 01:48:17 2026 read: IOPS=1, BW=2042KiB/s (2091kB/s)(7168KiB/3510msec) clat (usec): min=932, max=461326, avg=246647.98, stdev=146802.78 lat (usec): min=934, max=461328, avg=246649.71, stdev=146802.73 clat percentiles (usec): | 1.00th=[ 930], 5.00th=[ 930], 10.00th=[ 930], 20.00th=[198181], | 30.00th=[198181], 40.00th=[198181], 50.00th=[214959], 60.00th=[283116], | 70.00th=[283116], 80.00th=[371196], 90.00th=[459277], 95.00th=[459277], | 99.00th=[459277], 99.50th=[459277], 99.90th=[459277], 99.95th=[459277], | 99.99th=[459277] bw ( KiB/s): min= 1825, max= 3690, per=55.49%, avg=2294.00, stdev=785.46, samples=5 iops : min= 1, max= 3, avg= 1.60, stdev= 0.89, samples=5 write: IOPS=1, BW=1459KiB/s (1494kB/s)(5120KiB/3510msec); 0 zone resets clat (msec): min=300, max=417, avg=355.91, stdev=43.21 lat (msec): min=301, max=417, avg=356.48, stdev=43.11 clat percentiles (msec): | 1.00th=[ 300], 5.00th=[ 300], 10.00th=[ 300], 20.00th=[ 300], | 30.00th=[ 338], 40.00th=[ 338], 50.00th=[ 351], 60.00th=[ 351], | 70.00th=[ 372], 80.00th=[ 372], 90.00th=[ 418], 95.00th=[ 418], | 99.00th=[ 418], 99.50th=[ 418], 99.90th=[ 418], 99.95th=[ 418], | 99.99th=[ 418] bw ( KiB/s): min= 1825, max= 2048, per=34.08%, avg=1972.75, stdev=100.21, samples=4 iops : min= 1, max= 2, avg= 1.25, stdev= 0.50, samples=4 lat (usec) : 1000=8.33% lat (msec) : 250=25.00%, 500=66.67% cpu : usr=0.00%, sys=18.01%, ctx=236, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145264: Sat Aug 22 01:48:17 2026 read: IOPS=0, BW=413KiB/s (423kB/s)(2048KiB/4953msec) clat (msec): min=4, max=173, avg=88.86, stdev=119.86 lat (msec): min=4, max=173, avg=88.86, stdev=119.86 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 5], 10.00th=[ 5], 20.00th=[ 5], | 30.00th=[ 5], 40.00th=[ 5], 50.00th=[ 5], 60.00th=[ 174], | 70.00th=[ 174], 80.00th=[ 174], 90.00th=[ 174], 95.00th=[ 174], | 99.00th=[ 174], 99.50th=[ 174], 99.90th=[ 174], 99.95th=[ 174], | 99.99th=[ 174] bw ( KiB/s): min= 1721, max= 2048, per=45.59%, avg=1884.50, stdev=231.22, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 write: IOPS=2, BW=2067KiB/s (2117kB/s)(10.0MiB/4953msec); 0 zone resets clat (msec): min=282, max=831, avg=477.26, stdev=184.08 lat (msec): min=282, max=831, avg=477.43, stdev=184.07 clat percentiles (msec): | 1.00th=[ 284], 5.00th=[ 284], 10.00th=[ 284], 20.00th=[ 309], | 30.00th=[ 351], 40.00th=[ 368], 50.00th=[ 376], 60.00th=[ 439], | 70.00th=[ 481], 80.00th=[ 659], 90.00th=[ 676], 95.00th=[ 835], | 99.00th=[ 835], 99.50th=[ 835], 99.90th=[ 835], 99.95th=[ 835], | 99.99th=[ 835] bw ( KiB/s): min= 1825, max= 4063, per=44.27%, avg=2562.57, stdev=1014.92, samples=7 iops : min= 1, max= 3, avg= 1.86, stdev= 0.90, samples=7 lat (msec) : 10=8.33%, 250=8.33%, 500=58.33%, 750=16.67%, 1000=8.33% cpu : usr=0.02%, sys=14.33%, ctx=186, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145265: Sat Aug 22 01:48:17 2026 read: IOPS=1, BW=1314KiB/s (1346kB/s)(6144KiB/4675msec) clat (usec): min=609, max=240660, avg=75403.29, stdev=112339.39 lat (usec): min=610, max=240662, avg=75405.00, stdev=112339.84 clat percentiles (usec): | 1.00th=[ 611], 5.00th=[ 611], 10.00th=[ 611], 20.00th=[ 1188], | 30.00th=[ 1188], 40.00th=[ 5932], 50.00th=[ 5932], 60.00th=[ 5932], | 70.00th=[198181], 80.00th=[198181], 90.00th=[240124], 95.00th=[240124], | 99.00th=[240124], 99.50th=[240124], 99.90th=[240124], 99.95th=[240124], | 99.99th=[240124] bw ( KiB/s): min= 2048, max= 4071, per=81.71%, avg=3378.00, stdev=1152.15, samples=3 iops : min= 2, max= 3, avg= 2.67, stdev= 0.58, samples=3 write: IOPS=1, BW=1314KiB/s (1346kB/s)(6144KiB/4675msec); 0 zone resets clat (msec): min=376, max=1311, avg=700.57, stdev=330.02 lat (msec): min=376, max=1311, avg=700.65, stdev=330.01 clat percentiles (msec): | 1.00th=[ 376], 5.00th=[ 376], 10.00th=[ 376], 20.00th=[ 502], | 30.00th=[ 502], 40.00th=[ 609], 50.00th=[ 609], 60.00th=[ 609], | 70.00th=[ 802], 80.00th=[ 802], 90.00th=[ 1318], 95.00th=[ 1318], | 99.00th=[ 1318], 99.50th=[ 1318], 99.90th=[ 1318], 99.95th=[ 1318], | 99.99th=[ 1318] bw ( KiB/s): min= 1825, max= 2048, per=33.90%, avg=1962.20, stdev=97.31, samples=5 iops : min= 1, max= 2, avg= 1.20, stdev= 0.45, samples=5 lat (usec) : 750=8.33% lat (msec) : 2=8.33%, 10=16.67%, 250=16.67%, 500=8.33%, 750=25.00% lat (msec) : 1000=8.33%, 2000=8.33% cpu : usr=0.00%, sys=9.61%, ctx=117, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145266: Sat Aug 22 01:48:17 2026 read: IOPS=1, BW=1206KiB/s (1235kB/s)(5120KiB/4246msec) clat (usec): min=610, max=422568, avg=215531.82, stdev=209198.20 lat (usec): min=611, max=422569, avg=215533.24, stdev=209198.07 clat percentiles (usec): | 1.00th=[ 611], 5.00th=[ 611], 10.00th=[ 611], 20.00th=[ 611], | 30.00th=[ 2540], 40.00th=[ 2540], 50.00th=[235930], 60.00th=[235930], | 70.00th=[417334], 80.00th=[417334], 90.00th=[421528], 95.00th=[421528], | 99.00th=[421528], 99.50th=[421528], 99.90th=[421528], 99.95th=[421528], | 99.99th=[421528] bw ( KiB/s): min= 4015, max= 4096, per=98.10%, avg=4055.50, stdev=57.28, samples=2 iops : min= 3, max= 4, avg= 3.50, stdev= 0.71, samples=2 write: IOPS=1, BW=1688KiB/s (1729kB/s)(7168KiB/4246msec); 0 zone resets clat (msec): min=204, max=820, avg=451.92, stdev=230.11 lat (msec): min=204, max=820, avg=452.02, stdev=230.08 clat percentiles (msec): | 1.00th=[ 205], 5.00th=[ 205], 10.00th=[ 205], 20.00th=[ 296], | 30.00th=[ 300], 40.00th=[ 300], 50.00th=[ 313], 60.00th=[ 592], | 70.00th=[ 592], 80.00th=[ 642], 90.00th=[ 818], 95.00th=[ 818], | 99.00th=[ 818], 99.50th=[ 818], 99.90th=[ 818], 99.95th=[ 818], | 99.99th=[ 818] bw ( KiB/s): min= 1825, max= 4096, per=50.64%, avg=2931.00, stdev=1178.73, samples=4 iops : min= 1, max= 4, avg= 2.25, stdev= 1.50, samples=4 lat (usec) : 750=8.33% lat (msec) : 4=8.33%, 250=16.67%, 500=41.67%, 750=16.67%, 1000=8.33% cpu : usr=0.00%, sys=13.36%, ctx=188, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4135KiB/s (4234kB/s), 413KiB/s-2042KiB/s (423kB/s-2091kB/s), io=20.0MiB (20.0MB), run=3510-4953msec WRITE: bw=5789KiB/s (5928kB/s), 1314KiB/s-2067KiB/s (1346kB/s-2117kB/s), io=28.0MiB (29.4MB), run=3510-4953msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=145272: Sat Aug 22 01:48:30 2026 read: IOPS=0, BW=3634KiB/s (3722kB/s)(12.0MiB/3381msec) clat (msec): min=954, max=1220, avg=1077.21, stdev=134.39 lat (msec): min=954, max=1220, avg=1077.22, stdev=134.39 clat percentiles (msec): | 1.00th=[ 953], 5.00th=[ 953], 10.00th=[ 953], 20.00th=[ 953], | 30.00th=[ 953], 40.00th=[ 1053], 50.00th=[ 1053], 60.00th=[ 1053], | 70.00th=[ 1217], 80.00th=[ 1217], 90.00th=[ 1217], 95.00th=[ 1217], | 99.00th=[ 1217], 99.50th=[ 1217], 99.90th=[ 1217], 99.95th=[ 1217], | 99.99th=[ 1217] bw ( KiB/s): min= 7787, max= 7846, per=100.00%, avg=7816.50, stdev=41.72, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=33.33%, 2000=66.67% cpu : usr=0.00%, sys=11.36%, ctx=210, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145273: Sat Aug 22 01:48:30 2026 read: IOPS=0, BW=1538KiB/s (1574kB/s)(4096KiB/2664msec) clat (nsec): min=1046.9M, max=1046.9M, avg=1046907875.00, stdev= 0.00 lat (nsec): min=1046.9M, max=1046.9M, avg=1046910992.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1045], 5.00th=[ 1045], 10.00th=[ 1045], 20.00th=[ 1045], | 30.00th=[ 1045], 40.00th=[ 1045], 50.00th=[ 1045], 60.00th=[ 1045], | 70.00th=[ 1045], 80.00th=[ 1045], 90.00th=[ 1045], 95.00th=[ 1045], | 99.00th=[ 1045], 99.50th=[ 1045], 99.90th=[ 1045], 99.95th=[ 1045], | 99.99th=[ 1045] bw ( KiB/s): min= 7787, max= 7787, per=100.00%, avg=7787.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=3075KiB/s (3149kB/s)(8192KiB/2664msec); 0 zone resets clat (msec): min=367, max=1103, avg=735.88, stdev=520.46 lat (msec): min=368, max=1104, avg=736.33, stdev=520.53 clat percentiles (msec): | 1.00th=[ 368], 5.00th=[ 368], 10.00th=[ 368], 20.00th=[ 368], | 30.00th=[ 368], 40.00th=[ 368], 50.00th=[ 368], 60.00th=[ 1099], | 70.00th=[ 1099], 80.00th=[ 1099], 90.00th=[ 1099], 95.00th=[ 1099], | 99.00th=[ 1099], 99.50th=[ 1099], 99.90th=[ 1099], 99.95th=[ 1099], | 99.99th=[ 1099] bw ( KiB/s): min= 7787, max= 7787, per=97.65%, avg=7787.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.00%, sys=6.76%, ctx=227, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145274: Sat Aug 22 01:48:30 2026 write: IOPS=0, BW=2991KiB/s (3062kB/s)(12.0MiB/4109msec); 0 zone resets clat (msec): min=614, max=1917, avg=1316.19, stdev=657.34 lat (msec): min=617, max=1917, avg=1317.51, stdev=655.93 clat percentiles (msec): | 1.00th=[ 617], 5.00th=[ 617], 10.00th=[ 617], 20.00th=[ 617], | 30.00th=[ 617], 40.00th=[ 1418], 50.00th=[ 1418], 60.00th=[ 1418], | 70.00th=[ 1921], 80.00th=[ 1921], 90.00th=[ 1921], 95.00th=[ 1921], | 99.00th=[ 1921], 99.50th=[ 1921], 99.90th=[ 1921], 99.95th=[ 1921], | 99.99th=[ 1921] bw ( KiB/s): min= 7787, max= 8094, per=99.58%, avg=7940.50, stdev=217.08, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 2000=66.67% cpu : usr=0.00%, sys=5.79%, ctx=63, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145276: Sat Aug 22 01:48:30 2026 write: IOPS=0, BW=3508KiB/s (3592kB/s)(12.0MiB/3503msec); 0 zone resets clat (msec): min=460, max=2389, avg=1103.60, stdev=1113.47 lat (msec): min=460, max=2389, avg=1104.19, stdev=1113.34 clat percentiles (msec): | 1.00th=[ 460], 5.00th=[ 460], 10.00th=[ 460], 20.00th=[ 460], | 30.00th=[ 460], 40.00th=[ 460], 50.00th=[ 460], 60.00th=[ 460], | 70.00th=[ 2400], 80.00th=[ 2400], 90.00th=[ 2400], 95.00th=[ 2400], | 99.00th=[ 2400], 99.50th=[ 2400], 99.90th=[ 2400], 99.95th=[ 2400], | 99.99th=[ 2400] bw ( KiB/s): min= 6086, max= 8062, per=88.71%, avg=7074.00, stdev=1397.24, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=66.67%, >=2000=33.33% cpu : usr=0.00%, sys=4.54%, ctx=111, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4846KiB/s (4962kB/s), 1538KiB/s-3634KiB/s (1574kB/s-3722kB/s), io=16.0MiB (16.8MB), run=2664-3381msec WRITE: bw=7975KiB/s (8166kB/s), 2991KiB/s-3508KiB/s (3062kB/s-3592kB/s), io=32.0MiB (33.6MB), run=2664-4109msec rand-rw: (groupid=0, jobs=1): err= 0: pid=145277: Sat Aug 22 01:48:31 2026 read: IOPS=0, BW=3311KiB/s (3391kB/s)(12.0MiB/3711msec) clat (msec): min=568, max=1601, avg=1236.68, stdev=579.25 lat (msec): min=568, max=1601, avg=1236.68, stdev=579.25 clat percentiles (msec): | 1.00th=[ 567], 5.00th=[ 567], 10.00th=[ 567], 20.00th=[ 567], | 30.00th=[ 567], 40.00th=[ 1536], 50.00th=[ 1536], 60.00th=[ 1536], | 70.00th=[ 1603], 80.00th=[ 1603], 90.00th=[ 1603], 95.00th=[ 1603], | 99.00th=[ 1603], 99.50th=[ 1603], 99.90th=[ 1603], 99.95th=[ 1603], | 99.99th=[ 1603] bw ( KiB/s): min= 8143, max= 8175, per=100.00%, avg=8159.00, stdev=22.63, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 2000=66.67% cpu : usr=0.00%, sys=2.56%, ctx=39, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145279: Sat Aug 22 01:48:31 2026 read: IOPS=0, BW=1161KiB/s (1189kB/s)(4096KiB/3528msec) clat (nsec): min=1178.5M, max=1178.5M, avg=1178456219.00, stdev= 0.00 lat (nsec): min=1178.5M, max=1178.5M, avg=1178459285.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1183], 5.00th=[ 1183], 10.00th=[ 1183], 20.00th=[ 1183], | 30.00th=[ 1183], 40.00th=[ 1183], 50.00th=[ 1183], 60.00th=[ 1183], | 70.00th=[ 1183], 80.00th=[ 1183], 90.00th=[ 1183], 95.00th=[ 1183], | 99.00th=[ 1183], 99.50th=[ 1183], 99.90th=[ 1183], 99.95th=[ 1183], | 99.99th=[ 1183] bw ( KiB/s): min= 8143, max= 8143, per=100.00%, avg=8143.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2322KiB/s (2378kB/s)(8192KiB/3528msec); 0 zone resets clat (msec): min=567, max=1778, avg=1173.02, stdev=856.70 lat (msec): min=567, max=1779, avg=1173.56, stdev=856.86 clat percentiles (msec): | 1.00th=[ 567], 5.00th=[ 567], 10.00th=[ 567], 20.00th=[ 567], | 30.00th=[ 567], 40.00th=[ 567], 50.00th=[ 567], 60.00th=[ 1787], | 70.00th=[ 1787], 80.00th=[ 1787], 90.00th=[ 1787], 95.00th=[ 1787], | 99.00th=[ 1787], 99.50th=[ 1787], 99.90th=[ 1787], 99.95th=[ 1787], | 99.99th=[ 1787] bw ( KiB/s): min= 7831, max= 7831, per=99.09%, avg=7831.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, 2000=66.67% cpu : usr=0.00%, sys=2.67%, ctx=37, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145280: Sat Aug 22 01:48:31 2026 write: IOPS=0, BW=2964KiB/s (3035kB/s)(12.0MiB/4146msec); 0 zone resets clat (msec): min=328, max=1928, avg=1375.46, stdev=906.78 lat (msec): min=329, max=1928, avg=1376.06, stdev=906.82 clat percentiles (msec): | 1.00th=[ 330], 5.00th=[ 330], 10.00th=[ 330], 20.00th=[ 330], | 30.00th=[ 330], 40.00th=[ 1871], 50.00th=[ 1871], 60.00th=[ 1871], | 70.00th=[ 1921], 80.00th=[ 1921], 90.00th=[ 1921], 95.00th=[ 1921], | 99.00th=[ 1921], 99.50th=[ 1921], 99.90th=[ 1921], 99.95th=[ 1921], | 99.99th=[ 1921] bw ( KiB/s): min= 7627, max= 7627, per=96.51%, avg=7627.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.07%, sys=2.80%, ctx=55, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145281: Sat Aug 22 01:48:31 2026 write: IOPS=0, BW=3561KiB/s (3646kB/s)(12.0MiB/3451msec); 0 zone resets clat (msec): min=553, max=1937, avg=1148.47, stdev=712.24 lat (msec): min=554, max=1940, avg=1149.77, stdev=713.44 clat percentiles (msec): | 1.00th=[ 558], 5.00th=[ 558], 10.00th=[ 558], 20.00th=[ 558], | 30.00th=[ 558], 40.00th=[ 953], 50.00th=[ 953], 60.00th=[ 953], | 70.00th=[ 1938], 80.00th=[ 1938], 90.00th=[ 1938], 95.00th=[ 1938], | 99.00th=[ 1938], 99.50th=[ 1938], 99.90th=[ 1938], 99.95th=[ 1938], | 99.99th=[ 1938] bw ( KiB/s): min= 6649, max= 8143, per=93.58%, avg=7396.00, stdev=1056.42, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=3.33%, ctx=77, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4415KiB/s (4521kB/s), 1161KiB/s-3311KiB/s (1189kB/s-3391kB/s), io=16.0MiB (16.8MB), run=3528-3711msec WRITE: bw=7904KiB/s (8093kB/s), 2322KiB/s-3561KiB/s (2378kB/s-3646kB/s), io=32.0MiB (33.6MB), run=3451-4146msec