== sanity test 398b: DIO and buffer IO race ============== 23:39:18 (1788752358) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 4.04991 s, 12.4 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=145729: Sun Sep 6 23:41:11 2026 read: IOPS=15, BW=60.5KiB/s (61.9kB/s)(5992KiB/99108msec) clat (usec): min=35, max=367844, avg=30890.05, stdev=24933.91 lat (usec): min=36, max=367848, avg=30893.94, stdev=24933.41 clat percentiles (usec): | 1.00th=[ 49], 5.00th=[ 65], 10.00th=[ 151], 20.00th=[ 14615], | 30.00th=[ 18220], 40.00th=[ 21890], 50.00th=[ 26084], 60.00th=[ 31065], | 70.00th=[ 37487], 80.00th=[ 46400], 90.00th=[ 60556], 95.00th=[ 71828], | 99.00th=[105382], 99.50th=[135267], 99.90th=[240124], 99.95th=[367002], | 99.99th=[367002] bw ( KiB/s): min= 7, max= 143, per=25.07%, avg=59.92, stdev=24.60, samples=196 iops : min= 1, max= 35, avg=14.36, stdev= 6.22, samples=196 write: IOPS=15, BW=63.5KiB/s (65.1kB/s)(6296KiB/99108msec); 0 zone resets clat (usec): min=846, max=624578, avg=33447.86, stdev=36309.52 lat (usec): min=849, max=624580, avg=33466.59, stdev=36303.90 clat percentiles (usec): | 1.00th=[ 1106], 5.00th=[ 1319], 10.00th=[ 1975], 20.00th=[ 4113], | 30.00th=[ 8094], 40.00th=[ 16909], 50.00th=[ 25035], 60.00th=[ 33424], | 70.00th=[ 44303], 80.00th=[ 55837], 90.00th=[ 76022], 95.00th=[ 92799], | 99.00th=[137364], 99.50th=[183501], 99.90th=[291505], 99.95th=[624952], | 99.99th=[624952] bw ( KiB/s): min= 15, max= 134, per=25.32%, avg=63.30, stdev=24.26, samples=195 iops : min= 3, max= 33, avg=15.21, stdev= 6.11, samples=195 lat (usec) : 50=0.59%, 100=3.48%, 250=1.04%, 500=0.16%, 750=0.10% lat (usec) : 1000=0.26% lat (msec) : 2=5.05%, 4=4.98%, 10=7.45%, 20=16.15%, 50=39.84% lat (msec) : 100=18.26%, 250=2.54%, 500=0.07%, 750=0.03% cpu : usr=0.12%, sys=7.23%, ctx=6727, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145730: Sun Sep 6 23:41:11 2026 read: IOPS=14, BW=59.8KiB/s (61.2kB/s)(5940KiB/99340msec) clat (usec): min=37, max=223124, avg=31500.81, stdev=23722.58 lat (usec): min=37, max=223124, avg=31502.98, stdev=23722.35 clat percentiles (usec): | 1.00th=[ 49], 5.00th=[ 69], 10.00th=[ 330], 20.00th=[ 15139], | 30.00th=[ 19268], 40.00th=[ 22938], 50.00th=[ 26608], 60.00th=[ 31589], | 70.00th=[ 38536], 80.00th=[ 46924], 90.00th=[ 60031], 95.00th=[ 71828], | 99.00th=[110625], 99.50th=[129500], 99.90th=[204473], 99.95th=[223347], | 99.99th=[223347] bw ( KiB/s): min= 7, max= 125, per=24.77%, avg=59.20, stdev=23.33, samples=196 iops : min= 1, max= 31, avg=14.18, stdev= 5.89, samples=196 write: IOPS=15, BW=63.9KiB/s (65.4kB/s)(6348KiB/99340msec); 0 zone resets clat (usec): min=785, max=659873, avg=33024.35, stdev=36750.80 lat (usec): min=787, max=659874, avg=33027.12, stdev=36750.38 clat percentiles (usec): | 1.00th=[ 1123], 5.00th=[ 1319], 10.00th=[ 1762], 20.00th=[ 3458], | 30.00th=[ 7177], 40.00th=[ 16188], 50.00th=[ 25297], 60.00th=[ 33162], | 70.00th=[ 43779], 80.00th=[ 55313], 90.00th=[ 76022], 95.00th=[ 92799], | 99.00th=[145753], 99.50th=[196084], 99.90th=[329253], 99.95th=[658506], | 99.99th=[658506] bw ( KiB/s): min= 7, max= 181, per=25.30%, avg=63.24, stdev=24.90, samples=196 iops : min= 1, max= 45, avg=15.19, stdev= 6.28, samples=196 lat (usec) : 50=0.59%, 100=3.52%, 250=0.68%, 500=0.20%, 750=0.07% lat (usec) : 1000=0.29% lat (msec) : 2=5.96%, 4=5.18%, 10=7.45%, 20=14.49%, 50=40.92% lat (msec) : 100=17.94%, 250=2.64%, 500=0.07%, 750=0.03% cpu : usr=0.12%, sys=7.45%, ctx=6867, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145731: Sun Sep 6 23:41:11 2026 read: IOPS=15, BW=60.1KiB/s (61.5kB/s)(6028KiB/100325msec) clat (usec): min=25, max=255719, avg=31205.28, stdev=23339.84 lat (usec): min=25, max=255721, avg=31206.92, stdev=23339.75 clat percentiles (usec): | 1.00th=[ 51], 5.00th=[ 72], 10.00th=[ 7046], 20.00th=[ 15008], | 30.00th=[ 19268], 40.00th=[ 22938], 50.00th=[ 26608], 60.00th=[ 31327], | 70.00th=[ 38011], 80.00th=[ 45876], 90.00th=[ 57410], 95.00th=[ 71828], | 99.00th=[106431], 99.50th=[121111], 99.90th=[240124], 99.95th=[254804], | 99.99th=[254804] bw ( KiB/s): min= 7, max= 143, per=25.10%, avg=59.98, stdev=23.55, samples=196 iops : min= 1, max= 35, avg=14.38, stdev= 5.94, samples=196 write: IOPS=15, BW=62.4KiB/s (63.9kB/s)(6260KiB/100325msec); 0 zone resets clat (usec): min=810, max=748100, avg=33933.27, stdev=38295.43 lat (usec): min=811, max=748102, avg=33937.42, stdev=38296.05 clat percentiles (usec): | 1.00th=[ 1090], 5.00th=[ 1352], 10.00th=[ 1975], 20.00th=[ 4047], | 30.00th=[ 8848], 40.00th=[ 17433], 50.00th=[ 25822], 60.00th=[ 33424], | 70.00th=[ 43779], 80.00th=[ 55313], 90.00th=[ 76022], 95.00th=[ 93848], | 99.00th=[154141], 99.50th=[181404], 99.90th=[299893], 99.95th=[750781], | 99.99th=[750781] bw ( KiB/s): min= 7, max= 151, per=24.78%, avg=61.95, stdev=23.44, samples=197 iops : min= 1, max= 37, avg=14.88, stdev= 5.90, samples=197 lat (usec) : 50=0.39%, 100=3.12%, 250=0.78%, 500=0.07%, 750=0.07% lat (usec) : 1000=0.33% lat (msec) : 2=5.05%, 4=4.95%, 10=7.10%, 20=15.89%, 50=41.86% lat (msec) : 100=17.71%, 250=2.60%, 500=0.07%, 750=0.03% cpu : usr=0.11%, sys=7.13%, ctx=6826, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145732: Sun Sep 6 23:41:11 2026 read: IOPS=15, BW=61.5KiB/s (62.0kB/s)(6052KiB/98424msec) clat (usec): min=30, max=353718, avg=31489.95, stdev=26514.57 lat (usec): min=30, max=353718, avg=31498.21, stdev=26520.65 clat percentiles (usec): | 1.00th=[ 51], 5.00th=[ 70], 10.00th=[ 277], 20.00th=[ 14615], | 30.00th=[ 18220], 40.00th=[ 21890], 50.00th=[ 26084], 60.00th=[ 31065], | 70.00th=[ 38011], 80.00th=[ 45876], 90.00th=[ 58983], 95.00th=[ 71828], | 99.00th=[112722], 99.50th=[173016], 99.90th=[250610], 99.95th=[354419], | 99.99th=[354419] bw ( KiB/s): min= 7, max= 135, per=25.53%, avg=61.03, stdev=24.35, samples=193 iops : min= 1, max= 33, avg=14.64, stdev= 6.11, samples=193 write: IOPS=15, BW=63.4KiB/s (64.9kB/s)(6236KiB/98424msec); 0 zone resets clat (usec): min=731, max=679046, avg=32449.08, stdev=36642.89 lat (usec): min=731, max=679047, avg=32456.20, stdev=36641.98 clat percentiles (usec): | 1.00th=[ 1074], 5.00th=[ 1336], 10.00th=[ 1713], 20.00th=[ 3654], | 30.00th=[ 7111], 40.00th=[ 15270], 50.00th=[ 23200], 60.00th=[ 32113], | 70.00th=[ 42206], 80.00th=[ 55837], 90.00th=[ 77071], 95.00th=[ 95945], | 99.00th=[139461], 99.50th=[162530], 99.90th=[274727], 99.95th=[675283], | 99.99th=[675283] bw ( KiB/s): min= 7, max= 127, per=25.09%, avg=62.72, stdev=23.53, samples=194 iops : min= 1, max= 31, avg=15.07, stdev= 5.94, samples=194 lat (usec) : 50=0.42%, 100=3.68%, 250=0.72%, 500=0.29%, 750=0.13% lat (usec) : 1000=0.13% lat (msec) : 2=6.02%, 4=4.95%, 10=7.78%, 20=16.34%, 50=39.39% lat (msec) : 100=17.15%, 250=2.83%, 500=0.13%, 750=0.03% cpu : usr=0.10%, sys=7.31%, ctx=6859, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=239KiB/s (245kB/s), 59.8KiB/s-61.5KiB/s (61.2kB/s-62.0kB/s), io=23.4MiB (24.6MB), run=98424-100325msec WRITE: bw=251KiB/s (257kB/s), 62.4KiB/s-63.9KiB/s (63.9kB/s-65.4kB/s), io=24.6MiB (25.7MB), run=98424-100325msec rand-rw: (groupid=0, jobs=1): err= 0: pid=145724: Sun Sep 6 23:42:46 2026 read: IOPS=7, BW=31.1KiB/s (31.8kB/s)(5992KiB/192813msec) clat (msec): min=4, max=566, avg=26.52, stdev=31.05 lat (msec): min=4, max=566, avg=26.52, stdev=31.05 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 11], | 30.00th=[ 12], 40.00th=[ 14], 50.00th=[ 16], 60.00th=[ 20], | 70.00th=[ 25], 80.00th=[ 37], 90.00th=[ 59], 95.00th=[ 77], | 99.00th=[ 122], 99.50th=[ 167], 99.90th=[ 359], 99.95th=[ 567], | 99.99th=[ 567] bw ( KiB/s): min= 7, max= 111, per=27.07%, avg=33.30, stdev=21.01, samples=351 iops : min= 1, max= 27, avg= 7.72, stdev= 5.31, samples=351 write: IOPS=8, BW=32.7KiB/s (33.4kB/s)(6296KiB/192813msec); 0 zone resets clat (msec): min=22, max=422, avg=97.04, stdev=48.79 lat (msec): min=22, max=422, avg=97.05, stdev=48.79 clat percentiles (msec): | 1.00th=[ 38], 5.00th=[ 47], 10.00th=[ 52], 20.00th=[ 59], | 30.00th=[ 67], 40.00th=[ 74], 50.00th=[ 84], 60.00th=[ 93], | 70.00th=[ 108], 80.00th=[ 131], 90.00th=[ 165], 95.00th=[ 192], | 99.00th=[ 262], 99.50th=[ 288], 99.90th=[ 405], 99.95th=[ 422], | 99.99th=[ 422] bw ( KiB/s): min= 7, max= 71, per=24.92%, avg=32.15, stdev=14.99, samples=381 iops : min= 1, max= 17, avg= 7.43, stdev= 3.80, samples=381 lat (msec) : 10=8.50%, 20=21.52%, 50=16.47%, 100=34.64%, 250=18.07% lat (msec) : 500=0.78%, 750=0.03% cpu : usr=0.06%, sys=1.68%, ctx=5291, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145725: Sun Sep 6 23:42:46 2026 read: IOPS=7, BW=30.6KiB/s (31.4kB/s)(5940KiB/193899msec) clat (msec): min=4, max=692, avg=26.55, stdev=32.97 lat (msec): min=4, max=692, avg=26.56, stdev=32.97 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 11], | 30.00th=[ 13], 40.00th=[ 15], 50.00th=[ 17], 60.00th=[ 20], | 70.00th=[ 26], 80.00th=[ 34], 90.00th=[ 56], 95.00th=[ 80], | 99.00th=[ 127], 99.50th=[ 171], 99.90th=[ 363], 99.95th=[ 693], | 99.99th=[ 693] bw ( KiB/s): min= 7, max= 119, per=26.48%, avg=32.57, stdev=21.24, samples=355 iops : min= 1, max= 29, avg= 7.54, stdev= 5.34, samples=355 write: IOPS=8, BW=32.7KiB/s (33.5kB/s)(6348KiB/193899msec); 0 zone resets clat (msec): min=25, max=516, avg=97.12, stdev=49.18 lat (msec): min=25, max=516, avg=97.12, stdev=49.18 clat percentiles (msec): | 1.00th=[ 38], 5.00th=[ 45], 10.00th=[ 51], 20.00th=[ 58], | 30.00th=[ 66], 40.00th=[ 75], 50.00th=[ 85], 60.00th=[ 95], | 70.00th=[ 110], 80.00th=[ 131], 90.00th=[ 161], 95.00th=[ 194], | 99.00th=[ 266], 99.50th=[ 296], 99.90th=[ 388], 99.95th=[ 518], | 99.99th=[ 518] bw ( KiB/s): min= 7, max= 80, per=25.13%, avg=32.42, stdev=14.88, samples=381 iops : min= 1, max= 20, avg= 7.50, stdev= 3.76, samples=381 lat (msec) : 10=8.27%, 20=21.00%, 50=18.23%, 100=32.65%, 250=18.91% lat (msec) : 500=0.88%, 750=0.07% cpu : usr=0.06%, sys=1.69%, ctx=5204, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145726: Sun Sep 6 23:42:46 2026 read: IOPS=7, BW=30.9KiB/s (31.7kB/s)(6028KiB/194784msec) clat (msec): min=4, max=349, avg=27.71, stdev=29.16 lat (msec): min=4, max=349, avg=27.71, stdev=29.16 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 11], | 30.00th=[ 13], 40.00th=[ 15], 50.00th=[ 17], 60.00th=[ 21], | 70.00th=[ 27], 80.00th=[ 39], 90.00th=[ 64], 95.00th=[ 84], | 99.00th=[ 146], 99.50th=[ 174], 99.90th=[ 313], 99.95th=[ 351], | 99.99th=[ 351] bw ( KiB/s): min= 7, max= 119, per=25.78%, avg=31.71, stdev=21.40, samples=370 iops : min= 1, max= 29, avg= 7.33, stdev= 5.39, samples=370 write: IOPS=8, BW=32.1KiB/s (32.9kB/s)(6260KiB/194784msec); 0 zone resets clat (msec): min=21, max=736, avg=97.55, stdev=51.14 lat (msec): min=21, max=736, avg=97.56, stdev=51.14 clat percentiles (msec): | 1.00th=[ 37], 5.00th=[ 46], 10.00th=[ 51], 20.00th=[ 60], | 30.00th=[ 68], 40.00th=[ 75], 50.00th=[ 84], 60.00th=[ 96], | 70.00th=[ 110], 80.00th=[ 128], 90.00th=[ 163], 95.00th=[ 192], | 99.00th=[ 257], 99.50th=[ 309], 99.90th=[ 426], 99.95th=[ 735], | 99.99th=[ 735] bw ( KiB/s): min= 7, max= 72, per=24.64%, avg=31.79, stdev=15.02, samples=383 iops : min= 1, max= 18, avg= 7.34, stdev= 3.81, samples=383 lat (msec) : 10=8.20%, 20=20.70%, 50=17.71%, 100=33.66%, 250=19.04% lat (msec) : 500=0.65%, 750=0.03% cpu : usr=0.06%, sys=1.66%, ctx=5054, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145727: Sun Sep 6 23:42:46 2026 read: IOPS=7, BW=31.4KiB/s (32.1kB/s)(6052KiB/193042msec) clat (msec): min=5, max=311, avg=26.67, stdev=27.90 lat (msec): min=5, max=311, avg=26.68, stdev=27.90 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 11], | 30.00th=[ 12], 40.00th=[ 14], 50.00th=[ 17], 60.00th=[ 20], | 70.00th=[ 25], 80.00th=[ 38], 90.00th=[ 62], 95.00th=[ 84], | 99.00th=[ 128], 99.50th=[ 171], 99.90th=[ 253], 99.95th=[ 313], | 99.99th=[ 313] bw ( KiB/s): min= 7, max= 119, per=26.65%, avg=32.78, stdev=21.34, samples=360 iops : min= 1, max= 29, avg= 7.59, stdev= 5.35, samples=360 write: IOPS=8, BW=32.3KiB/s (33.1kB/s)(6236KiB/193042msec); 0 zone resets clat (msec): min=28, max=809, avg=97.72, stdev=51.83 lat (msec): min=28, max=809, avg=97.72, stdev=51.83 clat percentiles (msec): | 1.00th=[ 36], 5.00th=[ 46], 10.00th=[ 52], 20.00th=[ 61], | 30.00th=[ 68], 40.00th=[ 75], 50.00th=[ 84], 60.00th=[ 95], | 70.00th=[ 109], 80.00th=[ 130], 90.00th=[ 161], 95.00th=[ 192], | 99.00th=[ 257], 99.50th=[ 313], 99.90th=[ 527], 99.95th=[ 810], | 99.99th=[ 810] bw ( KiB/s): min= 7, max= 79, per=24.64%, avg=31.79, stdev=14.94, samples=382 iops : min= 1, max= 19, avg= 7.34, stdev= 3.79, samples=382 lat (msec) : 10=9.08%, 20=21.68%, 50=15.56%, 100=33.69%, 250=19.27% lat (msec) : 500=0.65%, 750=0.03%, 1000=0.03% cpu : usr=0.06%, sys=1.67%, ctx=5304, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=123KiB/s (126kB/s), 30.6KiB/s-31.4KiB/s (31.4kB/s-32.1kB/s), io=23.4MiB (24.6MB), run=192813-194784msec WRITE: bw=129KiB/s (132kB/s), 32.1KiB/s-32.7KiB/s (32.9kB/s-33.5kB/s), io=24.6MiB (25.7MB), run=192813-194784msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=145788: Sun Sep 6 23:43:32 2026 read: IOPS=9, BW=159KiB/s (163kB/s)(5920KiB/37181msec) clat (usec): min=36, max=451870, avg=51885.54, stdev=45769.62 lat (usec): min=37, max=451872, avg=51891.95, stdev=45776.20 clat percentiles (usec): | 1.00th=[ 42], 5.00th=[ 64], 10.00th=[ 77], 20.00th=[ 163], | 30.00th=[ 30278], 40.00th=[ 38011], 50.00th=[ 48497], 60.00th=[ 56361], | 70.00th=[ 67634], 80.00th=[ 79168], 90.00th=[107480], 95.00th=[125305], | 99.00th=[191890], 99.50th=[202376], 99.90th=[450888], 99.95th=[450888], | 99.99th=[450888] bw ( KiB/s): min= 62, max= 346, per=25.34%, avg=159.90, stdev=63.65, samples=72 iops : min= 3, max= 21, avg= 9.28, stdev= 4.02, samples=72 write: IOPS=10, BW=171KiB/s (175kB/s)(6368KiB/37181msec); 0 zone resets clat (usec): min=1383, max=290274, avg=44991.95, stdev=48957.66 lat (usec): min=1386, max=290276, avg=44997.48, stdev=48955.99 clat percentiles (usec): | 1.00th=[ 1696], 5.00th=[ 1991], 10.00th=[ 3752], 20.00th=[ 7767], | 30.00th=[ 10945], 40.00th=[ 15270], 50.00th=[ 26346], 60.00th=[ 38011], | 70.00th=[ 55837], 80.00th=[ 80217], 90.00th=[112722], 95.00th=[149947], | 99.00th=[210764], 99.50th=[242222], 99.90th=[291505], 99.95th=[291505], | 99.99th=[291505] bw ( KiB/s): min= 26, max= 377, per=25.92%, avg=172.11, stdev=74.98, samples=72 iops : min= 1, max= 23, avg=10.04, stdev= 4.77, samples=72 lat (usec) : 50=0.78%, 100=7.94%, 250=1.04%, 500=0.26%, 750=0.13% lat (msec) : 2=2.86%, 4=3.12%, 10=8.85%, 20=9.64%, 50=25.26% lat (msec) : 100=26.95%, 250=12.89%, 500=0.26% cpu : usr=0.10%, sys=5.50%, ctx=1521, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145789: Sun Sep 6 23:43:32 2026 read: IOPS=9, BW=152KiB/s (155kB/s)(5744KiB/37911msec) clat (usec): min=39, max=358885, avg=55558.42, stdev=47933.84 lat (usec): min=39, max=358888, avg=55560.15, stdev=47933.90 clat percentiles (usec): | 1.00th=[ 47], 5.00th=[ 66], 10.00th=[ 78], 20.00th=[ 20317], | 30.00th=[ 33817], 40.00th=[ 40109], 50.00th=[ 48497], 60.00th=[ 58459], | 70.00th=[ 69731], 80.00th=[ 83362], 90.00th=[105382], 95.00th=[137364], | 99.00th=[263193], 99.50th=[312476], 99.90th=[358613], 99.95th=[358613], | 99.99th=[358613] bw ( KiB/s): min= 26, max= 416, per=24.73%, avg=156.07, stdev=77.27, samples=72 iops : min= 1, max= 26, avg= 9.03, stdev= 4.96, samples=72 write: IOPS=10, BW=173KiB/s (177kB/s)(6544KiB/37911msec); 0 zone resets clat (usec): min=1498, max=371737, avg=43633.98, stdev=48478.13 lat (usec): min=1503, max=371741, avg=43652.10, stdev=48470.21 clat percentiles (usec): | 1.00th=[ 1762], 5.00th=[ 1975], 10.00th=[ 2933], 20.00th=[ 5604], | 30.00th=[ 10028], 40.00th=[ 15401], 50.00th=[ 24511], 60.00th=[ 38536], | 70.00th=[ 58459], 80.00th=[ 74974], 90.00th=[107480], 95.00th=[137364], | 99.00th=[191890], 99.50th=[208667], 99.90th=[371196], 99.95th=[371196], | 99.99th=[371196] bw ( KiB/s): min= 31, max= 349, per=25.98%, avg=172.50, stdev=81.81, samples=74 iops : min= 1, max= 21, avg=10.05, stdev= 5.16, samples=74 lat (usec) : 50=0.65%, 100=5.47%, 250=1.69%, 500=0.39%, 750=0.13% lat (msec) : 2=3.26%, 4=4.43%, 10=8.46%, 20=9.11%, 50=25.78% lat (msec) : 100=28.39%, 250=11.46%, 500=0.78% cpu : usr=0.06%, sys=5.25%, ctx=1573, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145790: Sun Sep 6 23:43:32 2026 read: IOPS=10, BW=167KiB/s (171kB/s)(6256KiB/37485msec) clat (usec): min=37, max=520028, avg=49448.42, stdev=45384.54 lat (usec): min=37, max=520030, avg=49451.14, stdev=45383.77 clat percentiles (usec): | 1.00th=[ 45], 5.00th=[ 65], 10.00th=[ 73], 20.00th=[ 121], | 30.00th=[ 26084], 40.00th=[ 38011], 50.00th=[ 46924], 60.00th=[ 56361], | 70.00th=[ 67634], 80.00th=[ 80217], 90.00th=[ 95945], 95.00th=[120062], | 99.00th=[164627], 99.50th=[202376], 99.90th=[517997], 99.95th=[517997], | 99.99th=[517997] bw ( KiB/s): min= 26, max= 471, per=26.90%, avg=169.71, stdev=87.69, samples=72 iops : min= 1, max= 29, avg= 9.90, stdev= 5.58, samples=72 write: IOPS=10, BW=161KiB/s (165kB/s)(6032KiB/37485msec); 0 zone resets clat (usec): min=1531, max=447672, avg=47859.13, stdev=54186.53 lat (usec): min=1535, max=447672, avg=47861.98, stdev=54186.46 clat percentiles (usec): | 1.00th=[ 1729], 5.00th=[ 2114], 10.00th=[ 3425], 20.00th=[ 6980], | 30.00th=[ 11731], 40.00th=[ 20055], 50.00th=[ 31327], 60.00th=[ 44303], | 70.00th=[ 58459], 80.00th=[ 77071], 90.00th=[113771], 95.00th=[154141], | 99.00th=[242222], 99.50th=[333448], 99.90th=[446694], 99.95th=[446694], | 99.99th=[446694] bw ( KiB/s): min= 31, max= 440, per=24.32%, avg=161.46, stdev=83.03, samples=72 iops : min= 1, max= 27, avg= 9.39, stdev= 5.24, samples=72 lat (usec) : 50=1.04%, 100=8.46%, 250=1.82%, 500=0.13%, 750=0.39% lat (msec) : 2=1.43%, 4=5.08%, 10=6.90%, 20=7.81%, 50=25.13% lat (msec) : 100=30.86%, 250=10.42%, 500=0.39%, 750=0.13% cpu : usr=0.10%, sys=4.95%, ctx=1501, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145791: Sun Sep 6 23:43:32 2026 read: IOPS=10, BW=161KiB/s (165kB/s)(6032KiB/37374msec) clat (usec): min=41, max=296710, avg=51065.39, stdev=45503.24 lat (usec): min=42, max=296711, avg=51067.34, stdev=45503.27 clat percentiles (usec): | 1.00th=[ 44], 5.00th=[ 62], 10.00th=[ 71], 20.00th=[ 93], | 30.00th=[ 30278], 40.00th=[ 36963], 50.00th=[ 45351], 60.00th=[ 55837], | 70.00th=[ 64226], 80.00th=[ 79168], 90.00th=[101188], 95.00th=[135267], | 99.00th=[212861], 99.50th=[261096], 99.90th=[295699], 99.95th=[295699], | 99.99th=[295699] bw ( KiB/s): min= 27, max= 312, per=25.65%, avg=161.88, stdev=65.59, samples=72 iops : min= 1, max= 19, avg= 9.40, stdev= 4.19, samples=72 write: IOPS=10, BW=167KiB/s (171kB/s)(6256KiB/37374msec); 0 zone resets clat (usec): min=1406, max=484787, avg=46126.18, stdev=54946.33 lat (usec): min=1407, max=484787, avg=46135.88, stdev=54944.88 clat percentiles (usec): | 1.00th=[ 1516], 5.00th=[ 2024], 10.00th=[ 3130], 20.00th=[ 7046], | 30.00th=[ 11863], 40.00th=[ 17957], 50.00th=[ 27132], 60.00th=[ 38011], | 70.00th=[ 56886], 80.00th=[ 78119], 90.00th=[116917], 95.00th=[139461], | 99.00th=[242222], 99.50th=[459277], 99.90th=[484443], 99.95th=[484443], | 99.99th=[484443] bw ( KiB/s): min= 31, max= 478, per=25.50%, avg=169.29, stdev=84.92, samples=72 iops : min= 1, max= 29, avg= 9.87, stdev= 5.39, samples=72 lat (usec) : 50=0.91%, 100=9.11%, 250=0.91%, 1000=0.13% lat (msec) : 2=2.60%, 4=3.78%, 10=7.68%, 20=9.38%, 50=26.04% lat (msec) : 100=27.47%, 250=11.46%, 500=0.52% cpu : usr=0.07%, sys=5.14%, ctx=1493, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=632KiB/s (647kB/s), 152KiB/s-167KiB/s (155kB/s-171kB/s), io=23.4MiB (24.5MB), run=37181-37911msec WRITE: bw=665KiB/s (681kB/s), 161KiB/s-173KiB/s (165kB/s-177kB/s), io=24.6MiB (25.8MB), run=37181-37911msec rand-rw: (groupid=0, jobs=1): err= 0: pid=145782: Sun Sep 6 23:44:15 2026 read: IOPS=4, BW=71.5KiB/s (73.2kB/s)(5920KiB/82763msec) clat (msec): min=7, max=411, avg=49.99, stdev=50.98 lat (msec): min=7, max=411, avg=49.99, stdev=50.98 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 12], 10.00th=[ 15], 20.00th=[ 20], | 30.00th=[ 24], 40.00th=[ 27], 50.00th=[ 33], 60.00th=[ 39], | 70.00th=[ 50], 80.00th=[ 64], 90.00th=[ 105], 95.00th=[ 163], | 99.00th=[ 264], 99.50th=[ 284], 99.90th=[ 414], 99.95th=[ 414], | 99.99th=[ 414] bw ( KiB/s): min= 30, max= 288, per=29.55%, avg=85.40, stdev=54.59, samples=136 iops : min= 1, max= 18, avg= 4.57, stdev= 3.47, samples=136 write: IOPS=4, BW=76.9KiB/s (78.8kB/s)(6368KiB/82763msec); 0 zone resets clat (msec): min=39, max=554, avg=160.83, stdev=83.12 lat (msec): min=39, max=554, avg=160.84, stdev=83.13 clat percentiles (msec): | 1.00th=[ 56], 5.00th=[ 71], 10.00th=[ 82], 20.00th=[ 100], | 30.00th=[ 111], 40.00th=[ 123], 50.00th=[ 134], 60.00th=[ 155], | 70.00th=[ 182], 80.00th=[ 209], 90.00th=[ 275], 95.00th=[ 338], | 99.00th=[ 460], 99.50th=[ 514], 99.90th=[ 558], 99.95th=[ 558], | 99.99th=[ 558] bw ( KiB/s): min= 22, max= 192, per=25.86%, avg=78.62, stdev=38.27, samples=159 iops : min= 1, max= 12, avg= 4.11, stdev= 2.50, samples=159 lat (msec) : 10=1.04%, 20=9.24%, 50=24.09%, 100=19.27%, 250=38.80% lat (msec) : 500=7.16%, 750=0.39% cpu : usr=0.04%, sys=1.19%, ctx=1278, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145783: Sun Sep 6 23:44:15 2026 read: IOPS=4, BW=69.9KiB/s (71.6kB/s)(5744KiB/82185msec) clat (msec): min=7, max=425, avg=46.83, stdev=50.31 lat (msec): min=7, max=425, avg=46.83, stdev=50.31 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 13], 10.00th=[ 15], 20.00th=[ 18], | 30.00th=[ 22], 40.00th=[ 27], 50.00th=[ 31], 60.00th=[ 37], | 70.00th=[ 46], 80.00th=[ 60], 90.00th=[ 93], 95.00th=[ 159], | 99.00th=[ 271], 99.50th=[ 305], 99.90th=[ 426], 99.95th=[ 426], | 99.99th=[ 426] bw ( KiB/s): min= 22, max= 286, per=29.98%, avg=86.65, stdev=54.89, samples=129 iops : min= 1, max= 17, avg= 4.62, stdev= 3.46, samples=129 write: IOPS=4, BW=79.6KiB/s (81.5kB/s)(6544KiB/82185msec); 0 zone resets clat (msec): min=55, max=620, avg=159.20, stdev=84.47 lat (msec): min=55, max=620, avg=159.21, stdev=84.47 clat percentiles (msec): | 1.00th=[ 65], 5.00th=[ 73], 10.00th=[ 81], 20.00th=[ 92], | 30.00th=[ 106], 40.00th=[ 118], 50.00th=[ 138], 60.00th=[ 155], | 70.00th=[ 182], 80.00th=[ 211], 90.00th=[ 266], 95.00th=[ 330], | 99.00th=[ 451], 99.50th=[ 493], 99.90th=[ 625], 99.95th=[ 625], | 99.99th=[ 625] bw ( KiB/s): min= 22, max= 160, per=26.72%, avg=81.22, stdev=38.97, samples=157 iops : min= 1, max= 10, avg= 4.27, stdev= 2.51, samples=157 lat (msec) : 10=0.52%, 20=11.85%, 50=22.79%, 100=21.61%, 250=36.20% lat (msec) : 500=6.77%, 750=0.26% cpu : usr=0.05%, sys=1.24%, ctx=1268, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145784: Sun Sep 6 23:44:15 2026 read: IOPS=4, BW=79.2KiB/s (81.1kB/s)(6256KiB/79000msec) clat (msec): min=7, max=410, avg=47.34, stdev=48.70 lat (msec): min=7, max=410, avg=47.34, stdev=48.70 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 13], 10.00th=[ 15], 20.00th=[ 19], | 30.00th=[ 22], 40.00th=[ 26], 50.00th=[ 30], 60.00th=[ 37], | 70.00th=[ 46], 80.00th=[ 66], 90.00th=[ 103], 95.00th=[ 153], | 99.00th=[ 230], 99.50th=[ 393], 99.90th=[ 409], 99.95th=[ 409], | 99.99th=[ 409] bw ( KiB/s): min= 30, max= 380, per=31.82%, avg=91.95, stdev=62.56, samples=134 iops : min= 1, max= 23, avg= 4.95, stdev= 4.00, samples=134 write: IOPS=4, BW=76.4KiB/s (78.2kB/s)(6032KiB/79000msec); 0 zone resets clat (msec): min=45, max=511, avg=159.79, stdev=80.13 lat (msec): min=45, max=511, avg=159.79, stdev=80.13 clat percentiles (msec): | 1.00th=[ 57], 5.00th=[ 75], 10.00th=[ 81], 20.00th=[ 95], | 30.00th=[ 109], 40.00th=[ 123], 50.00th=[ 138], 60.00th=[ 155], | 70.00th=[ 180], 80.00th=[ 220], 90.00th=[ 279], 95.00th=[ 317], | 99.00th=[ 435], 99.50th=[ 447], 99.90th=[ 510], 99.95th=[ 510], | 99.99th=[ 510] bw ( KiB/s): min= 22, max= 159, per=25.91%, avg=78.76, stdev=36.90, samples=149 iops : min= 1, max= 9, avg= 4.11, stdev= 2.38, samples=149 lat (msec) : 10=0.78%, 20=12.63%, 50=23.83%, 100=19.14%, 250=36.46% lat (msec) : 500=7.03%, 750=0.13% cpu : usr=0.04%, sys=1.28%, ctx=1346, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145785: Sun Sep 6 23:44:15 2026 read: IOPS=4, BW=73.5KiB/s (75.2kB/s)(6032KiB/82088msec) clat (msec): min=7, max=372, avg=48.35, stdev=50.78 lat (msec): min=7, max=372, avg=48.36, stdev=50.78 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 13], 10.00th=[ 15], 20.00th=[ 19], | 30.00th=[ 22], 40.00th=[ 27], 50.00th=[ 32], 60.00th=[ 40], | 70.00th=[ 48], 80.00th=[ 62], 90.00th=[ 96], 95.00th=[ 153], | 99.00th=[ 271], 99.50th=[ 355], 99.90th=[ 372], 99.95th=[ 372], | 99.99th=[ 372] bw ( KiB/s): min= 28, max= 286, per=30.37%, avg=87.77, stdev=57.30, samples=134 iops : min= 1, max= 17, avg= 4.69, stdev= 3.64, samples=134 write: IOPS=4, BW=76.2KiB/s (78.0kB/s)(6256KiB/82088msec); 0 zone resets clat (msec): min=35, max=509, avg=163.03, stdev=88.27 lat (msec): min=35, max=509, avg=163.04, stdev=88.31 clat percentiles (msec): | 1.00th=[ 61], 5.00th=[ 72], 10.00th=[ 82], 20.00th=[ 94], | 30.00th=[ 109], 40.00th=[ 120], 50.00th=[ 136], 60.00th=[ 157], | 70.00th=[ 184], 80.00th=[ 226], 90.00th=[ 279], 95.00th=[ 355], | 99.00th=[ 485], 99.50th=[ 502], 99.90th=[ 510], 99.95th=[ 510], | 99.99th=[ 510] bw ( KiB/s): min= 28, max= 190, per=26.28%, avg=79.90, stdev=39.74, samples=153 iops : min= 1, max= 11, avg= 4.18, stdev= 2.56, samples=153 lat (msec) : 10=0.91%, 20=11.33%, 50=23.31%, 100=21.35%, 250=35.42% lat (msec) : 500=7.55%, 750=0.13% cpu : usr=0.06%, sys=1.34%, ctx=1376, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=289KiB/s (296kB/s), 69.9KiB/s-79.2KiB/s (71.6kB/s-81.1kB/s), io=23.4MiB (24.5MB), run=79000-82763msec WRITE: bw=304KiB/s (312kB/s), 76.2KiB/s-79.6KiB/s (78.0kB/s-81.5kB/s), io=24.6MiB (25.8MB), run=79000-82763msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=145808: Sun Sep 6 23:44:38 2026 read: IOPS=2, BW=2238KiB/s (2292kB/s)(7168KiB/3203msec) clat (msec): min=136, max=351, avg=232.21, stdev=73.90 lat (msec): min=136, max=351, avg=232.21, stdev=73.90 clat percentiles (msec): | 1.00th=[ 138], 5.00th=[ 138], 10.00th=[ 138], 20.00th=[ 157], | 30.00th=[ 213], 40.00th=[ 213], 50.00th=[ 228], 60.00th=[ 262], | 70.00th=[ 262], 80.00th=[ 279], 90.00th=[ 351], 95.00th=[ 351], | 99.00th=[ 351], 99.50th=[ 351], 99.90th=[ 351], 99.95th=[ 351], | 99.99th=[ 351] bw ( KiB/s): min= 1961, max= 4087, per=100.00%, avg=2918.50, stdev=1086.29, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 1.15, samples=4 write: IOPS=1, BW=1599KiB/s (1637kB/s)(5120KiB/3203msec); 0 zone resets clat (msec): min=155, max=664, avg=309.34, stdev=216.08 lat (msec): min=155, max=664, avg=309.68, stdev=215.91 clat percentiles (msec): | 1.00th=[ 155], 5.00th=[ 155], 10.00th=[ 155], 20.00th=[ 155], | 30.00th=[ 171], 40.00th=[ 171], 50.00th=[ 188], 60.00th=[ 188], | 70.00th=[ 368], 80.00th=[ 368], 90.00th=[ 667], 95.00th=[ 667], | 99.00th=[ 667], 99.50th=[ 667], 99.90th=[ 667], 99.95th=[ 667], | 99.99th=[ 667] bw ( KiB/s): min= 1896, max= 5796, per=84.10%, avg=3239.67, stdev=2214.82, samples=3 iops : min= 1, max= 5, avg= 2.33, stdev= 2.31, samples=3 lat (msec) : 250=58.33%, 500=33.33%, 750=8.33% cpu : usr=0.00%, sys=17.71%, ctx=244, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145809: Sun Sep 6 23:44:38 2026 read: IOPS=0, BW=275KiB/s (282kB/s)(2048KiB/7443msec) clat (msec): min=177, max=187, avg=182.49, stdev= 6.63 lat (msec): min=177, max=187, avg=182.49, stdev= 6.63 clat percentiles (msec): | 1.00th=[ 178], 5.00th=[ 178], 10.00th=[ 178], 20.00th=[ 178], | 30.00th=[ 178], 40.00th=[ 178], 50.00th=[ 178], 60.00th=[ 188], | 70.00th=[ 188], 80.00th=[ 188], 90.00th=[ 188], 95.00th=[ 188], | 99.00th=[ 188], 99.50th=[ 188], 99.90th=[ 188], 99.95th=[ 188], | 99.99th=[ 188] bw ( KiB/s): min= 1651, max= 2043, per=67.14%, avg=1847.00, stdev=277.19, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1376KiB/s (1409kB/s)(10.0MiB/7443msec); 0 zone resets clat (msec): min=120, max=3066, avg=702.67, stdev=890.94 lat (msec): min=120, max=3066, avg=702.82, stdev=890.93 clat percentiles (msec): | 1.00th=[ 121], 5.00th=[ 121], 10.00th=[ 121], 20.00th=[ 174], | 30.00th=[ 176], 40.00th=[ 243], 50.00th=[ 247], 60.00th=[ 372], | 70.00th=[ 726], 80.00th=[ 902], 90.00th=[ 1003], 95.00th=[ 3071], | 99.00th=[ 3071], 99.50th=[ 3071], 99.90th=[ 3071], 99.95th=[ 3071], | 99.99th=[ 3071] bw ( KiB/s): min= 1932, max= 6107, per=77.34%, avg=2979.00, stdev=1693.34, samples=6 iops : min= 1, max= 5, avg= 2.00, stdev= 1.67, samples=6 lat (msec) : 250=58.33%, 500=8.33%, 750=8.33%, 1000=16.67%, >=2000=8.33% cpu : usr=0.00%, sys=6.32%, ctx=154, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145810: Sun Sep 6 23:44:38 2026 read: IOPS=0, BW=885KiB/s (906kB/s)(6144KiB/6942msec) clat (usec): min=877, max=2937.5k, avg=637480.07, stdev=1136105.07 lat (usec): min=878, max=2937.5k, avg=637481.68, stdev=1136104.52 clat percentiles (usec): | 1.00th=[ 881], 5.00th=[ 881], 10.00th=[ 881], | 20.00th=[ 9372], 30.00th=[ 9372], 40.00th=[ 252707], | 50.00th=[ 252707], 60.00th=[ 267387], 70.00th=[ 358613], | 80.00th=[ 358613], 90.00th=[2936013], 95.00th=[2936013], | 99.00th=[2936013], 99.50th=[2936013], 99.90th=[2936013], | 99.95th=[2936013], 99.99th=[2936013] bw ( KiB/s): min= 1932, max= 3930, per=90.40%, avg=2487.00, stdev=963.42, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 write: IOPS=0, BW=885KiB/s (906kB/s)(6144KiB/6942msec); 0 zone resets clat (msec): min=243, max=788, avg=506.15, stdev=234.94 lat (msec): min=243, max=788, avg=506.26, stdev=234.97 clat percentiles (msec): | 1.00th=[ 243], 5.00th=[ 243], 10.00th=[ 243], 20.00th=[ 321], | 30.00th=[ 321], 40.00th=[ 363], 50.00th=[ 363], 60.00th=[ 550], | 70.00th=[ 768], 80.00th=[ 768], 90.00th=[ 793], 95.00th=[ 793], | 99.00th=[ 793], 99.50th=[ 793], 99.90th=[ 793], 99.95th=[ 793], | 99.99th=[ 793] bw ( KiB/s): min= 1896, max= 2043, per=51.19%, avg=1972.00, stdev=57.54, samples=6 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=6 lat (usec) : 1000=8.33% lat (msec) : 10=8.33%, 250=8.33%, 500=41.67%, 750=8.33%, 1000=16.67% lat (msec) : >=2000=8.33% cpu : usr=0.00%, sys=8.13%, ctx=703, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145811: Sun Sep 6 23:44:38 2026 read: IOPS=0, BW=734KiB/s (751kB/s)(5120KiB/6979msec) clat (usec): min=645, max=422488, avg=129720.22, stdev=188638.24 lat (usec): min=646, max=422489, avg=129721.64, stdev=188638.01 clat percentiles (usec): | 1.00th=[ 644], 5.00th=[ 644], 10.00th=[ 644], 20.00th=[ 644], | 30.00th=[ 3032], 40.00th=[ 3032], 50.00th=[ 3425], 60.00th=[ 3425], | 70.00th=[219153], 80.00th=[219153], 90.00th=[421528], 95.00th=[421528], | 99.00th=[421528], 99.50th=[421528], 99.90th=[421528], 99.95th=[421528], | 99.99th=[421528] bw ( KiB/s): min= 8175, max= 8175, per=100.00%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 7, max= 7, avg= 7.00, stdev= 0.00, samples=1 write: IOPS=1, BW=1027KiB/s (1052kB/s)(7168KiB/6979msec); 0 zone resets clat (msec): min=188, max=3364, avg=897.73, stdev=1115.63 lat (msec): min=188, max=3364, avg=897.90, stdev=1115.62 clat percentiles (msec): | 1.00th=[ 190], 5.00th=[ 190], 10.00th=[ 190], 20.00th=[ 226], | 30.00th=[ 355], 40.00th=[ 355], 50.00th=[ 609], 60.00th=[ 693], | 70.00th=[ 693], 80.00th=[ 852], 90.00th=[ 3373], 95.00th=[ 3373], | 99.00th=[ 3373], 99.50th=[ 3373], 99.90th=[ 3373], 99.95th=[ 3373], | 99.99th=[ 3373] bw ( KiB/s): min= 1896, max= 2035, per=50.83%, avg=1957.80, stdev=51.25, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 lat (usec) : 750=8.33% lat (msec) : 4=16.67%, 250=25.00%, 500=16.67%, 750=16.67%, 1000=8.33% lat (msec) : >=2000=8.33% cpu : usr=0.00%, sys=6.32%, ctx=141, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2752KiB/s (2818kB/s), 275KiB/s-2238KiB/s (282kB/s-2292kB/s), io=20.0MiB (20.0MB), run=3203-7443msec WRITE: bw=3852KiB/s (3945kB/s), 885KiB/s-1599KiB/s (906kB/s-1637kB/s), io=28.0MiB (29.4MB), run=3203-7443msec rand-rw: (groupid=0, jobs=1): err= 0: pid=145813: Sun Sep 6 23:44:39 2026 read: IOPS=1, BW=1034KiB/s (1059kB/s)(7168KiB/6930msec) clat (msec): min=145, max=418, avg=238.61, stdev=101.06 lat (msec): min=145, max=418, avg=238.61, stdev=101.06 clat percentiles (msec): | 1.00th=[ 146], 5.00th=[ 146], 10.00th=[ 146], 20.00th=[ 146], | 30.00th=[ 167], 40.00th=[ 167], 50.00th=[ 224], 60.00th=[ 251], | 70.00th=[ 251], 80.00th=[ 317], 90.00th=[ 418], 95.00th=[ 418], | 99.00th=[ 418], 99.50th=[ 418], 99.90th=[ 418], 99.95th=[ 418], | 99.99th=[ 418] bw ( KiB/s): min= 1924, max= 3878, per=100.00%, avg=2855.75, stdev=1019.81, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 1.15, samples=4 write: IOPS=0, BW=739KiB/s (757kB/s)(5120KiB/6930msec); 0 zone resets clat (msec): min=270, max=3185, avg=1045.85, stdev=1219.54 lat (msec): min=270, max=3185, avg=1046.26, stdev=1219.32 clat percentiles (msec): | 1.00th=[ 271], 5.00th=[ 271], 10.00th=[ 271], 20.00th=[ 271], | 30.00th=[ 430], 40.00th=[ 430], 50.00th=[ 435], 60.00th=[ 435], | 70.00th=[ 911], 80.00th=[ 911], 90.00th=[ 3171], 95.00th=[ 3171], | 99.00th=[ 3171], 99.50th=[ 3171], 99.90th=[ 3171], 99.95th=[ 3171], | 99.99th=[ 3171] bw ( KiB/s): min= 1984, max= 2039, per=53.84%, avg=2016.20, stdev=23.55, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 lat (msec) : 250=33.33%, 500=50.00%, 1000=8.33%, >=2000=8.33% cpu : usr=0.01%, sys=2.55%, ctx=87, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145814: Sun Sep 6 23:44:39 2026 read: IOPS=0, BW=268KiB/s (274kB/s)(2048KiB/7655msec) clat (msec): min=362, max=894, avg=628.17, stdev=375.97 lat (msec): min=362, max=894, avg=628.17, stdev=375.97 clat percentiles (msec): | 1.00th=[ 363], 5.00th=[ 363], 10.00th=[ 363], 20.00th=[ 363], | 30.00th=[ 363], 40.00th=[ 363], 50.00th=[ 363], 60.00th=[ 894], | 70.00th=[ 894], 80.00th=[ 894], 90.00th=[ 894], 95.00th=[ 894], | 99.00th=[ 894], 99.50th=[ 894], 99.90th=[ 894], 99.95th=[ 894], | 99.99th=[ 894] bw ( KiB/s): min= 1924, max= 2035, per=74.00%, avg=1979.50, stdev=78.49, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1338KiB/s (1370kB/s)(10.0MiB/7655msec); 0 zone resets clat (msec): min=148, max=3281, avg=636.09, stdev=953.57 lat (msec): min=148, max=3281, avg=636.17, stdev=953.56 clat percentiles (msec): | 1.00th=[ 148], 5.00th=[ 148], 10.00th=[ 148], 20.00th=[ 157], | 30.00th=[ 161], 40.00th=[ 213], 50.00th=[ 230], 60.00th=[ 268], | 70.00th=[ 542], 80.00th=[ 659], 90.00th=[ 701], 95.00th=[ 3272], | 99.00th=[ 3272], 99.50th=[ 3272], 99.90th=[ 3272], 99.95th=[ 3272], | 99.99th=[ 3272] bw ( KiB/s): min= 1939, max= 4071, per=62.71%, avg=2348.50, stdev=844.70, samples=6 iops : min= 1, max= 3, avg= 1.33, stdev= 0.82, samples=6 lat (msec) : 250=41.67%, 500=16.67%, 750=25.00%, 1000=8.33%, >=2000=8.33% cpu : usr=0.01%, sys=3.32%, ctx=105, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145815: Sun Sep 6 23:44:39 2026 read: IOPS=0, BW=867KiB/s (888kB/s)(6144KiB/7087msec) clat (msec): min=49, max=146, avg=111.49, stdev=33.62 lat (msec): min=49, max=146, avg=111.49, stdev=33.62 clat percentiles (msec): | 1.00th=[ 50], 5.00th=[ 50], 10.00th=[ 50], 20.00th=[ 107], | 30.00th=[ 107], 40.00th=[ 111], 50.00th=[ 111], 60.00th=[ 128], | 70.00th=[ 129], 80.00th=[ 129], 90.00th=[ 146], 95.00th=[ 146], | 99.00th=[ 146], 99.50th=[ 146], 99.90th=[ 146], 99.95th=[ 146], | 99.99th=[ 146] bw ( KiB/s): min= 4000, max= 4047, per=100.00%, avg=4023.50, stdev=33.23, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 write: IOPS=0, BW=867KiB/s (888kB/s)(6144KiB/7087msec); 0 zone resets clat (msec): min=267, max=3576, avg=1062.73, stdev=1248.56 lat (msec): min=267, max=3576, avg=1062.82, stdev=1248.55 clat percentiles (msec): | 1.00th=[ 268], 5.00th=[ 268], 10.00th=[ 268], 20.00th=[ 447], | 30.00th=[ 447], 40.00th=[ 575], 50.00th=[ 575], 60.00th=[ 634], | 70.00th=[ 885], 80.00th=[ 885], 90.00th=[ 3574], 95.00th=[ 3574], | 99.00th=[ 3574], 99.50th=[ 3574], 99.90th=[ 3574], 99.95th=[ 3574], | 99.99th=[ 3574] bw ( KiB/s): min= 1924, max= 2039, per=53.43%, avg=2001.00, stdev=48.22, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 lat (msec) : 50=8.33%, 250=41.67%, 500=16.67%, 750=16.67%, 1000=8.33% lat (msec) : >=2000=8.33% cpu : usr=0.00%, sys=2.99%, ctx=105, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145816: Sun Sep 6 23:44:39 2026 read: IOPS=0, BW=669KiB/s (685kB/s)(5120KiB/7649msec) clat (msec): min=50, max=494, avg=222.22, stdev=173.54 lat (msec): min=50, max=494, avg=222.22, stdev=173.54 clat percentiles (msec): | 1.00th=[ 51], 5.00th=[ 51], 10.00th=[ 51], 20.00th=[ 51], | 30.00th=[ 130], 40.00th=[ 130], 50.00th=[ 155], 60.00th=[ 155], | 70.00th=[ 284], 80.00th=[ 284], 90.00th=[ 493], 95.00th=[ 493], | 99.00th=[ 493], 99.50th=[ 493], 99.90th=[ 493], 99.95th=[ 493], | 99.99th=[ 493] bw ( KiB/s): min= 2023, max= 4071, per=100.00%, avg=2709.67, stdev=1178.96, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 write: IOPS=0, BW=937KiB/s (960kB/s)(7168KiB/7649msec); 0 zone resets clat (msec): min=198, max=3151, avg=933.51, stdev=1046.61 lat (msec): min=198, max=3151, avg=933.61, stdev=1046.60 clat percentiles (msec): | 1.00th=[ 199], 5.00th=[ 199], 10.00th=[ 199], 20.00th=[ 262], | 30.00th=[ 275], 40.00th=[ 275], 50.00th=[ 506], 60.00th=[ 1036], | 70.00th=[ 1036], 80.00th=[ 1116], 90.00th=[ 3138], 95.00th=[ 3138], | 99.00th=[ 3138], 99.50th=[ 3138], 99.90th=[ 3138], 99.95th=[ 3138], | 99.99th=[ 3138] bw ( KiB/s): min= 1924, max= 2048, per=53.48%, avg=2002.80, stdev=50.13, samples=5 iops : min= 1, max= 2, avg= 1.20, stdev= 0.45, samples=5 lat (msec) : 100=8.33%, 250=25.00%, 500=33.33%, 750=8.33%, 2000=16.67% lat (msec) : >=2000=8.33% cpu : usr=0.00%, sys=2.00%, ctx=67, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2675KiB/s (2740kB/s), 268KiB/s-1034KiB/s (274kB/s-1059kB/s), io=20.0MiB (20.0MB), run=6930-7655msec WRITE: bw=3746KiB/s (3835kB/s), 739KiB/s-1338KiB/s (757kB/s-1370kB/s), io=28.0MiB (29.4MB), run=6930-7655msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=145829: Sun Sep 6 23:44:53 2026 read: IOPS=0, BW=2527KiB/s (2587kB/s)(12.0MiB/4863msec) clat (msec): min=291, max=2841, avg=1620.24, stdev=1278.67 lat (msec): min=291, max=2841, avg=1620.24, stdev=1278.67 clat percentiles (msec): | 1.00th=[ 292], 5.00th=[ 292], 10.00th=[ 292], 20.00th=[ 292], | 30.00th=[ 292], 40.00th=[ 1720], 50.00th=[ 1720], 60.00th=[ 1720], | 70.00th=[ 2836], 80.00th=[ 2836], 90.00th=[ 2836], 95.00th=[ 2836], | 99.00th=[ 2836], 99.50th=[ 2836], 99.90th=[ 2836], 99.95th=[ 2836], | 99.99th=[ 2836] bw ( KiB/s): min= 8143, max= 8175, per=100.00%, avg=8159.00, stdev=22.63, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=2.26%, ctx=50, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145830: Sun Sep 6 23:44:53 2026 read: IOPS=0, BW=735KiB/s (752kB/s)(4096KiB/5575msec) clat (nsec): min=2543.5M, max=2543.5M, avg=2543483724.00, stdev= 0.00 lat (nsec): min=2543.5M, max=2543.5M, avg=2543486894.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 2534], 5.00th=[ 2534], 10.00th=[ 2534], 20.00th=[ 2534], | 30.00th=[ 2534], 40.00th=[ 2534], 50.00th=[ 2534], 60.00th=[ 2534], | 70.00th=[ 2534], 80.00th=[ 2534], 90.00th=[ 2534], 95.00th=[ 2534], | 99.00th=[ 2534], 99.50th=[ 2534], 99.90th=[ 2534], 99.95th=[ 2534], | 99.99th=[ 2534] bw ( KiB/s): min= 7474, max= 7474, per=100.00%, avg=7474.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=1469KiB/s (1505kB/s)(8192KiB/5575msec); 0 zone resets clat (msec): min=1053, max=1974, avg=1513.83, stdev=650.83 lat (msec): min=1054, max=1974, avg=1514.30, stdev=650.72 clat percentiles (msec): | 1.00th=[ 1053], 5.00th=[ 1053], 10.00th=[ 1053], 20.00th=[ 1053], | 30.00th=[ 1053], 40.00th=[ 1053], 50.00th=[ 1053], 60.00th=[ 1972], | 70.00th=[ 1972], 80.00th=[ 1972], 90.00th=[ 1972], 95.00th=[ 1972], | 99.00th=[ 1972], 99.50th=[ 1972], 99.90th=[ 1972], 99.95th=[ 1972], | 99.99th=[ 1972] bw ( KiB/s): min= 8094, max= 8094, per=100.00%, avg=8094.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 2000=66.67%, >=2000=33.33% cpu : usr=0.00%, sys=1.38%, ctx=29, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145831: Sun Sep 6 23:44:53 2026 write: IOPS=0, BW=2210KiB/s (2264kB/s)(12.0MiB/5559msec); 0 zone resets clat (msec): min=313, max=3313, avg=1851.98, stdev=1501.40 lat (msec): min=313, max=3313, avg=1852.55, stdev=1501.33 clat percentiles (msec): | 1.00th=[ 313], 5.00th=[ 313], 10.00th=[ 313], 20.00th=[ 313], | 30.00th=[ 313], 40.00th=[ 1921], 50.00th=[ 1921], 60.00th=[ 1921], | 70.00th=[ 3306], 80.00th=[ 3306], 90.00th=[ 3306], 95.00th=[ 3306], | 99.00th=[ 3306], 99.50th=[ 3306], 99.90th=[ 3306], 99.95th=[ 3306], | 99.99th=[ 3306] bw ( KiB/s): min= 8078, max= 8143, per=100.00%, avg=8110.50, stdev=45.96, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.02%, sys=1.96%, ctx=64, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145832: Sun Sep 6 23:44:53 2026 write: IOPS=0, BW=2301KiB/s (2356kB/s)(12.0MiB/5340msec); 0 zone resets clat (msec): min=374, max=3285, avg=1774.17, stdev=1458.75 lat (msec): min=376, max=3286, avg=1774.98, stdev=1458.33 clat percentiles (msec): | 1.00th=[ 376], 5.00th=[ 376], 10.00th=[ 376], 20.00th=[ 376], | 30.00th=[ 376], 40.00th=[ 1670], 50.00th=[ 1670], 60.00th=[ 1670], | 70.00th=[ 3272], 80.00th=[ 3272], 90.00th=[ 3272], 95.00th=[ 3272], | 99.00th=[ 3272], 99.50th=[ 3272], 99.90th=[ 3272], 99.95th=[ 3272], | 99.99th=[ 3272] bw ( KiB/s): min= 8110, max= 8143, per=100.00%, avg=8126.50, stdev=23.33, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=2.25%, ctx=30, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2939KiB/s (3009kB/s), 735KiB/s-2527KiB/s (752kB/s-2587kB/s), io=16.0MiB (16.8MB), run=4863-5575msec WRITE: bw=5878KiB/s (6019kB/s), 1469KiB/s-2301KiB/s (1505kB/s-2356kB/s), io=32.0MiB (33.6MB), run=5340-5575msec rand-rw: (groupid=0, jobs=1): err= 0: pid=145824: Sun Sep 6 23:44:54 2026 read: IOPS=0, BW=2285KiB/s (2340kB/s)(12.0MiB/5377msec) clat (msec): min=943, max=3316, avg=1769.30, stdev=1341.15 lat (msec): min=943, max=3316, avg=1769.30, stdev=1341.15 clat percentiles (msec): | 1.00th=[ 944], 5.00th=[ 944], 10.00th=[ 944], 20.00th=[ 944], | 30.00th=[ 944], 40.00th=[ 1045], 50.00th=[ 1045], 60.00th=[ 1045], | 70.00th=[ 3306], 80.00th=[ 3306], 90.00th=[ 3306], 95.00th=[ 3306], | 99.00th=[ 3306], 99.50th=[ 3306], 99.90th=[ 3306], 99.95th=[ 3306], | 99.99th=[ 3306] bw ( KiB/s): min= 7922, max= 7937, per=100.00%, avg=7929.50, stdev=10.61, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=9.08%, ctx=730, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145825: Sun Sep 6 23:44:54 2026 read: IOPS=0, BW=754KiB/s (772kB/s)(4096KiB/5430msec) clat (nsec): min=545493k, max=545493k, avg=545493278.00, stdev= 0.00 lat (nsec): min=545497k, max=545497k, avg=545496992.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 550], 5.00th=[ 550], 10.00th=[ 550], 20.00th=[ 550], | 30.00th=[ 550], 40.00th=[ 550], 50.00th=[ 550], 60.00th=[ 550], | 70.00th=[ 550], 80.00th=[ 550], 90.00th=[ 550], 95.00th=[ 550], | 99.00th=[ 550], 99.50th=[ 550], 99.90th=[ 550], 99.95th=[ 550], | 99.99th=[ 550] bw ( KiB/s): min= 8175, max= 8175, per=100.00%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=1509KiB/s (1545kB/s)(8192KiB/5430msec); 0 zone resets clat (msec): min=1449, max=3393, avg=2421.36, stdev=1374.96 lat (msec): min=1449, max=3394, avg=2421.89, stdev=1374.91 clat percentiles (msec): | 1.00th=[ 1452], 5.00th=[ 1452], 10.00th=[ 1452], 20.00th=[ 1452], | 30.00th=[ 1452], 40.00th=[ 1452], 50.00th=[ 1452], 60.00th=[ 3406], | 70.00th=[ 3406], 80.00th=[ 3406], 90.00th=[ 3406], 95.00th=[ 3406], | 99.00th=[ 3406], 99.50th=[ 3406], 99.90th=[ 3406], 99.95th=[ 3406], | 99.99th=[ 3406] bw ( KiB/s): min= 8143, max= 8143, per=100.00%, avg=8143.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=4.73%, ctx=136, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145826: Sun Sep 6 23:44:54 2026 write: IOPS=0, BW=2131KiB/s (2182kB/s)(12.0MiB/5767msec); 0 zone resets clat (msec): min=519, max=3151, avg=1909.64, stdev=1322.40 lat (msec): min=521, max=3151, avg=1910.93, stdev=1321.24 clat percentiles (msec): | 1.00th=[ 518], 5.00th=[ 518], 10.00th=[ 518], 20.00th=[ 518], | 30.00th=[ 518], 40.00th=[ 2056], 50.00th=[ 2056], 60.00th=[ 2056], | 70.00th=[ 3138], 80.00th=[ 3138], 90.00th=[ 3138], 95.00th=[ 3138], | 99.00th=[ 3138], 99.50th=[ 3138], 99.90th=[ 3138], 99.95th=[ 3138], | 99.99th=[ 3138] bw ( KiB/s): min= 7684, max= 7937, per=100.00%, avg=7810.50, stdev=178.90, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, >=2000=66.67% cpu : usr=0.00%, sys=3.78%, ctx=106, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145827: Sun Sep 6 23:44:54 2026 write: IOPS=0, BW=1759KiB/s (1801kB/s)(12.0MiB/6985msec); 0 zone resets clat (msec): min=258, max=3374, avg=2293.46, stdev=1763.75 lat (msec): min=259, max=3374, avg=2297.39, stdev=1766.17 clat percentiles (msec): | 1.00th=[ 259], 5.00th=[ 259], 10.00th=[ 259], 20.00th=[ 259], | 30.00th=[ 259], 40.00th=[ 3239], 50.00th=[ 3239], 60.00th=[ 3239], | 70.00th=[ 3373], 80.00th=[ 3373], 90.00th=[ 3373], 95.00th=[ 3373], | 99.00th=[ 3373], 99.50th=[ 3373], 99.90th=[ 3373], 99.95th=[ 3373], | 99.99th=[ 3373] bw ( KiB/s): min= 7937, max= 8143, per=100.00%, avg=8040.00, stdev=145.66, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, >=2000=66.67% cpu : usr=0.00%, sys=2.84%, ctx=87, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3017KiB/s (3090kB/s), 754KiB/s-2285KiB/s (772kB/s-2340kB/s), io=16.0MiB (16.8MB), run=5377-5430msec WRITE: bw=4691KiB/s (4804kB/s), 1509KiB/s-2131KiB/s (1545kB/s-2182kB/s), io=32.0MiB (33.6MB), run=5430-6985msec