== sanity test 398b: DIO and buffer IO race ============== 15:08:51 (1782760131) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 5.8835 s, 8.6 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=146342: Mon Jun 29 15:11:01 2026 read: IOPS=13, BW=55.4KiB/s (56.8kB/s)(5992KiB/108066msec) clat (usec): min=34, max=209288, avg=35148.10, stdev=24098.29 lat (usec): min=34, max=209289, avg=35149.32, stdev=24098.22 clat percentiles (usec): | 1.00th=[ 49], 5.00th=[ 59], 10.00th=[ 7242], 20.00th=[ 17695], | 30.00th=[ 21890], 40.00th=[ 26084], 50.00th=[ 31065], 60.00th=[ 35914], | 70.00th=[ 43779], 80.00th=[ 52691], 90.00th=[ 65799], 95.00th=[ 77071], | 99.00th=[109577], 99.50th=[129500], 99.90th=[189793], 99.95th=[208667], | 99.99th=[208667] bw ( KiB/s): min= 7, max= 126, per=26.21%, avg=55.82, stdev=20.79, samples=210 iops : min= 1, max= 31, avg=13.34, stdev= 5.21, samples=210 write: IOPS=14, BW=58.3KiB/s (59.7kB/s)(6296KiB/108066msec); 0 zone resets clat (usec): min=849, max=926003, avg=34926.45, stdev=40889.23 lat (usec): min=851, max=926004, avg=34934.60, stdev=40887.08 clat percentiles (usec): | 1.00th=[ 1172], 5.00th=[ 1352], 10.00th=[ 1778], 20.00th=[ 4015], | 30.00th=[ 7373], 40.00th=[ 15008], 50.00th=[ 25822], 60.00th=[ 35390], | 70.00th=[ 46924], 80.00th=[ 60556], 90.00th=[ 82314], 95.00th=[102237], | 99.00th=[145753], 99.50th=[164627], 99.90th=[231736], 99.95th=[926942], | 99.99th=[926942] bw ( KiB/s): min= 7, max= 127, per=26.04%, avg=58.08, stdev=21.88, samples=212 iops : min= 1, max= 31, avg=13.91, stdev= 5.52, samples=212 lat (usec) : 50=0.52%, 100=3.91%, 250=0.10%, 500=0.10%, 750=0.03% lat (usec) : 1000=0.20% lat (msec) : 2=5.76%, 4=4.39%, 10=8.01%, 20=12.24%, 50=39.71% lat (msec) : 100=21.48%, 250=3.52%, 1000=0.03% cpu : usr=0.08%, sys=5.88%, ctx=6593, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146343: Mon Jun 29 15:11:01 2026 read: IOPS=13, BW=53.8KiB/s (55.1kB/s)(5940KiB/110482msec) clat (usec): min=25, max=970818, avg=36264.27, stdev=34267.91 lat (usec): min=25, max=970819, avg=36266.22, stdev=34268.69 clat percentiles (usec): | 1.00th=[ 51], 5.00th=[ 61], 10.00th=[ 10814], 20.00th=[ 18220], | 30.00th=[ 22938], 40.00th=[ 26870], 50.00th=[ 31327], 60.00th=[ 36963], | 70.00th=[ 44303], 80.00th=[ 52691], 90.00th=[ 66847], 95.00th=[ 78119], | 99.00th=[107480], 99.50th=[120062], 99.90th=[341836], 99.95th=[968885], | 99.99th=[968885] bw ( KiB/s): min= 7, max= 120, per=25.16%, avg=53.58, stdev=21.27, samples=217 iops : min= 1, max= 30, avg=12.78, stdev= 5.37, samples=217 write: IOPS=14, BW=57.5KiB/s (58.8kB/s)(6348KiB/110482msec); 0 zone resets clat (usec): min=1015, max=359556, avg=35389.76, stdev=35731.44 lat (usec): min=1016, max=359556, avg=35398.01, stdev=35727.16 clat percentiles (usec): | 1.00th=[ 1254], 5.00th=[ 1418], 10.00th=[ 2114], 20.00th=[ 4817], | 30.00th=[ 8848], 40.00th=[ 16450], 50.00th=[ 26084], 60.00th=[ 35390], | 70.00th=[ 47449], 80.00th=[ 61080], 90.00th=[ 82314], 95.00th=[101188], | 99.00th=[156238], 99.50th=[175113], 99.90th=[333448], 99.95th=[358613], | 99.99th=[358613] bw ( KiB/s): min= 15, max= 112, per=25.65%, avg=57.19, stdev=19.49, samples=217 iops : min= 3, max= 28, avg=13.70, stdev= 4.95, samples=217 lat (usec) : 50=0.39%, 100=3.45%, 250=0.13%, 500=0.20%, 750=0.03% lat (msec) : 2=4.95%, 4=4.36%, 10=7.58%, 20=13.09%, 50=40.17% lat (msec) : 100=22.33%, 250=3.19%, 500=0.10%, 1000=0.03% cpu : usr=0.08%, sys=5.85%, ctx=6514, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146344: Mon Jun 29 15:11:01 2026 read: IOPS=13, BW=53.5KiB/s (54.8kB/s)(6028KiB/112628msec) clat (usec): min=28, max=285603, avg=36400.58, stdev=26154.97 lat (usec): min=28, max=285605, avg=36410.90, stdev=26150.17 clat percentiles (usec): | 1.00th=[ 42], 5.00th=[ 60], 10.00th=[ 2442], 20.00th=[ 16909], | 30.00th=[ 21365], 40.00th=[ 26346], 50.00th=[ 31851], 60.00th=[ 37487], | 70.00th=[ 45876], 80.00th=[ 54789], 90.00th=[ 68682], 95.00th=[ 84411], | 99.00th=[120062], 99.50th=[141558], 99.90th=[191890], 99.95th=[287310], | 99.99th=[287310] bw ( KiB/s): min= 15, max= 120, per=24.82%, avg=52.86, stdev=20.85, samples=221 iops : min= 3, max= 30, avg=12.60, stdev= 5.26, samples=221 write: IOPS=13, BW=55.6KiB/s (56.9kB/s)(6260KiB/112628msec); 0 zone resets clat (usec): min=902, max=797321, avg=36624.44, stdev=40074.93 lat (usec): min=904, max=797322, avg=36632.66, stdev=40079.24 clat percentiles (usec): | 1.00th=[ 1221], 5.00th=[ 1401], 10.00th=[ 1827], 20.00th=[ 4555], | 30.00th=[ 9241], 40.00th=[ 18744], 50.00th=[ 27395], 60.00th=[ 36963], | 70.00th=[ 46924], 80.00th=[ 62653], 90.00th=[ 83362], 95.00th=[104334], | 99.00th=[152044], 99.50th=[177210], 99.90th=[295699], 99.95th=[801113], | 99.99th=[801113] bw ( KiB/s): min= 7, max= 104, per=24.56%, avg=54.76, stdev=20.05, samples=221 iops : min= 1, max= 26, avg=13.08, stdev= 5.06, samples=221 lat (usec) : 50=0.94%, 100=3.45%, 250=0.33%, 500=0.03%, 750=0.03% lat (usec) : 1000=0.13% lat (msec) : 2=5.44%, 4=3.68%, 10=7.49%, 20=12.92%, 50=38.93% lat (msec) : 100=22.79%, 250=3.71%, 500=0.10%, 1000=0.03% cpu : usr=0.09%, sys=5.69%, ctx=6685, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146345: Mon Jun 29 15:11:01 2026 read: IOPS=13, BW=54.2KiB/s (55.5kB/s)(6052KiB/111723msec) clat (usec): min=30, max=980484, avg=35745.19, stdev=34984.67 lat (usec): min=31, max=980485, avg=35747.80, stdev=34983.49 clat percentiles (usec): | 1.00th=[ 46], 5.00th=[ 60], 10.00th=[ 229], 20.00th=[ 17433], | 30.00th=[ 21890], 40.00th=[ 25822], 50.00th=[ 30540], 60.00th=[ 35914], | 70.00th=[ 43254], 80.00th=[ 52691], 90.00th=[ 67634], 95.00th=[ 80217], | 99.00th=[109577], 99.50th=[131597], 99.90th=[263193], 99.95th=[977273], | 99.99th=[977273] bw ( KiB/s): min= 7, max= 104, per=25.40%, avg=54.11, stdev=19.92, samples=218 iops : min= 1, max= 26, avg=12.92, stdev= 5.04, samples=218 write: IOPS=13, BW=55.8KiB/s (57.2kB/s)(6236KiB/111723msec); 0 zone resets clat (usec): min=957, max=326646, avg=36697.81, stdev=36337.68 lat (usec): min=958, max=326647, avg=36702.09, stdev=36335.56 clat percentiles (usec): | 1.00th=[ 1237], 5.00th=[ 1385], 10.00th=[ 2212], 20.00th=[ 4883], | 30.00th=[ 8848], 40.00th=[ 17695], 50.00th=[ 27395], 60.00th=[ 36963], | 70.00th=[ 49021], 80.00th=[ 64226], 90.00th=[ 85459], 95.00th=[102237], | 99.00th=[160433], 99.50th=[185598], 99.90th=[291505], 99.95th=[325059], | 99.99th=[325059] bw ( KiB/s): min= 7, max= 119, per=24.87%, avg=55.46, stdev=20.85, samples=219 iops : min= 1, max= 29, avg=13.26, stdev= 5.25, samples=219 lat (usec) : 50=0.75%, 100=3.91%, 250=0.33%, 750=0.10%, 1000=0.07% lat (msec) : 2=4.62%, 4=4.20%, 10=7.94%, 20=11.78%, 50=40.49% lat (msec) : 100=22.20%, 250=3.48%, 500=0.10%, 1000=0.03% cpu : usr=0.08%, sys=5.72%, ctx=6473, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=213KiB/s (218kB/s), 53.5KiB/s-55.4KiB/s (54.8kB/s-56.8kB/s), io=23.4MiB (24.6MB), run=108066-112628msec WRITE: bw=223KiB/s (229kB/s), 55.6KiB/s-58.3KiB/s (56.9kB/s-59.7kB/s), io=24.6MiB (25.7MB), run=108066-112628msec rand-rw: (groupid=0, jobs=1): err= 0: pid=146347: Mon Jun 29 15:13:05 2026 read: IOPS=6, BW=25.4KiB/s (26.0kB/s)(5992KiB/235757msec) clat (msec): min=5, max=982, avg=30.40, stdev=37.58 lat (msec): min=5, max=982, avg=30.40, stdev=37.58 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 10], 20.00th=[ 13], | 30.00th=[ 15], 40.00th=[ 17], 50.00th=[ 21], 60.00th=[ 24], | 70.00th=[ 29], 80.00th=[ 41], 90.00th=[ 66], 95.00th=[ 89], | 99.00th=[ 153], 99.50th=[ 171], 99.90th=[ 292], 99.95th=[ 986], | 99.99th=[ 986] bw ( KiB/s): min= 7, max= 111, per=26.99%, avg=27.26, stdev=18.70, samples=426 iops : min= 1, max= 27, avg= 6.19, stdev= 4.70, samples=426 write: IOPS=6, BW=26.7KiB/s (27.3kB/s)(6296KiB/235757msec); 0 zone resets clat (msec): min=33, max=476, avg=120.76, stdev=54.34 lat (msec): min=33, max=476, avg=120.76, stdev=54.34 clat percentiles (msec): | 1.00th=[ 45], 5.00th=[ 58], 10.00th=[ 65], 20.00th=[ 78], | 30.00th=[ 88], 40.00th=[ 99], 50.00th=[ 109], 60.00th=[ 122], | 70.00th=[ 136], 80.00th=[ 159], 90.00th=[ 194], 95.00th=[ 222], | 99.00th=[ 296], 99.50th=[ 351], 99.90th=[ 447], 99.95th=[ 477], | 99.99th=[ 477] bw ( KiB/s): min= 7, max= 63, per=24.76%, avg=26.25, stdev=10.96, samples=464 iops : min= 1, max= 15, avg= 5.94, stdev= 2.80, samples=464 lat (msec) : 10=5.11%, 20=19.21%, 50=18.20%, 100=25.78%, 250=30.37% lat (msec) : 500=1.30%, 1000=0.03% cpu : usr=0.04%, sys=1.47%, ctx=5282, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146348: Mon Jun 29 15:13:05 2026 read: IOPS=6, BW=25.1KiB/s (25.7kB/s)(5940KiB/236219msec) clat (msec): min=5, max=851, avg=30.68, stdev=36.22 lat (msec): min=5, max=851, avg=30.68, stdev=36.22 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 10], 20.00th=[ 13], | 30.00th=[ 15], 40.00th=[ 17], 50.00th=[ 20], 60.00th=[ 24], | 70.00th=[ 29], 80.00th=[ 41], 90.00th=[ 66], 95.00th=[ 90], | 99.00th=[ 159], 99.50th=[ 201], 99.90th=[ 243], 99.95th=[ 852], | 99.99th=[ 852] bw ( KiB/s): min= 7, max= 96, per=27.38%, avg=27.66, stdev=17.83, samples=416 iops : min= 1, max= 24, avg= 6.31, stdev= 4.49, samples=416 write: IOPS=6, BW=26.9KiB/s (27.5kB/s)(6348KiB/236219msec); 0 zone resets clat (msec): min=23, max=472, avg=120.06, stdev=52.70 lat (msec): min=23, max=472, avg=120.06, stdev=52.70 clat percentiles (msec): | 1.00th=[ 47], 5.00th=[ 58], 10.00th=[ 66], 20.00th=[ 78], | 30.00th=[ 88], 40.00th=[ 99], 50.00th=[ 109], 60.00th=[ 122], | 70.00th=[ 136], 80.00th=[ 157], 90.00th=[ 190], 95.00th=[ 228], | 99.00th=[ 288], 99.50th=[ 317], 99.90th=[ 414], 99.95th=[ 472], | 99.99th=[ 472] bw ( KiB/s): min= 7, max= 55, per=24.81%, avg=26.30, stdev=10.82, samples=466 iops : min= 1, max= 13, avg= 5.95, stdev= 2.75, samples=466 lat (msec) : 10=4.98%, 20=20.15%, 50=16.76%, 100=26.17%, 250=30.66% lat (msec) : 500=1.24%, 1000=0.03% cpu : usr=0.04%, sys=1.44%, ctx=5208, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146350: Mon Jun 29 15:13:05 2026 read: IOPS=6, BW=25.5KiB/s (26.1kB/s)(6028KiB/236688msec) clat (msec): min=5, max=347, avg=32.50, stdev=31.82 lat (msec): min=5, max=347, avg=32.50, stdev=31.82 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 13], | 30.00th=[ 16], 40.00th=[ 18], 50.00th=[ 21], 60.00th=[ 26], | 70.00th=[ 32], 80.00th=[ 47], 90.00th=[ 74], 95.00th=[ 94], | 99.00th=[ 165], 99.50th=[ 190], 99.90th=[ 268], 99.95th=[ 347], | 99.99th=[ 347] bw ( KiB/s): min= 7, max= 103, per=26.57%, avg=26.84, stdev=18.25, samples=435 iops : min= 1, max= 25, avg= 6.09, stdev= 4.61, samples=435 write: IOPS=6, BW=26.4KiB/s (27.1kB/s)(6260KiB/236688msec); 0 zone resets clat (msec): min=26, max=1013, avg=119.84, stdev=58.10 lat (msec): min=26, max=1013, avg=119.85, stdev=58.10 clat percentiles (msec): | 1.00th=[ 44], 5.00th=[ 57], 10.00th=[ 64], 20.00th=[ 77], | 30.00th=[ 87], 40.00th=[ 96], 50.00th=[ 107], 60.00th=[ 120], | 70.00th=[ 136], 80.00th=[ 155], 90.00th=[ 197], 95.00th=[ 226], | 99.00th=[ 288], 99.50th=[ 326], 99.90th=[ 384], 99.95th=[ 1011], | 99.99th=[ 1011] bw ( KiB/s): min= 7, max= 79, per=24.50%, avg=25.97, stdev=11.62, samples=466 iops : min= 1, max= 19, avg= 5.87, stdev= 2.95, samples=466 lat (msec) : 10=4.88%, 20=18.65%, 50=18.00%, 100=28.13%, 250=28.74% lat (msec) : 500=1.56%, 2000=0.03% cpu : usr=0.04%, sys=1.41%, ctx=5155, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146351: Mon Jun 29 15:13:05 2026 read: IOPS=6, BW=25.6KiB/s (26.3kB/s)(6052KiB/235966msec) clat (msec): min=4, max=293, avg=30.28, stdev=29.43 lat (msec): min=4, max=293, avg=30.28, stdev=29.43 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 13], | 30.00th=[ 15], 40.00th=[ 18], 50.00th=[ 21], 60.00th=[ 24], | 70.00th=[ 30], 80.00th=[ 40], 90.00th=[ 65], 95.00th=[ 93], | 99.00th=[ 148], 99.50th=[ 174], 99.90th=[ 271], 99.95th=[ 292], | 99.99th=[ 292] bw ( KiB/s): min= 7, max= 95, per=27.14%, avg=27.41, stdev=17.82, samples=427 iops : min= 1, max= 23, avg= 6.23, stdev= 4.47, samples=427 write: IOPS=6, BW=26.4KiB/s (27.1kB/s)(6236KiB/235966msec); 0 zone resets clat (msec): min=32, max=928, avg=121.89, stdev=55.97 lat (msec): min=32, max=928, avg=121.90, stdev=55.97 clat percentiles (msec): | 1.00th=[ 46], 5.00th=[ 58], 10.00th=[ 66], 20.00th=[ 79], | 30.00th=[ 90], 40.00th=[ 99], 50.00th=[ 111], 60.00th=[ 125], | 70.00th=[ 140], 80.00th=[ 163], 90.00th=[ 192], 95.00th=[ 222], | 99.00th=[ 284], 99.50th=[ 326], 99.90th=[ 464], 99.95th=[ 927], | 99.99th=[ 927] bw ( KiB/s): min= 7, max= 56, per=24.58%, avg=26.06, stdev=10.86, samples=462 iops : min= 1, max= 14, avg= 5.89, stdev= 2.78, samples=462 lat (msec) : 10=4.79%, 20=19.66%, 50=18.46%, 100=25.91%, 250=29.72% lat (msec) : 500=1.43%, 1000=0.03% cpu : usr=0.05%, sys=1.43%, ctx=5140, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=101KiB/s (104kB/s), 25.1KiB/s-25.6KiB/s (25.7kB/s-26.3kB/s), io=23.4MiB (24.6MB), run=235757-236688msec WRITE: bw=106KiB/s (109kB/s), 26.4KiB/s-26.9KiB/s (27.1kB/s-27.5kB/s), io=24.6MiB (25.7MB), run=235757-236688msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=146400: Mon Jun 29 15:13:49 2026 read: IOPS=11, BW=183KiB/s (187kB/s)(5920KiB/32396msec) clat (usec): min=33, max=268955, avg=44331.42, stdev=39876.39 lat (usec): min=33, max=268956, avg=44333.01, stdev=39876.15 clat percentiles (usec): | 1.00th=[ 42], 5.00th=[ 59], 10.00th=[ 67], 20.00th=[ 192], | 30.00th=[ 25297], 40.00th=[ 32900], 50.00th=[ 38011], 60.00th=[ 44303], | 70.00th=[ 55313], 80.00th=[ 69731], 90.00th=[ 86508], 95.00th=[109577], | 99.00th=[206570], 99.50th=[225444], 99.90th=[270533], 99.95th=[270533], | 99.99th=[270533] bw ( KiB/s): min= 31, max= 384, per=24.78%, avg=183.13, stdev=84.05, samples=63 iops : min= 1, max= 24, avg=10.65, stdev= 5.31, samples=63 write: IOPS=12, BW=197KiB/s (201kB/s)(6368KiB/32396msec); 0 zone resets clat (usec): min=1296, max=378068, avg=39465.11, stdev=47184.72 lat (usec): min=1296, max=378071, avg=39472.71, stdev=47183.47 clat percentiles (usec): | 1.00th=[ 1631], 5.00th=[ 1893], 10.00th=[ 2933], 20.00th=[ 5604], | 30.00th=[ 9503], 40.00th=[ 14746], 50.00th=[ 23987], 60.00th=[ 32637], | 70.00th=[ 45351], 80.00th=[ 66323], 90.00th=[ 99091], 95.00th=[128451], | 99.00th=[248513], 99.50th=[274727], 99.90th=[379585], 99.95th=[379585], | 99.99th=[379585] bw ( KiB/s): min= 31, max= 477, per=25.37%, avg=197.11, stdev=100.60, samples=63 iops : min= 1, max= 29, avg=11.52, stdev= 6.35, samples=63 lat (usec) : 50=0.91%, 100=7.68%, 250=1.30% lat (msec) : 2=3.39%, 4=4.69%, 10=8.85%, 20=8.59%, 50=33.85% lat (msec) : 100=23.05%, 250=7.16%, 500=0.52% cpu : usr=0.05%, sys=5.45%, ctx=1487, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146401: Mon Jun 29 15:13:49 2026 read: IOPS=11, BW=188KiB/s (192kB/s)(5744KiB/30623msec) clat (usec): min=37, max=248425, avg=43226.43, stdev=35010.04 lat (usec): min=38, max=248425, avg=43227.71, stdev=35009.94 clat percentiles (usec): | 1.00th=[ 45], 5.00th=[ 60], 10.00th=[ 68], 20.00th=[ 3130], | 30.00th=[ 25560], 40.00th=[ 32113], 50.00th=[ 39060], 60.00th=[ 47973], | 70.00th=[ 56361], 80.00th=[ 68682], 90.00th=[ 85459], 95.00th=[100140], | 99.00th=[158335], 99.50th=[191890], 99.90th=[248513], 99.95th=[248513], | 99.99th=[248513] bw ( KiB/s): min= 27, max= 411, per=25.46%, avg=188.17, stdev=86.99, samples=60 iops : min= 1, max= 25, avg=10.97, stdev= 5.47, samples=60 write: IOPS=13, BW=214KiB/s (219kB/s)(6544KiB/30623msec); 0 zone resets clat (usec): min=1484, max=306022, avg=36264.50, stdev=40749.48 lat (usec): min=1486, max=306024, avg=36266.92, stdev=40749.30 clat percentiles (usec): | 1.00th=[ 1631], 5.00th=[ 1893], 10.00th=[ 2966], 20.00th=[ 5407], | 30.00th=[ 8979], 40.00th=[ 14746], 50.00th=[ 20841], 60.00th=[ 33424], | 70.00th=[ 43254], 80.00th=[ 58983], 90.00th=[ 90702], 95.00th=[117965], | 99.00th=[175113], 99.50th=[196084], 99.90th=[304088], 99.95th=[304088], | 99.99th=[304088] bw ( KiB/s): min= 31, max= 476, per=27.44%, avg=213.18, stdev=102.50, samples=60 iops : min= 1, max= 29, avg=12.53, stdev= 6.45, samples=60 lat (usec) : 50=0.52%, 100=7.03%, 250=1.17%, 500=0.13%, 750=0.26% lat (msec) : 2=3.39%, 4=4.17%, 10=10.03%, 20=10.81%, 50=32.29% lat (msec) : 100=23.18%, 250=6.90%, 500=0.13% cpu : usr=0.08%, sys=5.71%, ctx=1529, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146402: Mon Jun 29 15:13:49 2026 read: IOPS=12, BW=202KiB/s (207kB/s)(6256KiB/30916msec) clat (usec): min=38, max=231052, avg=41249.40, stdev=34634.82 lat (usec): min=39, max=231054, avg=41250.97, stdev=34634.84 clat percentiles (usec): | 1.00th=[ 41], 5.00th=[ 57], 10.00th=[ 63], 20.00th=[ 115], | 30.00th=[ 23462], 40.00th=[ 32113], 50.00th=[ 38536], 60.00th=[ 45876], | 70.00th=[ 54789], 80.00th=[ 63701], 90.00th=[ 85459], 95.00th=[100140], | 99.00th=[154141], 99.50th=[200279], 99.90th=[231736], 99.95th=[231736], | 99.99th=[231736] bw ( KiB/s): min= 31, max= 473, per=27.53%, avg=203.45, stdev=91.29, samples=60 iops : min= 1, max= 29, avg=11.95, stdev= 5.77, samples=60 write: IOPS=12, BW=195KiB/s (200kB/s)(6032KiB/30916msec); 0 zone resets clat (usec): min=1450, max=361864, avg=39040.00, stdev=44073.36 lat (usec): min=1452, max=361866, avg=39042.91, stdev=44072.95 clat percentiles (usec): | 1.00th=[ 1614], 5.00th=[ 1876], 10.00th=[ 2737], 20.00th=[ 5342], | 30.00th=[ 7898], 40.00th=[ 14091], 50.00th=[ 23725], 60.00th=[ 33817], | 70.00th=[ 52167], 80.00th=[ 66847], 90.00th=[ 95945], 95.00th=[115868], | 99.00th=[206570], 99.50th=[214959], 99.90th=[362808], 99.95th=[362808], | 99.99th=[362808] bw ( KiB/s): min= 62, max= 410, per=24.88%, avg=193.32, stdev=87.15, samples=60 iops : min= 3, max= 25, avg=11.30, stdev= 5.52, samples=60 lat (usec) : 50=1.17%, 100=8.85%, 250=1.17%, 500=0.26%, 1000=0.26% lat (msec) : 2=3.26%, 4=4.82%, 10=9.38%, 20=7.42%, 50=30.21% lat (msec) : 100=26.43%, 250=6.64%, 500=0.13% cpu : usr=0.07%, sys=5.50%, ctx=1490, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146403: Mon Jun 29 15:13:49 2026 read: IOPS=12, BW=197KiB/s (202kB/s)(6032KiB/30553msec) clat (usec): min=32, max=424906, avg=43121.90, stdev=41395.05 lat (usec): min=33, max=424907, avg=43123.15, stdev=41395.12 clat percentiles (usec): | 1.00th=[ 44], 5.00th=[ 59], 10.00th=[ 67], 20.00th=[ 1123], | 30.00th=[ 24511], 40.00th=[ 31065], 50.00th=[ 37487], 60.00th=[ 44827], | 70.00th=[ 52691], 80.00th=[ 65274], 90.00th=[ 90702], 95.00th=[114820], | 99.00th=[191890], 99.50th=[248513], 99.90th=[425722], 99.95th=[425722], | 99.99th=[425722] bw ( KiB/s): min= 31, max= 378, per=26.71%, avg=197.42, stdev=76.59, samples=59 iops : min= 1, max= 23, avg=11.54, stdev= 4.83, samples=59 write: IOPS=12, BW=205KiB/s (210kB/s)(6256KiB/30553msec); 0 zone resets clat (usec): min=1486, max=395005, avg=36131.35, stdev=46298.94 lat (usec): min=1488, max=395006, avg=36133.61, stdev=46298.84 clat percentiles (usec): | 1.00th=[ 1598], 5.00th=[ 1860], 10.00th=[ 2409], 20.00th=[ 4686], | 30.00th=[ 7832], 40.00th=[ 11600], 50.00th=[ 17433], 60.00th=[ 29230], | 70.00th=[ 39060], 80.00th=[ 62129], 90.00th=[ 92799], 95.00th=[124257], | 99.00th=[233833], 99.50th=[242222], 99.90th=[396362], 99.95th=[396362], | 99.99th=[396362] bw ( KiB/s): min= 63, max= 525, per=26.94%, avg=209.29, stdev=100.89, samples=58 iops : min= 3, max= 32, avg=12.29, stdev= 6.34, samples=58 lat (usec) : 50=0.78%, 100=6.90%, 250=1.82%, 500=0.26% lat (msec) : 2=4.04%, 4=5.47%, 10=9.77%, 20=10.29%, 50=32.29% lat (msec) : 100=20.44%, 250=7.68%, 500=0.26% cpu : usr=0.07%, sys=5.56%, ctx=1510, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=739KiB/s (757kB/s), 183KiB/s-202KiB/s (187kB/s-207kB/s), io=23.4MiB (24.5MB), run=30553-32396msec WRITE: bw=778KiB/s (797kB/s), 195KiB/s-214KiB/s (200kB/s-219kB/s), io=24.6MiB (25.8MB), run=30553-32396msec rand-rw: (groupid=0, jobs=1): err= 0: pid=146404: Mon Jun 29 15:14:27 2026 read: IOPS=5, BW=84.0KiB/s (86.1kB/s)(5920KiB/70447msec) clat (msec): min=7, max=492, avg=38.58, stdev=41.64 lat (msec): min=7, max=492, avg=38.58, stdev=41.64 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 14], 20.00th=[ 17], | 30.00th=[ 20], 40.00th=[ 23], 50.00th=[ 27], 60.00th=[ 31], | 70.00th=[ 39], 80.00th=[ 51], 90.00th=[ 75], 95.00th=[ 99], | 99.00th=[ 241], 99.50th=[ 279], 99.90th=[ 493], 99.95th=[ 493], | 99.99th=[ 493] bw ( KiB/s): min= 31, max= 318, per=28.94%, avg=98.38, stdev=63.42, samples=118 iops : min= 1, max= 19, avg= 5.41, stdev= 4.03, samples=118 write: IOPS=5, BW=90.4KiB/s (92.6kB/s)(6368KiB/70447msec); 0 zone resets clat (msec): min=45, max=473, avg=140.44, stdev=75.49 lat (msec): min=45, max=473, avg=140.45, stdev=75.48 clat percentiles (msec): | 1.00th=[ 52], 5.00th=[ 64], 10.00th=[ 70], 20.00th=[ 84], | 30.00th=[ 93], 40.00th=[ 105], 50.00th=[ 120], 60.00th=[ 136], | 70.00th=[ 153], 80.00th=[ 186], 90.00th=[ 251], 95.00th=[ 300], | 99.00th=[ 388], 99.50th=[ 464], 99.90th=[ 472], 99.95th=[ 472], | 99.99th=[ 472] bw ( KiB/s): min= 30, max= 192, per=25.75%, avg=91.94, stdev=43.72, samples=136 iops : min= 1, max= 12, avg= 4.98, stdev= 2.80, samples=136 lat (msec) : 10=1.69%, 20=14.06%, 50=22.53%, 100=25.52%, 250=30.47% lat (msec) : 500=5.73% cpu : usr=0.04%, sys=1.45%, ctx=1400, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146405: Mon Jun 29 15:14:27 2026 read: IOPS=5, BW=81.8KiB/s (83.8kB/s)(5744KiB/70221msec) clat (msec): min=7, max=458, avg=40.52, stdev=46.13 lat (msec): min=7, max=458, avg=40.52, stdev=46.13 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 17], | 30.00th=[ 20], 40.00th=[ 23], 50.00th=[ 27], 60.00th=[ 32], | 70.00th=[ 39], 80.00th=[ 51], 90.00th=[ 82], 95.00th=[ 113], | 99.00th=[ 245], 99.50th=[ 397], 99.90th=[ 460], 99.95th=[ 460], | 99.99th=[ 460] bw ( KiB/s): min= 28, max= 319, per=28.41%, avg=96.59, stdev=64.48, samples=116 iops : min= 1, max= 19, avg= 5.28, stdev= 4.04, samples=116 write: IOPS=5, BW=93.2KiB/s (95.4kB/s)(6544KiB/70221msec); 0 zone resets clat (msec): min=40, max=550, avg=135.25, stdev=72.32 lat (msec): min=40, max=550, avg=135.25, stdev=72.32 clat percentiles (msec): | 1.00th=[ 54], 5.00th=[ 60], 10.00th=[ 68], 20.00th=[ 81], | 30.00th=[ 92], 40.00th=[ 105], 50.00th=[ 116], 60.00th=[ 129], | 70.00th=[ 148], 80.00th=[ 178], 90.00th=[ 234], 95.00th=[ 279], | 99.00th=[ 409], 99.50th=[ 443], 99.90th=[ 550], 99.95th=[ 550], | 99.99th=[ 550] bw ( KiB/s): min= 28, max= 192, per=26.46%, avg=94.45, stdev=45.72, samples=135 iops : min= 1, max= 12, avg= 5.13, stdev= 2.91, samples=135 lat (msec) : 10=1.95%, 20=13.02%, 50=22.79%, 100=24.61%, 250=33.20% lat (msec) : 500=4.30%, 750=0.13% cpu : usr=0.04%, sys=1.41%, ctx=1359, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146406: Mon Jun 29 15:14:27 2026 read: IOPS=5, BW=92.5KiB/s (94.8kB/s)(6256KiB/67602msec) clat (msec): min=7, max=267, avg=38.64, stdev=38.48 lat (msec): min=7, max=267, avg=38.64, stdev=38.48 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 17], | 30.00th=[ 19], 40.00th=[ 22], 50.00th=[ 24], 60.00th=[ 29], | 70.00th=[ 36], 80.00th=[ 48], 90.00th=[ 87], 95.00th=[ 122], | 99.00th=[ 188], 99.50th=[ 264], 99.90th=[ 268], 99.95th=[ 268], | 99.99th=[ 268] bw ( KiB/s): min= 30, max= 444, per=30.29%, avg=102.97, stdev=72.82, samples=120 iops : min= 1, max= 27, avg= 5.66, stdev= 4.63, samples=120 write: IOPS=5, BW=89.2KiB/s (91.4kB/s)(6032KiB/67602msec); 0 zone resets clat (msec): min=41, max=582, avg=138.94, stdev=71.15 lat (msec): min=41, max=582, avg=138.94, stdev=71.15 clat percentiles (msec): | 1.00th=[ 52], 5.00th=[ 61], 10.00th=[ 72], 20.00th=[ 87], | 30.00th=[ 96], 40.00th=[ 108], 50.00th=[ 120], 60.00th=[ 136], | 70.00th=[ 150], 80.00th=[ 184], 90.00th=[ 243], 95.00th=[ 288], | 99.00th=[ 355], 99.50th=[ 418], 99.90th=[ 584], 99.95th=[ 584], | 99.99th=[ 584] bw ( KiB/s): min= 30, max= 224, per=25.17%, avg=89.85, stdev=41.31, samples=131 iops : min= 1, max= 14, avg= 4.85, stdev= 2.67, samples=131 lat (msec) : 10=1.30%, 20=16.41%, 50=23.83%, 100=21.48%, 250=32.42% lat (msec) : 500=4.43%, 750=0.13% cpu : usr=0.05%, sys=1.53%, ctx=1411, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146407: Mon Jun 29 15:14:27 2026 read: IOPS=5, BW=87.1KiB/s (89.2kB/s)(6032KiB/69234msec) clat (msec): min=7, max=489, avg=41.56, stdev=52.83 lat (msec): min=7, max=489, avg=41.56, stdev=52.83 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 15], | 30.00th=[ 18], 40.00th=[ 22], 50.00th=[ 25], 60.00th=[ 29], | 70.00th=[ 36], 80.00th=[ 50], 90.00th=[ 85], 95.00th=[ 150], | 99.00th=[ 271], 99.50th=[ 388], 99.90th=[ 489], 99.95th=[ 489], | 99.99th=[ 489] bw ( KiB/s): min= 30, max= 415, per=29.17%, avg=99.17, stdev=69.57, samples=119 iops : min= 1, max= 25, avg= 5.43, stdev= 4.39, samples=119 write: IOPS=5, BW=90.4KiB/s (92.5kB/s)(6256KiB/69234msec); 0 zone resets clat (msec): min=41, max=492, avg=136.05, stdev=71.98 lat (msec): min=41, max=492, avg=136.07, stdev=71.97 clat percentiles (msec): | 1.00th=[ 50], 5.00th=[ 64], 10.00th=[ 69], 20.00th=[ 81], | 30.00th=[ 90], 40.00th=[ 103], 50.00th=[ 116], 60.00th=[ 134], | 70.00th=[ 150], 80.00th=[ 186], 90.00th=[ 236], 95.00th=[ 279], | 99.00th=[ 443], 99.50th=[ 472], 99.90th=[ 493], 99.95th=[ 493], | 99.99th=[ 493] bw ( KiB/s): min= 28, max= 221, per=26.40%, avg=94.26, stdev=44.05, samples=131 iops : min= 1, max= 13, avg= 5.13, stdev= 2.81, samples=131 lat (msec) : 10=2.73%, 20=15.23%, 50=22.27%, 100=24.61%, 250=30.47% lat (msec) : 500=4.69% cpu : usr=0.04%, sys=1.38%, ctx=1368, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=340KiB/s (348kB/s), 81.8KiB/s-92.5KiB/s (83.8kB/s-94.8kB/s), io=23.4MiB (24.5MB), run=67602-70447msec WRITE: bw=358KiB/s (366kB/s), 89.2KiB/s-93.2KiB/s (91.4kB/s-95.4kB/s), io=24.6MiB (25.8MB), run=67602-70447msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=146426: Mon Jun 29 15:14:45 2026 read: IOPS=1, BW=1385KiB/s (1418kB/s)(7168KiB/5176msec) clat (msec): min=3, max=478, avg=234.99, stdev=146.09 lat (msec): min=3, max=478, avg=234.99, stdev=146.09 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 4], 10.00th=[ 4], 20.00th=[ 171], | 30.00th=[ 203], 40.00th=[ 203], 50.00th=[ 205], 60.00th=[ 257], | 70.00th=[ 257], 80.00th=[ 330], 90.00th=[ 481], 95.00th=[ 481], | 99.00th=[ 481], 99.50th=[ 481], 99.90th=[ 481], 99.95th=[ 481], | 99.99th=[ 481] bw ( KiB/s): min= 1670, max= 4096, per=100.00%, avg=3284.33, stdev=1398.06, samples=3 iops : min= 1, max= 4, avg= 2.67, stdev= 1.53, samples=3 write: IOPS=0, BW=989KiB/s (1013kB/s)(5120KiB/5176msec); 0 zone resets clat (msec): min=175, max=1939, avg=646.52, stdev=732.36 lat (msec): min=175, max=1939, avg=646.62, stdev=732.36 clat percentiles (msec): | 1.00th=[ 176], 5.00th=[ 176], 10.00th=[ 176], 20.00th=[ 176], | 30.00th=[ 255], 40.00th=[ 255], 50.00th=[ 376], 60.00th=[ 376], | 70.00th=[ 485], 80.00th=[ 485], 90.00th=[ 1938], 95.00th=[ 1938], | 99.00th=[ 1938], 99.50th=[ 1938], 99.90th=[ 1938], 99.95th=[ 1938], | 99.99th=[ 1938] bw ( KiB/s): min= 1889, max= 4055, per=65.57%, avg=2662.33, stdev=1208.54, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (msec) : 4=8.33%, 250=33.33%, 500=50.00%, 2000=8.33% cpu : usr=0.00%, sys=7.54%, ctx=173, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146427: Mon Jun 29 15:14:45 2026 read: IOPS=0, BW=290KiB/s (297kB/s)(2048KiB/7061msec) clat (usec): min=1824, max=2397.7k, avg=1199773.66, stdev=1694155.58 lat (usec): min=1825, max=2397.7k, avg=1199775.32, stdev=1694156.34 clat percentiles (usec): | 1.00th=[ 1827], 5.00th=[ 1827], 10.00th=[ 1827], | 20.00th=[ 1827], 30.00th=[ 1827], 40.00th=[ 1827], | 50.00th=[ 1827], 60.00th=[2399142], 70.00th=[2399142], | 80.00th=[2399142], 90.00th=[2399142], 95.00th=[2399142], | 99.00th=[2399142], 99.50th=[2399142], 99.90th=[2399142], | 99.95th=[2399142], 99.99th=[2399142] bw ( KiB/s): min= 2015, max= 2039, per=69.90%, avg=2027.00, stdev=16.97, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1450KiB/s (1485kB/s)(10.0MiB/7061msec); 0 zone resets clat (msec): min=131, max=767, avg=459.00, stdev=223.52 lat (msec): min=159, max=768, avg=461.93, stdev=219.07 clat percentiles (msec): | 1.00th=[ 132], 5.00th=[ 132], 10.00th=[ 132], 20.00th=[ 224], | 30.00th=[ 259], 40.00th=[ 321], 50.00th=[ 372], 60.00th=[ 584], | 70.00th=[ 600], 80.00th=[ 659], 90.00th=[ 676], 95.00th=[ 768], | 99.00th=[ 768], 99.50th=[ 768], 99.90th=[ 768], 99.95th=[ 768], | 99.99th=[ 768] bw ( KiB/s): min= 1889, max= 4055, per=56.00%, avg=2273.71, stdev=787.08, samples=7 iops : min= 1, max= 3, avg= 1.29, stdev= 0.76, samples=7 lat (msec) : 2=8.33%, 250=16.67%, 500=25.00%, 750=33.33%, 1000=8.33% lat (msec) : >=2000=8.33% cpu : usr=0.04%, sys=8.22%, ctx=510, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146428: Mon Jun 29 15:14:45 2026 read: IOPS=1, BW=1073KiB/s (1098kB/s)(6144KiB/5728msec) clat (usec): min=571, max=277919, avg=172655.74, stdev=134390.82 lat (usec): min=572, max=277920, avg=172656.95, stdev=134390.73 clat percentiles (usec): | 1.00th=[ 570], 5.00th=[ 570], 10.00th=[ 570], 20.00th=[ 668], | 30.00th=[ 668], 40.00th=[227541], 50.00th=[227541], 60.00th=[258999], | 70.00th=[270533], 80.00th=[270533], 90.00th=[278922], 95.00th=[278922], | 99.00th=[278922], 99.50th=[278922], 99.90th=[278922], 99.95th=[278922], | 99.99th=[278922] bw ( KiB/s): min= 1889, max= 6047, per=100.00%, avg=3328.00, stdev=2356.06, samples=3 iops : min= 1, max= 5, avg= 2.67, stdev= 2.08, samples=3 write: IOPS=1, BW=1073KiB/s (1098kB/s)(6144KiB/5728msec); 0 zone resets clat (msec): min=188, max=2556, avg=752.99, stdev=898.06 lat (msec): min=188, max=2556, avg=753.06, stdev=898.07 clat percentiles (msec): | 1.00th=[ 188], 5.00th=[ 188], 10.00th=[ 188], 20.00th=[ 271], | 30.00th=[ 271], 40.00th=[ 363], 50.00th=[ 363], 60.00th=[ 493], | 70.00th=[ 651], 80.00th=[ 651], 90.00th=[ 2567], 95.00th=[ 2567], | 99.00th=[ 2567], 99.50th=[ 2567], 99.90th=[ 2567], 99.95th=[ 2567], | 99.99th=[ 2567] bw ( KiB/s): min= 1950, max= 4087, per=59.74%, avg=2425.40, stdev=929.58, samples=5 iops : min= 1, max= 3, avg= 1.60, stdev= 0.89, samples=5 lat (usec) : 750=16.67% lat (msec) : 250=16.67%, 500=50.00%, 750=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=6.46%, ctx=140, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146430: Mon Jun 29 15:14:45 2026 read: IOPS=0, BW=841KiB/s (861kB/s)(5120KiB/6087msec) clat (usec): min=435, max=407065, avg=197025.74, stdev=194285.41 lat (usec): min=436, max=407067, avg=197026.77, stdev=194285.60 clat percentiles (usec): | 1.00th=[ 437], 5.00th=[ 437], 10.00th=[ 437], 20.00th=[ 437], | 30.00th=[ 490], 40.00th=[ 490], 50.00th=[208667], 60.00th=[208667], | 70.00th=[367002], 80.00th=[367002], 90.00th=[408945], 95.00th=[408945], | 99.00th=[408945], 99.50th=[408945], 99.90th=[408945], 99.95th=[408945], | 99.99th=[408945] bw ( KiB/s): min= 3900, max= 4031, per=100.00%, avg=3965.50, stdev=92.63, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1178KiB/s (1206kB/s)(7168KiB/6087msec); 0 zone resets clat (msec): min=209, max=2504, avg=694.52, stdev=819.51 lat (msec): min=209, max=2504, avg=694.62, stdev=819.52 clat percentiles (msec): | 1.00th=[ 211], 5.00th=[ 211], 10.00th=[ 211], 20.00th=[ 230], | 30.00th=[ 271], 40.00th=[ 271], 50.00th=[ 388], 60.00th=[ 523], | 70.00th=[ 523], 80.00th=[ 735], 90.00th=[ 2500], 95.00th=[ 2500], | 99.00th=[ 2500], 99.50th=[ 2500], 99.90th=[ 2500], 99.95th=[ 2500], | 99.99th=[ 2500] bw ( KiB/s): min= 1889, max= 2048, per=49.05%, avg=1991.40, stdev=69.52, samples=5 iops : min= 1, max= 2, avg= 1.20, stdev= 0.45, samples=5 lat (usec) : 500=16.67% lat (msec) : 250=25.00%, 500=33.33%, 750=16.67%, >=2000=8.33% cpu : usr=0.00%, sys=6.28%, ctx=129, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2900KiB/s (2970kB/s), 290KiB/s-1385KiB/s (297kB/s-1418kB/s), io=20.0MiB (20.0MB), run=5176-7061msec WRITE: bw=4061KiB/s (4158kB/s), 989KiB/s-1450KiB/s (1013kB/s-1485kB/s), io=28.0MiB (29.4MB), run=5176-7061msec rand-rw: (groupid=0, jobs=1): err= 0: pid=146431: Mon Jun 29 15:14:45 2026 read: IOPS=1, BW=1144KiB/s (1171kB/s)(7168KiB/6266msec) clat (msec): min=103, max=584, avg=214.87, stdev=166.08 lat (msec): min=103, max=584, avg=214.87, stdev=166.08 clat percentiles (msec): | 1.00th=[ 104], 5.00th=[ 104], 10.00th=[ 104], 20.00th=[ 140], | 30.00th=[ 153], 40.00th=[ 153], 50.00th=[ 155], 60.00th=[ 161], | 70.00th=[ 161], 80.00th=[ 211], 90.00th=[ 584], 95.00th=[ 584], | 99.00th=[ 584], 99.50th=[ 584], 99.90th=[ 584], 99.95th=[ 584], | 99.99th=[ 584] bw ( KiB/s): min= 2003, max= 4063, per=100.00%, avg=2772.50, stdev=971.80, samples=4 iops : min= 1, max= 3, avg= 1.75, stdev= 0.96, samples=4 write: IOPS=0, BW=817KiB/s (837kB/s)(5120KiB/6266msec); 0 zone resets clat (msec): min=298, max=2393, avg=898.98, stdev=863.89 lat (msec): min=298, max=2393, avg=899.12, stdev=863.86 clat percentiles (msec): | 1.00th=[ 300], 5.00th=[ 300], 10.00th=[ 300], 20.00th=[ 300], | 30.00th=[ 451], 40.00th=[ 451], 50.00th=[ 464], 60.00th=[ 464], | 70.00th=[ 885], 80.00th=[ 885], 90.00th=[ 2400], 95.00th=[ 2400], | 99.00th=[ 2400], 99.50th=[ 2400], 99.90th=[ 2400], 99.95th=[ 2400], | 99.99th=[ 2400] bw ( KiB/s): min= 2003, max= 3992, per=69.50%, avg=2667.33, stdev=1147.20, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (msec) : 250=50.00%, 500=25.00%, 750=8.33%, 1000=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=2.60%, ctx=89, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146432: Mon Jun 29 15:14:45 2026 read: IOPS=0, BW=274KiB/s (281kB/s)(2048KiB/7470msec) clat (msec): min=134, max=2004, avg=1069.24, stdev=1322.62 lat (msec): min=134, max=2004, avg=1069.24, stdev=1322.62 clat percentiles (msec): | 1.00th=[ 134], 5.00th=[ 134], 10.00th=[ 134], 20.00th=[ 134], | 30.00th=[ 134], 40.00th=[ 134], 50.00th=[ 134], 60.00th=[ 2005], | 70.00th=[ 2005], 80.00th=[ 2005], 90.00th=[ 2005], 95.00th=[ 2005], | 99.00th=[ 2005], 99.50th=[ 2005], 99.90th=[ 2005], 99.95th=[ 2005], | 99.99th=[ 2005] bw ( KiB/s): min= 1917, max= 1976, per=71.01%, avg=1946.50, stdev=41.72, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1371KiB/s (1404kB/s)(10.0MiB/7470msec); 0 zone resets clat (msec): min=150, max=1453, avg=489.12, stdev=446.16 lat (msec): min=150, max=1453, avg=489.23, stdev=446.15 clat percentiles (msec): | 1.00th=[ 150], 5.00th=[ 150], 10.00th=[ 150], 20.00th=[ 161], | 30.00th=[ 207], 40.00th=[ 239], 50.00th=[ 259], 60.00th=[ 259], | 70.00th=[ 334], 80.00th=[ 902], 90.00th=[ 936], 95.00th=[ 1452], | 99.00th=[ 1452], 99.50th=[ 1452], 99.90th=[ 1452], 99.95th=[ 1452], | 99.99th=[ 1452] bw ( KiB/s): min= 1976, max= 6035, per=94.22%, avg=3616.20, stdev=1686.75, samples=5 iops : min= 1, max= 5, avg= 2.60, stdev= 1.67, samples=5 lat (msec) : 250=41.67%, 500=25.00%, 1000=16.67%, 2000=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=2.25%, ctx=77, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146433: Mon Jun 29 15:14:45 2026 read: IOPS=0, BW=873KiB/s (894kB/s)(6144KiB/7035msec) clat (msec): min=97, max=467, avg=281.24, stdev=151.72 lat (msec): min=97, max=467, avg=281.24, stdev=151.72 clat percentiles (msec): | 1.00th=[ 97], 5.00th=[ 97], 10.00th=[ 97], 20.00th=[ 171], | 30.00th=[ 171], 40.00th=[ 230], 50.00th=[ 230], 60.00th=[ 266], | 70.00th=[ 460], 80.00th=[ 460], 90.00th=[ 468], 95.00th=[ 468], | 99.00th=[ 468], 99.50th=[ 468], 99.90th=[ 468], 99.95th=[ 468], | 99.99th=[ 468] bw ( KiB/s): min= 1976, max= 4079, per=91.95%, avg=2520.25, stdev=1039.35, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 write: IOPS=0, BW=873KiB/s (894kB/s)(6144KiB/7035msec); 0 zone resets clat (msec): min=230, max=2968, avg=872.84, stdev=1046.07 lat (msec): min=230, max=2968, avg=872.97, stdev=1046.05 clat percentiles (msec): | 1.00th=[ 230], 5.00th=[ 230], 10.00th=[ 230], 20.00th=[ 326], | 30.00th=[ 326], 40.00th=[ 388], 50.00th=[ 388], 60.00th=[ 518], | 70.00th=[ 810], 80.00th=[ 810], 90.00th=[ 2970], 95.00th=[ 2970], | 99.00th=[ 2970], 99.50th=[ 2970], 99.90th=[ 2970], 99.95th=[ 2970], | 99.99th=[ 2970] bw ( KiB/s): min= 1996, max= 3953, per=62.58%, avg=2402.00, stdev=867.18, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 lat (msec) : 100=8.33%, 250=25.00%, 500=41.67%, 750=8.33%, 1000=8.33% lat (msec) : >=2000=8.33% cpu : usr=0.06%, sys=1.85%, ctx=83, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146434: Mon Jun 29 15:14:45 2026 read: IOPS=0, BW=751KiB/s (769kB/s)(5120KiB/6819msec) clat (msec): min=98, max=307, avg=197.93, stdev=99.87 lat (msec): min=98, max=307, avg=197.93, stdev=99.87 clat percentiles (msec): | 1.00th=[ 100], 5.00th=[ 100], 10.00th=[ 100], 20.00th=[ 100], | 30.00th=[ 125], 40.00th=[ 125], 50.00th=[ 157], 60.00th=[ 157], | 70.00th=[ 305], 80.00th=[ 305], 90.00th=[ 309], 95.00th=[ 309], | 99.00th=[ 309], 99.50th=[ 309], 99.90th=[ 309], 99.95th=[ 309], | 99.99th=[ 309] bw ( KiB/s): min= 4007, max= 4047, per=100.00%, avg=4027.00, stdev=28.28, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1051KiB/s (1076kB/s)(7168KiB/6819msec); 0 zone resets clat (msec): min=225, max=2993, avg=779.33, stdev=1001.82 lat (msec): min=225, max=2993, avg=779.44, stdev=1001.80 clat percentiles (msec): | 1.00th=[ 226], 5.00th=[ 226], 10.00th=[ 226], 20.00th=[ 268], | 30.00th=[ 300], 40.00th=[ 300], 50.00th=[ 351], 60.00th=[ 430], | 70.00th=[ 430], 80.00th=[ 894], 90.00th=[ 3004], 95.00th=[ 3004], | 99.00th=[ 3004], 99.50th=[ 3004], 99.90th=[ 3004], 99.95th=[ 3004], | 99.99th=[ 3004] bw ( KiB/s): min= 1996, max= 4063, per=73.22%, avg=2810.00, stdev=1094.35, samples=5 iops : min= 1, max= 3, avg= 1.80, stdev= 1.10, samples=5 lat (msec) : 100=8.33%, 250=25.00%, 500=50.00%, 1000=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=2.46%, ctx=86, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2742KiB/s (2807kB/s), 274KiB/s-1144KiB/s (281kB/s-1171kB/s), io=20.0MiB (20.0MB), run=6266-7470msec WRITE: bw=3838KiB/s (3930kB/s), 817KiB/s-1371KiB/s (837kB/s-1404kB/s), io=28.0MiB (29.4MB), run=6266-7470msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=146441: Mon Jun 29 15:15:00 2026 read: IOPS=1, BW=4354KiB/s (4459kB/s)(12.0MiB/2822msec) clat (msec): min=829, max=956, avg=902.43, stdev=65.96 lat (msec): min=829, max=956, avg=902.44, stdev=65.96 clat percentiles (msec): | 1.00th=[ 827], 5.00th=[ 827], 10.00th=[ 827], 20.00th=[ 827], | 30.00th=[ 827], 40.00th=[ 919], 50.00th=[ 919], 60.00th=[ 919], | 70.00th=[ 961], 80.00th=[ 961], 90.00th=[ 961], 95.00th=[ 961], | 99.00th=[ 961], 99.50th=[ 961], 99.90th=[ 961], 99.95th=[ 961], | 99.99th=[ 961] bw ( KiB/s): min= 7984, max= 8047, per=100.00%, avg=8015.50, stdev=44.55, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=100.00% cpu : usr=0.04%, sys=10.28%, ctx=256, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146442: Mon Jun 29 15:15:00 2026 read: IOPS=0, BW=1103KiB/s (1129kB/s)(4096KiB/3714msec) clat (nsec): min=1000.1M, max=1000.1M, avg=1000079433.00, stdev= 0.00 lat (nsec): min=1000.1M, max=1000.1M, avg=1000082378.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1003], 5.00th=[ 1003], 10.00th=[ 1003], 20.00th=[ 1003], | 30.00th=[ 1003], 40.00th=[ 1003], 50.00th=[ 1003], 60.00th=[ 1003], | 70.00th=[ 1003], 80.00th=[ 1003], 90.00th=[ 1003], 95.00th=[ 1003], | 99.00th=[ 1003], 99.50th=[ 1003], 99.90th=[ 1003], 99.95th=[ 1003], | 99.99th=[ 1003] bw ( KiB/s): min= 8047, max= 8047, per=100.00%, avg=8047.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2206KiB/s (2259kB/s)(8192KiB/3714msec); 0 zone resets clat (msec): min=859, max=1780, avg=1320.12, stdev=651.75 lat (msec): min=860, max=1781, avg=1321.13, stdev=651.05 clat percentiles (msec): | 1.00th=[ 860], 5.00th=[ 860], 10.00th=[ 860], 20.00th=[ 860], | 30.00th=[ 860], 40.00th=[ 860], 50.00th=[ 860], 60.00th=[ 1787], | 70.00th=[ 1787], 80.00th=[ 1787], 90.00th=[ 1787], 95.00th=[ 1787], | 99.00th=[ 1787], 99.50th=[ 1787], 99.90th=[ 1787], 99.95th=[ 1787], | 99.99th=[ 1787] bw ( KiB/s): min= 7984, max= 7984, per=90.50%, avg=7984.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 1000=33.33%, 2000=66.67% cpu : usr=0.00%, sys=3.39%, ctx=59, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146443: Mon Jun 29 15:15:00 2026 write: IOPS=0, BW=3320KiB/s (3400kB/s)(12.0MiB/3701msec); 0 zone resets clat (msec): min=516, max=1689, avg=1201.76, stdev=610.49 lat (msec): min=517, max=1693, avg=1203.64, stdev=612.26 clat percentiles (msec): | 1.00th=[ 518], 5.00th=[ 518], 10.00th=[ 518], 20.00th=[ 518], | 30.00th=[ 518], 40.00th=[ 1401], 50.00th=[ 1401], 60.00th=[ 1401], | 70.00th=[ 1687], 80.00th=[ 1687], 90.00th=[ 1687], 95.00th=[ 1687], | 99.00th=[ 1687], 99.50th=[ 1687], 99.90th=[ 1687], 99.95th=[ 1687], | 99.99th=[ 1687] bw ( KiB/s): min= 7984, max= 8000, per=90.59%, avg=7992.00, stdev=11.31, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 2000=66.67% cpu : usr=0.03%, sys=2.97%, ctx=47, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146444: Mon Jun 29 15:15:00 2026 write: IOPS=0, BW=3852KiB/s (3944kB/s)(12.0MiB/3190msec); 0 zone resets clat (msec): min=970, max=1153, avg=1054.11, stdev=92.60 lat (msec): min=970, max=1153, avg=1054.49, stdev=92.62 clat percentiles (msec): | 1.00th=[ 969], 5.00th=[ 969], 10.00th=[ 969], 20.00th=[ 969], | 30.00th=[ 969], 40.00th=[ 1036], 50.00th=[ 1036], 60.00th=[ 1036], | 70.00th=[ 1150], 80.00th=[ 1150], 90.00th=[ 1150], 95.00th=[ 1150], | 99.00th=[ 1150], 99.50th=[ 1150], 99.90th=[ 1150], 99.95th=[ 1150], | 99.99th=[ 1150] bw ( KiB/s): min= 8062, max= 8159, per=91.93%, avg=8110.50, stdev=68.59, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=33.33%, 2000=66.67% cpu : usr=0.00%, sys=3.79%, ctx=47, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4411KiB/s (4517kB/s), 1103KiB/s-4354KiB/s (1129kB/s-4459kB/s), io=16.0MiB (16.8MB), run=2822-3714msec WRITE: bw=8823KiB/s (9035kB/s), 2206KiB/s-3852KiB/s (2259kB/s-3944kB/s), io=32.0MiB (33.6MB), run=3190-3714msec rand-rw: (groupid=0, jobs=1): err= 0: pid=146446: Mon Jun 29 15:15:01 2026 read: IOPS=0, BW=3057KiB/s (3131kB/s)(12.0MiB/4019msec) clat (msec): min=384, max=1915, avg=1339.25, stdev=832.69 lat (msec): min=384, max=1915, avg=1339.25, stdev=832.69 clat percentiles (msec): | 1.00th=[ 384], 5.00th=[ 384], 10.00th=[ 384], 20.00th=[ 384], | 30.00th=[ 384], 40.00th=[ 1720], 50.00th=[ 1720], 60.00th=[ 1720], | 70.00th=[ 1921], 80.00th=[ 1921], 90.00th=[ 1921], 95.00th=[ 1921], | 99.00th=[ 1921], 99.50th=[ 1921], 99.90th=[ 1921], 99.95th=[ 1921], | 99.99th=[ 1921] bw ( KiB/s): min= 8094, max= 8094, per=100.00%, avg=8094.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.00%, sys=2.51%, ctx=53, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146447: Mon Jun 29 15:15:01 2026 read: IOPS=0, BW=1036KiB/s (1061kB/s)(4096KiB/3952msec) clat (nsec): min=2044.7M, max=2044.7M, avg=2044658119.00, stdev= 0.00 lat (nsec): min=2044.7M, max=2044.7M, avg=2044661027.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 2039], 5.00th=[ 2039], 10.00th=[ 2039], 20.00th=[ 2039], | 30.00th=[ 2039], 40.00th=[ 2039], 50.00th=[ 2039], 60.00th=[ 2039], | 70.00th=[ 2039], 80.00th=[ 2039], 90.00th=[ 2039], 95.00th=[ 2039], | 99.00th=[ 2039], 99.50th=[ 2039], 99.90th=[ 2039], 99.95th=[ 2039], | 99.99th=[ 2039] bw ( KiB/s): min= 7846, max= 7846, per=100.00%, avg=7846.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2073KiB/s (2123kB/s)(8192KiB/3952msec); 0 zone resets clat (msec): min=540, max=1302, avg=921.92, stdev=538.88 lat (msec): min=541, max=1303, avg=922.27, stdev=538.92 clat percentiles (msec): | 1.00th=[ 542], 5.00th=[ 542], 10.00th=[ 542], 20.00th=[ 542], | 30.00th=[ 542], 40.00th=[ 542], 50.00th=[ 542], 60.00th=[ 1301], | 70.00th=[ 1301], 80.00th=[ 1301], 90.00th=[ 1301], 95.00th=[ 1301], | 99.00th=[ 1301], 99.50th=[ 1301], 99.90th=[ 1301], 99.95th=[ 1301], | 99.99th=[ 1301] bw ( KiB/s): min= 8159, max= 8159, per=98.41%, avg=8159.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=3.32%, ctx=38, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146448: Mon Jun 29 15:15:01 2026 write: IOPS=0, BW=3250KiB/s (3328kB/s)(12.0MiB/3781msec); 0 zone resets clat (msec): min=384, max=1742, avg=1259.54, stdev=759.17 lat (msec): min=384, max=1742, avg=1259.92, stdev=759.16 clat percentiles (msec): | 1.00th=[ 384], 5.00th=[ 384], 10.00th=[ 384], 20.00th=[ 384], | 30.00th=[ 384], 40.00th=[ 1653], 50.00th=[ 1653], 60.00th=[ 1653], | 70.00th=[ 1737], 80.00th=[ 1737], 90.00th=[ 1737], 95.00th=[ 1737], | 99.00th=[ 1737], 99.50th=[ 1737], 99.90th=[ 1737], 99.95th=[ 1737], | 99.99th=[ 1737] bw ( KiB/s): min= 8094, max= 8175, per=98.11%, avg=8134.50, stdev=57.28, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.00%, sys=3.15%, ctx=35, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146449: Mon Jun 29 15:15:01 2026 write: IOPS=0, BW=4042KiB/s (4139kB/s)(12.0MiB/3040msec); 0 zone resets clat (msec): min=790, max=1160, avg=988.52, stdev=186.17 lat (msec): min=790, max=1160, avg=988.93, stdev=186.13 clat percentiles (msec): | 1.00th=[ 793], 5.00th=[ 793], 10.00th=[ 793], 20.00th=[ 793], | 30.00th=[ 793], 40.00th=[ 1020], 50.00th=[ 1020], 60.00th=[ 1020], | 70.00th=[ 1167], 80.00th=[ 1167], 90.00th=[ 1167], 95.00th=[ 1167], | 99.00th=[ 1167], 99.50th=[ 1167], 99.90th=[ 1167], 99.95th=[ 1167], | 99.99th=[ 1167] bw ( KiB/s): min= 8031, max= 8143, per=97.54%, avg=8087.00, stdev=79.20, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=33.33%, 2000=66.67% cpu : usr=0.00%, sys=3.32%, ctx=36, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4077KiB/s (4174kB/s), 1036KiB/s-3057KiB/s (1061kB/s-3131kB/s), io=16.0MiB (16.8MB), run=3952-4019msec WRITE: bw=8291KiB/s (8490kB/s), 2073KiB/s-4042KiB/s (2123kB/s-4139kB/s), io=32.0MiB (33.6MB), run=3040-3952msec