== sanity test 398b: DIO and buffer IO race ============== 11:51:58 (1781625118) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 5.03211 s, 10.0 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=147208: Tue Jun 16 11:54:06 2026 read: IOPS=13, BW=53.9KiB/s (55.2kB/s)(5992KiB/111170msec) clat (usec): min=34, max=632290, avg=36493.41, stdev=30739.40 lat (usec): min=34, max=632292, avg=36494.99, stdev=30739.33 clat percentiles (usec): | 1.00th=[ 49], 5.00th=[ 58], 10.00th=[ 4686], 20.00th=[ 17171], | 30.00th=[ 21365], 40.00th=[ 26346], 50.00th=[ 31589], 60.00th=[ 36963], | 70.00th=[ 44827], 80.00th=[ 54264], 90.00th=[ 66847], 95.00th=[ 80217], | 99.00th=[119014], 99.50th=[154141], 99.90th=[350225], 99.95th=[633340], | 99.99th=[633340] bw ( KiB/s): min= 5, max= 127, per=24.79%, avg=53.31, stdev=20.48, samples=219 iops : min= 1, max= 31, avg=12.72, stdev= 5.15, samples=219 write: IOPS=14, BW=56.6KiB/s (57.0kB/s)(6296KiB/111170msec); 0 zone resets clat (usec): min=984, max=308963, avg=35594.90, stdev=36242.11 lat (usec): min=986, max=308965, avg=35597.85, stdev=36241.37 clat percentiles (usec): | 1.00th=[ 1221], 5.00th=[ 1352], 10.00th=[ 1762], 20.00th=[ 4228], | 30.00th=[ 8455], 40.00th=[ 17957], 50.00th=[ 26346], 60.00th=[ 35390], | 70.00th=[ 46400], 80.00th=[ 60556], 90.00th=[ 82314], 95.00th=[103285], | 99.00th=[164627], 99.50th=[193987], 99.90th=[287310], 99.95th=[308282], | 99.99th=[308282] bw ( KiB/s): min= 7, max= 159, per=25.06%, avg=56.38, stdev=22.76, samples=218 iops : min= 1, max= 39, avg=13.50, stdev= 5.73, samples=218 lat (usec) : 50=0.65%, 100=3.68%, 250=0.23%, 500=0.10%, 1000=0.03% lat (msec) : 2=5.83%, 4=4.07%, 10=7.13%, 20=12.92%, 50=38.93% lat (msec) : 100=22.66%, 250=3.61%, 500=0.13%, 750=0.03% cpu : usr=0.08%, sys=5.84%, ctx=6597, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147209: Tue Jun 16 11:54:06 2026 read: IOPS=13, BW=53.9KiB/s (55.2kB/s)(5940KiB/110149msec) clat (usec): min=32, max=391416, avg=35093.38, stdev=26645.45 lat (usec): min=32, max=391417, avg=35094.86, stdev=26645.40 clat percentiles (usec): | 1.00th=[ 46], 5.00th=[ 57], 10.00th=[ 91], 20.00th=[ 17171], | 30.00th=[ 21890], 40.00th=[ 26084], 50.00th=[ 30540], 60.00th=[ 35390], | 70.00th=[ 42730], 80.00th=[ 51643], 90.00th=[ 65274], 95.00th=[ 79168], | 99.00th=[121111], 99.50th=[135267], 99.90th=[210764], 99.95th=[392168], | 99.99th=[392168] bw ( KiB/s): min= 5, max= 125, per=24.88%, avg=53.49, stdev=22.29, samples=217 iops : min= 1, max= 31, avg=12.76, stdev= 5.59, samples=217 write: IOPS=14, BW=57.6KiB/s (59.0kB/s)(6348KiB/110149msec); 0 zone resets clat (usec): min=1002, max=626434, avg=36295.25, stdev=40103.09 lat (usec): min=1004, max=626436, avg=36301.63, stdev=40105.29 clat percentiles (usec): | 1.00th=[ 1188], 5.00th=[ 1336], 10.00th=[ 1582], 20.00th=[ 3851], | 30.00th=[ 8356], 40.00th=[ 17957], 50.00th=[ 27657], 60.00th=[ 35390], | 70.00th=[ 46400], 80.00th=[ 61080], 90.00th=[ 83362], 95.00th=[109577], | 99.00th=[166724], 99.50th=[189793], 99.90th=[383779], 99.95th=[624952], | 99.99th=[624952] bw ( KiB/s): min= 7, max= 119, per=25.49%, avg=57.35, stdev=22.30, samples=216 iops : min= 1, max= 29, avg=13.74, stdev= 5.63, samples=216 lat (usec) : 50=0.94%, 100=3.97%, 250=0.23%, 1000=0.03% lat (msec) : 2=6.25%, 4=4.39%, 10=6.71%, 20=11.62%, 50=40.76% lat (msec) : 100=21.03%, 250=3.94%, 500=0.10%, 750=0.03% cpu : usr=0.08%, sys=5.90%, ctx=6430, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147210: Tue Jun 16 11:54:06 2026 read: IOPS=13, BW=54.2KiB/s (55.5kB/s)(6028KiB/111228msec) clat (usec): min=30, max=404624, avg=34983.56, stdev=27211.07 lat (usec): min=30, max=404624, avg=34986.25, stdev=27210.05 clat percentiles (usec): | 1.00th=[ 48], 5.00th=[ 58], 10.00th=[ 108], 20.00th=[ 16188], | 30.00th=[ 21627], 40.00th=[ 25035], 50.00th=[ 30016], 60.00th=[ 35914], | 70.00th=[ 43254], 80.00th=[ 52167], 90.00th=[ 66323], 95.00th=[ 80217], | 99.00th=[110625], 99.50th=[137364], 99.90th=[233833], 99.95th=[404751], | 99.99th=[404751] bw ( KiB/s): min= 7, max= 111, per=25.24%, avg=54.27, stdev=21.72, samples=217 iops : min= 1, max= 27, avg=12.95, stdev= 5.46, samples=217 write: IOPS=14, BW=56.3KiB/s (57.6kB/s)(6260KiB/111228msec); 0 zone resets clat (usec): min=885, max=866351, avg=37009.88, stdev=42468.38 lat (usec): min=886, max=866355, avg=37013.13, stdev=42469.39 clat percentiles (usec): | 1.00th=[ 1221], 5.00th=[ 1352], 10.00th=[ 1860], 20.00th=[ 4293], | 30.00th=[ 8586], 40.00th=[ 18744], 50.00th=[ 27132], 60.00th=[ 36963], | 70.00th=[ 49021], 80.00th=[ 63177], 90.00th=[ 83362], 95.00th=[103285], | 99.00th=[162530], 99.50th=[191890], 99.90th=[320865], 99.95th=[868221], | 99.99th=[868221] bw ( KiB/s): min= 7, max= 127, per=24.92%, avg=56.07, stdev=22.05, samples=218 iops : min= 1, max= 31, avg=13.41, stdev= 5.56, samples=218 lat (usec) : 50=0.68%, 100=4.20%, 250=0.20%, 500=0.03%, 750=0.07% lat (usec) : 1000=0.20% lat (msec) : 2=5.40%, 4=4.23%, 10=7.23%, 20=12.30%, 50=39.81% lat (msec) : 100=21.74%, 250=3.74%, 500=0.13%, 1000=0.03% cpu : usr=0.08%, sys=5.90%, ctx=6529, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147211: Tue Jun 16 11:54:06 2026 read: IOPS=13, BW=54.4KiB/s (55.7kB/s)(6052KiB/111273msec) clat (usec): min=32, max=250155, avg=35802.80, stdev=25979.30 lat (usec): min=32, max=250155, avg=35804.34, stdev=25979.26 clat percentiles (usec): | 1.00th=[ 46], 5.00th=[ 58], 10.00th=[ 115], 20.00th=[ 16909], | 30.00th=[ 21890], 40.00th=[ 26084], 50.00th=[ 30802], 60.00th=[ 36439], | 70.00th=[ 44827], 80.00th=[ 53740], 90.00th=[ 69731], 95.00th=[ 83362], | 99.00th=[115868], 99.50th=[130548], 99.90th=[173016], 99.95th=[250610], | 99.99th=[250610] bw ( KiB/s): min= 7, max= 143, per=25.66%, avg=55.16, stdev=22.25, samples=214 iops : min= 1, max= 35, avg=13.18, stdev= 5.59, samples=214 write: IOPS=14, BW=56.0KiB/s (57.4kB/s)(6236KiB/111273msec); 0 zone resets clat (usec): min=936, max=911751, avg=36322.26, stdev=44099.08 lat (usec): min=937, max=911753, avg=36323.97, stdev=44099.13 clat percentiles (usec): | 1.00th=[ 1205], 5.00th=[ 1336], 10.00th=[ 1532], 20.00th=[ 3654], | 30.00th=[ 7177], 40.00th=[ 15401], 50.00th=[ 26346], 60.00th=[ 35390], | 70.00th=[ 46400], 80.00th=[ 62653], 90.00th=[ 85459], 95.00th=[106431], | 99.00th=[164627], 99.50th=[225444], 99.90th=[337642], 99.95th=[910164], | 99.99th=[910164] bw ( KiB/s): min= 7, max= 134, per=24.90%, avg=56.03, stdev=22.49, samples=217 iops : min= 1, max= 33, avg=13.40, stdev= 5.64, samples=217 lat (usec) : 50=0.94%, 100=3.94%, 250=0.23%, 500=0.07%, 750=0.13% lat (usec) : 1000=0.13% lat (msec) : 2=6.58%, 4=4.33%, 10=7.49%, 20=11.13%, 50=39.68% lat (msec) : 100=20.96%, 250=4.20%, 500=0.16%, 1000=0.03% cpu : usr=0.08%, sys=5.83%, ctx=6427, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=216KiB/s (221kB/s), 53.9KiB/s-54.4KiB/s (55.2kB/s-55.7kB/s), io=23.4MiB (24.6MB), run=110149-111273msec WRITE: bw=226KiB/s (231kB/s), 56.0KiB/s-57.6KiB/s (57.4kB/s-59.0kB/s), io=24.6MiB (25.7MB), run=110149-111273msec rand-rw: (groupid=0, jobs=1): err= 0: pid=147204: Tue Jun 16 11:56:06 2026 read: IOPS=6, BW=25.9KiB/s (26.5kB/s)(5992KiB/231498msec) clat (msec): min=4, max=638, avg=32.65, stdev=32.67 lat (msec): min=4, max=638, avg=32.65, stdev=32.67 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 14], | 30.00th=[ 17], 40.00th=[ 20], 50.00th=[ 24], 60.00th=[ 29], | 70.00th=[ 34], 80.00th=[ 45], 90.00th=[ 67], 95.00th=[ 87], | 99.00th=[ 138], 99.50th=[ 178], 99.90th=[ 347], 99.95th=[ 642], | 99.99th=[ 642] bw ( KiB/s): min= 7, max= 103, per=26.76%, avg=27.56, stdev=18.51, samples=421 iops : min= 1, max= 25, avg= 6.27, stdev= 4.66, samples=421 write: IOPS=6, BW=27.2KiB/s (27.8kB/s)(6296KiB/231498msec); 0 zone resets clat (msec): min=29, max=493, avg=115.70, stdev=55.46 lat (msec): min=29, max=493, avg=115.70, stdev=55.46 clat percentiles (msec): | 1.00th=[ 42], 5.00th=[ 53], 10.00th=[ 62], 20.00th=[ 72], | 30.00th=[ 82], 40.00th=[ 91], 50.00th=[ 103], 60.00th=[ 114], | 70.00th=[ 131], 80.00th=[ 153], 90.00th=[ 192], 95.00th=[ 226], | 99.00th=[ 296], 99.50th=[ 321], 99.90th=[ 435], 99.95th=[ 493], | 99.99th=[ 493] bw ( KiB/s): min= 7, max= 56, per=24.78%, avg=26.76, stdev=11.62, samples=455 iops : min= 1, max= 14, avg= 6.07, stdev= 2.96, samples=455 lat (msec) : 10=4.39%, 20=15.59%, 50=22.43%, 100=29.46%, 250=26.53% lat (msec) : 500=1.56%, 750=0.03% cpu : usr=0.05%, sys=1.54%, ctx=5569, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147205: Tue Jun 16 11:56:06 2026 read: IOPS=6, BW=25.6KiB/s (26.2kB/s)(5940KiB/231795msec) clat (msec): min=5, max=726, avg=32.92, stdev=33.46 lat (msec): min=5, max=726, avg=32.93, stdev=33.46 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 14], | 30.00th=[ 17], 40.00th=[ 21], 50.00th=[ 25], 60.00th=[ 29], | 70.00th=[ 35], 80.00th=[ 44], 90.00th=[ 64], 95.00th=[ 92], | 99.00th=[ 138], 99.50th=[ 167], 99.90th=[ 268], 99.95th=[ 726], | 99.99th=[ 726] bw ( KiB/s): min= 7, max= 119, per=26.95%, avg=27.75, stdev=18.20, samples=415 iops : min= 1, max= 29, avg= 6.32, stdev= 4.57, samples=415 write: IOPS=6, BW=27.4KiB/s (28.0kB/s)(6348KiB/231795msec); 0 zone resets clat (msec): min=35, max=432, avg=114.95, stdev=53.74 lat (msec): min=35, max=432, avg=114.96, stdev=53.75 clat percentiles (msec): | 1.00th=[ 45], 5.00th=[ 55], 10.00th=[ 61], 20.00th=[ 72], | 30.00th=[ 81], 40.00th=[ 91], 50.00th=[ 102], 60.00th=[ 114], | 70.00th=[ 131], 80.00th=[ 153], 90.00th=[ 186], 95.00th=[ 215], | 99.00th=[ 300], 99.50th=[ 342], 99.90th=[ 401], 99.95th=[ 435], | 99.99th=[ 435] bw ( KiB/s): min= 7, max= 56, per=25.02%, avg=27.03, stdev=11.38, samples=455 iops : min= 1, max= 14, avg= 6.13, stdev= 2.89, samples=455 lat (msec) : 10=4.33%, 20=14.91%, 50=22.66%, 100=29.33%, 250=27.31% lat (msec) : 500=1.43%, 750=0.03% cpu : usr=0.04%, sys=1.58%, ctx=5601, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147206: Tue Jun 16 11:56:06 2026 read: IOPS=6, BW=26.0KiB/s (26.6kB/s)(6028KiB/231796msec) clat (msec): min=4, max=411, avg=33.60, stdev=33.69 lat (msec): min=4, max=411, avg=33.60, stdev=33.69 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 14], | 30.00th=[ 17], 40.00th=[ 21], 50.00th=[ 24], 60.00th=[ 28], | 70.00th=[ 35], 80.00th=[ 45], 90.00th=[ 68], 95.00th=[ 90], | 99.00th=[ 182], 99.50th=[ 220], 99.90th=[ 351], 99.95th=[ 414], | 99.99th=[ 414] bw ( KiB/s): min= 7, max= 111, per=26.94%, avg=27.75, stdev=18.62, samples=421 iops : min= 1, max= 27, avg= 6.33, stdev= 4.70, samples=421 write: IOPS=6, BW=27.0KiB/s (27.7kB/s)(6260KiB/231796msec); 0 zone resets clat (msec): min=38, max=850, avg=115.45, stdev=58.08 lat (msec): min=38, max=850, avg=115.46, stdev=58.08 clat percentiles (msec): | 1.00th=[ 44], 5.00th=[ 55], 10.00th=[ 62], 20.00th=[ 72], | 30.00th=[ 82], 40.00th=[ 91], 50.00th=[ 101], 60.00th=[ 112], | 70.00th=[ 130], 80.00th=[ 150], 90.00th=[ 190], 95.00th=[ 222], | 99.00th=[ 317], 99.50th=[ 351], 99.90th=[ 464], 99.95th=[ 852], | 99.99th=[ 852] bw ( KiB/s): min= 7, max= 56, per=24.72%, avg=26.70, stdev=11.73, samples=454 iops : min= 1, max= 14, avg= 6.05, stdev= 2.98, samples=454 lat (msec) : 10=4.43%, 20=14.75%, 50=23.27%, 100=30.21%, 250=25.88% lat (msec) : 500=1.43%, 1000=0.03% cpu : usr=0.04%, sys=1.60%, ctx=5636, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147207: Tue Jun 16 11:56:06 2026 read: IOPS=6, BW=26.3KiB/s (26.9kB/s)(6052KiB/230434msec) clat (msec): min=4, max=348, avg=33.64, stdev=30.91 lat (msec): min=4, max=348, avg=33.65, stdev=30.91 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 14], | 30.00th=[ 17], 40.00th=[ 21], 50.00th=[ 24], 60.00th=[ 29], | 70.00th=[ 35], 80.00th=[ 46], 90.00th=[ 69], 95.00th=[ 96], | 99.00th=[ 150], 99.50th=[ 176], 99.90th=[ 284], 99.95th=[ 351], | 99.99th=[ 351] bw ( KiB/s): min= 7, max= 103, per=27.39%, avg=28.21, stdev=18.13, samples=416 iops : min= 1, max= 25, avg= 6.43, stdev= 4.58, samples=416 write: IOPS=6, BW=27.1KiB/s (27.7kB/s)(6236KiB/230434msec); 0 zone resets clat (msec): min=33, max=890, avg=114.86, stdev=56.01 lat (msec): min=33, max=890, avg=114.86, stdev=56.01 clat percentiles (msec): | 1.00th=[ 42], 5.00th=[ 54], 10.00th=[ 62], 20.00th=[ 73], | 30.00th=[ 82], 40.00th=[ 91], 50.00th=[ 101], 60.00th=[ 114], | 70.00th=[ 131], 80.00th=[ 155], 90.00th=[ 190], 95.00th=[ 218], | 99.00th=[ 275], 99.50th=[ 326], 99.90th=[ 489], 99.95th=[ 894], | 99.99th=[ 894] bw ( KiB/s): min= 7, max= 63, per=24.58%, avg=26.55, stdev=11.55, samples=454 iops : min= 1, max= 15, avg= 6.02, stdev= 2.93, samples=454 lat (msec) : 10=4.30%, 20=15.23%, 50=22.69%, 100=29.88%, 250=26.82% lat (msec) : 500=1.04%, 1000=0.03% cpu : usr=0.04%, sys=1.59%, ctx=5686, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=104KiB/s (106kB/s), 25.6KiB/s-26.3KiB/s (26.2kB/s-26.9kB/s), io=23.4MiB (24.6MB), run=230434-231796msec WRITE: bw=108KiB/s (111kB/s), 27.0KiB/s-27.4KiB/s (27.7kB/s-28.0kB/s), io=24.6MiB (25.7MB), run=230434-231796msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=147259: Tue Jun 16 11:56:36 2026 read: IOPS=17, BW=276KiB/s (282kB/s)(5920KiB/21486msec) clat (usec): min=33, max=111922, avg=28065.55, stdev=21304.26 lat (usec): min=33, max=111922, avg=28066.75, stdev=21304.27 clat percentiles (usec): | 1.00th=[ 42], 5.00th=[ 55], 10.00th=[ 62], 20.00th=[ 102], | 30.00th=[ 17695], 40.00th=[ 23200], 50.00th=[ 27657], 60.00th=[ 32113], | 70.00th=[ 37487], 80.00th=[ 43779], 90.00th=[ 56361], 95.00th=[ 66847], | 99.00th=[ 84411], 99.50th=[103285], 99.90th=[111674], 99.95th=[111674], | 99.99th=[111674] bw ( KiB/s): min= 92, max= 542, per=24.62%, avg=274.07, stdev=90.06, samples=42 iops : min= 5, max= 33, avg=16.43, stdev= 5.63, samples=42 write: IOPS=18, BW=296KiB/s (303kB/s)(6368KiB/21486msec); 0 zone resets clat (usec): min=1294, max=116203, avg=27100.82, stdev=26304.66 lat (usec): min=1294, max=116206, avg=27103.10, stdev=26304.60 clat percentiles (usec): | 1.00th=[ 1434], 5.00th=[ 1811], 10.00th=[ 2311], 20.00th=[ 4424], | 30.00th=[ 6849], 40.00th=[ 12387], 50.00th=[ 18220], 60.00th=[ 26346], | 70.00th=[ 34866], 80.00th=[ 47973], 90.00th=[ 66323], 95.00th=[ 84411], | 99.00th=[107480], 99.50th=[115868], 99.90th=[115868], 99.95th=[115868], | 99.99th=[115868] bw ( KiB/s): min= 61, max= 477, per=25.91%, avg=303.41, stdev=94.68, samples=41 iops : min= 3, max= 29, avg=18.27, stdev= 5.99, samples=41 lat (usec) : 50=1.56%, 100=7.94%, 250=1.04%, 500=0.13% lat (msec) : 2=3.52%, 4=6.38%, 10=9.64%, 20=13.80%, 50=39.71% lat (msec) : 100=15.10%, 250=1.17% cpu : usr=0.10%, sys=8.04%, ctx=1513, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147261: Tue Jun 16 11:56:36 2026 read: IOPS=17, BW=287KiB/s (294kB/s)(5744KiB/19990msec) clat (usec): min=34, max=137880, avg=27662.96, stdev=23555.80 lat (usec): min=35, max=137882, avg=27664.17, stdev=23555.91 clat percentiles (usec): | 1.00th=[ 39], 5.00th=[ 54], 10.00th=[ 60], 20.00th=[ 89], | 30.00th=[ 15795], 40.00th=[ 21103], 50.00th=[ 24773], 60.00th=[ 29492], | 70.00th=[ 36439], 80.00th=[ 44827], 90.00th=[ 57934], 95.00th=[ 72877], | 99.00th=[ 96994], 99.50th=[120062], 99.90th=[137364], 99.95th=[137364], | 99.99th=[137364] bw ( KiB/s): min= 61, max= 510, per=25.85%, avg=287.67, stdev=96.19, samples=39 iops : min= 3, max= 31, avg=17.31, stdev= 6.06, samples=39 write: IOPS=20, BW=327KiB/s (335kB/s)(6544KiB/19990msec); 0 zone resets clat (usec): min=1202, max=211139, avg=23770.24, stdev=27281.23 lat (usec): min=1203, max=211140, avg=23772.28, stdev=27281.18 clat percentiles (usec): | 1.00th=[ 1565], 5.00th=[ 1975], 10.00th=[ 2573], 20.00th=[ 3949], | 30.00th=[ 6128], 40.00th=[ 9110], 50.00th=[ 13829], 60.00th=[ 20841], | 70.00th=[ 27919], 80.00th=[ 39584], 90.00th=[ 57410], 95.00th=[ 74974], | 99.00th=[121111], 99.50th=[127402], 99.90th=[210764], 99.95th=[210764], | 99.99th=[210764] bw ( KiB/s): min= 127, max= 576, per=27.98%, avg=327.59, stdev=113.05, samples=39 iops : min= 7, max= 36, avg=19.82, stdev= 7.10, samples=39 lat (usec) : 50=1.17%, 100=8.33%, 250=1.17%, 500=0.39%, 750=0.13% lat (msec) : 2=3.26%, 4=7.81%, 10=12.24%, 20=14.19%, 50=37.50% lat (msec) : 100=11.59%, 250=2.21% cpu : usr=0.08%, sys=8.39%, ctx=1431, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147263: Tue Jun 16 11:56:36 2026 read: IOPS=18, BW=291KiB/s (298kB/s)(6256KiB/21507msec) clat (usec): min=23, max=210493, avg=30024.29, stdev=26337.58 lat (usec): min=23, max=210495, avg=30025.78, stdev=26337.57 clat percentiles (usec): | 1.00th=[ 41], 5.00th=[ 53], 10.00th=[ 64], 20.00th=[ 98], | 30.00th=[ 16909], 40.00th=[ 23200], 50.00th=[ 27919], 60.00th=[ 33817], | 70.00th=[ 40633], 80.00th=[ 48497], 90.00th=[ 60031], 95.00th=[ 68682], | 99.00th=[129500], 99.50th=[158335], 99.90th=[210764], 99.95th=[210764], | 99.99th=[210764] bw ( KiB/s): min= 93, max= 476, per=26.12%, avg=290.76, stdev=93.54, samples=42 iops : min= 5, max= 29, avg=17.48, stdev= 5.84, samples=42 write: IOPS=17, BW=280KiB/s (287kB/s)(6032KiB/21507msec); 0 zone resets clat (usec): min=1448, max=173080, avg=25687.54, stdev=27216.42 lat (usec): min=1450, max=173082, avg=25696.10, stdev=27215.85 clat percentiles (usec): | 1.00th=[ 1582], 5.00th=[ 1893], 10.00th=[ 2540], 20.00th=[ 4752], | 30.00th=[ 7177], 40.00th=[ 10028], 50.00th=[ 15795], 60.00th=[ 22676], | 70.00th=[ 30802], 80.00th=[ 44303], 90.00th=[ 62653], 95.00th=[ 74974], | 99.00th=[125305], 99.50th=[137364], 99.90th=[173016], 99.95th=[173016], | 99.99th=[173016] bw ( KiB/s): min= 126, max= 479, per=23.61%, avg=276.45, stdev=102.59, samples=42 iops : min= 7, max= 29, avg=16.57, stdev= 6.42, samples=42 lat (usec) : 50=1.69%, 100=8.59%, 250=1.56%, 500=0.26%, 750=0.26% lat (msec) : 2=3.78%, 4=4.82%, 10=11.46%, 20=11.72%, 50=38.15% lat (msec) : 100=15.76%, 250=1.95% cpu : usr=0.10%, sys=8.04%, ctx=1529, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147265: Tue Jun 16 11:56:36 2026 read: IOPS=17, BW=283KiB/s (290kB/s)(6032KiB/21299msec) clat (usec): min=37, max=148817, avg=27408.54, stdev=23012.06 lat (usec): min=37, max=148818, avg=27409.69, stdev=23012.04 clat percentiles (usec): | 1.00th=[ 41], 5.00th=[ 57], 10.00th=[ 62], 20.00th=[ 88], | 30.00th=[ 15270], 40.00th=[ 22414], 50.00th=[ 26870], 60.00th=[ 31327], | 70.00th=[ 36439], 80.00th=[ 43779], 90.00th=[ 53216], 95.00th=[ 66847], | 99.00th=[ 99091], 99.50th=[137364], 99.90th=[147850], 99.95th=[147850], | 99.99th=[147850] bw ( KiB/s): min= 63, max= 493, per=26.06%, avg=290.00, stdev=99.56, samples=41 iops : min= 3, max= 30, avg=17.41, stdev= 6.34, samples=41 write: IOPS=18, BW=294KiB/s (301kB/s)(6256KiB/21299msec); 0 zone resets clat (usec): min=1300, max=161760, avg=27340.53, stdev=28386.37 lat (usec): min=1302, max=161763, avg=27342.67, stdev=28386.35 clat percentiles (usec): | 1.00th=[ 1549], 5.00th=[ 1876], 10.00th=[ 2737], 20.00th=[ 4490], | 30.00th=[ 6980], 40.00th=[ 11469], 50.00th=[ 17695], 60.00th=[ 25560], | 70.00th=[ 34341], 80.00th=[ 42730], 90.00th=[ 68682], 95.00th=[ 83362], | 99.00th=[135267], 99.50th=[162530], 99.90th=[162530], 99.95th=[162530], | 99.99th=[162530] bw ( KiB/s): min= 91, max= 510, per=25.15%, avg=294.52, stdev=105.89, samples=42 iops : min= 5, max= 31, avg=17.71, stdev= 6.63, samples=42 lat (usec) : 50=1.56%, 100=8.59%, 250=0.78%, 500=0.78%, 750=0.39% lat (usec) : 1000=0.26% lat (msec) : 2=3.39%, 4=5.60%, 10=10.16%, 20=12.76%, 50=39.71% lat (msec) : 100=14.45%, 250=1.56% cpu : usr=0.08%, sys=8.15%, ctx=1466, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1114KiB/s (1140kB/s), 276KiB/s-291KiB/s (282kB/s-298kB/s), io=23.4MiB (24.5MB), run=19990-21507msec WRITE: bw=1172KiB/s (1200kB/s), 280KiB/s-327KiB/s (287kB/s-335kB/s), io=24.6MiB (25.8MB), run=19990-21507msec rand-rw: (groupid=0, jobs=1): err= 0: pid=147260: Tue Jun 16 11:57:06 2026 read: IOPS=7, BW=116KiB/s (118kB/s)(5920KiB/51225msec) clat (msec): min=4, max=212, avg=30.60, stdev=30.30 lat (msec): min=4, max=212, avg=30.60, stdev=30.30 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 10], 20.00th=[ 12], | 30.00th=[ 15], 40.00th=[ 17], 50.00th=[ 20], 60.00th=[ 24], | 70.00th=[ 30], 80.00th=[ 42], 90.00th=[ 62], 95.00th=[ 96], | 99.00th=[ 157], 99.50th=[ 194], 99.90th=[ 213], 99.95th=[ 213], | 99.99th=[ 213] bw ( KiB/s): min= 31, max= 384, per=26.23%, avg=122.51, stdev=78.71, samples=94 iops : min= 1, max= 24, avg= 7.04, stdev= 5.01, samples=94 write: IOPS=7, BW=124KiB/s (127kB/s)(6368KiB/51225msec); 0 zone resets clat (msec): min=33, max=325, avg=99.48, stdev=44.65 lat (msec): min=33, max=325, avg=99.49, stdev=44.65 clat percentiles (msec): | 1.00th=[ 40], 5.00th=[ 50], 10.00th=[ 55], 20.00th=[ 64], | 30.00th=[ 72], 40.00th=[ 80], 50.00th=[ 90], 60.00th=[ 99], | 70.00th=[ 116], 80.00th=[ 131], 90.00th=[ 157], 95.00th=[ 186], | 99.00th=[ 271], 99.50th=[ 279], 99.90th=[ 326], 99.95th=[ 326], | 99.99th=[ 326] bw ( KiB/s): min= 31, max= 256, per=25.40%, avg=124.73, stdev=53.91, samples=100 iops : min= 1, max= 16, avg= 7.16, stdev= 3.49, samples=100 lat (msec) : 10=6.51%, 20=18.10%, 50=18.49%, 100=34.38%, 250=21.88% lat (msec) : 500=0.65% cpu : usr=0.04%, sys=1.90%, ctx=1391, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147262: Tue Jun 16 11:57:06 2026 read: IOPS=7, BW=112KiB/s (115kB/s)(5744KiB/51136msec) clat (msec): min=5, max=183, avg=28.04, stdev=27.93 lat (msec): min=5, max=183, avg=28.05, stdev=27.93 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 10], 20.00th=[ 12], | 30.00th=[ 14], 40.00th=[ 16], 50.00th=[ 18], 60.00th=[ 21], | 70.00th=[ 26], 80.00th=[ 36], 90.00th=[ 63], 95.00th=[ 89], | 99.00th=[ 144], 99.50th=[ 161], 99.90th=[ 184], 99.95th=[ 184], | 99.99th=[ 184] bw ( KiB/s): min= 29, max= 414, per=25.65%, avg=119.78, stdev=81.69, samples=94 iops : min= 1, max= 25, avg= 6.85, stdev= 5.18, samples=94 write: IOPS=7, BW=128KiB/s (131kB/s)(6544KiB/51136msec); 0 zone resets clat (msec): min=31, max=323, avg=99.60, stdev=47.11 lat (msec): min=31, max=323, avg=99.60, stdev=47.11 clat percentiles (msec): | 1.00th=[ 37], 5.00th=[ 48], 10.00th=[ 56], 20.00th=[ 64], | 30.00th=[ 72], 40.00th=[ 80], 50.00th=[ 87], 60.00th=[ 99], | 70.00th=[ 109], 80.00th=[ 129], 90.00th=[ 161], 95.00th=[ 199], | 99.00th=[ 255], 99.50th=[ 279], 99.90th=[ 326], 99.95th=[ 326], | 99.99th=[ 326] bw ( KiB/s): min= 31, max= 287, per=26.18%, avg=128.55, stdev=56.72, samples=100 iops : min= 1, max= 17, avg= 7.40, stdev= 3.68, samples=100 lat (msec) : 10=4.82%, 20=22.79%, 50=15.49%, 100=35.16%, 250=20.96% lat (msec) : 500=0.78% cpu : usr=0.02%, sys=1.74%, ctx=1323, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147264: Tue Jun 16 11:57:06 2026 read: IOPS=8, BW=128KiB/s (131kB/s)(6256KiB/48722msec) clat (msec): min=5, max=281, avg=28.87, stdev=29.02 lat (msec): min=5, max=281, avg=28.87, stdev=29.02 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 13], | 30.00th=[ 15], 40.00th=[ 17], 50.00th=[ 21], 60.00th=[ 23], | 70.00th=[ 28], 80.00th=[ 38], 90.00th=[ 57], 95.00th=[ 75], | 99.00th=[ 155], 99.50th=[ 236], 99.90th=[ 284], 99.95th=[ 284], | 99.99th=[ 284] bw ( KiB/s): min= 31, max= 352, per=29.20%, avg=136.34, stdev=85.61, samples=91 iops : min= 1, max= 22, avg= 7.89, stdev= 5.44, samples=91 write: IOPS=7, BW=124KiB/s (127kB/s)(6032KiB/48722msec); 0 zone resets clat (msec): min=31, max=380, avg=98.67, stdev=45.22 lat (msec): min=31, max=380, avg=98.67, stdev=45.22 clat percentiles (msec): | 1.00th=[ 40], 5.00th=[ 48], 10.00th=[ 54], 20.00th=[ 64], | 30.00th=[ 70], 40.00th=[ 79], 50.00th=[ 86], 60.00th=[ 97], | 70.00th=[ 113], 80.00th=[ 134], 90.00th=[ 159], 95.00th=[ 188], | 99.00th=[ 236], 99.50th=[ 264], 99.90th=[ 380], 99.95th=[ 380], | 99.99th=[ 380] bw ( KiB/s): min= 30, max= 254, per=25.10%, avg=123.24, stdev=53.00, samples=96 iops : min= 1, max= 15, avg= 7.05, stdev= 3.44, samples=96 lat (msec) : 10=4.43%, 20=20.83%, 50=22.01%, 100=33.20%, 250=19.14% lat (msec) : 500=0.39% cpu : usr=0.05%, sys=2.02%, ctx=1415, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147266: Tue Jun 16 11:57:06 2026 read: IOPS=7, BW=120KiB/s (123kB/s)(6032KiB/50142msec) clat (msec): min=6, max=268, avg=28.98, stdev=29.43 lat (msec): min=6, max=268, avg=28.98, stdev=29.43 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 13], | 30.00th=[ 15], 40.00th=[ 16], 50.00th=[ 19], 60.00th=[ 22], | 70.00th=[ 27], 80.00th=[ 39], 90.00th=[ 64], 95.00th=[ 101], | 99.00th=[ 148], 99.50th=[ 163], 99.90th=[ 268], 99.95th=[ 268], | 99.99th=[ 268] bw ( KiB/s): min= 30, max= 319, per=27.10%, avg=126.57, stdev=72.18, samples=93 iops : min= 1, max= 19, avg= 7.28, stdev= 4.58, samples=93 write: IOPS=7, BW=125KiB/s (128kB/s)(6256KiB/50142msec); 0 zone resets clat (msec): min=36, max=347, avg=100.10, stdev=47.13 lat (msec): min=36, max=347, avg=100.11, stdev=47.13 clat percentiles (msec): | 1.00th=[ 47], 5.00th=[ 53], 10.00th=[ 57], 20.00th=[ 65], | 30.00th=[ 71], 40.00th=[ 79], 50.00th=[ 87], 60.00th=[ 96], | 70.00th=[ 108], 80.00th=[ 128], 90.00th=[ 165], 95.00th=[ 188], | 99.00th=[ 284], 99.50th=[ 330], 99.90th=[ 347], 99.95th=[ 347], | 99.99th=[ 347] bw ( KiB/s): min= 31, max= 254, per=25.37%, avg=124.58, stdev=55.20, samples=99 iops : min= 1, max= 15, avg= 7.15, stdev= 3.57, samples=99 lat (msec) : 10=4.82%, 20=23.44%, 50=15.89%, 100=35.55%, 250=19.27% lat (msec) : 500=1.04% cpu : usr=0.05%, sys=1.82%, ctx=1338, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=468KiB/s (479kB/s), 112KiB/s-128KiB/s (115kB/s-131kB/s), io=23.4MiB (24.5MB), run=48722-51225msec WRITE: bw=492KiB/s (504kB/s), 124KiB/s-128KiB/s (127kB/s-131kB/s), io=24.6MiB (25.8MB), run=48722-51225msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=147279: Tue Jun 16 11:57:16 2026 read: IOPS=2, BW=2663KiB/s (2727kB/s)(7168KiB/2692msec) clat (msec): min=51, max=530, avg=210.66, stdev=197.37 lat (msec): min=51, max=530, avg=210.66, stdev=197.37 clat percentiles (msec): | 1.00th=[ 52], 5.00th=[ 52], 10.00th=[ 52], 20.00th=[ 63], | 30.00th=[ 82], 40.00th=[ 82], 50.00th=[ 94], 60.00th=[ 213], | 70.00th=[ 213], 80.00th=[ 443], 90.00th=[ 531], 95.00th=[ 531], | 99.00th=[ 531], 99.50th=[ 531], 99.90th=[ 531], 99.95th=[ 531], | 99.99th=[ 531] bw ( KiB/s): min= 1928, max= 5505, per=48.36%, avg=2865.00, stdev=1760.58, samples=4 iops : min= 1, max= 5, avg= 2.00, stdev= 2.00, samples=4 write: IOPS=1, BW=1902KiB/s (1948kB/s)(5120KiB/2692msec); 0 zone resets clat (msec): min=204, max=270, avg=237.95, stdev=23.69 lat (msec): min=204, max=270, avg=238.04, stdev=23.69 clat percentiles (msec): | 1.00th=[ 205], 5.00th=[ 205], 10.00th=[ 205], 20.00th=[ 205], | 30.00th=[ 234], 40.00th=[ 234], 50.00th=[ 236], 60.00th=[ 236], | 70.00th=[ 245], 80.00th=[ 245], 90.00th=[ 271], 95.00th=[ 271], | 99.00th=[ 271], 99.50th=[ 271], 99.90th=[ 271], 99.95th=[ 271], | 99.99th=[ 271] bw ( KiB/s): min= 1835, max= 3976, per=29.76%, avg=2468.25, stdev=1009.43, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (msec) : 100=33.33%, 250=41.67%, 500=16.67%, 750=8.33% cpu : usr=0.04%, sys=5.57%, ctx=69, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147280: Tue Jun 16 11:57:16 2026 read: IOPS=0, BW=592KiB/s (607kB/s)(2048KiB/3457msec) clat (msec): min=86, max=299, avg=193.14, stdev=150.61 lat (msec): min=86, max=299, avg=193.14, stdev=150.61 clat percentiles (msec): | 1.00th=[ 87], 5.00th=[ 87], 10.00th=[ 87], 20.00th=[ 87], | 30.00th=[ 87], 40.00th=[ 87], 50.00th=[ 87], 60.00th=[ 300], | 70.00th=[ 300], 80.00th=[ 300], 90.00th=[ 300], 95.00th=[ 300], | 99.00th=[ 300], 99.50th=[ 300], 99.90th=[ 300], 99.95th=[ 300], | 99.99th=[ 300] bw ( KiB/s): min= 1868, max= 2023, per=32.84%, avg=1945.50, stdev=109.60, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2962KiB/s (3033kB/s)(10.0MiB/3457msec); 0 zone resets clat (msec): min=128, max=665, avg=297.07, stdev=156.98 lat (msec): min=128, max=666, avg=297.19, stdev=156.98 clat percentiles (msec): | 1.00th=[ 129], 5.00th=[ 129], 10.00th=[ 129], 20.00th=[ 144], | 30.00th=[ 155], 40.00th=[ 262], 50.00th=[ 279], 60.00th=[ 292], | 70.00th=[ 305], 80.00th=[ 372], 90.00th=[ 372], 95.00th=[ 667], | 99.00th=[ 667], 99.50th=[ 667], 99.90th=[ 667], 99.95th=[ 667], | 99.99th=[ 667] bw ( KiB/s): min= 1868, max= 4096, per=31.89%, avg=2645.00, stdev=1035.51, samples=6 iops : min= 1, max= 4, avg= 1.83, stdev= 1.33, samples=6 lat (msec) : 100=8.33%, 250=25.00%, 500=58.33%, 750=8.33% cpu : usr=0.03%, sys=7.78%, ctx=135, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147281: Tue Jun 16 11:57:16 2026 read: IOPS=1, BW=1850KiB/s (1894kB/s)(6144KiB/3321msec) clat (msec): min=65, max=233, avg=123.46, stdev=63.95 lat (msec): min=65, max=233, avg=123.46, stdev=63.95 clat percentiles (msec): | 1.00th=[ 66], 5.00th=[ 66], 10.00th=[ 66], 20.00th=[ 79], | 30.00th=[ 79], 40.00th=[ 100], 50.00th=[ 100], 60.00th=[ 101], | 70.00th=[ 165], 80.00th=[ 165], 90.00th=[ 234], 95.00th=[ 234], | 99.00th=[ 234], 99.50th=[ 234], 99.90th=[ 234], 99.95th=[ 234], | 99.99th=[ 234] bw ( KiB/s): min= 2048, max= 4047, per=56.67%, avg=3357.00, stdev=1134.18, samples=3 iops : min= 2, max= 3, avg= 2.67, stdev= 0.58, samples=3 write: IOPS=1, BW=1850KiB/s (1894kB/s)(6144KiB/3321msec); 0 zone resets clat (msec): min=292, max=628, avg=414.95, stdev=140.23 lat (msec): min=292, max=628, avg=415.04, stdev=140.22 clat percentiles (msec): | 1.00th=[ 292], 5.00th=[ 292], 10.00th=[ 292], 20.00th=[ 300], | 30.00th=[ 300], 40.00th=[ 305], 50.00th=[ 305], 60.00th=[ 447], | 70.00th=[ 518], 80.00th=[ 518], 90.00th=[ 625], 95.00th=[ 625], | 99.00th=[ 625], 99.50th=[ 625], 99.90th=[ 625], 99.95th=[ 625], | 99.99th=[ 625] bw ( KiB/s): min= 1771, max= 2048, per=23.57%, avg=1954.80, stdev=113.33, samples=5 iops : min= 1, max= 2, avg= 1.20, stdev= 0.45, samples=5 lat (msec) : 100=25.00%, 250=25.00%, 500=33.33%, 750=16.67% cpu : usr=0.03%, sys=5.30%, ctx=68, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147282: Tue Jun 16 11:57:16 2026 read: IOPS=1, BW=1998KiB/s (2046kB/s)(5120KiB/2563msec) clat (msec): min=88, max=389, avg=187.46, stdev=123.92 lat (msec): min=88, max=389, avg=187.46, stdev=123.92 clat percentiles (msec): | 1.00th=[ 89], 5.00th=[ 89], 10.00th=[ 89], 20.00th=[ 89], | 30.00th=[ 101], 40.00th=[ 101], 50.00th=[ 142], 60.00th=[ 142], | 70.00th=[ 218], 80.00th=[ 218], 90.00th=[ 388], 95.00th=[ 388], | 99.00th=[ 388], 99.50th=[ 388], 99.90th=[ 388], 99.95th=[ 388], | 99.99th=[ 388] bw ( KiB/s): min= 7953, max= 7953, per=100.00%, avg=7953.00, stdev= 0.00, samples=1 iops : min= 7, max= 7, avg= 7.00, stdev= 0.00, samples=1 write: IOPS=2, BW=2797KiB/s (2864kB/s)(7168KiB/2563msec); 0 zone resets clat (msec): min=140, max=299, avg=213.33, stdev=56.80 lat (msec): min=141, max=299, avg=213.46, stdev=56.79 clat percentiles (msec): | 1.00th=[ 142], 5.00th=[ 142], 10.00th=[ 142], 20.00th=[ 161], | 30.00th=[ 203], 40.00th=[ 203], 50.00th=[ 207], 60.00th=[ 207], | 70.00th=[ 207], 80.00th=[ 275], 90.00th=[ 300], 95.00th=[ 300], | 99.00th=[ 300], 99.50th=[ 300], 99.90th=[ 300], 99.95th=[ 300], | 99.99th=[ 300] bw ( KiB/s): min= 3624, max= 4079, per=46.46%, avg=3853.00, stdev=227.51, samples=3 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=3 lat (msec) : 100=8.33%, 250=66.67%, 500=25.00% cpu : usr=0.04%, sys=4.45%, ctx=69, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5924KiB/s (6066kB/s), 592KiB/s-2663KiB/s (607kB/s-2727kB/s), io=20.0MiB (20.0MB), run=2563-3457msec WRITE: bw=8294KiB/s (8493kB/s), 1850KiB/s-2962KiB/s (1894kB/s-3033kB/s), io=28.0MiB (29.4MB), run=2563-3457msec rand-rw: (groupid=0, jobs=1): err= 0: pid=147284: Tue Jun 16 11:57:16 2026 read: IOPS=2, BW=2876KiB/s (2945kB/s)(7168KiB/2492msec) clat (msec): min=2, max=316, avg=158.97, stdev=94.57 lat (msec): min=2, max=316, avg=158.97, stdev=94.57 clat percentiles (msec): | 1.00th=[ 3], 5.00th=[ 3], 10.00th=[ 3], 20.00th=[ 112], | 30.00th=[ 148], 40.00th=[ 148], 50.00th=[ 155], 60.00th=[ 186], | 70.00th=[ 186], 80.00th=[ 194], 90.00th=[ 317], 95.00th=[ 317], | 99.00th=[ 317], 99.50th=[ 317], 99.90th=[ 317], 99.95th=[ 317], | 99.99th=[ 317] bw ( KiB/s): min= 3792, max= 6107, per=82.37%, avg=4949.50, stdev=1636.95, samples=2 iops : min= 3, max= 5, avg= 4.00, stdev= 1.41, samples=2 write: IOPS=2, BW=2055KiB/s (2104kB/s)(5120KiB/2492msec); 0 zone resets clat (msec): min=126, max=333, avg=252.58, stdev=95.26 lat (msec): min=127, max=333, avg=252.66, stdev=95.27 clat percentiles (msec): | 1.00th=[ 128], 5.00th=[ 128], 10.00th=[ 128], 20.00th=[ 128], | 30.00th=[ 174], 40.00th=[ 174], 50.00th=[ 309], 60.00th=[ 309], | 70.00th=[ 321], 80.00th=[ 321], 90.00th=[ 334], 95.00th=[ 334], | 99.00th=[ 334], 99.50th=[ 334], 99.90th=[ 334], 99.95th=[ 334], | 99.99th=[ 334] bw ( KiB/s): min= 2011, max= 4071, per=32.16%, avg=2705.67, stdev=1182.47, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (msec) : 4=8.33%, 250=58.33%, 500=33.33% cpu : usr=0.00%, sys=20.19%, ctx=305, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147285: Tue Jun 16 11:57:16 2026 read: IOPS=0, BW=601KiB/s (616kB/s)(2048KiB/3407msec) clat (msec): min=194, max=201, avg=198.13, stdev= 4.86 lat (msec): min=194, max=201, avg=198.13, stdev= 4.86 clat percentiles (msec): | 1.00th=[ 194], 5.00th=[ 194], 10.00th=[ 194], 20.00th=[ 194], | 30.00th=[ 194], 40.00th=[ 194], 50.00th=[ 194], 60.00th=[ 203], | 70.00th=[ 203], 80.00th=[ 203], 90.00th=[ 203], 95.00th=[ 203], | 99.00th=[ 203], 99.50th=[ 203], 99.90th=[ 203], 99.95th=[ 203], | 99.99th=[ 203] bw ( KiB/s): min= 1992, max= 2031, per=33.47%, avg=2011.50, stdev=27.58, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=3006KiB/s (3078kB/s)(10.0MiB/3407msec); 0 zone resets clat (msec): min=83, max=527, avg=284.74, stdev=171.07 lat (msec): min=84, max=527, avg=285.01, stdev=170.94 clat percentiles (msec): | 1.00th=[ 85], 5.00th=[ 85], 10.00th=[ 85], 20.00th=[ 120], | 30.00th=[ 133], 40.00th=[ 176], 50.00th=[ 211], 60.00th=[ 257], | 70.00th=[ 347], 80.00th=[ 485], 90.00th=[ 514], 95.00th=[ 527], | 99.00th=[ 527], 99.50th=[ 527], 99.90th=[ 527], 99.95th=[ 527], | 99.99th=[ 527] bw ( KiB/s): min= 2011, max= 6131, per=48.39%, avg=4071.00, stdev=1681.98, samples=4 iops : min= 1, max= 5, avg= 3.00, stdev= 1.63, samples=4 lat (msec) : 100=8.33%, 250=50.00%, 500=25.00%, 750=16.67% cpu : usr=0.00%, sys=17.12%, ctx=210, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147286: Tue Jun 16 11:57:16 2026 read: IOPS=1, BW=1803KiB/s (1846kB/s)(6144KiB/3408msec) clat (usec): min=524, max=251214, avg=128162.11, stdev=110956.98 lat (usec): min=526, max=251216, avg=128163.25, stdev=110956.70 clat percentiles (usec): | 1.00th=[ 529], 5.00th=[ 529], 10.00th=[ 529], 20.00th=[ 1532], | 30.00th=[ 1532], 40.00th=[116917], 50.00th=[116917], 60.00th=[154141], | 70.00th=[242222], 80.00th=[242222], 90.00th=[250610], 95.00th=[250610], | 99.00th=[250610], 99.50th=[250610], 99.90th=[250610], 99.95th=[250610], | 99.99th=[250610] bw ( KiB/s): min= 2011, max= 4063, per=42.24%, avg=2538.00, stdev=1016.76, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 write: IOPS=1, BW=1803KiB/s (1846kB/s)(6144KiB/3408msec); 0 zone resets clat (msec): min=258, max=633, avg=416.11, stdev=128.24 lat (msec): min=258, max=633, avg=416.17, stdev=128.24 clat percentiles (msec): | 1.00th=[ 259], 5.00th=[ 259], 10.00th=[ 259], 20.00th=[ 330], | 30.00th=[ 330], 40.00th=[ 388], 50.00th=[ 388], 60.00th=[ 430], | 70.00th=[ 456], 80.00th=[ 456], 90.00th=[ 634], 95.00th=[ 634], | 99.00th=[ 634], 99.50th=[ 634], 99.90th=[ 634], 99.95th=[ 634], | 99.99th=[ 634] bw ( KiB/s): min= 1872, max= 2043, per=23.75%, avg=1998.40, stdev=71.64, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 lat (usec) : 750=8.33% lat (msec) : 2=8.33%, 250=25.00%, 500=50.00%, 750=8.33% cpu : usr=0.06%, sys=14.62%, ctx=224, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147287: Tue Jun 16 11:57:16 2026 read: IOPS=1, BW=1950KiB/s (1997kB/s)(5120KiB/2625msec) clat (usec): min=583, max=188132, avg=95654.97, stdev=92537.90 lat (usec): min=584, max=188133, avg=95656.21, stdev=92537.78 clat percentiles (usec): | 1.00th=[ 586], 5.00th=[ 586], 10.00th=[ 586], 20.00th=[ 586], | 30.00th=[ 725], 40.00th=[ 725], 50.00th=[106431], 60.00th=[106431], | 70.00th=[183501], 80.00th=[183501], 90.00th=[187696], 95.00th=[187696], | 99.00th=[187696], 99.50th=[187696], 99.90th=[187696], 99.95th=[187696], | 99.99th=[187696] bw ( KiB/s): min= 4063, max= 4071, per=67.68%, avg=4067.00, stdev= 5.66, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2731KiB/s (2796kB/s)(7168KiB/2625msec); 0 zone resets clat (msec): min=138, max=581, avg=298.23, stdev=161.99 lat (msec): min=138, max=584, avg=298.79, stdev=162.96 clat percentiles (msec): | 1.00th=[ 138], 5.00th=[ 138], 10.00th=[ 138], 20.00th=[ 192], | 30.00th=[ 224], 40.00th=[ 224], 50.00th=[ 236], 60.00th=[ 251], | 70.00th=[ 251], 80.00th=[ 468], 90.00th=[ 584], 95.00th=[ 584], | 99.00th=[ 584], 99.50th=[ 584], 99.90th=[ 584], 99.95th=[ 584], | 99.99th=[ 584] bw ( KiB/s): min= 1906, max= 4063, per=28.65%, avg=2410.00, stdev=925.59, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 lat (usec) : 750=16.67% lat (msec) : 250=58.33%, 500=16.67%, 750=8.33% cpu : usr=0.00%, sys=20.54%, ctx=158, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=6009KiB/s (6154kB/s), 601KiB/s-2876KiB/s (616kB/s-2945kB/s), io=20.0MiB (20.0MB), run=2492-3408msec WRITE: bw=8413KiB/s (8615kB/s), 1803KiB/s-3006KiB/s (1846kB/s-3078kB/s), io=28.0MiB (29.4MB), run=2492-3408msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=147292: Tue Jun 16 11:57:26 2026 read: IOPS=1, BW=5629KiB/s (5764kB/s)(12.0MiB/2183msec) clat (msec): min=586, max=756, avg=675.31, stdev=85.56 lat (msec): min=586, max=756, avg=675.31, stdev=85.56 clat percentiles (msec): | 1.00th=[ 584], 5.00th=[ 584], 10.00th=[ 584], 20.00th=[ 584], | 30.00th=[ 584], 40.00th=[ 684], 50.00th=[ 684], 60.00th=[ 684], | 70.00th=[ 760], 80.00th=[ 760], 90.00th=[ 760], 95.00th=[ 760], | 99.00th=[ 760], 99.50th=[ 760], 99.90th=[ 760], 99.95th=[ 760], | 99.99th=[ 760] bw ( KiB/s): min= 7968, max= 8192, per=100.00%, avg=8080.00, stdev=158.39, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 750=66.67%, 1000=33.33% cpu : usr=0.05%, sys=20.94%, ctx=732, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147293: Tue Jun 16 11:57:26 2026 read: IOPS=0, BW=1801KiB/s (1844kB/s)(4096KiB/2274msec) clat (nsec): min=595314k, max=595314k, avg=595314181.00, stdev= 0.00 lat (nsec): min=595315k, max=595315k, avg=595315018.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 592], 5.00th=[ 592], 10.00th=[ 592], 20.00th=[ 592], | 30.00th=[ 592], 40.00th=[ 592], 50.00th=[ 592], 60.00th=[ 592], | 70.00th=[ 592], 80.00th=[ 592], 90.00th=[ 592], 95.00th=[ 592], | 99.00th=[ 592], 99.50th=[ 592], 99.90th=[ 592], 99.95th=[ 592], | 99.99th=[ 592] bw ( KiB/s): min= 8192, max= 8192, per=100.00%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 write: IOPS=0, BW=3602KiB/s (3689kB/s)(8192KiB/2274msec); 0 zone resets clat (msec): min=570, max=953, avg=761.79, stdev=271.06 lat (msec): min=570, max=954, avg=762.45, stdev=270.91 clat percentiles (msec): | 1.00th=[ 567], 5.00th=[ 567], 10.00th=[ 567], 20.00th=[ 567], | 30.00th=[ 567], 40.00th=[ 567], 50.00th=[ 567], 60.00th=[ 953], | 70.00th=[ 953], 80.00th=[ 953], 90.00th=[ 953], 95.00th=[ 953], | 99.00th=[ 953], 99.50th=[ 953], 99.90th=[ 953], 99.95th=[ 953], | 99.99th=[ 953] bw ( KiB/s): min= 7968, max= 7968, per=60.55%, avg=7968.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=66.67%, 1000=33.33% cpu : usr=0.09%, sys=9.37%, ctx=226, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147294: Tue Jun 16 11:57:26 2026 write: IOPS=1, BW=4935KiB/s (5053kB/s)(12.0MiB/2490msec); 0 zone resets clat (msec): min=750, max=811, avg=783.81, stdev=31.19 lat (msec): min=751, max=813, avg=786.76, stdev=32.20 clat percentiles (msec): | 1.00th=[ 751], 5.00th=[ 751], 10.00th=[ 751], 20.00th=[ 751], | 30.00th=[ 751], 40.00th=[ 793], 50.00th=[ 793], 60.00th=[ 793], | 70.00th=[ 810], 80.00th=[ 810], 90.00th=[ 810], 95.00th=[ 810], | 99.00th=[ 810], 99.50th=[ 810], 99.90th=[ 810], 99.95th=[ 810], | 99.99th=[ 810] bw ( KiB/s): min= 8094, max= 8192, per=61.88%, avg=8143.00, stdev=69.30, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 1000=100.00% cpu : usr=0.00%, sys=11.57%, ctx=79, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147295: Tue Jun 16 11:57:26 2026 write: IOPS=1, BW=6474KiB/s (6630kB/s)(12.0MiB/1898msec); 0 zone resets clat (msec): min=245, max=1293, avg=596.89, stdev=603.60 lat (msec): min=245, max=1294, avg=597.16, stdev=603.55 clat percentiles (msec): | 1.00th=[ 245], 5.00th=[ 245], 10.00th=[ 245], 20.00th=[ 245], | 30.00th=[ 245], 40.00th=[ 253], 50.00th=[ 253], 60.00th=[ 253], | 70.00th=[ 1301], 80.00th=[ 1301], 90.00th=[ 1301], 95.00th=[ 1301], | 99.00th=[ 1301], 99.50th=[ 1301], 99.90th=[ 1301], 99.95th=[ 1301], | 99.99th=[ 1301] bw ( KiB/s): min= 7185, max= 8192, per=58.43%, avg=7688.50, stdev=712.06, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 250=33.33%, 500=33.33%, 2000=33.33% cpu : usr=0.00%, sys=8.17%, ctx=39, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=7205KiB/s (7378kB/s), 1801KiB/s-5629KiB/s (1844kB/s-5764kB/s), io=16.0MiB (16.8MB), run=2183-2274msec WRITE: bw=12.9MiB/s (13.5MB/s), 3602KiB/s-6474KiB/s (3689kB/s-6630kB/s), io=32.0MiB (33.6MB), run=1898-2490msec rand-rw: (groupid=0, jobs=1): err= 0: pid=147297: Tue Jun 16 11:57:26 2026 read: IOPS=1, BW=5375KiB/s (5504kB/s)(12.0MiB/2286msec) clat (msec): min=375, max=1142, avg=761.74, stdev=383.67 lat (msec): min=375, max=1142, avg=761.75, stdev=383.67 clat percentiles (msec): | 1.00th=[ 376], 5.00th=[ 376], 10.00th=[ 376], 20.00th=[ 376], | 30.00th=[ 376], 40.00th=[ 768], 50.00th=[ 768], 60.00th=[ 768], | 70.00th=[ 1150], 80.00th=[ 1150], 90.00th=[ 1150], 95.00th=[ 1150], | 99.00th=[ 1150], 99.50th=[ 1150], 99.90th=[ 1150], 99.95th=[ 1150], | 99.99th=[ 1150] bw ( KiB/s): min= 8110, max= 8175, per=100.00%, avg=8142.50, stdev=45.96, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=4.16%, ctx=37, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147298: Tue Jun 16 11:57:26 2026 read: IOPS=0, BW=1908KiB/s (1954kB/s)(4096KiB/2147msec) clat (nsec): min=975030k, max=975030k, avg=975029999.00, stdev= 0.00 lat (nsec): min=975032k, max=975032k, avg=975032046.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 978], 5.00th=[ 978], 10.00th=[ 978], 20.00th=[ 978], | 30.00th=[ 978], 40.00th=[ 978], 50.00th=[ 978], 60.00th=[ 978], | 70.00th=[ 978], 80.00th=[ 978], 90.00th=[ 978], 95.00th=[ 978], | 99.00th=[ 978], 99.50th=[ 978], 99.90th=[ 978], 99.95th=[ 978], | 99.99th=[ 978] bw ( KiB/s): min= 8143, max= 8143, per=100.00%, avg=8143.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=3816KiB/s (3907kB/s)(8192KiB/2147msec); 0 zone resets clat (msec): min=348, max=819, avg=584.19, stdev=333.13 lat (msec): min=348, max=821, avg=585.28, stdev=334.15 clat percentiles (msec): | 1.00th=[ 351], 5.00th=[ 351], 10.00th=[ 351], 20.00th=[ 351], | 30.00th=[ 351], 40.00th=[ 351], 50.00th=[ 351], 60.00th=[ 818], | 70.00th=[ 818], 80.00th=[ 818], 90.00th=[ 818], 95.00th=[ 818], | 99.00th=[ 818], 99.50th=[ 818], 99.90th=[ 818], 99.95th=[ 818], | 99.99th=[ 818] bw ( KiB/s): min= 8110, max= 8110, per=54.75%, avg=8110.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 1000=66.67% cpu : usr=0.00%, sys=8.85%, ctx=62, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147299: Tue Jun 16 11:57:26 2026 write: IOPS=1, BW=5555KiB/s (5688kB/s)(12.0MiB/2212msec); 0 zone resets clat (msec): min=618, max=828, avg=735.52, stdev=107.02 lat (msec): min=618, max=828, avg=736.00, stdev=107.04 clat percentiles (msec): | 1.00th=[ 617], 5.00th=[ 617], 10.00th=[ 617], 20.00th=[ 617], | 30.00th=[ 617], 40.00th=[ 760], 50.00th=[ 760], 60.00th=[ 760], | 70.00th=[ 827], 80.00th=[ 827], 90.00th=[ 827], 95.00th=[ 827], | 99.00th=[ 827], 99.50th=[ 827], 99.90th=[ 827], 99.95th=[ 827], | 99.99th=[ 827] bw ( KiB/s): min= 8143, max= 8175, per=55.08%, avg=8159.00, stdev=22.63, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 1000=66.67% cpu : usr=0.00%, sys=6.42%, ctx=43, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147300: Tue Jun 16 11:57:26 2026 write: IOPS=1, BW=7078KiB/s (7248kB/s)(12.0MiB/1736msec); 0 zone resets clat (msec): min=216, max=949, avg=576.33, stdev=366.64 lat (msec): min=216, max=949, avg=578.08, stdev=366.50 clat percentiles (msec): | 1.00th=[ 218], 5.00th=[ 218], 10.00th=[ 218], 20.00th=[ 218], | 30.00th=[ 218], 40.00th=[ 567], 50.00th=[ 567], 60.00th=[ 567], | 70.00th=[ 953], 80.00th=[ 953], 90.00th=[ 953], 95.00th=[ 953], | 99.00th=[ 953], 99.50th=[ 953], 99.90th=[ 953], 99.95th=[ 953], | 99.99th=[ 953] bw ( KiB/s): min= 7098, max= 8143, per=51.44%, avg=7620.50, stdev=738.93, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 250=33.33%, 750=33.33%, 1000=33.33% cpu : usr=0.00%, sys=7.32%, ctx=29, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=7167KiB/s (7339kB/s), 1908KiB/s-5375KiB/s (1954kB/s-5504kB/s), io=16.0MiB (16.8MB), run=2147-2286msec WRITE: bw=14.5MiB/s (15.2MB/s), 3816KiB/s-7078KiB/s (3907kB/s-7248kB/s), io=32.0MiB (33.6MB), run=1736-2212msec