== sanity test 398b: DIO and buffer IO race ============== 16:16:14 (1775765774) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 6.55293 s, 7.7 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=180655: Thu Apr 9 16:18:35 2026 read: IOPS=12, BW=51.6KiB/s (52.9kB/s)(5992KiB/116023msec) clat (usec): min=40, max=218502, avg=42643.63, stdev=26417.73 lat (usec): min=45, max=218503, avg=42645.10, stdev=26417.70 clat percentiles (usec): | 1.00th=[ 52], 5.00th=[ 11207], 10.00th=[ 16581], 20.00th=[ 22414], | 30.00th=[ 27132], 40.00th=[ 31851], 50.00th=[ 37487], 60.00th=[ 43779], | 70.00th=[ 51643], 80.00th=[ 60031], 90.00th=[ 76022], 95.00th=[ 88605], | 99.00th=[128451], 99.50th=[154141], 99.90th=[200279], 99.95th=[219153], | 99.99th=[219153] bw ( KiB/s): min= 15, max= 127, per=25.68%, avg=51.36, stdev=20.39, samples=228 iops : min= 3, max= 31, avg=12.19, stdev= 5.13, samples=228 write: IOPS=13, BW=54.3KiB/s (55.6kB/s)(6296KiB/116023msec); 0 zone resets clat (usec): min=864, max=825583, avg=32864.85, stdev=39282.84 lat (usec): min=865, max=825584, avg=32868.54, stdev=39281.56 clat percentiles (usec): | 1.00th=[ 1156], 5.00th=[ 1336], 10.00th=[ 1500], 20.00th=[ 3556], | 30.00th=[ 6783], 40.00th=[ 14353], 50.00th=[ 23200], 60.00th=[ 31851], | 70.00th=[ 42206], 80.00th=[ 56886], 90.00th=[ 77071], 95.00th=[ 95945], | 99.00th=[164627], 99.50th=[189793], 99.90th=[252707], 99.95th=[826278], | 99.99th=[826278] bw ( KiB/s): min= 7, max= 144, per=25.93%, avg=54.20, stdev=23.95, samples=227 iops : min= 1, max= 36, avg=12.90, stdev= 6.05, samples=227 lat (usec) : 50=0.20%, 100=1.53%, 250=0.07%, 500=0.03%, 750=0.03% lat (usec) : 1000=0.16% lat (msec) : 2=6.64%, 4=4.43%, 10=7.62%, 20=10.32%, 50=40.62% lat (msec) : 100=24.64%, 250=3.65%, 500=0.03%, 1000=0.03% cpu : usr=0.06%, sys=4.84%, ctx=6442, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180657: Thu Apr 9 16:18:35 2026 read: IOPS=12, BW=50.5KiB/s (51.7kB/s)(5940KiB/117664msec) clat (usec): min=38, max=198672, avg=43829.40, stdev=26710.73 lat (usec): min=39, max=198673, avg=43834.82, stdev=26706.75 clat percentiles (usec): | 1.00th=[ 53], 5.00th=[ 13829], 10.00th=[ 17433], 20.00th=[ 22676], | 30.00th=[ 27919], 40.00th=[ 33424], 50.00th=[ 39060], 60.00th=[ 44827], | 70.00th=[ 52691], 80.00th=[ 61604], 90.00th=[ 76022], 95.00th=[ 90702], | 99.00th=[147850], 99.50th=[162530], 99.90th=[187696], 99.95th=[198181], | 99.99th=[198181] bw ( KiB/s): min= 7, max= 103, per=25.08%, avg=50.16, stdev=18.88, samples=231 iops : min= 1, max= 25, avg=11.88, stdev= 4.75, samples=231 write: IOPS=13, BW=53.0KiB/s (55.2kB/s)(6348KiB/117664msec); 0 zone resets clat (usec): min=993, max=862477, avg=32850.78, stdev=38874.74 lat (usec): min=995, max=862478, avg=32852.45, stdev=38874.58 clat percentiles (usec): | 1.00th=[ 1188], 5.00th=[ 1319], 10.00th=[ 1860], 20.00th=[ 3720], | 30.00th=[ 6521], 40.00th=[ 14222], 50.00th=[ 23200], 60.00th=[ 32637], | 70.00th=[ 42206], 80.00th=[ 56361], 90.00th=[ 79168], 95.00th=[ 99091], | 99.00th=[143655], 99.50th=[164627], 99.90th=[223347], 99.95th=[859833], | 99.99th=[859833] bw ( KiB/s): min= 7, max= 135, per=25.57%, avg=53.43, stdev=22.69, samples=231 iops : min= 1, max= 33, avg=12.71, stdev= 5.71, samples=231 lat (usec) : 50=0.23%, 100=1.17%, 250=0.03%, 500=0.03%, 1000=0.03% lat (msec) : 2=5.44%, 4=5.79%, 10=7.75%, 20=10.58%, 50=40.95% lat (msec) : 100=24.12%, 250=3.84%, 1000=0.03% cpu : usr=0.08%, sys=4.81%, ctx=6585, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180658: Thu Apr 9 16:18:35 2026 read: IOPS=12, BW=51.5KiB/s (52.8kB/s)(6028KiB/116963msec) clat (usec): min=39, max=299190, avg=43043.48, stdev=27607.71 lat (usec): min=39, max=299192, avg=43050.01, stdev=27606.85 clat percentiles (usec): | 1.00th=[ 52], 5.00th=[ 11076], 10.00th=[ 16909], 20.00th=[ 22414], | 30.00th=[ 27657], 40.00th=[ 32375], 50.00th=[ 38536], 60.00th=[ 43779], | 70.00th=[ 51643], 80.00th=[ 61080], 90.00th=[ 74974], 95.00th=[ 89654], | 99.00th=[132645], 99.50th=[160433], 99.90th=[227541], 99.95th=[299893], | 99.99th=[299893] bw ( KiB/s): min= 7, max= 103, per=25.69%, avg=51.38, stdev=20.17, samples=228 iops : min= 1, max= 25, avg=12.19, stdev= 5.09, samples=228 write: IOPS=13, BW=53.5KiB/s (54.8kB/s)(6260KiB/116963msec); 0 zone resets clat (usec): min=788, max=1023.6k, avg=32959.94, stdev=41573.87 lat (usec): min=788, max=1023.6k, avg=32967.40, stdev=41577.07 clat percentiles (usec): | 1.00th=[ 1156], 5.00th=[ 1336], 10.00th=[ 1614], | 20.00th=[ 3752], 30.00th=[ 7111], 40.00th=[ 15533], | 50.00th=[ 23725], 60.00th=[ 30802], 70.00th=[ 41157], | 80.00th=[ 54789], 90.00th=[ 79168], 95.00th=[ 99091], | 99.00th=[ 143655], 99.50th=[ 168821], 99.90th=[ 242222], | 99.95th=[1027605], 99.99th=[1027605] bw ( KiB/s): min= 7, max= 127, per=25.75%, avg=53.82, stdev=21.95, samples=226 iops : min= 1, max= 31, avg=12.80, stdev= 5.53, samples=226 lat (usec) : 50=0.29%, 100=1.73%, 250=0.03%, 500=0.10%, 1000=0.23% lat (msec) : 2=6.18%, 4=4.23%, 10=7.19%, 20=10.58%, 50=42.32% lat (msec) : 100=22.98%, 250=4.07%, 500=0.03%, 2000=0.03% cpu : usr=0.08%, sys=4.80%, ctx=6490, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180660: Thu Apr 9 16:18:35 2026 read: IOPS=12, BW=50.5KiB/s (51.7kB/s)(6052KiB/119956msec) clat (usec): min=33, max=298540, avg=43863.45, stdev=28401.34 lat (usec): min=33, max=298541, avg=43873.54, stdev=28396.03 clat percentiles (usec): | 1.00th=[ 53], 5.00th=[ 11207], 10.00th=[ 16188], 20.00th=[ 22414], | 30.00th=[ 26870], 40.00th=[ 32900], 50.00th=[ 38536], 60.00th=[ 43779], | 70.00th=[ 52167], 80.00th=[ 61604], 90.00th=[ 78119], 95.00th=[ 95945], | 99.00th=[135267], 99.50th=[154141], 99.90th=[244319], 99.95th=[299893], | 99.99th=[299893] bw ( KiB/s): min= 7, max= 127, per=25.16%, avg=50.32, stdev=20.11, samples=234 iops : min= 1, max= 31, avg=11.92, stdev= 5.07, samples=234 write: IOPS=12, BW=51.0KiB/s (53.2kB/s)(6236KiB/119956msec); 0 zone resets clat (usec): min=926, max=896805, avg=34037.67, stdev=40280.61 lat (usec): min=926, max=896806, avg=34039.77, stdev=40280.19 clat percentiles (usec): | 1.00th=[ 1172], 5.00th=[ 1336], 10.00th=[ 1696], 20.00th=[ 3785], | 30.00th=[ 7963], 40.00th=[ 16057], 50.00th=[ 23987], 60.00th=[ 32900], | 70.00th=[ 43254], 80.00th=[ 57410], 90.00th=[ 82314], 95.00th=[105382], | 99.00th=[152044], 99.50th=[162530], 99.90th=[206570], 99.95th=[893387], | 99.99th=[893387] bw ( KiB/s): min= 11, max= 142, per=24.67%, avg=51.57, stdev=22.15, samples=235 iops : min= 2, max= 35, avg=12.24, stdev= 5.57, samples=235 lat (usec) : 50=0.33%, 100=1.37%, 250=0.13%, 500=0.03%, 750=0.03% lat (usec) : 1000=0.03% lat (msec) : 2=6.22%, 4=4.39%, 10=6.45%, 20=11.46%, 50=41.28% lat (msec) : 100=23.18%, 250=5.05%, 500=0.03%, 1000=0.03% cpu : usr=0.07%, sys=4.82%, ctx=6596, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=200KiB/s (205kB/s), 50.5KiB/s-51.6KiB/s (51.7kB/s-52.9kB/s), io=23.4MiB (24.6MB), run=116023-119956msec WRITE: bw=210KiB/s (215kB/s), 51.0KiB/s-54.3KiB/s (53.2kB/s-55.6kB/s), io=24.6MiB (25.7MB), run=116023-119956msec rand-rw: (groupid=0, jobs=1): err= 0: pid=180654: Thu Apr 9 16:19:20 2026 read: IOPS=9, BW=36.5KiB/s (37.3kB/s)(5992KiB/164387msec) clat (msec): min=5, max=844, avg=42.74, stdev=40.94 lat (msec): min=5, max=844, avg=42.75, stdev=40.94 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 18], | 30.00th=[ 22], 40.00th=[ 26], 50.00th=[ 31], 60.00th=[ 38], | 70.00th=[ 47], 80.00th=[ 60], 90.00th=[ 90], 95.00th=[ 113], | 99.00th=[ 182], 99.50th=[ 224], 99.90th=[ 264], 99.95th=[ 844], | 99.99th=[ 844] bw ( KiB/s): min= 7, max= 159, per=25.33%, avg=36.73, stdev=23.71, samples=317 iops : min= 1, max= 39, avg= 8.51, stdev= 5.98, samples=317 write: IOPS=9, BW=38.3KiB/s (39.2kB/s)(6296KiB/164387msec); 0 zone resets clat (msec): min=10, max=348, avg=63.48, stdev=40.27 lat (msec): min=10, max=348, avg=63.49, stdev=40.27 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 21], 10.00th=[ 25], 20.00th=[ 32], | 30.00th=[ 39], 40.00th=[ 45], 50.00th=[ 52], 60.00th=[ 62], | 70.00th=[ 73], 80.00th=[ 92], 90.00th=[ 120], 95.00th=[ 144], | 99.00th=[ 201], 99.50th=[ 224], 99.90th=[ 305], 99.95th=[ 351], | 99.99th=[ 351] bw ( KiB/s): min= 7, max= 112, per=25.04%, avg=38.06, stdev=20.75, samples=321 iops : min= 1, max= 28, avg= 8.84, stdev= 5.23, samples=321 lat (msec) : 10=2.02%, 20=13.05%, 50=45.25%, 100=27.80%, 250=11.56% lat (msec) : 500=0.29%, 1000=0.03% cpu : usr=0.06%, sys=1.98%, ctx=4783, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180656: Thu Apr 9 16:19:20 2026 read: IOPS=8, BW=35.0KiB/s (36.8kB/s)(5940KiB/165183msec) clat (msec): min=4, max=851, avg=42.79, stdev=41.61 lat (msec): min=4, max=851, avg=42.79, stdev=41.61 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 17], | 30.00th=[ 22], 40.00th=[ 26], 50.00th=[ 32], 60.00th=[ 37], | 70.00th=[ 46], 80.00th=[ 58], 90.00th=[ 91], 95.00th=[ 120], | 99.00th=[ 182], 99.50th=[ 211], 99.90th=[ 292], 99.95th=[ 852], | 99.99th=[ 852] bw ( KiB/s): min= 7, max= 159, per=25.68%, avg=37.24, stdev=23.96, samples=309 iops : min= 1, max= 39, avg= 8.66, stdev= 6.03, samples=309 write: IOPS=9, BW=38.4KiB/s (39.4kB/s)(6348KiB/165183msec); 0 zone resets clat (msec): min=8, max=331, avg=63.74, stdev=42.25 lat (msec): min=8, max=331, avg=63.75, stdev=42.25 clat percentiles (msec): | 1.00th=[ 15], 5.00th=[ 21], 10.00th=[ 25], 20.00th=[ 32], | 30.00th=[ 38], 40.00th=[ 44], 50.00th=[ 52], 60.00th=[ 61], | 70.00th=[ 72], 80.00th=[ 91], 90.00th=[ 122], 95.00th=[ 146], | 99.00th=[ 220], 99.50th=[ 259], 99.90th=[ 313], 99.95th=[ 334], | 99.99th=[ 334] bw ( KiB/s): min= 7, max= 125, per=25.01%, avg=38.02, stdev=21.41, samples=323 iops : min= 1, max= 31, avg= 8.85, stdev= 5.40, samples=323 lat (msec) : 10=2.41%, 20=13.18%, 50=45.31%, 100=27.15%, 250=11.62% lat (msec) : 500=0.29%, 1000=0.03% cpu : usr=0.06%, sys=1.97%, ctx=4782, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180659: Thu Apr 9 16:19:20 2026 read: IOPS=9, BW=36.6KiB/s (37.5kB/s)(6028KiB/164760msec) clat (msec): min=5, max=233, avg=43.73, stdev=37.33 lat (msec): min=5, max=233, avg=43.74, stdev=37.33 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 14], 20.00th=[ 18], | 30.00th=[ 22], 40.00th=[ 26], 50.00th=[ 31], 60.00th=[ 37], | 70.00th=[ 47], 80.00th=[ 64], 90.00th=[ 94], 95.00th=[ 129], | 99.00th=[ 178], 99.50th=[ 211], 99.90th=[ 232], 99.95th=[ 234], | 99.99th=[ 234] bw ( KiB/s): min= 7, max= 167, per=25.37%, avg=36.78, stdev=22.82, samples=318 iops : min= 1, max= 41, avg= 8.53, stdev= 5.75, samples=318 write: IOPS=9, BW=37.0KiB/s (38.9kB/s)(6260KiB/164760msec); 0 zone resets clat (msec): min=11, max=977, avg=62.91, stdev=48.40 lat (msec): min=11, max=977, avg=62.92, stdev=48.39 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 21], 10.00th=[ 24], 20.00th=[ 30], | 30.00th=[ 36], 40.00th=[ 43], 50.00th=[ 50], 60.00th=[ 58], | 70.00th=[ 71], 80.00th=[ 88], 90.00th=[ 120], 95.00th=[ 150], | 99.00th=[ 211], 99.50th=[ 243], 99.90th=[ 363], 99.95th=[ 978], | 99.99th=[ 978] bw ( KiB/s): min= 7, max= 152, per=25.06%, avg=38.09, stdev=22.78, samples=319 iops : min= 1, max= 38, avg= 8.86, stdev= 5.74, samples=319 lat (msec) : 10=1.92%, 20=12.70%, 50=46.97%, 100=26.17%, 250=12.01% lat (msec) : 500=0.20%, 1000=0.03% cpu : usr=0.05%, sys=1.88%, ctx=4766, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180661: Thu Apr 9 16:19:20 2026 read: IOPS=9, BW=37.1KiB/s (38.0kB/s)(6052KiB/162974msec) clat (msec): min=5, max=319, avg=41.21, stdev=36.39 lat (msec): min=5, max=319, avg=41.22, stdev=36.39 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 17], | 30.00th=[ 21], 40.00th=[ 25], 50.00th=[ 29], 60.00th=[ 35], | 70.00th=[ 43], 80.00th=[ 56], 90.00th=[ 90], 95.00th=[ 123], | 99.00th=[ 169], 99.50th=[ 224], 99.90th=[ 268], 99.95th=[ 321], | 99.99th=[ 321] bw ( KiB/s): min= 7, max= 119, per=26.06%, avg=37.79, stdev=24.34, samples=312 iops : min= 1, max= 29, avg= 8.79, stdev= 6.11, samples=312 write: IOPS=9, BW=38.3KiB/s (39.2kB/s)(6236KiB/162974msec); 0 zone resets clat (msec): min=9, max=852, avg=64.21, stdev=46.15 lat (msec): min=9, max=852, avg=64.21, stdev=46.15 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 22], 10.00th=[ 26], 20.00th=[ 31], | 30.00th=[ 38], 40.00th=[ 44], 50.00th=[ 52], 60.00th=[ 62], | 70.00th=[ 73], 80.00th=[ 92], 90.00th=[ 121], 95.00th=[ 148], | 99.00th=[ 209], 99.50th=[ 243], 99.90th=[ 326], 99.95th=[ 852], | 99.99th=[ 852] bw ( KiB/s): min= 7, max= 127, per=25.02%, avg=38.04, stdev=21.94, samples=319 iops : min= 1, max= 31, avg= 8.85, stdev= 5.52, samples=319 lat (msec) : 10=2.08%, 20=13.70%, 50=46.09%, 100=25.81%, 250=12.01% lat (msec) : 500=0.26%, 1000=0.03% cpu : usr=0.05%, sys=1.94%, ctx=4677, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=145KiB/s (149kB/s), 35.0KiB/s-37.1KiB/s (36.8kB/s-38.0kB/s), io=23.4MiB (24.6MB), run=162974-165183msec WRITE: bw=152KiB/s (156kB/s), 37.0KiB/s-38.4KiB/s (38.9kB/s-39.4kB/s), io=24.6MiB (25.7MB), run=162974-165183msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=180705: Thu Apr 9 16:20:09 2026 read: IOPS=9, BW=153KiB/s (156kB/s)(5920KiB/38746msec) clat (usec): min=35, max=280244, avg=56255.46, stdev=39696.18 lat (usec): min=35, max=280245, avg=56256.74, stdev=39696.20 clat percentiles (usec): | 1.00th=[ 53], 5.00th=[ 64], 10.00th=[ 15401], 20.00th=[ 26346], | 30.00th=[ 33162], 40.00th=[ 40633], 50.00th=[ 50594], 60.00th=[ 58983], | 70.00th=[ 69731], 80.00th=[ 81265], 90.00th=[107480], 95.00th=[126354], | 99.00th=[198181], 99.50th=[246416], 99.90th=[278922], 99.95th=[278922], | 99.99th=[278922] bw ( KiB/s): min= 62, max= 412, per=24.99%, avg=151.95, stdev=59.20, samples=76 iops : min= 3, max= 25, avg= 8.70, stdev= 3.74, samples=76 write: IOPS=10, BW=164KiB/s (168kB/s)(6368KiB/38746msec); 0 zone resets clat (usec): min=1468, max=276848, avg=44909.79, stdev=44308.28 lat (usec): min=1470, max=276850, avg=44916.77, stdev=44307.59 clat percentiles (usec): | 1.00th=[ 1696], 5.00th=[ 2008], 10.00th=[ 3228], 20.00th=[ 7832], | 30.00th=[ 12780], 40.00th=[ 21890], 50.00th=[ 31589], 60.00th=[ 41681], | 70.00th=[ 58459], 80.00th=[ 77071], 90.00th=[105382], 95.00th=[135267], | 99.00th=[206570], 99.50th=[252707], 99.90th=[278922], 99.95th=[278922], | 99.99th=[278922] bw ( KiB/s): min= 31, max= 317, per=25.66%, avg=164.22, stdev=74.03, samples=76 iops : min= 1, max= 19, avg= 9.47, stdev= 4.70, samples=76 lat (usec) : 50=0.13%, 100=3.39%, 250=0.39%, 500=0.13% lat (msec) : 2=2.47%, 4=3.65%, 10=6.64%, 20=10.16%, 50=30.47% lat (msec) : 100=30.99%, 250=11.20%, 500=0.39% cpu : usr=0.04%, sys=4.81%, ctx=1688, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180706: Thu Apr 9 16:20:09 2026 read: IOPS=9, BW=146KiB/s (149kB/s)(5744KiB/39355msec) clat (usec): min=39, max=257569, avg=59456.52, stdev=42265.79 lat (usec): min=40, max=257570, avg=59458.20, stdev=42265.63 clat percentiles (usec): | 1.00th=[ 49], 5.00th=[ 62], 10.00th=[ 17695], 20.00th=[ 29492], | 30.00th=[ 36963], 40.00th=[ 45351], 50.00th=[ 51643], 60.00th=[ 60031], | 70.00th=[ 70779], 80.00th=[ 86508], 90.00th=[110625], 95.00th=[137364], | 99.00th=[217056], 99.50th=[250610], 99.90th=[256902], 99.95th=[256902], | 99.99th=[256902] bw ( KiB/s): min= 31, max= 314, per=23.76%, avg=144.44, stdev=65.50, samples=77 iops : min= 1, max= 19, avg= 8.22, stdev= 4.13, samples=77 write: IOPS=10, BW=166KiB/s (170kB/s)(6544KiB/39355msec); 0 zone resets clat (usec): min=1305, max=291827, avg=43962.86, stdev=43161.64 lat (usec): min=1307, max=291830, avg=43965.09, stdev=43161.63 clat percentiles (usec): | 1.00th=[ 1614], 5.00th=[ 2024], 10.00th=[ 3621], 20.00th=[ 7046], | 30.00th=[ 12649], 40.00th=[ 21890], 50.00th=[ 31065], 60.00th=[ 40109], | 70.00th=[ 54789], 80.00th=[ 77071], 90.00th=[104334], 95.00th=[126354], | 99.00th=[177210], 99.50th=[189793], 99.90th=[291505], 99.95th=[291505], | 99.99th=[291505] bw ( KiB/s): min= 30, max= 414, per=25.77%, avg=164.90, stdev=87.17, samples=77 iops : min= 1, max= 25, avg= 9.49, stdev= 5.49, samples=77 lat (usec) : 50=0.52%, 100=3.39%, 250=0.26% lat (msec) : 2=2.47%, 4=4.30%, 10=7.29%, 20=6.90%, 50=32.55% lat (msec) : 100=29.69%, 250=12.24%, 500=0.39% cpu : usr=0.05%, sys=4.39%, ctx=1602, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180709: Thu Apr 9 16:20:09 2026 read: IOPS=10, BW=163KiB/s (167kB/s)(6256KiB/38320msec) clat (usec): min=40, max=200868, avg=54443.22, stdev=34960.99 lat (usec): min=40, max=200869, avg=54542.35, stdev=35062.99 clat percentiles (usec): | 1.00th=[ 52], 5.00th=[ 68], 10.00th=[ 17433], 20.00th=[ 28443], | 30.00th=[ 33424], 40.00th=[ 41681], 50.00th=[ 50070], 60.00th=[ 56886], | 70.00th=[ 66323], 80.00th=[ 80217], 90.00th=[ 99091], 95.00th=[122160], | 99.00th=[166724], 99.50th=[198181], 99.90th=[200279], 99.95th=[200279], | 99.99th=[200279] bw ( KiB/s): min= 62, max= 380, per=26.88%, avg=163.40, stdev=71.88, samples=75 iops : min= 3, max= 23, avg= 9.43, stdev= 4.55, samples=75 write: IOPS=9, BW=157KiB/s (161kB/s)(6032KiB/38320msec); 0 zone resets clat (usec): min=1530, max=234819, avg=44952.29, stdev=42558.50 lat (usec): min=1531, max=234820, avg=44957.46, stdev=42556.97 clat percentiles (usec): | 1.00th=[ 1713], 5.00th=[ 2245], 10.00th=[ 3949], 20.00th=[ 8356], | 30.00th=[ 14484], 40.00th=[ 23462], 50.00th=[ 33162], 60.00th=[ 45351], | 70.00th=[ 57934], 80.00th=[ 73925], 90.00th=[104334], 95.00th=[125305], | 99.00th=[185598], 99.50th=[233833], 99.90th=[233833], 99.95th=[233833], | 99.99th=[233833] bw ( KiB/s): min= 31, max= 375, per=24.53%, avg=156.97, stdev=71.69, samples=74 iops : min= 1, max= 23, avg= 9.00, stdev= 4.54, samples=74 lat (usec) : 50=0.26%, 100=3.39%, 250=0.13%, 500=0.13%, 750=0.13% lat (msec) : 2=2.21%, 4=3.12%, 10=6.51%, 20=7.03%, 50=34.11% lat (msec) : 100=32.68%, 250=10.29% cpu : usr=0.06%, sys=4.83%, ctx=1663, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180710: Thu Apr 9 16:20:09 2026 read: IOPS=10, BW=161KiB/s (165kB/s)(6032KiB/37427msec) clat (usec): min=39, max=331299, avg=52100.95, stdev=38198.03 lat (usec): min=39, max=331300, avg=52141.31, stdev=38178.36 clat percentiles (usec): | 1.00th=[ 51], 5.00th=[ 63], 10.00th=[ 74], 20.00th=[ 23987], | 30.00th=[ 32113], 40.00th=[ 39584], 50.00th=[ 47973], 60.00th=[ 56361], | 70.00th=[ 66847], 80.00th=[ 78119], 90.00th=[ 98042], 95.00th=[114820], | 99.00th=[166724], 99.50th=[223347], 99.90th=[329253], 99.95th=[329253], | 99.99th=[329253] bw ( KiB/s): min= 31, max= 445, per=26.42%, avg=160.66, stdev=78.16, samples=73 iops : min= 1, max= 27, avg= 9.23, stdev= 4.90, samples=73 write: IOPS=10, BW=167KiB/s (171kB/s)(6256KiB/37427msec); 0 zone resets clat (usec): min=1325, max=224044, avg=45331.46, stdev=46955.01 lat (usec): min=1327, max=224067, avg=45367.96, stdev=46941.07 clat percentiles (usec): | 1.00th=[ 1680], 5.00th=[ 2057], 10.00th=[ 2999], 20.00th=[ 6980], | 30.00th=[ 11207], 40.00th=[ 19006], 50.00th=[ 29492], 60.00th=[ 40633], | 70.00th=[ 55837], 80.00th=[ 79168], 90.00th=[113771], 95.00th=[149947], | 99.00th=[200279], 99.50th=[210764], 99.90th=[223347], 99.95th=[223347], | 99.99th=[223347] bw ( KiB/s): min= 31, max= 381, per=26.16%, avg=167.44, stdev=78.68, samples=73 iops : min= 1, max= 23, avg= 9.67, stdev= 4.98, samples=73 lat (usec) : 50=0.26%, 100=5.60%, 250=0.78%, 500=0.13% lat (msec) : 2=2.47%, 4=3.65%, 10=7.68%, 20=8.20%, 50=31.38% lat (msec) : 100=27.86%, 250=11.85%, 500=0.13% cpu : usr=0.05%, sys=4.57%, ctx=1591, majf=0, minf=19 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=609KiB/s (623kB/s), 146KiB/s-163KiB/s (149kB/s-167kB/s), io=23.4MiB (24.5MB), run=37427-39355msec WRITE: bw=640KiB/s (656kB/s), 157KiB/s-167KiB/s (161kB/s-171kB/s), io=24.6MiB (25.8MB), run=37427-39355msec rand-rw: (groupid=0, jobs=1): err= 0: pid=180700: Thu Apr 9 16:20:21 2026 read: IOPS=7, BW=114KiB/s (117kB/s)(5920KiB/51759msec) clat (msec): min=8, max=286, avg=52.80, stdev=45.55 lat (msec): min=8, max=286, avg=52.80, stdev=45.55 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 14], 10.00th=[ 16], 20.00th=[ 21], | 30.00th=[ 25], 40.00th=[ 30], 50.00th=[ 37], 60.00th=[ 44], | 70.00th=[ 58], 80.00th=[ 78], 90.00th=[ 116], 95.00th=[ 157], | 99.00th=[ 230], 99.50th=[ 251], 99.90th=[ 288], 99.95th=[ 288], | 99.99th=[ 288] bw ( KiB/s): min= 31, max= 380, per=25.08%, avg=115.60, stdev=80.84, samples=97 iops : min= 1, max= 23, avg= 6.44, stdev= 5.11, samples=97 write: IOPS=7, BW=123KiB/s (126kB/s)(6368KiB/51759msec); 0 zone resets clat (msec): min=16, max=408, avg=80.45, stdev=56.54 lat (msec): min=16, max=408, avg=80.46, stdev=56.55 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 24], 10.00th=[ 30], 20.00th=[ 37], | 30.00th=[ 45], 40.00th=[ 53], 50.00th=[ 63], 60.00th=[ 74], | 70.00th=[ 93], 80.00th=[ 120], 90.00th=[ 155], 95.00th=[ 197], | 99.00th=[ 271], 99.50th=[ 313], 99.90th=[ 409], 99.95th=[ 409], | 99.99th=[ 409] bw ( KiB/s): min= 30, max= 350, per=25.20%, avg=122.20, stdev=74.87, samples=100 iops : min= 1, max= 21, avg= 6.85, stdev= 4.74, samples=100 lat (msec) : 10=0.78%, 20=9.64%, 50=41.28%, 100=27.60%, 250=19.66% lat (msec) : 500=1.04% cpu : usr=0.05%, sys=1.80%, ctx=1220, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180701: Thu Apr 9 16:20:21 2026 read: IOPS=6, BW=111KiB/s (114kB/s)(5744KiB/51598msec) clat (msec): min=8, max=343, avg=51.05, stdev=44.50 lat (msec): min=8, max=343, avg=51.05, stdev=44.50 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 14], 10.00th=[ 17], 20.00th=[ 21], | 30.00th=[ 26], 40.00th=[ 31], 50.00th=[ 39], 60.00th=[ 46], | 70.00th=[ 55], 80.00th=[ 74], 90.00th=[ 105], 95.00th=[ 138], | 99.00th=[ 224], 99.50th=[ 334], 99.90th=[ 342], 99.95th=[ 342], | 99.99th=[ 342] bw ( KiB/s): min= 30, max= 416, per=25.22%, avg=116.26, stdev=81.01, samples=96 iops : min= 1, max= 26, avg= 6.48, stdev= 5.14, samples=96 write: IOPS=7, BW=127KiB/s (130kB/s)(6544KiB/51598msec); 0 zone resets clat (msec): min=11, max=307, avg=81.07, stdev=55.58 lat (msec): min=11, max=307, avg=81.08, stdev=55.58 clat percentiles (msec): | 1.00th=[ 20], 5.00th=[ 25], 10.00th=[ 30], 20.00th=[ 37], | 30.00th=[ 44], 40.00th=[ 53], 50.00th=[ 61], 60.00th=[ 79], | 70.00th=[ 96], 80.00th=[ 118], 90.00th=[ 163], 95.00th=[ 201], | 99.00th=[ 262], 99.50th=[ 268], 99.90th=[ 309], 99.95th=[ 309], | 99.99th=[ 309] bw ( KiB/s): min= 31, max= 446, per=26.60%, avg=128.99, stdev=78.62, samples=98 iops : min= 1, max= 27, avg= 7.29, stdev= 4.96, samples=98 lat (msec) : 10=0.39%, 20=8.72%, 50=41.28%, 100=29.69%, 250=18.88% lat (msec) : 500=1.04% cpu : usr=0.04%, sys=1.68%, ctx=1184, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180702: Thu Apr 9 16:20:21 2026 read: IOPS=7, BW=122KiB/s (124kB/s)(6256KiB/51465msec) clat (msec): min=5, max=343, avg=54.84, stdev=50.02 lat (msec): min=5, max=343, avg=54.85, stdev=50.02 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 14], 10.00th=[ 17], 20.00th=[ 21], | 30.00th=[ 26], 40.00th=[ 32], 50.00th=[ 36], 60.00th=[ 45], | 70.00th=[ 59], 80.00th=[ 84], 90.00th=[ 117], 95.00th=[ 155], | 99.00th=[ 255], 99.50th=[ 334], 99.90th=[ 342], 99.95th=[ 342], | 99.99th=[ 342] bw ( KiB/s): min= 31, max= 411, per=27.16%, avg=125.21, stdev=90.23, samples=98 iops : min= 1, max= 25, avg= 7.05, stdev= 5.67, samples=98 write: IOPS=7, BW=117KiB/s (120kB/s)(6032KiB/51465msec); 0 zone resets clat (msec): min=16, max=398, avg=78.85, stdev=57.01 lat (msec): min=16, max=398, avg=78.86, stdev=57.01 clat percentiles (msec): | 1.00th=[ 18], 5.00th=[ 24], 10.00th=[ 29], 20.00th=[ 36], | 30.00th=[ 42], 40.00th=[ 50], 50.00th=[ 59], 60.00th=[ 70], | 70.00th=[ 92], 80.00th=[ 120], 90.00th=[ 159], 95.00th=[ 199], | 99.00th=[ 271], 99.50th=[ 300], 99.90th=[ 397], 99.95th=[ 397], | 99.99th=[ 397] bw ( KiB/s): min= 30, max= 350, per=24.62%, avg=119.42, stdev=71.29, samples=98 iops : min= 1, max= 21, avg= 6.68, stdev= 4.54, samples=98 lat (msec) : 10=0.52%, 20=10.68%, 50=42.45%, 100=25.39%, 250=19.79% lat (msec) : 500=1.17% cpu : usr=0.04%, sys=1.61%, ctx=1185, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180703: Thu Apr 9 16:20:21 2026 read: IOPS=7, BW=116KiB/s (119kB/s)(6032KiB/51871msec) clat (msec): min=4, max=339, avg=53.72, stdev=48.67 lat (msec): min=4, max=339, avg=53.72, stdev=48.67 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 15], 20.00th=[ 20], | 30.00th=[ 23], 40.00th=[ 30], 50.00th=[ 37], 60.00th=[ 45], | 70.00th=[ 62], 80.00th=[ 82], 90.00th=[ 122], 95.00th=[ 157], | 99.00th=[ 230], 99.50th=[ 259], 99.90th=[ 338], 99.95th=[ 338], | 99.99th=[ 338] bw ( KiB/s): min= 31, max= 411, per=26.11%, avg=120.37, stdev=82.99, samples=97 iops : min= 1, max= 25, avg= 6.75, stdev= 5.26, samples=97 write: IOPS=7, BW=121KiB/s (124kB/s)(6256KiB/51871msec); 0 zone resets clat (msec): min=10, max=336, avg=79.97, stdev=57.06 lat (msec): min=10, max=336, avg=79.98, stdev=57.05 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 24], 10.00th=[ 29], 20.00th=[ 37], | 30.00th=[ 44], 40.00th=[ 50], 50.00th=[ 58], 60.00th=[ 73], | 70.00th=[ 93], 80.00th=[ 122], 90.00th=[ 157], 95.00th=[ 203], | 99.00th=[ 279], 99.50th=[ 317], 99.90th=[ 338], 99.95th=[ 338], | 99.99th=[ 338] bw ( KiB/s): min= 30, max= 382, per=24.91%, avg=120.83, stdev=79.84, samples=101 iops : min= 1, max= 23, avg= 6.77, stdev= 5.08, samples=101 lat (msec) : 10=1.95%, 20=9.64%, 50=40.89%, 100=26.56%, 250=19.92% lat (msec) : 500=1.04% cpu : usr=0.04%, sys=1.75%, ctx=1247, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=462KiB/s (473kB/s), 111KiB/s-122KiB/s (114kB/s-124kB/s), io=23.4MiB (24.5MB), run=51465-51871msec WRITE: bw=486KiB/s (497kB/s), 117KiB/s-127KiB/s (120kB/s-130kB/s), io=24.6MiB (25.8MB), run=51465-51871msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=180723: Thu Apr 9 16:20:37 2026 read: IOPS=1, BW=1631KiB/s (1670kB/s)(7168KiB/4396msec) clat (msec): min=90, max=1957, avg=427.02, stdev=677.45 lat (msec): min=90, max=1957, avg=427.02, stdev=677.45 clat percentiles (msec): | 1.00th=[ 90], 5.00th=[ 90], 10.00th=[ 90], 20.00th=[ 93], | 30.00th=[ 182], 40.00th=[ 182], 50.00th=[ 205], 60.00th=[ 226], | 70.00th=[ 226], 80.00th=[ 239], 90.00th=[ 1955], 95.00th=[ 1955], | 99.00th=[ 1955], 99.50th=[ 1955], 99.90th=[ 1955], 99.95th=[ 1955], | 99.99th=[ 1955] bw ( KiB/s): min= 1563, max= 4096, per=76.64%, avg=2900.00, stdev=1351.20, samples=4 iops : min= 1, max= 4, avg= 2.25, stdev= 1.50, samples=4 write: IOPS=1, BW=1165KiB/s (1193kB/s)(5120KiB/4396msec); 0 zone resets clat (msec): min=140, max=353, avg=236.17, stdev=87.36 lat (msec): min=140, max=353, avg=236.38, stdev=87.28 clat percentiles (msec): | 1.00th=[ 142], 5.00th=[ 142], 10.00th=[ 142], 20.00th=[ 142], | 30.00th=[ 184], 40.00th=[ 184], 50.00th=[ 205], 60.00th=[ 205], | 70.00th=[ 300], 80.00th=[ 300], 90.00th=[ 355], 95.00th=[ 355], | 99.00th=[ 355], 99.50th=[ 355], 99.90th=[ 355], 99.95th=[ 355], | 99.99th=[ 355] bw ( KiB/s): min= 2048, max= 4071, per=62.53%, avg=3313.00, stdev=1102.69, samples=3 iops : min= 2, max= 3, avg= 2.67, stdev= 0.58, samples=3 lat (msec) : 100=16.67%, 250=58.33%, 500=16.67%, 2000=8.33% cpu : usr=0.00%, sys=3.73%, ctx=76, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180726: Thu Apr 9 16:20:37 2026 read: IOPS=0, BW=391KiB/s (400kB/s)(2048KiB/5244msec) clat (msec): min=122, max=151, avg=137.16, stdev=20.72 lat (msec): min=122, max=151, avg=137.16, stdev=20.72 clat percentiles (msec): | 1.00th=[ 123], 5.00th=[ 123], 10.00th=[ 123], 20.00th=[ 123], | 30.00th=[ 123], 40.00th=[ 123], 50.00th=[ 123], 60.00th=[ 153], | 70.00th=[ 153], 80.00th=[ 153], 90.00th=[ 153], 95.00th=[ 153], | 99.00th=[ 153], 99.50th=[ 153], 99.90th=[ 153], 99.95th=[ 153], | 99.99th=[ 153] bw ( KiB/s): min= 1582, max= 2035, per=47.79%, avg=1808.50, stdev=320.32, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1953KiB/s (2000kB/s)(10.0MiB/5244msec); 0 zone resets clat (msec): min=106, max=1780, avg=480.92, stdev=487.80 lat (msec): min=106, max=1780, avg=481.04, stdev=487.81 clat percentiles (msec): | 1.00th=[ 107], 5.00th=[ 107], 10.00th=[ 107], 20.00th=[ 180], | 30.00th=[ 207], 40.00th=[ 338], 50.00th=[ 342], 60.00th=[ 347], | 70.00th=[ 376], 80.00th=[ 393], 90.00th=[ 743], 95.00th=[ 1787], | 99.00th=[ 1787], 99.50th=[ 1787], 99.90th=[ 1787], 99.95th=[ 1787], | 99.99th=[ 1787] bw ( KiB/s): min= 2035, max= 5731, per=56.41%, avg=2988.50, stdev=1561.39, samples=6 iops : min= 1, max= 5, avg= 2.17, stdev= 1.60, samples=6 lat (msec) : 250=41.67%, 500=41.67%, 750=8.33%, 2000=8.33% cpu : usr=0.00%, sys=3.83%, ctx=88, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180728: Thu Apr 9 16:20:37 2026 read: IOPS=1, BW=1185KiB/s (1214kB/s)(6144KiB/5184msec) clat (msec): min=67, max=966, avg=266.08, stdev=345.43 lat (msec): min=67, max=966, avg=266.08, stdev=345.43 clat percentiles (msec): | 1.00th=[ 68], 5.00th=[ 68], 10.00th=[ 68], 20.00th=[ 105], | 30.00th=[ 105], 40.00th=[ 125], 50.00th=[ 125], 60.00th=[ 163], | 70.00th=[ 171], 80.00th=[ 171], 90.00th=[ 969], 95.00th=[ 969], | 99.00th=[ 969], 99.50th=[ 969], 99.90th=[ 969], 99.95th=[ 969], | 99.99th=[ 969] bw ( KiB/s): min= 1910, max= 4031, per=66.19%, avg=2504.75, stdev=1019.32, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 write: IOPS=1, BW=1185KiB/s (1214kB/s)(6144KiB/5184msec); 0 zone resets clat (msec): min=157, max=1889, avg=588.36, stdev=662.61 lat (msec): min=157, max=1889, avg=588.47, stdev=662.59 clat percentiles (msec): | 1.00th=[ 157], 5.00th=[ 157], 10.00th=[ 157], 20.00th=[ 194], | 30.00th=[ 194], 40.00th=[ 194], 50.00th=[ 194], 60.00th=[ 518], | 70.00th=[ 575], 80.00th=[ 575], 90.00th=[ 1888], 95.00th=[ 1888], | 99.00th=[ 1888], 99.50th=[ 1888], 99.90th=[ 1888], 99.95th=[ 1888], | 99.99th=[ 1888] bw ( KiB/s): min= 2043, max= 4031, per=56.36%, avg=2986.00, stdev=997.92, samples=3 iops : min= 1, max= 3, avg= 2.00, stdev= 1.00, samples=3 lat (msec) : 100=8.33%, 250=58.33%, 750=16.67%, 1000=8.33%, 2000=8.33% cpu : usr=0.00%, sys=3.36%, ctx=65, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180729: Thu Apr 9 16:20:37 2026 read: IOPS=0, BW=946KiB/s (969kB/s)(5120KiB/5411msec) clat (msec): min=77, max=265, avg=149.18, stdev=73.66 lat (msec): min=77, max=265, avg=149.18, stdev=73.65 clat percentiles (msec): | 1.00th=[ 79], 5.00th=[ 79], 10.00th=[ 79], 20.00th=[ 79], | 30.00th=[ 96], 40.00th=[ 96], 50.00th=[ 144], 60.00th=[ 144], | 70.00th=[ 163], 80.00th=[ 163], 90.00th=[ 266], 95.00th=[ 266], | 99.00th=[ 266], 99.50th=[ 266], 99.90th=[ 266], 99.95th=[ 266], | 99.99th=[ 266] bw ( KiB/s): min= 2043, max= 5731, per=100.00%, avg=3887.00, stdev=2607.81, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 write: IOPS=1, BW=1325KiB/s (1357kB/s)(7168KiB/5411msec); 0 zone resets clat (msec): min=149, max=2397, avg=650.90, stdev=803.65 lat (msec): min=150, max=2397, avg=651.79, stdev=803.26 clat percentiles (msec): | 1.00th=[ 150], 5.00th=[ 150], 10.00th=[ 150], 20.00th=[ 150], | 30.00th=[ 201], 40.00th=[ 201], 50.00th=[ 347], 60.00th=[ 535], | 70.00th=[ 535], 80.00th=[ 776], 90.00th=[ 2400], 95.00th=[ 2400], | 99.00th=[ 2400], 99.50th=[ 2400], 99.90th=[ 2400], 99.95th=[ 2400], | 99.99th=[ 2400] bw ( KiB/s): min= 1575, max= 4071, per=44.36%, avg=2350.40, stdev=982.36, samples=5 iops : min= 1, max= 3, avg= 1.60, stdev= 0.89, samples=5 lat (msec) : 100=16.67%, 250=41.67%, 500=16.67%, 750=8.33%, 1000=8.33% lat (msec) : >=2000=8.33% cpu : usr=0.00%, sys=2.40%, ctx=59, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3785KiB/s (3876kB/s), 391KiB/s-1631KiB/s (400kB/s-1670kB/s), io=20.0MiB (20.0MB), run=4396-5411msec WRITE: bw=5299KiB/s (5426kB/s), 1165KiB/s-1953KiB/s (1193kB/s-2000kB/s), io=28.0MiB (29.4MB), run=4396-5411msec rand-rw: (groupid=0, jobs=1): err= 0: pid=180724: Thu Apr 9 16:20:37 2026 read: IOPS=2, BW=2268KiB/s (2323kB/s)(7168KiB/3160msec) clat (usec): min=512, max=1569.6k, avg=347248.95, stdev=549374.91 lat (usec): min=513, max=1569.6k, avg=347250.39, stdev=549374.81 clat percentiles (usec): | 1.00th=[ 515], 5.00th=[ 515], 10.00th=[ 515], | 20.00th=[ 1020], 30.00th=[ 149947], 40.00th=[ 149947], | 50.00th=[ 212861], 60.00th=[ 240124], 70.00th=[ 240124], | 80.00th=[ 256902], 90.00th=[1568670], 95.00th=[1568670], | 99.00th=[1568670], 99.50th=[1568670], 99.90th=[1568670], | 99.95th=[1568670], 99.99th=[1568670] bw ( KiB/s): min= 1610, max= 4047, per=85.38%, avg=2927.75, stdev=1294.21, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 1.15, samples=4 write: IOPS=1, BW=1620KiB/s (1659kB/s)(5120KiB/3160msec); 0 zone resets clat (msec): min=107, max=177, avg=130.13, stdev=28.80 lat (msec): min=107, max=177, avg=130.18, stdev=28.81 clat percentiles (msec): | 1.00th=[ 108], 5.00th=[ 108], 10.00th=[ 108], 20.00th=[ 108], | 30.00th=[ 110], 40.00th=[ 110], 50.00th=[ 121], 60.00th=[ 121], | 70.00th=[ 136], 80.00th=[ 136], 90.00th=[ 178], 95.00th=[ 178], | 99.00th=[ 178], 99.50th=[ 178], 99.90th=[ 178], 99.95th=[ 178], | 99.99th=[ 178] bw ( KiB/s): min= 2023, max= 8062, per=100.00%, avg=5042.50, stdev=4270.22, samples=2 iops : min= 1, max= 7, avg= 4.00, stdev= 4.24, samples=2 lat (usec) : 750=8.33% lat (msec) : 2=8.33%, 250=66.67%, 500=8.33%, 2000=8.33% cpu : usr=0.06%, sys=13.04%, ctx=423, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180725: Thu Apr 9 16:20:37 2026 read: IOPS=0, BW=348KiB/s (356kB/s)(2048KiB/5885msec) clat (msec): min=95, max=122, avg=108.83, stdev=19.32 lat (msec): min=95, max=122, avg=108.83, stdev=19.32 clat percentiles (msec): | 1.00th=[ 95], 5.00th=[ 95], 10.00th=[ 95], 20.00th=[ 95], | 30.00th=[ 95], 40.00th=[ 95], 50.00th=[ 95], 60.00th=[ 123], | 70.00th=[ 123], 80.00th=[ 123], 90.00th=[ 123], 95.00th=[ 123], | 99.00th=[ 123], 99.50th=[ 123], 99.90th=[ 123], 99.95th=[ 123], | 99.99th=[ 123] bw ( KiB/s): min= 1622, max= 2007, per=52.92%, avg=1814.50, stdev=272.24, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1740KiB/s (1782kB/s)(10.0MiB/5885msec); 0 zone resets clat (msec): min=130, max=1764, avg=526.79, stdev=542.85 lat (msec): min=130, max=1764, avg=527.44, stdev=542.47 clat percentiles (msec): | 1.00th=[ 131], 5.00th=[ 131], 10.00th=[ 131], 20.00th=[ 155], | 30.00th=[ 165], 40.00th=[ 284], 50.00th=[ 321], 60.00th=[ 351], | 70.00th=[ 384], 80.00th=[ 456], 90.00th=[ 1267], 95.00th=[ 1770], | 99.00th=[ 1770], 99.50th=[ 1770], 99.90th=[ 1770], 99.95th=[ 1770], | 99.99th=[ 1770] bw ( KiB/s): min= 2007, max= 4047, per=56.20%, avg=2698.33, stdev=1044.75, samples=6 iops : min= 1, max= 3, avg= 1.67, stdev= 1.03, samples=6 lat (msec) : 100=8.33%, 250=33.33%, 500=41.67%, 2000=16.67% cpu : usr=0.02%, sys=8.96%, ctx=134, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180727: Thu Apr 9 16:20:37 2026 read: IOPS=1, BW=1264KiB/s (1295kB/s)(6144KiB/4860msec) clat (usec): min=444, max=334584, avg=175411.00, stdev=143184.63 lat (usec): min=444, max=334586, avg=175412.16, stdev=143184.87 clat percentiles (usec): | 1.00th=[ 445], 5.00th=[ 445], 10.00th=[ 445], 20.00th=[ 553], | 30.00th=[ 553], 40.00th=[202376], 50.00th=[202376], 60.00th=[227541], | 70.00th=[287310], 80.00th=[287310], 90.00th=[333448], 95.00th=[333448], | 99.00th=[333448], 99.50th=[333448], 99.90th=[333448], 99.95th=[333448], | 99.99th=[333448] bw ( KiB/s): min= 2007, max= 4031, per=73.75%, avg=2529.00, stdev=1001.45, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 write: IOPS=1, BW=1264KiB/s (1295kB/s)(6144KiB/4860msec); 0 zone resets clat (msec): min=66, max=2326, avg=573.91, stdev=865.40 lat (msec): min=67, max=2326, avg=574.08, stdev=865.38 clat percentiles (msec): | 1.00th=[ 67], 5.00th=[ 67], 10.00th=[ 67], 20.00th=[ 180], | 30.00th=[ 180], 40.00th=[ 186], 50.00th=[ 186], 60.00th=[ 309], | 70.00th=[ 380], 80.00th=[ 380], 90.00th=[ 2333], 95.00th=[ 2333], | 99.00th=[ 2333], 99.50th=[ 2333], 99.90th=[ 2333], 99.95th=[ 2333], | 99.99th=[ 2333] bw ( KiB/s): min= 2007, max= 4031, per=59.33%, avg=2848.50, stdev=995.16, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 1.15, samples=4 lat (usec) : 500=8.33%, 750=8.33% lat (msec) : 100=8.33%, 250=33.33%, 500=33.33%, >=2000=8.33% cpu : usr=0.00%, sys=8.03%, ctx=153, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180730: Thu Apr 9 16:20:37 2026 read: IOPS=0, BW=857KiB/s (878kB/s)(5120KiB/5972msec) clat (msec): min=63, max=389, avg=192.37, stdev=130.27 lat (msec): min=63, max=389, avg=192.37, stdev=130.27 clat percentiles (msec): | 1.00th=[ 64], 5.00th=[ 64], 10.00th=[ 64], 20.00th=[ 64], | 30.00th=[ 90], 40.00th=[ 90], 50.00th=[ 184], 60.00th=[ 184], | 70.00th=[ 236], 80.00th=[ 236], 90.00th=[ 388], 95.00th=[ 388], | 99.00th=[ 388], 99.50th=[ 388], 99.90th=[ 388], 99.95th=[ 388], | 99.99th=[ 388] bw ( KiB/s): min= 2007, max= 4063, per=78.67%, avg=2697.67, stdev=1182.44, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 write: IOPS=1, BW=1200KiB/s (1229kB/s)(7168KiB/5972msec); 0 zone resets clat (msec): min=170, max=2324, avg=675.91, stdev=837.32 lat (msec): min=170, max=2324, avg=676.00, stdev=837.32 clat percentiles (msec): | 1.00th=[ 171], 5.00th=[ 171], 10.00th=[ 171], 20.00th=[ 190], | 30.00th=[ 199], 40.00th=[ 199], 50.00th=[ 249], 60.00th=[ 275], | 70.00th=[ 275], 80.00th=[ 1334], 90.00th=[ 2333], 95.00th=[ 2333], | 99.00th=[ 2333], 99.50th=[ 2333], 99.90th=[ 2333], 99.95th=[ 2333], | 99.99th=[ 2333] bw ( KiB/s): min= 1648, max= 2043, per=40.56%, avg=1947.20, stdev=167.79, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 lat (msec) : 100=16.67%, 250=50.00%, 500=16.67%, 2000=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=7.89%, ctx=153, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3429KiB/s (3512kB/s), 348KiB/s-2268KiB/s (356kB/s-2323kB/s), io=20.0MiB (20.0MB), run=3160-5972msec WRITE: bw=4801KiB/s (4916kB/s), 1200KiB/s-1740KiB/s (1229kB/s-1782kB/s), io=28.0MiB (29.4MB), run=3160-5972msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=180742: Thu Apr 9 16:20:53 2026 read: IOPS=0, BW=4012KiB/s (4108kB/s)(12.0MiB/3063msec) clat (msec): min=402, max=1467, avg=990.63, stdev=541.28 lat (msec): min=402, max=1467, avg=990.63, stdev=541.28 clat percentiles (msec): | 1.00th=[ 401], 5.00th=[ 401], 10.00th=[ 401], 20.00th=[ 401], | 30.00th=[ 401], 40.00th=[ 1099], 50.00th=[ 1099], 60.00th=[ 1099], | 70.00th=[ 1469], 80.00th=[ 1469], 90.00th=[ 1469], 95.00th=[ 1469], | 99.00th=[ 1469], 99.50th=[ 1469], 99.90th=[ 1469], 99.95th=[ 1469], | 99.99th=[ 1469] bw ( KiB/s): min= 8031, max= 8031, per=100.00%, avg=8031.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.10%, sys=3.30%, ctx=47, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180744: Thu Apr 9 16:20:53 2026 read: IOPS=0, BW=1193KiB/s (1222kB/s)(4096KiB/3433msec) clat (nsec): min=1013.6M, max=1013.6M, avg=1013577208.00, stdev= 0.00 lat (nsec): min=1013.6M, max=1013.6M, avg=1013579767.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1011], 5.00th=[ 1011], 10.00th=[ 1011], 20.00th=[ 1011], | 30.00th=[ 1011], 40.00th=[ 1011], 50.00th=[ 1011], 60.00th=[ 1011], | 70.00th=[ 1011], 80.00th=[ 1011], 90.00th=[ 1011], 95.00th=[ 1011], | 99.00th=[ 1011], 99.50th=[ 1011], 99.90th=[ 1011], 99.95th=[ 1011], | 99.99th=[ 1011] bw ( KiB/s): min= 7922, max= 7922, per=100.00%, avg=7922.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2386KiB/s (2444kB/s)(8192KiB/3433msec); 0 zone resets clat (msec): min=1077, max=1183, avg=1130.87, stdev=75.03 lat (msec): min=1081, max=1185, avg=1133.76, stdev=73.66 clat percentiles (msec): | 1.00th=[ 1083], 5.00th=[ 1083], 10.00th=[ 1083], 20.00th=[ 1083], | 30.00th=[ 1083], 40.00th=[ 1083], 50.00th=[ 1083], 60.00th=[ 1183], | 70.00th=[ 1183], 80.00th=[ 1183], 90.00th=[ 1183], 95.00th=[ 1183], | 99.00th=[ 1183], 99.50th=[ 1183], 99.90th=[ 1183], 99.95th=[ 1183], | 99.99th=[ 1183] bw ( KiB/s): min= 8000, max= 8000, per=87.51%, avg=8000.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 2000=100.00% cpu : usr=0.03%, sys=3.03%, ctx=62, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180745: Thu Apr 9 16:20:53 2026 write: IOPS=1, BW=4121KiB/s (4220kB/s)(12.0MiB/2982msec); 0 zone resets clat (msec): min=678, max=1279, avg=964.86, stdev=301.52 lat (msec): min=680, max=1280, avg=965.79, stdev=300.97 clat percentiles (msec): | 1.00th=[ 676], 5.00th=[ 676], 10.00th=[ 676], 20.00th=[ 676], | 30.00th=[ 676], 40.00th=[ 936], 50.00th=[ 936], 60.00th=[ 936], | 70.00th=[ 1284], 80.00th=[ 1284], 90.00th=[ 1284], 95.00th=[ 1284], | 99.00th=[ 1284], 99.50th=[ 1284], 99.90th=[ 1284], 99.95th=[ 1284], | 99.99th=[ 1284] bw ( KiB/s): min= 7922, max= 7984, per=86.99%, avg=7953.00, stdev=43.84, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=3.29%, ctx=59, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180746: Thu Apr 9 16:20:53 2026 write: IOPS=0, BW=3429KiB/s (3511kB/s)(12.0MiB/3584msec); 0 zone resets clat (msec): min=232, max=2278, avg=1080.74, stdev=1066.93 lat (msec): min=236, max=2279, avg=1083.29, stdev=1065.11 clat percentiles (msec): | 1.00th=[ 234], 5.00th=[ 234], 10.00th=[ 234], 20.00th=[ 234], | 30.00th=[ 234], 40.00th=[ 735], 50.00th=[ 735], 60.00th=[ 735], | 70.00th=[ 2265], 80.00th=[ 2265], 90.00th=[ 2265], 95.00th=[ 2265], | 99.00th=[ 2265], 99.50th=[ 2265], 99.90th=[ 2265], 99.95th=[ 2265], | 99.99th=[ 2265] bw ( KiB/s): min= 7876, max= 7876, per=86.15%, avg=7876.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 750=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=3.46%, ctx=74, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4773KiB/s (4887kB/s), 1193KiB/s-4012KiB/s (1222kB/s-4108kB/s), io=16.0MiB (16.8MB), run=3063-3433msec WRITE: bw=9143KiB/s (9362kB/s), 2386KiB/s-4121KiB/s (2444kB/s-4220kB/s), io=32.0MiB (33.6MB), run=2982-3584msec rand-rw: (groupid=0, jobs=1): err= 0: pid=180739: Thu Apr 9 16:20:53 2026 read: IOPS=1, BW=4339KiB/s (4443kB/s)(12.0MiB/2832msec) clat (msec): min=776, max=1019, avg=882.84, stdev=124.24 lat (msec): min=776, max=1019, avg=882.84, stdev=124.24 clat percentiles (msec): | 1.00th=[ 776], 5.00th=[ 776], 10.00th=[ 776], 20.00th=[ 776], | 30.00th=[ 776], 40.00th=[ 852], 50.00th=[ 852], 60.00th=[ 852], | 70.00th=[ 1020], 80.00th=[ 1020], 90.00th=[ 1020], 95.00th=[ 1020], | 99.00th=[ 1020], 99.50th=[ 1020], 99.90th=[ 1020], 99.95th=[ 1020], | 99.99th=[ 1020] bw ( KiB/s): min= 8000, max= 8078, per=100.00%, avg=8039.00, stdev=55.15, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=66.67%, 2000=33.33% cpu : usr=0.00%, sys=9.61%, ctx=225, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180740: Thu Apr 9 16:20:53 2026 read: IOPS=0, BW=1335KiB/s (1367kB/s)(4096KiB/3068msec) clat (nsec): min=839017k, max=839017k, avg=839016999.00, stdev= 0.00 lat (nsec): min=839020k, max=839020k, avg=839019684.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 844], 5.00th=[ 844], 10.00th=[ 844], 20.00th=[ 844], | 30.00th=[ 844], 40.00th=[ 844], 50.00th=[ 844], 60.00th=[ 844], | 70.00th=[ 844], 80.00th=[ 844], 90.00th=[ 844], 95.00th=[ 844], | 99.00th=[ 844], 99.50th=[ 844], 99.90th=[ 844], 99.95th=[ 844], | 99.99th=[ 844] bw ( KiB/s): min= 8000, max= 8000, per=100.00%, avg=8000.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2670KiB/s (2734kB/s)(8192KiB/3068msec); 0 zone resets clat (msec): min=712, max=1281, avg=996.89, stdev=402.03 lat (msec): min=713, max=1281, avg=997.54, stdev=402.21 clat percentiles (msec): | 1.00th=[ 709], 5.00th=[ 709], 10.00th=[ 709], 20.00th=[ 709], | 30.00th=[ 709], 40.00th=[ 709], 50.00th=[ 709], 60.00th=[ 1284], | 70.00th=[ 1284], 80.00th=[ 1284], 90.00th=[ 1284], 95.00th=[ 1284], | 99.00th=[ 1284], 99.50th=[ 1284], 99.90th=[ 1284], 99.95th=[ 1284], | 99.99th=[ 1284] bw ( KiB/s): min= 8078, max= 8078, per=90.14%, avg=8078.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.10%, sys=3.55%, ctx=138, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180741: Thu Apr 9 16:20:53 2026 write: IOPS=0, BW=3361KiB/s (3442kB/s)(12.0MiB/3656msec); 0 zone resets clat (msec): min=180, max=2186, avg=1194.27, stdev=1003.24 lat (msec): min=180, max=2187, avg=1194.90, stdev=1003.67 clat percentiles (msec): | 1.00th=[ 182], 5.00th=[ 182], 10.00th=[ 182], 20.00th=[ 182], | 30.00th=[ 182], 40.00th=[ 1217], 50.00th=[ 1217], 60.00th=[ 1217], | 70.00th=[ 2198], 80.00th=[ 2198], 90.00th=[ 2198], 95.00th=[ 2198], | 99.00th=[ 2198], 99.50th=[ 2198], 99.90th=[ 2198], 99.95th=[ 2198], | 99.99th=[ 2198] bw ( KiB/s): min= 8159, max= 8159, per=91.04%, avg=8159.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=3.39%, ctx=47, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180743: Thu Apr 9 16:20:53 2026 write: IOPS=0, BW=3983KiB/s (4079kB/s)(12.0MiB/3085msec); 0 zone resets clat (msec): min=331, max=1924, avg=872.42, stdev=911.08 lat (msec): min=332, max=1924, avg=872.89, stdev=911.08 clat percentiles (msec): | 1.00th=[ 334], 5.00th=[ 334], 10.00th=[ 334], 20.00th=[ 334], | 30.00th=[ 334], 40.00th=[ 363], 50.00th=[ 363], 60.00th=[ 363], | 70.00th=[ 1921], 80.00th=[ 1921], 90.00th=[ 1921], 95.00th=[ 1921], | 99.00th=[ 1921], 99.50th=[ 1921], 99.90th=[ 1921], 99.95th=[ 1921], | 99.99th=[ 1921] bw ( KiB/s): min= 7474, max= 8175, per=87.31%, avg=7824.50, stdev=495.68, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=66.67%, 2000=33.33% cpu : usr=0.03%, sys=4.28%, ctx=55, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5340KiB/s (5468kB/s), 1335KiB/s-4339KiB/s (1367kB/s-4443kB/s), io=16.0MiB (16.8MB), run=2832-3068msec WRITE: bw=8963KiB/s (9178kB/s), 2670KiB/s-3983KiB/s (2734kB/s-4079kB/s), io=32.0MiB (33.6MB), run=3068-3656msec