== sanity test 398b: DIO and buffer IO race ============== 12:13:38 (1788624818) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 5.83658 s, 8.6 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144781: Sat Sep 5 12:16:12 2026 read: IOPS=11, BW=44.8KiB/s (45.9kB/s)(5992KiB/133809msec) clat (usec): min=35, max=417626, avg=42565.92, stdev=34529.69 lat (usec): min=35, max=417629, avg=42576.25, stdev=34536.37 clat percentiles (usec): | 1.00th=[ 48], 5.00th=[ 57], 10.00th=[ 94], 20.00th=[ 17695], | 30.00th=[ 23462], 40.00th=[ 28967], 50.00th=[ 35390], 60.00th=[ 42730], | 70.00th=[ 52691], 80.00th=[ 65274], 90.00th=[ 86508], 95.00th=[103285], | 99.00th=[149947], 99.50th=[168821], 99.90th=[341836], 99.95th=[417334], | 99.99th=[417334] bw ( KiB/s): min= 7, max= 111, per=25.45%, avg=44.80, stdev=20.25, samples=261 iops : min= 1, max= 27, avg=10.58, stdev= 5.07, samples=261 write: IOPS=11, BW=47.1KiB/s (48.2kB/s)(6296KiB/133809msec); 0 zone resets clat (usec): min=915, max=384537, avg=44409.61, stdev=48466.54 lat (usec): min=916, max=384539, avg=44411.63, stdev=48466.33 clat percentiles (usec): | 1.00th=[ 1029], 5.00th=[ 1139], 10.00th=[ 1614], 20.00th=[ 3949], | 30.00th=[ 8848], 40.00th=[ 19792], 50.00th=[ 31065], 60.00th=[ 42730], | 70.00th=[ 55837], 80.00th=[ 76022], 90.00th=[108528], 95.00th=[135267], | 99.00th=[217056], 99.50th=[263193], 99.90th=[379585], 99.95th=[383779], | 99.99th=[383779] bw ( KiB/s): min= 7, max= 111, per=25.46%, avg=46.84, stdev=21.61, samples=262 iops : min= 1, max= 27, avg=11.10, stdev= 5.41, samples=262 lat (usec) : 50=0.78%, 100=4.20%, 250=0.59%, 500=0.07%, 750=0.07% lat (usec) : 1000=0.29% lat (msec) : 2=6.18%, 4=4.04%, 10=6.58%, 20=9.28%, 50=34.24% lat (msec) : 100=24.45%, 250=8.89%, 500=0.36% cpu : usr=0.06%, sys=5.08%, ctx=6380, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144782: Sat Sep 5 12:16:12 2026 read: IOPS=11, BW=44.1KiB/s (45.2kB/s)(5940KiB/134597msec) clat (usec): min=31, max=797126, avg=42810.41, stdev=39694.65 lat (usec): min=31, max=797128, avg=42812.15, stdev=39694.62 clat percentiles (usec): | 1.00th=[ 48], 5.00th=[ 57], 10.00th=[ 81], 20.00th=[ 17171], | 30.00th=[ 23200], 40.00th=[ 28705], 50.00th=[ 35390], 60.00th=[ 42730], | 70.00th=[ 52167], 80.00th=[ 65799], 90.00th=[ 85459], 95.00th=[105382], | 99.00th=[152044], 99.50th=[200279], 99.90th=[358613], 99.95th=[801113], | 99.99th=[801113] bw ( KiB/s): min= 7, max= 127, per=25.13%, avg=44.23, stdev=21.74, samples=262 iops : min= 1, max= 31, avg=10.45, stdev= 5.45, samples=262 write: IOPS=11, BW=47.2KiB/s (48.3kB/s)(6348KiB/134597msec); 0 zone resets clat (usec): min=966, max=415656, avg=44662.45, stdev=48134.72 lat (usec): min=968, max=415660, avg=44665.63, stdev=48134.63 clat percentiles (usec): | 1.00th=[ 1020], 5.00th=[ 1156], 10.00th=[ 1745], 20.00th=[ 4424], | 30.00th=[ 9634], 40.00th=[ 20579], 50.00th=[ 31065], 60.00th=[ 44303], | 70.00th=[ 57934], 80.00th=[ 76022], 90.00th=[104334], 95.00th=[131597], | 99.00th=[221250], 99.50th=[256902], 99.90th=[358613], 99.95th=[417334], | 99.99th=[417334] bw ( KiB/s): min= 7, max= 172, per=25.45%, avg=46.83, stdev=22.73, samples=265 iops : min= 1, max= 43, avg=11.10, stdev= 5.73, samples=265 lat (usec) : 50=0.75%, 100=4.49%, 250=0.42%, 500=0.13%, 1000=0.26% lat (msec) : 2=5.86%, 4=3.81%, 10=6.71%, 20=9.77%, 50=34.34% lat (msec) : 100=24.77%, 250=8.30%, 500=0.36%, 1000=0.03% cpu : usr=0.07%, sys=5.00%, ctx=6357, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144783: Sat Sep 5 12:16:12 2026 read: IOPS=11, BW=44.4KiB/s (45.4kB/s)(6028KiB/135917msec) clat (usec): min=30, max=235917, avg=41268.56, stdev=31425.71 lat (usec): min=30, max=235919, avg=41272.68, stdev=31425.55 clat percentiles (usec): | 1.00th=[ 44], 5.00th=[ 56], 10.00th=[ 245], 20.00th=[ 17695], | 30.00th=[ 23725], 40.00th=[ 28705], 50.00th=[ 34866], 60.00th=[ 42730], | 70.00th=[ 51119], 80.00th=[ 62129], 90.00th=[ 81265], 95.00th=[ 99091], | 99.00th=[149947], 99.50th=[175113], 99.90th=[200279], 99.95th=[235930], | 99.99th=[235930] bw ( KiB/s): min= 7, max= 151, per=25.17%, avg=44.30, stdev=23.08, samples=264 iops : min= 1, max= 37, avg=10.47, stdev= 5.82, samples=264 write: IOPS=11, BW=46.1KiB/s (47.2kB/s)(6260KiB/135917msec); 0 zone resets clat (usec): min=863, max=852871, avg=47040.05, stdev=55450.18 lat (usec): min=864, max=852873, avg=47042.68, stdev=55449.72 clat percentiles (usec): | 1.00th=[ 1029], 5.00th=[ 1123], 10.00th=[ 1303], 20.00th=[ 3621], | 30.00th=[ 9110], 40.00th=[ 21103], 50.00th=[ 33424], 60.00th=[ 45876], | 70.00th=[ 59507], 80.00th=[ 77071], 90.00th=[112722], 95.00th=[143655], | 99.00th=[212861], 99.50th=[304088], 99.90th=[583009], 99.95th=[851444], | 99.99th=[851444] bw ( KiB/s): min= 7, max= 167, per=24.92%, avg=45.85, stdev=23.41, samples=265 iops : min= 1, max= 41, avg=10.85, stdev= 5.89, samples=265 lat (usec) : 50=1.14%, 100=3.32%, 250=0.46%, 500=0.10%, 1000=0.33% lat (msec) : 2=6.93%, 4=3.74%, 10=5.60%, 20=9.90%, 50=34.24% lat (msec) : 100=25.16%, 250=8.72%, 500=0.29%, 750=0.03%, 1000=0.03% cpu : usr=0.07%, sys=4.93%, ctx=6408, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144784: Sat Sep 5 12:16:12 2026 read: IOPS=11, BW=45.2KiB/s (46.3kB/s)(6052KiB/133885msec) clat (usec): min=26, max=363362, avg=42368.21, stdev=35527.42 lat (usec): min=26, max=363364, avg=42378.53, stdev=35524.65 clat percentiles (usec): | 1.00th=[ 47], 5.00th=[ 55], 10.00th=[ 80], 20.00th=[ 16909], | 30.00th=[ 22938], 40.00th=[ 28181], 50.00th=[ 34341], 60.00th=[ 43254], | 70.00th=[ 53216], 80.00th=[ 64750], 90.00th=[ 86508], 95.00th=[104334], | 99.00th=[145753], 99.50th=[212861], 99.90th=[320865], 99.95th=[362808], | 99.99th=[362808] bw ( KiB/s): min= 7, max= 103, per=25.69%, avg=45.21, stdev=20.30, samples=260 iops : min= 1, max= 25, avg=10.70, stdev= 5.12, samples=260 write: IOPS=11, BW=46.6KiB/s (47.7kB/s)(6236KiB/133885msec); 0 zone resets clat (usec): min=897, max=798591, avg=44686.01, stdev=53476.62 lat (usec): min=899, max=798594, avg=44687.60, stdev=53476.78 clat percentiles (usec): | 1.00th=[ 1037], 5.00th=[ 1139], 10.00th=[ 1385], 20.00th=[ 3195], | 30.00th=[ 7701], 40.00th=[ 18220], 50.00th=[ 30016], 60.00th=[ 41681], | 70.00th=[ 57934], 80.00th=[ 77071], 90.00th=[107480], 95.00th=[137364], | 99.00th=[219153], 99.50th=[256902], 99.90th=[450888], 99.95th=[801113], | 99.99th=[801113] bw ( KiB/s): min= 7, max= 118, per=25.15%, avg=46.27, stdev=21.95, samples=262 iops : min= 1, max= 29, avg=10.95, stdev= 5.53, samples=262 lat (usec) : 50=0.94%, 100=4.43%, 250=0.33%, 500=0.23%, 750=0.07% lat (usec) : 1000=0.26% lat (msec) : 2=6.90%, 4=4.46%, 10=5.57%, 20=9.99%, 50=33.63% lat (msec) : 100=24.09%, 250=8.72%, 500=0.36%, 1000=0.03% cpu : usr=0.07%, sys=4.98%, ctx=6304, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=177KiB/s (181kB/s), 44.1KiB/s-45.2KiB/s (45.2kB/s-46.3kB/s), io=23.4MiB (24.6MB), run=133809-135917msec WRITE: bw=185KiB/s (189kB/s), 46.1KiB/s-47.2KiB/s (47.2kB/s-48.3kB/s), io=24.6MiB (25.7MB), run=133809-135917msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144776: Sat Sep 5 12:18:22 2026 read: IOPS=5, BW=22.5KiB/s (23.0kB/s)(5992KiB/266273msec) clat (msec): min=4, max=663, avg=37.44, stdev=45.60 lat (msec): min=4, max=663, avg=37.45, stdev=45.60 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 14], | 30.00th=[ 16], 40.00th=[ 20], 50.00th=[ 24], 60.00th=[ 29], | 70.00th=[ 36], 80.00th=[ 51], 90.00th=[ 84], 95.00th=[ 109], | 99.00th=[ 188], 99.50th=[ 288], 99.90th=[ 625], 99.95th=[ 667], | 99.99th=[ 667] bw ( KiB/s): min= 7, max= 112, per=29.01%, avg=26.11, stdev=17.71, samples=445 iops : min= 1, max= 28, avg= 5.93, stdev= 4.49, samples=445 write: IOPS=5, BW=23.6KiB/s (24.2kB/s)(6296KiB/266273msec); 0 zone resets clat (msec): min=34, max=661, avg=133.28, stdev=78.41 lat (msec): min=34, max=661, avg=133.29, stdev=78.40 clat percentiles (msec): | 1.00th=[ 49], 5.00th=[ 61], 10.00th=[ 67], 20.00th=[ 78], | 30.00th=[ 89], 40.00th=[ 99], 50.00th=[ 109], 60.00th=[ 123], | 70.00th=[ 142], 80.00th=[ 180], 90.00th=[ 236], 95.00th=[ 300], | 99.00th=[ 409], 99.50th=[ 472], 99.90th=[ 600], 99.95th=[ 659], | 99.99th=[ 659] bw ( KiB/s): min= 7, max= 55, per=25.27%, avg=23.75, stdev=11.93, samples=512 iops : min= 1, max= 13, avg= 5.32, stdev= 3.06, samples=512 lat (msec) : 10=4.46%, 20=16.08%, 50=19.04%, 100=27.99%, 250=27.83% lat (msec) : 500=4.26%, 750=0.33% cpu : usr=0.04%, sys=1.10%, ctx=5387, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144777: Sat Sep 5 12:18:22 2026 read: IOPS=5, BW=22.3KiB/s (22.9kB/s)(5940KiB/265945msec) clat (msec): min=5, max=1005, avg=36.38, stdev=48.59 lat (msec): min=5, max=1005, avg=36.38, stdev=48.59 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 10], 20.00th=[ 13], | 30.00th=[ 16], 40.00th=[ 19], 50.00th=[ 23], 60.00th=[ 28], | 70.00th=[ 36], 80.00th=[ 48], 90.00th=[ 77], 95.00th=[ 105], | 99.00th=[ 207], 99.50th=[ 313], 99.90th=[ 514], 99.95th=[ 1003], | 99.99th=[ 1003] bw ( KiB/s): min= 7, max= 95, per=28.84%, avg=25.95, stdev=17.34, samples=443 iops : min= 1, max= 23, avg= 5.88, stdev= 4.39, samples=443 write: IOPS=5, BW=23.9KiB/s (24.4kB/s)(6348KiB/265945msec); 0 zone resets clat (msec): min=35, max=579, avg=133.29, stdev=76.51 lat (msec): min=35, max=579, avg=133.29, stdev=76.51 clat percentiles (msec): | 1.00th=[ 48], 5.00th=[ 61], 10.00th=[ 68], 20.00th=[ 79], | 30.00th=[ 88], 40.00th=[ 99], 50.00th=[ 109], 60.00th=[ 123], | 70.00th=[ 140], 80.00th=[ 174], 90.00th=[ 245], 95.00th=[ 305], | 99.00th=[ 409], 99.50th=[ 435], 99.90th=[ 481], 99.95th=[ 584], | 99.99th=[ 584] bw ( KiB/s): min= 7, max= 55, per=25.42%, avg=23.89, stdev=12.00, samples=513 iops : min= 1, max= 13, avg= 5.35, stdev= 3.08, samples=513 lat (msec) : 10=5.01%, 20=16.50%, 50=18.36%, 100=27.83%, 250=27.25% lat (msec) : 500=4.95%, 750=0.07%, 2000=0.03% cpu : usr=0.04%, sys=1.10%, ctx=5364, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144778: Sat Sep 5 12:18:22 2026 read: IOPS=5, BW=22.7KiB/s (23.2kB/s)(6028KiB/265981msec) clat (msec): min=5, max=666, avg=38.39, stdev=42.03 lat (msec): min=5, max=666, avg=38.39, stdev=42.03 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 14], | 30.00th=[ 17], 40.00th=[ 20], 50.00th=[ 25], 60.00th=[ 31], | 70.00th=[ 39], 80.00th=[ 52], 90.00th=[ 86], 95.00th=[ 120], | 99.00th=[ 197], 99.50th=[ 247], 99.90th=[ 380], 99.95th=[ 667], | 99.99th=[ 667] bw ( KiB/s): min= 7, max= 103, per=27.78%, avg=25.00, stdev=17.74, samples=466 iops : min= 1, max= 25, avg= 5.64, stdev= 4.46, samples=466 write: IOPS=5, BW=23.5KiB/s (24.1kB/s)(6260KiB/265981msec); 0 zone resets clat (msec): min=36, max=1010, avg=132.74, stdev=76.73 lat (msec): min=36, max=1010, avg=132.75, stdev=76.73 clat percentiles (msec): | 1.00th=[ 50], 5.00th=[ 62], 10.00th=[ 69], 20.00th=[ 79], | 30.00th=[ 89], 40.00th=[ 99], 50.00th=[ 109], 60.00th=[ 122], | 70.00th=[ 142], 80.00th=[ 176], 90.00th=[ 234], 95.00th=[ 292], | 99.00th=[ 401], 99.50th=[ 451], 99.90th=[ 567], 99.95th=[ 1011], | 99.99th=[ 1011] bw ( KiB/s): min= 7, max= 55, per=25.08%, avg=23.58, stdev=11.90, samples=512 iops : min= 1, max= 13, avg= 5.28, stdev= 3.05, samples=512 lat (msec) : 10=4.56%, 20=15.20%, 50=19.63%, 100=26.86%, 250=29.33% lat (msec) : 500=4.30%, 750=0.10%, 2000=0.03% cpu : usr=0.04%, sys=1.14%, ctx=5436, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144779: Sat Sep 5 12:18:22 2026 read: IOPS=5, BW=22.9KiB/s (23.4kB/s)(6052KiB/264481msec) clat (msec): min=5, max=486, avg=34.72, stdev=37.47 lat (msec): min=5, max=486, avg=34.72, stdev=37.47 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 14], | 30.00th=[ 16], 40.00th=[ 19], 50.00th=[ 23], 60.00th=[ 28], | 70.00th=[ 35], 80.00th=[ 47], 90.00th=[ 74], 95.00th=[ 105], | 99.00th=[ 180], 99.50th=[ 243], 99.90th=[ 414], 99.95th=[ 485], | 99.99th=[ 485] bw ( KiB/s): min= 7, max= 127, per=29.07%, avg=26.16, stdev=18.25, samples=448 iops : min= 1, max= 31, avg= 5.93, stdev= 4.61, samples=448 write: IOPS=5, BW=23.6KiB/s (24.1kB/s)(6236KiB/264481msec); 0 zone resets clat (msec): min=33, max=1012, avg=135.70, stdev=84.23 lat (msec): min=33, max=1012, avg=135.70, stdev=84.24 clat percentiles (msec): | 1.00th=[ 47], 5.00th=[ 59], 10.00th=[ 69], 20.00th=[ 78], | 30.00th=[ 88], 40.00th=[ 99], 50.00th=[ 108], 60.00th=[ 123], | 70.00th=[ 142], 80.00th=[ 184], 90.00th=[ 245], 95.00th=[ 305], | 99.00th=[ 422], 99.50th=[ 527], 99.90th=[ 659], 99.95th=[ 1011], | 99.99th=[ 1011] bw ( KiB/s): min= 7, max= 55, per=25.00%, avg=23.50, stdev=12.15, samples=512 iops : min= 1, max= 13, avg= 5.26, stdev= 3.10, samples=512 lat (msec) : 10=4.00%, 20=17.71%, 50=19.53%, 100=26.86%, 250=27.02% lat (msec) : 500=4.62%, 750=0.23%, 2000=0.03% cpu : usr=0.03%, sys=1.14%, ctx=5591, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=90.2KiB/s (92.3kB/s), 22.3KiB/s-22.9KiB/s (22.9kB/s-23.4kB/s), io=23.4MiB (24.6MB), run=264481-266273msec WRITE: bw=94.4KiB/s (96.7kB/s), 23.5KiB/s-23.9KiB/s (24.1kB/s-24.4kB/s), io=24.6MiB (25.7MB), run=264481-266273msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144836: Sat Sep 5 12:18:55 2026 read: IOPS=15, BW=247KiB/s (253kB/s)(5920KiB/23956msec) clat (usec): min=33, max=154994, avg=30735.53, stdev=26609.54 lat (usec): min=33, max=154995, avg=30737.02, stdev=26609.30 clat percentiles (usec): | 1.00th=[ 37], 5.00th=[ 54], 10.00th=[ 60], 20.00th=[ 77], | 30.00th=[ 17695], 40.00th=[ 22414], 50.00th=[ 28443], 60.00th=[ 34866], | 70.00th=[ 41681], 80.00th=[ 49021], 90.00th=[ 63177], 95.00th=[ 76022], | 99.00th=[129500], 99.50th=[145753], 99.90th=[154141], 99.95th=[154141], | 99.99th=[154141] bw ( KiB/s): min= 61, max= 632, per=24.56%, avg=245.32, stdev=101.72, samples=47 iops : min= 3, max= 39, avg=14.57, stdev= 6.37, samples=47 write: IOPS=16, BW=266KiB/s (272kB/s)(6368KiB/23956msec); 0 zone resets clat (usec): min=1440, max=273726, avg=30881.40, stdev=33671.41 lat (usec): min=1442, max=273727, avg=30884.70, stdev=33671.20 clat percentiles (usec): | 1.00th=[ 1532], 5.00th=[ 1991], 10.00th=[ 2868], 20.00th=[ 4686], | 30.00th=[ 8291], 40.00th=[ 13566], 50.00th=[ 21627], 60.00th=[ 30278], | 70.00th=[ 40633], 80.00th=[ 51119], 90.00th=[ 66847], 95.00th=[ 82314], | 99.00th=[183501], 99.50th=[258999], 99.90th=[274727], 99.95th=[274727], | 99.99th=[274727] bw ( KiB/s): min= 63, max= 727, per=25.83%, avg=271.48, stdev=119.80, samples=46 iops : min= 3, max= 45, avg=16.22, stdev= 7.55, samples=46 lat (usec) : 50=1.56%, 100=8.59%, 250=1.04%, 500=0.52%, 750=0.13% lat (usec) : 1000=0.13% lat (msec) : 2=3.12%, 4=5.21%, 10=9.64%, 20=11.72%, 50=37.76% lat (msec) : 100=18.10%, 250=2.21%, 500=0.26% cpu : usr=0.09%, sys=7.13%, ctx=1489, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144837: Sat Sep 5 12:18:55 2026 read: IOPS=15, BW=248KiB/s (253kB/s)(5744KiB/23208msec) clat (usec): min=38, max=283463, avg=32959.64, stdev=30207.17 lat (usec): min=39, max=283463, avg=32960.84, stdev=30207.19 clat percentiles (usec): | 1.00th=[ 43], 5.00th=[ 57], 10.00th=[ 65], 20.00th=[ 131], | 30.00th=[ 17433], 40.00th=[ 23462], 50.00th=[ 29230], 60.00th=[ 35914], | 70.00th=[ 45351], 80.00th=[ 53740], 90.00th=[ 67634], 95.00th=[ 80217], | 99.00th=[106431], 99.50th=[183501], 99.90th=[283116], 99.95th=[283116], | 99.99th=[283116] bw ( KiB/s): min= 63, max= 384, per=24.81%, avg=247.89, stdev=87.73, samples=45 iops : min= 3, max= 24, avg=14.73, stdev= 5.53, samples=45 write: IOPS=17, BW=282KiB/s (289kB/s)(6544KiB/23208msec); 0 zone resets clat (usec): min=1338, max=193939, avg=27687.07, stdev=30370.30 lat (usec): min=1339, max=193941, avg=27690.01, stdev=30369.83 clat percentiles (usec): | 1.00th=[ 1516], 5.00th=[ 1745], 10.00th=[ 2474], 20.00th=[ 4293], | 30.00th=[ 6325], 40.00th=[ 9110], 50.00th=[ 16450], 60.00th=[ 24249], | 70.00th=[ 34866], 80.00th=[ 49021], 90.00th=[ 70779], 95.00th=[ 83362], | 99.00th=[127402], 99.50th=[139461], 99.90th=[193987], 99.95th=[193987], | 99.99th=[193987] bw ( KiB/s): min= 31, max= 571, per=26.57%, avg=279.22, stdev=107.99, samples=45 iops : min= 1, max= 35, avg=16.71, stdev= 6.81, samples=45 lat (usec) : 50=0.91%, 100=7.03%, 250=1.95%, 500=0.52%, 750=0.13% lat (msec) : 2=3.78%, 4=6.12%, 10=12.76%, 20=11.20%, 50=34.38% lat (msec) : 100=18.75%, 250=2.34%, 500=0.13% cpu : usr=0.06%, sys=7.20%, ctx=1442, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144838: Sat Sep 5 12:18:55 2026 read: IOPS=17, BW=275KiB/s (282kB/s)(6256KiB/22735msec) clat (usec): min=38, max=214748, avg=29376.30, stdev=28061.88 lat (usec): min=38, max=214749, avg=29377.61, stdev=28061.77 clat percentiles (usec): | 1.00th=[ 41], 5.00th=[ 55], 10.00th=[ 62], 20.00th=[ 75], | 30.00th=[ 16057], 40.00th=[ 21103], 50.00th=[ 27657], 60.00th=[ 33424], | 70.00th=[ 38011], 80.00th=[ 45876], 90.00th=[ 58459], 95.00th=[ 73925], | 99.00th=[141558], 99.50th=[175113], 99.90th=[214959], 99.95th=[214959], | 99.99th=[214959] bw ( KiB/s): min= 120, max= 541, per=27.76%, avg=277.30, stdev=103.60, samples=44 iops : min= 7, max= 33, avg=16.57, stdev= 6.47, samples=44 write: IOPS=16, BW=265KiB/s (272kB/s)(6032KiB/22735msec); 0 zone resets clat (usec): min=1329, max=189786, avg=29266.59, stdev=30530.04 lat (usec): min=1331, max=189788, avg=29271.77, stdev=30527.85 clat percentiles (usec): | 1.00th=[ 1483], 5.00th=[ 1827], 10.00th=[ 2540], 20.00th=[ 4752], | 30.00th=[ 6849], 40.00th=[ 11338], 50.00th=[ 18220], 60.00th=[ 27132], | 70.00th=[ 39060], 80.00th=[ 54264], 90.00th=[ 72877], 95.00th=[ 86508], | 99.00th=[149947], 99.50th=[183501], 99.90th=[189793], 99.95th=[189793], | 99.99th=[189793] bw ( KiB/s): min= 63, max= 479, per=25.11%, avg=263.89, stdev=94.52, samples=44 iops : min= 3, max= 29, avg=15.75, stdev= 6.00, samples=44 lat (usec) : 50=1.69%, 100=10.03%, 250=0.78%, 500=0.26%, 1000=0.13% lat (msec) : 2=3.26%, 4=5.47%, 10=11.59%, 20=11.46%, 50=36.20% lat (msec) : 100=17.19%, 250=1.95% cpu : usr=0.11%, sys=7.22%, ctx=1468, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144839: Sat Sep 5 12:18:55 2026 read: IOPS=16, BW=266KiB/s (272kB/s)(6032KiB/22682msec) clat (usec): min=28, max=228057, avg=29045.84, stdev=26985.83 lat (usec): min=28, max=228058, avg=29047.03, stdev=26985.84 clat percentiles (usec): | 1.00th=[ 37], 5.00th=[ 56], 10.00th=[ 63], 20.00th=[ 85], | 30.00th=[ 15008], 40.00th=[ 22414], 50.00th=[ 26608], 60.00th=[ 31065], | 70.00th=[ 37487], 80.00th=[ 47449], 90.00th=[ 62129], 95.00th=[ 76022], | 99.00th=[110625], 99.50th=[177210], 99.90th=[227541], 99.95th=[227541], | 99.99th=[227541] bw ( KiB/s): min= 31, max= 599, per=26.57%, avg=265.48, stdev=103.00, samples=44 iops : min= 1, max= 37, avg=15.84, stdev= 6.46, samples=44 write: IOPS=17, BW=276KiB/s (282kB/s)(6256KiB/22682msec); 0 zone resets clat (usec): min=1321, max=196205, avg=29505.05, stdev=33158.07 lat (usec): min=1323, max=196207, avg=29507.20, stdev=33157.95 clat percentiles (usec): | 1.00th=[ 1467], 5.00th=[ 1844], 10.00th=[ 2671], 20.00th=[ 4424], | 30.00th=[ 6128], 40.00th=[ 10421], 50.00th=[ 17695], 60.00th=[ 25297], | 70.00th=[ 36963], 80.00th=[ 51643], 90.00th=[ 71828], 95.00th=[104334], | 99.00th=[147850], 99.50th=[175113], 99.90th=[196084], 99.95th=[196084], | 99.99th=[196084] bw ( KiB/s): min= 121, max= 479, per=26.30%, avg=276.36, stdev=89.36, samples=44 iops : min= 7, max= 29, avg=16.52, stdev= 5.60, samples=44 lat (usec) : 50=1.82%, 100=8.85%, 250=1.04%, 500=0.13%, 750=0.13% lat (usec) : 1000=0.13% lat (msec) : 2=4.56%, 4=5.99%, 10=11.07%, 20=11.59%, 50=35.42% lat (msec) : 100=15.49%, 250=3.78% cpu : usr=0.07%, sys=7.47%, ctx=1437, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1000KiB/s (1024kB/s), 247KiB/s-275KiB/s (253kB/s-282kB/s), io=23.4MiB (24.5MB), run=22682-23956msec WRITE: bw=1052KiB/s (1077kB/s), 265KiB/s-282KiB/s (272kB/s-289kB/s), io=24.6MiB (25.8MB), run=22682-23956msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144840: Sat Sep 5 12:19:33 2026 read: IOPS=5, BW=95.8KiB/s (98.1kB/s)(5920KiB/61821msec) clat (msec): min=5, max=155, avg=34.74, stdev=28.52 lat (msec): min=5, max=155, avg=34.74, stdev=28.52 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 12], 20.00th=[ 15], | 30.00th=[ 18], 40.00th=[ 22], 50.00th=[ 26], 60.00th=[ 30], | 70.00th=[ 37], 80.00th=[ 51], 90.00th=[ 69], 95.00th=[ 106], | 99.00th=[ 142], 99.50th=[ 150], 99.90th=[ 155], 99.95th=[ 155], | 99.99th=[ 155] bw ( KiB/s): min= 31, max= 318, per=26.50%, avg=102.55, stdev=61.24, samples=112 iops : min= 1, max= 19, avg= 5.69, stdev= 3.93, samples=112 write: IOPS=6, BW=103KiB/s (105kB/s)(6368KiB/61821msec); 0 zone resets clat (msec): min=30, max=487, avg=122.50, stdev=51.56 lat (msec): min=30, max=487, avg=122.50, stdev=51.56 clat percentiles (msec): | 1.00th=[ 47], 5.00th=[ 64], 10.00th=[ 71], 20.00th=[ 82], | 30.00th=[ 92], 40.00th=[ 104], 50.00th=[ 114], 60.00th=[ 126], | 70.00th=[ 138], 80.00th=[ 153], 90.00th=[ 180], 95.00th=[ 220], | 99.00th=[ 292], 99.50th=[ 334], 99.90th=[ 489], 99.95th=[ 489], | 99.99th=[ 489] bw ( KiB/s): min= 29, max= 192, per=25.02%, avg=101.81, stdev=39.50, samples=122 iops : min= 1, max= 12, avg= 5.62, stdev= 2.55, samples=122 lat (msec) : 10=3.39%, 20=15.10%, 50=20.83%, 100=25.78%, 250=33.07% lat (msec) : 500=1.82% cpu : usr=0.04%, sys=1.43%, ctx=1377, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144841: Sat Sep 5 12:19:33 2026 read: IOPS=5, BW=93.6KiB/s (95.9kB/s)(5744KiB/61363msec) clat (msec): min=5, max=181, avg=34.49, stdev=30.82 lat (msec): min=5, max=181, avg=34.49, stdev=30.82 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 11], 10.00th=[ 12], 20.00th=[ 15], | 30.00th=[ 17], 40.00th=[ 21], 50.00th=[ 24], 60.00th=[ 29], | 70.00th=[ 34], 80.00th=[ 48], 90.00th=[ 72], 95.00th=[ 99], | 99.00th=[ 161], 99.50th=[ 176], 99.90th=[ 182], 99.95th=[ 182], | 99.99th=[ 182] bw ( KiB/s): min= 29, max= 320, per=26.88%, avg=104.04, stdev=65.81, samples=108 iops : min= 1, max= 20, avg= 5.77, stdev= 4.16, samples=108 write: IOPS=6, BW=107KiB/s (109kB/s)(6544KiB/61363msec); 0 zone resets clat (msec): min=31, max=346, avg=119.55, stdev=47.30 lat (msec): min=31, max=346, avg=119.55, stdev=47.30 clat percentiles (msec): | 1.00th=[ 47], 5.00th=[ 63], 10.00th=[ 74], 20.00th=[ 82], | 30.00th=[ 92], 40.00th=[ 102], 50.00th=[ 111], 60.00th=[ 118], | 70.00th=[ 132], 80.00th=[ 153], 90.00th=[ 184], 95.00th=[ 211], | 99.00th=[ 271], 99.50th=[ 305], 99.90th=[ 347], 99.95th=[ 347], | 99.99th=[ 347] bw ( KiB/s): min= 31, max= 224, per=26.06%, avg=106.06, stdev=42.10, samples=121 iops : min= 1, max= 14, avg= 5.89, stdev= 2.72, samples=121 lat (msec) : 10=2.08%, 20=16.15%, 50=21.09%, 100=25.91%, 250=33.59% lat (msec) : 500=1.17% cpu : usr=0.05%, sys=1.37%, ctx=1348, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144842: Sat Sep 5 12:19:33 2026 read: IOPS=6, BW=106KiB/s (109kB/s)(6256KiB/58772msec) clat (msec): min=5, max=232, avg=32.48, stdev=30.56 lat (msec): min=5, max=232, avg=32.49, stdev=30.56 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 12], 20.00th=[ 14], | 30.00th=[ 17], 40.00th=[ 19], 50.00th=[ 23], 60.00th=[ 27], | 70.00th=[ 34], 80.00th=[ 43], 90.00th=[ 61], 95.00th=[ 94], | 99.00th=[ 180], 99.50th=[ 203], 99.90th=[ 234], 99.95th=[ 234], | 99.99th=[ 234] bw ( KiB/s): min= 31, max= 318, per=29.64%, avg=114.70, stdev=73.88, samples=108 iops : min= 1, max= 19, avg= 6.44, stdev= 4.67, samples=108 write: IOPS=6, BW=103KiB/s (105kB/s)(6032KiB/58772msec); 0 zone resets clat (msec): min=40, max=357, avg=121.34, stdev=48.88 lat (msec): min=40, max=357, avg=121.35, stdev=48.88 clat percentiles (msec): | 1.00th=[ 50], 5.00th=[ 58], 10.00th=[ 69], 20.00th=[ 81], | 30.00th=[ 91], 40.00th=[ 102], 50.00th=[ 112], 60.00th=[ 126], | 70.00th=[ 138], 80.00th=[ 157], 90.00th=[ 180], 95.00th=[ 220], | 99.00th=[ 271], 99.50th=[ 321], 99.90th=[ 359], 99.95th=[ 359], | 99.99th=[ 359] bw ( KiB/s): min= 29, max= 224, per=25.31%, avg=103.03, stdev=39.27, samples=115 iops : min= 1, max= 14, avg= 5.70, stdev= 2.52, samples=115 lat (msec) : 10=2.60%, 20=20.18%, 50=20.57%, 100=24.35%, 250=31.12% lat (msec) : 500=1.17% cpu : usr=0.04%, sys=1.43%, ctx=1410, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144843: Sat Sep 5 12:19:33 2026 read: IOPS=6, BW=99.8KiB/s (102kB/s)(6032KiB/60453msec) clat (msec): min=6, max=173, avg=33.20, stdev=26.14 lat (msec): min=6, max=173, avg=33.20, stdev=26.14 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 13], 20.00th=[ 15], | 30.00th=[ 18], 40.00th=[ 21], 50.00th=[ 24], 60.00th=[ 30], | 70.00th=[ 37], 80.00th=[ 48], 90.00th=[ 67], 95.00th=[ 90], | 99.00th=[ 138], 99.50th=[ 155], 99.90th=[ 174], 99.95th=[ 174], | 99.99th=[ 174] bw ( KiB/s): min= 31, max= 320, per=28.40%, avg=109.91, stdev=68.78, samples=107 iops : min= 1, max= 20, avg= 6.13, stdev= 4.43, samples=107 write: IOPS=6, BW=103KiB/s (106kB/s)(6256KiB/60453msec); 0 zone resets clat (msec): min=33, max=489, avg=121.91, stdev=51.94 lat (msec): min=33, max=489, avg=121.92, stdev=51.94 clat percentiles (msec): | 1.00th=[ 50], 5.00th=[ 63], 10.00th=[ 70], 20.00th=[ 80], | 30.00th=[ 90], 40.00th=[ 104], 50.00th=[ 112], 60.00th=[ 126], | 70.00th=[ 138], 80.00th=[ 157], 90.00th=[ 186], 95.00th=[ 220], | 99.00th=[ 313], 99.50th=[ 326], 99.90th=[ 489], 99.95th=[ 489], | 99.99th=[ 489] bw ( KiB/s): min= 29, max= 192, per=25.31%, avg=103.02, stdev=40.82, samples=119 iops : min= 1, max= 12, avg= 5.70, stdev= 2.61, samples=119 lat (msec) : 10=2.99%, 20=15.23%, 50=22.79%, 100=26.43%, 250=31.25% lat (msec) : 500=1.30% cpu : usr=0.03%, sys=1.46%, ctx=1383, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=387KiB/s (397kB/s), 93.6KiB/s-106KiB/s (95.9kB/s-109kB/s), io=23.4MiB (24.5MB), run=58772-61821msec WRITE: bw=408KiB/s (417kB/s), 103KiB/s-107KiB/s (105kB/s-109kB/s), io=24.6MiB (25.8MB), run=58772-61821msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144858: Sat Sep 5 12:19:48 2026 read: IOPS=1, BW=1626KiB/s (1665kB/s)(7168KiB/4408msec) clat (msec): min=90, max=537, avg=223.82, stdev=177.65 lat (msec): min=90, max=537, avg=223.82, stdev=177.65 clat percentiles (msec): | 1.00th=[ 90], 5.00th=[ 90], 10.00th=[ 90], 20.00th=[ 102], | 30.00th=[ 122], 40.00th=[ 122], 50.00th=[ 140], 60.00th=[ 163], | 70.00th=[ 163], 80.00th=[ 418], 90.00th=[ 542], 95.00th=[ 542], | 99.00th=[ 542], 99.50th=[ 542], 99.90th=[ 542], 99.95th=[ 542], | 99.99th=[ 542] bw ( KiB/s): min= 1976, max= 4551, per=84.49%, avg=3430.33, stdev=1319.53, samples=3 iops : min= 1, max= 4, avg= 2.67, stdev= 1.53, samples=3 write: IOPS=1, BW=1162KiB/s (1189kB/s)(5120KiB/4408msec); 0 zone resets clat (msec): min=189, max=1258, avg=529.26, stdev=451.66 lat (msec): min=189, max=1258, avg=529.33, stdev=451.67 clat percentiles (msec): | 1.00th=[ 190], 5.00th=[ 190], 10.00th=[ 190], 20.00th=[ 190], | 30.00th=[ 209], 40.00th=[ 209], 50.00th=[ 317], 60.00th=[ 317], | 70.00th=[ 676], 80.00th=[ 676], 90.00th=[ 1267], 95.00th=[ 1267], | 99.00th=[ 1267], 99.50th=[ 1267], 99.90th=[ 1267], 99.95th=[ 1267], | 99.99th=[ 1267] bw ( KiB/s): min= 1882, max= 3757, per=42.12%, avg=2394.25, stdev=909.51, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (msec) : 100=8.33%, 250=50.00%, 500=16.67%, 750=16.67%, 2000=8.33% cpu : usr=0.07%, sys=4.04%, ctx=73, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144859: Sat Sep 5 12:19:48 2026 read: IOPS=0, BW=406KiB/s (416kB/s)(2048KiB/5044msec) clat (msec): min=107, max=222, avg=164.91, stdev=80.85 lat (msec): min=107, max=222, avg=164.91, stdev=80.85 clat percentiles (msec): | 1.00th=[ 108], 5.00th=[ 108], 10.00th=[ 108], 20.00th=[ 108], | 30.00th=[ 108], 40.00th=[ 108], 50.00th=[ 108], 60.00th=[ 222], | 70.00th=[ 222], 80.00th=[ 222], 90.00th=[ 222], 95.00th=[ 222], | 99.00th=[ 222], 99.50th=[ 222], 99.90th=[ 222], 99.95th=[ 222], | 99.99th=[ 222] bw ( KiB/s): min= 1523, max= 1878, per=41.88%, avg=1700.50, stdev=251.02, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=2030KiB/s (2079kB/s)(10.0MiB/5044msec); 0 zone resets clat (msec): min=182, max=970, avg=467.76, stdev=264.66 lat (msec): min=182, max=970, avg=467.84, stdev=264.69 clat percentiles (msec): | 1.00th=[ 182], 5.00th=[ 182], 10.00th=[ 182], 20.00th=[ 213], | 30.00th=[ 226], 40.00th=[ 313], 50.00th=[ 368], 60.00th=[ 388], | 70.00th=[ 651], 80.00th=[ 651], 90.00th=[ 726], 95.00th=[ 969], | 99.00th=[ 969], 99.50th=[ 969], 99.90th=[ 969], 99.95th=[ 969], | 99.99th=[ 969] bw ( KiB/s): min= 1882, max= 3047, per=36.94%, avg=2099.75, stdev=385.54, samples=8 iops : min= 1, max= 2, avg= 1.12, stdev= 0.35, samples=8 lat (msec) : 250=41.67%, 500=25.00%, 750=25.00%, 1000=8.33% cpu : usr=0.00%, sys=4.12%, ctx=96, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144860: Sat Sep 5 12:19:48 2026 read: IOPS=1, BW=1286KiB/s (1316kB/s)(6144KiB/4779msec) clat (msec): min=91, max=613, avg=290.39, stdev=188.87 lat (msec): min=91, max=613, avg=290.40, stdev=188.87 clat percentiles (msec): | 1.00th=[ 92], 5.00th=[ 92], 10.00th=[ 92], 20.00th=[ 138], | 30.00th=[ 138], 40.00th=[ 236], 50.00th=[ 236], 60.00th=[ 284], | 70.00th=[ 384], 80.00th=[ 384], 90.00th=[ 617], 95.00th=[ 617], | 99.00th=[ 617], 99.50th=[ 617], 99.90th=[ 617], 99.95th=[ 617], | 99.99th=[ 617] bw ( KiB/s): min= 1882, max= 3757, per=59.11%, avg=2400.00, stdev=906.12, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 write: IOPS=1, BW=1286KiB/s (1316kB/s)(6144KiB/4779msec); 0 zone resets clat (msec): min=248, max=879, avg=478.94, stdev=262.30 lat (msec): min=248, max=880, avg=479.02, stdev=262.30 clat percentiles (msec): | 1.00th=[ 249], 5.00th=[ 249], 10.00th=[ 249], 20.00th=[ 279], | 30.00th=[ 279], 40.00th=[ 317], 50.00th=[ 317], 60.00th=[ 426], | 70.00th=[ 726], 80.00th=[ 726], 90.00th=[ 877], 95.00th=[ 877], | 99.00th=[ 877], 99.50th=[ 877], 99.90th=[ 877], 99.95th=[ 877], | 99.99th=[ 877] bw ( KiB/s): min= 1549, max= 3764, per=40.97%, avg=2329.00, stdev=980.38, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (msec) : 100=8.33%, 250=25.00%, 500=41.67%, 750=16.67%, 1000=8.33% cpu : usr=0.00%, sys=3.22%, ctx=78, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144861: Sat Sep 5 12:19:48 2026 read: IOPS=1, BW=1113KiB/s (1140kB/s)(5120KiB/4599msec) clat (msec): min=83, max=475, avg=288.01, stdev=144.82 lat (msec): min=83, max=475, avg=288.02, stdev=144.82 clat percentiles (msec): | 1.00th=[ 84], 5.00th=[ 84], 10.00th=[ 84], 20.00th=[ 84], | 30.00th=[ 230], 40.00th=[ 230], 50.00th=[ 309], 60.00th=[ 309], | 70.00th=[ 342], 80.00th=[ 342], 90.00th=[ 477], 95.00th=[ 477], | 99.00th=[ 477], 99.50th=[ 477], 99.90th=[ 477], 99.95th=[ 477], | 99.99th=[ 477] bw ( KiB/s): min= 3757, max= 3968, per=95.14%, avg=3862.50, stdev=149.20, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1559KiB/s (1596kB/s)(7168KiB/4599msec); 0 zone resets clat (msec): min=236, max=938, avg=441.31, stdev=271.50 lat (msec): min=236, max=938, avg=441.39, stdev=271.51 clat percentiles (msec): | 1.00th=[ 236], 5.00th=[ 236], 10.00th=[ 236], 20.00th=[ 271], | 30.00th=[ 275], 40.00th=[ 275], 50.00th=[ 284], 60.00th=[ 384], | 70.00th=[ 384], 80.00th=[ 701], 90.00th=[ 936], 95.00th=[ 936], | 99.00th=[ 936], 99.50th=[ 936], 99.90th=[ 936], 99.95th=[ 936], | 99.99th=[ 936] bw ( KiB/s): min= 1882, max= 3908, per=48.57%, avg=2760.50, stdev=973.36, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 1.15, samples=4 lat (msec) : 100=8.33%, 250=16.67%, 500=58.33%, 750=8.33%, 1000=8.33% cpu : usr=0.00%, sys=3.02%, ctx=61, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4060KiB/s (4158kB/s), 406KiB/s-1626KiB/s (416kB/s-1665kB/s), io=20.0MiB (20.0MB), run=4408-5044msec WRITE: bw=5684KiB/s (5821kB/s), 1162KiB/s-2030KiB/s (1189kB/s-2079kB/s), io=28.0MiB (29.4MB), run=4408-5044msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144863: Sat Sep 5 12:19:48 2026 read: IOPS=1, BW=1910KiB/s (1956kB/s)(7168KiB/3752msec) clat (msec): min=173, max=386, avg=263.96, stdev=73.08 lat (msec): min=173, max=386, avg=263.96, stdev=73.08 clat percentiles (msec): | 1.00th=[ 174], 5.00th=[ 174], 10.00th=[ 174], 20.00th=[ 205], | 30.00th=[ 222], 40.00th=[ 222], 50.00th=[ 257], 60.00th=[ 288], | 70.00th=[ 288], 80.00th=[ 317], 90.00th=[ 388], 95.00th=[ 388], | 99.00th=[ 388], 99.50th=[ 388], 99.90th=[ 388], 99.95th=[ 388], | 99.99th=[ 388] bw ( KiB/s): min= 1762, max= 4000, per=47.68%, avg=2317.60, stdev=949.76, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 write: IOPS=1, BW=1365KiB/s (1397kB/s)(5120KiB/3752msec); 0 zone resets clat (msec): min=148, max=715, avg=380.05, stdev=209.99 lat (msec): min=148, max=715, avg=380.12, stdev=209.98 clat percentiles (msec): | 1.00th=[ 148], 5.00th=[ 148], 10.00th=[ 148], 20.00th=[ 148], | 30.00th=[ 279], 40.00th=[ 279], 50.00th=[ 363], 60.00th=[ 363], | 70.00th=[ 393], 80.00th=[ 393], 90.00th=[ 718], 95.00th=[ 718], | 99.00th=[ 718], 99.50th=[ 718], 99.90th=[ 718], 99.95th=[ 718], | 99.99th=[ 718] bw ( KiB/s): min= 1762, max= 3537, per=34.16%, avg=2324.50, stdev=816.05, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (msec) : 250=33.33%, 500=58.33%, 750=8.33% cpu : usr=0.00%, sys=17.01%, ctx=301, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144864: Sat Sep 5 12:19:48 2026 read: IOPS=0, BW=486KiB/s (498kB/s)(2048KiB/4213msec) clat (msec): min=262, max=327, avg=294.88, stdev=45.81 lat (msec): min=262, max=327, avg=294.88, stdev=45.80 clat percentiles (msec): | 1.00th=[ 264], 5.00th=[ 264], 10.00th=[ 264], 20.00th=[ 264], | 30.00th=[ 264], 40.00th=[ 264], 50.00th=[ 264], 60.00th=[ 330], | 70.00th=[ 330], 80.00th=[ 330], 90.00th=[ 330], 95.00th=[ 330], | 99.00th=[ 330], 99.50th=[ 330], 99.90th=[ 330], 99.95th=[ 330], | 99.99th=[ 330] bw ( KiB/s): min= 1996, max= 2027, per=41.38%, avg=2011.50, stdev=21.92, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2431KiB/s (2489kB/s)(10.0MiB/4213msec); 0 zone resets clat (msec): min=141, max=608, avg=361.67, stdev=160.58 lat (msec): min=141, max=608, avg=361.81, stdev=160.60 clat percentiles (msec): | 1.00th=[ 142], 5.00th=[ 142], 10.00th=[ 142], 20.00th=[ 157], | 30.00th=[ 234], 40.00th=[ 300], 50.00th=[ 317], 60.00th=[ 401], | 70.00th=[ 409], 80.00th=[ 493], 90.00th=[ 558], 95.00th=[ 609], | 99.00th=[ 609], 99.50th=[ 609], 99.90th=[ 609], 99.95th=[ 609], | 99.99th=[ 609] bw ( KiB/s): min= 1762, max= 4087, per=43.22%, avg=2941.17, stdev=1195.69, samples=6 iops : min= 1, max= 3, avg= 2.00, stdev= 1.10, samples=6 lat (msec) : 250=25.00%, 500=58.33%, 750=16.67% cpu : usr=0.00%, sys=15.46%, ctx=197, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144865: Sat Sep 5 12:19:48 2026 read: IOPS=1, BW=1514KiB/s (1550kB/s)(6144KiB/4059msec) clat (usec): min=588, max=226504, avg=71895.90, stdev=110331.87 lat (usec): min=589, max=226506, avg=71897.04, stdev=110331.79 clat percentiles (usec): | 1.00th=[ 586], 5.00th=[ 586], 10.00th=[ 586], 20.00th=[ 701], | 30.00th=[ 701], 40.00th=[ 1045], 50.00th=[ 1045], 60.00th=[ 1123], | 70.00th=[202376], 80.00th=[202376], 90.00th=[227541], 95.00th=[227541], | 99.00th=[227541], 99.50th=[227541], 99.90th=[227541], 99.95th=[227541], | 99.99th=[227541] bw ( KiB/s): min= 1777, max= 3512, per=47.83%, avg=2325.00, stdev=798.67, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 write: IOPS=1, BW=1514KiB/s (1550kB/s)(6144KiB/4059msec); 0 zone resets clat (msec): min=324, max=891, avg=603.91, stdev=185.91 lat (msec): min=324, max=891, avg=603.97, stdev=185.91 clat percentiles (msec): | 1.00th=[ 326], 5.00th=[ 326], 10.00th=[ 326], 20.00th=[ 531], | 30.00th=[ 531], 40.00th=[ 575], 50.00th=[ 575], 60.00th=[ 634], | 70.00th=[ 676], 80.00th=[ 676], 90.00th=[ 894], 95.00th=[ 894], | 99.00th=[ 894], 99.50th=[ 894], 99.90th=[ 894], 99.95th=[ 894], | 99.99th=[ 894] bw ( KiB/s): min= 1393, max= 2039, per=26.86%, avg=1828.00, stdev=245.80, samples=6 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=6 lat (usec) : 750=16.67% lat (msec) : 2=16.67%, 250=16.67%, 500=8.33%, 750=33.33%, 1000=8.33% cpu : usr=0.00%, sys=11.51%, ctx=106, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144866: Sat Sep 5 12:19:48 2026 read: IOPS=1, BW=1276KiB/s (1306kB/s)(5120KiB/4013msec) clat (usec): min=467, max=262508, avg=53174.03, stdev=117022.15 lat (usec): min=468, max=262508, avg=53174.94, stdev=117021.87 clat percentiles (usec): | 1.00th=[ 469], 5.00th=[ 469], 10.00th=[ 469], 20.00th=[ 469], | 30.00th=[ 523], 40.00th=[ 523], 50.00th=[ 898], 60.00th=[ 898], | 70.00th=[ 1467], 80.00th=[ 1467], 90.00th=[263193], 95.00th=[263193], | 99.00th=[263193], 99.50th=[263193], 99.90th=[263193], 99.95th=[263193], | 99.99th=[263193] bw ( KiB/s): min= 8062, max= 8062, per=100.00%, avg=8062.00, stdev= 0.00, samples=1 iops : min= 7, max= 7, avg= 7.00, stdev= 0.00, samples=1 write: IOPS=1, BW=1786KiB/s (1829kB/s)(7168KiB/4013msec); 0 zone resets clat (msec): min=144, max=864, avg=534.98, stdev=290.76 lat (msec): min=144, max=864, avg=535.05, stdev=290.76 clat percentiles (msec): | 1.00th=[ 144], 5.00th=[ 144], 10.00th=[ 144], 20.00th=[ 165], | 30.00th=[ 510], 40.00th=[ 510], 50.00th=[ 531], 60.00th=[ 735], | 70.00th=[ 735], 80.00th=[ 802], 90.00th=[ 869], 95.00th=[ 869], | 99.00th=[ 869], 99.50th=[ 869], 99.90th=[ 869], 99.95th=[ 869], | 99.99th=[ 869] bw ( KiB/s): min= 1416, max= 3976, per=32.15%, avg=2188.00, stdev=1022.06, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 lat (usec) : 500=8.33%, 750=8.33%, 1000=8.33% lat (msec) : 2=8.33%, 250=16.67%, 500=8.33%, 750=25.00%, 1000=16.67% cpu : usr=0.00%, sys=9.62%, ctx=164, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4861KiB/s (4978kB/s), 486KiB/s-1910KiB/s (498kB/s-1956kB/s), io=20.0MiB (20.0MB), run=3752-4213msec WRITE: bw=6806KiB/s (6969kB/s), 1365KiB/s-2431KiB/s (1397kB/s-2489kB/s), io=28.0MiB (29.4MB), run=3752-4213msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144872: Sat Sep 5 12:20:03 2026 read: IOPS=0, BW=3668KiB/s (3756kB/s)(12.0MiB/3350msec) clat (msec): min=630, max=1208, avg=1002.75, stdev=323.20 lat (msec): min=630, max=1208, avg=1002.75, stdev=323.20 clat percentiles (msec): | 1.00th=[ 634], 5.00th=[ 634], 10.00th=[ 634], 20.00th=[ 634], | 30.00th=[ 634], 40.00th=[ 1167], 50.00th=[ 1167], 60.00th=[ 1167], | 70.00th=[ 1217], 80.00th=[ 1217], 90.00th=[ 1217], 95.00th=[ 1217], | 99.00th=[ 1217], 99.50th=[ 1217], 99.90th=[ 1217], 99.95th=[ 1217], | 99.99th=[ 1217] bw ( KiB/s): min= 7627, max= 8047, per=100.00%, avg=7837.00, stdev=296.98, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 2000=66.67% cpu : usr=0.00%, sys=3.79%, ctx=63, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144873: Sat Sep 5 12:20:03 2026 read: IOPS=0, BW=1295KiB/s (1326kB/s)(4096KiB/3163msec) clat (nsec): min=311473k, max=311473k, avg=311472908.00, stdev= 0.00 lat (nsec): min=311476k, max=311476k, avg=311475631.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 313], 5.00th=[ 313], 10.00th=[ 313], 20.00th=[ 313], | 30.00th=[ 313], 40.00th=[ 313], 50.00th=[ 313], 60.00th=[ 313], | 70.00th=[ 313], 80.00th=[ 313], 90.00th=[ 313], 95.00th=[ 313], | 99.00th=[ 313], 99.50th=[ 313], 99.90th=[ 313], 99.95th=[ 313], | 99.99th=[ 313] bw ( KiB/s): min= 8062, max= 8062, per=100.00%, avg=8062.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2590KiB/s (2652kB/s)(8192KiB/3163msec); 0 zone resets clat (msec): min=968, max=1542, avg=1255.23, stdev=405.83 lat (msec): min=968, max=1542, avg=1255.51, stdev=405.82 clat percentiles (msec): | 1.00th=[ 969], 5.00th=[ 969], 10.00th=[ 969], 20.00th=[ 969], | 30.00th=[ 969], 40.00th=[ 969], 50.00th=[ 969], 60.00th=[ 1536], | 70.00th=[ 1536], 80.00th=[ 1536], 90.00th=[ 1536], 95.00th=[ 1536], | 99.00th=[ 1536], 99.50th=[ 1536], 99.90th=[ 1536], 99.95th=[ 1536], | 99.99th=[ 1536] bw ( KiB/s): min= 7861, max= 7861, per=75.89%, avg=7861.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=4.84%, ctx=63, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144874: Sat Sep 5 12:20:03 2026 write: IOPS=1, BW=4265KiB/s (4368kB/s)(12.0MiB/2881msec); 0 zone resets clat (msec): min=789, max=955, avg=896.19, stdev=92.82 lat (msec): min=789, max=955, avg=896.62, stdev=92.54 clat percentiles (msec): | 1.00th=[ 793], 5.00th=[ 793], 10.00th=[ 793], 20.00th=[ 793], | 30.00th=[ 793], 40.00th=[ 944], 50.00th=[ 944], 60.00th=[ 944], | 70.00th=[ 953], 80.00th=[ 953], 90.00th=[ 953], 95.00th=[ 953], | 99.00th=[ 953], 99.50th=[ 953], 99.90th=[ 953], 99.95th=[ 953], | 99.99th=[ 953] bw ( KiB/s): min= 7861, max= 8062, per=76.86%, avg=7961.50, stdev=142.13, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=100.00% cpu : usr=0.00%, sys=4.58%, ctx=40, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144875: Sat Sep 5 12:20:03 2026 write: IOPS=1, BW=5939KiB/s (6082kB/s)(12.0MiB/2069msec); 0 zone resets clat (msec): min=586, max=633, avg=615.44, stdev=25.37 lat (msec): min=586, max=634, avg=615.79, stdev=25.39 clat percentiles (msec): | 1.00th=[ 584], 5.00th=[ 584], 10.00th=[ 584], 20.00th=[ 584], | 30.00th=[ 584], 40.00th=[ 625], 50.00th=[ 625], 60.00th=[ 625], | 70.00th=[ 634], 80.00th=[ 634], 90.00th=[ 634], 95.00th=[ 634], | 99.00th=[ 634], 99.50th=[ 634], 99.90th=[ 634], 99.95th=[ 634], | 99.99th=[ 634] bw ( KiB/s): min= 8062, max= 8062, per=77.83%, avg=8062.00, stdev= 0.00, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=100.00% cpu : usr=0.00%, sys=7.25%, ctx=62, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4891KiB/s (5008kB/s), 1295KiB/s-3668KiB/s (1326kB/s-3756kB/s), io=16.0MiB (16.8MB), run=3163-3350msec WRITE: bw=10.1MiB/s (10.6MB/s), 2590KiB/s-5939KiB/s (2652kB/s-6082kB/s), io=32.0MiB (33.6MB), run=2069-3163msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144877: Sat Sep 5 12:20:05 2026 read: IOPS=0, BW=3263KiB/s (3341kB/s)(12.0MiB/3766msec) clat (msec): min=1124, max=1364, avg=1254.27, stdev=120.88 lat (msec): min=1124, max=1364, avg=1254.27, stdev=120.88 clat percentiles (msec): | 1.00th=[ 1133], 5.00th=[ 1133], 10.00th=[ 1133], 20.00th=[ 1133], | 30.00th=[ 1133], 40.00th=[ 1267], 50.00th=[ 1267], 60.00th=[ 1267], | 70.00th=[ 1368], 80.00th=[ 1368], 90.00th=[ 1368], 95.00th=[ 1368], | 99.00th=[ 1368], 99.50th=[ 1368], 99.90th=[ 1368], 99.95th=[ 1368], | 99.99th=[ 1368] bw ( KiB/s): min= 8000, max= 8110, per=100.00%, avg=8055.00, stdev=77.78, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 2000=100.00% cpu : usr=0.00%, sys=8.66%, ctx=285, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144878: Sat Sep 5 12:20:05 2026 read: IOPS=0, BW=1151KiB/s (1179kB/s)(4096KiB/3558msec) clat (nsec): min=1270.6M, max=1270.6M, avg=1270558409.00, stdev= 0.00 lat (nsec): min=1270.6M, max=1270.6M, avg=1270560504.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1267], 5.00th=[ 1267], 10.00th=[ 1267], 20.00th=[ 1267], | 30.00th=[ 1267], 40.00th=[ 1267], 50.00th=[ 1267], 60.00th=[ 1267], | 70.00th=[ 1267], 80.00th=[ 1267], 90.00th=[ 1267], 95.00th=[ 1267], | 99.00th=[ 1267], 99.50th=[ 1267], 99.90th=[ 1267], 99.95th=[ 1267], | 99.99th=[ 1267] bw ( KiB/s): min= 8000, max= 8000, per=100.00%, avg=8000.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2302KiB/s (2358kB/s)(8192KiB/3558msec); 0 zone resets clat (msec): min=651, max=1631, avg=1141.07, stdev=692.89 lat (msec): min=651, max=1631, avg=1141.38, stdev=692.89 clat percentiles (msec): | 1.00th=[ 651], 5.00th=[ 651], 10.00th=[ 651], 20.00th=[ 651], | 30.00th=[ 651], 40.00th=[ 651], 50.00th=[ 651], 60.00th=[ 1636], | 70.00th=[ 1636], 80.00th=[ 1636], 90.00th=[ 1636], 95.00th=[ 1636], | 99.00th=[ 1636], 99.50th=[ 1636], 99.90th=[ 1636], 99.95th=[ 1636], | 99.99th=[ 1636] bw ( KiB/s): min= 8143, max= 8143, per=100.00%, avg=8143.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, 2000=66.67% cpu : usr=0.00%, sys=4.25%, ctx=119, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144879: Sat Sep 5 12:20:05 2026 write: IOPS=0, BW=2758KiB/s (2824kB/s)(12.0MiB/4455msec); 0 zone resets clat (msec): min=510, max=2010, avg=1483.39, stdev=843.63 lat (msec): min=510, max=2011, avg=1484.18, stdev=843.96 clat percentiles (msec): | 1.00th=[ 510], 5.00th=[ 510], 10.00th=[ 510], 20.00th=[ 510], | 30.00th=[ 510], 40.00th=[ 1921], 50.00th=[ 1921], 60.00th=[ 1921], | 70.00th=[ 2005], 80.00th=[ 2005], 90.00th=[ 2005], 95.00th=[ 2005], | 99.00th=[ 2005], 99.50th=[ 2005], 99.90th=[ 2005], 99.95th=[ 2005], | 99.99th=[ 2005] bw ( KiB/s): min= 7937, max= 8094, per=100.00%, avg=8015.50, stdev=111.02, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.13%, sys=3.59%, ctx=56, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144880: Sat Sep 5 12:20:05 2026 write: IOPS=0, BW=3657KiB/s (3745kB/s)(12.0MiB/3360msec); 0 zone resets clat (msec): min=487, max=2301, avg=1117.55, stdev=1025.91 lat (msec): min=488, max=2307, avg=1119.66, stdev=1029.14 clat percentiles (msec): | 1.00th=[ 489], 5.00th=[ 489], 10.00th=[ 489], 20.00th=[ 489], | 30.00th=[ 489], 40.00th=[ 567], 50.00th=[ 567], 60.00th=[ 567], | 70.00th=[ 2299], 80.00th=[ 2299], 90.00th=[ 2299], 95.00th=[ 2299], | 99.00th=[ 2299], 99.50th=[ 2299], 99.90th=[ 2299], 99.95th=[ 2299], | 99.99th=[ 2299] bw ( KiB/s): min= 7086, max= 8110, per=100.00%, avg=7598.00, stdev=724.08, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 750=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=4.85%, ctx=61, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4351KiB/s (4455kB/s), 1151KiB/s-3263KiB/s (1179kB/s-3341kB/s), io=16.0MiB (16.8MB), run=3558-3766msec WRITE: bw=7355KiB/s (7532kB/s), 2302KiB/s-3657KiB/s (2358kB/s-3745kB/s), io=32.0MiB (33.6MB), run=3360-4455msec