== sanity test 398b: DIO and buffer IO race ============== 09:32:32 (1775223152) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 8.10692 s, 6.2 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=181640: Fri Apr 3 09:35:00 2026 read: IOPS=12, BW=49.5KiB/s (50.6kB/s)(5992KiB/121142msec) clat (usec): min=38, max=699743, avg=44842.03, stdev=32849.32 lat (usec): min=38, max=699744, avg=44844.50, stdev=32850.40 clat percentiles (usec): | 1.00th=[ 52], 5.00th=[ 10683], 10.00th=[ 16712], 20.00th=[ 22938], | 30.00th=[ 28181], 40.00th=[ 32900], 50.00th=[ 39584], 60.00th=[ 45351], | 70.00th=[ 54264], 80.00th=[ 63177], 90.00th=[ 78119], 95.00th=[ 93848], | 99.00th=[141558], 99.50th=[175113], 99.90th=[254804], 99.95th=[700449], | 99.99th=[700449] bw ( KiB/s): min= 15, max= 103, per=24.77%, avg=49.05, stdev=17.66, samples=238 iops : min= 3, max= 25, avg=11.62, stdev= 4.44, samples=238 write: IOPS=12, BW=51.0KiB/s (53.2kB/s)(6296KiB/121142msec); 0 zone resets clat (usec): min=714, max=299157, avg=34006.73, stdev=33515.35 lat (usec): min=715, max=299159, avg=34010.23, stdev=33516.24 clat percentiles (usec): | 1.00th=[ 1205], 5.00th=[ 1336], 10.00th=[ 1860], 20.00th=[ 4490], | 30.00th=[ 8717], 40.00th=[ 17433], 50.00th=[ 24773], 60.00th=[ 33424], | 70.00th=[ 44303], 80.00th=[ 57410], 90.00th=[ 81265], 95.00th=[100140], | 99.00th=[139461], 99.50th=[164627], 99.90th=[198181], 99.95th=[299893], | 99.99th=[299893] bw ( KiB/s): min= 7, max= 127, per=24.90%, avg=51.55, stdev=21.34, samples=238 iops : min= 1, max= 31, avg=12.24, stdev= 5.37, samples=238 lat (usec) : 50=0.23%, 100=1.53%, 250=0.07%, 750=0.10%, 1000=0.10% lat (msec) : 2=5.27%, 4=3.91%, 10=7.49%, 20=10.64%, 50=40.92% lat (msec) : 100=25.46%, 250=4.20%, 500=0.07%, 750=0.03% cpu : usr=0.07%, sys=5.53%, ctx=6613, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181641: Fri Apr 3 09:35:00 2026 read: IOPS=12, BW=49.7KiB/s (50.9kB/s)(5940KiB/119446msec) clat (usec): min=29, max=677489, avg=44390.93, stdev=33434.80 lat (usec): min=29, max=677490, avg=44393.00, stdev=33434.58 clat percentiles (usec): | 1.00th=[ 54], 5.00th=[ 10552], 10.00th=[ 16581], 20.00th=[ 22152], | 30.00th=[ 26346], 40.00th=[ 31851], 50.00th=[ 37487], 60.00th=[ 44827], | 70.00th=[ 52167], 80.00th=[ 63177], 90.00th=[ 80217], 95.00th=[ 96994], | 99.00th=[158335], 99.50th=[185598], 99.90th=[210764], 99.95th=[675283], | 99.99th=[675283] bw ( KiB/s): min= 7, max= 134, per=24.87%, avg=49.25, stdev=19.90, samples=234 iops : min= 1, max= 33, avg=11.67, stdev= 5.00, samples=234 write: IOPS=13, BW=53.1KiB/s (54.4kB/s)(6348KiB/119446msec); 0 zone resets clat (usec): min=848, max=216550, avg=33460.03, stdev=35211.44 lat (usec): min=850, max=216551, avg=33461.86, stdev=35211.45 clat percentiles (usec): | 1.00th=[ 1172], 5.00th=[ 1352], 10.00th=[ 1844], 20.00th=[ 4015], | 30.00th=[ 7308], 40.00th=[ 14091], 50.00th=[ 23725], 60.00th=[ 32900], | 70.00th=[ 42206], 80.00th=[ 58459], 90.00th=[ 79168], 95.00th=[103285], | 99.00th=[154141], 99.50th=[181404], 99.90th=[210764], 99.95th=[217056], | 99.99th=[217056] bw ( KiB/s): min= 7, max= 143, per=25.46%, avg=52.70, stdev=22.94, samples=233 iops : min= 1, max= 35, avg=12.53, stdev= 5.79, samples=233 lat (usec) : 50=0.16%, 100=1.56%, 250=0.13%, 500=0.07%, 1000=0.10% lat (msec) : 2=5.47%, 4=4.69%, 10=8.63%, 20=10.12%, 50=40.30% lat (msec) : 100=23.67%, 250=5.08%, 750=0.03% cpu : usr=0.08%, sys=5.38%, ctx=6392, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181642: Fri Apr 3 09:35:00 2026 read: IOPS=12, BW=51.4KiB/s (52.6kB/s)(6028KiB/117292msec) clat (usec): min=33, max=265822, avg=42735.38, stdev=27526.68 lat (usec): min=33, max=265823, avg=42741.19, stdev=27522.65 clat percentiles (usec): | 1.00th=[ 52], 5.00th=[ 10159], 10.00th=[ 16909], 20.00th=[ 21890], | 30.00th=[ 26608], 40.00th=[ 31065], 50.00th=[ 37487], 60.00th=[ 44303], | 70.00th=[ 51643], 80.00th=[ 60556], 90.00th=[ 76022], 95.00th=[ 90702], | 99.00th=[126354], 99.50th=[154141], 99.90th=[263193], 99.95th=[265290], | 99.99th=[265290] bw ( KiB/s): min= 7, max= 110, per=25.85%, avg=51.18, stdev=18.69, samples=229 iops : min= 1, max= 27, avg=12.15, stdev= 4.72, samples=229 write: IOPS=13, BW=53.4KiB/s (54.7kB/s)(6260KiB/117292msec); 0 zone resets clat (usec): min=962, max=629262, avg=33513.62, stdev=37043.86 lat (usec): min=963, max=629265, avg=33524.60, stdev=37044.19 clat percentiles (usec): | 1.00th=[ 1205], 5.00th=[ 1352], 10.00th=[ 1778], 20.00th=[ 3785], | 30.00th=[ 7504], 40.00th=[ 14746], 50.00th=[ 23462], 60.00th=[ 33817], | 70.00th=[ 42730], 80.00th=[ 57934], 90.00th=[ 79168], 95.00th=[ 99091], | 99.00th=[141558], 99.50th=[181404], 99.90th=[263193], 99.95th=[633340], | 99.99th=[633340] bw ( KiB/s): min= 7, max= 173, per=25.53%, avg=52.84, stdev=22.18, samples=230 iops : min= 1, max= 43, avg=12.57, stdev= 5.57, samples=230 lat (usec) : 50=0.42%, 100=1.56%, 250=0.13%, 500=0.03%, 1000=0.10% lat (msec) : 2=5.99%, 4=4.59%, 10=7.19%, 20=10.77%, 50=41.11% lat (msec) : 100=24.02%, 250=3.94%, 500=0.10%, 750=0.03% cpu : usr=0.09%, sys=5.40%, ctx=6491, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181643: Fri Apr 3 09:35:00 2026 read: IOPS=12, BW=50.9KiB/s (52.1kB/s)(6052KiB/118980msec) clat (usec): min=36, max=681675, avg=43498.23, stdev=32586.38 lat (usec): min=37, max=681676, avg=43506.34, stdev=32582.31 clat percentiles (usec): | 1.00th=[ 51], 5.00th=[ 709], 10.00th=[ 16057], 20.00th=[ 21365], | 30.00th=[ 26084], 40.00th=[ 31851], 50.00th=[ 37487], 60.00th=[ 44303], | 70.00th=[ 52691], 80.00th=[ 62129], 90.00th=[ 77071], 95.00th=[ 96994], | 99.00th=[139461], 99.50th=[185598], 99.90th=[214959], 99.95th=[683672], | 99.99th=[683672] bw ( KiB/s): min= 7, max= 110, per=25.48%, avg=50.44, stdev=18.89, samples=233 iops : min= 1, max= 27, avg=11.95, stdev= 4.76, samples=233 write: IOPS=13, BW=52.4KiB/s (53.7kB/s)(6236KiB/118980msec); 0 zone resets clat (usec): min=984, max=296831, avg=33813.53, stdev=35609.91 lat (usec): min=985, max=296832, avg=33818.41, stdev=35607.60 clat percentiles (usec): | 1.00th=[ 1188], 5.00th=[ 1336], 10.00th=[ 1680], 20.00th=[ 3720], | 30.00th=[ 6456], 40.00th=[ 14746], 50.00th=[ 23725], 60.00th=[ 32113], | 70.00th=[ 43779], 80.00th=[ 59507], 90.00th=[ 83362], 95.00th=[104334], | 99.00th=[147850], 99.50th=[168821], 99.90th=[223347], 99.95th=[295699], | 99.99th=[295699] bw ( KiB/s): min= 7, max= 126, per=25.19%, avg=52.14, stdev=20.57, samples=232 iops : min= 1, max= 31, avg=12.39, stdev= 5.17, samples=232 lat (usec) : 50=0.42%, 100=1.86%, 250=0.07%, 500=0.10%, 750=0.03% lat (usec) : 1000=0.10% lat (msec) : 2=6.35%, 4=4.23%, 10=7.75%, 20=10.58%, 50=39.10% lat (msec) : 100=24.28%, 250=5.08%, 500=0.03%, 750=0.03% cpu : usr=0.07%, sys=5.40%, ctx=6515, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=198KiB/s (203kB/s), 49.5KiB/s-51.4KiB/s (50.6kB/s-52.6kB/s), io=23.4MiB (24.6MB), run=117292-121142msec WRITE: bw=208KiB/s (213kB/s), 51.0KiB/s-53.4KiB/s (53.2kB/s-54.7kB/s), io=24.6MiB (25.7MB), run=117292-121142msec rand-rw: (groupid=0, jobs=1): err= 0: pid=181645: Fri Apr 3 09:35:39 2026 read: IOPS=9, BW=37.0KiB/s (38.9kB/s)(5992KiB/157787msec) clat (msec): min=4, max=704, avg=40.91, stdev=41.38 lat (msec): min=4, max=704, avg=40.92, stdev=41.37 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 16], | 30.00th=[ 19], 40.00th=[ 23], 50.00th=[ 27], 60.00th=[ 34], | 70.00th=[ 43], 80.00th=[ 58], 90.00th=[ 92], 95.00th=[ 118], | 99.00th=[ 188], 99.50th=[ 226], 99.90th=[ 305], 99.95th=[ 701], | 99.99th=[ 701] bw ( KiB/s): min= 7, max= 175, per=25.17%, avg=38.00, stdev=26.90, samples=307 iops : min= 1, max= 43, avg= 8.83, stdev= 6.77, samples=307 write: IOPS=9, BW=39.9KiB/s (40.9kB/s)(6296KiB/157787msec); 0 zone resets clat (msec): min=10, max=358, avg=61.20, stdev=43.44 lat (msec): min=10, max=358, avg=61.20, stdev=43.44 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 20], 10.00th=[ 24], 20.00th=[ 29], | 30.00th=[ 34], 40.00th=[ 40], 50.00th=[ 47], 60.00th=[ 56], | 70.00th=[ 70], 80.00th=[ 91], 90.00th=[ 123], 95.00th=[ 146], | 99.00th=[ 211], 99.50th=[ 251], 99.90th=[ 342], 99.95th=[ 359], | 99.99th=[ 359] bw ( KiB/s): min= 7, max= 119, per=25.09%, avg=39.63, stdev=24.80, samples=309 iops : min= 1, max= 29, avg= 9.25, stdev= 6.26, samples=309 lat (msec) : 10=3.03%, 20=16.28%, 50=45.18%, 100=23.21%, 250=11.91% lat (msec) : 500=0.36%, 750=0.03% cpu : usr=0.07%, sys=2.19%, ctx=4994, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181646: Fri Apr 3 09:35:39 2026 read: IOPS=9, BW=37.5KiB/s (38.4kB/s)(5940KiB/158252msec) clat (msec): min=5, max=592, avg=42.17, stdev=41.50 lat (msec): min=5, max=592, avg=42.18, stdev=41.50 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 15], | 30.00th=[ 18], 40.00th=[ 23], 50.00th=[ 27], 60.00th=[ 34], | 70.00th=[ 44], 80.00th=[ 64], 90.00th=[ 97], 95.00th=[ 127], | 99.00th=[ 192], 99.50th=[ 213], 99.90th=[ 330], 99.95th=[ 592], | 99.99th=[ 592] bw ( KiB/s): min= 7, max= 144, per=25.28%, avg=38.17, stdev=27.27, samples=303 iops : min= 1, max= 36, avg= 8.88, stdev= 6.87, samples=303 write: IOPS=10, BW=40.1KiB/s (41.1kB/s)(6348KiB/158252msec); 0 zone resets clat (msec): min=10, max=359, avg=60.14, stdev=41.77 lat (msec): min=10, max=359, avg=60.15, stdev=41.77 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 21], 10.00th=[ 23], 20.00th=[ 29], | 30.00th=[ 34], 40.00th=[ 40], 50.00th=[ 47], 60.00th=[ 57], | 70.00th=[ 70], 80.00th=[ 88], 90.00th=[ 118], 95.00th=[ 146], | 99.00th=[ 199], 99.50th=[ 251], 99.90th=[ 326], 99.95th=[ 359], | 99.99th=[ 359] bw ( KiB/s): min= 7, max= 119, per=25.19%, avg=39.79, stdev=25.03, samples=310 iops : min= 1, max= 29, avg= 9.29, stdev= 6.32, samples=310 lat (msec) : 10=2.93%, 20=16.41%, 50=44.40%, 100=23.99%, 250=11.95% lat (msec) : 500=0.29%, 750=0.03% cpu : usr=0.06%, sys=2.06%, ctx=5030, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181647: Fri Apr 3 09:35:39 2026 read: IOPS=9, BW=38.2KiB/s (39.2kB/s)(6028KiB/157650msec) clat (msec): min=5, max=288, avg=41.73, stdev=38.60 lat (msec): min=5, max=288, avg=41.73, stdev=38.60 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 16], | 30.00th=[ 20], 40.00th=[ 24], 50.00th=[ 28], 60.00th=[ 33], | 70.00th=[ 43], 80.00th=[ 61], 90.00th=[ 99], 95.00th=[ 126], | 99.00th=[ 188], 99.50th=[ 213], 99.90th=[ 284], 99.95th=[ 288], | 99.99th=[ 288] bw ( KiB/s): min= 7, max= 150, per=25.54%, avg=38.56, stdev=26.46, samples=305 iops : min= 1, max= 37, avg= 8.98, stdev= 6.67, samples=305 write: IOPS=9, BW=39.7KiB/s (40.7kB/s)(6260KiB/157650msec); 0 zone resets clat (msec): min=10, max=635, avg=60.45, stdev=43.84 lat (msec): min=10, max=635, avg=60.46, stdev=43.84 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 21], 10.00th=[ 24], 20.00th=[ 29], | 30.00th=[ 34], 40.00th=[ 40], 50.00th=[ 46], 60.00th=[ 55], | 70.00th=[ 70], 80.00th=[ 87], 90.00th=[ 121], 95.00th=[ 142], | 99.00th=[ 203], 99.50th=[ 228], 99.90th=[ 338], 99.95th=[ 634], | 99.99th=[ 634] bw ( KiB/s): min= 7, max= 143, per=24.83%, avg=39.23, stdev=25.23, samples=311 iops : min= 1, max= 35, avg= 9.14, stdev= 6.36, samples=311 lat (msec) : 10=2.02%, 20=15.85%, 50=46.78%, 100=23.01%, 250=12.04% lat (msec) : 500=0.26%, 750=0.03% cpu : usr=0.06%, sys=2.12%, ctx=4924, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181648: Fri Apr 3 09:35:39 2026 read: IOPS=9, BW=38.2KiB/s (39.1kB/s)(6052KiB/158343msec) clat (msec): min=4, max=335, avg=41.44, stdev=39.29 lat (msec): min=4, max=335, avg=41.44, stdev=39.29 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 12], 20.00th=[ 16], | 30.00th=[ 18], 40.00th=[ 22], 50.00th=[ 27], 60.00th=[ 34], | 70.00th=[ 43], 80.00th=[ 63], 90.00th=[ 95], 95.00th=[ 124], | 99.00th=[ 186], 99.50th=[ 215], 99.90th=[ 300], 99.95th=[ 334], | 99.99th=[ 334] bw ( KiB/s): min= 7, max= 134, per=25.53%, avg=38.55, stdev=27.59, samples=306 iops : min= 1, max= 33, avg= 8.98, stdev= 6.95, samples=306 write: IOPS=9, BW=39.4KiB/s (40.3kB/s)(6236KiB/158343msec); 0 zone resets clat (msec): min=11, max=610, avg=61.28, stdev=44.88 lat (msec): min=11, max=610, avg=61.28, stdev=44.88 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 21], 10.00th=[ 24], 20.00th=[ 30], | 30.00th=[ 34], 40.00th=[ 40], 50.00th=[ 48], 60.00th=[ 57], | 70.00th=[ 71], 80.00th=[ 88], 90.00th=[ 116], 95.00th=[ 144], | 99.00th=[ 220], 99.50th=[ 259], 99.90th=[ 330], 99.95th=[ 609], | 99.99th=[ 609] bw ( KiB/s): min= 7, max= 119, per=24.73%, avg=39.08, stdev=24.57, samples=311 iops : min= 1, max= 29, avg= 9.11, stdev= 6.21, samples=311 lat (msec) : 10=2.47%, 20=17.22%, 50=44.04%, 100=24.28%, 250=11.52% lat (msec) : 500=0.42%, 750=0.03% cpu : usr=0.06%, sys=2.09%, ctx=4915, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=152KiB/s (155kB/s), 37.5KiB/s-38.2KiB/s (38.4kB/s-39.2kB/s), io=23.4MiB (24.6MB), run=157650-158343msec WRITE: bw=159KiB/s (163kB/s), 39.4KiB/s-40.1KiB/s (40.3kB/s-41.1kB/s), io=24.6MiB (25.7MB), run=157650-158343msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=181692: Fri Apr 3 09:36:20 2026 read: IOPS=12, BW=196KiB/s (201kB/s)(5920KiB/30129msec) clat (usec): min=24, max=182585, avg=42649.44, stdev=27839.71 lat (usec): min=24, max=182586, avg=42651.36, stdev=27839.46 clat percentiles (usec): | 1.00th=[ 50], 5.00th=[ 65], 10.00th=[ 10683], 20.00th=[ 22938], | 30.00th=[ 27657], 40.00th=[ 33817], 50.00th=[ 40109], 60.00th=[ 45351], | 70.00th=[ 52167], 80.00th=[ 59507], 90.00th=[ 71828], 95.00th=[ 92799], | 99.00th=[143655], 99.50th=[179307], 99.90th=[183501], 99.95th=[183501], | 99.99th=[183501] bw ( KiB/s): min= 63, max= 352, per=25.36%, avg=194.00, stdev=69.21, samples=59 iops : min= 3, max= 22, avg=11.39, stdev= 4.32, samples=59 write: IOPS=13, BW=211KiB/s (216kB/s)(6368KiB/30129msec); 0 zone resets clat (usec): min=1253, max=213723, avg=35115.27, stdev=36046.47 lat (usec): min=1254, max=213726, avg=35117.38, stdev=36046.48 clat percentiles (usec): | 1.00th=[ 1631], 5.00th=[ 1942], 10.00th=[ 2769], 20.00th=[ 4883], | 30.00th=[ 9241], 40.00th=[ 16909], 50.00th=[ 24249], 60.00th=[ 32637], | 70.00th=[ 43779], 80.00th=[ 59507], 90.00th=[ 89654], 95.00th=[103285], | 99.00th=[158335], 99.50th=[208667], 99.90th=[212861], 99.95th=[212861], | 99.99th=[212861] bw ( KiB/s): min= 30, max= 480, per=26.16%, avg=210.32, stdev=85.12, samples=59 iops : min= 1, max= 30, avg=12.42, stdev= 5.38, samples=59 lat (usec) : 50=0.52%, 100=2.99%, 250=0.26%, 500=0.52%, 1000=0.13% lat (msec) : 2=2.86%, 4=5.08%, 10=8.98%, 20=9.51%, 50=39.45% lat (msec) : 100=24.87%, 250=4.82% cpu : usr=0.08%, sys=6.05%, ctx=1656, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181693: Fri Apr 3 09:36:20 2026 read: IOPS=11, BW=183KiB/s (188kB/s)(5744KiB/31306msec) clat (usec): min=50, max=298309, avg=49393.94, stdev=34129.48 lat (usec): min=51, max=298310, avg=49395.15, stdev=34129.44 clat percentiles (usec): | 1.00th=[ 58], 5.00th=[ 80], 10.00th=[ 18220], 20.00th=[ 25560], | 30.00th=[ 30802], 40.00th=[ 37487], 50.00th=[ 43254], 60.00th=[ 49021], | 70.00th=[ 59507], 80.00th=[ 70779], 90.00th=[ 87557], 95.00th=[107480], | 99.00th=[181404], 99.50th=[217056], 99.90th=[299893], 99.95th=[299893], | 99.99th=[299893] bw ( KiB/s): min= 30, max= 351, per=23.72%, avg=181.48, stdev=76.78, samples=61 iops : min= 1, max= 21, avg=10.59, stdev= 4.82, samples=61 write: IOPS=13, BW=209KiB/s (214kB/s)(6544KiB/31306msec); 0 zone resets clat (usec): min=1400, max=145852, avg=32542.29, stdev=31321.94 lat (usec): min=1401, max=145855, avg=32544.43, stdev=31321.87 clat percentiles (usec): | 1.00th=[ 1713], 5.00th=[ 1991], 10.00th=[ 2966], 20.00th=[ 5473], | 30.00th=[ 9503], 40.00th=[ 15139], 50.00th=[ 22414], 60.00th=[ 30802], | 70.00th=[ 38536], 80.00th=[ 57934], 90.00th=[ 81265], 95.00th=[ 95945], | 99.00th=[135267], 99.50th=[135267], 99.90th=[145753], 99.95th=[145753], | 99.99th=[145753] bw ( KiB/s): min= 31, max= 383, per=25.83%, avg=207.63, stdev=82.90, samples=60 iops : min= 1, max= 23, avg=12.27, stdev= 5.19, samples=60 lat (usec) : 100=2.86%, 250=0.13%, 1000=0.13% lat (msec) : 2=2.73%, 4=4.95%, 10=8.33%, 20=9.90%, 50=39.84% lat (msec) : 100=26.43%, 250=4.56%, 500=0.13% cpu : usr=0.08%, sys=5.80%, ctx=1768, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181694: Fri Apr 3 09:36:20 2026 read: IOPS=12, BW=203KiB/s (208kB/s)(6256KiB/30806msec) clat (usec): min=43, max=214994, avg=45799.97, stdev=28583.43 lat (usec): min=43, max=214994, avg=45804.21, stdev=28585.67 clat percentiles (usec): | 1.00th=[ 59], 5.00th=[ 71], 10.00th=[ 17957], 20.00th=[ 25035], | 30.00th=[ 30540], 40.00th=[ 35914], 50.00th=[ 41157], 60.00th=[ 46400], | 70.00th=[ 53740], 80.00th=[ 65274], 90.00th=[ 80217], 95.00th=[ 94897], | 99.00th=[160433], 99.50th=[175113], 99.90th=[214959], 99.95th=[214959], | 99.99th=[214959] bw ( KiB/s): min= 61, max= 383, per=26.25%, avg=200.78, stdev=71.84, samples=60 iops : min= 3, max= 23, avg=11.82, stdev= 4.47, samples=60 write: IOPS=12, BW=196KiB/s (201kB/s)(6032KiB/30806msec); 0 zone resets clat (usec): min=1373, max=184038, avg=33234.93, stdev=31380.95 lat (usec): min=1374, max=184040, avg=33239.48, stdev=31380.77 clat percentiles (usec): | 1.00th=[ 1745], 5.00th=[ 2008], 10.00th=[ 3130], 20.00th=[ 5735], | 30.00th=[ 11207], 40.00th=[ 18220], 50.00th=[ 24773], 60.00th=[ 32113], | 70.00th=[ 43254], 80.00th=[ 56361], 90.00th=[ 77071], 95.00th=[ 93848], | 99.00th=[133694], 99.50th=[175113], 99.90th=[183501], 99.95th=[183501], | 99.99th=[183501] bw ( KiB/s): min= 32, max= 349, per=23.71%, avg=190.60, stdev=71.21, samples=60 iops : min= 2, max= 21, avg=11.20, stdev= 4.51, samples=60 lat (usec) : 50=0.26%, 100=2.60%, 250=0.13% lat (msec) : 2=2.60%, 4=4.56%, 10=7.68%, 20=10.29%, 50=42.32% lat (msec) : 100=25.00%, 250=4.56% cpu : usr=0.08%, sys=6.02%, ctx=1741, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181695: Fri Apr 3 09:36:20 2026 read: IOPS=12, BW=206KiB/s (211kB/s)(6032KiB/29220msec) clat (usec): min=36, max=181562, avg=42440.90, stdev=27179.83 lat (usec): min=37, max=181564, avg=42446.73, stdev=27179.89 clat percentiles (usec): | 1.00th=[ 53], 5.00th=[ 71], 10.00th=[ 262], 20.00th=[ 22676], | 30.00th=[ 28705], 40.00th=[ 33817], 50.00th=[ 39060], 60.00th=[ 45351], | 70.00th=[ 53740], 80.00th=[ 62129], 90.00th=[ 76022], 95.00th=[ 91751], | 99.00th=[119014], 99.50th=[156238], 99.90th=[181404], 99.95th=[181404], | 99.99th=[181404] bw ( KiB/s): min= 31, max= 415, per=26.78%, avg=204.84, stdev=69.76, samples=57 iops : min= 1, max= 25, avg=12.07, stdev= 4.33, samples=57 write: IOPS=13, BW=214KiB/s (219kB/s)(6256KiB/29220msec); 0 zone resets clat (usec): min=1419, max=185883, avg=33544.19, stdev=31901.49 lat (usec): min=1421, max=185887, avg=33546.45, stdev=31901.51 clat percentiles (usec): | 1.00th=[ 1598], 5.00th=[ 2008], 10.00th=[ 3163], 20.00th=[ 6652], | 30.00th=[ 9896], 40.00th=[ 17957], 50.00th=[ 24511], 60.00th=[ 33817], | 70.00th=[ 44827], 80.00th=[ 55837], 90.00th=[ 74974], 95.00th=[ 89654], | 99.00th=[162530], 99.50th=[181404], 99.90th=[185598], 99.95th=[185598], | 99.99th=[185598] bw ( KiB/s): min= 63, max= 352, per=26.36%, avg=211.89, stdev=70.75, samples=57 iops : min= 3, max= 22, avg=12.53, stdev= 4.52, samples=57 lat (usec) : 50=0.39%, 100=4.17%, 250=0.26%, 500=0.13%, 750=0.13% lat (msec) : 2=2.47%, 4=4.04%, 10=9.38%, 20=9.11%, 50=40.23% lat (msec) : 100=26.43%, 250=3.26% cpu : usr=0.06%, sys=6.07%, ctx=1680, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=765KiB/s (783kB/s), 183KiB/s-206KiB/s (188kB/s-211kB/s), io=23.4MiB (24.5MB), run=29220-31306msec WRITE: bw=805KiB/s (824kB/s), 196KiB/s-214KiB/s (201kB/s-219kB/s), io=24.6MiB (25.8MB), run=29220-31306msec rand-rw: (groupid=0, jobs=1): err= 0: pid=181688: Fri Apr 3 09:36:32 2026 read: IOPS=8, BW=136KiB/s (139kB/s)(5920KiB/43595msec) clat (msec): min=7, max=278, avg=44.96, stdev=39.27 lat (msec): min=7, max=278, avg=44.96, stdev=39.27 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 12], 10.00th=[ 16], 20.00th=[ 21], | 30.00th=[ 24], 40.00th=[ 27], 50.00th=[ 31], 60.00th=[ 36], | 70.00th=[ 45], 80.00th=[ 62], 90.00th=[ 90], 95.00th=[ 136], | 99.00th=[ 188], 99.50th=[ 230], 99.90th=[ 279], 99.95th=[ 279], | 99.99th=[ 279] bw ( KiB/s): min= 30, max= 510, per=24.41%, avg=133.99, stdev=80.37, samples=86 iops : min= 1, max= 31, avg= 7.55, stdev= 5.09, samples=86 write: IOPS=9, BW=146KiB/s (150kB/s)(6368KiB/43595msec); 0 zone resets clat (msec): min=11, max=270, avg=67.39, stdev=41.18 lat (msec): min=11, max=270, avg=67.40, stdev=41.18 clat percentiles (msec): | 1.00th=[ 13], 5.00th=[ 25], 10.00th=[ 32], 20.00th=[ 37], | 30.00th=[ 42], 40.00th=[ 48], 50.00th=[ 55], 60.00th=[ 64], | 70.00th=[ 77], 80.00th=[ 95], 90.00th=[ 131], 95.00th=[ 157], | 99.00th=[ 201], 99.50th=[ 239], 99.90th=[ 271], 99.95th=[ 271], | 99.99th=[ 271] bw ( KiB/s): min= 31, max= 415, per=25.32%, avg=146.35, stdev=78.82, samples=85 iops : min= 1, max= 25, avg= 8.33, stdev= 4.99, samples=85 lat (msec) : 10=1.43%, 20=9.11%, 50=47.53%, 100=28.39%, 250=13.28% lat (msec) : 500=0.26% cpu : usr=0.07%, sys=2.21%, ctx=1290, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181689: Fri Apr 3 09:36:32 2026 read: IOPS=8, BW=132KiB/s (135kB/s)(5744KiB/43482msec) clat (msec): min=6, max=213, avg=45.35, stdev=36.53 lat (msec): min=6, max=213, avg=45.35, stdev=36.53 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 14], 10.00th=[ 16], 20.00th=[ 20], | 30.00th=[ 24], 40.00th=[ 27], 50.00th=[ 33], 60.00th=[ 39], | 70.00th=[ 48], 80.00th=[ 64], 90.00th=[ 101], 95.00th=[ 130], | 99.00th=[ 178], 99.50th=[ 182], 99.90th=[ 213], 99.95th=[ 213], | 99.99th=[ 213] bw ( KiB/s): min= 30, max= 432, per=24.23%, avg=133.01, stdev=82.50, samples=83 iops : min= 1, max= 27, avg= 7.49, stdev= 5.23, samples=83 write: IOPS=9, BW=150KiB/s (154kB/s)(6544KiB/43482msec); 0 zone resets clat (msec): min=10, max=245, avg=66.41, stdev=42.05 lat (msec): min=10, max=245, avg=66.41, stdev=42.04 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 22], 10.00th=[ 29], 20.00th=[ 36], | 30.00th=[ 40], 40.00th=[ 46], 50.00th=[ 53], 60.00th=[ 63], | 70.00th=[ 75], 80.00th=[ 96], 90.00th=[ 128], 95.00th=[ 155], | 99.00th=[ 224], 99.50th=[ 236], 99.90th=[ 245], 99.95th=[ 245], | 99.99th=[ 245] bw ( KiB/s): min= 31, max= 351, per=25.55%, avg=147.69, stdev=70.17, samples=84 iops : min= 1, max= 21, avg= 8.42, stdev= 4.47, samples=84 lat (msec) : 10=0.78%, 20=10.29%, 50=47.79%, 100=26.82%, 250=14.32% cpu : usr=0.05%, sys=2.16%, ctx=1214, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181690: Fri Apr 3 09:36:32 2026 read: IOPS=9, BW=144KiB/s (148kB/s)(6256KiB/43323msec) clat (msec): min=8, max=374, avg=44.13, stdev=37.47 lat (msec): min=8, max=374, avg=44.13, stdev=37.47 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 14], 10.00th=[ 16], 20.00th=[ 21], | 30.00th=[ 24], 40.00th=[ 26], 50.00th=[ 31], 60.00th=[ 38], | 70.00th=[ 46], 80.00th=[ 62], 90.00th=[ 100], 95.00th=[ 122], | 99.00th=[ 161], 99.50th=[ 209], 99.90th=[ 376], 99.95th=[ 376], | 99.99th=[ 376] bw ( KiB/s): min= 31, max= 384, per=26.35%, avg=144.64, stdev=88.45, samples=84 iops : min= 1, max= 24, avg= 8.23, stdev= 5.58, samples=84 write: IOPS=8, BW=139KiB/s (143kB/s)(6032KiB/43323msec); 0 zone resets clat (msec): min=10, max=318, avg=68.53, stdev=40.74 lat (msec): min=10, max=318, avg=68.53, stdev=40.74 clat percentiles (msec): | 1.00th=[ 18], 5.00th=[ 27], 10.00th=[ 31], 20.00th=[ 39], | 30.00th=[ 45], 40.00th=[ 50], 50.00th=[ 58], 60.00th=[ 67], | 70.00th=[ 75], 80.00th=[ 91], 90.00th=[ 126], 95.00th=[ 146], | 99.00th=[ 213], 99.50th=[ 234], 99.90th=[ 317], 99.95th=[ 317], | 99.99th=[ 317] bw ( KiB/s): min= 31, max= 285, per=23.85%, avg=137.85, stdev=63.26, samples=84 iops : min= 1, max= 17, avg= 7.80, stdev= 4.01, samples=84 lat (msec) : 10=0.65%, 20=10.42%, 50=46.61%, 100=29.43%, 250=12.63% lat (msec) : 500=0.26% cpu : usr=0.06%, sys=1.94%, ctx=1228, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181691: Fri Apr 3 09:36:32 2026 read: IOPS=8, BW=140KiB/s (143kB/s)(6032KiB/43214msec) clat (msec): min=6, max=283, avg=45.99, stdev=38.54 lat (msec): min=6, max=283, avg=46.00, stdev=38.54 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 13], 10.00th=[ 16], 20.00th=[ 20], | 30.00th=[ 25], 40.00th=[ 28], 50.00th=[ 33], 60.00th=[ 38], | 70.00th=[ 50], 80.00th=[ 63], 90.00th=[ 99], 95.00th=[ 128], | 99.00th=[ 205], 99.50th=[ 228], 99.90th=[ 284], 99.95th=[ 284], | 99.99th=[ 284] bw ( KiB/s): min= 31, max= 405, per=26.00%, avg=142.76, stdev=71.29, samples=82 iops : min= 1, max= 25, avg= 8.11, stdev= 4.55, samples=82 write: IOPS=9, BW=145KiB/s (148kB/s)(6256KiB/43214msec); 0 zone resets clat (msec): min=16, max=314, avg=65.66, stdev=41.57 lat (msec): min=16, max=314, avg=65.67, stdev=41.57 clat percentiles (msec): | 1.00th=[ 20], 5.00th=[ 26], 10.00th=[ 31], 20.00th=[ 37], | 30.00th=[ 43], 40.00th=[ 48], 50.00th=[ 55], 60.00th=[ 63], | 70.00th=[ 71], 80.00th=[ 86], 90.00th=[ 115], 95.00th=[ 155], | 99.00th=[ 241], 99.50th=[ 279], 99.90th=[ 313], 99.95th=[ 313], | 99.99th=[ 313] bw ( KiB/s): min= 31, max= 352, per=25.22%, avg=145.80, stdev=73.88, samples=84 iops : min= 1, max= 22, avg= 8.30, stdev= 4.68, samples=84 lat (msec) : 10=0.78%, 20=9.90%, 50=46.22%, 100=31.25%, 250=11.46% lat (msec) : 500=0.39% cpu : usr=0.06%, sys=1.87%, ctx=1081, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=549KiB/s (563kB/s), 132KiB/s-144KiB/s (135kB/s-148kB/s), io=23.4MiB (24.5MB), run=43214-43595msec WRITE: bw=578KiB/s (592kB/s), 139KiB/s-150KiB/s (143kB/s-154kB/s), io=24.6MiB (25.8MB), run=43214-43595msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=181707: Fri Apr 3 09:36:47 2026 read: IOPS=2, BW=2133KiB/s (2185kB/s)(7168KiB/3360msec) clat (msec): min=75, max=455, avg=193.63, stdev=129.84 lat (msec): min=75, max=455, avg=193.64, stdev=129.84 clat percentiles (msec): | 1.00th=[ 75], 5.00th=[ 75], 10.00th=[ 75], 20.00th=[ 104], | 30.00th=[ 118], 40.00th=[ 118], 50.00th=[ 163], 60.00th=[ 188], | 70.00th=[ 188], 80.00th=[ 253], 90.00th=[ 456], 95.00th=[ 456], | 99.00th=[ 456], 99.50th=[ 456], 99.90th=[ 456], 99.95th=[ 456], | 99.99th=[ 456] bw ( KiB/s): min= 1950, max= 6159, per=66.36%, avg=3370.67, stdev=2414.91, samples=3 iops : min= 1, max= 6, avg= 2.67, stdev= 2.89, samples=3 write: IOPS=1, BW=1524KiB/s (1560kB/s)(5120KiB/3360msec); 0 zone resets clat (msec): min=72, max=742, avg=392.70, stdev=303.99 lat (msec): min=72, max=742, avg=392.87, stdev=304.06 clat percentiles (msec): | 1.00th=[ 72], 5.00th=[ 72], 10.00th=[ 72], 20.00th=[ 72], | 30.00th=[ 132], 40.00th=[ 132], 50.00th=[ 351], 60.00th=[ 351], | 70.00th=[ 667], 80.00th=[ 667], 90.00th=[ 743], 95.00th=[ 743], | 99.00th=[ 743], 99.50th=[ 743], 99.90th=[ 743], 99.95th=[ 743], | 99.99th=[ 743] bw ( KiB/s): min= 1539, max= 3900, per=33.18%, avg=2359.50, stdev=1049.87, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (msec) : 100=16.67%, 250=41.67%, 500=25.00%, 750=16.67% cpu : usr=0.00%, sys=2.89%, ctx=36, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181708: Fri Apr 3 09:36:47 2026 read: IOPS=0, BW=508KiB/s (520kB/s)(2048KiB/4032msec) clat (msec): min=97, max=121, avg=109.52, stdev=17.01 lat (msec): min=97, max=121, avg=109.52, stdev=17.01 clat percentiles (msec): | 1.00th=[ 97], 5.00th=[ 97], 10.00th=[ 97], 20.00th=[ 97], | 30.00th=[ 97], 40.00th=[ 97], 50.00th=[ 97], 60.00th=[ 122], | 70.00th=[ 122], 80.00th=[ 122], 90.00th=[ 122], 95.00th=[ 122], | 99.00th=[ 122], 99.50th=[ 122], 99.90th=[ 122], 99.95th=[ 122], | 99.99th=[ 122] bw ( KiB/s): min= 1590, max= 1950, per=34.85%, avg=1770.00, stdev=254.56, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2540KiB/s (2601kB/s)(10.0MiB/4032msec); 0 zone resets clat (msec): min=155, max=753, avg=375.01, stdev=195.57 lat (msec): min=155, max=753, avg=375.13, stdev=195.56 clat percentiles (msec): | 1.00th=[ 157], 5.00th=[ 157], 10.00th=[ 157], 20.00th=[ 182], | 30.00th=[ 220], 40.00th=[ 262], 50.00th=[ 309], 60.00th=[ 355], | 70.00th=[ 443], 80.00th=[ 456], 90.00th=[ 625], 95.00th=[ 751], | 99.00th=[ 751], 99.50th=[ 751], 99.90th=[ 751], 99.95th=[ 751], | 99.99th=[ 751] bw ( KiB/s): min= 1950, max= 3180, per=30.57%, avg=2174.00, stdev=444.93, samples=7 iops : min= 1, max= 3, avg= 1.29, stdev= 0.76, samples=7 lat (msec) : 100=8.33%, 250=33.33%, 500=41.67%, 750=8.33%, 1000=8.33% cpu : usr=0.00%, sys=5.31%, ctx=79, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181709: Fri Apr 3 09:36:47 2026 read: IOPS=1, BW=1824KiB/s (1868kB/s)(6144KiB/3368msec) clat (msec): min=98, max=614, avg=293.81, stdev=199.52 lat (msec): min=98, max=614, avg=293.82, stdev=199.52 clat percentiles (msec): | 1.00th=[ 99], 5.00th=[ 99], 10.00th=[ 99], 20.00th=[ 111], | 30.00th=[ 111], 40.00th=[ 190], 50.00th=[ 190], 60.00th=[ 368], | 70.00th=[ 384], 80.00th=[ 384], 90.00th=[ 617], 95.00th=[ 617], | 99.00th=[ 617], 99.50th=[ 617], 99.90th=[ 617], 99.95th=[ 617], | 99.99th=[ 617] bw ( KiB/s): min= 2043, max= 4007, per=65.30%, avg=3316.67, stdev=1104.32, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 write: IOPS=1, BW=1824KiB/s (1868kB/s)(6144KiB/3368msec); 0 zone resets clat (msec): min=114, max=708, avg=253.33, stdev=225.43 lat (msec): min=114, max=709, avg=253.52, stdev=225.47 clat percentiles (msec): | 1.00th=[ 115], 5.00th=[ 115], 10.00th=[ 115], 20.00th=[ 146], | 30.00th=[ 146], 40.00th=[ 159], 50.00th=[ 159], 60.00th=[ 197], | 70.00th=[ 197], 80.00th=[ 197], 90.00th=[ 709], 95.00th=[ 709], | 99.00th=[ 709], 99.50th=[ 709], 99.90th=[ 709], 99.95th=[ 709], | 99.99th=[ 709] bw ( KiB/s): min= 1950, max= 4619, per=37.15%, avg=2642.00, stdev=1318.35, samples=4 iops : min= 1, max= 4, avg= 1.75, stdev= 1.50, samples=4 lat (msec) : 100=8.33%, 250=58.33%, 500=16.67%, 750=16.67% cpu : usr=0.06%, sys=3.89%, ctx=109, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181710: Fri Apr 3 09:36:47 2026 read: IOPS=1, BW=1418KiB/s (1452kB/s)(5120KiB/3610msec) clat (msec): min=81, max=682, avg=290.73, stdev=279.93 lat (msec): min=81, max=682, avg=290.74, stdev=279.93 clat percentiles (msec): | 1.00th=[ 82], 5.00th=[ 82], 10.00th=[ 82], 20.00th=[ 82], | 30.00th=[ 97], 40.00th=[ 97], 50.00th=[ 99], 60.00th=[ 99], | 70.00th=[ 493], 80.00th=[ 493], 90.00th=[ 684], 95.00th=[ 684], | 99.00th=[ 684], 99.50th=[ 684], 99.90th=[ 684], 99.95th=[ 684], | 99.99th=[ 684] bw ( KiB/s): min= 3900, max= 4087, per=78.63%, avg=3993.50, stdev=132.23, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1986KiB/s (2033kB/s)(7168KiB/3610msec); 0 zone resets clat (msec): min=102, max=703, avg=296.55, stdev=210.59 lat (msec): min=102, max=703, avg=297.38, stdev=210.26 clat percentiles (msec): | 1.00th=[ 103], 5.00th=[ 103], 10.00th=[ 103], 20.00th=[ 169], | 30.00th=[ 203], 40.00th=[ 203], 50.00th=[ 211], 60.00th=[ 230], | 70.00th=[ 230], 80.00th=[ 460], 90.00th=[ 701], 95.00th=[ 701], | 99.00th=[ 701], 99.50th=[ 701], 99.90th=[ 701], 99.95th=[ 701], | 99.99th=[ 701] bw ( KiB/s): min= 1976, max= 4591, per=40.27%, avg=2863.33, stdev=1496.39, samples=3 iops : min= 1, max= 4, avg= 2.00, stdev= 1.73, samples=3 lat (msec) : 100=25.00%, 250=41.67%, 500=16.67%, 750=16.67% cpu : usr=0.00%, sys=5.02%, ctx=70, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5079KiB/s (5201kB/s), 508KiB/s-2133KiB/s (520kB/s-2185kB/s), io=20.0MiB (20.0MB), run=3360-4032msec WRITE: bw=7111KiB/s (7282kB/s), 1524KiB/s-2540KiB/s (1560kB/s-2601kB/s), io=28.0MiB (29.4MB), run=3360-4032msec rand-rw: (groupid=0, jobs=1): err= 0: pid=181712: Fri Apr 3 09:36:47 2026 read: IOPS=2, BW=2793KiB/s (2860kB/s)(7168KiB/2566msec) clat (usec): min=549, max=334237, avg=139612.48, stdev=119855.42 lat (usec): min=551, max=334239, avg=139614.08, stdev=119855.49 clat percentiles (usec): | 1.00th=[ 553], 5.00th=[ 553], 10.00th=[ 553], 20.00th=[ 734], | 30.00th=[125305], 40.00th=[125305], 50.00th=[132645], 60.00th=[147850], | 70.00th=[147850], 80.00th=[235930], 90.00th=[333448], 95.00th=[333448], | 99.00th=[333448], 99.50th=[333448], 99.90th=[333448], 99.95th=[333448], | 99.99th=[333448] bw ( KiB/s): min= 2043, max= 4530, per=63.41%, avg=3471.67, stdev=1284.19, samples=3 iops : min= 1, max= 4, avg= 2.67, stdev= 1.53, samples=3 write: IOPS=1, BW=1995KiB/s (2043kB/s)(5120KiB/2566msec); 0 zone resets clat (msec): min=133, max=493, avg=315.80, stdev=133.02 lat (msec): min=133, max=493, avg=315.91, stdev=133.05 clat percentiles (msec): | 1.00th=[ 134], 5.00th=[ 134], 10.00th=[ 134], 20.00th=[ 134], | 30.00th=[ 255], 40.00th=[ 255], 50.00th=[ 334], 60.00th=[ 334], | 70.00th=[ 363], 80.00th=[ 363], 90.00th=[ 493], 95.00th=[ 493], | 99.00th=[ 493], 99.50th=[ 493], 99.90th=[ 493], 99.95th=[ 493], | 99.99th=[ 493] bw ( KiB/s): min= 1858, max= 3842, per=33.67%, avg=2581.00, stdev=1095.97, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (usec) : 750=16.67% lat (msec) : 250=41.67%, 500=41.67% cpu : usr=0.08%, sys=15.13%, ctx=127, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181713: Fri Apr 3 09:36:47 2026 read: IOPS=0, BW=548KiB/s (561kB/s)(2048KiB/3740msec) clat (usec): min=499, max=550733, avg=275616.20, stdev=389074.24 lat (usec): min=500, max=550735, avg=275618.17, stdev=389075.32 clat percentiles (usec): | 1.00th=[ 498], 5.00th=[ 498], 10.00th=[ 498], 20.00th=[ 498], | 30.00th=[ 498], 40.00th=[ 498], 50.00th=[ 498], 60.00th=[549454], | 70.00th=[549454], 80.00th=[549454], 90.00th=[549454], 95.00th=[549454], | 99.00th=[549454], 99.50th=[549454], 99.90th=[549454], 99.95th=[549454], | 99.99th=[549454] bw ( KiB/s): min= 1530, max= 2043, per=32.63%, avg=1786.50, stdev=362.75, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2738KiB/s (2804kB/s)(10.0MiB/3740msec); 0 zone resets clat (msec): min=110, max=710, avg=317.79, stdev=214.36 lat (msec): min=110, max=710, avg=318.00, stdev=214.29 clat percentiles (msec): | 1.00th=[ 111], 5.00th=[ 111], 10.00th=[ 111], 20.00th=[ 157], | 30.00th=[ 171], 40.00th=[ 186], 50.00th=[ 194], 60.00th=[ 218], | 70.00th=[ 380], 80.00th=[ 397], 90.00th=[ 659], 95.00th=[ 709], | 99.00th=[ 709], 99.50th=[ 709], 99.90th=[ 709], 99.95th=[ 709], | 99.99th=[ 709] bw ( KiB/s): min= 2019, max= 5575, per=44.69%, avg=3426.00, stdev=1732.36, samples=4 iops : min= 1, max= 5, avg= 2.50, stdev= 1.91, samples=4 lat (usec) : 500=8.33% lat (msec) : 250=50.00%, 500=16.67%, 750=25.00% cpu : usr=0.00%, sys=14.82%, ctx=151, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181714: Fri Apr 3 09:36:47 2026 read: IOPS=1, BW=2010KiB/s (2059kB/s)(6144KiB/3056msec) clat (usec): min=382, max=299718, avg=165938.12, stdev=121699.47 lat (usec): min=384, max=299719, avg=165939.34, stdev=121699.29 clat percentiles (usec): | 1.00th=[ 383], 5.00th=[ 383], 10.00th=[ 383], 20.00th=[ 40633], | 30.00th=[ 40633], 40.00th=[162530], 50.00th=[162530], 60.00th=[242222], | 70.00th=[250610], 80.00th=[250610], 90.00th=[299893], 95.00th=[299893], | 99.00th=[299893], 99.50th=[299893], 99.90th=[299893], 99.95th=[299893], | 99.99th=[299893] bw ( KiB/s): min= 1921, max= 4087, per=59.20%, avg=3241.33, stdev=1158.39, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 write: IOPS=1, BW=2010KiB/s (2059kB/s)(6144KiB/3056msec); 0 zone resets clat (msec): min=154, max=633, avg=343.08, stdev=196.64 lat (msec): min=154, max=633, avg=343.15, stdev=196.66 clat percentiles (msec): | 1.00th=[ 155], 5.00th=[ 155], 10.00th=[ 155], 20.00th=[ 190], | 30.00th=[ 190], 40.00th=[ 232], 50.00th=[ 232], 60.00th=[ 313], | 70.00th=[ 535], 80.00th=[ 535], 90.00th=[ 634], 95.00th=[ 634], | 99.00th=[ 634], 99.50th=[ 634], 99.90th=[ 634], 99.95th=[ 634], | 99.99th=[ 634] bw ( KiB/s): min= 1858, max= 2896, per=28.43%, avg=2179.50, stdev=483.80, samples=4 iops : min= 1, max= 2, avg= 1.25, stdev= 0.50, samples=4 lat (usec) : 500=8.33% lat (msec) : 50=8.33%, 250=41.67%, 500=25.00%, 750=16.67% cpu : usr=0.00%, sys=13.42%, ctx=156, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181715: Fri Apr 3 09:36:47 2026 read: IOPS=1, BW=1489KiB/s (1525kB/s)(5120KiB/3438msec) clat (usec): min=351, max=261546, avg=160029.19, stdev=98130.45 lat (usec): min=352, max=261548, avg=160030.52, stdev=98130.66 clat percentiles (usec): | 1.00th=[ 351], 5.00th=[ 351], 10.00th=[ 351], 20.00th=[ 351], | 30.00th=[147850], 40.00th=[147850], 50.00th=[191890], 60.00th=[191890], | 70.00th=[198181], 80.00th=[198181], 90.00th=[261096], 95.00th=[261096], | 99.00th=[261096], 99.50th=[261096], 99.90th=[261096], 99.95th=[261096], | 99.99th=[261096] bw ( KiB/s): min= 4047, max= 4087, per=74.28%, avg=4067.00, stdev=28.28, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2085KiB/s (2135kB/s)(7168KiB/3438msec); 0 zone resets clat (msec): min=194, max=708, avg=370.54, stdev=193.15 lat (msec): min=194, max=708, avg=370.81, stdev=193.11 clat percentiles (msec): | 1.00th=[ 194], 5.00th=[ 194], 10.00th=[ 194], 20.00th=[ 207], | 30.00th=[ 218], 40.00th=[ 218], 50.00th=[ 313], 60.00th=[ 447], | 70.00th=[ 447], 80.00th=[ 510], 90.00th=[ 709], 95.00th=[ 709], | 99.00th=[ 709], 99.50th=[ 709], 99.90th=[ 709], 99.95th=[ 709], | 99.99th=[ 709] bw ( KiB/s): min= 1565, max= 4039, per=34.77%, avg=2665.40, stdev=1177.56, samples=5 iops : min= 1, max= 3, avg= 1.80, stdev= 1.10, samples=5 lat (usec) : 500=8.33% lat (msec) : 250=50.00%, 500=25.00%, 750=16.67% cpu : usr=0.00%, sys=14.58%, ctx=112, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5476KiB/s (5607kB/s), 548KiB/s-2793KiB/s (561kB/s-2860kB/s), io=20.0MiB (20.0MB), run=2566-3740msec WRITE: bw=7666KiB/s (7850kB/s), 1995KiB/s-2738KiB/s (2043kB/s-2804kB/s), io=28.0MiB (29.4MB), run=2566-3740msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=181723: Fri Apr 3 09:37:01 2026 read: IOPS=1, BW=4704KiB/s (4817kB/s)(12.0MiB/2612msec) clat (msec): min=693, max=844, avg=789.10, stdev=82.91 lat (msec): min=693, max=844, avg=789.10, stdev=82.91 clat percentiles (msec): | 1.00th=[ 693], 5.00th=[ 693], 10.00th=[ 693], 20.00th=[ 693], | 30.00th=[ 693], 40.00th=[ 827], 50.00th=[ 827], 60.00th=[ 827], | 70.00th=[ 844], 80.00th=[ 844], 90.00th=[ 844], 95.00th=[ 844], | 99.00th=[ 844], 99.50th=[ 844], 99.90th=[ 844], 99.95th=[ 844], | 99.99th=[ 844] bw ( KiB/s): min= 7892, max= 8143, per=100.00%, avg=8017.50, stdev=177.48, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 1000=66.67% cpu : usr=0.04%, sys=14.67%, ctx=317, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181725: Fri Apr 3 09:37:01 2026 read: IOPS=0, BW=1490KiB/s (1526kB/s)(4096KiB/2749msec) clat (nsec): min=831289k, max=831289k, avg=831288934.00, stdev= 0.00 lat (nsec): min=831291k, max=831291k, avg=831290791.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 835], 5.00th=[ 835], 10.00th=[ 835], 20.00th=[ 835], | 30.00th=[ 835], 40.00th=[ 835], 50.00th=[ 835], 60.00th=[ 835], | 70.00th=[ 835], 80.00th=[ 835], 90.00th=[ 835], 95.00th=[ 835], | 99.00th=[ 835], 99.50th=[ 835], 99.90th=[ 835], 99.95th=[ 835], | 99.99th=[ 835] bw ( KiB/s): min= 7892, max= 7892, per=100.00%, avg=7892.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2980KiB/s (3052kB/s)(8192KiB/2749msec); 0 zone resets clat (msec): min=685, max=954, avg=820.38, stdev=190.31 lat (msec): min=686, max=955, avg=820.83, stdev=190.12 clat percentiles (msec): | 1.00th=[ 684], 5.00th=[ 684], 10.00th=[ 684], 20.00th=[ 684], | 30.00th=[ 684], 40.00th=[ 684], 50.00th=[ 684], 60.00th=[ 953], | 70.00th=[ 953], 80.00th=[ 953], 90.00th=[ 953], 95.00th=[ 953], | 99.00th=[ 953], 99.50th=[ 953], 99.90th=[ 953], 99.95th=[ 953], | 99.99th=[ 953] bw ( KiB/s): min= 8143, max= 8143, per=78.83%, avg=8143.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, 1000=66.67% cpu : usr=0.00%, sys=6.73%, ctx=71, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181728: Fri Apr 3 09:37:01 2026 write: IOPS=0, BW=3874KiB/s (3967kB/s)(12.0MiB/3172msec); 0 zone resets clat (msec): min=675, max=1553, avg=970.99, stdev=504.44 lat (msec): min=675, max=1553, avg=971.53, stdev=504.43 clat percentiles (msec): | 1.00th=[ 676], 5.00th=[ 676], 10.00th=[ 676], 20.00th=[ 676], | 30.00th=[ 676], 40.00th=[ 684], 50.00th=[ 684], 60.00th=[ 684], | 70.00th=[ 1552], 80.00th=[ 1552], 90.00th=[ 1552], 95.00th=[ 1552], | 99.00th=[ 1552], 99.50th=[ 1552], 99.90th=[ 1552], 99.95th=[ 1552], | 99.99th=[ 1552] bw ( KiB/s): min= 8143, max= 8159, per=78.91%, avg=8151.00, stdev=11.31, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=66.67%, 2000=33.33% cpu : usr=0.09%, sys=4.29%, ctx=43, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181729: Fri Apr 3 09:37:01 2026 write: IOPS=1, BW=4554KiB/s (4664kB/s)(12.0MiB/2698msec); 0 zone resets clat (msec): min=226, max=1977, avg=851.90, stdev=976.47 lat (msec): min=230, max=1977, avg=853.46, stdev=975.35 clat percentiles (msec): | 1.00th=[ 228], 5.00th=[ 228], 10.00th=[ 228], 20.00th=[ 228], | 30.00th=[ 228], 40.00th=[ 351], 50.00th=[ 351], 60.00th=[ 351], | 70.00th=[ 1972], 80.00th=[ 1972], 90.00th=[ 1972], 95.00th=[ 1972], | 99.00th=[ 1972], 99.50th=[ 1972], 99.90th=[ 1972], 99.95th=[ 1972], | 99.99th=[ 1972] bw ( KiB/s): min= 7236, max= 7892, per=73.22%, avg=7564.00, stdev=463.86, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 250=33.33%, 500=33.33%, 2000=33.33% cpu : usr=0.04%, sys=4.30%, ctx=61, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5960KiB/s (6103kB/s), 1490KiB/s-4704KiB/s (1526kB/s-4817kB/s), io=16.0MiB (16.8MB), run=2612-2749msec WRITE: bw=10.1MiB/s (10.6MB/s), 2980KiB/s-4554KiB/s (3052kB/s-4664kB/s), io=32.0MiB (33.6MB), run=2698-3172msec rand-rw: (groupid=0, jobs=1): err= 0: pid=181722: Fri Apr 3 09:37:02 2026 read: IOPS=0, BW=3267KiB/s (3346kB/s)(12.0MiB/3761msec) clat (msec): min=271, max=2271, avg=1196.99, stdev=1008.00 lat (msec): min=271, max=2271, avg=1196.99, stdev=1008.00 clat percentiles (msec): | 1.00th=[ 271], 5.00th=[ 271], 10.00th=[ 271], 20.00th=[ 271], | 30.00th=[ 271], 40.00th=[ 1045], 50.00th=[ 1045], 60.00th=[ 1045], | 70.00th=[ 2265], 80.00th=[ 2265], 90.00th=[ 2265], 95.00th=[ 2265], | 99.00th=[ 2265], 99.50th=[ 2265], 99.90th=[ 2265], 99.95th=[ 2265], | 99.99th=[ 2265] bw ( KiB/s): min= 8110, max= 8126, per=100.00%, avg=8118.00, stdev=11.31, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=2.31%, ctx=53, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181724: Fri Apr 3 09:37:02 2026 read: IOPS=0, BW=1053KiB/s (1079kB/s)(4096KiB/3888msec) clat (nsec): min=1017.3M, max=1017.3M, avg=1017328813.00, stdev= 0.00 lat (nsec): min=1017.3M, max=1017.3M, avg=1017331262.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1020], 5.00th=[ 1020], 10.00th=[ 1020], 20.00th=[ 1020], | 30.00th=[ 1020], 40.00th=[ 1020], 50.00th=[ 1020], 60.00th=[ 1020], | 70.00th=[ 1020], 80.00th=[ 1020], 90.00th=[ 1020], 95.00th=[ 1020], | 99.00th=[ 1020], 99.50th=[ 1020], 99.90th=[ 1020], 99.95th=[ 1020], | 99.99th=[ 1020] bw ( KiB/s): min= 8110, max= 8110, per=100.00%, avg=8110.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2107KiB/s (2158kB/s)(8192KiB/3888msec); 0 zone resets clat (msec): min=1029, max=1543, avg=1286.50, stdev=363.42 lat (msec): min=1029, max=1544, avg=1287.02, stdev=363.49 clat percentiles (msec): | 1.00th=[ 1028], 5.00th=[ 1028], 10.00th=[ 1028], 20.00th=[ 1028], | 30.00th=[ 1028], 40.00th=[ 1028], 50.00th=[ 1028], 60.00th=[ 1536], | 70.00th=[ 1536], 80.00th=[ 1536], 90.00th=[ 1536], 95.00th=[ 1536], | 99.00th=[ 1536], 99.50th=[ 1536], 99.90th=[ 1536], 99.95th=[ 1536], | 99.99th=[ 1536] bw ( KiB/s): min= 8094, max= 8094, per=96.05%, avg=8094.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 2000=100.00% cpu : usr=0.03%, sys=3.99%, ctx=65, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181726: Fri Apr 3 09:37:02 2026 write: IOPS=0, BW=3530KiB/s (3615kB/s)(12.0MiB/3481msec); 0 zone resets clat (msec): min=332, max=2064, avg=1102.73, stdev=881.91 lat (msec): min=333, max=2065, avg=1103.75, stdev=881.69 clat percentiles (msec): | 1.00th=[ 334], 5.00th=[ 334], 10.00th=[ 334], 20.00th=[ 334], | 30.00th=[ 334], 40.00th=[ 911], 50.00th=[ 911], 60.00th=[ 911], | 70.00th=[ 2072], 80.00th=[ 2072], 90.00th=[ 2072], 95.00th=[ 2072], | 99.00th=[ 2072], 99.50th=[ 2072], 99.90th=[ 2072], 99.95th=[ 2072], | 99.99th=[ 2072] bw ( KiB/s): min= 8062, max= 8126, per=96.05%, avg=8094.00, stdev=45.25, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 1000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=3.33%, ctx=46, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181727: Fri Apr 3 09:37:02 2026 write: IOPS=0, BW=3937KiB/s (4032kB/s)(12.0MiB/3121msec); 0 zone resets clat (msec): min=310, max=2147, avg=998.02, stdev=1001.74 lat (msec): min=311, max=2147, avg=998.42, stdev=1001.88 clat percentiles (msec): | 1.00th=[ 313], 5.00th=[ 313], 10.00th=[ 313], 20.00th=[ 313], | 30.00th=[ 313], 40.00th=[ 535], 50.00th=[ 535], 60.00th=[ 535], | 70.00th=[ 2140], 80.00th=[ 2140], 90.00th=[ 2140], 95.00th=[ 2140], | 99.00th=[ 2140], 99.50th=[ 2140], 99.90th=[ 2140], 99.95th=[ 2140], | 99.99th=[ 2140] bw ( KiB/s): min= 5809, max= 8159, per=82.88%, avg=6984.00, stdev=1661.70, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 750=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=4.10%, ctx=64, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4214KiB/s (4315kB/s), 1053KiB/s-3267KiB/s (1079kB/s-3346kB/s), io=16.0MiB (16.8MB), run=3761-3888msec WRITE: bw=8428KiB/s (8630kB/s), 2107KiB/s-3937KiB/s (2158kB/s-4032kB/s), io=32.0MiB (33.6MB), run=3121-3888msec