== sanity test 398b: DIO and buffer IO race ============== 08:32:50 (1790685170) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 4.9653 s, 10.1 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=181386: Tue Sep 29 08:35:06 2026 read: IOPS=12, BW=50.0KiB/s (52.2kB/s)(5992KiB/117554msec) clat (usec): min=33, max=923459, avg=44261.47, stdev=36892.35 lat (usec): min=33, max=923462, avg=44264.82, stdev=36893.70 clat percentiles (usec): | 1.00th=[ 56], 5.00th=[ 11600], 10.00th=[ 16319], 20.00th=[ 21627], | 30.00th=[ 26346], 40.00th=[ 31589], 50.00th=[ 37487], 60.00th=[ 44303], | 70.00th=[ 52167], 80.00th=[ 62653], 90.00th=[ 81265], 95.00th=[ 96994], | 99.00th=[145753], 99.50th=[175113], 99.90th=[254804], 99.95th=[926942], | 99.99th=[926942] bw ( KiB/s): min= 7, max= 96, per=25.42%, avg=50.58, stdev=18.27, samples=231 iops : min= 1, max= 24, avg=12.00, stdev= 4.61, samples=231 write: IOPS=13, BW=53.6KiB/s (54.8kB/s)(6296KiB/117554msec); 0 zone resets clat (usec): min=640, max=213871, avg=32307.35, stdev=33998.26 lat (usec): min=641, max=213873, avg=32309.33, stdev=33998.36 clat percentiles (usec): | 1.00th=[ 1090], 5.00th=[ 1221], 10.00th=[ 1729], 20.00th=[ 3425], | 30.00th=[ 6259], 40.00th=[ 14091], 50.00th=[ 22938], 60.00th=[ 30802], | 70.00th=[ 40633], 80.00th=[ 55837], 90.00th=[ 78119], 95.00th=[103285], | 99.00th=[145753], 99.50th=[168821], 99.90th=[185598], 99.95th=[212861], | 99.99th=[212861] bw ( KiB/s): min= 7, max= 136, per=25.58%, avg=53.45, stdev=21.55, samples=230 iops : min= 1, max= 34, avg=12.72, stdev= 5.44, samples=230 lat (usec) : 50=0.13%, 100=1.56%, 250=0.23%, 500=0.03%, 750=0.10% lat (usec) : 1000=0.13% lat (msec) : 2=6.18%, 4=5.24%, 10=7.23%, 20=11.26%, 50=40.17% lat (msec) : 100=22.95%, 250=4.72%, 500=0.03%, 1000=0.03% cpu : usr=0.07%, sys=5.35%, ctx=6647, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181387: Tue Sep 29 08:35:06 2026 read: IOPS=12, BW=50.8KiB/s (52.0kB/s)(5940KiB/116923msec) clat (usec): min=44, max=198441, avg=43081.33, stdev=27467.22 lat (usec): min=44, max=198443, avg=43082.76, stdev=27467.21 clat percentiles (usec): | 1.00th=[ 57], 5.00th=[ 11076], 10.00th=[ 16909], 20.00th=[ 21890], | 30.00th=[ 27132], 40.00th=[ 32113], 50.00th=[ 37487], 60.00th=[ 43254], | 70.00th=[ 50070], 80.00th=[ 61604], 90.00th=[ 78119], 95.00th=[ 94897], | 99.00th=[145753], 99.50th=[156238], 99.90th=[189793], 99.95th=[198181], | 99.99th=[198181] bw ( KiB/s): min= 7, max= 103, per=25.38%, avg=50.51, stdev=19.65, samples=230 iops : min= 1, max= 25, avg=11.98, stdev= 4.95, samples=230 write: IOPS=13, BW=54.3KiB/s (55.6kB/s)(6348KiB/116923msec); 0 zone resets clat (usec): min=1013, max=898120, avg=33085.08, stdev=40706.19 lat (usec): min=1014, max=898122, avg=33087.46, stdev=40706.07 clat percentiles (usec): | 1.00th=[ 1090], 5.00th=[ 1237], 10.00th=[ 1745], 20.00th=[ 3261], | 30.00th=[ 6652], 40.00th=[ 13698], 50.00th=[ 24249], 60.00th=[ 32375], | 70.00th=[ 41681], 80.00th=[ 55313], 90.00th=[ 78119], 95.00th=[ 98042], | 99.00th=[152044], 99.50th=[173016], 99.90th=[329253], 99.95th=[901776], | 99.99th=[901776] bw ( KiB/s): min= 15, max= 111, per=25.89%, avg=54.10, stdev=21.35, samples=229 iops : min= 3, max= 27, avg=12.89, stdev= 5.37, samples=229 lat (usec) : 50=0.16%, 100=1.50%, 250=0.26%, 500=0.10% lat (msec) : 2=6.12%, 4=5.60%, 10=6.74%, 20=10.29%, 50=42.25% lat (msec) : 100=22.79%, 250=4.10%, 500=0.07%, 1000=0.03% cpu : usr=0.08%, sys=5.42%, ctx=6654, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181388: Tue Sep 29 08:35:06 2026 read: IOPS=12, BW=50.7KiB/s (51.9kB/s)(6028KiB/118909msec) clat (usec): min=39, max=934654, avg=43852.47, stdev=37389.70 lat (usec): min=39, max=934656, avg=43857.43, stdev=37389.11 clat percentiles (usec): | 1.00th=[ 56], 5.00th=[ 10421], 10.00th=[ 16581], 20.00th=[ 21890], | 30.00th=[ 26870], 40.00th=[ 31327], 50.00th=[ 36963], 60.00th=[ 43254], | 70.00th=[ 50070], 80.00th=[ 61080], 90.00th=[ 78119], 95.00th=[ 94897], | 99.00th=[154141], 99.50th=[181404], 99.90th=[295699], 99.95th=[935330], | 99.99th=[935330] bw ( KiB/s): min= 7, max= 128, per=25.43%, avg=50.61, stdev=19.36, samples=233 iops : min= 1, max= 32, avg=12.01, stdev= 4.89, samples=233 write: IOPS=13, BW=52.6KiB/s (53.9kB/s)(6260KiB/118909msec); 0 zone resets clat (usec): min=962, max=181136, avg=33503.84, stdev=33769.46 lat (usec): min=964, max=181137, avg=33511.11, stdev=33768.17 clat percentiles (usec): | 1.00th=[ 1074], 5.00th=[ 1237], 10.00th=[ 1582], 20.00th=[ 3228], | 30.00th=[ 6652], 40.00th=[ 14746], 50.00th=[ 25560], 60.00th=[ 33817], | 70.00th=[ 43779], 80.00th=[ 58459], 90.00th=[ 83362], 95.00th=[100140], | 99.00th=[147850], 99.50th=[162530], 99.90th=[175113], 99.95th=[181404], | 99.99th=[181404] bw ( KiB/s): min= 7, max= 118, per=25.02%, avg=52.28, stdev=20.29, samples=234 iops : min= 1, max= 29, avg=12.43, stdev= 5.09, samples=234 lat (usec) : 50=0.16%, 100=1.66%, 250=0.23%, 500=0.03%, 750=0.03% lat (usec) : 1000=0.13% lat (msec) : 2=6.64%, 4=4.43%, 10=7.00%, 20=10.55%, 50=41.60% lat (msec) : 100=22.79%, 250=4.65%, 500=0.07%, 1000=0.03% cpu : usr=0.08%, sys=5.21%, ctx=6725, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181389: Tue Sep 29 08:35:06 2026 read: IOPS=12, BW=50.4KiB/s (51.6kB/s)(6052KiB/120165msec) clat (usec): min=44, max=359462, avg=42867.68, stdev=29190.61 lat (usec): min=45, max=359464, avg=42869.84, stdev=29191.22 clat percentiles (usec): | 1.00th=[ 54], 5.00th=[ 9634], 10.00th=[ 16057], 20.00th=[ 21103], | 30.00th=[ 26084], 40.00th=[ 31327], 50.00th=[ 36963], 60.00th=[ 43254], | 70.00th=[ 51643], 80.00th=[ 61604], 90.00th=[ 78119], 95.00th=[ 94897], | 99.00th=[133694], 99.50th=[170918], 99.90th=[214959], 99.95th=[358613], | 99.99th=[358613] bw ( KiB/s): min= 7, max= 110, per=25.28%, avg=50.32, stdev=18.90, samples=234 iops : min= 1, max= 27, avg=11.94, stdev= 4.80, samples=234 write: IOPS=12, BW=51.9KiB/s (53.1kB/s)(6236KiB/120165msec); 0 zone resets clat (usec): min=978, max=842539, avg=35156.82, stdev=41152.71 lat (usec): min=980, max=842541, avg=35166.34, stdev=41154.79 clat percentiles (usec): | 1.00th=[ 1123], 5.00th=[ 1254], 10.00th=[ 1909], 20.00th=[ 3949], | 30.00th=[ 6980], 40.00th=[ 16450], 50.00th=[ 26084], 60.00th=[ 33817], | 70.00th=[ 45351], 80.00th=[ 59507], 90.00th=[ 83362], 95.00th=[103285], | 99.00th=[149947], 99.50th=[185598], 99.90th=[287310], 99.95th=[843056], | 99.99th=[843056] bw ( KiB/s): min= 7, max= 111, per=24.80%, avg=51.83, stdev=22.06, samples=234 iops : min= 1, max= 27, avg=12.32, stdev= 5.53, samples=234 lat (usec) : 50=0.16%, 100=1.69%, 250=0.29%, 500=0.13%, 1000=0.07% lat (msec) : 2=5.31%, 4=4.98%, 10=7.42%, 20=10.77%, 50=40.27% lat (msec) : 100=24.09%, 250=4.72%, 500=0.07%, 1000=0.03% cpu : usr=0.06%, sys=5.23%, ctx=6728, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=200KiB/s (205kB/s), 50.4KiB/s-50.0KiB/s (51.6kB/s-52.2kB/s), io=23.4MiB (24.6MB), run=116923-120165msec WRITE: bw=209KiB/s (214kB/s), 51.9KiB/s-54.3KiB/s (53.1kB/s-55.6kB/s), io=24.6MiB (25.7MB), run=116923-120165msec rand-rw: (groupid=0, jobs=1): err= 0: pid=181382: Tue Sep 29 08:35:46 2026 read: IOPS=9, BW=37.5KiB/s (38.4kB/s)(5992KiB/159956msec) clat (msec): min=6, max=931, avg=42.31, stdev=44.52 lat (msec): min=6, max=931, avg=42.31, stdev=44.52 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 16], | 30.00th=[ 20], 40.00th=[ 24], 50.00th=[ 28], 60.00th=[ 34], | 70.00th=[ 44], 80.00th=[ 59], 90.00th=[ 94], 95.00th=[ 122], | 99.00th=[ 186], 99.50th=[ 220], 99.90th=[ 313], 99.95th=[ 936], | 99.99th=[ 936] bw ( KiB/s): min= 7, max= 148, per=25.42%, avg=37.87, stdev=25.45, samples=308 iops : min= 1, max= 37, avg= 8.84, stdev= 6.41, samples=308 write: IOPS=9, BW=39.4KiB/s (40.3kB/s)(6296KiB/159956msec); 0 zone resets clat (msec): min=11, max=272, avg=61.10, stdev=42.31 lat (msec): min=11, max=272, avg=61.10, stdev=42.31 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 21], 10.00th=[ 25], 20.00th=[ 29], | 30.00th=[ 33], 40.00th=[ 39], 50.00th=[ 46], 60.00th=[ 58], | 70.00th=[ 70], 80.00th=[ 92], 90.00th=[ 118], 95.00th=[ 148], | 99.00th=[ 211], 99.50th=[ 226], 99.90th=[ 262], 99.95th=[ 271], | 99.99th=[ 271] bw ( KiB/s): min= 7, max= 110, per=25.33%, avg=39.51, stdev=23.90, samples=310 iops : min= 1, max= 27, avg= 9.25, stdev= 6.02, samples=310 lat (msec) : 10=2.28%, 20=15.36%, 50=46.19%, 100=23.73%, 250=12.21% lat (msec) : 500=0.20%, 1000=0.03% cpu : usr=0.04%, sys=1.78%, ctx=4692, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181383: Tue Sep 29 08:35:46 2026 read: IOPS=9, BW=36.9KiB/s (37.8kB/s)(5940KiB/160868msec) clat (msec): min=6, max=808, avg=42.82, stdev=42.71 lat (msec): min=6, max=808, avg=42.82, stdev=42.71 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 17], | 30.00th=[ 20], 40.00th=[ 24], 50.00th=[ 29], 60.00th=[ 35], | 70.00th=[ 45], 80.00th=[ 63], 90.00th=[ 97], 95.00th=[ 130], | 99.00th=[ 180], 99.50th=[ 199], 99.90th=[ 321], 99.95th=[ 810], | 99.99th=[ 810] bw ( KiB/s): min= 7, max= 126, per=25.12%, avg=37.42, stdev=25.36, samples=309 iops : min= 1, max= 31, avg= 8.73, stdev= 6.39, samples=309 write: IOPS=9, BW=39.5KiB/s (40.4kB/s)(6348KiB/160868msec); 0 zone resets clat (msec): min=12, max=346, avg=61.05, stdev=42.15 lat (msec): min=12, max=346, avg=61.06, stdev=42.15 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 21], 10.00th=[ 24], 20.00th=[ 29], | 30.00th=[ 34], 40.00th=[ 40], 50.00th=[ 47], 60.00th=[ 58], | 70.00th=[ 71], 80.00th=[ 89], 90.00th=[ 116], 95.00th=[ 142], | 99.00th=[ 215], 99.50th=[ 243], 99.90th=[ 338], 99.95th=[ 347], | 99.99th=[ 347] bw ( KiB/s): min= 7, max= 104, per=25.26%, avg=39.40, stdev=23.80, samples=313 iops : min= 1, max= 26, avg= 9.22, stdev= 6.00, samples=313 lat (msec) : 10=1.43%, 20=15.98%, 50=46.06%, 100=24.35%, 250=11.91% lat (msec) : 500=0.23%, 1000=0.03% cpu : usr=0.05%, sys=1.84%, ctx=4882, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181384: Tue Sep 29 08:35:46 2026 read: IOPS=9, BW=37.7KiB/s (38.6kB/s)(6028KiB/159803msec) clat (msec): min=5, max=299, avg=42.20, stdev=37.40 lat (msec): min=5, max=299, avg=42.20, stdev=37.40 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 17], | 30.00th=[ 21], 40.00th=[ 25], 50.00th=[ 30], 60.00th=[ 36], | 70.00th=[ 45], 80.00th=[ 61], 90.00th=[ 88], 95.00th=[ 124], | 99.00th=[ 184], 99.50th=[ 205], 99.90th=[ 247], 99.95th=[ 300], | 99.99th=[ 300] bw ( KiB/s): min= 7, max= 135, per=25.69%, avg=38.28, stdev=24.26, samples=306 iops : min= 1, max= 33, avg= 8.91, stdev= 6.09, samples=306 write: IOPS=9, BW=39.2KiB/s (40.1kB/s)(6260KiB/159803msec); 0 zone resets clat (msec): min=11, max=824, avg=61.23, stdev=47.14 lat (msec): min=11, max=824, avg=61.23, stdev=47.14 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 21], 10.00th=[ 24], 20.00th=[ 28], | 30.00th=[ 34], 40.00th=[ 40], 50.00th=[ 46], 60.00th=[ 56], | 70.00th=[ 69], 80.00th=[ 88], 90.00th=[ 121], 95.00th=[ 148], | 99.00th=[ 226], 99.50th=[ 262], 99.90th=[ 347], 99.95th=[ 827], | 99.99th=[ 827] bw ( KiB/s): min= 7, max= 116, per=25.00%, avg=38.99, stdev=24.01, samples=312 iops : min= 1, max= 29, avg= 9.09, stdev= 6.04, samples=312 lat (msec) : 10=1.76%, 20=15.04%, 50=46.84%, 100=24.28%, 250=11.72% lat (msec) : 500=0.33%, 1000=0.03% cpu : usr=0.06%, sys=1.89%, ctx=4902, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181385: Tue Sep 29 08:35:46 2026 read: IOPS=9, BW=37.7KiB/s (38.6kB/s)(6052KiB/160345msec) clat (msec): min=6, max=268, avg=40.97, stdev=36.10 lat (msec): min=6, max=268, avg=40.98, stdev=36.10 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 17], | 30.00th=[ 20], 40.00th=[ 24], 50.00th=[ 28], 60.00th=[ 35], | 70.00th=[ 45], 80.00th=[ 58], 90.00th=[ 90], 95.00th=[ 118], | 99.00th=[ 182], 99.50th=[ 209], 99.90th=[ 259], 99.95th=[ 268], | 99.99th=[ 268] bw ( KiB/s): min= 7, max= 119, per=26.16%, avg=38.98, stdev=24.91, samples=303 iops : min= 1, max= 29, avg= 9.08, stdev= 6.24, samples=303 write: IOPS=9, BW=38.9KiB/s (39.8kB/s)(6236KiB/160345msec); 0 zone resets clat (msec): min=10, max=846, avg=62.83, stdev=47.18 lat (msec): min=10, max=846, avg=62.84, stdev=47.18 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 21], 10.00th=[ 25], 20.00th=[ 29], | 30.00th=[ 34], 40.00th=[ 41], 50.00th=[ 48], 60.00th=[ 59], | 70.00th=[ 74], 80.00th=[ 93], 90.00th=[ 122], 95.00th=[ 146], | 99.00th=[ 222], 99.50th=[ 249], 99.90th=[ 338], 99.95th=[ 844], | 99.99th=[ 844] bw ( KiB/s): min= 7, max= 111, per=24.75%, avg=38.61, stdev=23.19, samples=315 iops : min= 1, max= 27, avg= 8.99, stdev= 5.83, samples=315 lat (msec) : 10=2.02%, 20=15.14%, 50=45.87%, 100=25.23%, 250=11.49% lat (msec) : 500=0.23%, 1000=0.03% cpu : usr=0.04%, sys=1.79%, ctx=4729, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=149KiB/s (153kB/s), 36.9KiB/s-37.7KiB/s (37.8kB/s-38.6kB/s), io=23.4MiB (24.6MB), run=159803-160868msec WRITE: bw=156KiB/s (160kB/s), 38.9KiB/s-39.5KiB/s (39.8kB/s-40.4kB/s), io=24.6MiB (25.7MB), run=159803-160868msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=181429: Tue Sep 29 08:36:28 2026 read: IOPS=11, BW=185KiB/s (189kB/s)(5920KiB/32047msec) clat (usec): min=52, max=157882, avg=45113.93, stdev=25973.88 lat (usec): min=53, max=157883, avg=45115.27, stdev=25973.93 clat percentiles (usec): | 1.00th=[ 65], 5.00th=[ 10028], 10.00th=[ 19530], 20.00th=[ 27132], | 30.00th=[ 30802], 40.00th=[ 33817], 50.00th=[ 39584], 60.00th=[ 45876], | 70.00th=[ 53216], 80.00th=[ 64226], 90.00th=[ 78119], 95.00th=[ 88605], | 99.00th=[145753], 99.50th=[156238], 99.90th=[158335], 99.95th=[158335], | 99.99th=[158335] bw ( KiB/s): min= 31, max= 320, per=25.30%, avg=184.46, stdev=60.88, samples=63 iops : min= 1, max= 20, avg=10.75, stdev= 3.88, samples=63 write: IOPS=12, BW=199KiB/s (203kB/s)(6368KiB/32047msec); 0 zone resets clat (usec): min=1432, max=184467, avg=38192.29, stdev=36341.29 lat (usec): min=1434, max=184470, avg=38199.17, stdev=36337.85 clat percentiles (usec): | 1.00th=[ 1696], 5.00th=[ 2474], 10.00th=[ 4015], 20.00th=[ 6718], | 30.00th=[ 10159], 40.00th=[ 17433], 50.00th=[ 28967], 60.00th=[ 36963], | 70.00th=[ 50594], 80.00th=[ 64750], 90.00th=[ 91751], 95.00th=[114820], | 99.00th=[160433], 99.50th=[181404], 99.90th=[183501], 99.95th=[183501], | 99.99th=[183501] bw ( KiB/s): min= 32, max= 407, per=25.93%, avg=198.92, stdev=76.86, samples=63 iops : min= 2, max= 25, avg=11.68, stdev= 4.83, samples=63 lat (usec) : 100=1.30%, 250=0.52%, 500=0.39% lat (msec) : 2=1.43%, 4=3.78%, 10=10.03%, 20=10.29%, 50=40.62% lat (msec) : 100=25.65%, 250=5.99% cpu : usr=0.08%, sys=5.82%, ctx=1847, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181430: Tue Sep 29 08:36:28 2026 read: IOPS=11, BW=176KiB/s (180kB/s)(5744KiB/32600msec) clat (usec): min=48, max=270385, avg=47115.66, stdev=32417.18 lat (usec): min=49, max=270386, avg=47117.75, stdev=32417.01 clat percentiles (usec): | 1.00th=[ 68], 5.00th=[ 190], 10.00th=[ 17433], 20.00th=[ 25035], | 30.00th=[ 30540], 40.00th=[ 34866], 50.00th=[ 40633], 60.00th=[ 46924], | 70.00th=[ 55313], 80.00th=[ 64750], 90.00th=[ 86508], 95.00th=[ 99091], | 99.00th=[166724], 99.50th=[231736], 99.90th=[270533], 99.95th=[270533], | 99.99th=[270533] bw ( KiB/s): min= 32, max= 350, per=24.01%, avg=175.00, stdev=68.37, samples=64 iops : min= 2, max= 21, avg=10.17, stdev= 4.31, samples=64 write: IOPS=12, BW=201KiB/s (206kB/s)(6544KiB/32600msec); 0 zone resets clat (usec): min=1331, max=230276, avg=38125.28, stdev=35155.79 lat (usec): min=1332, max=230278, avg=38127.89, stdev=35155.58 clat percentiles (usec): | 1.00th=[ 1713], 5.00th=[ 2638], 10.00th=[ 3884], 20.00th=[ 8291], | 30.00th=[ 13829], 40.00th=[ 21103], 50.00th=[ 29492], 60.00th=[ 38011], | 70.00th=[ 48497], 80.00th=[ 61080], 90.00th=[ 83362], 95.00th=[108528], | 99.00th=[152044], 99.50th=[166724], 99.90th=[229639], 99.95th=[229639], | 99.99th=[229639] bw ( KiB/s): min= 31, max= 446, per=26.15%, avg=200.56, stdev=80.47, samples=64 iops : min= 1, max= 27, avg=11.77, stdev= 5.07, samples=64 lat (usec) : 50=0.13%, 100=1.30%, 250=0.91%, 750=0.13% lat (msec) : 2=1.69%, 4=4.04%, 10=6.90%, 20=10.81%, 50=41.28% lat (msec) : 100=27.34%, 250=5.34%, 500=0.13% cpu : usr=0.07%, sys=5.40%, ctx=1866, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181431: Tue Sep 29 08:36:28 2026 read: IOPS=11, BW=190KiB/s (195kB/s)(6256KiB/32842msec) clat (usec): min=34, max=193987, avg=46519.67, stdev=32112.95 lat (usec): min=34, max=193989, avg=46533.55, stdev=32116.25 clat percentiles (usec): | 1.00th=[ 56], 5.00th=[ 78], 10.00th=[ 17695], 20.00th=[ 23987], | 30.00th=[ 28967], 40.00th=[ 34866], 50.00th=[ 40109], 60.00th=[ 47449], | 70.00th=[ 53740], 80.00th=[ 63701], 90.00th=[ 82314], 95.00th=[110625], | 99.00th=[177210], 99.50th=[181404], 99.90th=[193987], 99.95th=[193987], | 99.99th=[193987] bw ( KiB/s): min= 63, max= 382, per=26.25%, avg=191.36, stdev=64.29, samples=64 iops : min= 3, max= 23, avg=11.19, stdev= 4.05, samples=64 write: IOPS=11, BW=184KiB/s (188kB/s)(6032KiB/32842msec); 0 zone resets clat (usec): min=1407, max=197042, avg=38304.70, stdev=36672.76 lat (usec): min=1410, max=197044, avg=38315.13, stdev=36670.45 clat percentiles (usec): | 1.00th=[ 1614], 5.00th=[ 2180], 10.00th=[ 3556], 20.00th=[ 6128], | 30.00th=[ 11076], 40.00th=[ 17957], 50.00th=[ 26346], 60.00th=[ 36963], | 70.00th=[ 52167], 80.00th=[ 67634], 90.00th=[ 87557], 95.00th=[112722], | 99.00th=[156238], 99.50th=[193987], 99.90th=[196084], 99.95th=[196084], | 99.99th=[196084] bw ( KiB/s): min= 31, max= 349, per=23.96%, avg=183.76, stdev=75.73, samples=63 iops : min= 1, max= 21, avg=10.71, stdev= 4.77, samples=63 lat (usec) : 50=0.13%, 100=2.86%, 250=0.39%, 500=0.13%, 1000=0.26% lat (msec) : 2=1.69%, 4=3.78%, 10=8.59%, 20=10.42%, 50=38.15% lat (msec) : 100=27.21%, 250=6.38% cpu : usr=0.07%, sys=5.70%, ctx=1894, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181432: Tue Sep 29 08:36:28 2026 read: IOPS=11, BW=189KiB/s (193kB/s)(6032KiB/31955msec) clat (usec): min=49, max=233281, avg=47308.14, stdev=31657.70 lat (usec): min=49, max=233282, avg=47355.99, stdev=31664.89 clat percentiles (usec): | 1.00th=[ 60], 5.00th=[ 95], 10.00th=[ 15533], 20.00th=[ 25560], | 30.00th=[ 31065], 40.00th=[ 36439], 50.00th=[ 41681], 60.00th=[ 46400], | 70.00th=[ 55313], 80.00th=[ 66323], 90.00th=[ 87557], 95.00th=[109577], | 99.00th=[152044], 99.50th=[170918], 99.90th=[233833], 99.95th=[233833], | 99.99th=[233833] bw ( KiB/s): min= 31, max= 347, per=25.64%, avg=186.94, stdev=68.34, samples=63 iops : min= 1, max= 21, avg=10.92, stdev= 4.34, samples=63 write: IOPS=12, BW=196KiB/s (200kB/s)(6256KiB/31955msec); 0 zone resets clat (usec): min=1642, max=224698, avg=35357.62, stdev=33692.59 lat (usec): min=1644, max=224700, avg=35361.45, stdev=33692.95 clat percentiles (usec): | 1.00th=[ 1811], 5.00th=[ 2507], 10.00th=[ 3720], 20.00th=[ 6718], | 30.00th=[ 10814], 40.00th=[ 20317], 50.00th=[ 27657], 60.00th=[ 32637], | 70.00th=[ 42730], 80.00th=[ 58983], 90.00th=[ 81265], 95.00th=[105382], | 99.00th=[149947], 99.50th=[158335], 99.90th=[225444], 99.95th=[225444], | 99.99th=[225444] bw ( KiB/s): min= 63, max= 350, per=25.42%, avg=194.94, stdev=71.72, samples=63 iops : min= 3, max= 21, avg=11.41, stdev= 4.53, samples=63 lat (usec) : 50=0.13%, 100=2.47%, 250=0.78%, 500=0.39%, 750=0.26% lat (msec) : 2=1.43%, 4=4.56%, 10=8.59%, 20=8.46%, 50=42.19% lat (msec) : 100=24.61%, 250=6.12% cpu : usr=0.10%, sys=5.76%, ctx=1869, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=729KiB/s (747kB/s), 176KiB/s-190KiB/s (180kB/s-195kB/s), io=23.4MiB (24.5MB), run=31955-32842msec WRITE: bw=767KiB/s (786kB/s), 184KiB/s-201KiB/s (188kB/s-206kB/s), io=24.6MiB (25.8MB), run=31955-32842msec rand-rw: (groupid=0, jobs=1): err= 0: pid=181434: Tue Sep 29 08:36:40 2026 read: IOPS=8, BW=135KiB/s (139kB/s)(5920KiB/43708msec) clat (msec): min=6, max=296, avg=43.01, stdev=36.93 lat (msec): min=6, max=296, avg=43.02, stdev=36.93 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 13], 10.00th=[ 15], 20.00th=[ 20], | 30.00th=[ 23], 40.00th=[ 27], 50.00th=[ 31], 60.00th=[ 35], | 70.00th=[ 44], 80.00th=[ 62], 90.00th=[ 86], 95.00th=[ 117], | 99.00th=[ 190], 99.50th=[ 226], 99.90th=[ 296], 99.95th=[ 296], | 99.99th=[ 296] bw ( KiB/s): min= 31, max= 411, per=25.13%, avg=135.46, stdev=85.61, samples=85 iops : min= 1, max= 25, avg= 7.68, stdev= 5.41, samples=85 write: IOPS=9, BW=146KiB/s (149kB/s)(6368KiB/43708msec); 0 zone resets clat (msec): min=16, max=324, avg=69.43, stdev=45.58 lat (msec): min=16, max=324, avg=69.43, stdev=45.58 clat percentiles (msec): | 1.00th=[ 22], 5.00th=[ 28], 10.00th=[ 31], 20.00th=[ 36], | 30.00th=[ 42], 40.00th=[ 47], 50.00th=[ 54], 60.00th=[ 62], | 70.00th=[ 79], 80.00th=[ 97], 90.00th=[ 138], 95.00th=[ 163], | 99.00th=[ 230], 99.50th=[ 305], 99.90th=[ 326], 99.95th=[ 326], | 99.99th=[ 326] bw ( KiB/s): min= 30, max= 319, per=25.91%, avg=146.92, stdev=75.26, samples=85 iops : min= 1, max= 19, avg= 8.41, stdev= 4.75, samples=85 lat (msec) : 10=0.65%, 20=11.59%, 50=47.66%, 100=27.34%, 250=12.24% lat (msec) : 500=0.52% cpu : usr=0.04%, sys=1.81%, ctx=1198, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181435: Tue Sep 29 08:36:40 2026 read: IOPS=8, BW=129KiB/s (133kB/s)(5744KiB/44387msec) clat (msec): min=6, max=251, avg=46.68, stdev=42.39 lat (msec): min=6, max=251, avg=46.69, stdev=42.40 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 13], 10.00th=[ 15], 20.00th=[ 19], | 30.00th=[ 22], 40.00th=[ 26], 50.00th=[ 31], 60.00th=[ 37], | 70.00th=[ 47], 80.00th=[ 66], 90.00th=[ 110], 95.00th=[ 140], | 99.00th=[ 215], 99.50th=[ 230], 99.90th=[ 251], 99.95th=[ 251], | 99.99th=[ 251] bw ( KiB/s): min= 26, max= 384, per=24.16%, avg=130.21, stdev=82.69, samples=85 iops : min= 1, max= 24, avg= 7.35, stdev= 5.21, samples=85 write: IOPS=9, BW=147KiB/s (151kB/s)(6544KiB/44387msec); 0 zone resets clat (msec): min=12, max=325, avg=66.90, stdev=45.73 lat (msec): min=12, max=325, avg=66.91, stdev=45.74 clat percentiles (msec): | 1.00th=[ 18], 5.00th=[ 24], 10.00th=[ 28], 20.00th=[ 33], | 30.00th=[ 40], 40.00th=[ 45], 50.00th=[ 52], 60.00th=[ 63], | 70.00th=[ 77], 80.00th=[ 95], 90.00th=[ 128], 95.00th=[ 157], | 99.00th=[ 234], 99.50th=[ 279], 99.90th=[ 326], 99.95th=[ 326], | 99.99th=[ 326] bw ( KiB/s): min= 30, max= 410, per=25.45%, avg=144.28, stdev=86.36, samples=87 iops : min= 1, max= 25, avg= 8.24, stdev= 5.46, samples=87 lat (msec) : 10=0.52%, 20=11.98%, 50=46.61%, 100=25.91%, 250=14.45% lat (msec) : 500=0.52% cpu : usr=0.05%, sys=1.77%, ctx=1208, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181436: Tue Sep 29 08:36:40 2026 read: IOPS=8, BW=142KiB/s (145kB/s)(6256KiB/44107msec) clat (msec): min=8, max=235, avg=45.77, stdev=40.44 lat (msec): min=8, max=235, avg=45.77, stdev=40.44 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 13], 10.00th=[ 16], 20.00th=[ 19], | 30.00th=[ 22], 40.00th=[ 26], 50.00th=[ 30], 60.00th=[ 36], | 70.00th=[ 47], 80.00th=[ 67], 90.00th=[ 103], 95.00th=[ 132], | 99.00th=[ 199], 99.50th=[ 224], 99.90th=[ 236], 99.95th=[ 236], | 99.99th=[ 236] bw ( KiB/s): min= 31, max= 478, per=26.34%, avg=141.97, stdev=94.07, samples=87 iops : min= 1, max= 29, avg= 8.10, stdev= 5.93, samples=87 write: IOPS=8, BW=137KiB/s (140kB/s)(6032KiB/44107msec); 0 zone resets clat (msec): min=13, max=333, avg=68.76, stdev=46.82 lat (msec): min=13, max=333, avg=68.76, stdev=46.82 clat percentiles (msec): | 1.00th=[ 20], 5.00th=[ 26], 10.00th=[ 28], 20.00th=[ 34], | 30.00th=[ 39], 40.00th=[ 46], 50.00th=[ 51], 60.00th=[ 62], | 70.00th=[ 80], 80.00th=[ 101], 90.00th=[ 136], 95.00th=[ 167], | 99.00th=[ 228], 99.50th=[ 251], 99.90th=[ 334], 99.95th=[ 334], | 99.99th=[ 334] bw ( KiB/s): min= 31, max= 349, per=24.46%, avg=138.68, stdev=76.14, samples=85 iops : min= 1, max= 21, avg= 7.88, stdev= 4.82, samples=85 lat (msec) : 10=0.52%, 20=11.98%, 50=48.70%, 100=23.31%, 250=15.23% lat (msec) : 500=0.26% cpu : usr=0.05%, sys=1.80%, ctx=1224, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181437: Tue Sep 29 08:36:40 2026 read: IOPS=8, BW=137KiB/s (141kB/s)(6032KiB/43881msec) clat (msec): min=8, max=296, avg=45.04, stdev=41.34 lat (msec): min=8, max=296, avg=45.04, stdev=41.34 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 13], 10.00th=[ 15], 20.00th=[ 19], | 30.00th=[ 23], 40.00th=[ 26], 50.00th=[ 31], 60.00th=[ 37], | 70.00th=[ 46], 80.00th=[ 61], 90.00th=[ 96], 95.00th=[ 128], | 99.00th=[ 218], 99.50th=[ 288], 99.90th=[ 296], 99.95th=[ 296], | 99.99th=[ 296] bw ( KiB/s): min= 31, max= 410, per=26.39%, avg=142.23, stdev=82.00, samples=82 iops : min= 1, max= 25, avg= 8.12, stdev= 5.15, samples=82 write: IOPS=8, BW=143KiB/s (146kB/s)(6256KiB/43881msec); 0 zone resets clat (msec): min=17, max=307, avg=68.13, stdev=45.62 lat (msec): min=17, max=307, avg=68.13, stdev=45.62 clat percentiles (msec): | 1.00th=[ 21], 5.00th=[ 26], 10.00th=[ 30], 20.00th=[ 35], | 30.00th=[ 40], 40.00th=[ 46], 50.00th=[ 55], 60.00th=[ 62], | 70.00th=[ 72], 80.00th=[ 94], 90.00th=[ 131], 95.00th=[ 163], | 99.00th=[ 230], 99.50th=[ 249], 99.90th=[ 309], 99.95th=[ 309], | 99.99th=[ 309] bw ( KiB/s): min= 31, max= 348, per=24.82%, avg=140.71, stdev=79.34, samples=86 iops : min= 1, max= 21, avg= 8.01, stdev= 5.04, samples=86 lat (msec) : 10=0.39%, 20=11.72%, 50=46.88%, 100=26.69%, 250=13.80% lat (msec) : 500=0.52% cpu : usr=0.08%, sys=1.70%, ctx=1193, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=540KiB/s (553kB/s), 129KiB/s-142KiB/s (133kB/s-145kB/s), io=23.4MiB (24.5MB), run=43708-44387msec WRITE: bw=568KiB/s (581kB/s), 137KiB/s-147KiB/s (140kB/s-151kB/s), io=24.6MiB (25.8MB), run=43708-44387msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=181449: Tue Sep 29 08:36:58 2026 read: IOPS=1, BW=1067KiB/s (1093kB/s)(7168KiB/6716msec) clat (msec): min=89, max=2521, avg=639.80, stdev=900.88 lat (msec): min=89, max=2521, avg=639.80, stdev=900.88 clat percentiles (msec): | 1.00th=[ 90], 5.00th=[ 90], 10.00th=[ 90], 20.00th=[ 92], | 30.00th=[ 113], 40.00th=[ 113], 50.00th=[ 178], 60.00th=[ 418], | 70.00th=[ 418], 80.00th=[ 1070], 90.00th=[ 2534], 95.00th=[ 2534], | 99.00th=[ 2534], 99.50th=[ 2534], 99.90th=[ 2534], 99.95th=[ 2534], | 99.99th=[ 2534] bw ( KiB/s): min= 1889, max= 5796, per=100.00%, avg=2921.00, stdev=1917.44, samples=4 iops : min= 1, max= 5, avg= 2.00, stdev= 2.00, samples=4 write: IOPS=0, BW=762KiB/s (781kB/s)(5120KiB/6716msec); 0 zone resets clat (msec): min=214, max=583, avg=439.00, stdev=156.24 lat (msec): min=214, max=583, avg=439.11, stdev=156.21 clat percentiles (msec): | 1.00th=[ 215], 5.00th=[ 215], 10.00th=[ 215], 20.00th=[ 215], | 30.00th=[ 338], 40.00th=[ 338], 50.00th=[ 527], 60.00th=[ 527], | 70.00th=[ 531], 80.00th=[ 531], 90.00th=[ 584], 95.00th=[ 584], | 99.00th=[ 584], 99.50th=[ 584], 99.90th=[ 584], 99.95th=[ 584], | 99.99th=[ 584] bw ( KiB/s): min= 2003, max= 2048, per=52.32%, avg=2030.40, stdev=18.86, samples=5 iops : min= 1, max= 2, avg= 1.20, stdev= 0.45, samples=5 lat (msec) : 100=16.67%, 250=25.00%, 500=16.67%, 750=25.00%, 2000=8.33% lat (msec) : >=2000=8.33% cpu : usr=0.00%, sys=2.77%, ctx=90, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181450: Tue Sep 29 08:36:58 2026 read: IOPS=0, BW=277KiB/s (284kB/s)(2048KiB/7387msec) clat (msec): min=82, max=532, avg=307.24, stdev=318.16 lat (msec): min=82, max=532, avg=307.24, stdev=318.16 clat percentiles (msec): | 1.00th=[ 83], 5.00th=[ 83], 10.00th=[ 83], 20.00th=[ 83], | 30.00th=[ 83], 40.00th=[ 83], 50.00th=[ 83], 60.00th=[ 531], | 70.00th=[ 531], 80.00th=[ 531], 90.00th=[ 531], 95.00th=[ 531], | 99.00th=[ 531], 99.50th=[ 531], 99.90th=[ 531], 99.95th=[ 531], | 99.99th=[ 531] bw ( KiB/s): min= 1372, max= 1996, per=60.75%, avg=1684.00, stdev=441.23, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1386KiB/s (1419kB/s)(10.0MiB/7387msec); 0 zone resets clat (msec): min=157, max=2784, avg=669.71, stdev=805.00 lat (msec): min=157, max=2784, avg=670.53, stdev=805.12 clat percentiles (msec): | 1.00th=[ 159], 5.00th=[ 159], 10.00th=[ 159], 20.00th=[ 194], | 30.00th=[ 211], 40.00th=[ 241], 50.00th=[ 253], 60.00th=[ 253], | 70.00th=[ 776], 80.00th=[ 894], 90.00th=[ 927], 95.00th=[ 2769], | 99.00th=[ 2769], 99.50th=[ 2769], 99.90th=[ 2769], 99.95th=[ 2769], | 99.99th=[ 2769] bw ( KiB/s): min= 1910, max= 4087, per=72.54%, avg=2815.33, stdev=1022.00, samples=6 iops : min= 1, max= 3, avg= 2.00, stdev= 0.89, samples=6 lat (msec) : 100=8.33%, 250=33.33%, 500=16.67%, 750=8.33%, 1000=25.00% lat (msec) : >=2000=8.33% cpu : usr=0.01%, sys=3.66%, ctx=113, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181451: Tue Sep 29 08:36:58 2026 read: IOPS=0, BW=880KiB/s (901kB/s)(6144KiB/6985msec) clat (msec): min=72, max=711, avg=306.66, stdev=252.91 lat (msec): min=72, max=711, avg=306.66, stdev=252.91 clat percentiles (msec): | 1.00th=[ 73], 5.00th=[ 73], 10.00th=[ 73], 20.00th=[ 116], | 30.00th=[ 116], 40.00th=[ 128], 50.00th=[ 128], 60.00th=[ 330], | 70.00th=[ 485], 80.00th=[ 485], 90.00th=[ 709], 95.00th=[ 709], | 99.00th=[ 709], 99.50th=[ 709], 99.90th=[ 709], 99.95th=[ 709], | 99.99th=[ 709] bw ( KiB/s): min= 1889, max= 4007, per=90.03%, avg=2495.50, stdev=1010.28, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 write: IOPS=0, BW=880KiB/s (901kB/s)(6144KiB/6985msec); 0 zone resets clat (msec): min=90, max=3383, avg=831.09, stdev=1271.90 lat (msec): min=90, max=3383, avg=831.18, stdev=1271.88 clat percentiles (msec): | 1.00th=[ 91], 5.00th=[ 91], 10.00th=[ 91], 20.00th=[ 132], | 30.00th=[ 132], 40.00th=[ 305], 50.00th=[ 305], 60.00th=[ 334], | 70.00th=[ 743], 80.00th=[ 743], 90.00th=[ 3373], 95.00th=[ 3373], | 99.00th=[ 3373], 99.50th=[ 3373], 99.90th=[ 3373], 99.95th=[ 3373], | 99.99th=[ 3373] bw ( KiB/s): min= 1980, max= 3864, per=63.81%, avg=2476.50, stdev=925.36, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (msec) : 100=16.67%, 250=25.00%, 500=33.33%, 750=16.67%, >=2000=8.33% cpu : usr=0.00%, sys=2.53%, ctx=77, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181452: Tue Sep 29 08:36:58 2026 read: IOPS=0, BW=711KiB/s (728kB/s)(5120KiB/7204msec) clat (msec): min=79, max=3040, avg=824.49, stdev=1264.56 lat (msec): min=79, max=3040, avg=824.49, stdev=1264.56 clat percentiles (msec): | 1.00th=[ 81], 5.00th=[ 81], 10.00th=[ 81], 20.00th=[ 81], | 30.00th=[ 114], 40.00th=[ 114], 50.00th=[ 186], 60.00th=[ 186], | 70.00th=[ 701], 80.00th=[ 701], 90.00th=[ 3037], 95.00th=[ 3037], | 99.00th=[ 3037], 99.50th=[ 3037], 99.90th=[ 3037], 99.95th=[ 3037], | 99.99th=[ 3037] bw ( KiB/s): min= 3961, max= 4079, per=100.00%, avg=4020.00, stdev=83.44, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 write: IOPS=0, BW=995KiB/s (1019kB/s)(7168KiB/7204msec); 0 zone resets clat (msec): min=147, max=829, avg=413.67, stdev=273.99 lat (msec): min=147, max=829, avg=413.82, stdev=273.95 clat percentiles (msec): | 1.00th=[ 148], 5.00th=[ 148], 10.00th=[ 148], 20.00th=[ 150], | 30.00th=[ 182], 40.00th=[ 182], 50.00th=[ 368], 60.00th=[ 567], | 70.00th=[ 567], 80.00th=[ 659], 90.00th=[ 827], 95.00th=[ 827], | 99.00th=[ 827], 99.50th=[ 827], 99.90th=[ 827], 99.95th=[ 827], | 99.99th=[ 827] bw ( KiB/s): min= 1889, max= 4063, per=62.13%, avg=2411.40, stdev=925.49, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 lat (msec) : 100=8.33%, 250=41.67%, 500=8.33%, 750=25.00%, 1000=8.33% lat (msec) : >=2000=8.33% cpu : usr=0.03%, sys=3.93%, ctx=152, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2772KiB/s (2839kB/s), 277KiB/s-1067KiB/s (284kB/s-1093kB/s), io=20.0MiB (20.0MB), run=6716-7387msec WRITE: bw=3881KiB/s (3975kB/s), 762KiB/s-1386KiB/s (781kB/s-1419kB/s), io=28.0MiB (29.4MB), run=6716-7387msec rand-rw: (groupid=0, jobs=1): err= 0: pid=181454: Tue Sep 29 08:36:58 2026 read: IOPS=1, BW=1234KiB/s (1264kB/s)(7168KiB/5808msec) clat (msec): min=2, max=3025, avg=617.52, stdev=1067.74 lat (msec): min=2, max=3025, avg=617.52, stdev=1067.74 clat percentiles (msec): | 1.00th=[ 3], 5.00th=[ 3], 10.00th=[ 3], 20.00th=[ 161], | 30.00th=[ 209], 40.00th=[ 209], 50.00th=[ 292], 60.00th=[ 313], | 70.00th=[ 313], 80.00th=[ 321], 90.00th=[ 3037], 95.00th=[ 3037], | 99.00th=[ 3037], 99.50th=[ 3037], 99.90th=[ 3037], 99.95th=[ 3037], | 99.99th=[ 3037] bw ( KiB/s): min= 1670, max= 3813, per=87.59%, avg=2562.75, stdev=991.35, samples=4 iops : min= 1, max= 3, avg= 1.75, stdev= 0.96, samples=4 write: IOPS=0, BW=882KiB/s (903kB/s)(5120KiB/5808msec); 0 zone resets clat (msec): min=102, max=523, avg=295.85, stdev=173.20 lat (msec): min=102, max=523, avg=295.93, stdev=173.20 clat percentiles (msec): | 1.00th=[ 103], 5.00th=[ 103], 10.00th=[ 103], 20.00th=[ 103], | 30.00th=[ 203], 40.00th=[ 203], 50.00th=[ 226], 60.00th=[ 226], | 70.00th=[ 426], 80.00th=[ 426], 90.00th=[ 523], 95.00th=[ 523], | 99.00th=[ 523], 99.50th=[ 523], 99.90th=[ 523], 99.95th=[ 523], | 99.99th=[ 523] bw ( KiB/s): min= 1670, max= 3813, per=60.43%, avg=2475.33, stdev=1166.47, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (msec) : 4=8.33%, 250=41.67%, 500=33.33%, 750=8.33%, >=2000=8.33% cpu : usr=0.03%, sys=10.37%, ctx=485, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181455: Tue Sep 29 08:36:58 2026 read: IOPS=0, BW=293KiB/s (300kB/s)(2048KiB/6999msec) clat (msec): min=6, max=443, avg=224.92, stdev=308.93 lat (msec): min=6, max=443, avg=224.92, stdev=308.93 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 7], 10.00th=[ 7], 20.00th=[ 7], | 30.00th=[ 7], 40.00th=[ 7], 50.00th=[ 7], 60.00th=[ 443], | 70.00th=[ 443], 80.00th=[ 443], 90.00th=[ 443], 95.00th=[ 443], | 99.00th=[ 443], 99.50th=[ 443], 99.90th=[ 443], 99.95th=[ 443], | 99.99th=[ 443] bw ( KiB/s): min= 1499, max= 2000, per=59.79%, avg=1749.50, stdev=354.26, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1463KiB/s (1498kB/s)(10.0MiB/6999msec); 0 zone resets clat (msec): min=97, max=2641, avg=654.49, stdev=751.46 lat (msec): min=97, max=2642, avg=654.73, stdev=751.47 clat percentiles (msec): | 1.00th=[ 99], 5.00th=[ 99], 10.00th=[ 99], 20.00th=[ 132], | 30.00th=[ 155], 40.00th=[ 317], 50.00th=[ 326], 60.00th=[ 510], | 70.00th=[ 768], 80.00th=[ 793], 90.00th=[ 810], 95.00th=[ 2635], | 99.00th=[ 2635], 99.50th=[ 2635], 99.90th=[ 2635], 99.95th=[ 2635], | 99.99th=[ 2635] bw ( KiB/s): min= 1906, max= 6119, per=72.98%, avg=2989.17, stdev=1738.59, samples=6 iops : min= 1, max= 5, avg= 2.00, stdev= 1.67, samples=6 lat (msec) : 10=8.33%, 100=8.33%, 250=16.67%, 500=25.00%, 750=8.33% lat (msec) : 1000=25.00%, >=2000=8.33% cpu : usr=0.01%, sys=9.47%, ctx=109, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181456: Tue Sep 29 08:36:58 2026 read: IOPS=0, BW=925KiB/s (947kB/s)(6144KiB/6643msec) clat (usec): min=610, max=367749, avg=128053.91, stdev=156414.26 lat (usec): min=611, max=367752, avg=128055.70, stdev=156414.67 clat percentiles (usec): | 1.00th=[ 611], 5.00th=[ 611], 10.00th=[ 611], 20.00th=[ 791], | 30.00th=[ 791], 40.00th=[ 1139], 50.00th=[ 1139], 60.00th=[143655], | 70.00th=[254804], 80.00th=[254804], 90.00th=[367002], 95.00th=[367002], | 99.00th=[367002], 99.50th=[367002], 99.90th=[367002], 99.95th=[367002], | 99.99th=[367002] bw ( KiB/s): min= 1932, max= 4000, per=84.67%, avg=2477.50, stdev=1016.05, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 write: IOPS=0, BW=925KiB/s (947kB/s)(6144KiB/6643msec); 0 zone resets clat (msec): min=191, max=3702, avg=977.01, stdev=1344.84 lat (msec): min=191, max=3702, avg=977.08, stdev=1344.85 clat percentiles (msec): | 1.00th=[ 192], 5.00th=[ 192], 10.00th=[ 192], 20.00th=[ 338], | 30.00th=[ 338], 40.00th=[ 422], 50.00th=[ 422], 60.00th=[ 584], | 70.00th=[ 625], 80.00th=[ 625], 90.00th=[ 3708], 95.00th=[ 3708], | 99.00th=[ 3708], 99.50th=[ 3708], 99.90th=[ 3708], 99.95th=[ 3708], | 99.99th=[ 3708] bw ( KiB/s): min= 1932, max= 3016, per=54.27%, avg=2222.75, stdev=529.67, samples=4 iops : min= 1, max= 2, avg= 1.25, stdev= 0.50, samples=4 lat (usec) : 750=8.33%, 1000=8.33% lat (msec) : 2=8.33%, 250=16.67%, 500=33.33%, 750=16.67%, >=2000=8.33% cpu : usr=0.00%, sys=8.48%, ctx=147, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181457: Tue Sep 29 08:36:58 2026 read: IOPS=0, BW=864KiB/s (884kB/s)(5120KiB/5929msec) clat (usec): min=919, max=2507.3k, avg=585826.26, stdev=1080878.09 lat (usec): min=920, max=2507.3k, avg=585827.47, stdev=1080877.65 clat percentiles (usec): | 1.00th=[ 922], 5.00th=[ 922], 10.00th=[ 922], | 20.00th=[ 922], 30.00th=[ 3752], 40.00th=[ 3752], | 50.00th=[ 120062], 60.00th=[ 120062], 70.00th=[ 295699], | 80.00th=[ 295699], 90.00th=[2499806], 95.00th=[2499806], | 99.00th=[2499806], 99.50th=[2499806], 99.90th=[2499806], | 99.95th=[2499806], 99.99th=[2499806] bw ( KiB/s): min= 3813, max= 4071, per=100.00%, avg=3942.00, stdev=182.43, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1209KiB/s (1238kB/s)(7168KiB/5929msec); 0 zone resets clat (msec): min=149, max=794, avg=427.71, stdev=257.21 lat (msec): min=150, max=794, avg=427.84, stdev=257.21 clat percentiles (msec): | 1.00th=[ 150], 5.00th=[ 150], 10.00th=[ 150], 20.00th=[ 157], | 30.00th=[ 292], 40.00th=[ 292], 50.00th=[ 388], 60.00th=[ 489], | 70.00th=[ 489], 80.00th=[ 726], 90.00th=[ 793], 95.00th=[ 793], | 99.00th=[ 793], 99.50th=[ 793], 99.90th=[ 793], 99.95th=[ 793], | 99.99th=[ 793] bw ( KiB/s): min= 1393, max= 4071, per=65.16%, avg=2669.00, stdev=1248.90, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 1.15, samples=4 lat (usec) : 1000=8.33% lat (msec) : 4=8.33%, 250=25.00%, 500=33.33%, 750=8.33%, 1000=8.33% lat (msec) : >=2000=8.33% cpu : usr=0.02%, sys=10.32%, ctx=142, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2926KiB/s (2996kB/s), 293KiB/s-1234KiB/s (300kB/s-1264kB/s), io=20.0MiB (20.0MB), run=5808-6999msec WRITE: bw=4097KiB/s (4195kB/s), 882KiB/s-1463KiB/s (903kB/s-1498kB/s), io=28.0MiB (29.4MB), run=5808-6999msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=181463: Tue Sep 29 08:37:12 2026 read: IOPS=1, BW=4274KiB/s (4377kB/s)(12.0MiB/2875msec) clat (msec): min=759, max=1112, avg=887.26, stdev=195.41 lat (msec): min=759, max=1112, avg=887.26, stdev=195.41 clat percentiles (msec): | 1.00th=[ 760], 5.00th=[ 760], 10.00th=[ 760], 20.00th=[ 760], | 30.00th=[ 760], 40.00th=[ 793], 50.00th=[ 793], 60.00th=[ 793], | 70.00th=[ 1116], 80.00th=[ 1116], 90.00th=[ 1116], 95.00th=[ 1116], | 99.00th=[ 1116], 99.50th=[ 1116], 99.90th=[ 1116], 99.95th=[ 1116], | 99.99th=[ 1116] bw ( KiB/s): min= 8015, max= 8159, per=100.00%, avg=8087.00, stdev=101.82, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=66.67%, 2000=33.33% cpu : usr=0.00%, sys=4.38%, ctx=55, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181464: Tue Sep 29 08:37:12 2026 read: IOPS=0, BW=2424KiB/s (2482kB/s)(4096KiB/1690msec) clat (nsec): min=761879k, max=761879k, avg=761878674.00, stdev= 0.00 lat (nsec): min=761881k, max=761881k, avg=761880881.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 760], 5.00th=[ 760], 10.00th=[ 760], 20.00th=[ 760], | 30.00th=[ 760], 40.00th=[ 760], 50.00th=[ 760], 60.00th=[ 760], | 70.00th=[ 760], 80.00th=[ 760], 90.00th=[ 760], 95.00th=[ 760], | 99.00th=[ 760], 99.50th=[ 760], 99.90th=[ 760], 99.95th=[ 760], | 99.99th=[ 760] bw ( KiB/s): min= 8175, max= 8175, per=100.00%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=1, BW=4847KiB/s (4964kB/s)(8192KiB/1690msec); 0 zone resets clat (msec): min=297, max=550, avg=423.69, stdev=178.95 lat (msec): min=298, max=550, avg=424.33, stdev=178.66 clat percentiles (msec): | 1.00th=[ 296], 5.00th=[ 296], 10.00th=[ 296], 20.00th=[ 296], | 30.00th=[ 296], 40.00th=[ 296], 50.00th=[ 296], 60.00th=[ 550], | 70.00th=[ 550], 80.00th=[ 550], 90.00th=[ 550], 95.00th=[ 550], | 99.00th=[ 550], 99.50th=[ 550], 99.90th=[ 550], 99.95th=[ 550], | 99.99th=[ 550] bw ( KiB/s): min= 8175, max= 8175, per=43.01%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 750=33.33%, 1000=33.33% cpu : usr=0.00%, sys=6.75%, ctx=52, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181465: Tue Sep 29 08:37:12 2026 write: IOPS=1, BW=7918KiB/s (8108kB/s)(12.0MiB/1552msec); 0 zone resets clat (msec): min=371, max=570, avg=491.04, stdev=105.50 lat (msec): min=371, max=573, avg=492.81, stdev=106.55 clat percentiles (msec): | 1.00th=[ 372], 5.00th=[ 372], 10.00th=[ 372], 20.00th=[ 372], | 30.00th=[ 372], 40.00th=[ 531], 50.00th=[ 531], 60.00th=[ 531], | 70.00th=[ 575], 80.00th=[ 575], 90.00th=[ 575], 95.00th=[ 575], | 99.00th=[ 575], 99.50th=[ 575], 99.90th=[ 575], 99.95th=[ 575], | 99.99th=[ 575] bw ( KiB/s): min= 5610, max= 8175, per=36.26%, avg=6892.50, stdev=1813.73, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 750=66.67% cpu : usr=0.06%, sys=9.16%, ctx=48, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181466: Tue Sep 29 08:37:12 2026 write: IOPS=1, BW=7128KiB/s (7299kB/s)(12.0MiB/1724msec); 0 zone resets clat (msec): min=277, max=991, avg=540.72, stdev=391.82 lat (msec): min=278, max=991, avg=541.16, stdev=391.81 clat percentiles (msec): | 1.00th=[ 279], 5.00th=[ 279], 10.00th=[ 279], 20.00th=[ 279], | 30.00th=[ 279], 40.00th=[ 355], 50.00th=[ 355], 60.00th=[ 355], | 70.00th=[ 995], 80.00th=[ 995], 90.00th=[ 995], 95.00th=[ 995], | 99.00th=[ 995], 99.50th=[ 995], 99.90th=[ 995], 99.95th=[ 995], | 99.99th=[ 995] bw ( KiB/s): min= 8110, max= 8143, per=42.76%, avg=8126.50, stdev=23.33, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=66.67%, 1000=33.33% cpu : usr=0.06%, sys=12.54%, ctx=39, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5699KiB/s (5836kB/s), 2424KiB/s-4274KiB/s (2482kB/s-4377kB/s), io=16.0MiB (16.8MB), run=1690-2875msec WRITE: bw=18.6MiB/s (19.5MB/s), 4847KiB/s-7918KiB/s (4964kB/s-8108kB/s), io=32.0MiB (33.6MB), run=1552-1724msec rand-rw: (groupid=0, jobs=1): err= 0: pid=181468: Tue Sep 29 08:37:13 2026 read: IOPS=1, BW=4808KiB/s (4923kB/s)(12.0MiB/2556msec) clat (msec): min=654, max=956, avg=851.74, stdev=171.33 lat (msec): min=654, max=956, avg=851.74, stdev=171.33 clat percentiles (msec): | 1.00th=[ 651], 5.00th=[ 651], 10.00th=[ 651], 20.00th=[ 651], | 30.00th=[ 651], 40.00th=[ 944], 50.00th=[ 944], 60.00th=[ 944], | 70.00th=[ 961], 80.00th=[ 961], 90.00th=[ 961], 95.00th=[ 961], | 99.00th=[ 961], 99.50th=[ 961], 99.90th=[ 961], 99.95th=[ 961], | 99.99th=[ 961] bw ( KiB/s): min= 7728, max= 7742, per=100.00%, avg=7735.00, stdev= 9.90, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 1000=66.67% cpu : usr=0.00%, sys=12.95%, ctx=228, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181469: Tue Sep 29 08:37:13 2026 read: IOPS=0, BW=1536KiB/s (1573kB/s)(4096KiB/2667msec) clat (nsec): min=950217k, max=950217k, avg=950216860.00, stdev= 0.00 lat (nsec): min=950219k, max=950219k, avg=950219120.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 953], 5.00th=[ 953], 10.00th=[ 953], 20.00th=[ 953], | 30.00th=[ 953], 40.00th=[ 953], 50.00th=[ 953], 60.00th=[ 953], | 70.00th=[ 953], 80.00th=[ 953], 90.00th=[ 953], 95.00th=[ 953], | 99.00th=[ 953], 99.50th=[ 953], 99.90th=[ 953], 99.95th=[ 953], | 99.99th=[ 953] bw ( KiB/s): min= 7728, max= 7728, per=100.00%, avg=7728.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=3072KiB/s (3145kB/s)(8192KiB/2667msec); 0 zone resets clat (msec): min=811, max=901, avg=856.34, stdev=63.17 lat (msec): min=812, max=901, avg=856.85, stdev=63.07 clat percentiles (msec): | 1.00th=[ 810], 5.00th=[ 810], 10.00th=[ 810], 20.00th=[ 810], | 30.00th=[ 810], 40.00th=[ 810], 50.00th=[ 810], 60.00th=[ 902], | 70.00th=[ 902], 80.00th=[ 902], 90.00th=[ 902], 95.00th=[ 902], | 99.00th=[ 902], 99.50th=[ 902], 99.90th=[ 902], 99.95th=[ 902], | 99.99th=[ 902] bw ( KiB/s): min= 7742, max= 7742, per=69.18%, avg=7742.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 1000=100.00% cpu : usr=0.00%, sys=8.55%, ctx=114, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181470: Tue Sep 29 08:37:13 2026 write: IOPS=1, BW=4197KiB/s (4297kB/s)(12.0MiB/2928msec); 0 zone resets clat (msec): min=685, max=1123, avg=974.27, stdev=250.49 lat (msec): min=686, max=1123, avg=975.47, stdev=250.03 clat percentiles (msec): | 1.00th=[ 684], 5.00th=[ 684], 10.00th=[ 684], 20.00th=[ 684], | 30.00th=[ 684], 40.00th=[ 1116], 50.00th=[ 1116], 60.00th=[ 1116], | 70.00th=[ 1116], 80.00th=[ 1116], 90.00th=[ 1116], 95.00th=[ 1116], | 99.00th=[ 1116], 99.50th=[ 1116], 99.90th=[ 1116], 99.95th=[ 1116], | 99.99th=[ 1116] bw ( KiB/s): min= 8110, max= 8143, per=72.62%, avg=8126.50, stdev=23.33, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 2000=66.67% cpu : usr=0.00%, sys=9.19%, ctx=84, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181471: Tue Sep 29 08:37:13 2026 write: IOPS=1, BW=6617KiB/s (6776kB/s)(12.0MiB/1857msec); 0 zone resets clat (msec): min=312, max=1093, avg=617.41, stdev=417.52 lat (msec): min=313, max=1093, avg=618.17, stdev=417.22 clat percentiles (msec): | 1.00th=[ 313], 5.00th=[ 313], 10.00th=[ 313], 20.00th=[ 313], | 30.00th=[ 313], 40.00th=[ 447], 50.00th=[ 447], 60.00th=[ 447], | 70.00th=[ 1099], 80.00th=[ 1099], 90.00th=[ 1099], 95.00th=[ 1099], | 99.00th=[ 1099], 99.50th=[ 1099], 99.90th=[ 1099], 99.95th=[ 1099], | 99.99th=[ 1099] bw ( KiB/s): min= 7111, max= 8110, per=68.01%, avg=7610.50, stdev=706.40, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=66.67%, 2000=33.33% cpu : usr=0.05%, sys=6.25%, ctx=45, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=6143KiB/s (6291kB/s), 1536KiB/s-4808KiB/s (1573kB/s-4923kB/s), io=16.0MiB (16.8MB), run=2556-2667msec WRITE: bw=10.9MiB/s (11.5MB/s), 3072KiB/s-6617KiB/s (3145kB/s-6776kB/s), io=32.0MiB (33.6MB), run=1857-2928msec