== sanity test 398b: DIO and buffer IO race ============== 18:15:36 (1781216136) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 7.20576 s, 7.0 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179407: Thu Jun 11 18:18:12 2026 read: IOPS=11, BW=44.7KiB/s (45.7kB/s)(5992KiB/134129msec) clat (usec): min=42, max=1125.0k, avg=50003.26, stdev=42615.34 lat (usec): min=43, max=1125.0k, avg=50005.05, stdev=42616.08 clat percentiles (usec): | 1.00th=[ 56], 5.00th=[ 1385], 10.00th=[ 17171], | 20.00th=[ 24773], 30.00th=[ 31327], 40.00th=[ 37487], | 50.00th=[ 43779], 60.00th=[ 50594], 70.00th=[ 57934], | 80.00th=[ 69731], 90.00th=[ 87557], 95.00th=[ 109577], | 99.00th=[ 160433], 99.50th=[ 187696], 99.90th=[ 295699], | 99.95th=[1132463], 99.99th=[1132463] bw ( KiB/s): min= 7, max= 95, per=25.17%, avg=44.55, stdev=18.09, samples=262 iops : min= 1, max= 23, avg=10.48, stdev= 4.56, samples=262 write: IOPS=11, BW=46.9KiB/s (48.1kB/s)(6296KiB/134129msec); 0 zone resets clat (usec): min=928, max=237545, avg=37505.15, stdev=38582.17 lat (usec): min=929, max=237547, avg=37517.07, stdev=38586.67 clat percentiles (usec): | 1.00th=[ 1303], 5.00th=[ 1467], 10.00th=[ 1860], 20.00th=[ 4228], | 30.00th=[ 8455], 40.00th=[ 16057], 50.00th=[ 27132], 60.00th=[ 35914], | 70.00th=[ 49021], 80.00th=[ 64226], 90.00th=[ 91751], 95.00th=[116917], | 99.00th=[170918], 99.50th=[196084], 99.90th=[235930], 99.95th=[238027], | 99.99th=[238027] bw ( KiB/s): min= 7, max= 125, per=25.18%, avg=46.59, stdev=20.81, samples=263 iops : min= 1, max= 31, avg=11.00, stdev= 5.23, samples=263 lat (usec) : 50=0.16%, 100=1.79%, 250=0.23%, 500=0.03%, 750=0.07% lat (usec) : 1000=0.03% lat (msec) : 2=5.73%, 4=4.10%, 10=7.29%, 20=8.53%, 50=37.34% lat (msec) : 100=27.38%, 250=7.23%, 500=0.07%, 2000=0.03% cpu : usr=0.08%, sys=5.28%, ctx=6582, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179408: Thu Jun 11 18:18:12 2026 read: IOPS=11, BW=44.2KiB/s (45.3kB/s)(5940KiB/134387msec) clat (usec): min=35, max=966135, avg=50337.76, stdev=39017.16 lat (usec): min=35, max=966137, avg=50340.60, stdev=39015.31 clat percentiles (usec): | 1.00th=[ 57], 5.00th=[ 13829], 10.00th=[ 19006], 20.00th=[ 25035], | 30.00th=[ 31327], 40.00th=[ 37487], 50.00th=[ 43779], 60.00th=[ 50594], | 70.00th=[ 59507], 80.00th=[ 71828], 90.00th=[ 88605], 95.00th=[103285], | 99.00th=[160433], 99.50th=[181404], 99.90th=[254804], 99.95th=[968885], | 99.99th=[968885] bw ( KiB/s): min= 7, max= 103, per=24.76%, avg=43.82, stdev=16.70, samples=263 iops : min= 1, max= 25, avg=10.30, stdev= 4.21, samples=263 write: IOPS=11, BW=47.2KiB/s (48.4kB/s)(6348KiB/134387msec); 0 zone resets clat (usec): min=980, max=263454, avg=37484.51, stdev=39151.09 lat (usec): min=981, max=263456, avg=37488.01, stdev=39151.12 clat percentiles (usec): | 1.00th=[ 1303], 5.00th=[ 1483], 10.00th=[ 1975], 20.00th=[ 4490], | 30.00th=[ 8356], 40.00th=[ 16057], 50.00th=[ 26346], 60.00th=[ 36439], | 70.00th=[ 49021], 80.00th=[ 64750], 90.00th=[ 88605], 95.00th=[114820], | 99.00th=[177210], 99.50th=[196084], 99.90th=[256902], 99.95th=[263193], | 99.99th=[263193] bw ( KiB/s): min= 7, max= 103, per=25.38%, avg=46.95, stdev=21.24, samples=262 iops : min= 1, max= 25, avg=11.10, stdev= 5.37, samples=262 lat (usec) : 50=0.16%, 100=1.56%, 250=0.13%, 1000=0.03% lat (msec) : 2=5.24%, 4=4.43%, 10=7.58%, 20=8.63%, 50=37.17% lat (msec) : 100=28.48%, 250=6.41%, 500=0.13%, 1000=0.03% cpu : usr=0.08%, sys=5.13%, ctx=6394, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179409: Thu Jun 11 18:18:12 2026 read: IOPS=11, BW=44.5KiB/s (45.6kB/s)(6028KiB/135320msec) clat (usec): min=27, max=263792, avg=49239.82, stdev=31446.77 lat (usec): min=27, max=263794, avg=49244.31, stdev=31446.02 clat percentiles (usec): | 1.00th=[ 53], 5.00th=[ 167], 10.00th=[ 18220], 20.00th=[ 25297], | 30.00th=[ 31065], 40.00th=[ 36963], 50.00th=[ 43254], 60.00th=[ 50594], | 70.00th=[ 60556], 80.00th=[ 69731], 90.00th=[ 87557], 95.00th=[107480], | 99.00th=[158335], 99.50th=[164627], 99.90th=[238027], 99.95th=[263193], | 99.99th=[263193] bw ( KiB/s): min= 7, max= 95, per=25.16%, avg=44.53, stdev=17.57, samples=263 iops : min= 1, max= 23, avg=10.48, stdev= 4.43, samples=263 write: IOPS=11, BW=46.3KiB/s (47.4kB/s)(6260KiB/135320msec); 0 zone resets clat (usec): min=1116, max=1023.9k, avg=38913.80, stdev=46043.26 lat (usec): min=1118, max=1023.9k, avg=38915.59, stdev=46043.36 clat percentiles (usec): | 1.00th=[ 1287], 5.00th=[ 1483], 10.00th=[ 2147], | 20.00th=[ 5014], 30.00th=[ 9372], 40.00th=[ 18220], | 50.00th=[ 28705], 60.00th=[ 38011], 70.00th=[ 50070], | 80.00th=[ 66323], 90.00th=[ 88605], 95.00th=[ 114820], | 99.00th=[ 166724], 99.50th=[ 189793], 99.90th=[ 350225], | 99.95th=[1027605], 99.99th=[1027605] bw ( KiB/s): min= 7, max= 126, per=24.79%, avg=45.85, stdev=20.83, samples=265 iops : min= 1, max= 31, avg=10.82, stdev= 5.25, samples=265 lat (usec) : 50=0.26%, 100=2.15%, 250=0.07%, 500=0.03% lat (msec) : 2=4.79%, 4=3.74%, 10=7.45%, 20=8.56%, 50=37.60% lat (msec) : 100=28.45%, 250=6.77%, 500=0.10%, 2000=0.03% cpu : usr=0.08%, sys=5.15%, ctx=6574, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179410: Thu Jun 11 18:18:12 2026 read: IOPS=11, BW=45.4KiB/s (46.5kB/s)(6052KiB/133187msec) clat (usec): min=35, max=273924, avg=47593.82, stdev=30107.29 lat (usec): min=35, max=273925, avg=47595.97, stdev=30106.61 clat percentiles (usec): | 1.00th=[ 54], 5.00th=[ 1450], 10.00th=[ 17695], 20.00th=[ 24511], | 30.00th=[ 30016], 40.00th=[ 35390], 50.00th=[ 42206], 60.00th=[ 49546], | 70.00th=[ 57934], 80.00th=[ 68682], 90.00th=[ 85459], 95.00th=[ 96994], | 99.00th=[164627], 99.50th=[177210], 99.90th=[219153], 99.95th=[274727], | 99.99th=[274727] bw ( KiB/s): min= 7, max= 119, per=25.71%, avg=45.51, stdev=18.69, samples=259 iops : min= 1, max= 29, avg=10.73, stdev= 4.72, samples=259 write: IOPS=11, BW=46.8KiB/s (47.9kB/s)(6236KiB/133187msec); 0 zone resets clat (usec): min=1075, max=989871, avg=39077.63, stdev=46899.50 lat (usec): min=1077, max=989873, avg=39079.36, stdev=46899.50 clat percentiles (usec): | 1.00th=[ 1336], 5.00th=[ 1467], 10.00th=[ 1991], 20.00th=[ 4424], | 30.00th=[ 7635], 40.00th=[ 16712], 50.00th=[ 27919], 60.00th=[ 36963], | 70.00th=[ 49546], 80.00th=[ 67634], 90.00th=[ 91751], 95.00th=[115868], | 99.00th=[173016], 99.50th=[217056], 99.90th=[308282], 99.95th=[994051], | 99.99th=[994051] bw ( KiB/s): min= 7, max= 126, per=25.15%, avg=46.52, stdev=20.37, samples=261 iops : min= 1, max= 31, avg=10.98, stdev= 5.14, samples=261 lat (usec) : 50=0.26%, 100=1.86%, 250=0.20%, 500=0.07%, 750=0.03% lat (usec) : 1000=0.03% lat (msec) : 2=5.11%, 4=4.33%, 10=7.88%, 20=8.17%, 50=37.63% lat (msec) : 100=28.13%, 250=6.18%, 500=0.10%, 1000=0.03% cpu : usr=0.08%, sys=5.28%, ctx=6450, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=177KiB/s (182kB/s), 44.2KiB/s-45.4KiB/s (45.3kB/s-46.5kB/s), io=23.4MiB (24.6MB), run=133187-135320msec WRITE: bw=186KiB/s (190kB/s), 46.3KiB/s-47.2KiB/s (47.4kB/s-48.4kB/s), io=24.6MiB (25.7MB), run=133187-135320msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179402: Thu Jun 11 18:19:00 2026 read: IOPS=8, BW=32.7KiB/s (33.5kB/s)(5992KiB/183101msec) clat (msec): min=6, max=1236, avg=49.39, stdev=52.40 lat (msec): min=6, max=1236, avg=49.39, stdev=52.40 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 12], 10.00th=[ 15], 20.00th=[ 18], | 30.00th=[ 22], 40.00th=[ 29], 50.00th=[ 34], 60.00th=[ 43], | 70.00th=[ 54], 80.00th=[ 70], 90.00th=[ 109], 95.00th=[ 140], | 99.00th=[ 211], 99.50th=[ 232], 99.90th=[ 351], 99.95th=[ 1234], | 99.99th=[ 1234] bw ( KiB/s): min= 7, max= 111, per=25.63%, avg=33.32, stdev=21.92, samples=348 iops : min= 1, max= 27, avg= 7.66, stdev= 5.51, samples=348 write: IOPS=8, BW=34.4KiB/s (35.2kB/s)(6296KiB/183101msec); 0 zone resets clat (msec): min=14, max=335, avg=69.00, stdev=46.96 lat (msec): min=14, max=335, avg=69.01, stdev=46.96 clat percentiles (msec): | 1.00th=[ 19], 5.00th=[ 24], 10.00th=[ 27], 20.00th=[ 33], | 30.00th=[ 39], 40.00th=[ 46], 50.00th=[ 54], 60.00th=[ 65], | 70.00th=[ 79], 80.00th=[ 101], 90.00th=[ 133], 95.00th=[ 165], | 99.00th=[ 232], 99.50th=[ 271], 99.90th=[ 305], 99.95th=[ 334], | 99.99th=[ 334] bw ( KiB/s): min= 7, max= 128, per=25.16%, avg=34.22, stdev=21.24, samples=356 iops : min= 1, max= 32, avg= 7.88, stdev= 5.34, samples=356 lat (msec) : 10=1.24%, 20=11.88%, 50=43.55%, 100=27.41%, 250=15.46% lat (msec) : 500=0.42%, 2000=0.03% cpu : usr=0.05%, sys=2.06%, ctx=5097, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179403: Thu Jun 11 18:19:00 2026 read: IOPS=8, BW=32.4KiB/s (33.1kB/s)(5940KiB/183598msec) clat (msec): min=6, max=1078, avg=48.07, stdev=50.18 lat (msec): min=6, max=1078, avg=48.07, stdev=50.18 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 15], 20.00th=[ 18], | 30.00th=[ 23], 40.00th=[ 27], 50.00th=[ 33], 60.00th=[ 41], | 70.00th=[ 51], 80.00th=[ 68], 90.00th=[ 106], 95.00th=[ 136], | 99.00th=[ 215], 99.50th=[ 257], 99.90th=[ 443], 99.95th=[ 1083], | 99.99th=[ 1083] bw ( KiB/s): min= 7, max= 111, per=25.46%, avg=33.10, stdev=22.32, samples=348 iops : min= 1, max= 27, avg= 7.61, stdev= 5.61, samples=348 write: IOPS=8, BW=34.6KiB/s (35.4kB/s)(6348KiB/183598msec); 0 zone resets clat (msec): min=13, max=402, avg=70.38, stdev=48.07 lat (msec): min=13, max=402, avg=70.38, stdev=48.07 clat percentiles (msec): | 1.00th=[ 18], 5.00th=[ 24], 10.00th=[ 28], 20.00th=[ 34], | 30.00th=[ 40], 40.00th=[ 46], 50.00th=[ 54], 60.00th=[ 66], | 70.00th=[ 84], 80.00th=[ 104], 90.00th=[ 134], 95.00th=[ 165], | 99.00th=[ 247], 99.50th=[ 268], 99.90th=[ 309], 99.95th=[ 401], | 99.99th=[ 401] bw ( KiB/s): min= 7, max= 104, per=25.29%, avg=34.39, stdev=21.17, samples=357 iops : min= 1, max= 26, avg= 7.93, stdev= 5.33, samples=357 lat (msec) : 10=1.07%, 20=11.91%, 50=44.01%, 100=26.63%, 250=15.63% lat (msec) : 500=0.72%, 2000=0.03% cpu : usr=0.06%, sys=2.04%, ctx=5097, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179404: Thu Jun 11 18:19:00 2026 read: IOPS=8, BW=32.9KiB/s (33.6kB/s)(6028KiB/183452msec) clat (msec): min=6, max=356, avg=48.39, stdev=44.01 lat (msec): min=6, max=356, avg=48.40, stdev=44.01 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 13], 10.00th=[ 15], 20.00th=[ 19], | 30.00th=[ 23], 40.00th=[ 29], 50.00th=[ 33], 60.00th=[ 40], | 70.00th=[ 51], 80.00th=[ 67], 90.00th=[ 109], 95.00th=[ 142], | 99.00th=[ 218], 99.50th=[ 249], 99.90th=[ 355], 99.95th=[ 355], | 99.99th=[ 355] bw ( KiB/s): min= 7, max= 127, per=25.50%, avg=33.15, stdev=21.81, samples=353 iops : min= 1, max= 31, avg= 7.62, stdev= 5.47, samples=353 write: IOPS=8, BW=34.1KiB/s (34.9kB/s)(6260KiB/183452msec); 0 zone resets clat (msec): min=10, max=1116, avg=70.29, stdev=54.31 lat (msec): min=10, max=1116, avg=70.29, stdev=54.31 clat percentiles (msec): | 1.00th=[ 19], 5.00th=[ 23], 10.00th=[ 27], 20.00th=[ 33], | 30.00th=[ 38], 40.00th=[ 45], 50.00th=[ 55], 60.00th=[ 66], | 70.00th=[ 82], 80.00th=[ 104], 90.00th=[ 138], 95.00th=[ 163], | 99.00th=[ 236], 99.50th=[ 268], 99.90th=[ 355], 99.95th=[ 1116], | 99.99th=[ 1116] bw ( KiB/s): min= 7, max= 112, per=24.99%, avg=33.99, stdev=21.22, samples=357 iops : min= 1, max= 28, avg= 7.83, stdev= 5.34, samples=357 lat (msec) : 10=1.04%, 20=11.20%, 50=45.18%, 100=26.17%, 250=15.76% lat (msec) : 500=0.62%, 2000=0.03% cpu : usr=0.06%, sys=2.11%, ctx=5093, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179405: Thu Jun 11 18:19:00 2026 read: IOPS=8, BW=33.2KiB/s (34.0kB/s)(6052KiB/182134msec) clat (msec): min=5, max=452, avg=47.25, stdev=42.71 lat (msec): min=5, max=452, avg=47.25, stdev=42.71 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 15], 20.00th=[ 19], | 30.00th=[ 23], 40.00th=[ 28], 50.00th=[ 33], 60.00th=[ 40], | 70.00th=[ 50], 80.00th=[ 68], 90.00th=[ 105], 95.00th=[ 136], | 99.00th=[ 188], 99.50th=[ 232], 99.90th=[ 347], 99.95th=[ 451], | 99.99th=[ 451] bw ( KiB/s): min= 7, max= 119, per=26.47%, avg=34.42, stdev=22.90, samples=341 iops : min= 1, max= 29, avg= 7.93, stdev= 5.76, samples=341 write: IOPS=8, BW=34.2KiB/s (35.1kB/s)(6236KiB/182134msec); 0 zone resets clat (msec): min=12, max=1094, avg=70.63, stdev=54.47 lat (msec): min=12, max=1094, avg=70.63, stdev=54.47 clat percentiles (msec): | 1.00th=[ 19], 5.00th=[ 24], 10.00th=[ 27], 20.00th=[ 33], | 30.00th=[ 39], 40.00th=[ 46], 50.00th=[ 55], 60.00th=[ 66], | 70.00th=[ 82], 80.00th=[ 102], 90.00th=[ 136], 95.00th=[ 167], | 99.00th=[ 236], 99.50th=[ 296], 99.90th=[ 397], 99.95th=[ 1099], | 99.99th=[ 1099] bw ( KiB/s): min= 7, max= 103, per=25.00%, avg=34.01, stdev=20.61, samples=355 iops : min= 1, max= 25, avg= 7.83, stdev= 5.18, samples=355 lat (msec) : 10=1.40%, 20=11.78%, 50=44.47%, 100=26.60%, 250=15.23% lat (msec) : 500=0.49%, 2000=0.03% cpu : usr=0.06%, sys=2.14%, ctx=5101, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=131KiB/s (134kB/s), 32.4KiB/s-33.2KiB/s (33.1kB/s-34.0kB/s), io=23.4MiB (24.6MB), run=182134-183598msec WRITE: bw=137KiB/s (140kB/s), 34.1KiB/s-34.6KiB/s (34.9kB/s-35.4kB/s), io=24.6MiB (25.7MB), run=182134-183598msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179456: Thu Jun 11 18:19:46 2026 read: IOPS=10, BW=172KiB/s (176kB/s)(5920KiB/34430msec) clat (usec): min=35, max=199621, avg=51046.84, stdev=35509.96 lat (usec): min=35, max=199622, avg=51048.01, stdev=35509.98 clat percentiles (usec): | 1.00th=[ 52], 5.00th=[ 63], 10.00th=[ 96], 20.00th=[ 23987], | 30.00th=[ 30802], 40.00th=[ 37487], 50.00th=[ 46400], 60.00th=[ 53740], | 70.00th=[ 64226], 80.00th=[ 74974], 90.00th=[100140], 95.00th=[113771], | 99.00th=[162530], 99.50th=[198181], 99.90th=[200279], 99.95th=[200279], | 99.99th=[200279] bw ( KiB/s): min= 62, max= 351, per=24.72%, avg=171.79, stdev=72.94, samples=67 iops : min= 3, max= 21, avg=10.01, stdev= 4.61, samples=67 write: IOPS=11, BW=185KiB/s (189kB/s)(6368KiB/34430msec); 0 zone resets clat (usec): min=1680, max=215427, avg=38378.53, stdev=35459.26 lat (usec): min=1682, max=215428, avg=38381.17, stdev=35459.17 clat percentiles (usec): | 1.00th=[ 1893], 5.00th=[ 2180], 10.00th=[ 3195], 20.00th=[ 7635], | 30.00th=[ 12125], 40.00th=[ 20055], 50.00th=[ 29230], 60.00th=[ 37487], | 70.00th=[ 49546], 80.00th=[ 64750], 90.00th=[ 89654], 95.00th=[112722], | 99.00th=[143655], 99.50th=[170918], 99.90th=[214959], 99.95th=[214959], | 99.99th=[214959] bw ( KiB/s): min= 31, max= 438, per=25.38%, avg=185.51, stdev=79.22, samples=67 iops : min= 1, max= 27, avg=10.90, stdev= 5.03, samples=67 lat (usec) : 50=0.26%, 100=4.69%, 500=0.13% lat (msec) : 2=1.56%, 4=5.08%, 10=7.03%, 20=9.64%, 50=34.24% lat (msec) : 100=29.17%, 250=8.20% cpu : usr=0.06%, sys=5.43%, ctx=1718, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179457: Thu Jun 11 18:19:46 2026 read: IOPS=10, BW=167KiB/s (171kB/s)(5744KiB/34414msec) clat (usec): min=51, max=196318, avg=49820.27, stdev=32139.61 lat (usec): min=52, max=196318, avg=49830.30, stdev=32133.77 clat percentiles (usec): | 1.00th=[ 58], 5.00th=[ 65], 10.00th=[ 15270], 20.00th=[ 26346], | 30.00th=[ 32375], 40.00th=[ 38011], 50.00th=[ 45876], 60.00th=[ 52167], | 70.00th=[ 61080], 80.00th=[ 73925], 90.00th=[ 89654], 95.00th=[105382], | 99.00th=[164627], 99.50th=[187696], 99.90th=[196084], 99.95th=[196084], | 99.99th=[196084] bw ( KiB/s): min= 30, max= 286, per=23.99%, avg=166.72, stdev=58.08, samples=67 iops : min= 1, max= 17, avg= 9.70, stdev= 3.66, samples=67 write: IOPS=11, BW=190KiB/s (195kB/s)(6544KiB/34414msec); 0 zone resets clat (usec): min=1544, max=254753, avg=39873.10, stdev=40248.94 lat (usec): min=1546, max=254755, avg=39899.79, stdev=40239.09 clat percentiles (usec): | 1.00th=[ 1893], 5.00th=[ 2180], 10.00th=[ 3326], 20.00th=[ 7111], | 30.00th=[ 11731], 40.00th=[ 19530], 50.00th=[ 27919], 60.00th=[ 36963], | 70.00th=[ 47973], 80.00th=[ 68682], 90.00th=[ 98042], 95.00th=[119014], | 99.00th=[181404], 99.50th=[189793], 99.90th=[254804], 99.95th=[254804], | 99.99th=[254804] bw ( KiB/s): min= 31, max= 510, per=26.02%, avg=190.19, stdev=91.01, samples=67 iops : min= 1, max= 31, avg=11.19, stdev= 5.78, samples=67 lat (usec) : 100=3.65%, 250=0.13%, 750=0.13% lat (msec) : 2=1.30%, 4=4.82%, 10=8.07%, 20=9.77%, 50=36.20% lat (msec) : 100=27.86%, 250=7.94%, 500=0.13% cpu : usr=0.08%, sys=5.54%, ctx=1694, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179458: Thu Jun 11 18:19:46 2026 read: IOPS=11, BW=188KiB/s (192kB/s)(6256KiB/33290msec) clat (usec): min=41, max=323167, avg=48653.11, stdev=34138.76 lat (usec): min=41, max=323169, avg=48654.44, stdev=34138.77 clat percentiles (usec): | 1.00th=[ 55], 5.00th=[ 67], 10.00th=[ 15401], 20.00th=[ 25560], | 30.00th=[ 31327], 40.00th=[ 37487], 50.00th=[ 44303], 60.00th=[ 50594], | 70.00th=[ 58983], 80.00th=[ 68682], 90.00th=[ 85459], 95.00th=[100140], | 99.00th=[177210], 99.50th=[227541], 99.90th=[325059], 99.95th=[325059], | 99.99th=[325059] bw ( KiB/s): min= 63, max= 411, per=27.03%, avg=187.88, stdev=73.39, samples=65 iops : min= 3, max= 25, avg=11.02, stdev= 4.64, samples=65 write: IOPS=11, BW=181KiB/s (186kB/s)(6032KiB/33290msec); 0 zone resets clat (usec): min=1646, max=208938, avg=37432.37, stdev=37725.02 lat (usec): min=1647, max=208940, avg=37434.56, stdev=37724.98 clat percentiles (usec): | 1.00th=[ 1778], 5.00th=[ 2008], 10.00th=[ 2966], 20.00th=[ 5538], | 30.00th=[ 10159], 40.00th=[ 15926], 50.00th=[ 25822], 60.00th=[ 35390], | 70.00th=[ 47449], 80.00th=[ 63177], 90.00th=[ 92799], 95.00th=[115868], | 99.00th=[164627], 99.50th=[179307], 99.90th=[208667], 99.95th=[208667], | 99.99th=[208667] bw ( KiB/s): min= 31, max= 352, per=24.36%, avg=178.08, stdev=71.21, samples=65 iops : min= 1, max= 22, avg=10.40, stdev= 4.46, samples=65 lat (usec) : 50=0.13%, 100=3.78%, 250=0.26%, 500=0.26% lat (msec) : 2=2.08%, 4=3.91%, 10=8.33%, 20=10.42%, 50=35.68% lat (msec) : 100=28.26%, 250=6.77%, 500=0.13% cpu : usr=0.07%, sys=5.69%, ctx=1666, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179459: Thu Jun 11 18:19:46 2026 read: IOPS=11, BW=180KiB/s (185kB/s)(6032KiB/33458msec) clat (usec): min=37, max=222876, avg=47826.32, stdev=33380.63 lat (usec): min=37, max=222878, avg=47834.95, stdev=33377.47 clat percentiles (usec): | 1.00th=[ 44], 5.00th=[ 61], 10.00th=[ 71], 20.00th=[ 25297], | 30.00th=[ 32375], 40.00th=[ 38536], 50.00th=[ 43779], 60.00th=[ 50594], | 70.00th=[ 56361], 80.00th=[ 69731], 90.00th=[ 87557], 95.00th=[105382], | 99.00th=[156238], 99.50th=[196084], 99.90th=[223347], 99.95th=[223347], | 99.99th=[223347] bw ( KiB/s): min= 31, max= 379, per=25.79%, avg=179.22, stdev=74.13, samples=65 iops : min= 1, max= 23, avg=10.48, stdev= 4.62, samples=65 write: IOPS=11, BW=187KiB/s (191kB/s)(6256KiB/33458msec); 0 zone resets clat (usec): min=1474, max=248372, avg=38368.65, stdev=39178.86 lat (usec): min=1476, max=248375, avg=38371.18, stdev=39179.93 clat percentiles (usec): | 1.00th=[ 1762], 5.00th=[ 2147], 10.00th=[ 3195], 20.00th=[ 6915], | 30.00th=[ 10683], 40.00th=[ 17171], 50.00th=[ 26346], 60.00th=[ 36963], | 70.00th=[ 47449], 80.00th=[ 63177], 90.00th=[ 91751], 95.00th=[119014], | 99.00th=[175113], 99.50th=[231736], 99.90th=[248513], 99.95th=[248513], | 99.99th=[248513] bw ( KiB/s): min= 62, max= 383, per=25.56%, avg=186.83, stdev=75.66, samples=65 iops : min= 3, max= 23, avg=10.95, stdev= 4.75, samples=65 lat (usec) : 50=0.65%, 100=5.34%, 250=0.13%, 500=0.13% lat (msec) : 2=1.43%, 4=4.95%, 10=8.46%, 20=9.51%, 50=34.77% lat (msec) : 100=27.08%, 250=7.55% cpu : usr=0.05%, sys=5.33%, ctx=1598, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=696KiB/s (712kB/s), 167KiB/s-188KiB/s (171kB/s-192kB/s), io=23.4MiB (24.5MB), run=33290-34430msec WRITE: bw=732KiB/s (749kB/s), 181KiB/s-190KiB/s (186kB/s-195kB/s), io=24.6MiB (25.8MB), run=33290-34430msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179452: Thu Jun 11 18:19:59 2026 read: IOPS=7, BW=127KiB/s (130kB/s)(5920KiB/46777msec) clat (msec): min=8, max=266, avg=48.90, stdev=43.89 lat (msec): min=8, max=266, avg=48.90, stdev=43.89 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 15], 10.00th=[ 17], 20.00th=[ 21], | 30.00th=[ 25], 40.00th=[ 29], 50.00th=[ 34], 60.00th=[ 40], | 70.00th=[ 51], 80.00th=[ 66], 90.00th=[ 103], 95.00th=[ 130], | 99.00th=[ 253], 99.50th=[ 266], 99.90th=[ 268], 99.95th=[ 268], | 99.99th=[ 268] bw ( KiB/s): min= 31, max= 384, per=25.50%, avg=129.28, stdev=81.95, samples=90 iops : min= 1, max= 24, avg= 7.33, stdev= 5.21, samples=90 write: IOPS=8, BW=136KiB/s (139kB/s)(6368KiB/46777msec); 0 zone resets clat (msec): min=17, max=316, avg=71.00, stdev=45.97 lat (msec): min=17, max=316, avg=71.00, stdev=45.97 clat percentiles (msec): | 1.00th=[ 21], 5.00th=[ 26], 10.00th=[ 31], 20.00th=[ 37], | 30.00th=[ 42], 40.00th=[ 46], 50.00th=[ 55], 60.00th=[ 64], | 70.00th=[ 82], 80.00th=[ 104], 90.00th=[ 144], 95.00th=[ 165], | 99.00th=[ 224], 99.50th=[ 255], 99.90th=[ 317], 99.95th=[ 317], | 99.99th=[ 317] bw ( KiB/s): min= 22, max= 382, per=26.04%, avg=139.08, stdev=78.83, samples=90 iops : min= 1, max= 23, avg= 7.96, stdev= 5.00, samples=90 lat (msec) : 10=0.52%, 20=7.68%, 50=48.31%, 100=26.82%, 250=15.89% lat (msec) : 500=0.78% cpu : usr=0.04%, sys=1.90%, ctx=1233, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179453: Thu Jun 11 18:19:59 2026 read: IOPS=7, BW=122KiB/s (125kB/s)(5744KiB/47126msec) clat (msec): min=7, max=260, avg=46.42, stdev=39.47 lat (msec): min=7, max=260, avg=46.43, stdev=39.47 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 13], 10.00th=[ 16], 20.00th=[ 20], | 30.00th=[ 23], 40.00th=[ 28], 50.00th=[ 33], 60.00th=[ 39], | 70.00th=[ 46], 80.00th=[ 74], 90.00th=[ 97], 95.00th=[ 136], | 99.00th=[ 194], 99.50th=[ 205], 99.90th=[ 262], 99.95th=[ 262], | 99.99th=[ 262] bw ( KiB/s): min= 22, max= 413, per=25.48%, avg=129.20, stdev=82.09, samples=86 iops : min= 1, max= 25, avg= 7.34, stdev= 5.19, samples=86 write: IOPS=8, BW=139KiB/s (142kB/s)(6544KiB/47126msec); 0 zone resets clat (msec): min=15, max=309, avg=73.61, stdev=54.51 lat (msec): min=15, max=309, avg=73.62, stdev=54.51 clat percentiles (msec): | 1.00th=[ 20], 5.00th=[ 25], 10.00th=[ 28], 20.00th=[ 35], | 30.00th=[ 41], 40.00th=[ 47], 50.00th=[ 55], 60.00th=[ 63], | 70.00th=[ 80], 80.00th=[ 108], 90.00th=[ 144], 95.00th=[ 190], | 99.00th=[ 279], 99.50th=[ 292], 99.90th=[ 309], 99.95th=[ 309], | 99.99th=[ 309] bw ( KiB/s): min= 31, max= 352, per=25.94%, avg=138.54, stdev=82.09, samples=91 iops : min= 1, max= 22, avg= 7.93, stdev= 5.18, samples=91 lat (msec) : 10=0.39%, 20=10.42%, 50=46.74%, 100=26.30%, 250=14.97% lat (msec) : 500=1.17% cpu : usr=0.05%, sys=1.98%, ctx=1203, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179454: Thu Jun 11 18:19:59 2026 read: IOPS=8, BW=133KiB/s (136kB/s)(6256KiB/47161msec) clat (msec): min=6, max=277, avg=51.62, stdev=47.44 lat (msec): min=6, max=277, avg=51.62, stdev=47.44 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 14], 10.00th=[ 17], 20.00th=[ 20], | 30.00th=[ 23], 40.00th=[ 27], 50.00th=[ 33], 60.00th=[ 42], | 70.00th=[ 52], 80.00th=[ 82], 90.00th=[ 116], 95.00th=[ 155], | 99.00th=[ 236], 99.50th=[ 243], 99.90th=[ 279], 99.95th=[ 279], | 99.99th=[ 279] bw ( KiB/s): min= 31, max= 445, per=26.54%, avg=134.58, stdev=92.44, samples=90 iops : min= 1, max= 27, avg= 7.68, stdev= 5.82, samples=90 write: IOPS=7, BW=128KiB/s (131kB/s)(6032KiB/47161msec); 0 zone resets clat (msec): min=12, max=299, avg=71.35, stdev=45.71 lat (msec): min=12, max=299, avg=71.36, stdev=45.71 clat percentiles (msec): | 1.00th=[ 18], 5.00th=[ 27], 10.00th=[ 30], 20.00th=[ 35], | 30.00th=[ 42], 40.00th=[ 48], 50.00th=[ 57], 60.00th=[ 67], | 70.00th=[ 82], 80.00th=[ 106], 90.00th=[ 140], 95.00th=[ 167], | 99.00th=[ 215], 99.50th=[ 239], 99.90th=[ 300], 99.95th=[ 300], | 99.99th=[ 300] bw ( KiB/s): min= 29, max= 352, per=23.96%, avg=127.96, stdev=72.52, samples=90 iops : min= 1, max= 22, avg= 7.26, stdev= 4.60, samples=90 lat (msec) : 10=0.52%, 20=12.24%, 50=43.49%, 100=26.04%, 250=17.45% lat (msec) : 500=0.26% cpu : usr=0.04%, sys=2.00%, ctx=1205, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179455: Thu Jun 11 18:19:59 2026 read: IOPS=8, BW=131KiB/s (134kB/s)(6032KiB/45986msec) clat (msec): min=8, max=285, avg=47.67, stdev=43.35 lat (msec): min=8, max=285, avg=47.67, stdev=43.35 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 14], 10.00th=[ 16], 20.00th=[ 20], | 30.00th=[ 23], 40.00th=[ 27], 50.00th=[ 32], 60.00th=[ 40], | 70.00th=[ 48], 80.00th=[ 64], 90.00th=[ 110], 95.00th=[ 148], | 99.00th=[ 218], 99.50th=[ 279], 99.90th=[ 284], 99.95th=[ 284], | 99.99th=[ 284] bw ( KiB/s): min= 31, max= 384, per=25.89%, avg=131.28, stdev=81.02, samples=89 iops : min= 1, max= 24, avg= 7.46, stdev= 5.12, samples=89 write: IOPS=8, BW=136KiB/s (139kB/s)(6256KiB/45986msec); 0 zone resets clat (msec): min=14, max=323, avg=70.96, stdev=46.41 lat (msec): min=14, max=323, avg=70.97, stdev=46.41 clat percentiles (msec): | 1.00th=[ 19], 5.00th=[ 26], 10.00th=[ 29], 20.00th=[ 39], | 30.00th=[ 43], 40.00th=[ 48], 50.00th=[ 56], 60.00th=[ 66], | 70.00th=[ 79], 80.00th=[ 95], 90.00th=[ 129], 95.00th=[ 178], | 99.00th=[ 241], 99.50th=[ 288], 99.90th=[ 326], 99.95th=[ 326], | 99.99th=[ 326] bw ( KiB/s): min= 31, max= 377, per=25.46%, avg=135.98, stdev=78.64, samples=90 iops : min= 1, max= 23, avg= 7.76, stdev= 4.95, samples=90 lat (msec) : 10=0.13%, 20=10.94%, 50=45.83%, 100=27.86%, 250=14.71% lat (msec) : 500=0.52% cpu : usr=0.05%, sys=1.99%, ctx=1232, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=508KiB/s (520kB/s), 122KiB/s-133KiB/s (125kB/s-136kB/s), io=23.4MiB (24.5MB), run=45986-47161msec WRITE: bw=534KiB/s (547kB/s), 128KiB/s-139KiB/s (131kB/s-142kB/s), io=24.6MiB (25.8MB), run=45986-47161msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179477: Thu Jun 11 18:20:15 2026 read: IOPS=1, BW=1941KiB/s (1988kB/s)(7168KiB/3692msec) clat (msec): min=185, max=269, avg=224.04, stdev=31.26 lat (msec): min=185, max=269, avg=224.04, stdev=31.26 clat percentiles (msec): | 1.00th=[ 186], 5.00th=[ 186], 10.00th=[ 186], 20.00th=[ 199], | 30.00th=[ 211], 40.00th=[ 211], 50.00th=[ 218], 60.00th=[ 226], | 70.00th=[ 226], 80.00th=[ 262], 90.00th=[ 271], 95.00th=[ 271], | 99.00th=[ 271], 99.50th=[ 271], 99.90th=[ 271], 99.95th=[ 271], | 99.99th=[ 271] bw ( KiB/s): min= 2019, max= 3992, per=60.76%, avg=2703.25, stdev=929.43, samples=4 iops : min= 1, max= 3, avg= 1.75, stdev= 0.96, samples=4 write: IOPS=1, BW=1387KiB/s (1420kB/s)(5120KiB/3692msec); 0 zone resets clat (msec): min=291, max=497, avg=396.94, stdev=84.05 lat (msec): min=291, max=497, avg=397.03, stdev=84.05 clat percentiles (msec): | 1.00th=[ 292], 5.00th=[ 292], 10.00th=[ 292], 20.00th=[ 292], | 30.00th=[ 334], 40.00th=[ 334], 50.00th=[ 418], 60.00th=[ 418], | 70.00th=[ 447], 80.00th=[ 447], 90.00th=[ 498], 95.00th=[ 498], | 99.00th=[ 498], 99.50th=[ 498], 99.90th=[ 498], 99.95th=[ 498], | 99.99th=[ 498] bw ( KiB/s): min= 1980, max= 2027, per=32.19%, avg=2004.50, stdev=22.16, samples=4 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=4 lat (msec) : 250=41.67%, 500=58.33% cpu : usr=0.00%, sys=14.55%, ctx=262, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179478: Thu Jun 11 18:20:15 2026 read: IOPS=0, BW=445KiB/s (456kB/s)(2048KiB/4603msec) clat (msec): min=174, max=195, avg=184.84, stdev=14.69 lat (msec): min=174, max=195, avg=184.84, stdev=14.69 clat percentiles (msec): | 1.00th=[ 176], 5.00th=[ 176], 10.00th=[ 176], 20.00th=[ 176], | 30.00th=[ 176], 40.00th=[ 176], 50.00th=[ 176], 60.00th=[ 197], | 70.00th=[ 197], 80.00th=[ 197], 90.00th=[ 197], 95.00th=[ 197], | 99.00th=[ 197], 99.50th=[ 197], 99.90th=[ 197], 99.95th=[ 197], | 99.99th=[ 197] bw ( KiB/s): min= 1372, max= 1992, per=37.81%, avg=1682.00, stdev=438.41, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2225KiB/s (2278kB/s)(10.0MiB/4603msec); 0 zone resets clat (msec): min=154, max=868, avg=398.82, stdev=234.53 lat (msec): min=154, max=868, avg=398.90, stdev=234.53 clat percentiles (msec): | 1.00th=[ 155], 5.00th=[ 155], 10.00th=[ 155], 20.00th=[ 167], | 30.00th=[ 184], 40.00th=[ 268], 50.00th=[ 309], 60.00th=[ 409], | 70.00th=[ 435], 80.00th=[ 531], 90.00th=[ 667], 95.00th=[ 869], | 99.00th=[ 869], 99.50th=[ 869], 99.90th=[ 869], 99.95th=[ 869], | 99.99th=[ 869] bw ( KiB/s): min= 1980, max= 4055, per=41.55%, avg=2587.43, stdev=981.42, samples=7 iops : min= 1, max= 3, avg= 1.57, stdev= 0.98, samples=7 lat (msec) : 250=41.67%, 500=33.33%, 750=16.67%, 1000=8.33% cpu : usr=0.00%, sys=13.17%, ctx=189, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179479: Thu Jun 11 18:20:15 2026 read: IOPS=1, BW=1484KiB/s (1520kB/s)(6144KiB/4140msec) clat (usec): min=510, max=391592, avg=158859.22, stdev=163990.77 lat (usec): min=512, max=391593, avg=158860.45, stdev=163990.36 clat percentiles (usec): | 1.00th=[ 510], 5.00th=[ 510], 10.00th=[ 510], 20.00th=[ 562], | 30.00th=[ 562], 40.00th=[ 69731], 50.00th=[ 69731], 60.00th=[185598], | 70.00th=[304088], 80.00th=[304088], 90.00th=[392168], 95.00th=[392168], | 99.00th=[392168], 99.50th=[392168], 99.90th=[392168], 99.95th=[392168], | 99.99th=[392168] bw ( KiB/s): min= 2035, max= 4055, per=75.31%, avg=3350.33, stdev=1140.08, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 write: IOPS=1, BW=1484KiB/s (1520kB/s)(6144KiB/4140msec); 0 zone resets clat (msec): min=126, max=1007, avg=467.54, stdev=299.04 lat (msec): min=126, max=1007, avg=467.63, stdev=299.02 clat percentiles (msec): | 1.00th=[ 127], 5.00th=[ 127], 10.00th=[ 127], 20.00th=[ 305], | 30.00th=[ 305], 40.00th=[ 384], 50.00th=[ 384], 60.00th=[ 447], | 70.00th=[ 535], 80.00th=[ 535], 90.00th=[ 1011], 95.00th=[ 1011], | 99.00th=[ 1011], 99.50th=[ 1011], 99.90th=[ 1011], 99.95th=[ 1011], | 99.99th=[ 1011] bw ( KiB/s): min= 1404, max= 2035, per=30.28%, avg=1886.00, stdev=270.32, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 lat (usec) : 750=16.67% lat (msec) : 100=8.33%, 250=16.67%, 500=41.67%, 750=8.33%, 2000=8.33% cpu : usr=0.00%, sys=12.52%, ctx=220, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179480: Thu Jun 11 18:20:15 2026 read: IOPS=1, BW=1220KiB/s (1249kB/s)(5120KiB/4197msec) clat (usec): min=574, max=291163, avg=138897.95, stdev=139101.88 lat (usec): min=576, max=291165, avg=138899.19, stdev=139101.98 clat percentiles (usec): | 1.00th=[ 578], 5.00th=[ 578], 10.00th=[ 578], 20.00th=[ 578], | 30.00th=[ 1795], 40.00th=[ 1795], 50.00th=[135267], 60.00th=[135267], | 70.00th=[267387], 80.00th=[267387], 90.00th=[291505], 95.00th=[291505], | 99.00th=[291505], 99.50th=[291505], 99.90th=[291505], 99.95th=[291505], | 99.99th=[291505] bw ( KiB/s): min= 4063, max= 4063, per=91.32%, avg=4063.00, stdev= 0.00, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1708KiB/s (1749kB/s)(7168KiB/4197msec); 0 zone resets clat (msec): min=201, max=845, avg=457.79, stdev=248.65 lat (msec): min=202, max=845, avg=458.02, stdev=248.50 clat percentiles (msec): | 1.00th=[ 203], 5.00th=[ 203], 10.00th=[ 203], 20.00th=[ 211], | 30.00th=[ 232], 40.00th=[ 232], 50.00th=[ 523], 60.00th=[ 575], | 70.00th=[ 575], 80.00th=[ 617], 90.00th=[ 844], 95.00th=[ 844], | 99.00th=[ 844], 99.50th=[ 844], 99.90th=[ 844], 99.95th=[ 844], | 99.99th=[ 844] bw ( KiB/s): min= 1961, max= 4071, per=48.49%, avg=3020.00, stdev=1173.49, samples=4 iops : min= 1, max= 3, avg= 2.25, stdev= 0.96, samples=4 lat (usec) : 750=8.33% lat (msec) : 2=8.33%, 250=33.33%, 500=16.67%, 750=25.00%, 1000=8.33% cpu : usr=0.00%, sys=10.15%, ctx=217, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4449KiB/s (4556kB/s), 445KiB/s-1941KiB/s (456kB/s-1988kB/s), io=20.0MiB (20.0MB), run=3692-4603msec WRITE: bw=6229KiB/s (6378kB/s), 1387KiB/s-2225KiB/s (1420kB/s-2278kB/s), io=28.0MiB (29.4MB), run=3692-4603msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179472: Thu Jun 11 18:20:16 2026 read: IOPS=1, BW=2027KiB/s (2075kB/s)(7168KiB/3537msec) clat (msec): min=87, max=298, avg=196.01, stdev=71.28 lat (msec): min=87, max=298, avg=196.01, stdev=71.28 clat percentiles (msec): | 1.00th=[ 88], 5.00th=[ 88], 10.00th=[ 88], 20.00th=[ 144], | 30.00th=[ 165], 40.00th=[ 165], 50.00th=[ 197], 60.00th=[ 224], | 70.00th=[ 224], 80.00th=[ 257], 90.00th=[ 300], 95.00th=[ 300], | 99.00th=[ 300], 99.50th=[ 300], 99.90th=[ 300], 99.95th=[ 300], | 99.99th=[ 300] bw ( KiB/s): min= 1939, max= 4140, per=80.52%, avg=3383.33, stdev=1251.31, samples=3 iops : min= 1, max= 4, avg= 2.67, stdev= 1.53, samples=3 write: IOPS=1, BW=1448KiB/s (1482kB/s)(5120KiB/3537msec); 0 zone resets clat (msec): min=186, max=591, avg=413.37, stdev=150.75 lat (msec): min=186, max=591, avg=413.72, stdev=150.91 clat percentiles (msec): | 1.00th=[ 186], 5.00th=[ 186], 10.00th=[ 186], 20.00th=[ 186], | 30.00th=[ 363], 40.00th=[ 363], 50.00th=[ 451], 60.00th=[ 451], | 70.00th=[ 472], 80.00th=[ 472], 90.00th=[ 592], 95.00th=[ 592], | 99.00th=[ 592], 99.50th=[ 592], 99.90th=[ 592], 99.95th=[ 592], | 99.99th=[ 592] bw ( KiB/s): min= 1380, max= 2027, per=30.99%, avg=1823.00, stdev=268.75, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 lat (msec) : 100=8.33%, 250=41.67%, 500=41.67%, 750=8.33% cpu : usr=0.00%, sys=4.72%, ctx=75, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179474: Thu Jun 11 18:20:16 2026 read: IOPS=0, BW=420KiB/s (430kB/s)(2048KiB/4873msec) clat (msec): min=120, max=797, avg=459.01, stdev=478.35 lat (msec): min=120, max=797, avg=459.01, stdev=478.34 clat percentiles (msec): | 1.00th=[ 122], 5.00th=[ 122], 10.00th=[ 122], 20.00th=[ 122], | 30.00th=[ 122], 40.00th=[ 122], 50.00th=[ 122], 60.00th=[ 802], | 70.00th=[ 802], 80.00th=[ 802], 90.00th=[ 802], 95.00th=[ 802], | 99.00th=[ 802], 99.50th=[ 802], 99.90th=[ 802], 99.95th=[ 802], | 99.99th=[ 802] bw ( KiB/s): min= 1946, max= 2039, per=47.42%, avg=1992.50, stdev=65.76, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2101KiB/s (2152kB/s)(10.0MiB/4873msec); 0 zone resets clat (msec): min=179, max=664, avg=392.40, stdev=147.79 lat (msec): min=179, max=665, avg=392.71, stdev=147.99 clat percentiles (msec): | 1.00th=[ 180], 5.00th=[ 180], 10.00th=[ 180], 20.00th=[ 201], | 30.00th=[ 326], 40.00th=[ 342], 50.00th=[ 351], 60.00th=[ 418], | 70.00th=[ 435], 80.00th=[ 464], 90.00th=[ 550], 95.00th=[ 667], | 99.00th=[ 667], 99.50th=[ 667], 99.90th=[ 667], 99.95th=[ 667], | 99.99th=[ 667] bw ( KiB/s): min= 1765, max= 2048, per=33.91%, avg=1995.00, stdev=94.98, samples=8 iops : min= 1, max= 2, avg= 1.12, stdev= 0.35, samples=8 lat (msec) : 250=25.00%, 500=50.00%, 750=16.67%, 1000=8.33% cpu : usr=0.00%, sys=5.32%, ctx=123, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179475: Thu Jun 11 18:20:16 2026 read: IOPS=1, BW=1289KiB/s (1320kB/s)(6144KiB/4767msec) clat (msec): min=81, max=558, avg=311.55, stdev=213.00 lat (msec): min=81, max=558, avg=311.55, stdev=213.00 clat percentiles (msec): | 1.00th=[ 82], 5.00th=[ 82], 10.00th=[ 82], 20.00th=[ 113], | 30.00th=[ 113], 40.00th=[ 184], 50.00th=[ 184], 60.00th=[ 401], | 70.00th=[ 535], 80.00th=[ 535], 90.00th=[ 558], 95.00th=[ 558], | 99.00th=[ 558], 99.50th=[ 558], 99.90th=[ 558], 99.95th=[ 558], | 99.99th=[ 558] bw ( KiB/s): min= 1765, max= 2035, per=46.48%, avg=1953.00, stdev=111.16, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 write: IOPS=1, BW=1289KiB/s (1320kB/s)(6144KiB/4767msec); 0 zone resets clat (msec): min=179, max=1014, avg=455.70, stdev=313.05 lat (msec): min=179, max=1014, avg=455.79, stdev=313.05 clat percentiles (msec): | 1.00th=[ 180], 5.00th=[ 180], 10.00th=[ 180], 20.00th=[ 220], | 30.00th=[ 220], 40.00th=[ 313], 50.00th=[ 313], 60.00th=[ 401], | 70.00th=[ 609], 80.00th=[ 609], 90.00th=[ 1011], 95.00th=[ 1011], | 99.00th=[ 1011], 99.50th=[ 1011], 99.90th=[ 1011], 99.95th=[ 1011], | 99.99th=[ 1011] bw ( KiB/s): min= 1765, max= 2048, per=33.53%, avg=1972.40, stdev=117.10, samples=5 iops : min= 1, max= 2, avg= 1.20, stdev= 0.45, samples=5 lat (msec) : 100=8.33%, 250=33.33%, 500=25.00%, 750=25.00%, 2000=8.33% cpu : usr=0.00%, sys=4.24%, ctx=88, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179476: Thu Jun 11 18:20:16 2026 read: IOPS=1, BW=1259KiB/s (1289kB/s)(5120KiB/4068msec) clat (msec): min=109, max=526, avg=246.61, stdev=172.77 lat (msec): min=109, max=526, avg=246.61, stdev=172.77 clat percentiles (msec): | 1.00th=[ 110], 5.00th=[ 110], 10.00th=[ 110], 20.00th=[ 110], | 30.00th=[ 138], 40.00th=[ 138], 50.00th=[ 161], 60.00th=[ 161], | 70.00th=[ 300], 80.00th=[ 300], 90.00th=[ 527], 95.00th=[ 527], | 99.00th=[ 527], 99.50th=[ 527], 99.90th=[ 527], 99.95th=[ 527], | 99.99th=[ 527] bw ( KiB/s): min= 1762, max= 3878, per=60.66%, avg=2549.00, stdev=1157.45, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 write: IOPS=1, BW=1762KiB/s (1804kB/s)(7168KiB/4068msec); 0 zone resets clat (msec): min=112, max=778, avg=380.44, stdev=207.45 lat (msec): min=112, max=778, avg=380.73, stdev=207.31 clat percentiles (msec): | 1.00th=[ 113], 5.00th=[ 113], 10.00th=[ 113], 20.00th=[ 232], | 30.00th=[ 338], 40.00th=[ 338], 50.00th=[ 368], 60.00th=[ 397], | 70.00th=[ 397], 80.00th=[ 439], 90.00th=[ 776], 95.00th=[ 776], | 99.00th=[ 776], 99.50th=[ 776], 99.90th=[ 776], 99.95th=[ 776], | 99.99th=[ 776] bw ( KiB/s): min= 1395, max= 2048, per=32.44%, avg=1908.50, stdev=254.49, samples=6 iops : min= 1, max= 2, avg= 1.17, stdev= 0.41, samples=6 lat (msec) : 250=41.67%, 500=41.67%, 750=8.33%, 1000=8.33% cpu : usr=0.00%, sys=4.50%, ctx=78, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4203KiB/s (4304kB/s), 420KiB/s-2027KiB/s (430kB/s-2075kB/s), io=20.0MiB (20.0MB), run=3537-4873msec WRITE: bw=5884KiB/s (6025kB/s), 1289KiB/s-2101KiB/s (1320kB/s-2152kB/s), io=28.0MiB (29.4MB), run=3537-4873msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179486: Thu Jun 11 18:20:30 2026 read: IOPS=0, BW=3772KiB/s (3862kB/s)(12.0MiB/3258msec) clat (msec): min=222, max=1470, avg=1032.23, stdev=701.95 lat (msec): min=222, max=1470, avg=1032.23, stdev=701.95 clat percentiles (msec): | 1.00th=[ 224], 5.00th=[ 224], 10.00th=[ 224], 20.00th=[ 224], | 30.00th=[ 224], 40.00th=[ 1401], 50.00th=[ 1401], 60.00th=[ 1401], | 70.00th=[ 1469], 80.00th=[ 1469], 90.00th=[ 1469], 95.00th=[ 1469], | 99.00th=[ 1469], 99.50th=[ 1469], 99.90th=[ 1469], 99.95th=[ 1469], | 99.99th=[ 1469] bw ( KiB/s): min= 8062, max= 8062, per=100.00%, avg=8062.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 2000=66.67% cpu : usr=0.00%, sys=3.47%, ctx=52, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179488: Thu Jun 11 18:20:30 2026 read: IOPS=0, BW=1024KiB/s (1048kB/s)(4096KiB/4001msec) clat (nsec): min=1140.1M, max=1140.1M, avg=1140064467.00, stdev= 0.00 lat (nsec): min=1140.1M, max=1140.1M, avg=1140067875.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1133], 5.00th=[ 1133], 10.00th=[ 1133], 20.00th=[ 1133], | 30.00th=[ 1133], 40.00th=[ 1133], 50.00th=[ 1133], 60.00th=[ 1133], | 70.00th=[ 1133], 80.00th=[ 1133], 90.00th=[ 1133], 95.00th=[ 1133], | 99.00th=[ 1133], 99.50th=[ 1133], 99.90th=[ 1133], 99.95th=[ 1133], | 99.99th=[ 1133] bw ( KiB/s): min= 8110, max= 8110, per=100.00%, avg=8110.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2047KiB/s (2097kB/s)(8192KiB/4001msec); 0 zone resets clat (msec): min=1180, max=1528, avg=1354.04, stdev=246.08 lat (msec): min=1180, max=1528, avg=1354.55, stdev=245.91 clat percentiles (msec): | 1.00th=[ 1183], 5.00th=[ 1183], 10.00th=[ 1183], 20.00th=[ 1183], | 30.00th=[ 1183], 40.00th=[ 1183], 50.00th=[ 1183], 60.00th=[ 1536], | 70.00th=[ 1536], 80.00th=[ 1536], 90.00th=[ 1536], 95.00th=[ 1536], | 99.00th=[ 1536], 99.50th=[ 1536], 99.90th=[ 1536], 99.95th=[ 1536], | 99.99th=[ 1536] bw ( KiB/s): min= 8015, max= 8015, per=97.88%, avg=8015.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 2000=100.00% cpu : usr=0.00%, sys=3.00%, ctx=60, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179489: Thu Jun 11 18:20:30 2026 write: IOPS=1, BW=5815KiB/s (5955kB/s)(12.0MiB/2113msec); 0 zone resets clat (msec): min=312, max=950, avg=655.19, stdev=321.39 lat (msec): min=313, max=950, avg=656.89, stdev=321.38 clat percentiles (msec): | 1.00th=[ 313], 5.00th=[ 313], 10.00th=[ 313], 20.00th=[ 313], | 30.00th=[ 313], 40.00th=[ 701], 50.00th=[ 701], 60.00th=[ 701], | 70.00th=[ 953], 80.00th=[ 953], 90.00th=[ 953], 95.00th=[ 953], | 99.00th=[ 953], 99.50th=[ 953], 99.90th=[ 953], 99.95th=[ 953], | 99.99th=[ 953] bw ( KiB/s): min= 7801, max= 8110, per=97.15%, avg=7955.50, stdev=218.50, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 750=33.33%, 1000=33.33% cpu : usr=0.00%, sys=6.20%, ctx=39, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179490: Thu Jun 11 18:20:30 2026 write: IOPS=1, BW=4146KiB/s (4245kB/s)(12.0MiB/2964msec); 0 zone resets clat (msec): min=387, max=1943, avg=939.40, stdev=871.39 lat (msec): min=388, max=1948, avg=942.24, stdev=872.57 clat percentiles (msec): | 1.00th=[ 388], 5.00th=[ 388], 10.00th=[ 388], 20.00th=[ 388], | 30.00th=[ 388], 40.00th=[ 485], 50.00th=[ 485], 60.00th=[ 485], | 70.00th=[ 1938], 80.00th=[ 1938], 90.00th=[ 1938], 95.00th=[ 1938], | 99.00th=[ 1938], 99.50th=[ 1938], 99.90th=[ 1938], 99.95th=[ 1938], | 99.99th=[ 1938] bw ( KiB/s): min= 5728, max= 8015, per=83.91%, avg=6871.50, stdev=1617.15, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=66.67%, 2000=33.33% cpu : usr=0.00%, sys=4.05%, ctx=58, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4095KiB/s (4193kB/s), 1024KiB/s-3772KiB/s (1048kB/s-3862kB/s), io=16.0MiB (16.8MB), run=3258-4001msec WRITE: bw=8190KiB/s (8387kB/s), 2047KiB/s-5815KiB/s (2097kB/s-5955kB/s), io=32.0MiB (33.6MB), run=2113-4001msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179491: Thu Jun 11 18:20:30 2026 read: IOPS=1, BW=6047KiB/s (6192kB/s)(12.0MiB/2032msec) clat (msec): min=611, max=703, avg=657.57, stdev=46.30 lat (msec): min=611, max=703, avg=657.57, stdev=46.30 clat percentiles (msec): | 1.00th=[ 609], 5.00th=[ 609], 10.00th=[ 609], 20.00th=[ 609], | 30.00th=[ 609], 40.00th=[ 659], 50.00th=[ 659], 60.00th=[ 659], | 70.00th=[ 701], 80.00th=[ 701], 90.00th=[ 701], 95.00th=[ 701], | 99.00th=[ 701], 99.50th=[ 701], 99.90th=[ 701], 99.95th=[ 701], | 99.99th=[ 701] bw ( KiB/s): min= 5565, max= 8078, per=100.00%, avg=6821.50, stdev=1776.96, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=100.00% cpu : usr=0.00%, sys=16.99%, ctx=327, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179492: Thu Jun 11 18:20:30 2026 read: IOPS=0, BW=1392KiB/s (1426kB/s)(4096KiB/2942msec) clat (nsec): min=694092k, max=694092k, avg=694091862.00, stdev= 0.00 lat (nsec): min=694095k, max=694095k, avg=694095060.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 693], 5.00th=[ 693], 10.00th=[ 693], 20.00th=[ 693], | 30.00th=[ 693], 40.00th=[ 693], 50.00th=[ 693], 60.00th=[ 693], | 70.00th=[ 693], 80.00th=[ 693], 90.00th=[ 693], 95.00th=[ 693], | 99.00th=[ 693], 99.50th=[ 693], 99.90th=[ 693], 99.95th=[ 693], | 99.99th=[ 693] bw ( KiB/s): min= 8143, max= 8143, per=100.00%, avg=8143.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2785KiB/s (2851kB/s)(8192KiB/2942msec); 0 zone resets clat (msec): min=542, max=1644, avg=1093.53, stdev=779.50 lat (msec): min=542, max=1645, avg=1094.06, stdev=779.32 clat percentiles (msec): | 1.00th=[ 542], 5.00th=[ 542], 10.00th=[ 542], 20.00th=[ 542], | 30.00th=[ 542], 40.00th=[ 542], 50.00th=[ 542], 60.00th=[ 1653], | 70.00th=[ 1653], 80.00th=[ 1653], 90.00th=[ 1653], 95.00th=[ 1653], | 99.00th=[ 1653], 99.50th=[ 1653], 99.90th=[ 1653], 99.95th=[ 1653], | 99.99th=[ 1653] bw ( KiB/s): min= 8192, max= 8192, per=92.95%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 750=66.67%, 2000=33.33% cpu : usr=0.00%, sys=3.50%, ctx=112, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179493: Thu Jun 11 18:20:30 2026 write: IOPS=0, BW=3305KiB/s (3384kB/s)(12.0MiB/3718msec); 0 zone resets clat (msec): min=288, max=1737, avg=1221.79, stdev=810.02 lat (msec): min=288, max=1739, avg=1223.14, stdev=810.83 clat percentiles (msec): | 1.00th=[ 288], 5.00th=[ 288], 10.00th=[ 288], 20.00th=[ 288], | 30.00th=[ 288], 40.00th=[ 1636], 50.00th=[ 1636], 60.00th=[ 1636], | 70.00th=[ 1737], 80.00th=[ 1737], 90.00th=[ 1737], 95.00th=[ 1737], | 99.00th=[ 1737], 99.50th=[ 1737], 99.90th=[ 1737], 99.95th=[ 1737], | 99.99th=[ 1737] bw ( KiB/s): min= 7816, max= 7831, per=88.77%, avg=7823.50, stdev=10.61, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.00%, sys=2.74%, ctx=40, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179494: Thu Jun 11 18:20:30 2026 write: IOPS=0, BW=3769KiB/s (3860kB/s)(12.0MiB/3260msec); 0 zone resets clat (msec): min=318, max=2273, avg=1066.85, stdev=1055.17 lat (msec): min=319, max=2274, avg=1067.42, stdev=1055.07 clat percentiles (msec): | 1.00th=[ 321], 5.00th=[ 321], 10.00th=[ 321], 20.00th=[ 321], | 30.00th=[ 321], 40.00th=[ 609], 50.00th=[ 609], 60.00th=[ 609], | 70.00th=[ 2265], 80.00th=[ 2265], 90.00th=[ 2265], 95.00th=[ 2265], | 99.00th=[ 2265], 99.50th=[ 2265], 99.90th=[ 2265], 99.95th=[ 2265], | 99.99th=[ 2265] bw ( KiB/s): min= 5673, max= 5673, per=64.37%, avg=5673.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 750=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=2.76%, ctx=46, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5569KiB/s (5703kB/s), 1392KiB/s-6047KiB/s (1426kB/s-6192kB/s), io=16.0MiB (16.8MB), run=2032-2942msec WRITE: bw=8813KiB/s (9025kB/s), 2785KiB/s-3769KiB/s (2851kB/s-3860kB/s), io=32.0MiB (33.6MB), run=2942-3718msec