== sanity test 398b: DIO and buffer IO race ============== 01:40:06 (1781242806) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 6.57498 s, 7.7 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179362: Fri Jun 12 01:42:21 2026 read: IOPS=12, BW=51.5KiB/s (52.7kB/s)(5992KiB/116383msec) clat (usec): min=49, max=693034, avg=43884.52, stdev=32731.54 lat (usec): min=50, max=693036, avg=43886.51, stdev=32731.59 clat percentiles (usec): | 1.00th=[ 60], 5.00th=[ 11994], 10.00th=[ 16712], 20.00th=[ 22414], | 30.00th=[ 27132], 40.00th=[ 32637], 50.00th=[ 38011], 60.00th=[ 43779], | 70.00th=[ 52167], 80.00th=[ 61080], 90.00th=[ 77071], 95.00th=[ 92799], | 99.00th=[152044], 99.50th=[185598], 99.90th=[229639], 99.95th=[692061], | 99.99th=[692061] bw ( KiB/s): min= 7, max= 103, per=25.01%, avg=51.26, stdev=18.43, samples=229 iops : min= 1, max= 25, avg=12.15, stdev= 4.66, samples=229 write: IOPS=13, BW=54.1KiB/s (55.4kB/s)(6296KiB/116383msec); 0 zone resets clat (usec): min=842, max=173066, avg=31881.80, stdev=29828.43 lat (usec): min=843, max=173068, avg=31895.21, stdev=29846.15 clat percentiles (usec): | 1.00th=[ 1319], 5.00th=[ 1532], 10.00th=[ 2245], 20.00th=[ 4883], | 30.00th=[ 9896], 40.00th=[ 17957], 50.00th=[ 24511], 60.00th=[ 31065], | 70.00th=[ 41157], 80.00th=[ 53740], 90.00th=[ 72877], 95.00th=[ 91751], | 99.00th=[130548], 99.50th=[147850], 99.90th=[170918], 99.95th=[173016], | 99.99th=[173016] bw ( KiB/s): min= 7, max= 118, per=25.17%, avg=53.86, stdev=21.31, samples=229 iops : min= 1, max= 29, avg=12.79, stdev= 5.37, samples=229 lat (usec) : 50=0.03%, 100=1.46%, 250=0.20%, 750=0.03%, 1000=0.10% lat (msec) : 2=4.33%, 4=4.46%, 10=6.90%, 20=11.69%, 50=43.20% lat (msec) : 100=23.96%, 250=3.61%, 750=0.03% cpu : usr=0.10%, sys=6.04%, ctx=6991, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179363: Fri Jun 12 01:42:21 2026 read: IOPS=12, BW=50.7KiB/s (51.9kB/s)(5940KiB/117094msec) clat (usec): min=48, max=198748, avg=43304.90, stdev=27365.36 lat (usec): min=48, max=198750, avg=43312.25, stdev=27361.31 clat percentiles (usec): | 1.00th=[ 62], 5.00th=[ 12780], 10.00th=[ 17171], 20.00th=[ 22152], | 30.00th=[ 26870], 40.00th=[ 31851], 50.00th=[ 37487], 60.00th=[ 44303], | 70.00th=[ 51119], 80.00th=[ 60556], 90.00th=[ 76022], 95.00th=[ 92799], | 99.00th=[143655], 99.50th=[166724], 99.90th=[189793], 99.95th=[198181], | 99.99th=[198181] bw ( KiB/s): min= 7, max= 103, per=24.49%, avg=50.19, stdev=17.89, samples=231 iops : min= 1, max= 25, avg=11.88, stdev= 4.50, samples=231 write: IOPS=13, BW=54.2KiB/s (55.5kB/s)(6348KiB/117094msec); 0 zone resets clat (usec): min=953, max=647694, avg=32954.17, stdev=35016.44 lat (usec): min=954, max=647695, avg=32963.26, stdev=35017.75 clat percentiles (usec): | 1.00th=[ 1303], 5.00th=[ 1549], 10.00th=[ 2245], 20.00th=[ 5014], | 30.00th=[ 8586], 40.00th=[ 17433], 50.00th=[ 24249], 60.00th=[ 31327], | 70.00th=[ 41681], 80.00th=[ 55837], 90.00th=[ 78119], 95.00th=[ 95945], | 99.00th=[132645], 99.50th=[158335], 99.90th=[217056], 99.95th=[650118], | 99.99th=[650118] bw ( KiB/s): min= 7, max= 135, per=25.00%, avg=53.50, stdev=21.55, samples=231 iops : min= 1, max= 33, avg=12.71, stdev= 5.43, samples=231 lat (usec) : 50=0.03%, 100=1.04%, 250=0.23%, 750=0.03%, 1000=0.07% lat (msec) : 2=4.43%, 4=3.87%, 10=8.33%, 20=11.78%, 50=42.45% lat (msec) : 100=23.70%, 250=4.00%, 750=0.03% cpu : usr=0.10%, sys=5.75%, ctx=6857, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179364: Fri Jun 12 01:42:21 2026 read: IOPS=12, BW=51.7KiB/s (52.0kB/s)(6028KiB/116514msec) clat (usec): min=38, max=676602, avg=41960.06, stdev=30708.74 lat (usec): min=38, max=676603, avg=41963.28, stdev=30708.91 clat percentiles (usec): | 1.00th=[ 61], 5.00th=[ 11600], 10.00th=[ 16188], 20.00th=[ 22152], | 30.00th=[ 26870], 40.00th=[ 31589], 50.00th=[ 35914], 60.00th=[ 42730], | 70.00th=[ 49546], 80.00th=[ 57934], 90.00th=[ 71828], 95.00th=[ 87557], | 99.00th=[126354], 99.50th=[152044], 99.90th=[320865], 99.95th=[675283], | 99.99th=[675283] bw ( KiB/s): min= 5, max= 119, per=25.01%, avg=51.28, stdev=20.33, samples=230 iops : min= 1, max= 29, avg=12.14, stdev= 5.10, samples=230 write: IOPS=13, BW=53.7KiB/s (55.0kB/s)(6260KiB/116514msec); 0 zone resets clat (usec): min=869, max=271232, avg=33728.03, stdev=34254.33 lat (usec): min=870, max=271234, avg=33740.29, stdev=34255.93 clat percentiles (usec): | 1.00th=[ 1319], 5.00th=[ 1565], 10.00th=[ 2180], 20.00th=[ 4817], | 30.00th=[ 9110], 40.00th=[ 17171], 50.00th=[ 24773], 60.00th=[ 32900], | 70.00th=[ 42206], 80.00th=[ 56886], 90.00th=[ 78119], 95.00th=[101188], | 99.00th=[147850], 99.50th=[179307], 99.90th=[233833], 99.95th=[270533], | 99.99th=[270533] bw ( KiB/s): min= 7, max= 111, per=24.83%, avg=53.14, stdev=21.40, samples=230 iops : min= 1, max= 27, avg=12.63, stdev= 5.41, samples=230 lat (usec) : 50=0.13%, 100=1.37%, 250=0.20%, 500=0.07%, 750=0.03% lat (usec) : 1000=0.03% lat (msec) : 2=4.85%, 4=4.23%, 10=7.10%, 20=12.43%, 50=42.55% lat (msec) : 100=22.79%, 250=4.13%, 500=0.07%, 750=0.03% cpu : usr=0.08%, sys=5.74%, ctx=6863, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179365: Fri Jun 12 01:42:21 2026 read: IOPS=13, BW=52.8KiB/s (54.1kB/s)(6052KiB/114629msec) clat (usec): min=34, max=679304, avg=42285.93, stdev=31043.66 lat (usec): min=34, max=679306, avg=42291.38, stdev=31043.81 clat percentiles (usec): | 1.00th=[ 61], 5.00th=[ 12780], 10.00th=[ 17171], 20.00th=[ 22152], | 30.00th=[ 26608], 40.00th=[ 31589], 50.00th=[ 36963], 60.00th=[ 43254], | 70.00th=[ 50070], 80.00th=[ 58459], 90.00th=[ 70779], 95.00th=[ 88605], | 99.00th=[135267], 99.50th=[166724], 99.90th=[304088], 99.95th=[675283], | 99.99th=[675283] bw ( KiB/s): min= 7, max= 103, per=25.67%, avg=52.63, stdev=18.89, samples=225 iops : min= 1, max= 25, avg=12.49, stdev= 4.76, samples=225 write: IOPS=13, BW=54.4KiB/s (55.7kB/s)(6236KiB/114629msec); 0 zone resets clat (usec): min=886, max=228539, avg=32169.99, stdev=31759.08 lat (usec): min=887, max=228542, avg=32172.50, stdev=31759.60 clat percentiles (usec): | 1.00th=[ 1303], 5.00th=[ 1532], 10.00th=[ 2212], 20.00th=[ 4621], | 30.00th=[ 7898], 40.00th=[ 15401], 50.00th=[ 22676], 60.00th=[ 30802], | 70.00th=[ 42206], 80.00th=[ 56886], 90.00th=[ 77071], 95.00th=[ 94897], | 99.00th=[131597], 99.50th=[141558], 99.90th=[200279], 99.95th=[227541], | 99.99th=[227541] bw ( KiB/s): min= 7, max= 140, per=25.19%, avg=53.91, stdev=21.99, samples=226 iops : min= 1, max= 35, avg=12.82, stdev= 5.54, samples=226 lat (usec) : 50=0.07%, 100=1.30%, 250=0.07%, 500=0.10%, 1000=0.10% lat (msec) : 2=4.59%, 4=4.23%, 10=8.56%, 20=11.78%, 50=41.80% lat (msec) : 100=24.06%, 250=3.29%, 500=0.03%, 750=0.03% cpu : usr=0.07%, sys=5.74%, ctx=6838, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=205KiB/s (210kB/s), 50.7KiB/s-52.8KiB/s (51.9kB/s-54.1kB/s), io=23.4MiB (24.6MB), run=114629-117094msec WRITE: bw=215KiB/s (220kB/s), 53.7KiB/s-54.4KiB/s (55.0kB/s-55.7kB/s), io=24.6MiB (25.7MB), run=114629-117094msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179367: Fri Jun 12 01:42:58 2026 read: IOPS=9, BW=39.1KiB/s (40.1kB/s)(5992KiB/153180msec) clat (msec): min=6, max=729, avg=41.30, stdev=39.10 lat (msec): min=6, max=729, avg=41.30, stdev=39.10 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 14], 20.00th=[ 17], | 30.00th=[ 21], 40.00th=[ 25], 50.00th=[ 29], 60.00th=[ 36], | 70.00th=[ 44], 80.00th=[ 59], 90.00th=[ 88], 95.00th=[ 112], | 99.00th=[ 182], 99.50th=[ 220], 99.90th=[ 266], 99.95th=[ 726], | 99.99th=[ 726] bw ( KiB/s): min= 7, max= 150, per=25.30%, avg=39.21, stdev=25.97, samples=296 iops : min= 1, max= 37, avg= 9.14, stdev= 6.54, samples=296 write: IOPS=10, BW=41.1KiB/s (42.1kB/s)(6296KiB/153180msec); 0 zone resets clat (msec): min=11, max=350, avg=57.80, stdev=39.25 lat (msec): min=11, max=350, avg=57.80, stdev=39.26 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 19], 10.00th=[ 23], 20.00th=[ 28], | 30.00th=[ 34], 40.00th=[ 40], 50.00th=[ 47], 60.00th=[ 56], | 70.00th=[ 67], 80.00th=[ 84], 90.00th=[ 107], 95.00th=[ 134], | 99.00th=[ 192], 99.50th=[ 234], 99.90th=[ 326], 99.95th=[ 351], | 99.99th=[ 351] bw ( KiB/s): min= 7, max= 127, per=25.10%, avg=40.92, stdev=23.89, samples=299 iops : min= 1, max= 31, avg= 9.56, stdev= 5.99, samples=299 lat (msec) : 10=1.46%, 20=16.63%, 50=46.48%, 100=25.81%, 250=9.31% lat (msec) : 500=0.26%, 750=0.03% cpu : usr=0.07%, sys=2.42%, ctx=5061, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179368: Fri Jun 12 01:42:58 2026 read: IOPS=9, BW=38.6KiB/s (39.5kB/s)(5940KiB/153957msec) clat (msec): min=5, max=646, avg=41.62, stdev=40.01 lat (msec): min=5, max=646, avg=41.63, stdev=40.01 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 17], | 30.00th=[ 20], 40.00th=[ 24], 50.00th=[ 29], 60.00th=[ 34], | 70.00th=[ 44], 80.00th=[ 62], 90.00th=[ 91], 95.00th=[ 116], | 99.00th=[ 178], 99.50th=[ 201], 99.90th=[ 321], 99.95th=[ 651], | 99.99th=[ 651] bw ( KiB/s): min= 7, max= 158, per=25.55%, avg=39.61, stdev=26.78, samples=292 iops : min= 1, max= 39, avg= 9.22, stdev= 6.72, samples=292 write: IOPS=10, BW=41.2KiB/s (42.2kB/s)(6348KiB/153957msec); 0 zone resets clat (msec): min=11, max=338, avg=57.84, stdev=39.58 lat (msec): min=11, max=338, avg=57.85, stdev=39.58 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 20], 10.00th=[ 22], 20.00th=[ 27], | 30.00th=[ 33], 40.00th=[ 39], 50.00th=[ 47], 60.00th=[ 56], | 70.00th=[ 67], 80.00th=[ 84], 90.00th=[ 111], 95.00th=[ 138], | 99.00th=[ 197], 99.50th=[ 230], 99.90th=[ 313], 99.95th=[ 338], | 99.99th=[ 338] bw ( KiB/s): min= 7, max= 120, per=25.04%, avg=40.81, stdev=24.32, samples=302 iops : min= 1, max= 30, avg= 9.53, stdev= 6.12, samples=302 lat (msec) : 10=2.08%, 20=16.44%, 50=45.12%, 100=25.68%, 250=10.42% lat (msec) : 500=0.23%, 750=0.03% cpu : usr=0.07%, sys=2.32%, ctx=4943, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179369: Fri Jun 12 01:42:58 2026 read: IOPS=9, BW=39.4KiB/s (40.4kB/s)(6028KiB/152904msec) clat (msec): min=6, max=228, avg=41.02, stdev=34.48 lat (msec): min=6, max=228, avg=41.03, stdev=34.48 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 17], | 30.00th=[ 20], 40.00th=[ 24], 50.00th=[ 29], 60.00th=[ 36], | 70.00th=[ 45], 80.00th=[ 61], 90.00th=[ 91], 95.00th=[ 115], | 99.00th=[ 163], 99.50th=[ 194], 99.90th=[ 220], 99.95th=[ 228], | 99.99th=[ 228] bw ( KiB/s): min= 7, max= 150, per=25.55%, avg=39.60, stdev=25.25, samples=296 iops : min= 1, max= 37, avg= 9.23, stdev= 6.35, samples=296 write: IOPS=10, BW=40.9KiB/s (41.9kB/s)(6260KiB/152904msec); 0 zone resets clat (msec): min=9, max=707, avg=57.97, stdev=42.94 lat (msec): min=9, max=707, avg=57.98, stdev=42.94 clat percentiles (msec): | 1.00th=[ 15], 5.00th=[ 20], 10.00th=[ 22], 20.00th=[ 28], | 30.00th=[ 33], 40.00th=[ 39], 50.00th=[ 45], 60.00th=[ 55], | 70.00th=[ 67], 80.00th=[ 84], 90.00th=[ 110], 95.00th=[ 136], | 99.00th=[ 205], 99.50th=[ 234], 99.90th=[ 359], 99.95th=[ 709], | 99.99th=[ 709] bw ( KiB/s): min= 7, max= 134, per=25.00%, avg=40.76, stdev=24.18, samples=299 iops : min= 1, max= 33, avg= 9.52, stdev= 6.08, samples=299 lat (msec) : 10=2.21%, 20=16.02%, 50=46.42%, 100=25.29%, 250=9.86% lat (msec) : 500=0.16%, 750=0.03% cpu : usr=0.06%, sys=2.35%, ctx=4958, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179370: Fri Jun 12 01:42:58 2026 read: IOPS=9, BW=39.4KiB/s (40.4kB/s)(6052KiB/153553msec) clat (msec): min=5, max=289, avg=40.95, stdev=36.79 lat (msec): min=5, max=289, avg=40.95, stdev=36.79 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 17], | 30.00th=[ 20], 40.00th=[ 23], 50.00th=[ 28], 60.00th=[ 34], | 70.00th=[ 44], 80.00th=[ 58], 90.00th=[ 90], 95.00th=[ 123], | 99.00th=[ 178], 99.50th=[ 207], 99.90th=[ 279], 99.95th=[ 288], | 99.99th=[ 288] bw ( KiB/s): min= 7, max= 167, per=25.66%, avg=39.77, stdev=26.38, samples=296 iops : min= 1, max= 41, avg= 9.27, stdev= 6.61, samples=296 write: IOPS=10, BW=40.6KiB/s (41.6kB/s)(6236KiB/153553msec); 0 zone resets clat (msec): min=9, max=765, avg=58.55, stdev=43.60 lat (msec): min=9, max=765, avg=58.56, stdev=43.60 clat percentiles (msec): | 1.00th=[ 15], 5.00th=[ 20], 10.00th=[ 23], 20.00th=[ 28], | 30.00th=[ 33], 40.00th=[ 39], 50.00th=[ 46], 60.00th=[ 57], | 70.00th=[ 68], 80.00th=[ 85], 90.00th=[ 111], 95.00th=[ 136], | 99.00th=[ 199], 99.50th=[ 234], 99.90th=[ 342], 99.95th=[ 768], | 99.99th=[ 768] bw ( KiB/s): min= 7, max= 134, per=24.73%, avg=40.30, stdev=24.35, samples=300 iops : min= 1, max= 33, avg= 9.40, stdev= 6.13, samples=300 lat (msec) : 10=2.08%, 20=16.31%, 50=46.42%, 100=24.28%, 250=10.64% lat (msec) : 500=0.23%, 1000=0.03% cpu : usr=0.07%, sys=2.42%, ctx=5025, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=156KiB/s (160kB/s), 38.6KiB/s-39.4KiB/s (39.5kB/s-40.4kB/s), io=23.4MiB (24.6MB), run=152904-153957msec WRITE: bw=163KiB/s (167kB/s), 40.6KiB/s-41.2KiB/s (41.6kB/s-42.2kB/s), io=24.6MiB (25.7MB), run=152904-153957msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179409: Fri Jun 12 01:43:39 2026 read: IOPS=11, BW=190KiB/s (194kB/s)(5920KiB/31221msec) clat (usec): min=53, max=212592, avg=45643.51, stdev=31508.92 lat (usec): min=54, max=212592, avg=45644.81, stdev=31508.94 clat percentiles (usec): | 1.00th=[ 56], 5.00th=[ 73], 10.00th=[ 9503], 20.00th=[ 22938], | 30.00th=[ 28181], 40.00th=[ 33162], 50.00th=[ 39584], 60.00th=[ 47973], | 70.00th=[ 54789], 80.00th=[ 67634], 90.00th=[ 84411], 95.00th=[105382], | 99.00th=[139461], 99.50th=[168821], 99.90th=[212861], 99.95th=[212861], | 99.99th=[212861] bw ( KiB/s): min= 31, max= 382, per=24.28%, avg=186.23, stdev=79.67, samples=61 iops : min= 1, max= 23, avg=10.82, stdev= 5.03, samples=61 write: IOPS=12, BW=204KiB/s (209kB/s)(6368KiB/31221msec); 0 zone resets clat (usec): min=1621, max=173544, avg=35811.86, stdev=31822.14 lat (usec): min=1622, max=173547, avg=35814.39, stdev=31822.19 clat percentiles (usec): | 1.00th=[ 1844], 5.00th=[ 2311], 10.00th=[ 3621], 20.00th=[ 6915], | 30.00th=[ 13042], 40.00th=[ 21890], 50.00th=[ 29230], 60.00th=[ 35914], | 70.00th=[ 45351], 80.00th=[ 57410], 90.00th=[ 77071], 95.00th=[ 99091], | 99.00th=[149947], 99.50th=[168821], 99.90th=[173016], 99.95th=[173016], | 99.99th=[173016] bw ( KiB/s): min= 31, max= 412, per=25.10%, avg=202.52, stdev=74.19, samples=61 iops : min= 1, max= 25, avg=11.85, stdev= 4.70, samples=61 lat (usec) : 100=3.78%, 250=0.26%, 500=0.26% lat (msec) : 2=1.04%, 4=4.95%, 10=7.81%, 20=9.51%, 50=40.49% lat (msec) : 100=26.43%, 250=5.47% cpu : usr=0.07%, sys=5.94%, ctx=1779, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179410: Fri Jun 12 01:43:39 2026 read: IOPS=11, BW=185KiB/s (190kB/s)(5744KiB/30969msec) clat (usec): min=43, max=169386, avg=43996.06, stdev=29270.25 lat (usec): min=44, max=169387, avg=43997.41, stdev=29270.30 clat percentiles (usec): | 1.00th=[ 58], 5.00th=[ 80], 10.00th=[ 14484], 20.00th=[ 23200], | 30.00th=[ 28967], 40.00th=[ 33817], 50.00th=[ 38011], 60.00th=[ 43779], | 70.00th=[ 51643], 80.00th=[ 62653], 90.00th=[ 81265], 95.00th=[ 99091], | 99.00th=[164627], 99.50th=[168821], 99.90th=[168821], 99.95th=[168821], | 99.99th=[168821] bw ( KiB/s): min= 63, max= 383, per=23.94%, avg=183.58, stdev=76.23, samples=60 iops : min= 3, max= 23, avg=10.67, stdev= 4.80, samples=60 write: IOPS=13, BW=211KiB/s (216kB/s)(6544KiB/30969msec); 0 zone resets clat (usec): min=1335, max=240299, avg=36737.28, stdev=36779.82 lat (usec): min=1338, max=240302, avg=36743.28, stdev=36779.70 clat percentiles (usec): | 1.00th=[ 1795], 5.00th=[ 2442], 10.00th=[ 3556], 20.00th=[ 6718], | 30.00th=[ 10945], 40.00th=[ 18220], 50.00th=[ 25297], 60.00th=[ 34866], | 70.00th=[ 45876], 80.00th=[ 61604], 90.00th=[ 84411], 95.00th=[104334], | 99.00th=[158335], 99.50th=[175113], 99.90th=[240124], 99.95th=[240124], | 99.99th=[240124] bw ( KiB/s): min= 63, max= 415, per=25.38%, avg=204.78, stdev=82.00, samples=60 iops : min= 3, max= 25, avg=12.00, stdev= 5.18, samples=60 lat (usec) : 50=0.13%, 100=2.86%, 250=0.26%, 500=0.26% lat (msec) : 2=1.43%, 4=4.69%, 10=9.38%, 20=10.94%, 50=40.23% lat (msec) : 100=24.87%, 250=4.95% cpu : usr=0.07%, sys=5.87%, ctx=1760, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179411: Fri Jun 12 01:43:39 2026 read: IOPS=13, BW=209KiB/s (214kB/s)(6256KiB/29981msec) clat (usec): min=46, max=201587, avg=45697.21, stdev=31321.30 lat (usec): min=47, max=201589, avg=45703.90, stdev=31321.14 clat percentiles (usec): | 1.00th=[ 61], 5.00th=[ 80], 10.00th=[ 14353], 20.00th=[ 24773], | 30.00th=[ 30016], 40.00th=[ 34866], 50.00th=[ 40109], 60.00th=[ 46924], | 70.00th=[ 53740], 80.00th=[ 65274], 90.00th=[ 78119], 95.00th=[102237], | 99.00th=[177210], 99.50th=[193987], 99.90th=[202376], 99.95th=[202376], | 99.99th=[202376] bw ( KiB/s): min= 94, max= 381, per=27.25%, avg=208.98, stdev=72.71, samples=59 iops : min= 5, max= 23, avg=12.25, stdev= 4.61, samples=59 write: IOPS=12, BW=201KiB/s (206kB/s)(6032KiB/29981msec); 0 zone resets clat (usec): min=1433, max=148768, avg=31764.02, stdev=30608.29 lat (usec): min=1435, max=148772, avg=31766.76, stdev=30608.50 clat percentiles (usec): | 1.00th=[ 1958], 5.00th=[ 2343], 10.00th=[ 3458], 20.00th=[ 5669], | 30.00th=[ 8979], 40.00th=[ 13960], 50.00th=[ 21627], 60.00th=[ 30278], | 70.00th=[ 43254], 80.00th=[ 55313], 90.00th=[ 74974], 95.00th=[ 96994], | 99.00th=[135267], 99.50th=[147850], 99.90th=[147850], 99.95th=[147850], | 99.99th=[147850] bw ( KiB/s): min= 63, max= 411, per=25.20%, avg=203.38, stdev=77.80, samples=58 iops : min= 3, max= 25, avg=11.90, stdev= 4.92, samples=58 lat (usec) : 50=0.13%, 100=3.12%, 250=0.78%, 750=0.13% lat (msec) : 2=0.65%, 4=5.34%, 10=10.42%, 20=10.94%, 50=39.06% lat (msec) : 100=24.48%, 250=4.95% cpu : usr=0.07%, sys=6.11%, ctx=1793, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179412: Fri Jun 12 01:43:39 2026 read: IOPS=12, BW=198KiB/s (203kB/s)(6032KiB/30484msec) clat (usec): min=46, max=196705, avg=42601.56, stdev=29960.31 lat (usec): min=48, max=196706, avg=42602.96, stdev=29960.24 clat percentiles (usec): | 1.00th=[ 62], 5.00th=[ 75], 10.00th=[ 88], 20.00th=[ 22414], | 30.00th=[ 27919], 40.00th=[ 32637], 50.00th=[ 38011], 60.00th=[ 44827], | 70.00th=[ 51643], 80.00th=[ 60556], 90.00th=[ 78119], 95.00th=[101188], | 99.00th=[143655], 99.50th=[181404], 99.90th=[196084], 99.95th=[196084], | 99.99th=[196084] bw ( KiB/s): min= 63, max= 412, per=25.75%, avg=197.47, stdev=80.08, samples=60 iops : min= 3, max= 25, avg=11.53, stdev= 5.07, samples=60 write: IOPS=12, BW=205KiB/s (210kB/s)(6256KiB/30484msec); 0 zone resets clat (usec): min=1457, max=178854, avg=36505.70, stdev=35087.66 lat (usec): min=1461, max=178856, avg=36510.67, stdev=35085.71 clat percentiles (usec): | 1.00th=[ 1827], 5.00th=[ 2212], 10.00th=[ 3228], 20.00th=[ 6587], | 30.00th=[ 11863], 40.00th=[ 18220], 50.00th=[ 25035], 60.00th=[ 34866], | 70.00th=[ 47973], 80.00th=[ 61080], 90.00th=[ 86508], 95.00th=[106431], | 99.00th=[162530], 99.50th=[170918], 99.90th=[179307], 99.95th=[179307], | 99.99th=[179307] bw ( KiB/s): min= 31, max= 444, per=25.41%, avg=205.08, stdev=81.32, samples=60 iops : min= 1, max= 27, avg=12.02, stdev= 5.08, samples=60 lat (usec) : 50=0.13%, 100=5.08%, 250=0.13%, 500=0.13%, 1000=0.13% lat (msec) : 2=1.43%, 4=5.47%, 10=7.29%, 20=10.81%, 50=38.80% lat (msec) : 100=24.87%, 250=5.73% cpu : usr=0.08%, sys=6.00%, ctx=1777, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=767KiB/s (786kB/s), 185KiB/s-209KiB/s (190kB/s-214kB/s), io=23.4MiB (24.5MB), run=29981-31221msec WRITE: bw=807KiB/s (827kB/s), 201KiB/s-211KiB/s (206kB/s-216kB/s), io=24.6MiB (25.8MB), run=29981-31221msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179414: Fri Jun 12 01:43:50 2026 read: IOPS=8, BW=143KiB/s (146kB/s)(5920KiB/41505msec) clat (msec): min=8, max=243, avg=44.01, stdev=38.93 lat (msec): min=8, max=243, avg=44.01, stdev=38.93 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 14], 10.00th=[ 15], 20.00th=[ 19], | 30.00th=[ 22], 40.00th=[ 26], 50.00th=[ 30], 60.00th=[ 35], | 70.00th=[ 43], 80.00th=[ 63], 90.00th=[ 95], 95.00th=[ 136], | 99.00th=[ 201], 99.50th=[ 230], 99.90th=[ 245], 99.95th=[ 245], | 99.99th=[ 245] bw ( KiB/s): min= 31, max= 441, per=25.03%, avg=142.67, stdev=85.74, samples=80 iops : min= 1, max= 27, avg= 8.09, stdev= 5.43, samples=80 write: IOPS=9, BW=153KiB/s (157kB/s)(6368KiB/41505msec); 0 zone resets clat (msec): min=14, max=226, avg=63.20, stdev=40.27 lat (msec): min=14, max=226, avg=63.21, stdev=40.29 clat percentiles (msec): | 1.00th=[ 19], 5.00th=[ 25], 10.00th=[ 28], 20.00th=[ 32], | 30.00th=[ 37], 40.00th=[ 43], 50.00th=[ 50], 60.00th=[ 61], | 70.00th=[ 71], 80.00th=[ 88], 90.00th=[ 127], 95.00th=[ 150], | 99.00th=[ 209], 99.50th=[ 220], 99.90th=[ 228], 99.95th=[ 228], | 99.99th=[ 228] bw ( KiB/s): min= 31, max= 380, per=25.74%, avg=154.44, stdev=83.40, samples=80 iops : min= 1, max= 23, avg= 8.82, stdev= 5.27, samples=80 lat (msec) : 10=0.52%, 20=12.76%, 50=49.09%, 100=25.00%, 250=12.63% cpu : usr=0.06%, sys=2.30%, ctx=1263, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179415: Fri Jun 12 01:43:50 2026 read: IOPS=8, BW=138KiB/s (142kB/s)(5744KiB/41560msec) clat (msec): min=8, max=281, avg=43.71, stdev=39.17 lat (msec): min=8, max=281, avg=43.71, stdev=39.17 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 17], | 30.00th=[ 21], 40.00th=[ 25], 50.00th=[ 30], 60.00th=[ 35], | 70.00th=[ 46], 80.00th=[ 62], 90.00th=[ 105], 95.00th=[ 134], | 99.00th=[ 163], 99.50th=[ 251], 99.90th=[ 284], 99.95th=[ 284], | 99.99th=[ 284] bw ( KiB/s): min= 21, max= 412, per=24.65%, avg=140.51, stdev=89.69, samples=79 iops : min= 1, max= 25, avg= 7.95, stdev= 5.68, samples=79 write: IOPS=9, BW=157KiB/s (161kB/s)(6544KiB/41560msec); 0 zone resets clat (msec): min=15, max=364, avg=63.06, stdev=42.36 lat (msec): min=15, max=364, avg=63.09, stdev=42.36 clat percentiles (msec): | 1.00th=[ 19], 5.00th=[ 22], 10.00th=[ 27], 20.00th=[ 33], | 30.00th=[ 39], 40.00th=[ 44], 50.00th=[ 53], 60.00th=[ 62], | 70.00th=[ 71], 80.00th=[ 86], 90.00th=[ 110], 95.00th=[ 144], | 99.00th=[ 218], 99.50th=[ 279], 99.90th=[ 363], 99.95th=[ 363], | 99.99th=[ 363] bw ( KiB/s): min= 31, max= 349, per=25.95%, avg=155.68, stdev=79.87, samples=81 iops : min= 1, max= 21, avg= 8.90, stdev= 5.05, samples=81 lat (msec) : 10=0.26%, 20=14.06%, 50=44.92%, 100=30.08%, 250=10.16% lat (msec) : 500=0.52% cpu : usr=0.06%, sys=2.39%, ctx=1267, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179416: Fri Jun 12 01:43:50 2026 read: IOPS=9, BW=151KiB/s (154kB/s)(6256KiB/41542msec) clat (msec): min=7, max=345, avg=44.57, stdev=38.29 lat (msec): min=7, max=345, avg=44.57, stdev=38.29 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 13], 10.00th=[ 14], 20.00th=[ 18], | 30.00th=[ 22], 40.00th=[ 26], 50.00th=[ 32], 60.00th=[ 39], | 70.00th=[ 48], 80.00th=[ 67], 90.00th=[ 95], 95.00th=[ 124], | 99.00th=[ 169], 99.50th=[ 218], 99.90th=[ 347], 99.95th=[ 347], | 99.99th=[ 347] bw ( KiB/s): min= 31, max= 443, per=26.79%, avg=152.72, stdev=98.87, samples=80 iops : min= 1, max= 27, avg= 8.73, stdev= 6.24, samples=80 write: IOPS=9, BW=145KiB/s (149kB/s)(6032KiB/41542msec); 0 zone resets clat (msec): min=14, max=269, avg=63.74, stdev=42.73 lat (msec): min=14, max=269, avg=63.75, stdev=42.73 clat percentiles (msec): | 1.00th=[ 19], 5.00th=[ 23], 10.00th=[ 27], 20.00th=[ 32], | 30.00th=[ 37], 40.00th=[ 42], 50.00th=[ 50], 60.00th=[ 58], | 70.00th=[ 72], 80.00th=[ 90], 90.00th=[ 125], 95.00th=[ 150], | 99.00th=[ 241], 99.50th=[ 245], 99.90th=[ 271], 99.95th=[ 271], | 99.99th=[ 271] bw ( KiB/s): min= 31, max= 349, per=24.11%, avg=144.69, stdev=82.19, samples=80 iops : min= 1, max= 21, avg= 8.21, stdev= 5.19, samples=80 lat (msec) : 10=0.65%, 20=13.54%, 50=46.88%, 100=26.30%, 250=12.37% lat (msec) : 500=0.26% cpu : usr=0.06%, sys=2.21%, ctx=1274, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179417: Fri Jun 12 01:43:50 2026 read: IOPS=8, BW=144KiB/s (147kB/s)(6032KiB/41980msec) clat (msec): min=8, max=358, avg=46.72, stdev=42.59 lat (msec): min=8, max=358, avg=46.72, stdev=42.59 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 14], 10.00th=[ 17], 20.00th=[ 19], | 30.00th=[ 22], 40.00th=[ 25], 50.00th=[ 32], 60.00th=[ 40], | 70.00th=[ 48], 80.00th=[ 67], 90.00th=[ 101], 95.00th=[ 136], | 99.00th=[ 205], 99.50th=[ 239], 99.90th=[ 359], 99.95th=[ 359], | 99.99th=[ 359] bw ( KiB/s): min= 31, max= 448, per=25.58%, avg=145.83, stdev=91.00, samples=80 iops : min= 1, max= 28, avg= 8.27, stdev= 5.75, samples=80 write: IOPS=9, BW=149KiB/s (153kB/s)(6256KiB/41980msec); 0 zone resets clat (msec): min=13, max=314, avg=62.08, stdev=44.29 lat (msec): min=13, max=314, avg=62.09, stdev=44.28 clat percentiles (msec): | 1.00th=[ 19], 5.00th=[ 22], 10.00th=[ 26], 20.00th=[ 30], | 30.00th=[ 34], 40.00th=[ 40], 50.00th=[ 47], 60.00th=[ 54], | 70.00th=[ 70], 80.00th=[ 88], 90.00th=[ 127], 95.00th=[ 155], | 99.00th=[ 209], 99.50th=[ 226], 99.90th=[ 317], 99.95th=[ 317], | 99.99th=[ 317] bw ( KiB/s): min= 31, max= 383, per=24.97%, avg=149.79, stdev=89.68, samples=81 iops : min= 1, max= 23, avg= 8.54, stdev= 5.68, samples=81 lat (msec) : 10=0.26%, 20=13.41%, 50=49.22%, 100=24.09%, 250=12.76% lat (msec) : 500=0.26% cpu : usr=0.06%, sys=2.26%, ctx=1246, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=571KiB/s (584kB/s), 138KiB/s-151KiB/s (142kB/s-154kB/s), io=23.4MiB (24.5MB), run=41505-41980msec WRITE: bw=600KiB/s (615kB/s), 145KiB/s-157KiB/s (149kB/s-161kB/s), io=24.6MiB (25.8MB), run=41505-41980msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179429: Fri Jun 12 01:44:08 2026 read: IOPS=0, BW=941KiB/s (963kB/s)(7168KiB/7620msec) clat (usec): min=669, max=737243, avg=253737.47, stdev=250143.91 lat (usec): min=671, max=737245, avg=253739.25, stdev=250143.68 clat percentiles (usec): | 1.00th=[ 668], 5.00th=[ 668], 10.00th=[ 668], 20.00th=[ 709], | 30.00th=[193987], 40.00th=[193987], 50.00th=[208667], 60.00th=[312476], | 70.00th=[312476], 80.00th=[320865], 90.00th=[734004], 95.00th=[734004], | 99.00th=[734004], 99.50th=[734004], 99.90th=[734004], 99.95th=[734004], | 99.99th=[734004] bw ( KiB/s): min= 1865, max= 4039, per=100.00%, avg=2783.50, stdev=1061.43, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 1.15, samples=4 write: IOPS=0, BW=672KiB/s (688kB/s)(5120KiB/7620msec); 0 zone resets clat (msec): min=264, max=3391, avg=1137.48, stdev=1297.07 lat (msec): min=265, max=3391, avg=1137.61, stdev=1297.06 clat percentiles (msec): | 1.00th=[ 266], 5.00th=[ 266], 10.00th=[ 266], 20.00th=[ 266], | 30.00th=[ 451], 40.00th=[ 451], 50.00th=[ 493], 60.00th=[ 493], | 70.00th=[ 1083], 80.00th=[ 1083], 90.00th=[ 3406], 95.00th=[ 3406], | 99.00th=[ 3406], 99.50th=[ 3406], 99.90th=[ 3406], 99.95th=[ 3406], | 99.99th=[ 3406] bw ( KiB/s): min= 1943, max= 2043, per=57.00%, avg=2006.25, stdev=47.63, samples=4 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=4 lat (usec) : 750=16.67% lat (msec) : 250=16.67%, 500=41.67%, 750=8.33%, 2000=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=6.97%, ctx=302, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179430: Fri Jun 12 01:44:09 2026 read: IOPS=0, BW=251KiB/s (257kB/s)(2048KiB/8145msec) clat (msec): min=3, max=225, avg=114.51, stdev=156.32 lat (msec): min=3, max=225, avg=114.51, stdev=156.32 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 4], 10.00th=[ 4], 20.00th=[ 4], | 30.00th=[ 4], 40.00th=[ 4], 50.00th=[ 4], 60.00th=[ 226], | 70.00th=[ 226], 80.00th=[ 226], 90.00th=[ 226], 95.00th=[ 226], | 99.00th=[ 226], 99.50th=[ 226], 99.90th=[ 226], 99.95th=[ 226], | 99.99th=[ 226] bw ( KiB/s): min= 1610, max= 2043, per=72.65%, avg=1826.50, stdev=306.18, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1257KiB/s (1287kB/s)(10.0MiB/8145msec); 0 zone resets clat (msec): min=199, max=3342, avg=785.45, stdev=928.88 lat (msec): min=200, max=3342, avg=787.40, stdev=927.78 clat percentiles (msec): | 1.00th=[ 201], 5.00th=[ 201], 10.00th=[ 201], 20.00th=[ 268], | 30.00th=[ 288], 40.00th=[ 447], 50.00th=[ 485], 60.00th=[ 518], | 70.00th=[ 567], 80.00th=[ 760], 90.00th=[ 986], 95.00th=[ 3339], | 99.00th=[ 3339], 99.50th=[ 3339], 99.90th=[ 3339], 99.95th=[ 3339], | 99.99th=[ 3339] bw ( KiB/s): min= 1865, max= 2043, per=56.84%, avg=2000.75, stdev=63.82, samples=8 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=8 lat (msec) : 4=8.33%, 250=16.67%, 500=33.33%, 750=16.67%, 1000=16.67% lat (msec) : >=2000=8.33% cpu : usr=0.00%, sys=9.05%, ctx=201, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179431: Fri Jun 12 01:44:09 2026 read: IOPS=0, BW=838KiB/s (858kB/s)(6144KiB/7333msec) clat (msec): min=2, max=3200, avg=690.94, stdev=1236.91 lat (msec): min=2, max=3200, avg=690.94, stdev=1236.91 clat percentiles (msec): | 1.00th=[ 3], 5.00th=[ 3], 10.00th=[ 3], 20.00th=[ 52], | 30.00th=[ 52], 40.00th=[ 245], 50.00th=[ 245], 60.00th=[ 321], | 70.00th=[ 330], 80.00th=[ 330], 90.00th=[ 3205], 95.00th=[ 3205], | 99.00th=[ 3205], 99.50th=[ 3205], 99.90th=[ 3205], 99.95th=[ 3205], | 99.99th=[ 3205] bw ( KiB/s): min= 2043, max= 4071, per=100.00%, avg=3384.33, stdev=1161.74, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 write: IOPS=0, BW=838KiB/s (858kB/s)(6144KiB/7333msec); 0 zone resets clat (msec): min=152, max=736, avg=505.15, stdev=227.70 lat (msec): min=152, max=736, avg=505.26, stdev=227.70 clat percentiles (msec): | 1.00th=[ 153], 5.00th=[ 153], 10.00th=[ 153], 20.00th=[ 321], | 30.00th=[ 321], 40.00th=[ 510], 50.00th=[ 510], 60.00th=[ 634], | 70.00th=[ 684], 80.00th=[ 684], 90.00th=[ 735], 95.00th=[ 735], | 99.00th=[ 735], 99.50th=[ 735], 99.90th=[ 735], 99.95th=[ 735], | 99.99th=[ 735] bw ( KiB/s): min= 1943, max= 3235, per=64.20%, avg=2259.80, stdev=546.79, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 lat (msec) : 4=8.33%, 100=8.33%, 250=16.67%, 500=25.00%, 750=33.33% lat (msec) : >=2000=8.33% cpu : usr=0.00%, sys=9.68%, ctx=641, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179433: Fri Jun 12 01:44:09 2026 read: IOPS=1, BW=1204KiB/s (1233kB/s)(5120KiB/4251msec) clat (usec): min=716, max=357806, avg=128862.77, stdev=173353.92 lat (usec): min=718, max=357809, avg=128864.48, stdev=173354.35 clat percentiles (usec): | 1.00th=[ 717], 5.00th=[ 717], 10.00th=[ 717], 20.00th=[ 717], | 30.00th=[ 3687], 40.00th=[ 3687], 50.00th=[ 8029], 60.00th=[ 8029], | 70.00th=[274727], 80.00th=[274727], 90.00th=[358613], 95.00th=[358613], | 99.00th=[358613], 99.50th=[358613], 99.90th=[358613], 99.95th=[358613], | 99.99th=[358613] bw ( KiB/s): min= 7984, max= 7984, per=100.00%, avg=7984.00, stdev= 0.00, samples=1 iops : min= 7, max= 7, avg= 7.00, stdev= 0.00, samples=1 write: IOPS=1, BW=1686KiB/s (1727kB/s)(7168KiB/4251msec); 0 zone resets clat (msec): min=184, max=981, avg=443.63, stdev=285.42 lat (msec): min=184, max=981, avg=443.84, stdev=285.35 clat percentiles (msec): | 1.00th=[ 184], 5.00th=[ 184], 10.00th=[ 184], 20.00th=[ 186], | 30.00th=[ 249], 40.00th=[ 249], 50.00th=[ 426], 60.00th=[ 472], | 70.00th=[ 472], 80.00th=[ 609], 90.00th=[ 978], 95.00th=[ 978], | 99.00th=[ 978], 99.50th=[ 978], 99.90th=[ 978], 99.95th=[ 978], | 99.99th=[ 978] bw ( KiB/s): min= 1865, max= 3886, per=65.77%, avg=2315.17, stdev=772.60, samples=6 iops : min= 1, max= 3, avg= 1.33, stdev= 0.82, samples=6 lat (usec) : 750=8.33% lat (msec) : 4=8.33%, 10=8.33%, 250=25.00%, 500=33.33%, 750=8.33% lat (msec) : 1000=8.33% cpu : usr=0.00%, sys=13.08%, ctx=149, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2514KiB/s (2575kB/s), 251KiB/s-1204KiB/s (257kB/s-1233kB/s), io=20.0MiB (20.0MB), run=4251-8145msec WRITE: bw=3520KiB/s (3605kB/s), 672KiB/s-1686KiB/s (688kB/s-1727kB/s), io=28.0MiB (29.4MB), run=4251-8145msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179434: Fri Jun 12 01:44:09 2026 read: IOPS=0, BW=833KiB/s (853kB/s)(7168KiB/8604msec) clat (msec): min=61, max=1560, avg=428.36, stdev=535.36 lat (msec): min=61, max=1560, avg=428.36, stdev=535.36 clat percentiles (msec): | 1.00th=[ 62], 5.00th=[ 62], 10.00th=[ 62], 20.00th=[ 72], | 30.00th=[ 129], 40.00th=[ 129], 50.00th=[ 215], 60.00th=[ 351], | 70.00th=[ 351], 80.00th=[ 609], 90.00th=[ 1569], 95.00th=[ 1569], | 99.00th=[ 1569], 99.50th=[ 1569], 99.90th=[ 1569], 99.95th=[ 1569], | 99.99th=[ 1569] bw ( KiB/s): min= 1454, max= 4047, per=100.00%, avg=2385.25, stdev=1139.74, samples=4 iops : min= 1, max= 3, avg= 1.75, stdev= 0.96, samples=4 write: IOPS=0, BW=595KiB/s (609kB/s)(5120KiB/8604msec); 0 zone resets clat (msec): min=98, max=3567, avg=1049.11, stdev=1445.34 lat (msec): min=99, max=3567, avg=1049.63, stdev=1445.32 clat percentiles (msec): | 1.00th=[ 100], 5.00th=[ 100], 10.00th=[ 100], 20.00th=[ 100], | 30.00th=[ 245], 40.00th=[ 245], 50.00th=[ 376], 60.00th=[ 376], | 70.00th=[ 961], 80.00th=[ 961], 90.00th=[ 3574], 95.00th=[ 3574], | 99.00th=[ 3574], 99.50th=[ 3574], 99.90th=[ 3574], 99.95th=[ 3574], | 99.99th=[ 3574] bw ( KiB/s): min= 1903, max= 2027, per=59.87%, avg=1995.00, stdev=61.36, samples=4 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=4 lat (msec) : 100=25.00%, 250=25.00%, 500=16.67%, 750=8.33%, 1000=8.33% lat (msec) : 2000=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=2.57%, ctx=115, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179435: Fri Jun 12 01:44:09 2026 read: IOPS=0, BW=247KiB/s (253kB/s)(2048KiB/8296msec) clat (msec): min=111, max=308, avg=209.78, stdev=139.07 lat (msec): min=111, max=308, avg=209.78, stdev=139.07 clat percentiles (msec): | 1.00th=[ 112], 5.00th=[ 112], 10.00th=[ 112], 20.00th=[ 112], | 30.00th=[ 112], 40.00th=[ 112], 50.00th=[ 112], 60.00th=[ 309], | 70.00th=[ 309], 80.00th=[ 309], 90.00th=[ 309], 95.00th=[ 309], | 99.00th=[ 309], 99.50th=[ 309], 99.90th=[ 309], 99.95th=[ 309], | 99.99th=[ 309] bw ( KiB/s): min= 1563, max= 2023, per=75.34%, avg=1793.00, stdev=325.27, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1234KiB/s (1264kB/s)(10.0MiB/8296msec); 0 zone resets clat (msec): min=127, max=3186, avg=755.18, stdev=888.94 lat (msec): min=127, max=3186, avg=755.32, stdev=888.94 clat percentiles (msec): | 1.00th=[ 128], 5.00th=[ 128], 10.00th=[ 128], 20.00th=[ 207], | 30.00th=[ 355], 40.00th=[ 380], 50.00th=[ 422], 60.00th=[ 617], | 70.00th=[ 634], 80.00th=[ 651], 90.00th=[ 978], 95.00th=[ 3171], | 99.00th=[ 3171], 99.50th=[ 3171], 99.90th=[ 3171], 99.95th=[ 3171], | 99.99th=[ 3171] bw ( KiB/s): min= 1935, max= 4087, per=90.59%, avg=3018.50, stdev=1122.17, samples=6 iops : min= 1, max= 3, avg= 2.00, stdev= 1.10, samples=6 lat (msec) : 250=25.00%, 500=33.33%, 750=25.00%, 1000=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=3.16%, ctx=121, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179436: Fri Jun 12 01:44:09 2026 read: IOPS=0, BW=730KiB/s (747kB/s)(6144KiB/8422msec) clat (msec): min=96, max=3376, avg=707.78, stdev=1310.49 lat (msec): min=96, max=3376, avg=707.79, stdev=1310.49 clat percentiles (msec): | 1.00th=[ 96], 5.00th=[ 96], 10.00th=[ 96], 20.00th=[ 112], | 30.00th=[ 112], 40.00th=[ 138], 50.00th=[ 138], 60.00th=[ 176], | 70.00th=[ 351], 80.00th=[ 351], 90.00th=[ 3373], 95.00th=[ 3373], | 99.00th=[ 3373], 99.50th=[ 3373], 99.90th=[ 3373], 99.95th=[ 3373], | 99.99th=[ 3373] bw ( KiB/s): min= 1903, max= 2043, per=84.23%, avg=2004.60, stdev=57.31, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 write: IOPS=0, BW=730KiB/s (747kB/s)(6144KiB/8422msec); 0 zone resets clat (msec): min=156, max=1424, avg=666.99, stdev=472.41 lat (msec): min=156, max=1424, avg=667.14, stdev=472.39 clat percentiles (msec): | 1.00th=[ 157], 5.00th=[ 157], 10.00th=[ 157], 20.00th=[ 262], | 30.00th=[ 262], 40.00th=[ 514], 50.00th=[ 514], 60.00th=[ 676], | 70.00th=[ 969], 80.00th=[ 969], 90.00th=[ 1418], 95.00th=[ 1418], | 99.00th=[ 1418], 99.50th=[ 1418], 99.90th=[ 1418], 99.95th=[ 1418], | 99.99th=[ 1418] bw ( KiB/s): min= 1903, max= 4055, per=71.81%, avg=2392.60, stdev=931.20, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 lat (msec) : 100=8.33%, 250=33.33%, 500=16.67%, 750=16.67%, 1000=8.33% lat (msec) : 2000=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=3.02%, ctx=108, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179437: Fri Jun 12 01:44:09 2026 read: IOPS=0, BW=675KiB/s (691kB/s)(5120KiB/7584msec) clat (msec): min=114, max=532, avg=266.34, stdev=179.58 lat (msec): min=114, max=532, avg=266.35, stdev=179.58 clat percentiles (msec): | 1.00th=[ 115], 5.00th=[ 115], 10.00th=[ 115], 20.00th=[ 115], | 30.00th=[ 126], 40.00th=[ 126], 50.00th=[ 192], 60.00th=[ 192], | 70.00th=[ 368], 80.00th=[ 368], 90.00th=[ 531], 95.00th=[ 531], | 99.00th=[ 531], 99.50th=[ 531], 99.90th=[ 531], 99.95th=[ 531], | 99.99th=[ 531] bw ( KiB/s): min= 1992, max= 3806, per=100.00%, avg=2607.00, stdev=1038.48, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 write: IOPS=0, BW=945KiB/s (968kB/s)(7168KiB/7584msec); 0 zone resets clat (msec): min=163, max=3409, avg=885.26, stdev=1133.46 lat (msec): min=163, max=3409, avg=885.53, stdev=1133.39 clat percentiles (msec): | 1.00th=[ 163], 5.00th=[ 163], 10.00th=[ 163], 20.00th=[ 222], | 30.00th=[ 443], 40.00th=[ 443], 50.00th=[ 575], 60.00th=[ 642], | 70.00th=[ 642], 80.00th=[ 743], 90.00th=[ 3406], 95.00th=[ 3406], | 99.00th=[ 3406], 99.50th=[ 3406], 99.90th=[ 3406], 99.95th=[ 3406], | 99.99th=[ 3406] bw ( KiB/s): min= 1503, max= 2048, per=57.76%, avg=1924.67, stdev=210.45, samples=6 iops : min= 1, max= 2, avg= 1.17, stdev= 0.41, samples=6 lat (msec) : 250=41.67%, 500=16.67%, 750=33.33%, >=2000=8.33% cpu : usr=0.03%, sys=2.70%, ctx=101, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2380KiB/s (2437kB/s), 247KiB/s-833KiB/s (253kB/s-853kB/s), io=20.0MiB (20.0MB), run=7584-8604msec WRITE: bw=3332KiB/s (3412kB/s), 595KiB/s-1234KiB/s (609kB/s-1264kB/s), io=28.0MiB (29.4MB), run=7584-8604msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179446: Fri Jun 12 01:44:26 2026 read: IOPS=0, BW=3408KiB/s (3489kB/s)(12.0MiB/3606msec) clat (msec): min=654, max=1959, avg=1175.38, stdev=690.84 lat (msec): min=654, max=1959, avg=1175.38, stdev=690.84 clat percentiles (msec): | 1.00th=[ 659], 5.00th=[ 659], 10.00th=[ 659], 20.00th=[ 659], | 30.00th=[ 659], 40.00th=[ 911], 50.00th=[ 911], 60.00th=[ 911], | 70.00th=[ 1955], 80.00th=[ 1955], 90.00th=[ 1955], 95.00th=[ 1955], | 99.00th=[ 1955], 99.50th=[ 1955], 99.90th=[ 1955], 99.95th=[ 1955], | 99.99th=[ 1955] bw ( KiB/s): min= 8047, max= 8159, per=100.00%, avg=8103.00, stdev=79.20, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=2.11%, ctx=59, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179447: Fri Jun 12 01:44:26 2026 read: IOPS=0, BW=1068KiB/s (1093kB/s)(4096KiB/3836msec) clat (nsec): min=419472k, max=419472k, avg=419471794.00, stdev= 0.00 lat (nsec): min=419476k, max=419476k, avg=419476080.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 422], 5.00th=[ 422], 10.00th=[ 422], 20.00th=[ 422], | 30.00th=[ 422], 40.00th=[ 422], 50.00th=[ 422], 60.00th=[ 422], | 70.00th=[ 422], 80.00th=[ 422], 90.00th=[ 422], 95.00th=[ 422], | 99.00th=[ 422], 99.50th=[ 422], 99.90th=[ 422], 99.95th=[ 422], | 99.99th=[ 422] bw ( KiB/s): min= 7585, max= 7585, per=100.00%, avg=7585.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2136KiB/s (2187kB/s)(8192KiB/3836msec); 0 zone resets clat (msec): min=1484, max=1811, avg=1647.58, stdev=231.25 lat (msec): min=1485, max=1812, avg=1648.88, stdev=230.70 clat percentiles (msec): | 1.00th=[ 1485], 5.00th=[ 1485], 10.00th=[ 1485], 20.00th=[ 1485], | 30.00th=[ 1485], 40.00th=[ 1485], 50.00th=[ 1485], 60.00th=[ 1804], | 70.00th=[ 1804], 80.00th=[ 1804], 90.00th=[ 1804], 95.00th=[ 1804], | 99.00th=[ 1804], 99.50th=[ 1804], 99.90th=[ 1804], 99.95th=[ 1804], | 99.99th=[ 1804] bw ( KiB/s): min= 8159, max= 8159, per=100.00%, avg=8159.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.05%, sys=3.16%, ctx=56, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179448: Fri Jun 12 01:44:26 2026 write: IOPS=0, BW=2895KiB/s (2964kB/s)(12.0MiB/4245msec); 0 zone resets clat (msec): min=411, max=2103, avg=1363.20, stdev=865.86 lat (msec): min=411, max=2103, avg=1363.69, stdev=865.74 clat percentiles (msec): | 1.00th=[ 414], 5.00th=[ 414], 10.00th=[ 414], 20.00th=[ 414], | 30.00th=[ 414], 40.00th=[ 1569], 50.00th=[ 1569], 60.00th=[ 1569], | 70.00th=[ 2106], 80.00th=[ 2106], 90.00th=[ 2106], 95.00th=[ 2106], | 99.00th=[ 2106], 99.50th=[ 2106], 99.90th=[ 2106], 99.95th=[ 2106], | 99.99th=[ 2106] bw ( KiB/s): min= 8159, max= 8175, per=100.00%, avg=8167.00, stdev=11.31, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=4.62%, ctx=86, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179449: Fri Jun 12 01:44:26 2026 write: IOPS=0, BW=3783KiB/s (3874kB/s)(12.0MiB/3248msec); 0 zone resets clat (msec): min=401, max=2133, avg=1053.21, stdev=941.86 lat (msec): min=401, max=2134, avg=1054.92, stdev=942.15 clat percentiles (msec): | 1.00th=[ 401], 5.00th=[ 401], 10.00th=[ 401], 20.00th=[ 401], | 30.00th=[ 401], 40.00th=[ 625], 50.00th=[ 625], 60.00th=[ 625], | 70.00th=[ 2140], 80.00th=[ 2140], 90.00th=[ 2140], 95.00th=[ 2140], | 99.00th=[ 2140], 99.50th=[ 2140], 99.90th=[ 2140], 99.95th=[ 2140], | 99.99th=[ 2140] bw ( KiB/s): min= 6301, max= 7984, per=92.53%, avg=7142.50, stdev=1190.06, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 750=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=2.96%, ctx=45, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4271KiB/s (4374kB/s), 1068KiB/s-3408KiB/s (1093kB/s-3489kB/s), io=16.0MiB (16.8MB), run=3606-3836msec WRITE: bw=7719KiB/s (7904kB/s), 2136KiB/s-3783KiB/s (2187kB/s-3874kB/s), io=32.0MiB (33.6MB), run=3248-4245msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179450: Fri Jun 12 01:44:27 2026 read: IOPS=0, BW=3724KiB/s (3813kB/s)(12.0MiB/3300msec) clat (msec): min=980, max=1081, avg=1028.24, stdev=51.02 lat (msec): min=980, max=1081, avg=1028.25, stdev=51.02 clat percentiles (msec): | 1.00th=[ 978], 5.00th=[ 978], 10.00th=[ 978], 20.00th=[ 978], | 30.00th=[ 978], 40.00th=[ 1020], 50.00th=[ 1020], 60.00th=[ 1020], | 70.00th=[ 1083], 80.00th=[ 1083], 90.00th=[ 1083], 95.00th=[ 1083], | 99.00th=[ 1083], 99.50th=[ 1083], 99.90th=[ 1083], 99.95th=[ 1083], | 99.99th=[ 1083] bw ( KiB/s): min= 8143, max= 8159, per=100.00%, avg=8151.00, stdev=11.31, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=33.33%, 2000=66.67% cpu : usr=0.00%, sys=12.91%, ctx=180, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179451: Fri Jun 12 01:44:27 2026 read: IOPS=0, BW=987KiB/s (1011kB/s)(4096KiB/4148msec) clat (nsec): min=1526.5M, max=1526.5M, avg=1526547286.00, stdev= 0.00 lat (nsec): min=1526.6M, max=1526.6M, avg=1526550576.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1519], 5.00th=[ 1519], 10.00th=[ 1519], 20.00th=[ 1519], | 30.00th=[ 1519], 40.00th=[ 1519], 50.00th=[ 1519], 60.00th=[ 1519], | 70.00th=[ 1519], 80.00th=[ 1519], 90.00th=[ 1519], 95.00th=[ 1519], | 99.00th=[ 1519], 99.50th=[ 1519], 99.90th=[ 1519], 99.95th=[ 1519], | 99.99th=[ 1519] bw ( KiB/s): min= 7937, max= 7937, per=100.00%, avg=7937.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=1975KiB/s (2022kB/s)(8192KiB/4148msec); 0 zone resets clat (msec): min=807, max=1671, avg=1239.22, stdev=611.09 lat (msec): min=807, max=1671, avg=1239.86, stdev=610.91 clat percentiles (msec): | 1.00th=[ 810], 5.00th=[ 810], 10.00th=[ 810], 20.00th=[ 810], | 30.00th=[ 810], 40.00th=[ 810], 50.00th=[ 810], 60.00th=[ 1670], | 70.00th=[ 1670], 80.00th=[ 1670], 90.00th=[ 1670], 95.00th=[ 1670], | 99.00th=[ 1670], 99.50th=[ 1670], 99.90th=[ 1670], 99.95th=[ 1670], | 99.99th=[ 1670] bw ( KiB/s): min= 8126, max= 8126, per=100.00%, avg=8126.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 1000=33.33%, 2000=66.67% cpu : usr=0.00%, sys=5.96%, ctx=118, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179452: Fri Jun 12 01:44:27 2026 write: IOPS=0, BW=2789KiB/s (2856kB/s)(12.0MiB/4406msec); 0 zone resets clat (msec): min=360, max=2524, avg=1434.31, stdev=1082.14 lat (msec): min=360, max=2524, avg=1434.73, stdev=1082.27 clat percentiles (msec): | 1.00th=[ 359], 5.00th=[ 359], 10.00th=[ 359], 20.00th=[ 359], | 30.00th=[ 359], 40.00th=[ 1418], 50.00th=[ 1418], 60.00th=[ 1418], | 70.00th=[ 2534], 80.00th=[ 2534], 90.00th=[ 2534], 95.00th=[ 2534], | 99.00th=[ 2534], 99.50th=[ 2534], 99.90th=[ 2534], 99.95th=[ 2534], | 99.99th=[ 2534] bw ( KiB/s): min= 8047, max= 8143, per=100.00%, avg=8095.00, stdev=67.88, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.16%, sys=4.18%, ctx=64, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179453: Fri Jun 12 01:44:27 2026 write: IOPS=0, BW=3492KiB/s (3576kB/s)(12.0MiB/3519msec); 0 zone resets clat (msec): min=462, max=2064, avg=1145.71, stdev=826.71 lat (msec): min=462, max=2065, avg=1146.22, stdev=826.76 clat percentiles (msec): | 1.00th=[ 464], 5.00th=[ 464], 10.00th=[ 464], 20.00th=[ 464], | 30.00th=[ 464], 40.00th=[ 911], 50.00th=[ 911], 60.00th=[ 911], | 70.00th=[ 2072], 80.00th=[ 2072], 90.00th=[ 2072], 95.00th=[ 2072], | 99.00th=[ 2072], 99.50th=[ 2072], 99.90th=[ 2072], 99.95th=[ 2072], | 99.99th=[ 2072] bw ( KiB/s): min= 7627, max= 7937, per=100.00%, avg=7782.00, stdev=219.20, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 1000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=3.55%, ctx=61, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3950KiB/s (4045kB/s), 987KiB/s-3724KiB/s (1011kB/s-3813kB/s), io=16.0MiB (16.8MB), run=3300-4148msec WRITE: bw=7437KiB/s (7616kB/s), 1975KiB/s-3492KiB/s (2022kB/s-3576kB/s), io=32.0MiB (33.6MB), run=3519-4406msec