== sanity test 398b: DIO and buffer IO race ============== 22:39:51 (1786675191) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 7.02887 s, 7.2 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=178944: Thu Aug 13 22:42:37 2026 read: IOPS=10, BW=42.1KiB/s (43.1kB/s)(5992KiB/142493msec) clat (usec): min=42, max=578467, avg=52077.61, stdev=35228.46 lat (usec): min=43, max=578469, avg=52083.12, stdev=35227.97 clat percentiles (usec): | 1.00th=[ 59], 5.00th=[ 12911], 10.00th=[ 20579], 20.00th=[ 26870], | 30.00th=[ 33162], 40.00th=[ 38536], 50.00th=[ 44827], 60.00th=[ 52691], | 70.00th=[ 62129], 80.00th=[ 72877], 90.00th=[ 90702], 95.00th=[107480], | 99.00th=[166724], 99.50th=[193987], 99.90th=[312476], 99.95th=[574620], | 99.99th=[574620] bw ( KiB/s): min= 7, max= 95, per=25.05%, avg=41.83, stdev=17.10, samples=278 iops : min= 1, max= 23, avg= 9.82, stdev= 4.30, samples=278 write: IOPS=11, BW=44.2KiB/s (45.2kB/s)(6296KiB/142493msec); 0 zone resets clat (usec): min=1218, max=528589, avg=40824.71, stdev=41350.98 lat (usec): min=1220, max=528592, avg=40828.21, stdev=41352.60 clat percentiles (usec): | 1.00th=[ 1385], 5.00th=[ 1598], 10.00th=[ 2671], 20.00th=[ 5604], | 30.00th=[ 11469], 40.00th=[ 22414], 50.00th=[ 30802], 60.00th=[ 39060], | 70.00th=[ 50594], 80.00th=[ 68682], 90.00th=[ 94897], 95.00th=[119014], | 99.00th=[179307], 99.50th=[198181], 99.90th=[261096], 99.95th=[530580], | 99.99th=[530580] bw ( KiB/s): min= 7, max= 103, per=24.97%, avg=43.69, stdev=18.74, samples=280 iops : min= 1, max= 25, avg=10.28, stdev= 4.72, samples=280 lat (usec) : 50=0.10%, 100=1.56%, 250=0.23%, 500=0.10% lat (msec) : 2=3.84%, 4=3.84%, 10=6.93%, 20=7.45%, 50=39.03% lat (msec) : 100=28.97%, 250=7.78%, 500=0.10%, 750=0.07% cpu : usr=0.08%, sys=5.18%, ctx=6929, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178945: Thu Aug 13 22:42:37 2026 read: IOPS=10, BW=41.8KiB/s (42.8kB/s)(5940KiB/141978msec) clat (usec): min=37, max=526343, avg=52133.88, stdev=34092.15 lat (usec): min=38, max=526345, avg=52137.71, stdev=34091.65 clat percentiles (usec): | 1.00th=[ 61], 5.00th=[ 17171], 10.00th=[ 22414], 20.00th=[ 28967], | 30.00th=[ 33817], 40.00th=[ 39060], 50.00th=[ 45351], 60.00th=[ 52167], | 70.00th=[ 61080], 80.00th=[ 71828], 90.00th=[ 87557], 95.00th=[111674], | 99.00th=[158335], 99.50th=[202376], 99.90th=[341836], 99.95th=[526386], | 99.99th=[526386] bw ( KiB/s): min= 7, max= 101, per=24.81%, avg=41.43, stdev=16.07, samples=279 iops : min= 1, max= 25, avg= 9.72, stdev= 4.04, samples=279 write: IOPS=11, BW=44.7KiB/s (45.8kB/s)(6348KiB/141978msec); 0 zone resets clat (usec): min=1126, max=367917, avg=40560.40, stdev=42157.52 lat (usec): min=1127, max=367920, avg=40563.01, stdev=42157.42 clat percentiles (usec): | 1.00th=[ 1385], 5.00th=[ 1680], 10.00th=[ 2769], 20.00th=[ 5473], | 30.00th=[ 9503], 40.00th=[ 18744], 50.00th=[ 28181], 60.00th=[ 38536], | 70.00th=[ 51119], 80.00th=[ 70779], 90.00th=[ 99091], 95.00th=[121111], | 99.00th=[170918], 99.50th=[229639], 99.90th=[308282], 99.95th=[367002], | 99.99th=[367002] bw ( KiB/s): min= 7, max= 103, per=25.38%, avg=44.41, stdev=19.07, samples=278 iops : min= 1, max= 25, avg=10.46, stdev= 4.79, samples=278 lat (usec) : 50=0.10%, 100=0.98%, 250=0.29%, 750=0.03% lat (msec) : 2=3.81%, 4=4.10%, 10=8.20%, 20=7.19%, 50=38.57% lat (msec) : 100=28.48%, 250=8.01%, 500=0.20%, 750=0.03% cpu : usr=0.08%, sys=5.26%, ctx=6932, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178946: Thu Aug 13 22:42:37 2026 read: IOPS=10, BW=42.1KiB/s (43.1kB/s)(6028KiB/143050msec) clat (usec): min=38, max=273122, avg=51349.33, stdev=33814.74 lat (usec): min=38, max=273123, avg=51357.44, stdev=33830.95 clat percentiles (usec): | 1.00th=[ 57], 5.00th=[ 13829], 10.00th=[ 20579], 20.00th=[ 26346], | 30.00th=[ 31589], 40.00th=[ 37487], 50.00th=[ 44303], 60.00th=[ 51643], | 70.00th=[ 60031], 80.00th=[ 71828], 90.00th=[ 91751], 95.00th=[113771], | 99.00th=[181404], 99.50th=[208667], 99.90th=[248513], 99.95th=[274727], | 99.99th=[274727] bw ( KiB/s): min= 7, max= 111, per=25.01%, avg=41.77, stdev=17.27, samples=280 iops : min= 1, max= 27, avg= 9.80, stdev= 4.36, samples=280 write: IOPS=10, BW=43.8KiB/s (44.8kB/s)(6260KiB/143050msec); 0 zone resets clat (usec): min=1111, max=562884, avg=41783.51, stdev=42365.55 lat (usec): min=1112, max=562885, avg=41792.03, stdev=42365.84 clat percentiles (usec): | 1.00th=[ 1352], 5.00th=[ 1663], 10.00th=[ 2835], 20.00th=[ 5866], | 30.00th=[ 10683], 40.00th=[ 20579], 50.00th=[ 30278], 60.00th=[ 41157], | 70.00th=[ 52691], 80.00th=[ 73925], 90.00th=[100140], 95.00th=[122160], | 99.00th=[166724], 99.50th=[183501], 99.90th=[295699], 99.95th=[566232], | 99.99th=[566232] bw ( KiB/s): min= 7, max= 110, per=24.73%, avg=43.28, stdev=19.10, samples=280 iops : min= 1, max= 27, avg=10.18, stdev= 4.82, samples=280 lat (usec) : 50=0.07%, 100=1.60%, 250=0.20%, 750=0.03% lat (msec) : 2=3.35%, 4=3.81%, 10=7.68%, 20=8.20%, 50=37.96% lat (msec) : 100=28.52%, 250=8.50%, 500=0.07%, 750=0.03% cpu : usr=0.10%, sys=5.24%, ctx=6936, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178947: Thu Aug 13 22:42:37 2026 read: IOPS=10, BW=42.6KiB/s (43.6kB/s)(6052KiB/142037msec) clat (usec): min=37, max=290958, avg=51836.81, stdev=33033.94 lat (usec): min=37, max=290959, avg=51838.83, stdev=33035.55 clat percentiles (usec): | 1.00th=[ 57], 5.00th=[ 12256], 10.00th=[ 20579], 20.00th=[ 26870], | 30.00th=[ 32900], 40.00th=[ 39060], 50.00th=[ 45876], 60.00th=[ 53216], | 70.00th=[ 63177], 80.00th=[ 73925], 90.00th=[ 90702], 95.00th=[108528], | 99.00th=[166724], 99.50th=[196084], 99.90th=[238027], 99.95th=[291505], | 99.99th=[291505] bw ( KiB/s): min= 7, max= 96, per=25.47%, avg=42.53, stdev=16.70, samples=277 iops : min= 1, max= 24, avg= 9.99, stdev= 4.21, samples=277 write: IOPS=10, BW=43.9KiB/s (44.0kB/s)(6236KiB/142037msec); 0 zone resets clat (usec): min=1159, max=564138, avg=40651.93, stdev=43088.26 lat (usec): min=1160, max=564142, avg=40655.86, stdev=43087.13 clat percentiles (usec): | 1.00th=[ 1369], 5.00th=[ 1647], 10.00th=[ 2606], 20.00th=[ 6063], | 30.00th=[ 9896], 40.00th=[ 19006], 50.00th=[ 29230], 60.00th=[ 39060], | 70.00th=[ 51643], 80.00th=[ 68682], 90.00th=[ 94897], 95.00th=[114820], | 99.00th=[185598], 99.50th=[225444], 99.90th=[354419], 99.95th=[566232], | 99.99th=[566232] bw ( KiB/s): min= 7, max= 112, per=24.96%, avg=43.69, stdev=19.35, samples=278 iops : min= 1, max= 28, avg=10.28, stdev= 4.90, samples=278 lat (usec) : 50=0.20%, 100=1.73%, 250=0.16%, 500=0.07%, 750=0.03% lat (msec) : 2=3.78%, 4=3.71%, 10=8.04%, 20=7.81%, 50=36.62% lat (msec) : 100=30.08%, 250=7.58%, 500=0.16%, 750=0.03% cpu : usr=0.08%, sys=5.19%, ctx=6942, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=168KiB/s (172kB/s), 41.8KiB/s-42.6KiB/s (42.8kB/s-43.6kB/s), io=23.4MiB (24.6MB), run=141978-143050msec WRITE: bw=176KiB/s (180kB/s), 43.8KiB/s-44.7KiB/s (44.8kB/s-45.8kB/s), io=24.6MiB (25.7MB), run=141978-143050msec rand-rw: (groupid=0, jobs=1): err= 0: pid=178939: Thu Aug 13 22:43:28 2026 read: IOPS=7, BW=31.2KiB/s (31.9kB/s)(5992KiB/192181msec) clat (msec): min=6, max=1032, avg=50.37, stdev=50.22 lat (msec): min=6, max=1032, avg=50.37, stdev=50.22 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 15], 20.00th=[ 20], | 30.00th=[ 25], 40.00th=[ 31], 50.00th=[ 37], 60.00th=[ 44], | 70.00th=[ 53], 80.00th=[ 70], 90.00th=[ 106], 95.00th=[ 140], | 99.00th=[ 218], 99.50th=[ 257], 99.90th=[ 359], 99.95th=[ 1036], | 99.99th=[ 1036] bw ( KiB/s): min= 7, max= 143, per=25.97%, avg=31.69, stdev=21.61, samples=366 iops : min= 1, max= 35, avg= 7.25, stdev= 5.44, samples=366 write: IOPS=8, BW=32.8KiB/s (33.5kB/s)(6296KiB/192181msec); 0 zone resets clat (msec): min=14, max=394, avg=73.90, stdev=47.31 lat (msec): min=14, max=394, avg=73.90, stdev=47.31 clat percentiles (msec): | 1.00th=[ 19], 5.00th=[ 25], 10.00th=[ 29], 20.00th=[ 36], | 30.00th=[ 44], 40.00th=[ 51], 50.00th=[ 62], 60.00th=[ 71], | 70.00th=[ 87], 80.00th=[ 108], 90.00th=[ 140], 95.00th=[ 167], | 99.00th=[ 220], 99.50th=[ 288], 99.90th=[ 351], 99.95th=[ 397], | 99.99th=[ 397] bw ( KiB/s): min= 7, max= 104, per=25.58%, avg=32.74, stdev=18.77, samples=372 iops : min= 1, max= 26, avg= 7.52, stdev= 4.74, samples=372 lat (msec) : 10=1.14%, 20=9.99%, 50=41.41%, 100=30.53%, 250=16.34% lat (msec) : 500=0.55%, 2000=0.03% cpu : usr=0.06%, sys=2.12%, ctx=5028, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178940: Thu Aug 13 22:43:28 2026 read: IOPS=7, BW=30.4KiB/s (31.1kB/s)(5940KiB/195539msec) clat (msec): min=6, max=978, avg=51.55, stdev=50.12 lat (msec): min=6, max=978, avg=51.57, stdev=50.12 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 13], 10.00th=[ 16], 20.00th=[ 21], | 30.00th=[ 25], 40.00th=[ 30], 50.00th=[ 36], 60.00th=[ 45], | 70.00th=[ 57], 80.00th=[ 75], 90.00th=[ 109], 95.00th=[ 138], | 99.00th=[ 211], 99.50th=[ 257], 99.90th=[ 558], 99.95th=[ 978], | 99.99th=[ 978] bw ( KiB/s): min= 7, max= 111, per=25.62%, avg=31.25, stdev=20.79, samples=368 iops : min= 1, max= 27, avg= 7.15, stdev= 5.25, samples=368 write: IOPS=8, BW=32.5KiB/s (33.2kB/s)(6348KiB/195539msec); 0 zone resets clat (msec): min=10, max=372, avg=74.70, stdev=50.27 lat (msec): min=10, max=372, avg=74.71, stdev=50.27 clat percentiles (msec): | 1.00th=[ 20], 5.00th=[ 26], 10.00th=[ 30], 20.00th=[ 36], | 30.00th=[ 43], 40.00th=[ 50], 50.00th=[ 59], 60.00th=[ 70], | 70.00th=[ 85], 80.00th=[ 108], 90.00th=[ 146], 95.00th=[ 178], | 99.00th=[ 243], 99.50th=[ 284], 99.90th=[ 372], 99.95th=[ 372], | 99.99th=[ 372] bw ( KiB/s): min= 7, max= 104, per=25.06%, avg=32.07, stdev=19.67, samples=383 iops : min= 1, max= 26, avg= 7.36, stdev= 4.95, samples=383 lat (msec) : 10=0.94%, 20=9.51%, 50=42.12%, 100=29.92%, 250=16.73% lat (msec) : 500=0.72%, 750=0.03%, 1000=0.03% cpu : usr=0.06%, sys=2.01%, ctx=5052, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178941: Thu Aug 13 22:43:28 2026 read: IOPS=7, BW=30.9KiB/s (31.7kB/s)(6028KiB/194968msec) clat (msec): min=5, max=562, avg=52.31, stdev=47.99 lat (msec): min=5, max=562, avg=52.32, stdev=47.99 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 13], 10.00th=[ 15], 20.00th=[ 20], | 30.00th=[ 25], 40.00th=[ 30], 50.00th=[ 37], 60.00th=[ 45], | 70.00th=[ 57], 80.00th=[ 73], 90.00th=[ 113], 95.00th=[ 146], | 99.00th=[ 234], 99.50th=[ 279], 99.90th=[ 388], 99.95th=[ 567], | 99.99th=[ 567] bw ( KiB/s): min= 7, max= 112, per=25.47%, avg=31.07, stdev=20.45, samples=376 iops : min= 1, max= 28, avg= 7.10, stdev= 5.16, samples=376 write: IOPS=8, BW=32.1KiB/s (32.9kB/s)(6260KiB/194968msec); 0 zone resets clat (msec): min=12, max=1006, avg=73.94, stdev=53.86 lat (msec): min=12, max=1006, avg=73.94, stdev=53.86 clat percentiles (msec): | 1.00th=[ 20], 5.00th=[ 25], 10.00th=[ 29], 20.00th=[ 37], | 30.00th=[ 43], 40.00th=[ 50], 50.00th=[ 58], 60.00th=[ 69], | 70.00th=[ 85], 80.00th=[ 107], 90.00th=[ 140], 95.00th=[ 169], | 99.00th=[ 253], 99.50th=[ 300], 99.90th=[ 351], 99.95th=[ 1003], | 99.99th=[ 1003] bw ( KiB/s): min= 7, max= 96, per=25.00%, avg=32.00, stdev=19.88, samples=379 iops : min= 1, max= 24, avg= 7.34, stdev= 5.01, samples=379 lat (msec) : 10=1.04%, 20=9.73%, 50=42.22%, 100=29.39%, 250=16.73% lat (msec) : 500=0.81%, 750=0.03%, 2000=0.03% cpu : usr=0.06%, sys=1.99%, ctx=5083, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178942: Thu Aug 13 22:43:28 2026 read: IOPS=7, BW=31.1KiB/s (31.8kB/s)(6052KiB/194642msec) clat (msec): min=6, max=467, avg=51.63, stdev=46.13 lat (msec): min=6, max=467, avg=51.64, stdev=46.13 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 14], 10.00th=[ 16], 20.00th=[ 21], | 30.00th=[ 25], 40.00th=[ 30], 50.00th=[ 36], 60.00th=[ 44], | 70.00th=[ 55], 80.00th=[ 74], 90.00th=[ 112], 95.00th=[ 148], | 99.00th=[ 220], 99.50th=[ 247], 99.90th=[ 388], 99.95th=[ 468], | 99.99th=[ 468] bw ( KiB/s): min= 7, max= 127, per=26.65%, avg=32.52, stdev=21.51, samples=361 iops : min= 1, max= 31, avg= 7.47, stdev= 5.43, samples=361 write: IOPS=8, BW=32.0KiB/s (32.8kB/s)(6236KiB/194642msec); 0 zone resets clat (msec): min=9, max=1005, avg=74.46, stdev=52.48 lat (msec): min=9, max=1005, avg=74.46, stdev=52.48 clat percentiles (msec): | 1.00th=[ 19], 5.00th=[ 26], 10.00th=[ 30], 20.00th=[ 36], | 30.00th=[ 43], 40.00th=[ 51], 50.00th=[ 60], 60.00th=[ 71], | 70.00th=[ 88], 80.00th=[ 108], 90.00th=[ 142], 95.00th=[ 169], | 99.00th=[ 222], 99.50th=[ 241], 99.90th=[ 347], 99.95th=[ 1003], | 99.99th=[ 1003] bw ( KiB/s): min= 7, max= 103, per=25.09%, avg=32.11, stdev=19.18, samples=376 iops : min= 1, max= 25, avg= 7.36, stdev= 4.85, samples=376 lat (msec) : 10=0.98%, 20=9.67%, 50=41.37%, 100=30.08%, 250=17.51% lat (msec) : 500=0.36%, 2000=0.03% cpu : usr=0.05%, sys=2.10%, ctx=5126, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=123KiB/s (126kB/s), 30.4KiB/s-31.2KiB/s (31.1kB/s-31.9kB/s), io=23.4MiB (24.6MB), run=192181-195539msec WRITE: bw=129KiB/s (132kB/s), 32.0KiB/s-32.8KiB/s (32.8kB/s-33.5kB/s), io=24.6MiB (25.7MB), run=192181-195539msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=178996: Thu Aug 13 22:44:16 2026 read: IOPS=10, BW=167KiB/s (171kB/s)(5920KiB/35431msec) clat (usec): min=38, max=190410, avg=49349.97, stdev=33430.67 lat (usec): min=39, max=190411, avg=49372.37, stdev=33428.58 clat percentiles (usec): | 1.00th=[ 49], 5.00th=[ 68], 10.00th=[ 97], 20.00th=[ 25560], | 30.00th=[ 32637], 40.00th=[ 39060], 50.00th=[ 44303], 60.00th=[ 52167], | 70.00th=[ 61604], 80.00th=[ 74974], 90.00th=[ 90702], 95.00th=[108528], | 99.00th=[164627], 99.50th=[187696], 99.90th=[189793], 99.95th=[189793], | 99.99th=[189793] bw ( KiB/s): min= 62, max= 343, per=26.01%, avg=170.38, stdev=67.63, samples=68 iops : min= 3, max= 21, avg= 9.87, stdev= 4.27, samples=68 write: IOPS=11, BW=180KiB/s (184kB/s)(6368KiB/35431msec); 0 zone resets clat (usec): min=1803, max=199838, avg=42017.36, stdev=39032.67 lat (usec): min=1804, max=199841, avg=42025.62, stdev=39039.25 clat percentiles (usec): | 1.00th=[ 1876], 5.00th=[ 2507], 10.00th=[ 3982], 20.00th=[ 7373], | 30.00th=[ 11207], 40.00th=[ 20317], 50.00th=[ 29492], 60.00th=[ 40633], | 70.00th=[ 54789], 80.00th=[ 76022], 90.00th=[102237], 95.00th=[121111], | 99.00th=[147850], 99.50th=[177210], 99.90th=[200279], 99.95th=[200279], | 99.99th=[200279] bw ( KiB/s): min= 21, max= 383, per=26.35%, avg=181.54, stdev=71.48, samples=69 iops : min= 1, max= 23, avg=10.58, stdev= 4.51, samples=69 lat (usec) : 50=0.65%, 100=4.30%, 250=0.91%, 500=0.26%, 1000=0.13% lat (msec) : 2=1.30%, 4=3.91%, 10=8.33%, 20=7.55%, 50=35.68% lat (msec) : 100=28.39%, 250=8.59% cpu : usr=0.09%, sys=5.92%, ctx=1744, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178997: Thu Aug 13 22:44:16 2026 read: IOPS=9, BW=157KiB/s (161kB/s)(5744KiB/36530msec) clat (usec): min=42, max=213126, avg=52487.52, stdev=34764.49 lat (usec): min=43, max=213127, avg=52492.65, stdev=34765.70 clat percentiles (usec): | 1.00th=[ 56], 5.00th=[ 73], 10.00th=[ 18482], 20.00th=[ 27395], | 30.00th=[ 33424], 40.00th=[ 40109], 50.00th=[ 46924], 60.00th=[ 53740], | 70.00th=[ 63701], 80.00th=[ 76022], 90.00th=[ 95945], 95.00th=[117965], | 99.00th=[170918], 99.50th=[189793], 99.90th=[212861], 99.95th=[212861], | 99.99th=[212861] bw ( KiB/s): min= 62, max= 319, per=24.56%, avg=160.89, stdev=69.82, samples=70 iops : min= 3, max= 19, avg= 9.26, stdev= 4.38, samples=70 write: IOPS=11, BW=179KiB/s (183kB/s)(6544KiB/36530msec); 0 zone resets clat (usec): min=1849, max=337408, avg=41895.58, stdev=42545.68 lat (usec): min=1852, max=337410, avg=41923.72, stdev=42586.15 clat percentiles (usec): | 1.00th=[ 1942], 5.00th=[ 3392], 10.00th=[ 4686], 20.00th=[ 8029], | 30.00th=[ 12387], 40.00th=[ 19530], 50.00th=[ 29230], 60.00th=[ 38536], | 70.00th=[ 50594], 80.00th=[ 70779], 90.00th=[ 95945], 95.00th=[132645], | 99.00th=[179307], 99.50th=[212861], 99.90th=[337642], 99.95th=[337642], | 99.99th=[337642] bw ( KiB/s): min= 62, max= 502, per=26.64%, avg=183.54, stdev=74.21, samples=70 iops : min= 3, max= 31, avg=10.70, stdev= 4.71, samples=70 lat (usec) : 50=0.13%, 100=3.39%, 250=0.52%, 500=0.13% lat (msec) : 2=0.91%, 4=2.73%, 10=9.51%, 20=9.24%, 50=36.07% lat (msec) : 100=28.78%, 250=8.33%, 500=0.26% cpu : usr=0.08%, sys=5.62%, ctx=1830, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178998: Thu Aug 13 22:44:16 2026 read: IOPS=10, BW=173KiB/s (178kB/s)(6256KiB/36073msec) clat (usec): min=44, max=240985, avg=51842.95, stdev=34122.53 lat (usec): min=45, max=240986, avg=51854.49, stdev=34115.11 clat percentiles (usec): | 1.00th=[ 56], 5.00th=[ 78], 10.00th=[ 20055], 20.00th=[ 29230], | 30.00th=[ 33817], 40.00th=[ 40109], 50.00th=[ 45351], 60.00th=[ 51643], | 70.00th=[ 61080], 80.00th=[ 72877], 90.00th=[ 92799], 95.00th=[113771], | 99.00th=[160433], 99.50th=[231736], 99.90th=[240124], 99.95th=[240124], | 99.99th=[240124] bw ( KiB/s): min= 31, max= 319, per=26.39%, avg=172.86, stdev=74.95, samples=71 iops : min= 1, max= 19, avg=10.03, stdev= 4.73, samples=71 write: IOPS=10, BW=167KiB/s (171kB/s)(6032KiB/36073msec); 0 zone resets clat (usec): min=1770, max=203629, avg=41361.42, stdev=38173.80 lat (usec): min=1772, max=203635, avg=41364.28, stdev=38173.99 clat percentiles (usec): | 1.00th=[ 1975], 5.00th=[ 2442], 10.00th=[ 5145], 20.00th=[ 8717], | 30.00th=[ 14353], 40.00th=[ 22152], 50.00th=[ 29230], 60.00th=[ 38536], | 70.00th=[ 52691], 80.00th=[ 70779], 90.00th=[ 94897], 95.00th=[114820], | 99.00th=[187696], 99.50th=[196084], 99.90th=[204473], 99.95th=[204473], | 99.99th=[204473] bw ( KiB/s): min= 31, max= 317, per=23.87%, avg=164.45, stdev=67.35, samples=71 iops : min= 1, max= 19, avg= 9.49, stdev= 4.26, samples=71 lat (usec) : 50=0.26%, 100=3.12%, 250=0.39% lat (msec) : 2=1.04%, 4=3.12%, 10=7.55%, 20=7.68%, 50=39.71% lat (msec) : 100=29.17%, 250=7.94% cpu : usr=0.09%, sys=6.07%, ctx=1819, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178999: Thu Aug 13 22:44:16 2026 read: IOPS=10, BW=166KiB/s (170kB/s)(6032KiB/36291msec) clat (usec): min=37, max=321303, avg=52129.71, stdev=38903.03 lat (usec): min=37, max=321305, avg=52131.12, stdev=38903.05 clat percentiles (usec): | 1.00th=[ 55], 5.00th=[ 68], 10.00th=[ 105], 20.00th=[ 25297], | 30.00th=[ 33817], 40.00th=[ 39584], 50.00th=[ 46400], 60.00th=[ 55837], | 70.00th=[ 65274], 80.00th=[ 72877], 90.00th=[ 92799], 95.00th=[117965], | 99.00th=[173016], 99.50th=[287310], 99.90th=[320865], 99.95th=[320865], | 99.99th=[320865] bw ( KiB/s): min= 31, max= 349, per=25.13%, avg=164.59, stdev=64.08, samples=71 iops : min= 1, max= 21, avg= 9.49, stdev= 4.02, samples=71 write: IOPS=10, BW=172KiB/s (177kB/s)(6256KiB/36291msec); 0 zone resets clat (usec): min=1751, max=190782, avg=41512.84, stdev=35807.67 lat (usec): min=1754, max=190785, avg=41522.72, stdev=35801.72 clat percentiles (msec): | 1.00th=[ 3], 5.00th=[ 4], 10.00th=[ 6], 20.00th=[ 9], | 30.00th=[ 14], 40.00th=[ 24], 50.00th=[ 33], 60.00th=[ 43], | 70.00th=[ 55], 80.00th=[ 71], 90.00th=[ 95], 95.00th=[ 109], | 99.00th=[ 144], 99.50th=[ 169], 99.90th=[ 190], 99.95th=[ 190], | 99.99th=[ 190] bw ( KiB/s): min= 30, max= 383, per=24.92%, avg=171.70, stdev=76.26, samples=71 iops : min= 1, max= 23, avg= 9.94, stdev= 4.81, samples=71 lat (usec) : 50=0.13%, 100=4.69%, 250=0.52%, 500=0.13% lat (msec) : 2=0.39%, 4=3.91%, 10=8.59%, 20=7.55%, 50=34.38% lat (msec) : 100=31.51%, 250=7.94%, 500=0.26% cpu : usr=0.08%, sys=5.72%, ctx=1816, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=656KiB/s (671kB/s), 157KiB/s-173KiB/s (161kB/s-178kB/s), io=23.4MiB (24.5MB), run=35431-36530msec WRITE: bw=690KiB/s (706kB/s), 167KiB/s-180KiB/s (171kB/s-184kB/s), io=24.6MiB (25.8MB), run=35431-36530msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179000: Thu Aug 13 22:44:30 2026 read: IOPS=7, BW=117KiB/s (120kB/s)(5920KiB/50450msec) clat (msec): min=8, max=224, avg=51.74, stdev=40.78 lat (msec): min=8, max=224, avg=51.74, stdev=40.78 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 16], 10.00th=[ 19], 20.00th=[ 24], | 30.00th=[ 29], 40.00th=[ 33], 50.00th=[ 38], 60.00th=[ 45], | 70.00th=[ 54], 80.00th=[ 69], 90.00th=[ 109], 95.00th=[ 146], | 99.00th=[ 215], 99.50th=[ 222], 99.90th=[ 224], 99.95th=[ 224], | 99.99th=[ 224] bw ( KiB/s): min= 30, max= 352, per=25.33%, avg=120.07, stdev=72.60, samples=95 iops : min= 1, max= 22, avg= 6.76, stdev= 4.60, samples=95 write: IOPS=7, BW=126KiB/s (129kB/s)(6368KiB/50450msec); 0 zone resets clat (msec): min=11, max=436, avg=77.63, stdev=53.12 lat (msec): min=11, max=436, avg=77.64, stdev=53.13 clat percentiles (msec): | 1.00th=[ 21], 5.00th=[ 30], 10.00th=[ 34], 20.00th=[ 40], | 30.00th=[ 48], 40.00th=[ 54], 50.00th=[ 61], 60.00th=[ 73], | 70.00th=[ 85], 80.00th=[ 103], 90.00th=[ 146], 95.00th=[ 169], | 99.00th=[ 296], 99.50th=[ 368], 99.90th=[ 439], 99.95th=[ 439], | 99.99th=[ 439] bw ( KiB/s): min= 31, max= 286, per=25.65%, avg=127.75, stdev=63.63, samples=97 iops : min= 1, max= 17, avg= 7.24, stdev= 3.99, samples=97 lat (msec) : 10=0.65%, 20=5.21%, 50=43.10%, 100=34.64%, 250=15.36% lat (msec) : 500=1.04% cpu : usr=0.05%, sys=1.93%, ctx=1234, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179001: Thu Aug 13 22:44:30 2026 read: IOPS=7, BW=114KiB/s (116kB/s)(5744KiB/50506msec) clat (msec): min=9, max=265, avg=50.51, stdev=43.26 lat (msec): min=9, max=265, avg=50.51, stdev=43.26 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 15], 10.00th=[ 18], 20.00th=[ 23], | 30.00th=[ 26], 40.00th=[ 30], 50.00th=[ 34], 60.00th=[ 41], | 70.00th=[ 51], 80.00th=[ 70], 90.00th=[ 114], 95.00th=[ 150], | 99.00th=[ 209], 99.50th=[ 259], 99.90th=[ 266], 99.95th=[ 266], | 99.99th=[ 266] bw ( KiB/s): min= 30, max= 381, per=24.92%, avg=118.14, stdev=78.44, samples=96 iops : min= 1, max= 23, avg= 6.63, stdev= 4.96, samples=96 write: IOPS=8, BW=130KiB/s (133kB/s)(6544KiB/50506msec); 0 zone resets clat (msec): min=16, max=434, avg=77.96, stdev=52.38 lat (msec): min=16, max=434, avg=77.97, stdev=52.38 clat percentiles (msec): | 1.00th=[ 23], 5.00th=[ 28], 10.00th=[ 33], 20.00th=[ 39], | 30.00th=[ 45], 40.00th=[ 53], 50.00th=[ 61], 60.00th=[ 73], | 70.00th=[ 90], 80.00th=[ 112], 90.00th=[ 140], 95.00th=[ 180], | 99.00th=[ 264], 99.50th=[ 300], 99.90th=[ 435], 99.95th=[ 435], | 99.99th=[ 435] bw ( KiB/s): min= 31, max= 383, per=26.70%, avg=132.98, stdev=70.30, samples=97 iops : min= 1, max= 23, avg= 7.57, stdev= 4.42, samples=97 lat (msec) : 10=0.26%, 20=7.03%, 50=44.53%, 100=29.17%, 250=17.84% lat (msec) : 500=1.17% cpu : usr=0.06%, sys=1.92%, ctx=1262, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179002: Thu Aug 13 22:44:30 2026 read: IOPS=7, BW=127KiB/s (130kB/s)(6256KiB/49439msec) clat (msec): min=9, max=323, avg=53.17, stdev=43.23 lat (msec): min=9, max=323, avg=53.17, stdev=43.23 clat percentiles (msec): | 1.00th=[ 12], 5.00th=[ 16], 10.00th=[ 19], 20.00th=[ 24], | 30.00th=[ 27], 40.00th=[ 33], 50.00th=[ 39], 60.00th=[ 47], | 70.00th=[ 58], 80.00th=[ 75], 90.00th=[ 108], 95.00th=[ 157], | 99.00th=[ 186], 99.50th=[ 288], 99.90th=[ 326], 99.95th=[ 326], | 99.99th=[ 326] bw ( KiB/s): min= 30, max= 381, per=27.29%, avg=129.34, stdev=77.58, samples=95 iops : min= 1, max= 23, avg= 7.34, stdev= 4.87, samples=95 write: IOPS=7, BW=122KiB/s (125kB/s)(6032KiB/49439msec); 0 zone resets clat (msec): min=18, max=425, avg=75.75, stdev=47.83 lat (msec): min=18, max=425, avg=75.75, stdev=47.83 clat percentiles (msec): | 1.00th=[ 22], 5.00th=[ 30], 10.00th=[ 34], 20.00th=[ 41], | 30.00th=[ 47], 40.00th=[ 54], 50.00th=[ 61], 60.00th=[ 70], | 70.00th=[ 85], 80.00th=[ 107], 90.00th=[ 142], 95.00th=[ 174], | 99.00th=[ 241], 99.50th=[ 279], 99.90th=[ 426], 99.95th=[ 426], | 99.99th=[ 426] bw ( KiB/s): min= 31, max= 319, per=24.34%, avg=121.21, stdev=66.00, samples=96 iops : min= 1, max= 19, avg= 6.81, stdev= 4.14, samples=96 lat (msec) : 10=0.13%, 20=6.51%, 50=43.36%, 100=32.55%, 250=16.80% lat (msec) : 500=0.65% cpu : usr=0.05%, sys=2.09%, ctx=1278, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179003: Thu Aug 13 22:44:30 2026 read: IOPS=7, BW=122KiB/s (125kB/s)(6032KiB/49551msec) clat (msec): min=9, max=258, avg=51.43, stdev=42.31 lat (msec): min=9, max=258, avg=51.43, stdev=42.31 clat percentiles (msec): | 1.00th=[ 12], 5.00th=[ 15], 10.00th=[ 18], 20.00th=[ 23], | 30.00th=[ 28], 40.00th=[ 32], 50.00th=[ 36], 60.00th=[ 43], | 70.00th=[ 54], 80.00th=[ 74], 90.00th=[ 113], 95.00th=[ 146], | 99.00th=[ 201], 99.50th=[ 243], 99.90th=[ 259], 99.95th=[ 259], | 99.99th=[ 259] bw ( KiB/s): min= 30, max= 446, per=26.84%, avg=127.23, stdev=81.81, samples=93 iops : min= 1, max= 27, avg= 7.20, stdev= 5.15, samples=93 write: IOPS=7, BW=126KiB/s (129kB/s)(6256KiB/49551msec); 0 zone resets clat (msec): min=17, max=289, avg=76.16, stdev=49.14 lat (msec): min=17, max=289, avg=76.16, stdev=49.14 clat percentiles (msec): | 1.00th=[ 21], 5.00th=[ 27], 10.00th=[ 32], 20.00th=[ 39], | 30.00th=[ 45], 40.00th=[ 53], 50.00th=[ 63], 60.00th=[ 72], | 70.00th=[ 87], 80.00th=[ 110], 90.00th=[ 142], 95.00th=[ 180], | 99.00th=[ 253], 99.50th=[ 288], 99.90th=[ 292], 99.95th=[ 292], | 99.99th=[ 292] bw ( KiB/s): min= 31, max= 413, per=25.86%, avg=128.78, stdev=70.43, samples=96 iops : min= 1, max= 25, avg= 7.29, stdev= 4.41, samples=96 lat (msec) : 10=0.13%, 20=8.33%, 50=43.10%, 100=30.99%, 250=16.67% lat (msec) : 500=0.78% cpu : usr=0.05%, sys=2.02%, ctx=1285, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=474KiB/s (486kB/s), 114KiB/s-127KiB/s (116kB/s-130kB/s), io=23.4MiB (24.5MB), run=49439-50506msec WRITE: bw=499KiB/s (511kB/s), 122KiB/s-130KiB/s (125kB/s-133kB/s), io=24.6MiB (25.8MB), run=49439-50506msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179017: Thu Aug 13 22:44:50 2026 read: IOPS=1, BW=1827KiB/s (1871kB/s)(7168KiB/3924msec) clat (usec): min=1042, max=468379, avg=220645.62, stdev=156791.55 lat (usec): min=1043, max=468380, avg=220647.57, stdev=156791.64 clat percentiles (usec): | 1.00th=[ 1045], 5.00th=[ 1045], 10.00th=[ 1045], 20.00th=[ 47449], | 30.00th=[217056], 40.00th=[217056], 50.00th=[250610], 60.00th=[278922], | 70.00th=[278922], 80.00th=[283116], 90.00th=[467665], 95.00th=[467665], | 99.00th=[467665], 99.50th=[467665], 99.90th=[467665], 99.95th=[467665], | 99.99th=[467665] bw ( KiB/s): min= 1793, max= 4063, per=100.00%, avg=2979.50, stdev=1240.86, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 1.15, samples=4 write: IOPS=1, BW=1305KiB/s (1336kB/s)(5120KiB/3924msec); 0 zone resets clat (msec): min=225, max=952, avg=439.07, stdev=299.95 lat (msec): min=225, max=952, avg=439.36, stdev=299.95 clat percentiles (msec): | 1.00th=[ 226], 5.00th=[ 226], 10.00th=[ 226], 20.00th=[ 226], | 30.00th=[ 232], 40.00th=[ 232], 50.00th=[ 355], 60.00th=[ 355], | 70.00th=[ 435], 80.00th=[ 435], 90.00th=[ 953], 95.00th=[ 953], | 99.00th=[ 953], 99.50th=[ 953], 99.90th=[ 953], 99.95th=[ 953], | 99.99th=[ 953] bw ( KiB/s): min= 1996, max= 2048, per=55.25%, avg=2021.50, stdev=21.30, samples=4 iops : min= 1, max= 2, avg= 1.25, stdev= 0.50, samples=4 lat (msec) : 2=8.33%, 50=8.33%, 250=25.00%, 500=50.00%, 1000=8.33% cpu : usr=0.05%, sys=10.94%, ctx=214, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179020: Thu Aug 13 22:44:50 2026 read: IOPS=0, BW=273KiB/s (280kB/s)(2048KiB/7499msec) clat (msec): min=211, max=222, avg=216.81, stdev= 7.59 lat (msec): min=211, max=222, avg=216.82, stdev= 7.59 clat percentiles (msec): | 1.00th=[ 211], 5.00th=[ 211], 10.00th=[ 211], 20.00th=[ 211], | 30.00th=[ 211], 40.00th=[ 211], 50.00th=[ 211], 60.00th=[ 222], | 70.00th=[ 222], 80.00th=[ 222], 90.00th=[ 222], 95.00th=[ 222], | 99.00th=[ 222], 99.50th=[ 222], 99.90th=[ 222], 99.95th=[ 222], | 99.99th=[ 222] bw ( KiB/s): min= 1965, max= 2043, per=76.69%, avg=2004.00, stdev=55.15, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1366KiB/s (1398kB/s)(10.0MiB/7499msec); 0 zone resets clat (msec): min=166, max=2517, avg=691.16, stdev=755.71 lat (msec): min=166, max=2517, avg=691.28, stdev=755.70 clat percentiles (msec): | 1.00th=[ 167], 5.00th=[ 167], 10.00th=[ 167], 20.00th=[ 203], | 30.00th=[ 220], 40.00th=[ 247], 50.00th=[ 351], 60.00th=[ 523], | 70.00th=[ 542], 80.00th=[ 617], 90.00th=[ 1519], 95.00th=[ 2534], | 99.00th=[ 2534], 99.50th=[ 2534], 99.90th=[ 2534], 99.95th=[ 2534], | 99.99th=[ 2534] bw ( KiB/s): min= 1996, max= 6107, per=71.30%, avg=2608.86, stdev=1542.61, samples=7 iops : min= 1, max= 5, avg= 1.57, stdev= 1.51, samples=7 lat (msec) : 250=50.00%, 500=8.33%, 750=25.00%, 2000=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=8.58%, ctx=180, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179022: Thu Aug 13 22:44:50 2026 read: IOPS=1, BW=1491KiB/s (1527kB/s)(6144KiB/4120msec) clat (usec): min=766, max=558937, avg=297683.30, stdev=199926.71 lat (usec): min=768, max=558938, avg=297684.98, stdev=199926.43 clat percentiles (usec): | 1.00th=[ 766], 5.00th=[ 766], 10.00th=[ 766], 20.00th=[208667], | 30.00th=[208667], 40.00th=[248513], 50.00th=[248513], 60.00th=[291505], | 70.00th=[480248], 80.00th=[480248], 90.00th=[557843], 95.00th=[557843], | 99.00th=[557843], 99.50th=[557843], 99.90th=[557843], 99.95th=[557843], | 99.99th=[557843] bw ( KiB/s): min= 2019, max= 4071, per=97.05%, avg=2536.00, stdev=1023.35, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 write: IOPS=1, BW=1491KiB/s (1527kB/s)(6144KiB/4120msec); 0 zone resets clat (msec): min=223, max=601, avg=379.19, stdev=167.32 lat (msec): min=223, max=601, avg=379.36, stdev=167.36 clat percentiles (msec): | 1.00th=[ 224], 5.00th=[ 224], 10.00th=[ 224], 20.00th=[ 271], | 30.00th=[ 271], 40.00th=[ 275], 50.00th=[ 275], 60.00th=[ 321], | 70.00th=[ 584], 80.00th=[ 584], 90.00th=[ 600], 95.00th=[ 600], | 99.00th=[ 600], 99.50th=[ 600], 99.90th=[ 600], 99.95th=[ 600], | 99.99th=[ 600] bw ( KiB/s): min= 1996, max= 3543, per=65.52%, avg=2397.25, stdev=763.97, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (usec) : 1000=8.33% lat (msec) : 250=25.00%, 500=41.67%, 750=25.00% cpu : usr=0.02%, sys=10.78%, ctx=150, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179024: Thu Aug 13 22:44:50 2026 read: IOPS=0, BW=653KiB/s (669kB/s)(5120KiB/7836msec) clat (usec): min=597, max=2970.3k, avg=661439.31, stdev=1293411.88 lat (usec): min=599, max=2970.3k, avg=661440.97, stdev=1293411.83 clat percentiles (usec): | 1.00th=[ 594], 5.00th=[ 594], 10.00th=[ 594], | 20.00th=[ 594], 30.00th=[ 1029], 40.00th=[ 1029], | 50.00th=[ 154141], 60.00th=[ 154141], 70.00th=[ 181404], | 80.00th=[ 181404], 90.00th=[2969568], 95.00th=[2969568], | 99.00th=[2969568], 99.50th=[2969568], 99.90th=[2969568], | 99.95th=[2969568], 99.99th=[2969568] bw ( KiB/s): min= 2027, max= 4087, per=100.00%, avg=2717.67, stdev=1185.89, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 write: IOPS=0, BW=915KiB/s (937kB/s)(7168KiB/7836msec); 0 zone resets clat (msec): min=137, max=1370, avg=607.39, stdev=517.13 lat (msec): min=137, max=1370, avg=607.53, stdev=517.19 clat percentiles (msec): | 1.00th=[ 138], 5.00th=[ 138], 10.00th=[ 138], 20.00th=[ 194], | 30.00th=[ 249], 40.00th=[ 249], 50.00th=[ 477], 60.00th=[ 527], | 70.00th=[ 527], 80.00th=[ 1301], 90.00th=[ 1368], 95.00th=[ 1368], | 99.00th=[ 1368], 99.50th=[ 1368], 99.90th=[ 1368], 99.95th=[ 1368], | 99.99th=[ 1368] bw ( KiB/s): min= 1996, max= 4071, per=66.42%, avg=2430.40, stdev=917.28, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 lat (usec) : 750=8.33% lat (msec) : 2=8.33%, 250=41.67%, 500=8.33%, 750=8.33%, 2000=16.67% lat (msec) : >=2000=8.33% cpu : usr=0.00%, sys=6.66%, ctx=620, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2614KiB/s (2676kB/s), 273KiB/s-1827KiB/s (280kB/s-1871kB/s), io=20.0MiB (20.0MB), run=3924-7836msec WRITE: bw=3659KiB/s (3747kB/s), 915KiB/s-1491KiB/s (937kB/s-1527kB/s), io=28.0MiB (29.4MB), run=3924-7836msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179018: Thu Aug 13 22:44:51 2026 read: IOPS=1, BW=1939KiB/s (1986kB/s)(7168KiB/3696msec) clat (msec): min=100, max=501, avg=234.35, stdev=165.20 lat (msec): min=100, max=501, avg=234.35, stdev=165.20 clat percentiles (msec): | 1.00th=[ 102], 5.00th=[ 102], 10.00th=[ 102], 20.00th=[ 113], | 30.00th=[ 144], 40.00th=[ 144], 50.00th=[ 144], 60.00th=[ 199], | 70.00th=[ 199], 80.00th=[ 439], 90.00th=[ 502], 95.00th=[ 502], | 99.00th=[ 502], 99.50th=[ 502], 99.90th=[ 502], 99.95th=[ 502], | 99.99th=[ 502] bw ( KiB/s): min= 2003, max= 5417, per=100.00%, avg=3838.67, stdev=1721.49, samples=3 iops : min= 1, max= 5, avg= 3.33, stdev= 2.08, samples=3 write: IOPS=1, BW=1385KiB/s (1419kB/s)(5120KiB/3696msec); 0 zone resets clat (msec): min=165, max=824, avg=385.98, stdev=264.55 lat (msec): min=165, max=824, avg=386.28, stdev=264.41 clat percentiles (msec): | 1.00th=[ 165], 5.00th=[ 165], 10.00th=[ 165], 20.00th=[ 165], | 30.00th=[ 203], 40.00th=[ 203], 50.00th=[ 321], 60.00th=[ 321], | 70.00th=[ 418], 80.00th=[ 418], 90.00th=[ 827], 95.00th=[ 827], | 99.00th=[ 827], 99.50th=[ 827], 99.90th=[ 827], 99.95th=[ 827], | 99.99th=[ 827] bw ( KiB/s): min= 2000, max= 3984, per=78.28%, avg=2508.75, stdev=983.75, samples=4 iops : min= 1, max= 3, avg= 1.75, stdev= 0.96, samples=4 lat (msec) : 250=58.33%, 500=25.00%, 750=8.33%, 1000=8.33% cpu : usr=0.00%, sys=3.33%, ctx=70, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179019: Thu Aug 13 22:44:51 2026 read: IOPS=0, BW=277KiB/s (283kB/s)(2048KiB/7399msec) clat (msec): min=91, max=146, avg=119.00, stdev=39.02 lat (msec): min=91, max=146, avg=119.00, stdev=39.02 clat percentiles (msec): | 1.00th=[ 92], 5.00th=[ 92], 10.00th=[ 92], 20.00th=[ 92], | 30.00th=[ 92], 40.00th=[ 92], 50.00th=[ 92], 60.00th=[ 146], | 70.00th=[ 146], 80.00th=[ 146], 90.00th=[ 146], 95.00th=[ 146], | 99.00th=[ 146], 99.50th=[ 146], 99.90th=[ 146], 99.95th=[ 146], | 99.99th=[ 146] bw ( KiB/s): min= 1617, max= 1992, per=78.83%, avg=1804.50, stdev=265.17, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1384KiB/s (1417kB/s)(10.0MiB/7399msec); 0 zone resets clat (msec): min=138, max=3242, avg=711.26, stdev=934.04 lat (msec): min=138, max=3242, avg=711.92, stdev=933.76 clat percentiles (msec): | 1.00th=[ 140], 5.00th=[ 140], 10.00th=[ 140], 20.00th=[ 155], | 30.00th=[ 178], 40.00th=[ 220], 50.00th=[ 347], 60.00th=[ 477], | 70.00th=[ 642], 80.00th=[ 718], 90.00th=[ 1003], 95.00th=[ 3239], | 99.00th=[ 3239], 99.50th=[ 3239], 99.90th=[ 3239], 99.95th=[ 3239], | 99.99th=[ 3239] bw ( KiB/s): min= 1617, max= 4096, per=91.71%, avg=2939.33, stdev=1151.55, samples=6 iops : min= 1, max= 4, avg= 2.33, stdev= 1.21, samples=6 lat (msec) : 100=8.33%, 250=41.67%, 500=16.67%, 750=16.67%, 2000=8.33% lat (msec) : >=2000=8.33% cpu : usr=0.03%, sys=2.43%, ctx=85, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179021: Thu Aug 13 22:44:51 2026 read: IOPS=0, BW=836KiB/s (856kB/s)(6144KiB/7353msec) clat (msec): min=128, max=2923, avg=631.86, stdev=1124.20 lat (msec): min=128, max=2923, avg=631.86, stdev=1124.20 clat percentiles (msec): | 1.00th=[ 129], 5.00th=[ 129], 10.00th=[ 129], 20.00th=[ 132], | 30.00th=[ 132], 40.00th=[ 150], 50.00th=[ 150], 60.00th=[ 174], | 70.00th=[ 284], 80.00th=[ 284], 90.00th=[ 2937], 95.00th=[ 2937], | 99.00th=[ 2937], 99.50th=[ 2937], 99.90th=[ 2937], 99.95th=[ 2937], | 99.99th=[ 2937] bw ( KiB/s): min= 1928, max= 3984, per=100.00%, avg=2486.75, stdev=999.16, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 write: IOPS=0, BW=836KiB/s (856kB/s)(6144KiB/7353msec); 0 zone resets clat (msec): min=354, max=667, avg=531.38, stdev=118.40 lat (msec): min=357, max=667, avg=531.94, stdev=117.58 clat percentiles (msec): | 1.00th=[ 355], 5.00th=[ 355], 10.00th=[ 355], 20.00th=[ 481], | 30.00th=[ 481], 40.00th=[ 510], 50.00th=[ 510], 60.00th=[ 514], | 70.00th=[ 659], 80.00th=[ 659], 90.00th=[ 667], 95.00th=[ 667], | 99.00th=[ 667], 99.50th=[ 667], 99.90th=[ 667], 99.95th=[ 667], | 99.99th=[ 667] bw ( KiB/s): min= 1992, max= 2048, per=63.02%, avg=2019.67, stdev=24.86, samples=6 iops : min= 1, max= 2, avg= 1.33, stdev= 0.52, samples=6 lat (msec) : 250=33.33%, 500=25.00%, 750=33.33%, >=2000=8.33% cpu : usr=0.01%, sys=3.06%, ctx=112, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179023: Thu Aug 13 22:44:51 2026 read: IOPS=0, BW=572KiB/s (586kB/s)(5120KiB/8946msec) clat (msec): min=122, max=2711, avg=765.48, stdev=1092.33 lat (msec): min=122, max=2711, avg=765.49, stdev=1092.33 clat percentiles (msec): | 1.00th=[ 123], 5.00th=[ 123], 10.00th=[ 123], 20.00th=[ 123], | 30.00th=[ 266], 40.00th=[ 266], 50.00th=[ 342], 60.00th=[ 342], | 70.00th=[ 388], 80.00th=[ 388], 90.00th=[ 2702], 95.00th=[ 2702], | 99.00th=[ 2702], 99.50th=[ 2702], 99.90th=[ 2702], 99.95th=[ 2702], | 99.99th=[ 2702] bw ( KiB/s): min= 2003, max= 4071, per=100.00%, avg=2705.67, stdev=1182.58, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 write: IOPS=0, BW=801KiB/s (820kB/s)(7168KiB/8946msec); 0 zone resets clat (msec): min=159, max=1586, avg=680.55, stdev=625.07 lat (msec): min=164, max=1586, avg=681.92, stdev=624.33 clat percentiles (msec): | 1.00th=[ 161], 5.00th=[ 161], 10.00th=[ 161], 20.00th=[ 178], | 30.00th=[ 243], 40.00th=[ 243], 50.00th=[ 426], 60.00th=[ 634], | 70.00th=[ 634], 80.00th=[ 1536], 90.00th=[ 1586], 95.00th=[ 1586], | 99.00th=[ 1586], 99.50th=[ 1586], 99.90th=[ 1586], 99.95th=[ 1586], | 99.99th=[ 1586] bw ( KiB/s): min= 1928, max= 4007, per=74.66%, avg=2393.00, stdev=903.01, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 lat (msec) : 250=33.33%, 500=33.33%, 750=8.33%, 2000=16.67%, >=2000=8.33% cpu : usr=0.02%, sys=3.33%, ctx=100, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2289KiB/s (2344kB/s), 277KiB/s-1939KiB/s (283kB/s-1986kB/s), io=20.0MiB (20.0MB), run=3696-8946msec WRITE: bw=3205KiB/s (3282kB/s), 801KiB/s-1385KiB/s (820kB/s-1419kB/s), io=28.0MiB (29.4MB), run=3696-8946msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179031: Thu Aug 13 22:45:07 2026 read: IOPS=0, BW=3996KiB/s (4092kB/s)(12.0MiB/3075msec) clat (msec): min=866, max=1131, avg=992.95, stdev=132.76 lat (msec): min=866, max=1131, avg=992.95, stdev=132.76 clat percentiles (msec): | 1.00th=[ 869], 5.00th=[ 869], 10.00th=[ 869], 20.00th=[ 869], | 30.00th=[ 869], 40.00th=[ 978], 50.00th=[ 978], 60.00th=[ 978], | 70.00th=[ 1133], 80.00th=[ 1133], 90.00th=[ 1133], 95.00th=[ 1133], | 99.00th=[ 1133], 99.50th=[ 1133], 99.90th=[ 1133], 99.95th=[ 1133], | 99.99th=[ 1133] bw ( KiB/s): min= 8094, max= 8143, per=100.00%, avg=8118.50, stdev=34.65, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=66.67%, 2000=33.33% cpu : usr=0.00%, sys=11.42%, ctx=356, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179032: Thu Aug 13 22:45:07 2026 read: IOPS=0, BW=1261KiB/s (1291kB/s)(4096KiB/3248msec) clat (nsec): min=905029k, max=905029k, avg=905028729.00, stdev= 0.00 lat (nsec): min=905030k, max=905030k, avg=905029887.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 902], 5.00th=[ 902], 10.00th=[ 902], 20.00th=[ 902], | 30.00th=[ 902], 40.00th=[ 902], 50.00th=[ 902], 60.00th=[ 902], | 70.00th=[ 902], 80.00th=[ 902], 90.00th=[ 902], 95.00th=[ 902], | 99.00th=[ 902], 99.50th=[ 902], 99.90th=[ 902], 99.95th=[ 902], | 99.99th=[ 902] bw ( KiB/s): min= 8175, max= 8175, per=100.00%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2522KiB/s (2583kB/s)(8192KiB/3248msec); 0 zone resets clat (msec): min=726, max=1574, avg=1150.75, stdev=599.59 lat (msec): min=727, max=1575, avg=1151.16, stdev=599.53 clat percentiles (msec): | 1.00th=[ 726], 5.00th=[ 726], 10.00th=[ 726], 20.00th=[ 726], | 30.00th=[ 726], 40.00th=[ 726], 50.00th=[ 726], 60.00th=[ 1569], | 70.00th=[ 1569], 80.00th=[ 1569], 90.00th=[ 1569], 95.00th=[ 1569], | 99.00th=[ 1569], 99.50th=[ 1569], 99.90th=[ 1569], 99.95th=[ 1569], | 99.99th=[ 1569] bw ( KiB/s): min= 8159, max= 8159, per=85.81%, avg=8159.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=3.79%, ctx=61, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179033: Thu Aug 13 22:45:07 2026 write: IOPS=0, BW=3566KiB/s (3651kB/s)(12.0MiB/3446msec); 0 zone resets clat (msec): min=988, max=1215, avg=1127.85, stdev=122.32 lat (msec): min=988, max=1216, avg=1128.33, stdev=122.35 clat percentiles (msec): | 1.00th=[ 986], 5.00th=[ 986], 10.00th=[ 986], 20.00th=[ 986], | 30.00th=[ 986], 40.00th=[ 1183], 50.00th=[ 1183], 60.00th=[ 1183], | 70.00th=[ 1217], 80.00th=[ 1217], 90.00th=[ 1217], 95.00th=[ 1217], | 99.00th=[ 1217], 99.50th=[ 1217], 99.90th=[ 1217], 99.95th=[ 1217], | 99.99th=[ 1217] bw ( KiB/s): min= 7787, max= 8175, per=83.94%, avg=7981.00, stdev=274.36, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=33.33%, 2000=66.67% cpu : usr=0.06%, sys=5.34%, ctx=84, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179034: Thu Aug 13 22:45:07 2026 write: IOPS=1, BW=4253KiB/s (4355kB/s)(12.0MiB/2889msec); 0 zone resets clat (msec): min=866, max=1010, avg=929.97, stdev=73.17 lat (msec): min=867, max=1010, avg=930.41, stdev=73.05 clat percentiles (msec): | 1.00th=[ 869], 5.00th=[ 869], 10.00th=[ 869], 20.00th=[ 869], | 30.00th=[ 869], 40.00th=[ 911], 50.00th=[ 911], 60.00th=[ 911], | 70.00th=[ 1011], 80.00th=[ 1011], 90.00th=[ 1011], 95.00th=[ 1011], | 99.00th=[ 1011], 99.50th=[ 1011], 99.90th=[ 1011], 99.95th=[ 1011], | 99.99th=[ 1011] bw ( KiB/s): min= 8159, max= 8175, per=85.90%, avg=8167.00, stdev=11.31, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=66.67%, 2000=33.33% cpu : usr=0.00%, sys=3.70%, ctx=52, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5044KiB/s (5165kB/s), 1261KiB/s-3996KiB/s (1291kB/s-4092kB/s), io=16.0MiB (16.8MB), run=3075-3248msec WRITE: bw=9509KiB/s (9737kB/s), 2522KiB/s-4253KiB/s (2583kB/s-4355kB/s), io=32.0MiB (33.6MB), run=2889-3446msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179036: Thu Aug 13 22:45:07 2026 read: IOPS=0, BW=4037KiB/s (4134kB/s)(12.0MiB/3044msec) clat (msec): min=286, max=1658, avg=1013.62, stdev=689.97 lat (msec): min=286, max=1658, avg=1013.62, stdev=689.97 clat percentiles (msec): | 1.00th=[ 288], 5.00th=[ 288], 10.00th=[ 288], 20.00th=[ 288], | 30.00th=[ 288], 40.00th=[ 1099], 50.00th=[ 1099], 60.00th=[ 1099], | 70.00th=[ 1653], 80.00th=[ 1653], 90.00th=[ 1653], 95.00th=[ 1653], | 99.00th=[ 1653], 99.50th=[ 1653], 99.90th=[ 1653], 99.95th=[ 1653], | 99.99th=[ 1653] bw ( KiB/s): min= 7968, max= 7968, per=100.00%, avg=7968.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.00%, sys=2.63%, ctx=45, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179037: Thu Aug 13 22:45:07 2026 read: IOPS=0, BW=1328KiB/s (1360kB/s)(4096KiB/3084msec) clat (nsec): min=762442k, max=762442k, avg=762441593.00, stdev= 0.00 lat (nsec): min=762444k, max=762444k, avg=762444015.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 760], 5.00th=[ 760], 10.00th=[ 760], 20.00th=[ 760], | 30.00th=[ 760], 40.00th=[ 760], 50.00th=[ 760], 60.00th=[ 760], | 70.00th=[ 760], 80.00th=[ 760], 90.00th=[ 760], 95.00th=[ 760], | 99.00th=[ 760], 99.50th=[ 760], 99.90th=[ 760], 99.95th=[ 760], | 99.99th=[ 760] bw ( KiB/s): min= 7968, max= 7968, per=100.00%, avg=7968.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2656KiB/s (2720kB/s)(8192KiB/3084msec); 0 zone resets clat (msec): min=429, max=1888, avg=1159.02, stdev=1031.37 lat (msec): min=430, max=1890, avg=1160.13, stdev=1032.28 clat percentiles (msec): | 1.00th=[ 430], 5.00th=[ 430], 10.00th=[ 430], 20.00th=[ 430], | 30.00th=[ 430], 40.00th=[ 430], 50.00th=[ 430], 60.00th=[ 1888], | 70.00th=[ 1888], 80.00th=[ 1888], 90.00th=[ 1888], 95.00th=[ 1888], | 99.00th=[ 1888], 99.50th=[ 1888], 99.90th=[ 1888], 99.95th=[ 1888], | 99.99th=[ 1888] bw ( KiB/s): min= 7984, max= 7984, per=83.99%, avg=7984.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=3.24%, ctx=51, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179038: Thu Aug 13 22:45:07 2026 write: IOPS=0, BW=3565KiB/s (3650kB/s)(12.0MiB/3447msec); 0 zone resets clat (msec): min=200, max=1947, avg=1148.12, stdev=882.64 lat (msec): min=201, max=1948, avg=1148.59, stdev=882.62 clat percentiles (msec): | 1.00th=[ 201], 5.00th=[ 201], 10.00th=[ 201], 20.00th=[ 201], | 30.00th=[ 201], 40.00th=[ 1301], 50.00th=[ 1301], 60.00th=[ 1301], | 70.00th=[ 1955], 80.00th=[ 1955], 90.00th=[ 1955], 95.00th=[ 1955], | 99.00th=[ 1955], 99.50th=[ 1955], 99.90th=[ 1955], 99.95th=[ 1955], | 99.99th=[ 1955] bw ( KiB/s): min= 7984, max= 7984, per=83.99%, avg=7984.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 2000=66.67% cpu : usr=0.00%, sys=3.48%, ctx=41, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179039: Thu Aug 13 22:45:07 2026 write: IOPS=1, BW=5011KiB/s (5132kB/s)(12.0MiB/2452msec); 0 zone resets clat (msec): min=379, max=1462, avg=815.82, stdev=571.67 lat (msec): min=380, max=1463, avg=816.86, stdev=571.30 clat percentiles (msec): | 1.00th=[ 380], 5.00th=[ 380], 10.00th=[ 380], 20.00th=[ 380], | 30.00th=[ 380], 40.00th=[ 609], 50.00th=[ 609], 60.00th=[ 609], | 70.00th=[ 1469], 80.00th=[ 1469], 90.00th=[ 1469], 95.00th=[ 1469], | 99.00th=[ 1469], 99.50th=[ 1469], 99.90th=[ 1469], 99.95th=[ 1469], | 99.99th=[ 1469] bw ( KiB/s): min= 5843, max= 8175, per=73.73%, avg=7009.00, stdev=1648.97, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.08%, sys=4.41%, ctx=23, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5313KiB/s (5440kB/s), 1328KiB/s-4037KiB/s (1360kB/s-4134kB/s), io=16.0MiB (16.8MB), run=3044-3084msec WRITE: bw=9506KiB/s (9734kB/s), 2656KiB/s-5011KiB/s (2720kB/s-5132kB/s), io=32.0MiB (33.6MB), run=2452-3447msec