== sanity test 398b: DIO and buffer IO race ============== 20:22:03 (1787444523) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 6.81528 s, 7.4 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=145730: Sat Aug 22 20:24:36 2026 read: IOPS=11, BW=45.2KiB/s (46.3kB/s)(5992KiB/132488msec) clat (usec): min=42, max=988798, avg=44335.24, stdev=44554.44 lat (usec): min=42, max=988799, avg=44338.84, stdev=44554.21 clat percentiles (usec): | 1.00th=[ 63], 5.00th=[ 78], 10.00th=[ 12256], 20.00th=[ 20841], | 30.00th=[ 26084], 40.00th=[ 31327], 50.00th=[ 36963], 60.00th=[ 44303], | 70.00th=[ 52691], 80.00th=[ 64750], 90.00th=[ 80217], 95.00th=[ 94897], | 99.00th=[143655], 99.50th=[198181], 99.90th=[801113], 99.95th=[985662], | 99.99th=[985662] bw ( KiB/s): min= 7, max= 126, per=24.82%, avg=44.93, stdev=19.37, samples=259 iops : min= 1, max= 31, avg=10.57, stdev= 4.87, samples=259 write: IOPS=11, BW=47.5KiB/s (48.7kB/s)(6296KiB/132488msec); 0 zone resets clat (usec): min=1092, max=375789, avg=41613.55, stdev=40434.09 lat (usec): min=1094, max=375791, avg=41620.37, stdev=40435.16 clat percentiles (usec): | 1.00th=[ 1221], 5.00th=[ 1434], 10.00th=[ 2606], 20.00th=[ 5669], | 30.00th=[ 10683], 40.00th=[ 21365], 50.00th=[ 32637], 60.00th=[ 42730], | 70.00th=[ 55313], 80.00th=[ 70779], 90.00th=[ 96994], 95.00th=[119014], | 99.00th=[175113], 99.50th=[193987], 99.90th=[261096], 99.95th=[375391], | 99.99th=[375391] bw ( KiB/s): min= 7, max= 182, per=25.01%, avg=47.27, stdev=21.30, samples=259 iops : min= 1, max= 45, avg=11.16, stdev= 5.35, samples=259 lat (usec) : 50=0.10%, 100=2.96%, 250=0.52%, 500=0.26%, 750=0.07% lat (usec) : 1000=0.03% lat (msec) : 2=4.43%, 4=3.29%, 10=7.55%, 20=9.96%, 50=36.98% lat (msec) : 100=27.31%, 250=6.32%, 500=0.16%, 1000=0.07% cpu : usr=0.10%, sys=5.36%, ctx=6819, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145731: Sat Aug 22 20:24:36 2026 read: IOPS=11, BW=45.1KiB/s (46.2kB/s)(5940KiB/131729msec) clat (usec): min=31, max=1049.7k, avg=44334.52, stdev=43712.67 lat (usec): min=31, max=1049.7k, avg=44336.85, stdev=43712.51 clat percentiles (usec): | 1.00th=[ 59], 5.00th=[ 78], 10.00th=[ 10683], | 20.00th=[ 21103], 30.00th=[ 26346], 40.00th=[ 31327], | 50.00th=[ 37487], 60.00th=[ 43779], 70.00th=[ 53216], | 80.00th=[ 66323], 90.00th=[ 80217], 95.00th=[ 95945], | 99.00th=[ 154141], 99.50th=[ 185598], 99.90th=[ 509608], | 99.95th=[1052771], 99.99th=[1052771] bw ( KiB/s): min= 7, max= 95, per=24.79%, avg=44.86, stdev=18.18, samples=258 iops : min= 1, max= 23, avg=10.56, stdev= 4.55, samples=258 write: IOPS=12, BW=48.2KiB/s (49.3kB/s)(6348KiB/131729msec); 0 zone resets clat (usec): min=1007, max=338409, avg=41155.94, stdev=40149.20 lat (usec): min=1008, max=338855, avg=41167.31, stdev=40158.06 clat percentiles (usec): | 1.00th=[ 1221], 5.00th=[ 1401], 10.00th=[ 2147], 20.00th=[ 5080], | 30.00th=[ 10028], 40.00th=[ 20317], 50.00th=[ 31065], 60.00th=[ 42730], | 70.00th=[ 54789], 80.00th=[ 70779], 90.00th=[ 94897], 95.00th=[121111], | 99.00th=[170918], 99.50th=[196084], 99.90th=[214959], 99.95th=[337642], | 99.99th=[337642] bw ( KiB/s): min= 7, max= 119, per=25.37%, avg=47.95, stdev=21.54, samples=258 iops : min= 1, max= 29, avg=11.32, stdev= 5.40, samples=258 lat (usec) : 50=0.26%, 100=3.19%, 250=0.68%, 500=0.10%, 750=0.10% lat (usec) : 1000=0.03% lat (msec) : 2=4.92%, 4=3.45%, 10=7.52%, 20=9.18%, 50=37.37% lat (msec) : 100=26.89%, 250=6.15%, 500=0.07%, 750=0.07%, 2000=0.03% cpu : usr=0.08%, sys=5.39%, ctx=6675, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145732: Sat Aug 22 20:24:36 2026 read: IOPS=11, BW=45.7KiB/s (46.8kB/s)(6028KiB/132008msec) clat (usec): min=32, max=222674, avg=41617.80, stdev=28107.71 lat (usec): min=32, max=222675, avg=41625.62, stdev=28109.05 clat percentiles (usec): | 1.00th=[ 58], 5.00th=[ 76], 10.00th=[ 11338], 20.00th=[ 21103], | 30.00th=[ 26084], 40.00th=[ 30802], 50.00th=[ 35914], 60.00th=[ 43254], | 70.00th=[ 51119], 80.00th=[ 62129], 90.00th=[ 79168], 95.00th=[ 91751], | 99.00th=[132645], 99.50th=[147850], 99.90th=[183501], 99.95th=[223347], | 99.99th=[223347] bw ( KiB/s): min= 7, max= 103, per=25.35%, avg=45.89, stdev=20.58, samples=255 iops : min= 1, max= 25, avg=10.81, stdev= 5.19, samples=255 write: IOPS=11, BW=47.4KiB/s (48.6kB/s)(6260KiB/132008msec); 0 zone resets clat (usec): min=1018, max=961765, avg=43889.01, stdev=52744.96 lat (usec): min=1020, max=961767, avg=43906.44, stdev=52749.63 clat percentiles (usec): | 1.00th=[ 1221], 5.00th=[ 1385], 10.00th=[ 1844], 20.00th=[ 5145], | 30.00th=[ 10028], 40.00th=[ 20317], 50.00th=[ 32113], 60.00th=[ 43779], | 70.00th=[ 54789], 80.00th=[ 72877], 90.00th=[100140], 95.00th=[127402], | 99.00th=[214959], 99.50th=[274727], 99.90th=[488637], 99.95th=[960496], | 99.99th=[960496] bw ( KiB/s): min= 7, max= 143, per=24.78%, avg=46.84, stdev=21.08, samples=259 iops : min= 1, max= 35, avg=11.05, stdev= 5.28, samples=259 lat (usec) : 50=0.20%, 100=3.12%, 250=0.65%, 500=0.13%, 750=0.03% lat (usec) : 1000=0.03% lat (msec) : 2=5.60%, 4=3.48%, 10=6.64%, 20=9.44%, 50=37.89% lat (msec) : 100=26.04%, 250=6.41%, 500=0.29%, 1000=0.03% cpu : usr=0.11%, sys=5.32%, ctx=6754, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145733: Sat Aug 22 20:24:36 2026 read: IOPS=11, BW=46.1KiB/s (47.2kB/s)(6052KiB/131255msec) clat (usec): min=35, max=967989, avg=43008.63, stdev=42120.58 lat (usec): min=35, max=967991, avg=43012.99, stdev=42121.37 clat percentiles (usec): | 1.00th=[ 58], 5.00th=[ 72], 10.00th=[ 6980], 20.00th=[ 20317], | 30.00th=[ 25035], 40.00th=[ 30278], 50.00th=[ 35914], 60.00th=[ 42730], | 70.00th=[ 50594], 80.00th=[ 61604], 90.00th=[ 80217], 95.00th=[ 95945], | 99.00th=[143655], 99.50th=[200279], 99.90th=[484443], 99.95th=[968885], | 99.99th=[968885] bw ( KiB/s): min= 7, max= 96, per=25.60%, avg=46.34, stdev=19.41, samples=255 iops : min= 1, max= 24, avg=10.93, stdev= 4.86, samples=255 write: IOPS=11, BW=47.5KiB/s (48.7kB/s)(6236KiB/131255msec); 0 zone resets clat (usec): min=1156, max=394498, avg=42092.19, stdev=42703.40 lat (usec): min=1157, max=394500, avg=42096.66, stdev=42702.28 clat percentiles (usec): | 1.00th=[ 1237], 5.00th=[ 1401], 10.00th=[ 2147], 20.00th=[ 5145], | 30.00th=[ 10159], 40.00th=[ 20317], 50.00th=[ 31065], 60.00th=[ 43254], | 70.00th=[ 56361], 80.00th=[ 71828], 90.00th=[ 96994], 95.00th=[117965], | 99.00th=[173016], 99.50th=[210764], 99.90th=[367002], 99.95th=[396362], | 99.99th=[396362] bw ( KiB/s): min= 7, max= 111, per=25.04%, avg=47.32, stdev=18.78, samples=257 iops : min= 1, max= 27, avg=11.17, stdev= 4.73, samples=257 lat (usec) : 50=0.26%, 100=3.58%, 250=0.62%, 500=0.16%, 1000=0.07% lat (msec) : 2=4.95%, 4=3.81%, 10=6.84%, 20=9.41%, 50=37.34% lat (msec) : 100=26.11%, 250=6.58%, 500=0.26%, 1000=0.03% cpu : usr=0.10%, sys=5.28%, ctx=6667, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=181KiB/s (186kB/s), 45.1KiB/s-46.1KiB/s (46.2kB/s-47.2kB/s), io=23.4MiB (24.6MB), run=131255-132488msec WRITE: bw=190KiB/s (194kB/s), 47.4KiB/s-48.2KiB/s (48.6kB/s-49.3kB/s), io=24.6MiB (25.7MB), run=131255-132488msec rand-rw: (groupid=0, jobs=1): err= 0: pid=145735: Sat Aug 22 20:26:58 2026 read: IOPS=5, BW=21.8KiB/s (22.3kB/s)(5992KiB/275025msec) clat (msec): min=5, max=1046, avg=35.26, stdev=44.82 lat (msec): min=5, max=1046, avg=35.26, stdev=44.82 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 15], | 30.00th=[ 17], 40.00th=[ 20], 50.00th=[ 23], 60.00th=[ 27], | 70.00th=[ 33], 80.00th=[ 45], 90.00th=[ 77], 95.00th=[ 104], | 99.00th=[ 186], 99.50th=[ 241], 99.90th=[ 401], 99.95th=[ 1045], | 99.99th=[ 1045] bw ( KiB/s): min= 7, max= 87, per=28.49%, avg=24.79, stdev=16.85, samples=466 iops : min= 1, max= 21, avg= 5.57, stdev= 4.25, samples=466 write: IOPS=5, BW=22.9KiB/s (23.4kB/s)(6296KiB/275025msec); 0 zone resets clat (msec): min=32, max=928, avg=141.06, stdev=67.06 lat (msec): min=32, max=928, avg=141.07, stdev=67.06 clat percentiles (msec): | 1.00th=[ 52], 5.00th=[ 67], 10.00th=[ 74], 20.00th=[ 87], | 30.00th=[ 101], 40.00th=[ 113], 50.00th=[ 126], 60.00th=[ 142], | 70.00th=[ 161], 80.00th=[ 186], 90.00th=[ 234], 95.00th=[ 275], | 99.00th=[ 334], 99.50th=[ 368], 99.90th=[ 518], 99.95th=[ 927], | 99.99th=[ 927] bw ( KiB/s): min= 7, max= 55, per=24.84%, avg=22.60, stdev=10.30, samples=535 iops : min= 1, max= 13, avg= 5.02, stdev= 2.64, samples=535 lat (msec) : 10=2.90%, 20=18.00%, 50=19.60%, 100=20.74%, 250=34.60% lat (msec) : 500=4.07%, 750=0.03%, 1000=0.03%, 2000=0.03% cpu : usr=0.05%, sys=1.14%, ctx=5171, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145736: Sat Aug 22 20:26:58 2026 read: IOPS=5, BW=21.7KiB/s (22.2kB/s)(5940KiB/274146msec) clat (msec): min=5, max=1071, avg=35.45, stdev=47.36 lat (msec): min=5, max=1071, avg=35.45, stdev=47.36 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 11], 20.00th=[ 14], | 30.00th=[ 17], 40.00th=[ 19], 50.00th=[ 22], 60.00th=[ 27], | 70.00th=[ 33], 80.00th=[ 45], 90.00th=[ 77], 95.00th=[ 105], | 99.00th=[ 171], 99.50th=[ 232], 99.90th=[ 659], 99.95th=[ 1070], | 99.99th=[ 1070] bw ( KiB/s): min= 7, max= 95, per=27.99%, avg=24.35, stdev=16.25, samples=471 iops : min= 1, max= 23, avg= 5.47, stdev= 4.10, samples=471 write: IOPS=5, BW=23.2KiB/s (23.7kB/s)(6348KiB/274146msec); 0 zone resets clat (msec): min=40, max=895, avg=139.46, stdev=64.44 lat (msec): min=40, max=895, avg=139.47, stdev=64.44 clat percentiles (msec): | 1.00th=[ 51], 5.00th=[ 65], 10.00th=[ 75], 20.00th=[ 88], | 30.00th=[ 100], 40.00th=[ 113], 50.00th=[ 126], 60.00th=[ 142], | 70.00th=[ 161], 80.00th=[ 186], 90.00th=[ 226], 95.00th=[ 264], | 99.00th=[ 338], 99.50th=[ 359], 99.90th=[ 422], 99.95th=[ 894], | 99.99th=[ 894] bw ( KiB/s): min= 7, max= 55, per=25.01%, avg=22.76, stdev=10.25, samples=537 iops : min= 1, max= 13, avg= 5.06, stdev= 2.63, samples=537 lat (msec) : 10=3.09%, 20=18.39%, 50=18.36%, 100=21.81%, 250=34.99% lat (msec) : 500=3.26%, 750=0.03%, 1000=0.03%, 2000=0.03% cpu : usr=0.04%, sys=1.15%, ctx=5209, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145737: Sat Aug 22 20:26:58 2026 read: IOPS=5, BW=22.1KiB/s (22.7kB/s)(6028KiB/272319msec) clat (msec): min=5, max=389, avg=35.45, stdev=36.72 lat (msec): min=5, max=389, avg=35.45, stdev=36.72 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 15], | 30.00th=[ 17], 40.00th=[ 20], 50.00th=[ 23], 60.00th=[ 28], | 70.00th=[ 34], 80.00th=[ 46], 90.00th=[ 77], 95.00th=[ 114], | 99.00th=[ 163], 99.50th=[ 201], 99.90th=[ 347], 99.95th=[ 388], | 99.99th=[ 388] bw ( KiB/s): min= 7, max= 119, per=27.80%, avg=24.19, stdev=16.36, samples=481 iops : min= 1, max= 29, avg= 5.42, stdev= 4.11, samples=481 write: IOPS=5, BW=22.0KiB/s (23.5kB/s)(6260KiB/272319msec); 0 zone resets clat (msec): min=37, max=1154, avg=139.76, stdev=70.90 lat (msec): min=37, max=1154, avg=139.76, stdev=70.90 clat percentiles (msec): | 1.00th=[ 55], 5.00th=[ 66], 10.00th=[ 75], 20.00th=[ 88], | 30.00th=[ 100], 40.00th=[ 111], 50.00th=[ 126], 60.00th=[ 140], | 70.00th=[ 159], 80.00th=[ 188], 90.00th=[ 226], 95.00th=[ 255], | 99.00th=[ 330], 99.50th=[ 363], 99.90th=[ 944], 99.95th=[ 1150], | 99.99th=[ 1150] bw ( KiB/s): min= 7, max= 48, per=24.92%, avg=22.68, stdev=10.11, samples=531 iops : min= 1, max= 12, avg= 5.04, stdev= 2.61, samples=531 lat (msec) : 10=2.83%, 20=17.35%, 50=20.48%, 100=20.87%, 250=35.42% lat (msec) : 500=2.96%, 1000=0.07%, 2000=0.03% cpu : usr=0.05%, sys=1.17%, ctx=5219, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145738: Sat Aug 22 20:26:58 2026 read: IOPS=5, BW=22.2KiB/s (22.7kB/s)(6052KiB/272803msec) clat (msec): min=5, max=348, avg=35.75, stdev=35.55 lat (msec): min=5, max=348, avg=35.75, stdev=35.55 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 15], | 30.00th=[ 18], 40.00th=[ 20], 50.00th=[ 24], 60.00th=[ 27], | 70.00th=[ 35], 80.00th=[ 49], 90.00th=[ 81], 95.00th=[ 109], | 99.00th=[ 174], 99.50th=[ 203], 99.90th=[ 305], 99.95th=[ 351], | 99.99th=[ 351] bw ( KiB/s): min= 7, max= 111, per=28.71%, avg=24.98, stdev=16.80, samples=468 iops : min= 1, max= 27, avg= 5.62, stdev= 4.26, samples=468 write: IOPS=5, BW=22.9KiB/s (23.4kB/s)(6236KiB/272803msec); 0 zone resets clat (msec): min=35, max=1232, avg=140.20, stdev=72.04 lat (msec): min=35, max=1232, avg=140.20, stdev=72.04 clat percentiles (msec): | 1.00th=[ 52], 5.00th=[ 65], 10.00th=[ 73], 20.00th=[ 88], | 30.00th=[ 100], 40.00th=[ 113], 50.00th=[ 124], 60.00th=[ 138], | 70.00th=[ 157], 80.00th=[ 184], 90.00th=[ 226], 95.00th=[ 271], | 99.00th=[ 347], 99.50th=[ 418], 99.90th=[ 827], 99.95th=[ 1234], | 99.99th=[ 1234] bw ( KiB/s): min= 7, max= 48, per=24.78%, avg=22.55, stdev=10.37, samples=532 iops : min= 1, max= 12, avg= 5.01, stdev= 2.66, samples=532 lat (msec) : 10=2.73%, 20=17.48%, 50=19.82%, 100=21.58%, 250=34.80% lat (msec) : 500=3.52%, 1000=0.03%, 2000=0.03% cpu : usr=0.05%, sys=1.17%, ctx=5283, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=87.3KiB/s (89.4kB/s), 21.7KiB/s-22.2KiB/s (22.2kB/s-22.7kB/s), io=23.4MiB (24.6MB), run=272319-275025msec WRITE: bw=91.4KiB/s (93.6kB/s), 22.9KiB/s-23.2KiB/s (23.4kB/s-23.7kB/s), io=24.6MiB (25.7MB), run=272319-275025msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=145797: Sat Aug 22 20:27:37 2026 read: IOPS=12, BW=196KiB/s (200kB/s)(5920KiB/30235msec) clat (usec): min=38, max=375056, avg=39958.01, stdev=40272.47 lat (usec): min=38, max=375057, avg=39959.71, stdev=40272.06 clat percentiles (usec): | 1.00th=[ 41], 5.00th=[ 59], 10.00th=[ 70], 20.00th=[ 105], | 30.00th=[ 19268], 40.00th=[ 25560], 50.00th=[ 33162], 60.00th=[ 42206], | 70.00th=[ 51119], 80.00th=[ 64750], 90.00th=[ 85459], 95.00th=[105382], | 99.00th=[185598], 99.50th=[270533], 99.90th=[375391], 99.95th=[375391], | 99.99th=[375391] bw ( KiB/s): min= 32, max= 416, per=24.98%, avg=196.34, stdev=83.28, samples=59 iops : min= 2, max= 26, avg=11.51, stdev= 5.22, samples=59 write: IOPS=13, BW=211KiB/s (216kB/s)(6368KiB/30235msec); 0 zone resets clat (usec): min=1505, max=227899, avg=38667.68, stdev=41673.67 lat (usec): min=1507, max=227901, avg=38672.22, stdev=41672.84 clat percentiles (usec): | 1.00th=[ 1598], 5.00th=[ 2024], 10.00th=[ 3523], 20.00th=[ 6063], | 30.00th=[ 8848], 40.00th=[ 15270], 50.00th=[ 24249], 60.00th=[ 32900], | 70.00th=[ 49021], 80.00th=[ 66847], 90.00th=[100140], 95.00th=[128451], | 99.00th=[185598], 99.50th=[221250], 99.90th=[227541], 99.95th=[227541], | 99.99th=[227541] bw ( KiB/s): min= 31, max= 475, per=25.55%, avg=211.27, stdev=98.09, samples=59 iops : min= 1, max= 29, avg=12.44, stdev= 6.17, samples=59 lat (usec) : 50=1.56%, 100=7.81%, 250=1.56%, 500=0.26%, 750=0.39% lat (msec) : 2=2.60%, 4=3.78%, 10=10.94%, 20=9.51%, 50=31.38% lat (msec) : 100=22.14%, 250=7.81%, 500=0.26% cpu : usr=0.12%, sys=5.94%, ctx=1438, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145798: Sat Aug 22 20:27:38 2026 read: IOPS=11, BW=189KiB/s (193kB/s)(5744KiB/30441msec) clat (usec): min=36, max=348308, avg=41481.27, stdev=40478.00 lat (usec): min=37, max=348309, avg=41483.19, stdev=40478.02 clat percentiles (usec): | 1.00th=[ 40], 5.00th=[ 59], 10.00th=[ 71], 20.00th=[ 141], | 30.00th=[ 19530], 40.00th=[ 28967], 50.00th=[ 35390], 60.00th=[ 45351], | 70.00th=[ 53740], 80.00th=[ 65274], 90.00th=[ 88605], 95.00th=[119014], | 99.00th=[183501], 99.50th=[227541], 99.90th=[350225], 99.95th=[350225], | 99.99th=[350225] bw ( KiB/s): min= 31, max= 404, per=24.73%, avg=194.37, stdev=89.74, samples=57 iops : min= 1, max= 25, avg=11.37, stdev= 5.69, samples=57 write: IOPS=13, BW=215KiB/s (220kB/s)(6544KiB/30441msec); 0 zone resets clat (usec): min=1528, max=386706, avg=37861.31, stdev=49911.54 lat (usec): min=1531, max=386707, avg=37864.09, stdev=49911.95 clat percentiles (usec): | 1.00th=[ 1565], 5.00th=[ 1713], 10.00th=[ 2180], 20.00th=[ 4047], | 30.00th=[ 6915], 40.00th=[ 10552], 50.00th=[ 17695], 60.00th=[ 27395], | 70.00th=[ 46400], 80.00th=[ 64750], 90.00th=[ 94897], 95.00th=[128451], | 99.00th=[254804], 99.50th=[267387], 99.90th=[387974], 99.95th=[387974], | 99.99th=[387974] bw ( KiB/s): min= 31, max= 411, per=25.64%, avg=212.03, stdev=98.11, samples=59 iops : min= 1, max= 25, avg=12.51, stdev= 6.13, samples=59 lat (usec) : 50=0.91%, 100=7.03%, 250=2.34%, 500=0.65%, 750=0.26% lat (usec) : 1000=0.13% lat (msec) : 2=5.21%, 4=5.86%, 10=10.29%, 20=9.90%, 50=25.78% lat (msec) : 100=23.70%, 250=7.16%, 500=0.78% cpu : usr=0.10%, sys=5.85%, ctx=1397, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145799: Sat Aug 22 20:27:38 2026 read: IOPS=13, BW=208KiB/s (213kB/s)(6256KiB/30012msec) clat (usec): min=36, max=199762, avg=41118.25, stdev=34006.36 lat (usec): min=36, max=199763, avg=41130.08, stdev=34011.01 clat percentiles (usec): | 1.00th=[ 48], 5.00th=[ 60], 10.00th=[ 70], 20.00th=[ 363], | 30.00th=[ 21365], 40.00th=[ 27657], 50.00th=[ 36963], 60.00th=[ 44303], | 70.00th=[ 54264], 80.00th=[ 66847], 90.00th=[ 90702], 95.00th=[100140], | 99.00th=[147850], 99.50th=[156238], 99.90th=[200279], 99.95th=[200279], | 99.99th=[200279] bw ( KiB/s): min= 31, max= 443, per=26.62%, avg=209.27, stdev=91.71, samples=59 iops : min= 1, max= 27, avg=12.32, stdev= 5.77, samples=59 write: IOPS=12, BW=201KiB/s (206kB/s)(6032KiB/30012msec); 0 zone resets clat (usec): min=1487, max=588866, avg=36846.20, stdev=49636.00 lat (usec): min=1489, max=588868, avg=36848.61, stdev=49636.02 clat percentiles (usec): | 1.00th=[ 1598], 5.00th=[ 1893], 10.00th=[ 2606], 20.00th=[ 5080], | 30.00th=[ 7767], 40.00th=[ 10945], 50.00th=[ 17695], 60.00th=[ 30278], | 70.00th=[ 44827], 80.00th=[ 67634], 90.00th=[ 88605], 95.00th=[114820], | 99.00th=[214959], 99.50th=[231736], 99.90th=[591397], 99.95th=[591397], | 99.99th=[591397] bw ( KiB/s): min= 31, max= 480, per=24.72%, avg=204.40, stdev=94.43, samples=58 iops : min= 1, max= 30, avg=12.02, stdev= 6.00, samples=58 lat (usec) : 50=0.65%, 100=8.46%, 250=0.78%, 500=0.39%, 1000=0.39% lat (msec) : 2=2.99%, 4=4.69%, 10=10.16%, 20=11.59%, 50=29.17% lat (msec) : 100=24.61%, 250=5.99%, 750=0.13% cpu : usr=0.10%, sys=6.04%, ctx=1446, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145800: Sat Aug 22 20:27:38 2026 read: IOPS=12, BW=201KiB/s (206kB/s)(6032KiB/29973msec) clat (usec): min=35, max=279283, avg=40735.11, stdev=39373.93 lat (usec): min=36, max=279284, avg=40736.31, stdev=39373.95 clat percentiles (usec): | 1.00th=[ 41], 5.00th=[ 57], 10.00th=[ 64], 20.00th=[ 96], | 30.00th=[ 16319], 40.00th=[ 26608], 50.00th=[ 33817], 60.00th=[ 44827], | 70.00th=[ 53216], 80.00th=[ 66847], 90.00th=[ 89654], 95.00th=[109577], | 99.00th=[173016], 99.50th=[250610], 99.90th=[278922], 99.95th=[278922], | 99.99th=[278922] bw ( KiB/s): min= 23, max= 384, per=25.58%, avg=201.07, stdev=88.09, samples=58 iops : min= 1, max= 24, avg=11.81, stdev= 5.55, samples=58 write: IOPS=13, BW=209KiB/s (214kB/s)(6256KiB/29973msec); 0 zone resets clat (usec): min=1393, max=312275, avg=37187.73, stdev=42822.16 lat (usec): min=1395, max=312279, avg=37190.69, stdev=42821.82 clat percentiles (usec): | 1.00th=[ 1598], 5.00th=[ 1991], 10.00th=[ 2999], 20.00th=[ 6063], | 30.00th=[ 8848], 40.00th=[ 12911], 50.00th=[ 21627], 60.00th=[ 33817], | 70.00th=[ 44827], 80.00th=[ 64750], 90.00th=[ 87557], 95.00th=[115868], | 99.00th=[219153], 99.50th=[229639], 99.90th=[312476], 99.95th=[312476], | 99.99th=[312476] bw ( KiB/s): min= 61, max= 416, per=25.32%, avg=209.41, stdev=92.97, samples=58 iops : min= 3, max= 26, avg=12.33, stdev= 5.87, samples=58 lat (usec) : 50=1.43%, 100=8.85%, 250=2.08%, 500=0.52%, 750=0.26% lat (usec) : 1000=0.13% lat (msec) : 2=2.60%, 4=4.43%, 10=10.55%, 20=9.24%, 50=29.30% lat (msec) : 100=23.44%, 250=6.77%, 500=0.39% cpu : usr=0.08%, sys=6.04%, ctx=1439, majf=0, minf=19 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=787KiB/s (806kB/s), 189KiB/s-208KiB/s (193kB/s-213kB/s), io=23.4MiB (24.5MB), run=29973-30441msec WRITE: bw=828KiB/s (848kB/s), 201KiB/s-215KiB/s (206kB/s-220kB/s), io=24.6MiB (25.8MB), run=29973-30441msec rand-rw: (groupid=0, jobs=1): err= 0: pid=145792: Sat Aug 22 20:28:32 2026 read: IOPS=4, BW=69.2KiB/s (70.8kB/s)(5920KiB/85598msec) clat (msec): min=7, max=485, avg=43.81, stdev=40.31 lat (msec): min=7, max=485, avg=43.82, stdev=40.31 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 13], 10.00th=[ 16], 20.00th=[ 20], | 30.00th=[ 24], 40.00th=[ 28], 50.00th=[ 32], 60.00th=[ 38], | 70.00th=[ 44], 80.00th=[ 55], 90.00th=[ 95], 95.00th=[ 115], | 99.00th=[ 169], 99.50th=[ 218], 99.90th=[ 485], 99.95th=[ 485], | 99.99th=[ 485] bw ( KiB/s): min= 30, max= 380, per=29.49%, avg=82.28, stdev=52.97, samples=141 iops : min= 1, max= 23, avg= 4.38, stdev= 3.35, samples=141 write: IOPS=4, BW=74.4KiB/s (76.2kB/s)(6368KiB/85598msec); 0 zone resets clat (msec): min=42, max=734, avg=173.93, stdev=84.96 lat (msec): min=42, max=734, avg=173.94, stdev=84.97 clat percentiles (msec): | 1.00th=[ 63], 5.00th=[ 80], 10.00th=[ 92], 20.00th=[ 107], | 30.00th=[ 120], 40.00th=[ 144], 50.00th=[ 159], 60.00th=[ 176], | 70.00th=[ 201], 80.00th=[ 228], 90.00th=[ 271], 95.00th=[ 330], | 99.00th=[ 510], 99.50th=[ 642], 99.90th=[ 735], 99.95th=[ 735], | 99.99th=[ 735] bw ( KiB/s): min= 30, max= 158, per=25.66%, avg=75.44, stdev=31.24, samples=165 iops : min= 1, max= 9, avg= 3.94, stdev= 2.01, samples=165 lat (msec) : 10=0.65%, 20=9.24%, 50=27.34%, 100=14.71%, 250=40.62% lat (msec) : 500=6.90%, 750=0.52% cpu : usr=0.04%, sys=1.23%, ctx=1348, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145793: Sat Aug 22 20:28:32 2026 read: IOPS=4, BW=67.5KiB/s (69.1kB/s)(5744KiB/85127msec) clat (msec): min=9, max=484, avg=45.64, stdev=41.53 lat (msec): min=9, max=484, avg=45.64, stdev=41.52 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 13], 10.00th=[ 16], 20.00th=[ 21], | 30.00th=[ 24], 40.00th=[ 29], 50.00th=[ 34], 60.00th=[ 40], | 70.00th=[ 50], 80.00th=[ 62], 90.00th=[ 94], 95.00th=[ 115], | 99.00th=[ 199], 99.50th=[ 228], 99.90th=[ 485], 99.95th=[ 485], | 99.99th=[ 485] bw ( KiB/s): min= 29, max= 250, per=30.21%, avg=84.28, stdev=48.10, samples=134 iops : min= 1, max= 15, avg= 4.50, stdev= 3.03, samples=134 write: IOPS=4, BW=76.9KiB/s (78.7kB/s)(6544KiB/85127msec); 0 zone resets clat (msec): min=46, max=462, avg=167.88, stdev=75.36 lat (msec): min=46, max=462, avg=167.88, stdev=75.36 clat percentiles (msec): | 1.00th=[ 55], 5.00th=[ 74], 10.00th=[ 88], 20.00th=[ 110], | 30.00th=[ 125], 40.00th=[ 136], 50.00th=[ 150], 60.00th=[ 167], | 70.00th=[ 192], 80.00th=[ 224], 90.00th=[ 271], 95.00th=[ 321], | 99.00th=[ 405], 99.50th=[ 430], 99.90th=[ 464], 99.95th=[ 464], | 99.99th=[ 464] bw ( KiB/s): min= 30, max= 223, per=26.29%, avg=77.28, stdev=35.66, samples=166 iops : min= 1, max= 13, avg= 4.05, stdev= 2.28, samples=166 lat (msec) : 10=0.65%, 20=8.46%, 50=23.83%, 100=18.10%, 250=41.93% lat (msec) : 500=7.03% cpu : usr=0.04%, sys=1.22%, ctx=1261, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145794: Sat Aug 22 20:28:32 2026 read: IOPS=4, BW=76.2KiB/s (78.0kB/s)(6256KiB/82112msec) clat (msec): min=8, max=324, avg=46.01, stdev=40.48 lat (msec): min=8, max=324, avg=46.02, stdev=40.48 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 14], 10.00th=[ 17], 20.00th=[ 20], | 30.00th=[ 24], 40.00th=[ 29], 50.00th=[ 34], 60.00th=[ 39], | 70.00th=[ 47], 80.00th=[ 62], 90.00th=[ 96], 95.00th=[ 134], | 99.00th=[ 211], 99.50th=[ 266], 99.90th=[ 326], 99.95th=[ 326], | 99.99th=[ 326] bw ( KiB/s): min= 30, max= 287, per=31.80%, avg=88.73, stdev=59.93, samples=139 iops : min= 1, max= 17, avg= 4.74, stdev= 3.78, samples=139 write: IOPS=4, BW=73.5KiB/s (75.2kB/s)(6032KiB/82112msec); 0 zone resets clat (msec): min=42, max=641, avg=169.69, stdev=76.92 lat (msec): min=42, max=641, avg=169.69, stdev=76.92 clat percentiles (msec): | 1.00th=[ 56], 5.00th=[ 74], 10.00th=[ 86], 20.00th=[ 106], | 30.00th=[ 122], 40.00th=[ 140], 50.00th=[ 157], 60.00th=[ 174], | 70.00th=[ 199], 80.00th=[ 228], 90.00th=[ 271], 95.00th=[ 326], | 99.00th=[ 422], 99.50th=[ 456], 99.90th=[ 642], 99.95th=[ 642], | 99.99th=[ 642] bw ( KiB/s): min= 30, max= 190, per=25.42%, avg=74.75, stdev=32.80, samples=158 iops : min= 1, max= 11, avg= 3.88, stdev= 2.05, samples=158 lat (msec) : 10=0.65%, 20=10.03%, 50=26.17%, 100=17.32%, 250=38.93% lat (msec) : 500=6.77%, 750=0.13% cpu : usr=0.06%, sys=1.36%, ctx=1375, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145795: Sat Aug 22 20:28:32 2026 read: IOPS=4, BW=70.7KiB/s (72.4kB/s)(6032KiB/85367msec) clat (msec): min=7, max=312, avg=44.59, stdev=40.31 lat (msec): min=7, max=312, avg=44.59, stdev=40.31 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 13], 10.00th=[ 17], 20.00th=[ 20], | 30.00th=[ 23], 40.00th=[ 27], 50.00th=[ 32], 60.00th=[ 37], | 70.00th=[ 46], 80.00th=[ 60], 90.00th=[ 94], 95.00th=[ 128], | 99.00th=[ 243], 99.50th=[ 255], 99.90th=[ 313], 99.95th=[ 313], | 99.99th=[ 313] bw ( KiB/s): min= 30, max= 252, per=30.39%, avg=84.79, stdev=52.31, samples=138 iops : min= 1, max= 15, avg= 4.53, stdev= 3.32, samples=138 write: IOPS=4, BW=73.3KiB/s (75.0kB/s)(6256KiB/85367msec); 0 zone resets clat (msec): min=47, max=519, avg=174.92, stdev=79.22 lat (msec): min=47, max=519, avg=174.92, stdev=79.22 clat percentiles (msec): | 1.00th=[ 61], 5.00th=[ 81], 10.00th=[ 93], 20.00th=[ 108], | 30.00th=[ 123], 40.00th=[ 140], 50.00th=[ 161], 60.00th=[ 188], | 70.00th=[ 205], 80.00th=[ 234], 90.00th=[ 275], 95.00th=[ 321], | 99.00th=[ 435], 99.50th=[ 510], 99.90th=[ 518], 99.95th=[ 518], | 99.99th=[ 518] bw ( KiB/s): min= 30, max= 191, per=25.07%, avg=73.70, stdev=33.68, samples=166 iops : min= 1, max= 11, avg= 3.82, stdev= 2.17, samples=166 lat (msec) : 10=0.65%, 20=9.38%, 50=26.17%, 100=16.15%, 250=39.84% lat (msec) : 500=7.42%, 750=0.39% cpu : usr=0.03%, sys=1.17%, ctx=1348, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=280KiB/s (287kB/s), 67.5KiB/s-76.2KiB/s (69.1kB/s-78.0kB/s), io=23.4MiB (24.5MB), run=82112-85598msec WRITE: bw=294KiB/s (301kB/s), 73.3KiB/s-76.9KiB/s (75.0kB/s-78.7kB/s), io=24.6MiB (25.8MB), run=82112-85598msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=145819: Sat Aug 22 20:28:52 2026 read: IOPS=0, BW=851KiB/s (872kB/s)(7168KiB/8419msec) clat (msec): min=157, max=538, avg=250.99, stdev=134.78 lat (msec): min=157, max=538, avg=250.99, stdev=134.78 clat percentiles (msec): | 1.00th=[ 159], 5.00th=[ 159], 10.00th=[ 159], 20.00th=[ 165], | 30.00th=[ 197], 40.00th=[ 197], 50.00th=[ 197], 60.00th=[ 209], | 70.00th=[ 209], 80.00th=[ 296], 90.00th=[ 542], 95.00th=[ 542], | 99.00th=[ 542], 99.50th=[ 542], 99.90th=[ 542], 99.95th=[ 542], | 99.99th=[ 542] bw ( KiB/s): min= 2027, max= 4112, per=100.00%, avg=2551.25, stdev=1040.52, samples=4 iops : min= 1, max= 4, avg= 1.75, stdev= 1.50, samples=4 write: IOPS=0, BW=608KiB/s (623kB/s)(5120KiB/8419msec); 0 zone resets clat (msec): min=248, max=4621, avg=1325.64, stdev=1856.13 lat (msec): min=248, max=4621, avg=1325.75, stdev=1856.12 clat percentiles (msec): | 1.00th=[ 249], 5.00th=[ 249], 10.00th=[ 249], 20.00th=[ 249], | 30.00th=[ 426], 40.00th=[ 426], 50.00th=[ 464], 60.00th=[ 464], | 70.00th=[ 869], 80.00th=[ 869], 90.00th=[ 4597], 95.00th=[ 4597], | 99.00th=[ 4597], 99.50th=[ 4597], 99.90th=[ 4597], 99.95th=[ 4597], | 99.99th=[ 4597] bw ( KiB/s): min= 2023, max= 4063, per=80.59%, avg=2541.00, stdev=1014.69, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (msec) : 250=50.00%, 500=25.00%, 750=8.33%, 1000=8.33%, >=2000=8.33% cpu : usr=0.02%, sys=2.04%, ctx=73, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145820: Sat Aug 22 20:28:52 2026 read: IOPS=0, BW=225KiB/s (231kB/s)(2048KiB/9093msec) clat (msec): min=140, max=257, avg=198.71, stdev=82.64 lat (msec): min=140, max=257, avg=198.71, stdev=82.64 clat percentiles (msec): | 1.00th=[ 140], 5.00th=[ 140], 10.00th=[ 140], 20.00th=[ 140], | 30.00th=[ 140], 40.00th=[ 140], 50.00th=[ 140], 60.00th=[ 257], | 70.00th=[ 257], 80.00th=[ 257], 90.00th=[ 257], 95.00th=[ 257], | 99.00th=[ 257], 99.50th=[ 257], 99.90th=[ 257], 99.95th=[ 257], | 99.99th=[ 257] bw ( KiB/s): min= 1440, max= 2031, per=77.06%, avg=1735.50, stdev=417.90, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1126KiB/s (1153kB/s)(10.0MiB/9093msec); 0 zone resets clat (msec): min=203, max=3373, avg=859.94, stdev=929.69 lat (msec): min=204, max=3373, avg=860.21, stdev=929.60 clat percentiles (msec): | 1.00th=[ 205], 5.00th=[ 205], 10.00th=[ 205], 20.00th=[ 279], | 30.00th=[ 317], 40.00th=[ 489], 50.00th=[ 667], 60.00th=[ 676], | 70.00th=[ 684], 80.00th=[ 701], 90.00th=[ 1217], 95.00th=[ 3373], | 99.00th=[ 3373], 99.50th=[ 3373], 99.90th=[ 3373], 99.95th=[ 3373], | 99.99th=[ 3373] bw ( KiB/s): min= 1440, max= 2043, per=61.54%, avg=1940.33, stdev=200.50, samples=9 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=9 lat (msec) : 250=16.67%, 500=33.33%, 750=33.33%, 2000=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=2.46%, ctx=88, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145821: Sat Aug 22 20:28:52 2026 read: IOPS=0, BW=754KiB/s (772kB/s)(6144KiB/8146msec) clat (msec): min=120, max=3029, avg=916.15, stdev=1087.95 lat (msec): min=120, max=3029, avg=916.15, stdev=1087.95 clat percentiles (msec): | 1.00th=[ 121], 5.00th=[ 121], 10.00th=[ 121], 20.00th=[ 241], | 30.00th=[ 241], 40.00th=[ 414], 50.00th=[ 414], 60.00th=[ 625], | 70.00th=[ 1070], 80.00th=[ 1070], 90.00th=[ 3037], 95.00th=[ 3037], | 99.00th=[ 3037], 99.50th=[ 3037], 99.90th=[ 3037], 99.95th=[ 3037], | 99.99th=[ 3037] bw ( KiB/s): min= 2015, max= 4055, per=100.00%, avg=2534.00, stdev=1014.05, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 write: IOPS=0, BW=754KiB/s (772kB/s)(6144KiB/8146msec); 0 zone resets clat (msec): min=295, max=776, avg=415.66, stdev=186.91 lat (msec): min=295, max=776, avg=415.75, stdev=186.88 clat percentiles (msec): | 1.00th=[ 296], 5.00th=[ 296], 10.00th=[ 296], 20.00th=[ 305], | 30.00th=[ 305], 40.00th=[ 313], 50.00th=[ 313], 60.00th=[ 342], | 70.00th=[ 464], 80.00th=[ 464], 90.00th=[ 776], 95.00th=[ 776], | 99.00th=[ 776], 99.50th=[ 776], 99.90th=[ 776], 99.95th=[ 776], | 99.99th=[ 776] bw ( KiB/s): min= 1406, max= 3637, per=70.64%, avg=2227.20, stdev=833.31, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 lat (msec) : 250=16.67%, 500=50.00%, 750=8.33%, 1000=8.33%, 2000=8.33% lat (msec) : >=2000=8.33% cpu : usr=0.00%, sys=1.45%, ctx=60, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145822: Sat Aug 22 20:28:52 2026 read: IOPS=1, BW=1215KiB/s (1244kB/s)(5120KiB/4215msec) clat (msec): min=90, max=401, avg=193.24, stdev=126.52 lat (msec): min=90, max=401, avg=193.24, stdev=126.52 clat percentiles (msec): | 1.00th=[ 91], 5.00th=[ 91], 10.00th=[ 91], 20.00th=[ 91], | 30.00th=[ 126], 40.00th=[ 126], 50.00th=[ 127], 60.00th=[ 127], | 70.00th=[ 224], 80.00th=[ 224], 90.00th=[ 401], 95.00th=[ 401], | 99.00th=[ 401], 99.50th=[ 401], 99.90th=[ 401], 99.95th=[ 401], | 99.99th=[ 401] bw ( KiB/s): min= 2027, max= 4047, per=100.00%, avg=2701.67, stdev=1165.09, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 write: IOPS=1, BW=1701KiB/s (1741kB/s)(7168KiB/4215msec); 0 zone resets clat (msec): min=284, max=1027, avg=442.82, stdev=275.75 lat (msec): min=284, max=1027, avg=443.02, stdev=275.94 clat percentiles (msec): | 1.00th=[ 284], 5.00th=[ 284], 10.00th=[ 284], 20.00th=[ 292], | 30.00th=[ 309], 40.00th=[ 309], 50.00th=[ 309], 60.00th=[ 321], | 70.00th=[ 321], 80.00th=[ 567], 90.00th=[ 1028], 95.00th=[ 1028], | 99.00th=[ 1028], 99.50th=[ 1028], 99.90th=[ 1028], 99.95th=[ 1028], | 99.99th=[ 1028] bw ( KiB/s): min= 1350, max= 2039, per=59.69%, avg=1882.00, stdev=274.23, samples=6 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=6 lat (msec) : 100=8.33%, 250=25.00%, 500=50.00%, 750=8.33%, 2000=8.33% cpu : usr=0.05%, sys=3.46%, ctx=81, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2252KiB/s (2306kB/s), 225KiB/s-1215KiB/s (231kB/s-1244kB/s), io=20.0MiB (20.0MB), run=4215-9093msec WRITE: bw=3153KiB/s (3229kB/s), 608KiB/s-1701KiB/s (623kB/s-1741kB/s), io=28.0MiB (29.4MB), run=4215-9093msec rand-rw: (groupid=0, jobs=1): err= 0: pid=145825: Sat Aug 22 20:28:52 2026 read: IOPS=0, BW=876KiB/s (897kB/s)(7168KiB/8183msec) clat (msec): min=2, max=424, avg=258.88, stdev=131.28 lat (msec): min=2, max=424, avg=258.88, stdev=131.28 clat percentiles (msec): | 1.00th=[ 3], 5.00th=[ 3], 10.00th=[ 3], 20.00th=[ 215], | 30.00th=[ 255], 40.00th=[ 255], 50.00th=[ 279], 60.00th=[ 296], | 70.00th=[ 296], 80.00th=[ 342], 90.00th=[ 426], 95.00th=[ 426], | 99.00th=[ 426], 99.50th=[ 426], 99.90th=[ 426], 99.95th=[ 426], | 99.99th=[ 426] bw ( KiB/s): min= 1424, max= 3976, per=100.00%, avg=2821.75, stdev=1292.32, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 1.15, samples=4 write: IOPS=0, BW=626KiB/s (641kB/s)(5120KiB/8183msec); 0 zone resets clat (msec): min=341, max=4441, avg=1273.46, stdev=1775.41 lat (msec): min=342, max=4441, avg=1273.57, stdev=1775.39 clat percentiles (msec): | 1.00th=[ 342], 5.00th=[ 342], 10.00th=[ 342], 20.00th=[ 342], | 30.00th=[ 388], 40.00th=[ 388], 50.00th=[ 531], 60.00th=[ 531], | 70.00th=[ 667], 80.00th=[ 667], 90.00th=[ 4463], 95.00th=[ 4463], | 99.00th=[ 4463], 99.50th=[ 4463], 99.90th=[ 4463], 99.95th=[ 4463], | 99.99th=[ 4463] bw ( KiB/s): min= 2019, max= 3757, per=77.63%, avg=2603.67, stdev=998.85, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (msec) : 4=8.33%, 250=8.33%, 500=58.33%, 750=16.67%, >=2000=8.33% cpu : usr=0.00%, sys=6.21%, ctx=261, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145826: Sat Aug 22 20:28:52 2026 read: IOPS=0, BW=240KiB/s (245kB/s)(2048KiB/8547msec) clat (msec): min=287, max=453, avg=370.50, stdev=117.15 lat (msec): min=287, max=453, avg=370.50, stdev=117.15 clat percentiles (msec): | 1.00th=[ 288], 5.00th=[ 288], 10.00th=[ 288], 20.00th=[ 288], | 30.00th=[ 288], 40.00th=[ 288], 50.00th=[ 288], 60.00th=[ 456], | 70.00th=[ 456], 80.00th=[ 456], 90.00th=[ 456], 95.00th=[ 456], | 99.00th=[ 456], 99.50th=[ 456], 99.90th=[ 456], 99.95th=[ 456], | 99.99th=[ 456] bw ( KiB/s): min= 1560, max= 1878, per=71.74%, avg=1719.00, stdev=224.86, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1198KiB/s (1227kB/s)(10.0MiB/8547msec); 0 zone resets clat (msec): min=145, max=3366, avg=779.45, stdev=965.62 lat (msec): min=145, max=3370, avg=779.99, stdev=966.89 clat percentiles (msec): | 1.00th=[ 146], 5.00th=[ 146], 10.00th=[ 146], 20.00th=[ 213], | 30.00th=[ 213], 40.00th=[ 372], 50.00th=[ 418], 60.00th=[ 435], | 70.00th=[ 567], 80.00th=[ 860], 90.00th=[ 1217], 95.00th=[ 3373], | 99.00th=[ 3373], 99.50th=[ 3373], 99.90th=[ 3373], 99.95th=[ 3373], | 99.99th=[ 3373] bw ( KiB/s): min= 1910, max= 5965, per=89.15%, avg=2990.00, stdev=1681.92, samples=6 iops : min= 1, max= 5, avg= 2.00, stdev= 1.67, samples=6 lat (msec) : 250=25.00%, 500=41.67%, 750=8.33%, 1000=8.33%, 2000=8.33% lat (msec) : >=2000=8.33% cpu : usr=0.01%, sys=7.66%, ctx=173, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145827: Sat Aug 22 20:28:52 2026 read: IOPS=0, BW=770KiB/s (789kB/s)(6144KiB/7976msec) clat (usec): min=594, max=3948.8k, avg=911966.43, stdev=1498830.31 lat (usec): min=596, max=3948.8k, avg=911968.09, stdev=1498830.15 clat percentiles (usec): | 1.00th=[ 594], 5.00th=[ 594], 10.00th=[ 594], | 20.00th=[ 244319], 30.00th=[ 244319], 40.00th=[ 354419], | 50.00th=[ 354419], 60.00th=[ 371196], 70.00th=[ 557843], | 80.00th=[ 557843], 90.00th=[3942646], 95.00th=[3942646], | 99.00th=[3942646], 99.50th=[3942646], 99.90th=[3942646], | 99.95th=[3942646], 99.99th=[3942646] bw ( KiB/s): min= 1932, max= 2035, per=83.94%, avg=2011.20, stdev=44.54, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 write: IOPS=0, BW=770KiB/s (789kB/s)(6144KiB/7976msec); 0 zone resets clat (msec): min=123, max=1031, avg=411.54, stdev=336.51 lat (msec): min=124, max=1031, avg=411.62, stdev=336.52 clat percentiles (msec): | 1.00th=[ 125], 5.00th=[ 125], 10.00th=[ 125], 20.00th=[ 163], | 30.00th=[ 163], 40.00th=[ 305], 50.00th=[ 305], 60.00th=[ 309], | 70.00th=[ 542], 80.00th=[ 542], 90.00th=[ 1028], 95.00th=[ 1028], | 99.00th=[ 1028], 99.50th=[ 1028], 99.90th=[ 1028], 99.95th=[ 1028], | 99.99th=[ 1028] bw ( KiB/s): min= 1878, max= 4071, per=81.04%, avg=2718.00, stdev=1009.85, samples=4 iops : min= 1, max= 3, avg= 1.75, stdev= 0.96, samples=4 lat (usec) : 750=8.33% lat (msec) : 250=25.00%, 500=33.33%, 750=16.67%, 2000=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=6.97%, ctx=592, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145828: Sat Aug 22 20:28:52 2026 read: IOPS=1, BW=1173KiB/s (1201kB/s)(5120KiB/4365msec) clat (usec): min=648, max=493765, avg=144041.73, stdev=217324.09 lat (usec): min=650, max=493767, avg=144043.14, stdev=217324.20 clat percentiles (usec): | 1.00th=[ 652], 5.00th=[ 652], 10.00th=[ 652], 20.00th=[ 652], | 30.00th=[ 1037], 40.00th=[ 1037], 50.00th=[ 3752], 60.00th=[ 3752], | 70.00th=[221250], 80.00th=[221250], 90.00th=[492831], 95.00th=[492831], | 99.00th=[492831], 99.50th=[492831], 99.90th=[492831], 99.95th=[492831], | 99.99th=[492831] bw ( KiB/s): min= 1878, max= 6071, per=100.00%, avg=3974.50, stdev=2964.90, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 write: IOPS=1, BW=1642KiB/s (1682kB/s)(7168KiB/4365msec); 0 zone resets clat (msec): min=100, max=1012, avg=519.87, stdev=370.08 lat (msec): min=100, max=1013, avg=520.11, stdev=370.23 clat percentiles (msec): | 1.00th=[ 101], 5.00th=[ 101], 10.00th=[ 101], 20.00th=[ 228], | 30.00th=[ 268], 40.00th=[ 268], 50.00th=[ 388], 60.00th=[ 659], | 70.00th=[ 659], 80.00th=[ 986], 90.00th=[ 1011], 95.00th=[ 1011], | 99.00th=[ 1011], 99.50th=[ 1011], 99.90th=[ 1011], 99.95th=[ 1011], | 99.99th=[ 1011] bw ( KiB/s): min= 1535, max= 3820, per=67.30%, avg=2257.40, stdev=896.36, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 lat (usec) : 750=8.33% lat (msec) : 2=8.33%, 4=8.33%, 250=25.00%, 500=25.00%, 750=8.33% lat (msec) : 1000=8.33%, 2000=8.33% cpu : usr=0.00%, sys=10.63%, ctx=101, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2396KiB/s (2454kB/s), 240KiB/s-1173KiB/s (245kB/s-1201kB/s), io=20.0MiB (20.0MB), run=4365-8547msec WRITE: bw=3355KiB/s (3435kB/s), 626KiB/s-1642KiB/s (641kB/s-1682kB/s), io=28.0MiB (29.4MB), run=4365-8547msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=145835: Sat Aug 22 20:29:07 2026 read: IOPS=0, BW=3827KiB/s (3919kB/s)(12.0MiB/3211msec) clat (msec): min=786, max=1433, avg=1023.38, stdev=356.95 lat (msec): min=786, max=1433, avg=1023.38, stdev=356.95 clat percentiles (msec): | 1.00th=[ 785], 5.00th=[ 785], 10.00th=[ 785], 20.00th=[ 785], | 30.00th=[ 785], 40.00th=[ 852], 50.00th=[ 852], 60.00th=[ 852], | 70.00th=[ 1435], 80.00th=[ 1435], 90.00th=[ 1435], 95.00th=[ 1435], | 99.00th=[ 1435], 99.50th=[ 1435], 99.90th=[ 1435], 99.95th=[ 1435], | 99.99th=[ 1435] bw ( KiB/s): min= 7907, max= 8192, per=100.00%, avg=8049.50, stdev=201.53, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 1000=66.67%, 2000=33.33% cpu : usr=0.00%, sys=13.15%, ctx=212, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145836: Sat Aug 22 20:29:07 2026 read: IOPS=0, BW=1217KiB/s (1246kB/s)(4096KiB/3366msec) clat (nsec): min=1439.7M, max=1439.7M, avg=1439699004.00, stdev= 0.00 lat (nsec): min=1439.7M, max=1439.7M, avg=1439701188.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1435], 5.00th=[ 1435], 10.00th=[ 1435], 20.00th=[ 1435], | 30.00th=[ 1435], 40.00th=[ 1435], 50.00th=[ 1435], 60.00th=[ 1435], | 70.00th=[ 1435], 80.00th=[ 1435], 90.00th=[ 1435], 95.00th=[ 1435], | 99.00th=[ 1435], 99.50th=[ 1435], 99.90th=[ 1435], 99.95th=[ 1435], | 99.99th=[ 1435] bw ( KiB/s): min= 7907, max= 7907, per=100.00%, avg=7907.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2434KiB/s (2492kB/s)(8192KiB/3366msec); 0 zone resets clat (msec): min=402, max=1326, avg=864.21, stdev=653.27 lat (msec): min=402, max=1326, avg=864.66, stdev=653.41 clat percentiles (msec): | 1.00th=[ 401], 5.00th=[ 401], 10.00th=[ 401], 20.00th=[ 401], | 30.00th=[ 401], 40.00th=[ 401], 50.00th=[ 401], 60.00th=[ 1334], | 70.00th=[ 1334], 80.00th=[ 1334], 90.00th=[ 1334], 95.00th=[ 1334], | 99.00th=[ 1334], 99.50th=[ 1334], 99.90th=[ 1334], 99.95th=[ 1334], | 99.99th=[ 1334] bw ( KiB/s): min= 8175, max= 8175, per=89.49%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.09%, sys=5.41%, ctx=141, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145837: Sat Aug 22 20:29:07 2026 write: IOPS=0, BW=3426KiB/s (3508kB/s)(12.0MiB/3587msec); 0 zone resets clat (msec): min=843, max=1761, avg=1161.84, stdev=519.77 lat (msec): min=843, max=1762, avg=1162.24, stdev=519.85 clat percentiles (msec): | 1.00th=[ 844], 5.00th=[ 844], 10.00th=[ 844], 20.00th=[ 844], | 30.00th=[ 844], 40.00th=[ 877], 50.00th=[ 877], 60.00th=[ 877], | 70.00th=[ 1770], 80.00th=[ 1770], 90.00th=[ 1770], 95.00th=[ 1770], | 99.00th=[ 1770], 99.50th=[ 1770], 99.90th=[ 1770], 99.95th=[ 1770], | 99.99th=[ 1770] bw ( KiB/s): min= 7984, max= 8175, per=88.45%, avg=8079.50, stdev=135.06, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=66.67%, 2000=33.33% cpu : usr=0.00%, sys=5.80%, ctx=91, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145838: Sat Aug 22 20:29:07 2026 write: IOPS=0, BW=4043KiB/s (4140kB/s)(12.0MiB/3039msec); 0 zone resets clat (msec): min=350, max=2018, avg=957.68, stdev=922.21 lat (msec): min=351, max=2023, avg=960.34, stdev=924.38 clat percentiles (msec): | 1.00th=[ 351], 5.00th=[ 351], 10.00th=[ 351], 20.00th=[ 351], | 30.00th=[ 351], 40.00th=[ 506], 50.00th=[ 506], 60.00th=[ 506], | 70.00th=[ 2022], 80.00th=[ 2022], 90.00th=[ 2022], 95.00th=[ 2022], | 99.00th=[ 2022], 99.50th=[ 2022], 99.90th=[ 2022], 99.95th=[ 2022], | 99.99th=[ 2022] bw ( KiB/s): min= 6282, max= 8175, per=79.13%, avg=7228.50, stdev=1338.55, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 750=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=4.44%, ctx=72, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4867KiB/s (4984kB/s), 1217KiB/s-3827KiB/s (1246kB/s-3919kB/s), io=16.0MiB (16.8MB), run=3211-3366msec WRITE: bw=9135KiB/s (9354kB/s), 2434KiB/s-4043KiB/s (2492kB/s-4140kB/s), io=32.0MiB (33.6MB), run=3039-3587msec rand-rw: (groupid=0, jobs=1): err= 0: pid=145840: Sat Aug 22 20:29:07 2026 read: IOPS=0, BW=3186KiB/s (3262kB/s)(12.0MiB/3857msec) clat (msec): min=536, max=1788, avg=1268.12, stdev=652.03 lat (msec): min=536, max=1788, avg=1268.13, stdev=652.04 clat percentiles (msec): | 1.00th=[ 535], 5.00th=[ 535], 10.00th=[ 535], 20.00th=[ 535], | 30.00th=[ 535], 40.00th=[ 1485], 50.00th=[ 1485], 60.00th=[ 1485], | 70.00th=[ 1787], 80.00th=[ 1787], 90.00th=[ 1787], 95.00th=[ 1787], | 99.00th=[ 1787], 99.50th=[ 1787], 99.90th=[ 1787], 99.95th=[ 1787], | 99.99th=[ 1787] bw ( KiB/s): min= 8015, max= 8175, per=100.00%, avg=8095.00, stdev=113.14, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 2000=66.67% cpu : usr=0.00%, sys=2.83%, ctx=36, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145841: Sat Aug 22 20:29:07 2026 read: IOPS=0, BW=1121KiB/s (1148kB/s)(4096KiB/3654msec) clat (nsec): min=1703.0M, max=1703.0M, avg=1703009624.00, stdev= 0.00 lat (nsec): min=1703.0M, max=1703.0M, avg=1703012973.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1703], 5.00th=[ 1703], 10.00th=[ 1703], 20.00th=[ 1703], | 30.00th=[ 1703], 40.00th=[ 1703], 50.00th=[ 1703], 60.00th=[ 1703], | 70.00th=[ 1703], 80.00th=[ 1703], 90.00th=[ 1703], 95.00th=[ 1703], | 99.00th=[ 1703], 99.50th=[ 1703], 99.90th=[ 1703], 99.95th=[ 1703], | 99.99th=[ 1703] bw ( KiB/s): min= 8192, max= 8192, per=100.00%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2242KiB/s (2296kB/s)(8192KiB/3654msec); 0 zone resets clat (msec): min=387, max=1555, avg=971.77, stdev=825.90 lat (msec): min=388, max=1558, avg=973.28, stdev=826.93 clat percentiles (msec): | 1.00th=[ 388], 5.00th=[ 388], 10.00th=[ 388], 20.00th=[ 388], | 30.00th=[ 388], 40.00th=[ 388], 50.00th=[ 388], 60.00th=[ 1552], | 70.00th=[ 1552], 80.00th=[ 1552], 90.00th=[ 1552], 95.00th=[ 1552], | 99.00th=[ 1552], 99.50th=[ 1552], 99.90th=[ 1552], 99.95th=[ 1552], | 99.99th=[ 1552] bw ( KiB/s): min= 8047, max= 8047, per=91.63%, avg=8047.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.00%, sys=3.15%, ctx=65, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145842: Sat Aug 22 20:29:07 2026 write: IOPS=0, BW=3293KiB/s (3373kB/s)(12.0MiB/3731msec); 0 zone resets clat (msec): min=759, max=1468, avg=1216.98, stdev=396.92 lat (msec): min=759, max=1469, avg=1217.66, stdev=397.35 clat percentiles (msec): | 1.00th=[ 760], 5.00th=[ 760], 10.00th=[ 760], 20.00th=[ 760], | 30.00th=[ 760], 40.00th=[ 1418], 50.00th=[ 1418], 60.00th=[ 1418], | 70.00th=[ 1469], 80.00th=[ 1469], 90.00th=[ 1469], 95.00th=[ 1469], | 99.00th=[ 1469], 99.50th=[ 1469], 99.90th=[ 1469], 99.95th=[ 1469], | 99.99th=[ 1469] bw ( KiB/s): min= 8047, max= 8078, per=91.81%, avg=8062.50, stdev=21.92, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=33.33%, 2000=66.67% cpu : usr=0.00%, sys=2.65%, ctx=47, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145843: Sat Aug 22 20:29:07 2026 write: IOPS=1, BW=4486KiB/s (4594kB/s)(12.0MiB/2739msec); 0 zone resets clat (msec): min=213, max=2207, avg=907.65, stdev=1126.65 lat (msec): min=214, max=2208, avg=908.49, stdev=1126.30 clat percentiles (msec): | 1.00th=[ 213], 5.00th=[ 213], 10.00th=[ 213], 20.00th=[ 213], | 30.00th=[ 213], 40.00th=[ 305], 50.00th=[ 305], 60.00th=[ 305], | 70.00th=[ 2198], 80.00th=[ 2198], 90.00th=[ 2198], 95.00th=[ 2198], | 99.00th=[ 2198], 99.50th=[ 2198], 99.90th=[ 2198], 99.95th=[ 2198], | 99.99th=[ 2198] bw ( KiB/s): min=12047, max=12047, per=100.00%, avg=12047.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 500=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=4.27%, ctx=39, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4248KiB/s (4350kB/s), 1121KiB/s-3186KiB/s (1148kB/s-3262kB/s), io=16.0MiB (16.8MB), run=3654-3857msec WRITE: bw=8783KiB/s (8993kB/s), 2242KiB/s-4486KiB/s (2296kB/s-4594kB/s), io=32.0MiB (33.6MB), run=2739-3731msec