== sanity test 398b: DIO and buffer IO race ============== 20:10:46 (1788567046) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 8.66483 s, 5.8 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=178567: Fri Sep 4 20:13:37 2026 read: IOPS=10, BW=41.3KiB/s (42.2kB/s)(5992KiB/145243msec) clat (usec): min=35, max=924242, avg=54833.84, stdev=42444.23 lat (usec): min=35, max=924244, avg=54835.52, stdev=42444.16 clat percentiles (usec): | 1.00th=[ 63], 5.00th=[ 11863], 10.00th=[ 19530], 20.00th=[ 27395], | 30.00th=[ 34341], 40.00th=[ 40633], 50.00th=[ 46924], 60.00th=[ 54789], | 70.00th=[ 63701], 80.00th=[ 77071], 90.00th=[ 96994], 95.00th=[121111], | 99.00th=[175113], 99.50th=[210764], 99.90th=[367002], 99.95th=[926942], | 99.99th=[926942] bw ( KiB/s): min= 7, max= 110, per=25.09%, avg=40.90, stdev=17.67, samples=284 iops : min= 1, max= 27, avg= 9.56, stdev= 4.46, samples=284 write: IOPS=10, BW=43.3KiB/s (44.4kB/s)(6296KiB/145243msec); 0 zone resets clat (usec): min=936, max=363458, avg=39943.84, stdev=41131.09 lat (usec): min=938, max=363461, avg=39946.32, stdev=41131.01 clat percentiles (usec): | 1.00th=[ 1139], 5.00th=[ 1303], 10.00th=[ 1614], 20.00th=[ 4424], | 30.00th=[ 9372], 40.00th=[ 19530], 50.00th=[ 29492], 60.00th=[ 39060], | 70.00th=[ 50594], 80.00th=[ 67634], 90.00th=[ 93848], 95.00th=[126354], | 99.00th=[185598], 99.50th=[206570], 99.90th=[233833], 99.95th=[362808], | 99.99th=[362808] bw ( KiB/s): min= 7, max= 119, per=25.34%, avg=43.08, stdev=22.81, samples=283 iops : min= 1, max= 29, avg=10.12, stdev= 5.75, samples=283 lat (usec) : 50=0.07%, 100=1.40%, 250=0.23%, 500=0.03%, 750=0.03% lat (usec) : 1000=0.07% lat (msec) : 2=6.28%, 4=3.39%, 10=6.25%, 20=8.24%, 50=36.10% lat (msec) : 100=29.04%, 250=8.72%, 500=0.13%, 1000=0.03% cpu : usr=0.08%, sys=4.35%, ctx=6629, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178568: Fri Sep 4 20:13:37 2026 read: IOPS=10, BW=41.0KiB/s (42.0kB/s)(5940KiB/141592msec) clat (usec): min=51, max=718183, avg=53927.84, stdev=38465.89 lat (usec): min=52, max=718184, avg=53931.01, stdev=38465.96 clat percentiles (usec): | 1.00th=[ 70], 5.00th=[ 15533], 10.00th=[ 20317], 20.00th=[ 26608], | 30.00th=[ 32900], 40.00th=[ 39060], 50.00th=[ 45876], 60.00th=[ 53216], | 70.00th=[ 63177], 80.00th=[ 76022], 90.00th=[ 99091], 95.00th=[119014], | 99.00th=[183501], 99.50th=[191890], 99.90th=[299893], 99.95th=[717226], | 99.99th=[717226] bw ( KiB/s): min= 7, max= 111, per=25.62%, avg=41.76, stdev=17.18, samples=276 iops : min= 1, max= 27, avg= 9.79, stdev= 4.34, samples=276 write: IOPS=11, BW=44.8KiB/s (45.9kB/s)(6348KiB/141592msec); 0 zone resets clat (usec): min=821, max=297278, avg=38603.20, stdev=39875.48 lat (usec): min=821, max=297279, avg=38608.75, stdev=39879.92 clat percentiles (usec): | 1.00th=[ 1090], 5.00th=[ 1319], 10.00th=[ 1565], 20.00th=[ 4146], | 30.00th=[ 9241], 40.00th=[ 19006], 50.00th=[ 27919], 60.00th=[ 37487], | 70.00th=[ 48497], 80.00th=[ 65799], 90.00th=[ 92799], 95.00th=[116917], | 99.00th=[177210], 99.50th=[208667], 99.90th=[265290], 99.95th=[295699], | 99.99th=[295699] bw ( KiB/s): min= 7, max= 126, per=26.13%, avg=44.43, stdev=22.20, samples=277 iops : min= 1, max= 31, avg=10.44, stdev= 5.60, samples=277 lat (usec) : 100=0.91%, 250=0.26%, 500=0.03%, 1000=0.16% lat (msec) : 2=6.12%, 4=4.00%, 10=5.83%, 20=8.50%, 50=37.47% lat (msec) : 100=27.90%, 250=8.63%, 500=0.16%, 750=0.03% cpu : usr=0.09%, sys=4.41%, ctx=6482, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178569: Fri Sep 4 20:13:37 2026 read: IOPS=10, BW=41.5KiB/s (42.5kB/s)(6028KiB/145406msec) clat (usec): min=47, max=322615, avg=53286.89, stdev=36265.22 lat (usec): min=47, max=322616, avg=53289.16, stdev=36265.01 clat percentiles (usec): | 1.00th=[ 63], 5.00th=[ 13566], 10.00th=[ 18482], 20.00th=[ 25822], | 30.00th=[ 32375], 40.00th=[ 38536], 50.00th=[ 44827], 60.00th=[ 53216], | 70.00th=[ 63177], 80.00th=[ 77071], 90.00th=[ 95945], 95.00th=[117965], | 99.00th=[179307], 99.50th=[208667], 99.90th=[312476], 99.95th=[320865], | 99.99th=[320865] bw ( KiB/s): min= 7, max= 127, per=25.39%, avg=41.39, stdev=18.94, samples=283 iops : min= 1, max= 31, avg= 9.69, stdev= 4.78, samples=283 write: IOPS=10, BW=43.1KiB/s (44.1kB/s)(6260KiB/145406msec); 0 zone resets clat (usec): min=862, max=715303, avg=41481.83, stdev=46424.59 lat (usec): min=863, max=715306, avg=41489.15, stdev=46421.25 clat percentiles (usec): | 1.00th=[ 1123], 5.00th=[ 1303], 10.00th=[ 1467], 20.00th=[ 3720], | 30.00th=[ 8094], 40.00th=[ 20055], 50.00th=[ 28705], 60.00th=[ 38536], | 70.00th=[ 52691], 80.00th=[ 72877], 90.00th=[100140], 95.00th=[127402], | 99.00th=[193987], 99.50th=[214959], 99.90th=[265290], 99.95th=[717226], | 99.99th=[717226] bw ( KiB/s): min= 7, max= 111, per=25.47%, avg=43.31, stdev=21.02, samples=281 iops : min= 1, max= 27, avg=10.17, stdev= 5.30, samples=281 lat (usec) : 50=0.03%, 100=1.43%, 250=0.13%, 500=0.13%, 750=0.03% lat (usec) : 1000=0.20% lat (msec) : 2=6.71%, 4=3.81%, 10=6.05%, 20=7.62%, 50=36.13% lat (msec) : 100=28.55%, 250=8.95%, 500=0.20%, 750=0.03% cpu : usr=0.09%, sys=4.40%, ctx=6567, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178570: Fri Sep 4 20:13:37 2026 read: IOPS=10, BW=41.1KiB/s (42.1kB/s)(6052KiB/147112msec) clat (usec): min=33, max=380807, avg=53671.20, stdev=38684.51 lat (usec): min=34, max=380809, avg=53681.59, stdev=38681.83 clat percentiles (usec): | 1.00th=[ 61], 5.00th=[ 11600], 10.00th=[ 18744], 20.00th=[ 25035], | 30.00th=[ 32637], 40.00th=[ 38536], 50.00th=[ 44827], 60.00th=[ 53216], | 70.00th=[ 62653], 80.00th=[ 76022], 90.00th=[ 99091], 95.00th=[119014], | 99.00th=[198181], 99.50th=[238027], 99.90th=[320865], 99.95th=[379585], | 99.99th=[379585] bw ( KiB/s): min= 7, max= 87, per=25.10%, avg=40.91, stdev=17.04, samples=286 iops : min= 1, max= 21, avg= 9.57, stdev= 4.30, samples=286 write: IOPS=10, BW=42.4KiB/s (43.4kB/s)(6236KiB/147112msec); 0 zone resets clat (usec): min=715, max=760416, avg=42086.19, stdev=47020.48 lat (usec): min=727, max=760419, avg=42088.66, stdev=47020.47 clat percentiles (usec): | 1.00th=[ 1156], 5.00th=[ 1319], 10.00th=[ 1696], 20.00th=[ 4293], | 30.00th=[ 10028], 40.00th=[ 20579], 50.00th=[ 30540], 60.00th=[ 40109], | 70.00th=[ 53740], 80.00th=[ 70779], 90.00th=[ 99091], 95.00th=[126354], | 99.00th=[193987], 99.50th=[212861], 99.90th=[383779], 99.95th=[759170], | 99.99th=[759170] bw ( KiB/s): min= 7, max= 135, per=24.78%, avg=42.13, stdev=20.77, samples=286 iops : min= 1, max= 33, avg= 9.87, stdev= 5.24, samples=286 lat (usec) : 50=0.13%, 100=1.56%, 250=0.16%, 500=0.10%, 750=0.07% lat (usec) : 1000=0.10% lat (msec) : 2=5.86%, 4=3.61%, 10=5.89%, 20=7.98%, 50=36.85% lat (msec) : 100=28.03%, 250=9.38%, 500=0.26%, 1000=0.03% cpu : usr=0.08%, sys=4.47%, ctx=6542, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=163KiB/s (167kB/s), 41.1KiB/s-41.0KiB/s (42.1kB/s-42.0kB/s), io=23.4MiB (24.6MB), run=141592-147112msec WRITE: bw=171KiB/s (175kB/s), 42.4KiB/s-44.8KiB/s (43.4kB/s-45.9kB/s), io=24.6MiB (25.7MB), run=141592-147112msec rand-rw: (groupid=0, jobs=1): err= 0: pid=178562: Fri Sep 4 20:14:14 2026 read: IOPS=8, BW=32.6KiB/s (33.3kB/s)(5992KiB/184010msec) clat (msec): min=4, max=1032, avg=47.95, stdev=51.92 lat (msec): min=4, max=1032, avg=47.95, stdev=51.92 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 13], 20.00th=[ 17], | 30.00th=[ 21], 40.00th=[ 26], 50.00th=[ 31], 60.00th=[ 39], | 70.00th=[ 49], 80.00th=[ 69], 90.00th=[ 112], 95.00th=[ 148], | 99.00th=[ 211], 99.50th=[ 271], 99.90th=[ 384], 99.95th=[ 1036], | 99.99th=[ 1036] bw ( KiB/s): min= 7, max= 159, per=25.84%, avg=33.33, stdev=25.27, samples=348 iops : min= 1, max= 39, avg= 7.65, stdev= 6.36, samples=348 write: IOPS=8, BW=34.2KiB/s (35.0kB/s)(6296KiB/184010msec); 0 zone resets clat (msec): min=11, max=439, avg=70.90, stdev=53.95 lat (msec): min=11, max=439, avg=70.91, stdev=53.96 clat percentiles (msec): | 1.00th=[ 15], 5.00th=[ 19], 10.00th=[ 24], 20.00th=[ 31], | 30.00th=[ 37], 40.00th=[ 44], 50.00th=[ 53], 60.00th=[ 66], | 70.00th=[ 84], 80.00th=[ 106], 90.00th=[ 142], 95.00th=[ 176], | 99.00th=[ 266], 99.50th=[ 309], 99.90th=[ 401], 99.95th=[ 439], | 99.99th=[ 439] bw ( KiB/s): min= 7, max= 143, per=25.19%, avg=34.00, stdev=23.69, samples=358 iops : min= 1, max= 35, avg= 7.82, stdev= 5.96, samples=358 lat (msec) : 10=2.51%, 20=15.07%, 50=41.28%, 100=24.02%, 250=16.18% lat (msec) : 500=0.91%, 2000=0.03% cpu : usr=0.06%, sys=1.64%, ctx=4745, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178563: Fri Sep 4 20:14:14 2026 read: IOPS=8, BW=32.1KiB/s (32.9kB/s)(5940KiB/185111msec) clat (msec): min=4, max=854, avg=48.36, stdev=49.06 lat (msec): min=4, max=854, avg=48.36, stdev=49.07 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 14], 20.00th=[ 18], | 30.00th=[ 22], 40.00th=[ 27], 50.00th=[ 32], 60.00th=[ 40], | 70.00th=[ 51], 80.00th=[ 72], 90.00th=[ 113], 95.00th=[ 144], | 99.00th=[ 207], 99.50th=[ 236], 99.90th=[ 384], 99.95th=[ 852], | 99.99th=[ 852] bw ( KiB/s): min= 7, max= 151, per=26.18%, avg=33.77, stdev=25.30, samples=340 iops : min= 1, max= 37, avg= 7.76, stdev= 6.37, samples=340 write: IOPS=8, BW=34.3KiB/s (35.1kB/s)(6348KiB/185111msec); 0 zone resets clat (msec): min=9, max=435, avg=71.04, stdev=52.29 lat (msec): min=9, max=435, avg=71.04, stdev=52.29 clat percentiles (msec): | 1.00th=[ 15], 5.00th=[ 21], 10.00th=[ 24], 20.00th=[ 31], | 30.00th=[ 37], 40.00th=[ 45], 50.00th=[ 54], 60.00th=[ 67], | 70.00th=[ 84], 80.00th=[ 107], 90.00th=[ 144], 95.00th=[ 174], | 99.00th=[ 247], 99.50th=[ 292], 99.90th=[ 405], 99.95th=[ 435], | 99.99th=[ 435] bw ( KiB/s): min= 7, max= 135, per=25.28%, avg=34.13, stdev=22.97, samples=359 iops : min= 1, max= 33, avg= 7.84, stdev= 5.77, samples=359 lat (msec) : 10=2.05%, 20=13.51%, 50=42.32%, 100=24.48%, 250=16.96% lat (msec) : 500=0.65%, 1000=0.03% cpu : usr=0.07%, sys=1.56%, ctx=4757, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178564: Fri Sep 4 20:14:14 2026 read: IOPS=8, BW=32.6KiB/s (33.4kB/s)(6028KiB/184987msec) clat (msec): min=5, max=465, avg=49.34, stdev=47.46 lat (msec): min=5, max=465, avg=49.35, stdev=47.46 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 19], | 30.00th=[ 22], 40.00th=[ 27], 50.00th=[ 33], 60.00th=[ 41], | 70.00th=[ 51], 80.00th=[ 69], 90.00th=[ 112], 95.00th=[ 150], | 99.00th=[ 222], 99.50th=[ 271], 99.90th=[ 359], 99.95th=[ 464], | 99.99th=[ 464] bw ( KiB/s): min= 7, max= 143, per=25.78%, avg=33.25, stdev=24.27, samples=351 iops : min= 1, max= 35, avg= 7.63, stdev= 6.09, samples=351 write: IOPS=8, BW=33.8KiB/s (34.7kB/s)(6260KiB/184987msec); 0 zone resets clat (msec): min=10, max=842, avg=70.31, stdev=59.17 lat (msec): min=10, max=842, avg=70.31, stdev=59.17 clat percentiles (msec): | 1.00th=[ 15], 5.00th=[ 20], 10.00th=[ 24], 20.00th=[ 30], | 30.00th=[ 35], 40.00th=[ 43], 50.00th=[ 51], 60.00th=[ 63], | 70.00th=[ 81], 80.00th=[ 105], 90.00th=[ 140], 95.00th=[ 176], | 99.00th=[ 275], 99.50th=[ 334], 99.90th=[ 558], 99.95th=[ 844], | 99.99th=[ 844] bw ( KiB/s): min= 7, max= 127, per=25.41%, avg=34.31, stdev=23.85, samples=353 iops : min= 1, max= 31, avg= 7.89, stdev= 6.00, samples=353 lat (msec) : 10=1.56%, 20=14.03%, 50=43.91%, 100=23.18%, 250=16.24% lat (msec) : 500=0.98%, 750=0.07%, 1000=0.03% cpu : usr=0.06%, sys=1.67%, ctx=4848, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178565: Fri Sep 4 20:14:14 2026 read: IOPS=8, BW=32.7KiB/s (33.5kB/s)(6052KiB/185056msec) clat (msec): min=5, max=468, avg=48.36, stdev=44.85 lat (msec): min=5, max=468, avg=48.37, stdev=44.85 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 14], 20.00th=[ 18], | 30.00th=[ 22], 40.00th=[ 27], 50.00th=[ 33], 60.00th=[ 41], | 70.00th=[ 54], 80.00th=[ 72], 90.00th=[ 106], 95.00th=[ 144], | 99.00th=[ 211], 99.50th=[ 257], 99.90th=[ 317], 99.95th=[ 468], | 99.99th=[ 468] bw ( KiB/s): min= 7, max= 135, per=26.09%, avg=33.66, stdev=24.60, samples=348 iops : min= 1, max= 33, avg= 7.73, stdev= 6.19, samples=348 write: IOPS=8, BW=33.7KiB/s (34.5kB/s)(6236KiB/185056msec); 0 zone resets clat (msec): min=10, max=854, avg=71.40, stdev=59.14 lat (msec): min=10, max=854, avg=71.40, stdev=59.14 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 20], 10.00th=[ 23], 20.00th=[ 30], | 30.00th=[ 36], 40.00th=[ 43], 50.00th=[ 53], 60.00th=[ 65], | 70.00th=[ 82], 80.00th=[ 106], 90.00th=[ 146], 95.00th=[ 188], | 99.00th=[ 264], 99.50th=[ 300], 99.90th=[ 510], 99.95th=[ 852], | 99.99th=[ 852] bw ( KiB/s): min= 7, max= 125, per=25.09%, avg=33.88, stdev=23.93, samples=356 iops : min= 1, max= 31, avg= 7.78, stdev= 6.02, samples=356 lat (msec) : 10=2.18%, 20=13.41%, 50=42.55%, 100=25.03%, 250=15.92% lat (msec) : 500=0.85%, 750=0.03%, 1000=0.03% cpu : usr=0.05%, sys=1.60%, ctx=4811, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=130KiB/s (133kB/s), 32.1KiB/s-32.7KiB/s (32.9kB/s-33.5kB/s), io=23.4MiB (24.6MB), run=184010-185111msec WRITE: bw=136KiB/s (139kB/s), 33.7KiB/s-34.3KiB/s (34.5kB/s-35.1kB/s), io=24.6MiB (25.7MB), run=184010-185111msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=178614: Fri Sep 4 20:15:13 2026 read: IOPS=8, BW=138KiB/s (141kB/s)(5920KiB/42852msec) clat (usec): min=54, max=285134, avg=61116.15, stdev=39334.07 lat (usec): min=54, max=285135, avg=61121.17, stdev=39335.10 clat percentiles (usec): | 1.00th=[ 62], 5.00th=[ 90], 10.00th=[ 22414], 20.00th=[ 30540], | 30.00th=[ 40633], 40.00th=[ 47973], 50.00th=[ 55313], 60.00th=[ 63177], | 70.00th=[ 72877], 80.00th=[ 86508], 90.00th=[105382], 95.00th=[128451], | 99.00th=[200279], 99.50th=[254804], 99.90th=[283116], 99.95th=[283116], | 99.99th=[283116] bw ( KiB/s): min= 31, max= 254, per=25.90%, avg=139.88, stdev=49.05, samples=83 iops : min= 1, max= 15, avg= 7.96, stdev= 3.10, samples=83 write: IOPS=9, BW=149KiB/s (152kB/s)(6368KiB/42852msec); 0 zone resets clat (usec): min=1540, max=407602, avg=50202.79, stdev=51476.18 lat (usec): min=1543, max=407606, avg=50221.73, stdev=51491.41 clat percentiles (usec): | 1.00th=[ 1713], 5.00th=[ 2057], 10.00th=[ 3654], 20.00th=[ 7635], | 30.00th=[ 15139], 40.00th=[ 25035], 50.00th=[ 35390], 60.00th=[ 46924], | 70.00th=[ 60031], 80.00th=[ 86508], 90.00th=[115868], 95.00th=[145753], | 99.00th=[238027], 99.50th=[270533], 99.90th=[408945], 99.95th=[408945], | 99.99th=[408945] bw ( KiB/s): min= 31, max= 382, per=26.43%, avg=150.10, stdev=72.33, samples=83 iops : min= 1, max= 23, avg= 8.61, stdev= 4.60, samples=83 lat (usec) : 100=2.47%, 250=0.65%, 1000=0.13% lat (msec) : 2=1.95%, 4=3.78%, 10=7.81%, 20=5.47%, 50=30.08% lat (msec) : 100=33.33%, 250=13.67%, 500=0.65% cpu : usr=0.07%, sys=4.53%, ctx=1798, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178615: Fri Sep 4 20:15:13 2026 read: IOPS=8, BW=137KiB/s (140kB/s)(5744KiB/42075msec) clat (usec): min=58, max=299020, avg=62869.26, stdev=40290.37 lat (usec): min=59, max=299021, avg=62878.28, stdev=40290.95 clat percentiles (usec): | 1.00th=[ 69], 5.00th=[ 90], 10.00th=[ 23462], 20.00th=[ 33817], | 30.00th=[ 39584], 40.00th=[ 49021], 50.00th=[ 57934], 60.00th=[ 65274], | 70.00th=[ 77071], 80.00th=[ 89654], 90.00th=[107480], 95.00th=[128451], | 99.00th=[183501], 99.50th=[283116], 99.90th=[299893], 99.95th=[299893], | 99.99th=[299893] bw ( KiB/s): min= 30, max= 314, per=25.24%, avg=136.29, stdev=54.55, samples=82 iops : min= 1, max= 19, avg= 7.73, stdev= 3.47, samples=82 write: IOPS=9, BW=156KiB/s (159kB/s)(6544KiB/42075msec); 0 zone resets clat (usec): min=1305, max=275932, avg=47439.45, stdev=43707.31 lat (usec): min=1308, max=275935, avg=47442.69, stdev=43707.15 clat percentiles (usec): | 1.00th=[ 1663], 5.00th=[ 2057], 10.00th=[ 5276], 20.00th=[ 9634], | 30.00th=[ 15401], 40.00th=[ 25822], 50.00th=[ 36963], 60.00th=[ 46924], | 70.00th=[ 59507], 80.00th=[ 78119], 90.00th=[109577], 95.00th=[133694], | 99.00th=[198181], 99.50th=[204473], 99.90th=[274727], 99.95th=[274727], | 99.99th=[274727] bw ( KiB/s): min= 31, max= 318, per=27.37%, avg=155.46, stdev=66.21, samples=82 iops : min= 1, max= 19, avg= 8.96, stdev= 4.23, samples=82 lat (usec) : 100=2.34%, 250=0.52%, 500=0.26%, 750=0.13% lat (msec) : 2=2.34%, 4=1.95%, 10=6.90%, 20=7.03%, 50=31.51% lat (msec) : 100=34.38%, 250=12.11%, 500=0.52% cpu : usr=0.07%, sys=4.22%, ctx=1739, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178617: Fri Sep 4 20:15:13 2026 read: IOPS=8, BW=141KiB/s (144kB/s)(6256KiB/44342msec) clat (usec): min=45, max=296866, avg=61574.10, stdev=39483.09 lat (usec): min=46, max=296867, avg=61583.24, stdev=39479.02 clat percentiles (usec): | 1.00th=[ 65], 5.00th=[ 84], 10.00th=[ 22938], 20.00th=[ 32375], | 30.00th=[ 41157], 40.00th=[ 47973], 50.00th=[ 56886], 60.00th=[ 65274], | 70.00th=[ 74974], 80.00th=[ 87557], 90.00th=[104334], 95.00th=[125305], | 99.00th=[210764], 99.50th=[265290], 99.90th=[295699], 99.95th=[295699], | 99.99th=[295699] bw ( KiB/s): min= 30, max= 281, per=26.11%, avg=140.99, stdev=57.71, samples=87 iops : min= 1, max= 17, avg= 8.03, stdev= 3.66, samples=87 write: IOPS=8, BW=136KiB/s (139kB/s)(6032KiB/44342msec); 0 zone resets clat (usec): min=1779, max=267265, avg=52699.47, stdev=49457.97 lat (usec): min=1783, max=267268, avg=52702.54, stdev=49457.94 clat percentiles (usec): | 1.00th=[ 1844], 5.00th=[ 2180], 10.00th=[ 4752], 20.00th=[ 9634], | 30.00th=[ 17957], 40.00th=[ 28705], 50.00th=[ 39060], 60.00th=[ 50594], | 70.00th=[ 66847], 80.00th=[ 90702], 90.00th=[126354], 95.00th=[156238], | 99.00th=[206570], 99.50th=[233833], 99.90th=[267387], 99.95th=[267387], | 99.99th=[267387] bw ( KiB/s): min= 30, max= 348, per=23.81%, avg=135.25, stdev=64.42, samples=87 iops : min= 1, max= 21, avg= 7.67, stdev= 4.11, samples=87 lat (usec) : 50=0.13%, 100=2.73%, 250=0.65%, 500=0.26% lat (msec) : 2=1.56%, 4=2.99%, 10=6.25%, 20=5.73%, 50=30.99% lat (msec) : 100=34.51%, 250=13.80%, 500=0.39% cpu : usr=0.07%, sys=4.09%, ctx=1789, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178618: Fri Sep 4 20:15:13 2026 read: IOPS=9, BW=146KiB/s (150kB/s)(6032KiB/41248msec) clat (usec): min=45, max=248608, avg=59890.81, stdev=41167.26 lat (usec): min=46, max=248610, avg=59920.08, stdev=41187.34 clat percentiles (usec): | 1.00th=[ 56], 5.00th=[ 73], 10.00th=[ 269], 20.00th=[ 30278], | 30.00th=[ 38536], 40.00th=[ 47449], 50.00th=[ 55313], 60.00th=[ 64226], | 70.00th=[ 73925], 80.00th=[ 84411], 90.00th=[109577], 95.00th=[131597], | 99.00th=[210764], 99.50th=[242222], 99.90th=[248513], 99.95th=[248513], | 99.99th=[248513] bw ( KiB/s): min= 30, max= 316, per=26.99%, avg=145.74, stdev=59.64, samples=81 iops : min= 1, max= 19, avg= 8.33, stdev= 3.78, samples=81 write: IOPS=9, BW=152KiB/s (155kB/s)(6256KiB/41248msec); 0 zone resets clat (usec): min=1577, max=238793, avg=46524.51, stdev=43383.28 lat (usec): min=1586, max=238796, avg=46566.15, stdev=43365.31 clat percentiles (usec): | 1.00th=[ 1680], 5.00th=[ 2376], 10.00th=[ 4621], 20.00th=[ 8979], | 30.00th=[ 16057], 40.00th=[ 25560], 50.00th=[ 32900], 60.00th=[ 45351], | 70.00th=[ 59507], 80.00th=[ 76022], 90.00th=[107480], 95.00th=[139461], | 99.00th=[191890], 99.50th=[219153], 99.90th=[238027], 99.95th=[238027], | 99.99th=[238027] bw ( KiB/s): min= 31, max= 277, per=26.71%, avg=151.69, stdev=63.40, samples=81 iops : min= 1, max= 17, avg= 8.70, stdev= 4.03, samples=81 lat (usec) : 50=0.13%, 100=4.30%, 250=0.39%, 500=0.13%, 1000=0.13% lat (msec) : 2=1.82%, 4=3.39%, 10=7.16%, 20=6.25%, 50=31.25% lat (msec) : 100=32.03%, 250=13.02% cpu : usr=0.08%, sys=4.05%, ctx=1662, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=540KiB/s (553kB/s), 137KiB/s-146KiB/s (140kB/s-150kB/s), io=23.4MiB (24.5MB), run=41248-44342msec WRITE: bw=568KiB/s (582kB/s), 136KiB/s-156KiB/s (139kB/s-159kB/s), io=24.6MiB (25.8MB), run=41248-44342msec rand-rw: (groupid=0, jobs=1): err= 0: pid=178619: Fri Sep 4 20:15:40 2026 read: IOPS=5, BW=83.8KiB/s (85.8kB/s)(5920KiB/70684msec) clat (msec): min=9, max=319, avg=79.28, stdev=60.22 lat (msec): min=9, max=319, avg=79.28, stdev=60.22 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 19], 10.00th=[ 26], 20.00th=[ 34], | 30.00th=[ 42], 40.00th=[ 50], 50.00th=[ 62], 60.00th=[ 70], | 70.00th=[ 85], 80.00th=[ 116], 90.00th=[ 167], 95.00th=[ 218], | 99.00th=[ 288], 99.50th=[ 300], 99.90th=[ 321], 99.95th=[ 321], | 99.99th=[ 321] bw ( KiB/s): min= 28, max= 318, per=25.90%, avg=87.53, stdev=51.60, samples=132 iops : min= 1, max= 19, avg= 4.63, stdev= 3.26, samples=132 write: IOPS=5, BW=90.1KiB/s (92.3kB/s)(6368KiB/70684msec); 0 zone resets clat (msec): min=17, max=442, avg=102.81, stdev=62.54 lat (msec): min=17, max=442, avg=102.81, stdev=62.54 clat percentiles (msec): | 1.00th=[ 26], 5.00th=[ 35], 10.00th=[ 43], 20.00th=[ 54], | 30.00th=[ 64], 40.00th=[ 72], 50.00th=[ 86], 60.00th=[ 105], | 70.00th=[ 123], 80.00th=[ 144], 90.00th=[ 176], 95.00th=[ 230], | 99.00th=[ 326], 99.50th=[ 376], 99.90th=[ 443], 99.95th=[ 443], | 99.99th=[ 443] bw ( KiB/s): min= 31, max= 255, per=25.68%, avg=91.40, stdev=45.89, samples=136 iops : min= 1, max= 15, avg= 4.88, stdev= 2.91, samples=136 lat (msec) : 10=0.39%, 20=3.12%, 50=24.48%, 100=38.41%, 250=30.73% lat (msec) : 500=2.86% cpu : usr=0.05%, sys=1.22%, ctx=1248, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178620: Fri Sep 4 20:15:40 2026 read: IOPS=5, BW=82.1KiB/s (84.1kB/s)(5744KiB/69943msec) clat (msec): min=9, max=418, avg=80.87, stdev=61.35 lat (msec): min=9, max=418, avg=80.89, stdev=61.35 clat percentiles (msec): | 1.00th=[ 14], 5.00th=[ 22], 10.00th=[ 27], 20.00th=[ 35], | 30.00th=[ 45], 40.00th=[ 53], 50.00th=[ 65], 60.00th=[ 73], | 70.00th=[ 88], 80.00th=[ 120], 90.00th=[ 163], 95.00th=[ 203], | 99.00th=[ 313], 99.50th=[ 330], 99.90th=[ 418], 99.95th=[ 418], | 99.99th=[ 418] bw ( KiB/s): min= 28, max= 287, per=25.35%, avg=85.68, stdev=49.43, samples=130 iops : min= 1, max= 17, avg= 4.52, stdev= 3.14, samples=130 write: IOPS=5, BW=93.6KiB/s (95.8kB/s)(6544KiB/69943msec); 0 zone resets clat (msec): min=16, max=336, avg=99.52, stdev=55.96 lat (msec): min=16, max=336, avg=99.53, stdev=55.95 clat percentiles (msec): | 1.00th=[ 26], 5.00th=[ 37], 10.00th=[ 42], 20.00th=[ 54], | 30.00th=[ 65], 40.00th=[ 74], 50.00th=[ 88], 60.00th=[ 100], | 70.00th=[ 115], 80.00th=[ 138], 90.00th=[ 176], 95.00th=[ 220], | 99.00th=[ 284], 99.50th=[ 313], 99.90th=[ 338], 99.95th=[ 338], | 99.99th=[ 338] bw ( KiB/s): min= 28, max= 255, per=27.08%, avg=96.40, stdev=47.38, samples=132 iops : min= 1, max= 15, avg= 5.20, stdev= 2.98, samples=132 lat (msec) : 10=0.13%, 20=1.69%, 50=24.74%, 100=40.49%, 250=30.34% lat (msec) : 500=2.60% cpu : usr=0.05%, sys=1.21%, ctx=1170, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178621: Fri Sep 4 20:15:40 2026 read: IOPS=5, BW=89.2KiB/s (91.4kB/s)(6256KiB/70111msec) clat (msec): min=11, max=321, avg=77.35, stdev=53.94 lat (msec): min=11, max=321, avg=77.36, stdev=53.94 clat percentiles (msec): | 1.00th=[ 14], 5.00th=[ 23], 10.00th=[ 30], 20.00th=[ 35], | 30.00th=[ 42], 40.00th=[ 53], 50.00th=[ 63], 60.00th=[ 74], | 70.00th=[ 90], 80.00th=[ 111], 90.00th=[ 148], 95.00th=[ 192], | 99.00th=[ 292], 99.50th=[ 317], 99.90th=[ 321], 99.95th=[ 321], | 99.99th=[ 321] bw ( KiB/s): min= 29, max= 287, per=27.32%, avg=92.35, stdev=52.81, samples=133 iops : min= 1, max= 17, avg= 4.94, stdev= 3.33, samples=133 write: IOPS=5, BW=86.0KiB/s (88.1kB/s)(6032KiB/70111msec); 0 zone resets clat (msec): min=18, max=711, avg=104.70, stdev=68.00 lat (msec): min=18, max=711, avg=104.72, stdev=67.99 clat percentiles (msec): | 1.00th=[ 27], 5.00th=[ 39], 10.00th=[ 44], 20.00th=[ 56], | 30.00th=[ 66], 40.00th=[ 77], 50.00th=[ 90], 60.00th=[ 102], | 70.00th=[ 118], 80.00th=[ 146], 90.00th=[ 190], 95.00th=[ 224], | 99.00th=[ 347], 99.50th=[ 380], 99.90th=[ 709], 99.95th=[ 709], | 99.99th=[ 709] bw ( KiB/s): min= 29, max= 220, per=24.76%, avg=88.13, stdev=39.41, samples=134 iops : min= 1, max= 13, avg= 4.67, stdev= 2.52, samples=134 lat (msec) : 20=1.95%, 50=25.39%, 100=40.49%, 250=29.95%, 500=2.08% lat (msec) : 750=0.13% cpu : usr=0.06%, sys=1.28%, ctx=1286, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178622: Fri Sep 4 20:15:40 2026 read: IOPS=5, BW=87.4KiB/s (89.5kB/s)(6032KiB/68987msec) clat (msec): min=9, max=609, avg=77.01, stdev=60.22 lat (msec): min=9, max=609, avg=77.02, stdev=60.23 clat percentiles (msec): | 1.00th=[ 14], 5.00th=[ 24], 10.00th=[ 29], 20.00th=[ 38], | 30.00th=[ 45], 40.00th=[ 52], 50.00th=[ 59], 60.00th=[ 72], | 70.00th=[ 84], 80.00th=[ 105], 90.00th=[ 146], 95.00th=[ 188], | 99.00th=[ 326], 99.50th=[ 351], 99.90th=[ 609], 99.95th=[ 609], | 99.99th=[ 609] bw ( KiB/s): min= 31, max= 255, per=26.72%, avg=90.30, stdev=47.32, samples=129 iops : min= 1, max= 15, avg= 4.81, stdev= 3.03, samples=129 write: IOPS=5, BW=90.7KiB/s (92.9kB/s)(6256KiB/68987msec); 0 zone resets clat (msec): min=13, max=396, avg=100.71, stdev=57.41 lat (msec): min=13, max=396, avg=100.71, stdev=57.41 clat percentiles (msec): | 1.00th=[ 22], 5.00th=[ 34], 10.00th=[ 41], 20.00th=[ 55], | 30.00th=[ 68], 40.00th=[ 81], 50.00th=[ 90], 60.00th=[ 103], | 70.00th=[ 116], 80.00th=[ 136], 90.00th=[ 167], 95.00th=[ 203], | 99.00th=[ 309], 99.50th=[ 372], 99.90th=[ 397], 99.95th=[ 397], | 99.99th=[ 397] bw ( KiB/s): min= 29, max= 285, per=26.00%, avg=92.56, stdev=45.69, samples=132 iops : min= 1, max= 17, avg= 4.95, stdev= 2.88, samples=132 lat (msec) : 10=0.13%, 20=1.69%, 50=25.52%, 100=40.36%, 250=29.82% lat (msec) : 500=2.34%, 750=0.13% cpu : usr=0.03%, sys=1.28%, ctx=1219, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=339KiB/s (347kB/s), 82.1KiB/s-89.2KiB/s (84.1kB/s-91.4kB/s), io=23.4MiB (24.5MB), run=68987-70684msec WRITE: bw=357KiB/s (365kB/s), 86.0KiB/s-93.6KiB/s (88.1kB/s-95.8kB/s), io=24.6MiB (25.8MB), run=68987-70684msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=178638: Fri Sep 4 20:16:03 2026 read: IOPS=0, BW=786KiB/s (805kB/s)(7168KiB/9118msec) clat (msec): min=187, max=437, avg=309.39, stdev=100.22 lat (msec): min=187, max=437, avg=309.39, stdev=100.22 clat percentiles (msec): | 1.00th=[ 188], 5.00th=[ 188], 10.00th=[ 188], 20.00th=[ 241], | 30.00th=[ 249], 40.00th=[ 249], 50.00th=[ 251], 60.00th=[ 397], | 70.00th=[ 397], 80.00th=[ 405], 90.00th=[ 439], 95.00th=[ 439], | 99.00th=[ 439], 99.50th=[ 439], 99.90th=[ 439], 99.95th=[ 439], | 99.99th=[ 439] bw ( KiB/s): min= 1790, max= 3976, per=100.00%, avg=2335.80, stdev=921.96, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 write: IOPS=0, BW=562KiB/s (575kB/s)(5120KiB/9118msec); 0 zone resets clat (msec): min=193, max=5142, avg=1355.31, stdev=2125.99 lat (msec): min=193, max=5143, avg=1355.41, stdev=2126.01 clat percentiles (msec): | 1.00th=[ 194], 5.00th=[ 194], 10.00th=[ 194], 20.00th=[ 194], | 30.00th=[ 247], 40.00th=[ 247], 50.00th=[ 558], 60.00th=[ 558], | 70.00th=[ 634], 80.00th=[ 634], 90.00th=[ 5134], 95.00th=[ 5134], | 99.00th=[ 5134], 99.50th=[ 5134], 99.90th=[ 5134], 99.95th=[ 5134], | 99.99th=[ 5134] bw ( KiB/s): min= 1882, max= 4096, per=92.08%, avg=2480.75, stdev=1078.74, samples=4 iops : min= 1, max= 4, avg= 1.75, stdev= 1.50, samples=4 lat (msec) : 250=41.67%, 500=33.33%, 750=16.67%, >=2000=8.33% cpu : usr=0.00%, sys=1.22%, ctx=59, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178639: Fri Sep 4 20:16:03 2026 read: IOPS=0, BW=193KiB/s (197kB/s)(2048KiB/10625msec) clat (msec): min=205, max=229, avg=217.67, stdev=17.04 lat (msec): min=205, max=229, avg=217.67, stdev=17.04 clat percentiles (msec): | 1.00th=[ 207], 5.00th=[ 207], 10.00th=[ 207], 20.00th=[ 207], | 30.00th=[ 207], 40.00th=[ 207], 50.00th=[ 207], 60.00th=[ 230], | 70.00th=[ 230], 80.00th=[ 230], 90.00th=[ 230], 95.00th=[ 230], | 99.00th=[ 230], 99.50th=[ 230], 99.90th=[ 230], 99.95th=[ 230], | 99.99th=[ 230] bw ( KiB/s): min= 1835, max= 2048, per=100.00%, avg=1941.50, stdev=150.61, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 write: IOPS=0, BW=964KiB/s (987kB/s)(10.0MiB/10625msec); 0 zone resets clat (msec): min=187, max=4900, avg=991.49, stdev=1401.54 lat (msec): min=187, max=4901, avg=991.77, stdev=1401.86 clat percentiles (msec): | 1.00th=[ 188], 5.00th=[ 188], 10.00th=[ 188], 20.00th=[ 262], | 30.00th=[ 347], 40.00th=[ 351], 50.00th=[ 567], 60.00th=[ 609], | 70.00th=[ 751], 80.00th=[ 927], 90.00th=[ 1028], 95.00th=[ 4933], | 99.00th=[ 4933], 99.50th=[ 4933], 99.90th=[ 4933], 99.95th=[ 4933], | 99.99th=[ 4933] bw ( KiB/s): min= 1790, max= 4063, per=93.66%, avg=2523.14, stdev=1050.37, samples=7 iops : min= 1, max= 3, avg= 1.71, stdev= 0.95, samples=7 lat (msec) : 250=25.00%, 500=25.00%, 750=25.00%, 1000=8.33%, 2000=8.33% lat (msec) : >=2000=8.33% cpu : usr=0.00%, sys=2.17%, ctx=109, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178640: Fri Sep 4 20:16:03 2026 read: IOPS=0, BW=577KiB/s (591kB/s)(6144KiB/10642msec) clat (msec): min=148, max=751, avg=399.17, stdev=217.94 lat (msec): min=148, max=751, avg=399.17, stdev=217.94 clat percentiles (msec): | 1.00th=[ 148], 5.00th=[ 148], 10.00th=[ 148], 20.00th=[ 234], | 30.00th=[ 234], 40.00th=[ 334], 50.00th=[ 334], 60.00th=[ 393], | 70.00th=[ 542], 80.00th=[ 542], 90.00th=[ 751], 95.00th=[ 751], | 99.00th=[ 751], 99.50th=[ 751], 99.90th=[ 751], 99.95th=[ 751], | 99.99th=[ 751] bw ( KiB/s): min= 1882, max= 4079, per=100.00%, avg=2506.75, stdev=1050.58, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 write: IOPS=0, BW=577KiB/s (591kB/s)(6144KiB/10642msec); 0 zone resets clat (msec): min=193, max=4094, avg=1356.00, stdev=1480.84 lat (msec): min=193, max=4094, avg=1356.10, stdev=1480.84 clat percentiles (msec): | 1.00th=[ 194], 5.00th=[ 194], 10.00th=[ 194], 20.00th=[ 255], | 30.00th=[ 255], 40.00th=[ 550], 50.00th=[ 550], 60.00th=[ 1217], | 70.00th=[ 1838], 80.00th=[ 1838], 90.00th=[ 4111], 95.00th=[ 4111], | 99.00th=[ 4111], 99.50th=[ 4111], 99.90th=[ 4111], 99.95th=[ 4111], | 99.99th=[ 4111] bw ( KiB/s): min= 1812, max= 2048, per=72.71%, avg=1958.83, stdev=93.26, samples=6 iops : min= 1, max= 2, avg= 1.17, stdev= 0.41, samples=6 lat (msec) : 250=25.00%, 500=25.00%, 750=16.67%, 1000=8.33%, 2000=16.67% lat (msec) : >=2000=8.33% cpu : usr=0.02%, sys=2.63%, ctx=84, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178641: Fri Sep 4 20:16:03 2026 read: IOPS=0, BW=566KiB/s (580kB/s)(5120KiB/9042msec) clat (msec): min=224, max=1007, avg=543.61, stdev=317.06 lat (msec): min=224, max=1007, avg=543.61, stdev=317.06 clat percentiles (msec): | 1.00th=[ 224], 5.00th=[ 224], 10.00th=[ 224], 20.00th=[ 224], | 30.00th=[ 313], 40.00th=[ 313], 50.00th=[ 472], 60.00th=[ 472], | 70.00th=[ 701], 80.00th=[ 701], 90.00th=[ 1011], 95.00th=[ 1011], | 99.00th=[ 1011], 99.50th=[ 1011], 99.90th=[ 1011], 99.95th=[ 1011], | 99.99th=[ 1011] bw ( KiB/s): min= 1790, max= 2043, per=100.00%, avg=1976.75, stdev=124.54, samples=4 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=4 write: IOPS=0, BW=793KiB/s (812kB/s)(7168KiB/9042msec); 0 zone resets clat (msec): min=194, max=3399, avg=866.80, stdev=1170.76 lat (msec): min=194, max=3400, avg=867.20, stdev=1170.87 clat percentiles (msec): | 1.00th=[ 194], 5.00th=[ 194], 10.00th=[ 194], 20.00th=[ 257], | 30.00th=[ 279], 40.00th=[ 279], 50.00th=[ 330], 60.00th=[ 388], | 70.00th=[ 388], 80.00th=[ 1217], 90.00th=[ 3406], 95.00th=[ 3406], | 99.00th=[ 3406], 99.50th=[ 3406], 99.90th=[ 3406], 99.95th=[ 3406], | 99.99th=[ 3406] bw ( KiB/s): min= 1988, max= 4096, per=100.00%, avg=3043.50, stdev=1196.45, samples=4 iops : min= 1, max= 4, avg= 2.25, stdev= 1.50, samples=4 lat (msec) : 250=16.67%, 500=50.00%, 750=8.33%, 2000=16.67%, >=2000=8.33% cpu : usr=0.02%, sys=1.00%, ctx=68, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1924KiB/s (1971kB/s), 193KiB/s-786KiB/s (197kB/s-805kB/s), io=20.0MiB (20.0MB), run=9042-10642msec WRITE: bw=2694KiB/s (2759kB/s), 562KiB/s-964KiB/s (575kB/s-987kB/s), io=28.0MiB (29.4MB), run=9042-10642msec rand-rw: (groupid=0, jobs=1): err= 0: pid=178643: Fri Sep 4 20:16:04 2026 read: IOPS=0, BW=749KiB/s (767kB/s)(7168KiB/9571msec) clat (usec): min=512, max=4609.8k, avg=961188.79, stdev=1619652.51 lat (usec): min=513, max=4609.8k, avg=961189.95, stdev=1619652.49 clat percentiles (usec): | 1.00th=[ 515], 5.00th=[ 515], 10.00th=[ 515], | 20.00th=[ 238027], 30.00th=[ 362808], 40.00th=[ 362808], | 50.00th=[ 484443], 60.00th=[ 497026], 70.00th=[ 497026], | 80.00th=[ 534774], 90.00th=[4596958], 95.00th=[4596958], | 99.00th=[4596958], 99.50th=[4596958], 99.90th=[4596958], | 99.95th=[4596958], 99.99th=[4596958] bw ( KiB/s): min= 1868, max= 2760, per=100.00%, avg=2124.80, stdev=360.68, samples=5 iops : min= 1, max= 2, avg= 1.20, stdev= 0.45, samples=5 write: IOPS=0, BW=535KiB/s (548kB/s)(5120KiB/9571msec); 0 zone resets clat (msec): min=206, max=1241, avg=567.19, stdev=420.88 lat (msec): min=207, max=1241, avg=568.30, stdev=420.00 clat percentiles (msec): | 1.00th=[ 207], 5.00th=[ 207], 10.00th=[ 207], 20.00th=[ 207], | 30.00th=[ 275], 40.00th=[ 275], 50.00th=[ 418], 60.00th=[ 418], | 70.00th=[ 693], 80.00th=[ 693], 90.00th=[ 1250], 95.00th=[ 1250], | 99.00th=[ 1250], 99.50th=[ 1250], 99.90th=[ 1250], 99.95th=[ 1250], | 99.99th=[ 1250] bw ( KiB/s): min= 2011, max= 3586, per=85.02%, avg=2413.75, stdev=781.63, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (usec) : 750=8.33% lat (msec) : 250=16.67%, 500=41.67%, 750=16.67%, 2000=8.33%, >=2000=8.33% cpu : usr=0.05%, sys=5.63%, ctx=673, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178644: Fri Sep 4 20:16:04 2026 read: IOPS=0, BW=203KiB/s (208kB/s)(2048KiB/10098msec) clat (msec): min=295, max=441, avg=368.72, stdev=103.07 lat (msec): min=295, max=441, avg=368.72, stdev=103.07 clat percentiles (msec): | 1.00th=[ 296], 5.00th=[ 296], 10.00th=[ 296], 20.00th=[ 296], | 30.00th=[ 296], 40.00th=[ 296], 50.00th=[ 296], 60.00th=[ 443], | 70.00th=[ 443], 80.00th=[ 443], 90.00th=[ 443], 95.00th=[ 443], | 99.00th=[ 443], 99.50th=[ 443], 99.90th=[ 443], 99.95th=[ 443], | 99.99th=[ 443] bw ( KiB/s): min= 1381, max= 1812, per=78.72%, avg=1596.50, stdev=304.76, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=0, BW=1014KiB/s (1038kB/s)(10.0MiB/10098msec); 0 zone resets clat (msec): min=195, max=4498, avg=934.81, stdev=1333.87 lat (msec): min=195, max=4498, avg=934.91, stdev=1333.87 clat percentiles (msec): | 1.00th=[ 197], 5.00th=[ 197], 10.00th=[ 197], 20.00th=[ 205], | 30.00th=[ 234], 40.00th=[ 279], 50.00th=[ 279], 60.00th=[ 334], | 70.00th=[ 617], 80.00th=[ 1167], 90.00th=[ 1536], 95.00th=[ 4530], | 99.00th=[ 4530], 99.50th=[ 4530], 99.90th=[ 4530], 99.95th=[ 4530], | 99.99th=[ 4530] bw ( KiB/s): min= 1812, max= 4047, per=100.00%, avg=2970.00, stdev=1170.34, samples=6 iops : min= 1, max= 3, avg= 2.00, stdev= 1.10, samples=6 lat (msec) : 250=25.00%, 500=41.67%, 750=8.33%, 2000=16.67%, >=2000=8.33% cpu : usr=0.02%, sys=5.39%, ctx=143, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178645: Fri Sep 4 20:16:04 2026 read: IOPS=0, BW=646KiB/s (662kB/s)(6144KiB/9504msec) clat (usec): min=496, max=346022, avg=219313.53, stdev=169939.33 lat (usec): min=497, max=346023, avg=219314.42, stdev=169939.10 clat percentiles (usec): | 1.00th=[ 498], 5.00th=[ 498], 10.00th=[ 498], 20.00th=[ 515], | 30.00th=[ 515], 40.00th=[308282], 50.00th=[308282], 60.00th=[325059], | 70.00th=[333448], 80.00th=[333448], 90.00th=[346031], 95.00th=[346031], | 99.00th=[346031], 99.50th=[346031], 99.90th=[346031], 99.95th=[346031], | 99.99th=[346031] bw ( KiB/s): min= 1793, max= 3737, per=100.00%, avg=2338.25, stdev=937.70, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 write: IOPS=0, BW=646KiB/s (662kB/s)(6144KiB/9504msec); 0 zone resets clat (msec): min=186, max=5283, avg=1363.64, stdev=1956.66 lat (msec): min=187, max=5283, avg=1363.72, stdev=1956.67 clat percentiles (msec): | 1.00th=[ 188], 5.00th=[ 188], 10.00th=[ 188], 20.00th=[ 309], | 30.00th=[ 309], 40.00th=[ 372], 50.00th=[ 372], 60.00th=[ 860], | 70.00th=[ 1183], 80.00th=[ 1183], 90.00th=[ 5269], 95.00th=[ 5269], | 99.00th=[ 5269], 99.50th=[ 5269], 99.90th=[ 5269], 99.95th=[ 5269], | 99.99th=[ 5269] bw ( KiB/s): min= 1793, max= 4015, per=83.55%, avg=2372.00, stdev=1095.80, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (usec) : 500=8.33%, 750=8.33% lat (msec) : 250=8.33%, 500=50.00%, 1000=8.33%, 2000=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=4.48%, ctx=185, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178646: Fri Sep 4 20:16:04 2026 read: IOPS=0, BW=590KiB/s (604kB/s)(5120KiB/8684msec) clat (usec): min=678, max=434933, avg=144952.16, stdev=202935.28 lat (usec): min=679, max=434934, avg=144953.13, stdev=202935.45 clat percentiles (usec): | 1.00th=[ 676], 5.00th=[ 676], 10.00th=[ 676], 20.00th=[ 676], | 30.00th=[ 1631], 40.00th=[ 1631], 50.00th=[ 3621], 60.00th=[ 3621], | 70.00th=[283116], 80.00th=[283116], 90.00th=[434111], 95.00th=[434111], | 99.00th=[434111], 99.50th=[434111], 99.90th=[434111], 99.95th=[434111], | 99.99th=[434111] bw ( KiB/s): min= 1812, max= 5380, per=100.00%, avg=3596.00, stdev=2522.96, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 write: IOPS=0, BW=825KiB/s (845kB/s)(7168KiB/8684msec); 0 zone resets clat (msec): min=322, max=4943, avg=1134.34, stdev=1689.42 lat (msec): min=322, max=4943, avg=1134.72, stdev=1689.26 clat percentiles (msec): | 1.00th=[ 321], 5.00th=[ 321], 10.00th=[ 321], 20.00th=[ 372], | 30.00th=[ 397], 40.00th=[ 397], 50.00th=[ 456], 60.00th=[ 600], | 70.00th=[ 600], 80.00th=[ 860], 90.00th=[ 4933], 95.00th=[ 4933], | 99.00th=[ 4933], 99.50th=[ 4933], 99.90th=[ 4933], 99.95th=[ 4933], | 99.99th=[ 4933] bw ( KiB/s): min= 1793, max= 2043, per=68.55%, avg=1946.00, stdev=96.86, samples=6 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=6 lat (usec) : 750=8.33% lat (msec) : 2=8.33%, 4=8.33%, 500=50.00%, 750=8.33%, 1000=8.33% lat (msec) : >=2000=8.33% cpu : usr=0.03%, sys=4.73%, ctx=118, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2028KiB/s (2077kB/s), 203KiB/s-749KiB/s (208kB/s-767kB/s), io=20.0MiB (20.0MB), run=8684-10098msec WRITE: bw=2839KiB/s (2908kB/s), 535KiB/s-1014KiB/s (548kB/s-1038kB/s), io=28.0MiB (29.4MB), run=8684-10098msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=178654: Fri Sep 4 20:16:24 2026 read: IOPS=1, BW=4815KiB/s (4931kB/s)(12.0MiB/2552msec) clat (msec): min=431, max=924, avg=656.79, stdev=249.42 lat (msec): min=431, max=924, avg=656.96, stdev=249.37 clat percentiles (msec): | 1.00th=[ 430], 5.00th=[ 430], 10.00th=[ 430], 20.00th=[ 430], | 30.00th=[ 430], 40.00th=[ 617], 50.00th=[ 617], 60.00th=[ 617], | 70.00th=[ 927], 80.00th=[ 927], 90.00th=[ 927], 95.00th=[ 927], | 99.00th=[ 927], 99.50th=[ 927], 99.90th=[ 927], 99.95th=[ 927], | 99.99th=[ 927] bw ( KiB/s): min= 7984, max= 7984, per=100.00%, avg=7984.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 750=33.33%, 1000=33.33% cpu : usr=0.12%, sys=14.39%, ctx=470, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178655: Fri Sep 4 20:16:24 2026 read: IOPS=0, BW=672KiB/s (688kB/s)(4096KiB/6096msec) clat (nsec): min=4068.2M, max=4068.2M, avg=4068151754.00, stdev= 0.00 lat (nsec): min=4068.2M, max=4068.2M, avg=4068154284.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 4077], 5.00th=[ 4077], 10.00th=[ 4077], 20.00th=[ 4077], | 30.00th=[ 4077], 40.00th=[ 4077], 50.00th=[ 4077], 60.00th=[ 4077], | 70.00th=[ 4077], 80.00th=[ 4077], 90.00th=[ 4077], 95.00th=[ 4077], | 99.00th=[ 4077], 99.50th=[ 4077], 99.90th=[ 4077], 99.95th=[ 4077], | 99.99th=[ 4077] bw ( KiB/s): min= 8078, max= 8078, per=100.00%, avg=8078.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=1344KiB/s (1376kB/s)(8192KiB/6096msec); 0 zone resets clat (msec): min=819, max=984, avg=901.58, stdev=116.62 lat (msec): min=819, max=984, avg=901.92, stdev=116.44 clat percentiles (msec): | 1.00th=[ 818], 5.00th=[ 818], 10.00th=[ 818], 20.00th=[ 818], | 30.00th=[ 818], 40.00th=[ 818], 50.00th=[ 818], 60.00th=[ 986], | 70.00th=[ 986], 80.00th=[ 986], 90.00th=[ 986], 95.00th=[ 986], | 99.00th=[ 986], 99.50th=[ 986], 99.90th=[ 986], 99.95th=[ 986], | 99.99th=[ 986] bw ( KiB/s): min= 8062, max= 8062, per=100.00%, avg=8062.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 1000=66.67%, >=2000=33.33% cpu : usr=0.05%, sys=3.76%, ctx=460, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178656: Fri Sep 4 20:16:24 2026 write: IOPS=0, BW=1747KiB/s (1789kB/s)(12.0MiB/7035msec); 0 zone resets clat (msec): min=484, max=4384, avg=2169.61, stdev=2003.52 lat (msec): min=486, max=4386, avg=2171.46, stdev=2003.18 clat percentiles (msec): | 1.00th=[ 485], 5.00th=[ 485], 10.00th=[ 485], 20.00th=[ 485], | 30.00th=[ 485], 40.00th=[ 1636], 50.00th=[ 1636], 60.00th=[ 1636], | 70.00th=[ 4396], 80.00th=[ 4396], 90.00th=[ 4396], 95.00th=[ 4396], | 99.00th=[ 4396], 99.50th=[ 4396], 99.90th=[ 4396], 99.95th=[ 4396], | 99.99th=[ 4396] bw ( KiB/s): min= 8126, max= 8159, per=100.00%, avg=8142.50, stdev=23.33, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=2.29%, ctx=80, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178657: Fri Sep 4 20:16:24 2026 write: IOPS=0, BW=1984KiB/s (2032kB/s)(12.0MiB/6193msec); 0 zone resets clat (msec): min=188, max=5260, avg=2044.58, stdev=2795.95 lat (msec): min=188, max=5261, avg=2045.18, stdev=2796.35 clat percentiles (msec): | 1.00th=[ 188], 5.00th=[ 188], 10.00th=[ 188], 20.00th=[ 188], | 30.00th=[ 188], 40.00th=[ 684], 50.00th=[ 684], 60.00th=[ 684], | 70.00th=[ 5269], 80.00th=[ 5269], 90.00th=[ 5269], 95.00th=[ 5269], | 99.00th=[ 5269], 99.50th=[ 5269], 99.90th=[ 5269], 99.95th=[ 5269], | 99.99th=[ 5269] bw ( KiB/s): min=16000, max=16000, per=100.00%, avg=16000.00, stdev= 0.00, samples=1 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 750=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=1.21%, ctx=40, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2688KiB/s (2752kB/s), 672KiB/s-4815KiB/s (688kB/s-4931kB/s), io=16.0MiB (16.8MB), run=2552-6096msec WRITE: bw=4658KiB/s (4770kB/s), 1344KiB/s-1984KiB/s (1376kB/s-2032kB/s), io=32.0MiB (33.6MB), run=6096-7035msec rand-rw: (groupid=0, jobs=1): err= 0: pid=178658: Fri Sep 4 20:16:25 2026 read: IOPS=0, BW=1954KiB/s (2000kB/s)(12.0MiB/6290msec) clat (msec): min=774, max=4628, avg=2067.21, stdev=2217.86 lat (msec): min=774, max=4628, avg=2067.21, stdev=2217.87 clat percentiles (msec): | 1.00th=[ 776], 5.00th=[ 776], 10.00th=[ 776], 20.00th=[ 776], | 30.00th=[ 776], 40.00th=[ 802], 50.00th=[ 802], 60.00th=[ 802], | 70.00th=[ 4597], 80.00th=[ 4597], 90.00th=[ 4597], 95.00th=[ 4597], | 99.00th=[ 4597], 99.50th=[ 4597], 99.90th=[ 4597], 99.95th=[ 4597], | 99.99th=[ 4597] bw ( KiB/s): min= 8078, max= 8175, per=100.00%, avg=8126.50, stdev=68.59, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=66.67%, >=2000=33.33% cpu : usr=0.00%, sys=1.26%, ctx=60, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178659: Fri Sep 4 20:16:25 2026 read: IOPS=0, BW=634KiB/s (650kB/s)(4096KiB/6456msec) clat (nsec): min=4972.9M, max=4972.9M, avg=4972886541.00, stdev= 0.00 lat (nsec): min=4972.9M, max=4972.9M, avg=4972889653.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 5000], 5.00th=[ 5000], 10.00th=[ 5000], 20.00th=[ 5000], | 30.00th=[ 5000], 40.00th=[ 5000], 50.00th=[ 5000], 60.00th=[ 5000], | 70.00th=[ 5000], 80.00th=[ 5000], 90.00th=[ 5000], 95.00th=[ 5000], | 99.00th=[ 5000], 99.50th=[ 5000], 99.90th=[ 5000], 99.95th=[ 5000], | 99.99th=[ 5000] bw ( KiB/s): min= 8175, max= 8175, per=100.00%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=1269KiB/s (1299kB/s)(8192KiB/6456msec); 0 zone resets clat (msec): min=399, max=996, avg=697.92, stdev=422.32 lat (msec): min=399, max=996, avg=698.22, stdev=422.20 clat percentiles (msec): | 1.00th=[ 401], 5.00th=[ 401], 10.00th=[ 401], 20.00th=[ 401], | 30.00th=[ 401], 40.00th=[ 401], 50.00th=[ 401], 60.00th=[ 995], | 70.00th=[ 995], 80.00th=[ 995], 90.00th=[ 995], 95.00th=[ 995], | 99.00th=[ 995], 99.50th=[ 995], 99.90th=[ 995], 99.95th=[ 995], | 99.99th=[ 995] bw ( KiB/s): min= 8078, max= 8078, per=100.00%, avg=8078.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 1000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=1.36%, ctx=35, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178660: Fri Sep 4 20:16:25 2026 write: IOPS=0, BW=1854KiB/s (1898kB/s)(12.0MiB/6629msec); 0 zone resets clat (msec): min=492, max=5108, avg=2143.59, stdev=2573.57 lat (msec): min=493, max=5109, avg=2144.27, stdev=2573.22 clat percentiles (msec): | 1.00th=[ 493], 5.00th=[ 493], 10.00th=[ 493], 20.00th=[ 493], | 30.00th=[ 493], 40.00th=[ 827], 50.00th=[ 827], 60.00th=[ 827], | 70.00th=[ 5134], 80.00th=[ 5134], 90.00th=[ 5134], 95.00th=[ 5134], | 99.00th=[ 5134], 99.50th=[ 5134], 99.90th=[ 5134], 99.95th=[ 5134], | 99.99th=[ 5134] bw ( KiB/s): min= 8110, max= 8110, per=100.00%, avg=8110.00, stdev= 0.00, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 1000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=1.51%, ctx=44, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178661: Fri Sep 4 20:16:25 2026 write: IOPS=0, BW=2007KiB/s (2055kB/s)(12.0MiB/6124msec); 0 zone resets clat (msec): min=381, max=4980, avg=1932.63, stdev=2640.06 lat (msec): min=382, max=4981, avg=1933.14, stdev=2639.90 clat percentiles (msec): | 1.00th=[ 380], 5.00th=[ 380], 10.00th=[ 380], 20.00th=[ 380], | 30.00th=[ 380], 40.00th=[ 435], 50.00th=[ 435], 60.00th=[ 435], | 70.00th=[ 5000], 80.00th=[ 5000], 90.00th=[ 5000], 95.00th=[ 5000], | 99.00th=[ 5000], 99.50th=[ 5000], 99.90th=[ 5000], 99.95th=[ 5000], | 99.99th=[ 5000] bw ( KiB/s): min=16286, max=16286, per=100.00%, avg=16286.00, stdev= 0.00, samples=1 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=1 lat (msec) : 500=66.67%, >=2000=33.33% cpu : usr=0.03%, sys=1.57%, ctx=42, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2538KiB/s (2599kB/s), 634KiB/s-1954KiB/s (650kB/s-2000kB/s), io=16.0MiB (16.8MB), run=6290-6456msec WRITE: bw=4943KiB/s (5062kB/s), 1269KiB/s-2007KiB/s (1299kB/s-2055kB/s), io=32.0MiB (33.6MB), run=6124-6629msec