== sanity test 398b: DIO and buffer IO race ============== 03:53:09 (1786953189) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 6.04439 s, 8.3 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=145532: Mon Aug 17 03:55:51 2026 read: IOPS=10, BW=41.9KiB/s (42.9kB/s)(5992KiB/143147msec) clat (usec): min=37, max=1174.0k, avg=48525.01, stdev=47471.48 lat (usec): min=37, max=1174.0k, avg=48531.22, stdev=47475.00 clat percentiles (usec): | 1.00th=[ 55], 5.00th=[ 73], 10.00th=[ 3523], | 20.00th=[ 22414], 30.00th=[ 28181], 40.00th=[ 34341], | 50.00th=[ 40633], 60.00th=[ 47973], 70.00th=[ 58983], | 80.00th=[ 70779], 90.00th=[ 90702], 95.00th=[ 109577], | 99.00th=[ 164627], 99.50th=[ 206570], 99.90th=[ 471860], | 99.95th=[1182794], 99.99th=[1182794] bw ( KiB/s): min= 7, max= 95, per=25.25%, avg=41.92, stdev=18.65, samples=278 iops : min= 1, max= 23, avg= 9.82, stdev= 4.67, samples=278 write: IOPS=10, BW=43.0KiB/s (45.0kB/s)(6296KiB/143147msec); 0 zone resets clat (usec): min=1124, max=558531, avg=44413.46, stdev=45941.35 lat (usec): min=1125, max=558534, avg=44421.46, stdev=45940.58 clat percentiles (usec): | 1.00th=[ 1319], 5.00th=[ 1565], 10.00th=[ 2409], 20.00th=[ 5735], | 30.00th=[ 9896], 40.00th=[ 20055], 50.00th=[ 33162], 60.00th=[ 44827], | 70.00th=[ 58459], 80.00th=[ 74974], 90.00th=[104334], 95.00th=[129500], | 99.00th=[196084], 99.50th=[238027], 99.90th=[312476], 99.95th=[557843], | 99.99th=[557843] bw ( KiB/s): min= 7, max= 95, per=25.12%, avg=43.71, stdev=18.87, samples=280 iops : min= 1, max= 23, avg=10.28, stdev= 4.74, samples=280 lat (usec) : 50=0.33%, 100=3.52%, 250=0.75%, 500=0.10%, 1000=0.03% lat (msec) : 2=4.23%, 4=3.58%, 10=8.04%, 20=7.75%, 50=34.21% lat (msec) : 100=28.06%, 250=9.05%, 500=0.29%, 750=0.03%, 2000=0.03% cpu : usr=0.09%, sys=5.42%, ctx=6861, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145533: Mon Aug 17 03:55:51 2026 read: IOPS=10, BW=41.7KiB/s (42.7kB/s)(5940KiB/142453msec) clat (usec): min=30, max=311893, avg=46609.45, stdev=34947.78 lat (usec): min=30, max=311894, avg=46613.99, stdev=34949.30 clat percentiles (usec): | 1.00th=[ 56], 5.00th=[ 73], 10.00th=[ 137], 20.00th=[ 20841], | 30.00th=[ 27657], 40.00th=[ 33817], 50.00th=[ 40109], 60.00th=[ 47449], | 70.00th=[ 56886], 80.00th=[ 69731], 90.00th=[ 91751], 95.00th=[108528], | 99.00th=[152044], 99.50th=[187696], 99.90th=[261096], 99.95th=[312476], | 99.99th=[312476] bw ( KiB/s): min= 5, max= 103, per=25.08%, avg=41.63, stdev=18.86, samples=278 iops : min= 1, max= 25, avg= 9.76, stdev= 4.74, samples=278 write: IOPS=11, BW=44.6KiB/s (45.6kB/s)(6348KiB/142453msec); 0 zone resets clat (usec): min=1077, max=1099.6k, avg=45859.92, stdev=53665.18 lat (usec): min=1079, max=1099.6k, avg=45865.60, stdev=53663.97 clat percentiles (usec): | 1.00th=[ 1336], 5.00th=[ 1631], 10.00th=[ 2737], | 20.00th=[ 5604], 30.00th=[ 10552], 40.00th=[ 20579], | 50.00th=[ 32375], 60.00th=[ 44827], 70.00th=[ 57410], | 80.00th=[ 78119], 90.00th=[ 108528], 95.00th=[ 137364], | 99.00th=[ 202376], 99.50th=[ 221250], 99.90th=[ 429917], | 99.95th=[1098908], 99.99th=[1098908] bw ( KiB/s): min= 7, max= 127, per=25.70%, avg=44.72, stdev=19.74, samples=277 iops : min= 1, max= 31, avg=10.53, stdev= 4.96, samples=277 lat (usec) : 50=0.23%, 100=4.07%, 250=0.81%, 500=0.16%, 750=0.07% lat (usec) : 1000=0.07% lat (msec) : 2=3.55%, 4=4.20%, 10=7.36%, 20=8.89%, 50=33.85% lat (msec) : 100=26.66%, 250=9.86%, 500=0.20%, 2000=0.03% cpu : usr=0.07%, sys=5.71%, ctx=6885, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145534: Mon Aug 17 03:55:51 2026 read: IOPS=10, BW=41.9KiB/s (42.0kB/s)(6028KiB/143702msec) clat (usec): min=28, max=261460, avg=45500.58, stdev=33802.31 lat (usec): min=29, max=261462, avg=45503.14, stdev=33803.04 clat percentiles (usec): | 1.00th=[ 56], 5.00th=[ 70], 10.00th=[ 133], 20.00th=[ 22414], | 30.00th=[ 28443], 40.00th=[ 33162], 50.00th=[ 38536], 60.00th=[ 46400], | 70.00th=[ 55837], 80.00th=[ 66323], 90.00th=[ 85459], 95.00th=[104334], | 99.00th=[173016], 99.50th=[212861], 99.90th=[244319], 99.95th=[261096], | 99.99th=[261096] bw ( KiB/s): min= 7, max= 103, per=25.14%, avg=41.73, stdev=19.16, samples=281 iops : min= 1, max= 25, avg= 9.78, stdev= 4.82, samples=281 write: IOPS=10, BW=43.6KiB/s (44.6kB/s)(6260KiB/143702msec); 0 zone resets clat (usec): min=1010, max=1105.8k, avg=47722.02, stdev=53124.13 lat (usec): min=1011, max=1105.8k, avg=47727.33, stdev=53125.68 clat percentiles (usec): | 1.00th=[ 1385], 5.00th=[ 1663], 10.00th=[ 3294], | 20.00th=[ 6849], 30.00th=[ 12518], 40.00th=[ 23725], | 50.00th=[ 35914], 60.00th=[ 46924], 70.00th=[ 60556], | 80.00th=[ 80217], 90.00th=[ 108528], 95.00th=[ 135267], | 99.00th=[ 193987], 99.50th=[ 240124], 99.90th=[ 367002], | 99.95th=[1098908], 99.99th=[1098908] bw ( KiB/s): min= 7, max= 110, per=24.91%, avg=43.34, stdev=17.85, samples=281 iops : min= 1, max= 27, avg=10.19, stdev= 4.50, samples=281 lat (usec) : 50=0.26%, 100=4.17%, 250=0.68%, 500=0.10%, 750=0.10% lat (msec) : 2=3.32%, 4=2.86%, 10=7.52%, 20=8.07%, 50=36.07% lat (msec) : 100=27.51%, 250=9.08%, 500=0.23%, 2000=0.03% cpu : usr=0.08%, sys=5.54%, ctx=6913, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145535: Mon Aug 17 03:55:51 2026 read: IOPS=10, BW=42.1KiB/s (43.1kB/s)(6052KiB/143839msec) clat (usec): min=22, max=339203, avg=46507.44, stdev=34900.07 lat (usec): min=22, max=339203, avg=46510.69, stdev=34899.08 clat percentiles (usec): | 1.00th=[ 52], 5.00th=[ 71], 10.00th=[ 449], 20.00th=[ 21627], | 30.00th=[ 28181], 40.00th=[ 33817], 50.00th=[ 40633], 60.00th=[ 47973], | 70.00th=[ 56886], 80.00th=[ 68682], 90.00th=[ 86508], 95.00th=[105382], | 99.00th=[149947], 99.50th=[189793], 99.90th=[320865], 99.95th=[337642], | 99.99th=[337642] bw ( KiB/s): min= 7, max= 111, per=25.39%, avg=42.14, stdev=18.72, samples=280 iops : min= 1, max= 27, avg= 9.88, stdev= 4.70, samples=280 write: IOPS=10, BW=43.4KiB/s (44.4kB/s)(6236KiB/143839msec); 0 zone resets clat (usec): min=1169, max=906515, avg=46826.57, stdev=50757.49 lat (usec): min=1172, max=906517, avg=46840.79, stdev=50752.65 clat percentiles (usec): | 1.00th=[ 1336], 5.00th=[ 1549], 10.00th=[ 2474], 20.00th=[ 6194], | 30.00th=[ 11469], 40.00th=[ 23462], 50.00th=[ 33817], 60.00th=[ 46924], | 70.00th=[ 62129], 80.00th=[ 81265], 90.00th=[103285], 95.00th=[132645], | 99.00th=[206570], 99.50th=[270533], 99.90th=[320865], 99.95th=[910164], | 99.99th=[910164] bw ( KiB/s): min= 7, max= 111, per=24.93%, avg=43.38, stdev=18.25, samples=280 iops : min= 1, max= 27, avg=10.19, stdev= 4.62, samples=280 lat (usec) : 50=0.46%, 100=3.45%, 250=0.91%, 500=0.13%, 750=0.07% lat (msec) : 2=3.87%, 4=3.81%, 10=6.77%, 20=8.59%, 50=34.08% lat (msec) : 100=28.91%, 250=8.50%, 500=0.42%, 1000=0.03% cpu : usr=0.09%, sys=5.46%, ctx=6935, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=167KiB/s (171kB/s), 41.7KiB/s-42.1KiB/s (42.7kB/s-43.1kB/s), io=23.4MiB (24.6MB), run=142453-143839msec WRITE: bw=175KiB/s (179kB/s), 43.4KiB/s-44.6KiB/s (44.4kB/s-45.6kB/s), io=24.6MiB (25.7MB), run=142453-143839msec rand-rw: (groupid=0, jobs=1): err= 0: pid=145537: Mon Aug 17 03:58:08 2026 read: IOPS=5, BW=21.5KiB/s (21.0kB/s)(5992KiB/278972msec) clat (msec): min=6, max=1164, avg=38.00, stdev=49.19 lat (msec): min=6, max=1164, avg=38.00, stdev=49.19 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 15], | 30.00th=[ 17], 40.00th=[ 21], 50.00th=[ 24], 60.00th=[ 28], | 70.00th=[ 35], 80.00th=[ 52], 90.00th=[ 85], 95.00th=[ 116], | 99.00th=[ 184], 99.50th=[ 241], 99.90th=[ 472], 99.95th=[ 1167], | 99.99th=[ 1167] bw ( KiB/s): min= 7, max= 95, per=28.84%, avg=24.51, stdev=17.59, samples=472 iops : min= 1, max= 23, avg= 5.51, stdev= 4.44, samples=472 write: IOPS=5, BW=22.6KiB/s (23.1kB/s)(6296KiB/278972msec); 0 zone resets clat (msec): min=37, max=566, avg=140.91, stdev=69.23 lat (msec): min=37, max=566, avg=140.92, stdev=69.23 clat percentiles (msec): | 1.00th=[ 51], 5.00th=[ 63], 10.00th=[ 72], 20.00th=[ 86], | 30.00th=[ 99], 40.00th=[ 111], 50.00th=[ 124], 60.00th=[ 142], | 70.00th=[ 159], 80.00th=[ 188], 90.00th=[ 234], 95.00th=[ 268], | 99.00th=[ 393], 99.50th=[ 426], 99.90th=[ 531], 99.95th=[ 567], | 99.99th=[ 567] bw ( KiB/s): min= 7, max= 48, per=25.04%, avg=22.28, stdev=10.55, samples=543 iops : min= 1, max= 12, avg= 4.94, stdev= 2.71, samples=543 lat (msec) : 10=2.51%, 20=16.96%, 50=19.79%, 100=22.14%, 250=34.60% lat (msec) : 500=3.91%, 750=0.07%, 2000=0.03% cpu : usr=0.04%, sys=1.41%, ctx=5317, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145538: Mon Aug 17 03:58:08 2026 read: IOPS=5, BW=21.2KiB/s (21.7kB/s)(5940KiB/280679msec) clat (msec): min=6, max=974, avg=39.45, stdev=47.84 lat (msec): min=6, max=974, avg=39.45, stdev=47.84 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 12], 20.00th=[ 15], | 30.00th=[ 17], 40.00th=[ 20], 50.00th=[ 24], 60.00th=[ 28], | 70.00th=[ 36], 80.00th=[ 55], 90.00th=[ 90], 95.00th=[ 121], | 99.00th=[ 222], 99.50th=[ 271], 99.90th=[ 397], 99.95th=[ 978], | 99.99th=[ 978] bw ( KiB/s): min= 7, max= 95, per=28.42%, avg=24.15, stdev=16.30, samples=474 iops : min= 1, max= 23, avg= 5.42, stdev= 4.14, samples=474 write: IOPS=5, BW=22.6KiB/s (23.2kB/s)(6348KiB/280679msec); 0 zone resets clat (msec): min=30, max=530, avg=139.71, stdev=66.00 lat (msec): min=30, max=530, avg=139.72, stdev=66.01 clat percentiles (msec): | 1.00th=[ 48], 5.00th=[ 64], 10.00th=[ 73], 20.00th=[ 86], | 30.00th=[ 99], 40.00th=[ 111], 50.00th=[ 124], 60.00th=[ 138], | 70.00th=[ 161], 80.00th=[ 190], 90.00th=[ 228], 95.00th=[ 271], | 99.00th=[ 355], 99.50th=[ 393], 99.90th=[ 481], 99.95th=[ 531], | 99.99th=[ 531] bw ( KiB/s): min= 7, max= 56, per=25.09%, avg=22.33, stdev=10.75, samples=545 iops : min= 1, max= 14, avg= 4.96, stdev= 2.76, samples=545 lat (msec) : 10=2.08%, 20=17.64%, 50=18.39%, 100=22.72%, 250=35.32% lat (msec) : 500=3.78%, 750=0.03%, 1000=0.03% cpu : usr=0.05%, sys=1.35%, ctx=5240, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145539: Mon Aug 17 03:58:08 2026 read: IOPS=5, BW=21.6KiB/s (22.1kB/s)(6028KiB/279259msec) clat (msec): min=5, max=449, avg=39.62, stdev=41.34 lat (msec): min=5, max=449, avg=39.62, stdev=41.34 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 12], 20.00th=[ 15], | 30.00th=[ 18], 40.00th=[ 20], 50.00th=[ 24], 60.00th=[ 29], | 70.00th=[ 39], 80.00th=[ 57], 90.00th=[ 92], 95.00th=[ 122], | 99.00th=[ 184], 99.50th=[ 271], 99.90th=[ 351], 99.95th=[ 451], | 99.99th=[ 451] bw ( KiB/s): min= 7, max= 95, per=28.06%, avg=23.85, stdev=16.87, samples=488 iops : min= 1, max= 23, avg= 5.34, stdev= 4.28, samples=488 write: IOPS=5, BW=22.4KiB/s (22.0kB/s)(6260KiB/279259msec); 0 zone resets clat (msec): min=34, max=1074, avg=139.99, stdev=72.79 lat (msec): min=34, max=1074, avg=139.99, stdev=72.79 clat percentiles (msec): | 1.00th=[ 50], 5.00th=[ 64], 10.00th=[ 72], 20.00th=[ 85], | 30.00th=[ 96], 40.00th=[ 108], 50.00th=[ 122], 60.00th=[ 138], | 70.00th=[ 163], 80.00th=[ 190], 90.00th=[ 228], 95.00th=[ 268], | 99.00th=[ 388], 99.50th=[ 439], 99.90th=[ 625], 99.95th=[ 1083], | 99.99th=[ 1083] bw ( KiB/s): min= 7, max= 55, per=25.08%, avg=22.32, stdev=11.09, samples=540 iops : min= 1, max= 13, avg= 4.95, stdev= 2.83, samples=540 lat (msec) : 10=2.31%, 20=17.77%, 50=18.13%, 100=23.57%, 250=34.18% lat (msec) : 500=3.87%, 750=0.13%, 2000=0.03% cpu : usr=0.04%, sys=1.33%, ctx=5219, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145540: Mon Aug 17 03:58:08 2026 read: IOPS=5, BW=21.8KiB/s (22.3kB/s)(6052KiB/277839msec) clat (msec): min=5, max=368, avg=37.47, stdev=36.59 lat (msec): min=5, max=368, avg=37.47, stdev=36.59 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 12], 20.00th=[ 15], | 30.00th=[ 18], 40.00th=[ 20], 50.00th=[ 24], 60.00th=[ 29], | 70.00th=[ 36], 80.00th=[ 53], 90.00th=[ 86], 95.00th=[ 114], | 99.00th=[ 167], 99.50th=[ 201], 99.90th=[ 321], 99.95th=[ 368], | 99.99th=[ 368] bw ( KiB/s): min= 7, max= 88, per=29.54%, avg=25.11, stdev=16.87, samples=466 iops : min= 1, max= 22, avg= 5.66, stdev= 4.25, samples=466 write: IOPS=5, BW=22.4KiB/s (22.0kB/s)(6236KiB/277839msec); 0 zone resets clat (msec): min=39, max=1017, avg=141.61, stdev=74.54 lat (msec): min=39, max=1017, avg=141.61, stdev=74.55 clat percentiles (msec): | 1.00th=[ 53], 5.00th=[ 64], 10.00th=[ 73], 20.00th=[ 86], | 30.00th=[ 97], 40.00th=[ 110], 50.00th=[ 124], 60.00th=[ 138], | 70.00th=[ 159], 80.00th=[ 188], 90.00th=[ 239], 95.00th=[ 275], | 99.00th=[ 393], 99.50th=[ 439], 99.90th=[ 651], 99.95th=[ 1020], | 99.99th=[ 1020] bw ( KiB/s): min= 7, max= 56, per=24.82%, avg=22.09, stdev=10.78, samples=543 iops : min= 1, max= 14, avg= 4.90, stdev= 2.77, samples=543 lat (msec) : 10=2.25%, 20=17.84%, 50=18.98%, 100=23.18%, 250=33.53% lat (msec) : 500=4.07%, 750=0.13%, 2000=0.03% cpu : usr=0.05%, sys=1.43%, ctx=5451, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=85.5KiB/s (87.6kB/s), 21.2KiB/s-21.8KiB/s (21.7kB/s-22.3kB/s), io=23.4MiB (24.6MB), run=277839-280679msec WRITE: bw=89.6KiB/s (91.7kB/s), 22.4KiB/s-22.6KiB/s (22.0kB/s-23.2kB/s), io=24.6MiB (25.7MB), run=277839-280679msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=145597: Mon Aug 17 03:58:46 2026 read: IOPS=12, BW=198KiB/s (203kB/s)(5920KiB/29907msec) clat (usec): min=37, max=412940, avg=42593.35, stdev=39208.50 lat (usec): min=37, max=412940, avg=42594.75, stdev=39208.43 clat percentiles (usec): | 1.00th=[ 43], 5.00th=[ 60], 10.00th=[ 70], 20.00th=[ 184], | 30.00th=[ 26608], 40.00th=[ 32113], 50.00th=[ 39060], 60.00th=[ 44827], | 70.00th=[ 53216], 80.00th=[ 63177], 90.00th=[ 78119], 95.00th=[ 95945], | 99.00th=[183501], 99.50th=[212861], 99.90th=[413139], 99.95th=[413139], | 99.99th=[413139] bw ( KiB/s): min= 31, max= 413, per=25.43%, avg=195.81, stdev=77.91, samples=58 iops : min= 1, max= 25, avg=11.45, stdev= 4.91, samples=58 write: IOPS=13, BW=213KiB/s (218kB/s)(6368KiB/29907msec); 0 zone resets clat (usec): min=1605, max=205695, avg=35326.17, stdev=35020.04 lat (usec): min=1606, max=205698, avg=35347.52, stdev=35008.19 clat percentiles (usec): | 1.00th=[ 1795], 5.00th=[ 2073], 10.00th=[ 3720], 20.00th=[ 6849], | 30.00th=[ 10028], 40.00th=[ 15926], 50.00th=[ 22938], 60.00th=[ 32375], | 70.00th=[ 43779], 80.00th=[ 63701], 90.00th=[ 83362], 95.00th=[101188], | 99.00th=[170918], 99.50th=[200279], 99.90th=[206570], 99.95th=[206570], | 99.99th=[206570] bw ( KiB/s): min= 31, max= 443, per=26.22%, avg=212.34, stdev=82.51, samples=58 iops : min= 1, max= 27, avg=12.48, stdev= 5.20, samples=58 lat (usec) : 50=1.17%, 100=7.16%, 250=1.56%, 500=0.13%, 1000=0.13% lat (msec) : 2=1.95%, 4=3.91%, 10=9.64%, 20=10.94%, 50=33.20% lat (msec) : 100=25.26%, 250=4.82%, 500=0.13% cpu : usr=0.10%, sys=6.54%, ctx=1529, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145598: Mon Aug 17 03:58:46 2026 read: IOPS=11, BW=185KiB/s (189kB/s)(5744KiB/31082msec) clat (usec): min=34, max=482057, avg=44429.06, stdev=38277.83 lat (usec): min=34, max=482057, avg=44431.07, stdev=38277.69 clat percentiles (usec): | 1.00th=[ 42], 5.00th=[ 61], 10.00th=[ 74], 20.00th=[ 16450], | 30.00th=[ 27919], 40.00th=[ 35390], 50.00th=[ 42730], 60.00th=[ 49021], | 70.00th=[ 56361], 80.00th=[ 68682], 90.00th=[ 83362], 95.00th=[ 96994], | 99.00th=[130548], 99.50th=[166724], 99.90th=[480248], 99.95th=[480248], | 99.99th=[480248] bw ( KiB/s): min= 31, max= 413, per=23.86%, avg=183.70, stdev=77.48, samples=61 iops : min= 1, max= 25, avg=10.67, stdev= 4.88, samples=61 write: IOPS=13, BW=211KiB/s (216kB/s)(6544KiB/31082msec); 0 zone resets clat (usec): min=1636, max=323789, avg=36568.69, stdev=40109.68 lat (usec): min=1637, max=323790, avg=36572.33, stdev=40109.67 clat percentiles (usec): | 1.00th=[ 1729], 5.00th=[ 2057], 10.00th=[ 3654], 20.00th=[ 6783], | 30.00th=[ 9765], 40.00th=[ 14877], 50.00th=[ 22938], 60.00th=[ 32637], | 70.00th=[ 44827], 80.00th=[ 63177], 90.00th=[ 85459], 95.00th=[110625], | 99.00th=[189793], 99.50th=[248513], 99.90th=[325059], 99.95th=[325059], | 99.99th=[325059] bw ( KiB/s): min= 31, max= 560, per=25.90%, avg=209.75, stdev=97.10, samples=61 iops : min= 1, max= 35, avg=12.31, stdev= 6.16, samples=61 lat (usec) : 50=0.65%, 100=5.86%, 250=1.30%, 500=0.13%, 1000=0.13% lat (msec) : 2=2.73%, 4=3.26%, 10=10.94%, 20=9.77%, 50=33.59% lat (msec) : 100=26.56%, 250=4.69%, 500=0.39% cpu : usr=0.10%, sys=6.56%, ctx=1593, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145599: Mon Aug 17 03:58:46 2026 read: IOPS=12, BW=207KiB/s (212kB/s)(6256KiB/30269msec) clat (usec): min=37, max=594140, avg=43325.85, stdev=43699.10 lat (usec): min=38, max=594142, avg=43346.80, stdev=43713.76 clat percentiles (usec): | 1.00th=[ 44], 5.00th=[ 60], 10.00th=[ 70], 20.00th=[ 127], | 30.00th=[ 26870], 40.00th=[ 33162], 50.00th=[ 39584], 60.00th=[ 47449], | 70.00th=[ 54264], 80.00th=[ 65799], 90.00th=[ 82314], 95.00th=[ 98042], | 99.00th=[154141], 99.50th=[244319], 99.90th=[591397], 99.95th=[591397], | 99.99th=[591397] bw ( KiB/s): min= 63, max= 442, per=26.79%, avg=206.25, stdev=84.63, samples=59 iops : min= 3, max= 27, avg=12.12, stdev= 5.38, samples=59 write: IOPS=12, BW=199KiB/s (204kB/s)(6032KiB/30269msec); 0 zone resets clat (usec): min=1675, max=282592, avg=34914.22, stdev=37270.81 lat (usec): min=1677, max=282595, avg=34916.61, stdev=37270.84 clat percentiles (usec): | 1.00th=[ 1876], 5.00th=[ 2212], 10.00th=[ 3425], 20.00th=[ 7177], | 30.00th=[ 10159], 40.00th=[ 14091], 50.00th=[ 22152], 60.00th=[ 32637], | 70.00th=[ 42206], 80.00th=[ 58983], 90.00th=[ 82314], 95.00th=[102237], | 99.00th=[158335], 99.50th=[270533], 99.90th=[283116], 99.95th=[283116], | 99.99th=[283116] bw ( KiB/s): min= 31, max= 415, per=24.12%, avg=195.37, stdev=87.99, samples=59 iops : min= 1, max= 25, avg=11.41, stdev= 5.57, samples=59 lat (usec) : 50=0.78%, 100=8.46%, 250=1.30%, 750=0.13% lat (msec) : 2=1.30%, 4=4.30%, 10=9.24%, 20=10.42%, 50=33.72% lat (msec) : 100=25.39%, 250=4.56%, 500=0.26%, 750=0.13% cpu : usr=0.14%, sys=6.58%, ctx=1491, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145600: Mon Aug 17 03:58:46 2026 read: IOPS=12, BW=201KiB/s (206kB/s)(6032KiB/29949msec) clat (usec): min=36, max=271713, avg=45105.27, stdev=35818.92 lat (usec): min=37, max=271714, avg=45106.71, stdev=35818.85 clat percentiles (usec): | 1.00th=[ 58], 5.00th=[ 64], 10.00th=[ 76], 20.00th=[ 11338], | 30.00th=[ 27919], 40.00th=[ 34341], 50.00th=[ 42206], 60.00th=[ 49546], | 70.00th=[ 57934], 80.00th=[ 69731], 90.00th=[ 88605], 95.00th=[103285], | 99.00th=[168821], 99.50th=[202376], 99.90th=[270533], 99.95th=[270533], | 99.99th=[270533] bw ( KiB/s): min= 63, max= 319, per=25.79%, avg=198.59, stdev=62.83, samples=58 iops : min= 3, max= 19, avg=11.62, stdev= 3.96, samples=58 write: IOPS=13, BW=209KiB/s (214kB/s)(6256KiB/29949msec); 0 zone resets clat (usec): min=1650, max=285333, avg=32600.96, stdev=36371.76 lat (usec): min=1652, max=285335, avg=32616.92, stdev=36371.47 clat percentiles (usec): | 1.00th=[ 1745], 5.00th=[ 1958], 10.00th=[ 3195], 20.00th=[ 6128], | 30.00th=[ 8356], 40.00th=[ 12518], 50.00th=[ 17957], 60.00th=[ 28443], | 70.00th=[ 38011], 80.00th=[ 58459], 90.00th=[ 78119], 95.00th=[ 99091], | 99.00th=[173016], 99.50th=[198181], 99.90th=[287310], 99.95th=[287310], | 99.99th=[287310] bw ( KiB/s): min= 31, max= 445, per=25.59%, avg=207.31, stdev=99.55, samples=58 iops : min= 1, max= 27, avg=12.14, stdev= 6.26, samples=58 lat (usec) : 50=0.13%, 100=7.03%, 250=2.08%, 500=0.39% lat (msec) : 2=2.86%, 4=3.52%, 10=11.85%, 20=8.98%, 50=31.51% lat (msec) : 100=26.56%, 250=4.82%, 500=0.26% cpu : usr=0.09%, sys=6.35%, ctx=1543, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=771KiB/s (789kB/s), 185KiB/s-207KiB/s (189kB/s-212kB/s), io=23.4MiB (24.5MB), run=29907-31082msec WRITE: bw=811KiB/s (830kB/s), 199KiB/s-213KiB/s (204kB/s-218kB/s), io=24.6MiB (25.8MB), run=29907-31082msec rand-rw: (groupid=0, jobs=1): err= 0: pid=145602: Mon Aug 17 03:59:27 2026 read: IOPS=5, BW=83.7KiB/s (85.7kB/s)(5920KiB/70708msec) clat (msec): min=7, max=326, avg=41.59, stdev=41.28 lat (msec): min=7, max=326, avg=41.59, stdev=41.28 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 15], 20.00th=[ 18], | 30.00th=[ 20], 40.00th=[ 23], 50.00th=[ 27], 60.00th=[ 31], | 70.00th=[ 40], 80.00th=[ 55], 90.00th=[ 91], 95.00th=[ 129], | 99.00th=[ 201], 99.50th=[ 243], 99.90th=[ 326], 99.95th=[ 326], | 99.99th=[ 326] bw ( KiB/s): min= 30, max= 318, per=28.07%, avg=94.89, stdev=58.93, samples=121 iops : min= 1, max= 19, avg= 5.16, stdev= 3.72, samples=121 write: IOPS=5, BW=90.1KiB/s (92.2kB/s)(6368KiB/70708msec); 0 zone resets clat (msec): min=38, max=452, avg=138.80, stdev=59.20 lat (msec): min=38, max=452, avg=138.81, stdev=59.20 clat percentiles (msec): | 1.00th=[ 47], 5.00th=[ 70], 10.00th=[ 78], 20.00th=[ 92], | 30.00th=[ 103], 40.00th=[ 114], 50.00th=[ 129], 60.00th=[ 142], | 70.00th=[ 157], 80.00th=[ 178], 90.00th=[ 209], 95.00th=[ 271], | 99.00th=[ 359], 99.50th=[ 376], 99.90th=[ 451], 99.95th=[ 451], | 99.99th=[ 451] bw ( KiB/s): min= 27, max= 191, per=25.31%, avg=89.86, stdev=40.33, samples=138 iops : min= 1, max= 11, avg= 4.83, stdev= 2.57, samples=138 lat (msec) : 10=1.04%, 20=13.80%, 50=22.92%, 100=20.57%, 250=38.67% lat (msec) : 500=2.99% cpu : usr=0.04%, sys=1.61%, ctx=1381, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145603: Mon Aug 17 03:59:27 2026 read: IOPS=5, BW=81.1KiB/s (83.0kB/s)(5744KiB/70836msec) clat (msec): min=8, max=325, avg=39.47, stdev=38.94 lat (msec): min=8, max=325, avg=39.47, stdev=38.94 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 17], | 30.00th=[ 21], 40.00th=[ 23], 50.00th=[ 27], 60.00th=[ 32], | 70.00th=[ 37], 80.00th=[ 50], 90.00th=[ 86], 95.00th=[ 121], | 99.00th=[ 203], 99.50th=[ 249], 99.90th=[ 326], 99.95th=[ 326], | 99.99th=[ 326] bw ( KiB/s): min= 27, max= 318, per=28.90%, avg=97.67, stdev=59.53, samples=116 iops : min= 1, max= 19, avg= 5.33, stdev= 3.79, samples=116 write: IOPS=5, BW=92.4KiB/s (94.6kB/s)(6544KiB/70836msec); 0 zone resets clat (msec): min=38, max=372, avg=138.33, stdev=61.27 lat (msec): min=38, max=372, avg=138.35, stdev=61.28 clat percentiles (msec): | 1.00th=[ 57], 5.00th=[ 67], 10.00th=[ 78], 20.00th=[ 89], | 30.00th=[ 101], 40.00th=[ 113], 50.00th=[ 125], 60.00th=[ 138], | 70.00th=[ 157], 80.00th=[ 178], 90.00th=[ 211], 95.00th=[ 275], | 99.00th=[ 351], 99.50th=[ 368], 99.90th=[ 372], 99.95th=[ 372], | 99.99th=[ 372] bw ( KiB/s): min= 27, max= 192, per=26.04%, avg=92.45, stdev=38.89, samples=139 iops : min= 1, max= 12, avg= 4.99, stdev= 2.49, samples=139 lat (msec) : 10=1.30%, 20=12.11%, 50=24.61%, 100=21.22%, 250=37.37% lat (msec) : 500=3.39% cpu : usr=0.04%, sys=1.45%, ctx=1352, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145604: Mon Aug 17 03:59:27 2026 read: IOPS=5, BW=89.1KiB/s (91.3kB/s)(6256KiB/70182msec) clat (msec): min=6, max=326, avg=38.12, stdev=36.87 lat (msec): min=6, max=326, avg=38.12, stdev=36.87 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 17], | 30.00th=[ 20], 40.00th=[ 24], 50.00th=[ 27], 60.00th=[ 31], | 70.00th=[ 37], 80.00th=[ 47], 90.00th=[ 77], 95.00th=[ 109], | 99.00th=[ 186], 99.50th=[ 262], 99.90th=[ 326], 99.95th=[ 326], | 99.99th=[ 326] bw ( KiB/s): min= 30, max= 319, per=28.80%, avg=97.33, stdev=69.69, samples=127 iops : min= 1, max= 19, avg= 5.29, stdev= 4.42, samples=127 write: IOPS=5, BW=85.9KiB/s (88.0kB/s)(6032KiB/70182msec); 0 zone resets clat (msec): min=41, max=668, avg=146.48, stdev=80.09 lat (msec): min=41, max=668, avg=146.49, stdev=80.09 clat percentiles (msec): | 1.00th=[ 53], 5.00th=[ 64], 10.00th=[ 74], 20.00th=[ 91], | 30.00th=[ 104], 40.00th=[ 114], 50.00th=[ 125], 60.00th=[ 140], | 70.00th=[ 159], 80.00th=[ 184], 90.00th=[ 241], 95.00th=[ 305], | 99.00th=[ 464], 99.50th=[ 659], 99.90th=[ 667], 99.95th=[ 667], | 99.99th=[ 667] bw ( KiB/s): min= 28, max= 191, per=24.38%, avg=86.54, stdev=38.52, samples=136 iops : min= 1, max= 11, avg= 4.62, stdev= 2.44, samples=136 lat (msec) : 10=1.04%, 20=14.58%, 50=25.65%, 100=19.40%, 250=34.38% lat (msec) : 500=4.69%, 750=0.26% cpu : usr=0.05%, sys=1.56%, ctx=1379, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145605: Mon Aug 17 03:59:27 2026 read: IOPS=5, BW=86.3KiB/s (88.4kB/s)(6032KiB/69876msec) clat (msec): min=8, max=295, avg=38.83, stdev=33.72 lat (msec): min=8, max=295, avg=38.83, stdev=33.72 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 13], 10.00th=[ 15], 20.00th=[ 18], | 30.00th=[ 22], 40.00th=[ 26], 50.00th=[ 29], 60.00th=[ 33], | 70.00th=[ 39], 80.00th=[ 50], 90.00th=[ 73], 95.00th=[ 118], | 99.00th=[ 163], 99.50th=[ 209], 99.90th=[ 296], 99.95th=[ 296], | 99.99th=[ 296] bw ( KiB/s): min= 30, max= 288, per=29.79%, avg=100.68, stdev=66.20, samples=117 iops : min= 1, max= 18, avg= 5.52, stdev= 4.17, samples=117 write: IOPS=5, BW=89.5KiB/s (91.7kB/s)(6256KiB/69876msec); 0 zone resets clat (msec): min=35, max=672, avg=141.17, stdev=68.49 lat (msec): min=35, max=672, avg=141.17, stdev=68.49 clat percentiles (msec): | 1.00th=[ 53], 5.00th=[ 70], 10.00th=[ 81], 20.00th=[ 93], | 30.00th=[ 104], 40.00th=[ 113], 50.00th=[ 124], 60.00th=[ 140], | 70.00th=[ 155], 80.00th=[ 178], 90.00th=[ 228], 95.00th=[ 257], | 99.00th=[ 422], 99.50th=[ 527], 99.90th=[ 676], 99.95th=[ 676], | 99.99th=[ 676] bw ( KiB/s): min= 29, max= 253, per=25.30%, avg=89.82, stdev=38.48, samples=137 iops : min= 1, max= 15, avg= 4.82, stdev= 2.43, samples=137 lat (msec) : 10=0.52%, 20=11.72%, 50=27.47%, 100=19.79%, 250=37.50% lat (msec) : 500=2.73%, 750=0.26% cpu : usr=0.04%, sys=1.57%, ctx=1424, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=338KiB/s (346kB/s), 81.1KiB/s-89.1KiB/s (83.0kB/s-91.3kB/s), io=23.4MiB (24.5MB), run=69876-70836msec WRITE: bw=356KiB/s (364kB/s), 85.9KiB/s-92.4KiB/s (88.0kB/s-94.6kB/s), io=24.6MiB (25.8MB), run=69876-70836msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=145632: Mon Aug 17 03:59:42 2026 read: IOPS=1, BW=1784KiB/s (1827kB/s)(7168KiB/4018msec) clat (usec): min=527, max=1373.7k, avg=308103.31, stdev=487181.23 lat (usec): min=528, max=1373.7k, avg=308104.97, stdev=487181.41 clat percentiles (usec): | 1.00th=[ 529], 5.00th=[ 529], 10.00th=[ 529], | 20.00th=[ 988], 30.00th=[ 4883], 40.00th=[ 4883], | 50.00th=[ 240124], 60.00th=[ 265290], 70.00th=[ 265290], | 80.00th=[ 270533], 90.00th=[1367344], 95.00th=[1367344], | 99.00th=[1367344], 99.50th=[1367344], 99.90th=[1367344], | 99.95th=[1367344], 99.99th=[1367344] bw ( KiB/s): min= 2000, max= 6131, per=95.41%, avg=3686.67, stdev=2167.22, samples=3 iops : min= 1, max= 5, avg= 2.67, stdev= 2.08, samples=3 write: IOPS=1, BW=1274KiB/s (1305kB/s)(5120KiB/4018msec); 0 zone resets clat (msec): min=124, max=1053, avg=349.19, stdev=400.65 lat (msec): min=124, max=1053, avg=349.25, stdev=400.65 clat percentiles (msec): | 1.00th=[ 125], 5.00th=[ 125], 10.00th=[ 125], 20.00th=[ 125], | 30.00th=[ 125], 40.00th=[ 125], 50.00th=[ 142], 60.00th=[ 142], | 70.00th=[ 305], 80.00th=[ 305], 90.00th=[ 1053], 95.00th=[ 1053], | 99.00th=[ 1053], 99.50th=[ 1053], 99.90th=[ 1053], 99.95th=[ 1053], | 99.99th=[ 1053] bw ( KiB/s): min= 2007, max= 6131, per=75.23%, avg=4069.00, stdev=2916.11, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 lat (usec) : 750=8.33%, 1000=8.33% lat (msec) : 10=8.33%, 250=33.33%, 500=25.00%, 2000=16.67% cpu : usr=0.00%, sys=12.35%, ctx=197, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145633: Mon Aug 17 03:59:42 2026 read: IOPS=0, BW=386KiB/s (396kB/s)(2048KiB/5300msec) clat (usec): min=565, max=229853, avg=115209.45, stdev=162131.70 lat (usec): min=567, max=229858, avg=115212.54, stdev=162133.23 clat percentiles (usec): | 1.00th=[ 562], 5.00th=[ 562], 10.00th=[ 562], 20.00th=[ 562], | 30.00th=[ 562], 40.00th=[ 562], 50.00th=[ 562], 60.00th=[229639], | 70.00th=[229639], 80.00th=[229639], 90.00th=[229639], 95.00th=[229639], | 99.00th=[229639], 99.50th=[229639], 99.90th=[229639], 99.95th=[229639], | 99.99th=[229639] bw ( KiB/s): min= 1440, max= 2043, per=45.07%, avg=1741.50, stdev=426.39, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1932KiB/s (1978kB/s)(10.0MiB/5300msec); 0 zone resets clat (msec): min=133, max=1743, avg=494.78, stdev=489.47 lat (msec): min=133, max=1743, avg=494.87, stdev=489.47 clat percentiles (msec): | 1.00th=[ 133], 5.00th=[ 133], 10.00th=[ 133], 20.00th=[ 159], | 30.00th=[ 190], 40.00th=[ 199], 50.00th=[ 264], 60.00th=[ 347], | 70.00th=[ 498], 80.00th=[ 701], 90.00th=[ 718], 95.00th=[ 1737], | 99.00th=[ 1737], 99.50th=[ 1737], 99.90th=[ 1737], 99.95th=[ 1737], | 99.99th=[ 1737] bw ( KiB/s): min= 1903, max= 4087, per=51.20%, avg=2769.20, stdev=1083.45, samples=5 iops : min= 1, max= 3, avg= 1.80, stdev= 1.10, samples=5 lat (usec) : 750=8.33% lat (msec) : 250=41.67%, 500=25.00%, 750=16.67%, 2000=8.33% cpu : usr=0.00%, sys=10.21%, ctx=140, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145635: Mon Aug 17 03:59:42 2026 read: IOPS=1, BW=1786KiB/s (1828kB/s)(6144KiB/3441msec) clat (msec): min=157, max=365, avg=227.52, stdev=81.79 lat (msec): min=157, max=365, avg=227.53, stdev=81.79 clat percentiles (msec): | 1.00th=[ 159], 5.00th=[ 159], 10.00th=[ 159], 20.00th=[ 169], | 30.00th=[ 169], 40.00th=[ 174], 50.00th=[ 174], 60.00th=[ 220], | 70.00th=[ 284], 80.00th=[ 284], 90.00th=[ 368], 95.00th=[ 368], | 99.00th=[ 368], 99.50th=[ 368], 99.90th=[ 368], 99.95th=[ 368], | 99.99th=[ 368] bw ( KiB/s): min= 2000, max= 4087, per=65.53%, avg=2532.25, stdev=1036.61, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 write: IOPS=1, BW=1786KiB/s (1828kB/s)(6144KiB/3441msec); 0 zone resets clat (msec): min=121, max=650, avg=339.70, stdev=181.71 lat (msec): min=122, max=650, avg=339.80, stdev=181.71 clat percentiles (msec): | 1.00th=[ 123], 5.00th=[ 123], 10.00th=[ 123], 20.00th=[ 236], | 30.00th=[ 236], 40.00th=[ 262], 50.00th=[ 262], 60.00th=[ 376], | 70.00th=[ 397], 80.00th=[ 397], 90.00th=[ 651], 95.00th=[ 651], | 99.00th=[ 651], 99.50th=[ 651], 99.90th=[ 651], 99.95th=[ 651], | 99.99th=[ 651] bw ( KiB/s): min= 2000, max= 4015, per=50.30%, avg=2720.50, stdev=944.67, samples=4 iops : min= 1, max= 3, avg= 1.75, stdev= 0.96, samples=4 lat (msec) : 250=50.00%, 500=41.67%, 750=8.33% cpu : usr=0.00%, sys=18.58%, ctx=296, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145636: Mon Aug 17 03:59:42 2026 read: IOPS=1, BW=1572KiB/s (1610kB/s)(5120KiB/3257msec) clat (usec): min=731, max=289573, avg=137271.70, stdev=131425.50 lat (usec): min=734, max=289574, avg=137273.54, stdev=131425.26 clat percentiles (usec): | 1.00th=[ 734], 5.00th=[ 734], 10.00th=[ 734], 20.00th=[ 734], | 30.00th=[ 832], 40.00th=[ 832], 50.00th=[170918], 60.00th=[170918], | 70.00th=[223347], 80.00th=[223347], 90.00th=[291505], 95.00th=[291505], | 99.00th=[291505], 99.50th=[291505], 99.90th=[291505], 99.95th=[291505], | 99.99th=[291505] bw ( KiB/s): min= 8000, max= 8000, per=100.00%, avg=8000.00, stdev= 0.00, samples=1 iops : min= 7, max= 7, avg= 7.00, stdev= 0.00, samples=1 write: IOPS=2, BW=2201KiB/s (2254kB/s)(7168KiB/3257msec); 0 zone resets clat (msec): min=173, max=676, avg=348.57, stdev=214.35 lat (msec): min=173, max=676, avg=348.65, stdev=214.35 clat percentiles (msec): | 1.00th=[ 174], 5.00th=[ 174], 10.00th=[ 174], 20.00th=[ 190], | 30.00th=[ 243], 40.00th=[ 243], 50.00th=[ 251], 60.00th=[ 268], | 70.00th=[ 268], 80.00th=[ 642], 90.00th=[ 676], 95.00th=[ 676], | 99.00th=[ 676], 99.50th=[ 676], 99.90th=[ 676], 99.95th=[ 676], | 99.99th=[ 676] bw ( KiB/s): min= 1446, max= 4071, per=43.74%, avg=2365.75, stdev=1165.06, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (usec) : 750=8.33%, 1000=8.33% lat (msec) : 250=41.67%, 500=25.00%, 750=16.67% cpu : usr=0.00%, sys=18.61%, ctx=136, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3864KiB/s (3957kB/s), 386KiB/s-1786KiB/s (396kB/s-1828kB/s), io=20.0MiB (20.0MB), run=3257-5300msec WRITE: bw=5410KiB/s (5540kB/s), 1274KiB/s-2201KiB/s (1305kB/s-2254kB/s), io=28.0MiB (29.4MB), run=3257-5300msec rand-rw: (groupid=0, jobs=1): err= 0: pid=145637: Mon Aug 17 03:59:43 2026 read: IOPS=1, BW=1373KiB/s (1406kB/s)(7168KiB/5219msec) clat (msec): min=94, max=1066, avg=288.33, stdev=350.41 lat (msec): min=94, max=1066, avg=288.34, stdev=350.41 clat percentiles (msec): | 1.00th=[ 94], 5.00th=[ 94], 10.00th=[ 94], 20.00th=[ 102], | 30.00th=[ 106], 40.00th=[ 106], 50.00th=[ 169], 60.00th=[ 182], | 70.00th=[ 182], 80.00th=[ 300], 90.00th=[ 1070], 95.00th=[ 1070], | 99.00th=[ 1070], 99.50th=[ 1070], 99.90th=[ 1070], 99.95th=[ 1070], | 99.99th=[ 1070] bw ( KiB/s): min= 1446, max= 4079, per=84.66%, avg=3144.33, stdev=1473.28, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 write: IOPS=0, BW=981KiB/s (1005kB/s)(5120KiB/5219msec); 0 zone resets clat (msec): min=134, max=1611, avg=612.47, stdev=578.04 lat (msec): min=134, max=1611, avg=612.55, stdev=578.04 clat percentiles (msec): | 1.00th=[ 136], 5.00th=[ 136], 10.00th=[ 136], 20.00th=[ 136], | 30.00th=[ 326], 40.00th=[ 326], 50.00th=[ 481], 60.00th=[ 481], | 70.00th=[ 514], 80.00th=[ 514], 90.00th=[ 1620], 95.00th=[ 1620], | 99.00th=[ 1620], 99.50th=[ 1620], 99.90th=[ 1620], 99.95th=[ 1620], | 99.99th=[ 1620] bw ( KiB/s): min= 2039, max= 2043, per=39.24%, avg=2040.33, stdev= 2.31, samples=3 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=3 lat (msec) : 100=8.33%, 250=41.67%, 500=25.00%, 750=8.33%, 2000=16.67% cpu : usr=0.00%, sys=3.70%, ctx=103, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145638: Mon Aug 17 03:59:43 2026 read: IOPS=0, BW=371KiB/s (380kB/s)(2048KiB/5514msec) clat (msec): min=107, max=204, avg=155.74, stdev=68.47 lat (msec): min=107, max=204, avg=155.74, stdev=68.47 clat percentiles (msec): | 1.00th=[ 108], 5.00th=[ 108], 10.00th=[ 108], 20.00th=[ 108], | 30.00th=[ 108], 40.00th=[ 108], 50.00th=[ 108], 60.00th=[ 205], | 70.00th=[ 205], 80.00th=[ 205], 90.00th=[ 205], 95.00th=[ 205], | 99.00th=[ 205], 99.50th=[ 205], 99.90th=[ 205], 99.95th=[ 205], | 99.99th=[ 205] bw ( KiB/s): min= 1484, max= 2043, per=47.48%, avg=1763.50, stdev=395.27, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1857KiB/s (1902kB/s)(10.0MiB/5514msec); 0 zone resets clat (msec): min=131, max=1716, avg=506.19, stdev=469.76 lat (msec): min=131, max=1716, avg=506.35, stdev=469.70 clat percentiles (msec): | 1.00th=[ 132], 5.00th=[ 132], 10.00th=[ 132], 20.00th=[ 213], | 30.00th=[ 245], 40.00th=[ 247], 50.00th=[ 292], 60.00th=[ 313], | 70.00th=[ 506], 80.00th=[ 676], 90.00th=[ 726], 95.00th=[ 1720], | 99.00th=[ 1720], 99.50th=[ 1720], 99.90th=[ 1720], 99.95th=[ 1720], | 99.99th=[ 1720] bw ( KiB/s): min= 2031, max= 4079, per=52.27%, avg=2717.67, stdev=1054.50, samples=6 iops : min= 1, max= 3, avg= 1.67, stdev= 1.03, samples=6 lat (msec) : 250=50.00%, 500=16.67%, 750=25.00%, 2000=8.33% cpu : usr=0.02%, sys=4.08%, ctx=83, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145639: Mon Aug 17 03:59:43 2026 read: IOPS=1, BW=1207KiB/s (1236kB/s)(6144KiB/5089msec) clat (msec): min=82, max=1444, avg=430.03, stdev=523.00 lat (msec): min=82, max=1444, avg=430.03, stdev=523.00 clat percentiles (msec): | 1.00th=[ 83], 5.00th=[ 83], 10.00th=[ 83], 20.00th=[ 88], | 30.00th=[ 88], 40.00th=[ 121], 50.00th=[ 121], 60.00th=[ 380], | 70.00th=[ 468], 80.00th=[ 468], 90.00th=[ 1452], 95.00th=[ 1452], | 99.00th=[ 1452], 99.50th=[ 1452], 99.90th=[ 1452], 99.95th=[ 1452], | 99.99th=[ 1452] bw ( KiB/s): min= 2031, max= 4079, per=68.63%, avg=2549.00, stdev=1020.02, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 write: IOPS=1, BW=1207KiB/s (1236kB/s)(6144KiB/5089msec); 0 zone resets clat (msec): min=153, max=1249, avg=397.58, stdev=419.76 lat (msec): min=153, max=1249, avg=397.73, stdev=419.74 clat percentiles (msec): | 1.00th=[ 153], 5.00th=[ 153], 10.00th=[ 153], 20.00th=[ 205], | 30.00th=[ 205], 40.00th=[ 243], 50.00th=[ 243], 60.00th=[ 251], | 70.00th=[ 284], 80.00th=[ 284], 90.00th=[ 1250], 95.00th=[ 1250], | 99.00th=[ 1250], 99.50th=[ 1250], 99.90th=[ 1250], 99.95th=[ 1250], | 99.99th=[ 1250] bw ( KiB/s): min= 2031, max= 4087, per=53.43%, avg=2778.00, stdev=973.25, samples=4 iops : min= 1, max= 3, avg= 1.75, stdev= 0.96, samples=4 lat (msec) : 100=16.67%, 250=33.33%, 500=33.33%, 2000=16.67% cpu : usr=0.00%, sys=3.05%, ctx=57, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145641: Mon Aug 17 03:59:43 2026 read: IOPS=1, BW=1165KiB/s (1193kB/s)(5120KiB/4395msec) clat (msec): min=68, max=572, avg=231.56, stdev=197.68 lat (msec): min=68, max=572, avg=231.57, stdev=197.68 clat percentiles (msec): | 1.00th=[ 68], 5.00th=[ 68], 10.00th=[ 68], 20.00th=[ 68], | 30.00th=[ 148], 40.00th=[ 148], 50.00th=[ 155], 60.00th=[ 155], | 70.00th=[ 215], 80.00th=[ 215], 90.00th=[ 575], 95.00th=[ 575], | 99.00th=[ 575], 99.50th=[ 575], 99.90th=[ 575], 99.95th=[ 575], | 99.99th=[ 575] bw ( KiB/s): min= 2039, max= 4031, per=72.81%, avg=2704.33, stdev=1148.93, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 write: IOPS=1, BW=1631KiB/s (1670kB/s)(7168KiB/4395msec); 0 zone resets clat (msec): min=242, max=1047, avg=441.92, stdev=274.32 lat (msec): min=242, max=1047, avg=442.17, stdev=274.42 clat percentiles (msec): | 1.00th=[ 243], 5.00th=[ 243], 10.00th=[ 243], 20.00th=[ 275], | 30.00th=[ 342], 40.00th=[ 342], 50.00th=[ 376], 60.00th=[ 397], | 70.00th=[ 397], 80.00th=[ 418], 90.00th=[ 1045], 95.00th=[ 1045], | 99.00th=[ 1045], 99.50th=[ 1045], 99.90th=[ 1045], 99.95th=[ 1045], | 99.99th=[ 1045] bw ( KiB/s): min= 1438, max= 4063, per=44.37%, avg=2306.60, stdev=1013.28, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 lat (msec) : 100=8.33%, 250=33.33%, 500=41.67%, 750=8.33%, 2000=8.33% cpu : usr=0.00%, sys=4.30%, ctx=75, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3714KiB/s (3803kB/s), 371KiB/s-1373KiB/s (380kB/s-1406kB/s), io=20.0MiB (20.0MB), run=4395-5514msec WRITE: bw=5200KiB/s (5325kB/s), 981KiB/s-1857KiB/s (1005kB/s-1902kB/s), io=28.0MiB (29.4MB), run=4395-5514msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=145648: Mon Aug 17 03:59:58 2026 read: IOPS=1, BW=4979KiB/s (5098kB/s)(12.0MiB/2468msec) clat (msec): min=632, max=1024, avg=800.53, stdev=201.88 lat (msec): min=632, max=1024, avg=800.53, stdev=201.88 clat percentiles (msec): | 1.00th=[ 634], 5.00th=[ 634], 10.00th=[ 634], 20.00th=[ 634], | 30.00th=[ 634], 40.00th=[ 743], 50.00th=[ 743], 60.00th=[ 743], | 70.00th=[ 1028], 80.00th=[ 1028], 90.00th=[ 1028], 95.00th=[ 1028], | 99.00th=[ 1028], 99.50th=[ 1028], 99.90th=[ 1028], 99.95th=[ 1028], | 99.99th=[ 1028] bw ( KiB/s): min= 8143, max= 8159, per=100.00%, avg=8151.00, stdev=11.31, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=66.67%, 2000=33.33% cpu : usr=0.00%, sys=12.28%, ctx=229, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145649: Mon Aug 17 03:59:58 2026 read: IOPS=0, BW=1256KiB/s (1286kB/s)(4096KiB/3261msec) clat (nsec): min=777288k, max=777288k, avg=777288050.00, stdev= 0.00 lat (nsec): min=777291k, max=777291k, avg=777290793.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 776], 5.00th=[ 776], 10.00th=[ 776], 20.00th=[ 776], | 30.00th=[ 776], 40.00th=[ 776], 50.00th=[ 776], 60.00th=[ 776], | 70.00th=[ 776], 80.00th=[ 776], 90.00th=[ 776], 95.00th=[ 776], | 99.00th=[ 776], 99.50th=[ 776], 99.90th=[ 776], 99.95th=[ 776], | 99.99th=[ 776] bw ( KiB/s): min= 8159, max= 8159, per=100.00%, avg=8159.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2512KiB/s (2572kB/s)(8192KiB/3261msec); 0 zone resets clat (msec): min=809, max=1617, avg=1213.48, stdev=571.88 lat (msec): min=810, max=1620, avg=1215.65, stdev=573.23 clat percentiles (msec): | 1.00th=[ 810], 5.00th=[ 810], 10.00th=[ 810], 20.00th=[ 810], | 30.00th=[ 810], 40.00th=[ 810], 50.00th=[ 810], 60.00th=[ 1620], | 70.00th=[ 1620], 80.00th=[ 1620], 90.00th=[ 1620], 95.00th=[ 1620], | 99.00th=[ 1620], 99.50th=[ 1620], 99.90th=[ 1620], 99.95th=[ 1620], | 99.99th=[ 1620] bw ( KiB/s): min= 8015, max= 8015, per=79.77%, avg=8015.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 1000=66.67%, 2000=33.33% cpu : usr=0.00%, sys=5.89%, ctx=161, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145650: Mon Aug 17 03:59:58 2026 write: IOPS=0, BW=3773KiB/s (3863kB/s)(12.0MiB/3257msec); 0 zone resets clat (msec): min=826, max=1331, avg=1070.14, stdev=253.00 lat (msec): min=826, max=1331, avg=1070.54, stdev=252.94 clat percentiles (msec): | 1.00th=[ 827], 5.00th=[ 827], 10.00th=[ 827], 20.00th=[ 827], | 30.00th=[ 827], 40.00th=[ 1053], 50.00th=[ 1053], 60.00th=[ 1053], | 70.00th=[ 1334], 80.00th=[ 1334], 90.00th=[ 1334], 95.00th=[ 1334], | 99.00th=[ 1334], 99.50th=[ 1334], 99.90th=[ 1334], 99.95th=[ 1334], | 99.99th=[ 1334] bw ( KiB/s): min= 8000, max= 8159, per=80.41%, avg=8079.50, stdev=112.43, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=33.33%, 2000=66.67% cpu : usr=0.06%, sys=3.69%, ctx=68, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145652: Mon Aug 17 03:59:58 2026 write: IOPS=1, BW=4901KiB/s (5019kB/s)(12.0MiB/2507msec); 0 zone resets clat (msec): min=329, max=1188, avg=795.15, stdev=433.99 lat (msec): min=331, max=1188, avg=795.99, stdev=433.40 clat percentiles (msec): | 1.00th=[ 330], 5.00th=[ 330], 10.00th=[ 330], 20.00th=[ 330], | 30.00th=[ 330], 40.00th=[ 869], 50.00th=[ 869], 60.00th=[ 869], | 70.00th=[ 1183], 80.00th=[ 1183], 90.00th=[ 1183], 95.00th=[ 1183], | 99.00th=[ 1183], 99.50th=[ 1183], 99.90th=[ 1183], 99.95th=[ 1183], | 99.99th=[ 1183] bw ( KiB/s): min= 8078, max= 8078, per=80.39%, avg=8078.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=7.58%, ctx=77, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5024KiB/s (5145kB/s), 1256KiB/s-4979KiB/s (1286kB/s-5098kB/s), io=16.0MiB (16.8MB), run=2468-3261msec WRITE: bw=9.81MiB/s (10.3MB/s), 2512KiB/s-4901KiB/s (2572kB/s-5019kB/s), io=32.0MiB (33.6MB), run=2507-3261msec rand-rw: (groupid=0, jobs=1): err= 0: pid=145653: Mon Aug 17 03:59:58 2026 read: IOPS=1, BW=6461KiB/s (6616kB/s)(12.0MiB/1902msec) clat (msec): min=455, max=914, avg=615.15, stdev=259.26 lat (msec): min=455, max=914, avg=615.15, stdev=259.26 clat percentiles (msec): | 1.00th=[ 456], 5.00th=[ 456], 10.00th=[ 456], 20.00th=[ 456], | 30.00th=[ 456], 40.00th=[ 477], 50.00th=[ 477], 60.00th=[ 477], | 70.00th=[ 911], 80.00th=[ 911], 90.00th=[ 911], 95.00th=[ 911], | 99.00th=[ 911], 99.50th=[ 911], 99.90th=[ 911], 99.95th=[ 911], | 99.99th=[ 911] bw ( KiB/s): min= 6977, max= 7816, per=100.00%, avg=7396.50, stdev=593.26, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=66.67%, 1000=33.33% cpu : usr=0.00%, sys=6.58%, ctx=89, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145654: Mon Aug 17 03:59:58 2026 read: IOPS=0, BW=1086KiB/s (1112kB/s)(4096KiB/3772msec) clat (nsec): min=1285.8M, max=1285.8M, avg=1285763635.00, stdev= 0.00 lat (nsec): min=1285.8M, max=1285.8M, avg=1285767006.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1284], 5.00th=[ 1284], 10.00th=[ 1284], 20.00th=[ 1284], | 30.00th=[ 1284], 40.00th=[ 1284], 50.00th=[ 1284], 60.00th=[ 1284], | 70.00th=[ 1284], 80.00th=[ 1284], 90.00th=[ 1284], 95.00th=[ 1284], | 99.00th=[ 1284], 99.50th=[ 1284], 99.90th=[ 1284], 99.95th=[ 1284], | 99.99th=[ 1284] bw ( KiB/s): min= 8159, max= 8159, per=100.00%, avg=8159.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2172KiB/s (2224kB/s)(8192KiB/3772msec); 0 zone resets clat (msec): min=1012, max=1404, avg=1208.27, stdev=277.21 lat (msec): min=1012, max=1404, avg=1208.58, stdev=277.24 clat percentiles (msec): | 1.00th=[ 1011], 5.00th=[ 1011], 10.00th=[ 1011], 20.00th=[ 1011], | 30.00th=[ 1011], 40.00th=[ 1011], 50.00th=[ 1011], 60.00th=[ 1401], | 70.00th=[ 1401], 80.00th=[ 1401], 90.00th=[ 1401], 95.00th=[ 1401], | 99.00th=[ 1401], 99.50th=[ 1401], 99.90th=[ 1401], 99.95th=[ 1401], | 99.99th=[ 1401] bw ( KiB/s): min= 7585, max= 7585, per=87.31%, avg=7585.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 2000=100.00% cpu : usr=0.00%, sys=3.47%, ctx=56, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145655: Mon Aug 17 03:59:58 2026 write: IOPS=0, BW=3310KiB/s (3390kB/s)(12.0MiB/3712msec); 0 zone resets clat (msec): min=316, max=1695, avg=1218.36, stdev=781.20 lat (msec): min=317, max=1695, avg=1218.71, stdev=781.13 clat percentiles (msec): | 1.00th=[ 317], 5.00th=[ 317], 10.00th=[ 317], 20.00th=[ 317], | 30.00th=[ 317], 40.00th=[ 1636], 50.00th=[ 1636], 60.00th=[ 1636], | 70.00th=[ 1703], 80.00th=[ 1703], 90.00th=[ 1703], 95.00th=[ 1703], | 99.00th=[ 1703], 99.50th=[ 1703], 99.90th=[ 1703], 99.95th=[ 1703], | 99.99th=[ 1703] bw ( KiB/s): min= 8159, max= 8159, per=93.92%, avg=8159.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.00%, sys=3.15%, ctx=54, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145656: Mon Aug 17 03:59:58 2026 write: IOPS=0, BW=3991KiB/s (4087kB/s)(12.0MiB/3079msec); 0 zone resets clat (msec): min=376, max=1641, avg=982.17, stdev=634.38 lat (msec): min=376, max=1642, avg=982.52, stdev=634.44 clat percentiles (msec): | 1.00th=[ 376], 5.00th=[ 376], 10.00th=[ 376], 20.00th=[ 376], | 30.00th=[ 376], 40.00th=[ 927], 50.00th=[ 927], 60.00th=[ 927], | 70.00th=[ 1636], 80.00th=[ 1636], 90.00th=[ 1636], 95.00th=[ 1636], | 99.00th=[ 1636], 99.50th=[ 1636], 99.90th=[ 1636], 99.95th=[ 1636], | 99.99th=[ 1636] bw ( KiB/s): min= 7585, max= 8143, per=90.53%, avg=7864.00, stdev=394.57, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=3.15%, ctx=46, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4344KiB/s (4448kB/s), 1086KiB/s-6461KiB/s (1112kB/s-6616kB/s), io=16.0MiB (16.8MB), run=1902-3772msec WRITE: bw=8687KiB/s (8896kB/s), 2172KiB/s-3991KiB/s (2224kB/s-4087kB/s), io=32.0MiB (33.6MB), run=3079-3772msec