== sanity test 398b: DIO and buffer IO race ============== 05:48:57 (1779097737) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 5.37014 s, 9.4 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144806: Mon May 18 05:51:18 2026 read: IOPS=12, BW=49.2KiB/s (50.4kB/s)(5992KiB/121675msec) clat (usec): min=28, max=938439, avg=40111.57, stdev=37326.05 lat (usec): min=28, max=938440, avg=40116.51, stdev=37327.50 clat percentiles (usec): | 1.00th=[ 48], 5.00th=[ 59], 10.00th=[ 9634], 20.00th=[ 19268], | 30.00th=[ 23987], 40.00th=[ 29230], 50.00th=[ 34341], 60.00th=[ 40633], | 70.00th=[ 47973], 80.00th=[ 57934], 90.00th=[ 73925], 95.00th=[ 88605], | 99.00th=[139461], 99.50th=[164627], 99.90th=[329253], 99.95th=[935330], | 99.99th=[935330] bw ( KiB/s): min= 7, max= 111, per=24.79%, avg=48.84, stdev=20.74, samples=238 iops : min= 1, max= 27, avg=11.57, stdev= 5.21, samples=238 write: IOPS=12, BW=51.7KiB/s (52.0kB/s)(6296KiB/121675msec); 0 zone resets clat (usec): min=1078, max=329745, avg=38944.66, stdev=39169.85 lat (usec): min=1079, max=329747, avg=38946.42, stdev=39169.74 clat percentiles (usec): | 1.00th=[ 1221], 5.00th=[ 1401], 10.00th=[ 2114], 20.00th=[ 5407], | 30.00th=[ 9896], 40.00th=[ 19006], 50.00th=[ 29492], 60.00th=[ 38536], | 70.00th=[ 50594], 80.00th=[ 66847], 90.00th=[ 87557], 95.00th=[112722], | 99.00th=[170918], 99.50th=[202376], 99.90th=[299893], 99.95th=[329253], | 99.99th=[329253] bw ( KiB/s): min= 7, max= 143, per=24.98%, avg=51.45, stdev=21.13, samples=238 iops : min= 1, max= 35, avg=12.21, stdev= 5.30, samples=238 lat (usec) : 50=0.72%, 100=3.39%, 250=0.20%, 500=0.07%, 750=0.10% lat (msec) : 2=4.98%, 4=3.55%, 10=7.39%, 20=10.74%, 50=39.55% lat (msec) : 100=24.02%, 250=5.05%, 500=0.23%, 1000=0.03% cpu : usr=0.07%, sys=5.57%, ctx=6613, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144808: Mon May 18 05:51:18 2026 read: IOPS=12, BW=49.2KiB/s (50.4kB/s)(5940KiB/120616msec) clat (usec): min=24, max=250499, avg=38555.58, stdev=28350.39 lat (usec): min=24, max=250500, avg=38556.78, stdev=28350.36 clat percentiles (usec): | 1.00th=[ 49], 5.00th=[ 59], 10.00th=[ 1287], 20.00th=[ 19006], | 30.00th=[ 24511], 40.00th=[ 29230], 50.00th=[ 34866], 60.00th=[ 39584], | 70.00th=[ 46400], 80.00th=[ 55837], 90.00th=[ 68682], 95.00th=[ 84411], | 99.00th=[143655], 99.50th=[179307], 99.90th=[246416], 99.95th=[250610], | 99.99th=[250610] bw ( KiB/s): min= 5, max= 126, per=24.67%, avg=48.60, stdev=21.74, samples=237 iops : min= 1, max= 31, avg=11.51, stdev= 5.46, samples=237 write: IOPS=13, BW=52.6KiB/s (53.9kB/s)(6348KiB/120616msec); 0 zone resets clat (usec): min=1068, max=866154, avg=39715.46, stdev=44803.27 lat (usec): min=1069, max=866156, avg=39719.28, stdev=44801.83 clat percentiles (usec): | 1.00th=[ 1221], 5.00th=[ 1369], 10.00th=[ 2089], 20.00th=[ 4817], | 30.00th=[ 8979], 40.00th=[ 19006], 50.00th=[ 28967], 60.00th=[ 40109], | 70.00th=[ 51643], 80.00th=[ 67634], 90.00th=[ 91751], 95.00th=[115868], | 99.00th=[175113], 99.50th=[212861], 99.90th=[371196], 99.95th=[868221], | 99.99th=[868221] bw ( KiB/s): min= 5, max= 126, per=25.20%, avg=51.92, stdev=19.83, samples=237 iops : min= 1, max= 31, avg=12.34, stdev= 4.98, samples=237 lat (usec) : 50=0.65%, 100=3.55%, 250=0.42%, 500=0.13%, 1000=0.07% lat (msec) : 2=4.98%, 4=4.10%, 10=7.52%, 20=9.99%, 50=39.81% lat (msec) : 100=23.27%, 250=5.37%, 500=0.10%, 1000=0.03% cpu : usr=0.07%, sys=5.73%, ctx=6604, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144809: Mon May 18 05:51:18 2026 read: IOPS=12, BW=49.8KiB/s (50.0kB/s)(6028KiB/121120msec) clat (usec): min=33, max=479698, avg=39071.15, stdev=32046.10 lat (usec): min=33, max=479699, avg=39076.90, stdev=32041.21 clat percentiles (usec): | 1.00th=[ 49], 5.00th=[ 59], 10.00th=[ 194], 20.00th=[ 18482], | 30.00th=[ 23725], 40.00th=[ 28181], 50.00th=[ 33424], 60.00th=[ 40109], | 70.00th=[ 47449], 80.00th=[ 56886], 90.00th=[ 73925], 95.00th=[ 86508], | 99.00th=[143655], 99.50th=[202376], 99.90th=[346031], 99.95th=[480248], | 99.99th=[480248] bw ( KiB/s): min= 7, max= 102, per=25.20%, avg=49.65, stdev=19.68, samples=236 iops : min= 1, max= 25, avg=11.77, stdev= 4.94, samples=236 write: IOPS=12, BW=51.7KiB/s (52.9kB/s)(6260KiB/121120msec); 0 zone resets clat (usec): min=1115, max=959292, avg=39530.62, stdev=47204.97 lat (usec): min=1116, max=959295, avg=39533.76, stdev=47204.19 clat percentiles (usec): | 1.00th=[ 1205], 5.00th=[ 1352], 10.00th=[ 1860], 20.00th=[ 4621], | 30.00th=[ 8979], 40.00th=[ 19530], 50.00th=[ 29492], 60.00th=[ 39060], | 70.00th=[ 49546], 80.00th=[ 66323], 90.00th=[ 92799], 95.00th=[111674], | 99.00th=[170918], 99.50th=[221250], 99.90th=[549454], 99.95th=[960496], | 99.99th=[960496] bw ( KiB/s): min= 7, max= 127, per=24.91%, avg=51.32, stdev=21.27, samples=237 iops : min= 1, max= 31, avg=12.19, stdev= 5.33, samples=237 lat (usec) : 50=0.68%, 100=3.87%, 250=0.39%, 500=0.07%, 1000=0.03% lat (msec) : 2=5.57%, 4=3.87%, 10=6.93%, 20=10.48%, 50=39.68% lat (msec) : 100=23.08%, 250=5.08%, 500=0.20%, 750=0.03%, 1000=0.03% cpu : usr=0.08%, sys=5.59%, ctx=6612, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144810: Mon May 18 05:51:18 2026 read: IOPS=12, BW=50.3KiB/s (51.5kB/s)(6052KiB/120302msec) clat (usec): min=33, max=403935, avg=38879.17, stdev=30994.06 lat (usec): min=33, max=403936, avg=38885.43, stdev=30992.50 clat percentiles (usec): | 1.00th=[ 49], 5.00th=[ 59], 10.00th=[ 9896], 20.00th=[ 17957], | 30.00th=[ 23462], 40.00th=[ 28705], 50.00th=[ 33162], 60.00th=[ 39060], | 70.00th=[ 46400], 80.00th=[ 55837], 90.00th=[ 72877], 95.00th=[ 87557], | 99.00th=[137364], 99.50th=[198181], 99.90th=[329253], 99.95th=[404751], | 99.99th=[404751] bw ( KiB/s): min= 7, max= 103, per=25.63%, avg=50.49, stdev=20.28, samples=234 iops : min= 1, max= 25, avg=11.97, stdev= 5.11, samples=234 write: IOPS=12, BW=51.8KiB/s (53.1kB/s)(6236KiB/120302msec); 0 zone resets clat (usec): min=991, max=875984, avg=39270.85, stdev=44570.19 lat (usec): min=992, max=875985, avg=39272.41, stdev=44570.23 clat percentiles (usec): | 1.00th=[ 1205], 5.00th=[ 1352], 10.00th=[ 1893], 20.00th=[ 4817], | 30.00th=[ 10290], 40.00th=[ 19530], 50.00th=[ 29230], 60.00th=[ 38536], | 70.00th=[ 52167], 80.00th=[ 66323], 90.00th=[ 89654], 95.00th=[109577], | 99.00th=[158335], 99.50th=[179307], 99.90th=[476054], 99.95th=[876610], | 99.99th=[876610] bw ( KiB/s): min= 8, max= 149, per=24.91%, avg=51.31, stdev=21.34, samples=237 iops : min= 2, max= 37, avg=12.19, stdev= 5.36, samples=237 lat (usec) : 50=0.65%, 100=3.65%, 250=0.20%, 500=0.07%, 750=0.03% lat (usec) : 1000=0.10% lat (msec) : 2=5.47%, 4=3.78%, 10=5.96%, 20=12.24%, 50=38.61% lat (msec) : 100=24.02%, 250=5.08%, 500=0.13%, 1000=0.03% cpu : usr=0.08%, sys=5.56%, ctx=6667, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=197KiB/s (202kB/s), 49.2KiB/s-50.3KiB/s (50.4kB/s-51.5kB/s), io=23.4MiB (24.6MB), run=120302-121675msec WRITE: bw=207KiB/s (212kB/s), 51.7KiB/s-52.6KiB/s (52.9kB/s-53.9kB/s), io=24.6MiB (25.7MB), run=120302-121675msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144803: Mon May 18 05:54:21 2026 read: IOPS=4, BW=19.8KiB/s (20.2kB/s)(5992KiB/303095msec) clat (msec): min=5, max=966, avg=39.29, stdev=39.76 lat (msec): min=5, max=966, avg=39.29, stdev=39.76 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 13], 20.00th=[ 17], | 30.00th=[ 21], 40.00th=[ 25], 50.00th=[ 30], 60.00th=[ 36], | 70.00th=[ 43], 80.00th=[ 55], 90.00th=[ 78], 95.00th=[ 96], | 99.00th=[ 171], 99.50th=[ 205], 99.90th=[ 363], 99.95th=[ 969], | 99.99th=[ 969] bw ( KiB/s): min= 7, max= 88, per=28.75%, avg=22.43, stdev=13.73, samples=514 iops : min= 1, max= 22, avg= 4.98, stdev= 3.48, samples=514 write: IOPS=5, BW=20.8KiB/s (21.3kB/s)(6296KiB/303095msec); 0 zone resets clat (msec): min=36, max=1051, avg=154.97, stdev=67.81 lat (msec): min=36, max=1051, avg=154.98, stdev=67.81 clat percentiles (msec): | 1.00th=[ 53], 5.00th=[ 72], 10.00th=[ 85], 20.00th=[ 102], | 30.00th=[ 117], 40.00th=[ 130], 50.00th=[ 144], 60.00th=[ 161], | 70.00th=[ 178], 80.00th=[ 201], 90.00th=[ 236], 95.00th=[ 271], | 99.00th=[ 368], 99.50th=[ 414], 99.90th=[ 684], 99.95th=[ 1053], | 99.99th=[ 1053] bw ( KiB/s): min= 7, max= 48, per=24.85%, avg=20.38, stdev= 8.20, samples=592 iops : min= 1, max= 12, avg= 4.47, stdev= 2.11, samples=592 lat (msec) : 10=2.54%, 20=11.91%, 50=23.05%, 100=18.82%, 250=39.94% lat (msec) : 500=3.65%, 750=0.03%, 1000=0.03%, 2000=0.03% cpu : usr=0.04%, sys=1.21%, ctx=5248, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144804: Mon May 18 05:54:21 2026 read: IOPS=4, BW=19.5KiB/s (19.0kB/s)(5940KiB/304270msec) clat (msec): min=5, max=889, avg=39.89, stdev=40.33 lat (msec): min=5, max=889, avg=39.89, stdev=40.33 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 18], | 30.00th=[ 22], 40.00th=[ 25], 50.00th=[ 30], 60.00th=[ 36], | 70.00th=[ 44], 80.00th=[ 55], 90.00th=[ 74], 95.00th=[ 99], | 99.00th=[ 184], 99.50th=[ 224], 99.90th=[ 363], 99.95th=[ 894], | 99.99th=[ 894] bw ( KiB/s): min= 7, max= 80, per=28.65%, avg=22.35, stdev=14.38, samples=512 iops : min= 1, max= 20, avg= 4.97, stdev= 3.66, samples=512 write: IOPS=5, BW=20.9KiB/s (21.4kB/s)(6348KiB/304270msec); 0 zone resets clat (msec): min=31, max=741, avg=154.22, stdev=64.71 lat (msec): min=31, max=741, avg=154.22, stdev=64.71 clat percentiles (msec): | 1.00th=[ 51], 5.00th=[ 71], 10.00th=[ 83], 20.00th=[ 102], | 30.00th=[ 115], 40.00th=[ 131], 50.00th=[ 144], 60.00th=[ 161], | 70.00th=[ 180], 80.00th=[ 205], 90.00th=[ 236], 95.00th=[ 266], | 99.00th=[ 351], 99.50th=[ 401], 99.90th=[ 481], 99.95th=[ 743], | 99.99th=[ 743] bw ( KiB/s): min= 7, max= 48, per=24.80%, avg=20.33, stdev= 8.31, samples=599 iops : min= 1, max= 12, avg= 4.46, stdev= 2.13, samples=599 lat (msec) : 10=2.21%, 20=11.17%, 50=23.67%, 100=19.04%, 250=39.81% lat (msec) : 500=4.04%, 750=0.03%, 1000=0.03% cpu : usr=0.04%, sys=1.24%, ctx=5446, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144805: Mon May 18 05:54:21 2026 read: IOPS=4, BW=19.8KiB/s (20.3kB/s)(6028KiB/304295msec) clat (msec): min=5, max=340, avg=40.86, stdev=33.64 lat (msec): min=5, max=340, avg=40.86, stdev=33.64 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 14], 20.00th=[ 18], | 30.00th=[ 22], 40.00th=[ 26], 50.00th=[ 32], 60.00th=[ 38], | 70.00th=[ 45], 80.00th=[ 57], 90.00th=[ 81], 95.00th=[ 104], | 99.00th=[ 161], 99.50th=[ 218], 99.90th=[ 305], 99.95th=[ 342], | 99.99th=[ 342] bw ( KiB/s): min= 7, max= 103, per=28.03%, avg=21.86, stdev=14.08, samples=530 iops : min= 1, max= 25, avg= 4.84, stdev= 3.53, samples=530 write: IOPS=5, BW=20.6KiB/s (21.1kB/s)(6260KiB/304295msec); 0 zone resets clat (msec): min=34, max=945, avg=154.89, stdev=68.53 lat (msec): min=34, max=945, avg=154.89, stdev=68.53 clat percentiles (msec): | 1.00th=[ 50], 5.00th=[ 71], 10.00th=[ 84], 20.00th=[ 101], | 30.00th=[ 116], 40.00th=[ 131], 50.00th=[ 146], 60.00th=[ 159], | 70.00th=[ 180], 80.00th=[ 201], 90.00th=[ 239], 95.00th=[ 271], | 99.00th=[ 342], 99.50th=[ 405], 99.90th=[ 894], 99.95th=[ 944], | 99.99th=[ 944] bw ( KiB/s): min= 7, max= 47, per=24.74%, avg=20.28, stdev= 8.33, samples=592 iops : min= 1, max= 11, avg= 4.45, stdev= 2.15, samples=592 lat (msec) : 10=1.89%, 20=10.55%, 50=24.61%, 100=19.30%, 250=39.62% lat (msec) : 500=3.94%, 750=0.03%, 1000=0.07% cpu : usr=0.04%, sys=1.29%, ctx=5365, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144807: Mon May 18 05:54:21 2026 read: IOPS=4, BW=19.9KiB/s (20.4kB/s)(6052KiB/303376msec) clat (msec): min=5, max=330, avg=39.08, stdev=32.50 lat (msec): min=5, max=330, avg=39.08, stdev=32.50 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 17], | 30.00th=[ 21], 40.00th=[ 25], 50.00th=[ 30], 60.00th=[ 36], | 70.00th=[ 44], 80.00th=[ 56], 90.00th=[ 75], 95.00th=[ 100], | 99.00th=[ 163], 99.50th=[ 205], 99.90th=[ 275], 99.95th=[ 330], | 99.99th=[ 330] bw ( KiB/s): min= 7, max= 80, per=29.72%, avg=23.18, stdev=14.72, samples=503 iops : min= 1, max= 20, avg= 5.17, stdev= 3.71, samples=503 write: IOPS=5, BW=20.6KiB/s (21.0kB/s)(6236KiB/303376msec); 0 zone resets clat (msec): min=34, max=940, avg=156.49, stdev=66.45 lat (msec): min=34, max=940, avg=156.49, stdev=66.45 clat percentiles (msec): | 1.00th=[ 48], 5.00th=[ 73], 10.00th=[ 85], 20.00th=[ 105], | 30.00th=[ 120], 40.00th=[ 133], 50.00th=[ 148], 60.00th=[ 161], | 70.00th=[ 180], 80.00th=[ 203], 90.00th=[ 236], 95.00th=[ 271], | 99.00th=[ 347], 99.50th=[ 409], 99.90th=[ 625], 99.95th=[ 944], | 99.99th=[ 944] bw ( KiB/s): min= 7, max= 48, per=24.46%, avg=20.05, stdev= 8.01, samples=595 iops : min= 1, max= 12, avg= 4.39, stdev= 2.05, samples=595 lat (msec) : 10=2.02%, 20=12.30%, 50=23.44%, 100=17.68%, 250=40.76% lat (msec) : 500=3.71%, 750=0.07%, 1000=0.03% cpu : usr=0.03%, sys=1.20%, ctx=5286, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=78.9KiB/s (80.8kB/s), 19.5KiB/s-19.9KiB/s (19.0kB/s-20.4kB/s), io=23.4MiB (24.6MB), run=303095-304295msec WRITE: bw=82.6KiB/s (84.6kB/s), 20.6KiB/s-20.9KiB/s (21.0kB/s-21.4kB/s), io=24.6MiB (25.7MB), run=303095-304295msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144871: Mon May 18 05:55:02 2026 read: IOPS=13, BW=210KiB/s (215kB/s)(5920KiB/28178msec) clat (usec): min=39, max=315867, avg=38755.38, stdev=36563.74 lat (usec): min=39, max=315868, avg=38757.85, stdev=36562.91 clat percentiles (usec): | 1.00th=[ 46], 5.00th=[ 56], 10.00th=[ 61], 20.00th=[ 86], | 30.00th=[ 18220], 40.00th=[ 28181], 50.00th=[ 34866], 60.00th=[ 42206], | 70.00th=[ 49546], 80.00th=[ 62653], 90.00th=[ 83362], 95.00th=[ 99091], | 99.00th=[145753], 99.50th=[258999], 99.90th=[316670], 99.95th=[316670], | 99.99th=[316670] bw ( KiB/s): min= 31, max= 495, per=24.38%, avg=207.20, stdev=80.70, samples=55 iops : min= 1, max= 30, avg=12.20, stdev= 5.09, samples=55 write: IOPS=14, BW=226KiB/s (231kB/s)(6368KiB/28178msec); 0 zone resets clat (usec): min=1474, max=282049, avg=34383.04, stdev=36827.75 lat (usec): min=1476, max=282050, avg=34386.59, stdev=36829.57 clat percentiles (usec): | 1.00th=[ 1565], 5.00th=[ 1909], 10.00th=[ 2638], 20.00th=[ 5014], | 30.00th=[ 7308], 40.00th=[ 13042], 50.00th=[ 20317], 60.00th=[ 31589], | 70.00th=[ 45876], 80.00th=[ 61604], 90.00th=[ 86508], 95.00th=[106431], | 99.00th=[154141], 99.50th=[198181], 99.90th=[283116], 99.95th=[283116], | 99.99th=[283116] bw ( KiB/s): min= 61, max= 475, per=25.15%, avg=224.84, stdev=91.98, samples=55 iops : min= 3, max= 29, avg=13.33, stdev= 5.83, samples=55 lat (usec) : 50=1.04%, 100=9.38%, 250=0.65%, 750=0.39%, 1000=0.13% lat (msec) : 2=3.65%, 4=4.95%, 10=11.07%, 20=9.51%, 50=31.25% lat (msec) : 100=22.53%, 250=5.08%, 500=0.39% cpu : usr=0.06%, sys=6.19%, ctx=1486, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144872: Mon May 18 05:55:02 2026 read: IOPS=13, BW=214KiB/s (219kB/s)(5744KiB/26838msec) clat (usec): min=39, max=267628, avg=38234.67, stdev=32953.10 lat (usec): min=40, max=267629, avg=38235.89, stdev=32953.11 clat percentiles (usec): | 1.00th=[ 44], 5.00th=[ 57], 10.00th=[ 64], 20.00th=[ 131], | 30.00th=[ 22414], 40.00th=[ 29230], 50.00th=[ 34341], 60.00th=[ 40633], | 70.00th=[ 49546], 80.00th=[ 59507], 90.00th=[ 78119], 95.00th=[ 90702], | 99.00th=[143655], 99.50th=[202376], 99.90th=[267387], 99.95th=[267387], | 99.99th=[267387] bw ( KiB/s): min= 63, max= 378, per=25.20%, avg=214.21, stdev=69.91, samples=53 iops : min= 3, max= 23, avg=12.64, stdev= 4.44, samples=53 write: IOPS=15, BW=244KiB/s (250kB/s)(6544KiB/26838msec); 0 zone resets clat (usec): min=1534, max=258508, avg=31919.21, stdev=36003.37 lat (usec): min=1534, max=258509, avg=31922.32, stdev=36003.19 clat percentiles (usec): | 1.00th=[ 1598], 5.00th=[ 1893], 10.00th=[ 2311], 20.00th=[ 4146], | 30.00th=[ 6915], 40.00th=[ 10814], 50.00th=[ 17171], 60.00th=[ 26870], | 70.00th=[ 39060], 80.00th=[ 60031], 90.00th=[ 85459], 95.00th=[108528], | 99.00th=[145753], 99.50th=[156238], 99.90th=[258999], 99.95th=[258999], | 99.99th=[258999] bw ( KiB/s): min= 63, max= 542, per=27.22%, avg=243.36, stdev=104.14, samples=53 iops : min= 3, max= 33, avg=14.49, stdev= 6.55, samples=53 lat (usec) : 50=1.04%, 100=8.20%, 250=0.26%, 500=0.13%, 750=0.13% lat (msec) : 2=3.78%, 4=6.64%, 10=10.55%, 20=10.55%, 50=32.03% lat (msec) : 100=22.14%, 250=4.30%, 500=0.26% cpu : usr=0.10%, sys=6.82%, ctx=1360, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144873: Mon May 18 05:55:02 2026 read: IOPS=14, BW=232KiB/s (237kB/s)(6256KiB/26991msec) clat (usec): min=36, max=185251, avg=37322.79, stdev=31351.61 lat (usec): min=37, max=185253, avg=37386.41, stdev=31301.56 clat percentiles (usec): | 1.00th=[ 39], 5.00th=[ 56], 10.00th=[ 62], 20.00th=[ 102], | 30.00th=[ 18744], 40.00th=[ 28443], 50.00th=[ 34866], 60.00th=[ 42730], | 70.00th=[ 50594], 80.00th=[ 58459], 90.00th=[ 77071], 95.00th=[ 90702], | 99.00th=[143655], 99.50th=[170918], 99.90th=[185598], 99.95th=[185598], | 99.99th=[185598] bw ( KiB/s): min= 92, max= 433, per=27.36%, avg=232.53, stdev=94.12, samples=53 iops : min= 5, max= 27, avg=13.79, stdev= 5.92, samples=53 write: IOPS=13, BW=223KiB/s (229kB/s)(6032KiB/26991msec); 0 zone resets clat (usec): min=1500, max=288536, avg=32330.06, stdev=37458.23 lat (usec): min=1501, max=288538, avg=32341.75, stdev=37456.76 clat percentiles (usec): | 1.00th=[ 1614], 5.00th=[ 1876], 10.00th=[ 2835], 20.00th=[ 4883], | 30.00th=[ 7046], 40.00th=[ 11338], 50.00th=[ 16057], 60.00th=[ 26870], | 70.00th=[ 42206], 80.00th=[ 56361], 90.00th=[ 82314], 95.00th=[102237], | 99.00th=[177210], 99.50th=[189793], 99.90th=[287310], 99.95th=[287310], | 99.99th=[287310] bw ( KiB/s): min= 92, max= 415, per=24.70%, avg=220.81, stdev=76.38, samples=53 iops : min= 5, max= 25, avg=13.06, stdev= 4.85, samples=53 lat (usec) : 50=1.30%, 100=8.85%, 250=1.17%, 500=0.26%, 750=0.13% lat (msec) : 2=2.99%, 4=5.86%, 10=10.16%, 20=12.11%, 50=29.56% lat (msec) : 100=23.31%, 250=4.17%, 500=0.13% cpu : usr=0.08%, sys=6.37%, ctx=1433, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144874: Mon May 18 05:55:02 2026 read: IOPS=14, BW=229KiB/s (234kB/s)(6032KiB/26363msec) clat (usec): min=34, max=180762, avg=35276.39, stdev=32263.53 lat (usec): min=34, max=180763, avg=35299.21, stdev=32242.88 clat percentiles (usec): | 1.00th=[ 36], 5.00th=[ 50], 10.00th=[ 59], 20.00th=[ 77], | 30.00th=[ 16581], 40.00th=[ 23987], 50.00th=[ 32637], 60.00th=[ 39060], | 70.00th=[ 48497], 80.00th=[ 57410], 90.00th=[ 74974], 95.00th=[ 92799], | 99.00th=[143655], 99.50th=[177210], 99.90th=[181404], 99.95th=[181404], | 99.99th=[181404] bw ( KiB/s): min= 62, max= 444, per=26.88%, avg=228.48, stdev=85.62, samples=52 iops : min= 3, max= 27, avg=13.56, stdev= 5.43, samples=52 write: IOPS=14, BW=237KiB/s (243kB/s)(6256KiB/26363msec); 0 zone resets clat (usec): min=1515, max=299263, avg=32841.09, stdev=40635.10 lat (usec): min=1517, max=299266, avg=32844.45, stdev=40634.59 clat percentiles (usec): | 1.00th=[ 1598], 5.00th=[ 1795], 10.00th=[ 2474], 20.00th=[ 4293], | 30.00th=[ 6587], 40.00th=[ 10945], 50.00th=[ 17695], 60.00th=[ 27919], | 70.00th=[ 40633], 80.00th=[ 56361], 90.00th=[ 78119], 95.00th=[107480], | 99.00th=[217056], 99.50th=[278922], 99.90th=[299893], 99.95th=[299893], | 99.99th=[299893] bw ( KiB/s): min= 31, max= 573, per=26.59%, avg=237.75, stdev=101.68, samples=52 iops : min= 1, max= 35, avg=14.13, stdev= 6.37, samples=52 lat (usec) : 50=2.34%, 100=9.24%, 250=1.04%, 500=0.39%, 750=0.39% lat (usec) : 1000=0.13% lat (msec) : 2=3.91%, 4=4.95%, 10=10.42%, 20=10.16%, 50=30.86% lat (msec) : 100=21.48%, 250=4.43%, 500=0.26% cpu : usr=0.10%, sys=6.63%, ctx=1392, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=850KiB/s (870kB/s), 210KiB/s-232KiB/s (215kB/s-237kB/s), io=23.4MiB (24.5MB), run=26363-28178msec WRITE: bw=894KiB/s (916kB/s), 223KiB/s-244KiB/s (229kB/s-250kB/s), io=24.6MiB (25.8MB), run=26363-28178msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144876: Mon May 18 05:55:53 2026 read: IOPS=4, BW=76.2KiB/s (78.0kB/s)(5920KiB/77692msec) clat (msec): min=8, max=297, avg=43.30, stdev=44.05 lat (msec): min=8, max=297, avg=43.30, stdev=44.05 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 18], | 30.00th=[ 23], 40.00th=[ 26], 50.00th=[ 30], 60.00th=[ 35], | 70.00th=[ 43], 80.00th=[ 55], 90.00th=[ 81], 95.00th=[ 124], | 99.00th=[ 259], 99.50th=[ 284], 99.90th=[ 296], 99.95th=[ 296], | 99.99th=[ 296] bw ( KiB/s): min= 30, max= 317, per=28.93%, avg=88.53, stdev=57.23, samples=130 iops : min= 1, max= 19, avg= 4.77, stdev= 3.58, samples=130 write: IOPS=5, BW=81.0KiB/s (83.9kB/s)(6368KiB/77692msec); 0 zone resets clat (msec): min=38, max=508, avg=154.81, stdev=68.06 lat (msec): min=38, max=508, avg=154.82, stdev=68.06 clat percentiles (msec): | 1.00th=[ 43], 5.00th=[ 67], 10.00th=[ 83], 20.00th=[ 102], | 30.00th=[ 115], 40.00th=[ 129], 50.00th=[ 144], 60.00th=[ 161], | 70.00th=[ 176], 80.00th=[ 199], 90.00th=[ 243], 95.00th=[ 279], | 99.00th=[ 397], 99.50th=[ 485], 99.90th=[ 510], 99.95th=[ 510], | 99.99th=[ 510] bw ( KiB/s): min= 29, max= 223, per=25.79%, avg=82.79, stdev=33.99, samples=150 iops : min= 1, max= 13, avg= 4.39, stdev= 2.17, samples=150 lat (msec) : 10=0.91%, 20=11.20%, 50=25.26%, 100=16.93%, 250=40.76% lat (msec) : 500=4.82%, 750=0.13% cpu : usr=0.03%, sys=1.31%, ctx=1363, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144878: Mon May 18 05:55:53 2026 read: IOPS=4, BW=73.4KiB/s (75.2kB/s)(5744KiB/78261msec) clat (msec): min=7, max=338, avg=43.22, stdev=39.72 lat (msec): min=7, max=338, avg=43.22, stdev=39.72 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 19], | 30.00th=[ 23], 40.00th=[ 26], 50.00th=[ 33], 60.00th=[ 37], | 70.00th=[ 43], 80.00th=[ 58], 90.00th=[ 84], 95.00th=[ 123], | 99.00th=[ 192], 99.50th=[ 288], 99.90th=[ 338], 99.95th=[ 338], | 99.99th=[ 338] bw ( KiB/s): min= 30, max= 310, per=27.96%, avg=85.55, stdev=57.80, samples=130 iops : min= 1, max= 19, avg= 4.58, stdev= 3.66, samples=130 write: IOPS=5, BW=83.6KiB/s (85.6kB/s)(6544KiB/78261msec); 0 zone resets clat (msec): min=34, max=446, avg=153.27, stdev=67.29 lat (msec): min=34, max=446, avg=153.28, stdev=67.29 clat percentiles (msec): | 1.00th=[ 43], 5.00th=[ 63], 10.00th=[ 78], 20.00th=[ 99], | 30.00th=[ 112], 40.00th=[ 128], 50.00th=[ 144], 60.00th=[ 161], | 70.00th=[ 180], 80.00th=[ 203], 90.00th=[ 245], 95.00th=[ 284], | 99.00th=[ 363], 99.50th=[ 363], 99.90th=[ 447], 99.95th=[ 447], | 99.99th=[ 447] bw ( KiB/s): min= 30, max= 255, per=26.16%, avg=83.97, stdev=35.94, samples=151 iops : min= 1, max= 15, avg= 4.46, stdev= 2.28, samples=151 lat (msec) : 10=1.30%, 20=9.90%, 50=25.78%, 100=17.84%, 250=40.62% lat (msec) : 500=4.56% cpu : usr=0.02%, sys=1.34%, ctx=1364, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144879: Mon May 18 05:55:53 2026 read: IOPS=5, BW=82.1KiB/s (84.1kB/s)(6256KiB/76165msec) clat (msec): min=8, max=307, avg=39.65, stdev=31.69 lat (msec): min=8, max=307, avg=39.65, stdev=31.69 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 13], 10.00th=[ 15], 20.00th=[ 20], | 30.00th=[ 24], 40.00th=[ 27], 50.00th=[ 31], 60.00th=[ 35], | 70.00th=[ 42], 80.00th=[ 51], 90.00th=[ 75], 95.00th=[ 95], | 99.00th=[ 182], 99.50th=[ 192], 99.90th=[ 309], 99.95th=[ 309], | 99.99th=[ 309] bw ( KiB/s): min= 30, max= 288, per=30.27%, avg=92.62, stdev=61.04, samples=133 iops : min= 1, max= 18, avg= 5.04, stdev= 3.87, samples=133 write: IOPS=4, BW=79.2KiB/s (81.1kB/s)(6032KiB/76165msec); 0 zone resets clat (msec): min=44, max=443, avg=160.79, stdev=64.23 lat (msec): min=44, max=443, avg=160.80, stdev=64.23 clat percentiles (msec): | 1.00th=[ 52], 5.00th=[ 73], 10.00th=[ 90], 20.00th=[ 108], | 30.00th=[ 123], 40.00th=[ 133], 50.00th=[ 153], 60.00th=[ 171], | 70.00th=[ 186], 80.00th=[ 207], 90.00th=[ 247], 95.00th=[ 288], | 99.00th=[ 342], 99.50th=[ 363], 99.90th=[ 443], 99.95th=[ 443], | 99.99th=[ 443] bw ( KiB/s): min= 31, max= 159, per=24.42%, avg=78.37, stdev=29.33, samples=150 iops : min= 1, max= 9, avg= 4.11, stdev= 1.92, samples=150 lat (msec) : 10=0.78%, 20=10.16%, 50=29.56%, 100=15.89%, 250=39.32% lat (msec) : 500=4.30% cpu : usr=0.03%, sys=1.41%, ctx=1401, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144880: Mon May 18 05:55:53 2026 read: IOPS=4, BW=78.7KiB/s (80.6kB/s)(6032KiB/76601msec) clat (msec): min=7, max=346, avg=39.83, stdev=35.64 lat (msec): min=7, max=346, avg=39.83, stdev=35.64 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 19], | 30.00th=[ 22], 40.00th=[ 26], 50.00th=[ 29], 60.00th=[ 34], | 70.00th=[ 41], 80.00th=[ 52], 90.00th=[ 81], 95.00th=[ 118], | 99.00th=[ 176], 99.50th=[ 257], 99.90th=[ 347], 99.95th=[ 347], | 99.99th=[ 347] bw ( KiB/s): min= 31, max= 255, per=30.52%, avg=93.40, stdev=53.33, samples=126 iops : min= 1, max= 15, avg= 5.04, stdev= 3.37, samples=126 write: IOPS=5, BW=81.7KiB/s (83.6kB/s)(6256KiB/76601msec); 0 zone resets clat (msec): min=36, max=449, avg=157.35, stdev=61.95 lat (msec): min=36, max=449, avg=157.35, stdev=61.95 clat percentiles (msec): | 1.00th=[ 54], 5.00th=[ 77], 10.00th=[ 88], 20.00th=[ 109], | 30.00th=[ 122], 40.00th=[ 136], 50.00th=[ 148], 60.00th=[ 163], | 70.00th=[ 180], 80.00th=[ 201], 90.00th=[ 241], 95.00th=[ 284], | 99.00th=[ 355], 99.50th=[ 397], 99.90th=[ 451], 99.95th=[ 451], | 99.99th=[ 451] bw ( KiB/s): min= 31, max= 159, per=25.28%, avg=81.15, stdev=29.06, samples=151 iops : min= 1, max= 9, avg= 4.29, stdev= 1.89, samples=151 lat (msec) : 10=0.78%, 20=10.81%, 50=27.47%, 100=14.71%, 250=42.06% lat (msec) : 500=4.17% cpu : usr=0.04%, sys=1.27%, ctx=1310, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=306KiB/s (313kB/s), 73.4KiB/s-82.1KiB/s (75.2kB/s-84.1kB/s), io=23.4MiB (24.5MB), run=76165-78261msec WRITE: bw=322KiB/s (330kB/s), 79.2KiB/s-83.6KiB/s (81.1kB/s-85.6kB/s), io=24.6MiB (25.8MB), run=76165-78261msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144897: Mon May 18 05:56:09 2026 read: IOPS=1, BW=1122KiB/s (1149kB/s)(7168KiB/6389msec) clat (usec): min=850, max=3677.2k, avg=662932.71, stdev=1336184.40 lat (usec): min=851, max=3677.2k, avg=662934.30, stdev=1336184.50 clat percentiles (usec): | 1.00th=[ 848], 5.00th=[ 848], 10.00th=[ 848], | 20.00th=[ 13435], 30.00th=[ 129500], 40.00th=[ 129500], | 50.00th=[ 141558], 60.00th=[ 325059], 70.00th=[ 325059], | 80.00th=[ 354419], 90.00th=[3674211], 95.00th=[3674211], | 99.00th=[3674211], 99.50th=[3674211], 99.90th=[3674211], | 99.95th=[3674211], 99.99th=[3674211] bw ( KiB/s): min= 1988, max= 4031, per=100.00%, avg=2768.50, stdev=962.48, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 0.82, samples=4 write: IOPS=0, BW=801KiB/s (821kB/s)(5120KiB/6389msec); 0 zone resets clat (msec): min=198, max=393, avg=310.02, stdev=78.44 lat (msec): min=199, max=393, avg=310.13, stdev=78.42 clat percentiles (msec): | 1.00th=[ 199], 5.00th=[ 199], 10.00th=[ 199], 20.00th=[ 199], | 30.00th=[ 288], 40.00th=[ 288], 50.00th=[ 292], 60.00th=[ 292], | 70.00th=[ 376], 80.00th=[ 376], 90.00th=[ 393], 95.00th=[ 393], | 99.00th=[ 393], 99.50th=[ 393], 99.90th=[ 393], 99.95th=[ 393], | 99.99th=[ 393] bw ( KiB/s): min= 1992, max= 4096, per=73.16%, avg=2707.67, stdev=1202.52, samples=3 iops : min= 1, max= 4, avg= 2.00, stdev= 1.73, samples=3 lat (usec) : 1000=8.33% lat (msec) : 20=8.33%, 250=25.00%, 500=50.00%, >=2000=8.33% cpu : usr=0.02%, sys=9.44%, ctx=693, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144898: Mon May 18 05:56:09 2026 read: IOPS=0, BW=264KiB/s (271kB/s)(2048KiB/7747msec) clat (usec): min=960, max=3693.3k, avg=1847118.00, stdev=2610860.88 lat (usec): min=961, max=3693.3k, avg=1847119.85, stdev=2610861.71 clat percentiles (usec): | 1.00th=[ 963], 5.00th=[ 963], 10.00th=[ 963], | 20.00th=[ 963], 30.00th=[ 963], 40.00th=[ 963], | 50.00th=[ 963], 60.00th=[3707765], 70.00th=[3707765], | 80.00th=[3707765], 90.00th=[3707765], 95.00th=[3707765], | 99.00th=[3707765], 99.50th=[3707765], 99.90th=[3707765], | 99.95th=[3707765], 99.99th=[3707765] bw ( KiB/s): min= 1988, max= 1992, per=75.29%, avg=1990.00, stdev= 2.83, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1322KiB/s (1354kB/s)(10.0MiB/7747msec); 0 zone resets clat (msec): min=103, max=733, avg=400.98, stdev=225.03 lat (msec): min=103, max=733, avg=401.30, stdev=225.01 clat percentiles (msec): | 1.00th=[ 104], 5.00th=[ 104], 10.00th=[ 104], 20.00th=[ 203], | 30.00th=[ 213], 40.00th=[ 247], 50.00th=[ 296], 60.00th=[ 384], | 70.00th=[ 535], 80.00th=[ 609], 90.00th=[ 693], 95.00th=[ 735], | 99.00th=[ 735], 99.50th=[ 735], 99.90th=[ 735], 99.95th=[ 735], | 99.99th=[ 735] bw ( KiB/s): min= 1992, max= 4071, per=87.48%, avg=3237.60, stdev=1119.46, samples=5 iops : min= 1, max= 3, avg= 2.20, stdev= 1.10, samples=5 lat (usec) : 1000=8.33% lat (msec) : 250=33.33%, 500=16.67%, 750=33.33%, >=2000=8.33% cpu : usr=0.00%, sys=8.46%, ctx=558, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144899: Mon May 18 05:56:09 2026 read: IOPS=0, BW=939KiB/s (961kB/s)(6144KiB/6546msec) clat (usec): min=563, max=400515, avg=174974.26, stdev=195540.32 lat (usec): min=565, max=400516, avg=174975.55, stdev=195540.28 clat percentiles (usec): | 1.00th=[ 562], 5.00th=[ 562], 10.00th=[ 562], 20.00th=[ 652], | 30.00th=[ 652], 40.00th=[ 1004], 50.00th=[ 1004], 60.00th=[274727], | 70.00th=[375391], 80.00th=[375391], 90.00th=[400557], 95.00th=[400557], | 99.00th=[400557], 99.50th=[400557], 99.90th=[400557], 99.95th=[400557], | 99.99th=[400557] bw ( KiB/s): min= 2048, max= 4031, per=100.00%, avg=3354.33, stdev=1131.56, samples=3 iops : min= 2, max= 3, avg= 2.67, stdev= 0.58, samples=3 write: IOPS=0, BW=939KiB/s (961kB/s)(6144KiB/6546msec); 0 zone resets clat (msec): min=120, max=3860, avg=901.63, stdev=1464.15 lat (msec): min=120, max=3860, avg=901.70, stdev=1464.16 clat percentiles (msec): | 1.00th=[ 122], 5.00th=[ 122], 10.00th=[ 122], 20.00th=[ 161], | 30.00th=[ 161], 40.00th=[ 174], 50.00th=[ 174], 60.00th=[ 443], | 70.00th=[ 651], 80.00th=[ 651], 90.00th=[ 3876], 95.00th=[ 3876], | 99.00th=[ 3876], 99.50th=[ 3876], 99.90th=[ 3876], 99.95th=[ 3876], | 99.99th=[ 3876] bw ( KiB/s): min= 2015, max= 3984, per=89.84%, avg=3325.00, stdev=1134.50, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 lat (usec) : 750=16.67% lat (msec) : 2=8.33%, 250=25.00%, 500=33.33%, 750=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=6.26%, ctx=164, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144900: Mon May 18 05:56:09 2026 read: IOPS=0, BW=794KiB/s (813kB/s)(5120KiB/6451msec) clat (usec): min=433, max=309982, avg=75215.83, stdev=134075.87 lat (usec): min=434, max=309983, avg=75217.46, stdev=134075.86 clat percentiles (usec): | 1.00th=[ 433], 5.00th=[ 433], 10.00th=[ 433], 20.00th=[ 433], | 30.00th=[ 709], 40.00th=[ 709], 50.00th=[ 906], 60.00th=[ 906], | 70.00th=[ 64226], 80.00th=[ 64226], 90.00th=[308282], 95.00th=[308282], | 99.00th=[308282], 99.50th=[308282], 99.90th=[308282], 99.95th=[308282], | 99.99th=[308282] bw ( KiB/s): min= 7968, max= 7968, per=100.00%, avg=7968.00, stdev= 0.00, samples=1 iops : min= 7, max= 7, avg= 7.00, stdev= 0.00, samples=1 write: IOPS=1, BW=1111KiB/s (1138kB/s)(7168KiB/6451msec); 0 zone resets clat (msec): min=189, max=3836, avg=861.07, stdev=1319.42 lat (msec): min=189, max=3836, avg=861.18, stdev=1319.43 clat percentiles (msec): | 1.00th=[ 190], 5.00th=[ 190], 10.00th=[ 190], 20.00th=[ 222], | 30.00th=[ 271], 40.00th=[ 271], 50.00th=[ 460], 60.00th=[ 523], | 70.00th=[ 523], 80.00th=[ 527], 90.00th=[ 3842], 95.00th=[ 3842], | 99.00th=[ 3842], 99.50th=[ 3842], 99.90th=[ 3842], 99.95th=[ 3842], | 99.99th=[ 3842] bw ( KiB/s): min= 1988, max= 4031, per=68.24%, avg=2525.50, stdev=1004.00, samples=4 iops : min= 1, max= 3, avg= 1.75, stdev= 0.96, samples=4 lat (usec) : 500=8.33%, 750=8.33%, 1000=8.33% lat (msec) : 100=8.33%, 250=16.67%, 500=25.00%, 750=16.67%, >=2000=8.33% cpu : usr=0.00%, sys=7.09%, ctx=120, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2644KiB/s (2707kB/s), 264KiB/s-1122KiB/s (271kB/s-1149kB/s), io=20.0MiB (20.0MB), run=6389-7747msec WRITE: bw=3701KiB/s (3790kB/s), 801KiB/s-1322KiB/s (821kB/s-1354kB/s), io=28.0MiB (29.4MB), run=6389-7747msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144902: Mon May 18 05:56:10 2026 read: IOPS=0, BW=1013KiB/s (1037kB/s)(7168KiB/7075msec) clat (msec): min=68, max=3544, avg=772.38, stdev=1260.02 lat (msec): min=68, max=3544, avg=772.39, stdev=1260.02 clat percentiles (msec): | 1.00th=[ 68], 5.00th=[ 68], 10.00th=[ 68], 20.00th=[ 86], | 30.00th=[ 115], 40.00th=[ 115], 50.00th=[ 190], 60.00th=[ 489], | 70.00th=[ 489], 80.00th=[ 919], 90.00th=[ 3540], 95.00th=[ 3540], | 99.00th=[ 3540], 99.50th=[ 3540], 99.90th=[ 3540], 99.95th=[ 3540], | 99.99th=[ 3540] bw ( KiB/s): min= 1848, max= 3828, per=90.15%, avg=2430.50, stdev=935.33, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 write: IOPS=0, BW=724KiB/s (741kB/s)(5120KiB/7075msec); 0 zone resets clat (msec): min=220, max=584, avg=331.45, stdev=149.34 lat (msec): min=220, max=585, avg=331.57, stdev=149.34 clat percentiles (msec): | 1.00th=[ 220], 5.00th=[ 220], 10.00th=[ 220], 20.00th=[ 220], | 30.00th=[ 228], 40.00th=[ 228], 50.00th=[ 292], 60.00th=[ 292], | 70.00th=[ 334], 80.00th=[ 334], 90.00th=[ 584], 95.00th=[ 584], | 99.00th=[ 584], 99.50th=[ 584], 99.90th=[ 584], 99.95th=[ 584], | 99.99th=[ 584] bw ( KiB/s): min= 1848, max= 4087, per=70.46%, avg=2659.33, stdev=1240.23, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (msec) : 100=16.67%, 250=33.33%, 500=25.00%, 750=8.33%, 1000=8.33% lat (msec) : >=2000=8.33% cpu : usr=0.00%, sys=3.01%, ctx=81, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144903: Mon May 18 05:56:10 2026 read: IOPS=0, BW=271KiB/s (277kB/s)(2048KiB/7559msec) clat (msec): min=77, max=3194, avg=1635.95, stdev=2203.63 lat (msec): min=77, max=3194, avg=1635.96, stdev=2203.63 clat percentiles (msec): | 1.00th=[ 79], 5.00th=[ 79], 10.00th=[ 79], 20.00th=[ 79], | 30.00th=[ 79], 40.00th=[ 79], 50.00th=[ 79], 60.00th=[ 3205], | 70.00th=[ 3205], 80.00th=[ 3205], 90.00th=[ 3205], 95.00th=[ 3205], | 99.00th=[ 3205], 99.50th=[ 3205], 99.90th=[ 3205], 99.95th=[ 3205], | 99.99th=[ 3205] bw ( KiB/s): min= 2015, max= 2043, per=75.26%, avg=2029.00, stdev=19.80, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1355KiB/s (1387kB/s)(10.0MiB/7559msec); 0 zone resets clat (msec): min=162, max=1066, avg=421.36, stdev=257.26 lat (msec): min=162, max=1067, avg=421.64, stdev=257.65 clat percentiles (msec): | 1.00th=[ 163], 5.00th=[ 163], 10.00th=[ 163], 20.00th=[ 243], | 30.00th=[ 249], 40.00th=[ 284], 50.00th=[ 372], 60.00th=[ 376], | 70.00th=[ 401], 80.00th=[ 502], 90.00th=[ 567], 95.00th=[ 1070], | 99.00th=[ 1070], 99.50th=[ 1070], 99.90th=[ 1070], 99.95th=[ 1070], | 99.99th=[ 1070] bw ( KiB/s): min= 1848, max= 4087, per=70.63%, avg=2665.67, stdev=1094.23, samples=6 iops : min= 1, max= 3, avg= 1.67, stdev= 1.03, samples=6 lat (msec) : 100=8.33%, 250=25.00%, 500=41.67%, 750=8.33%, 2000=8.33% lat (msec) : >=2000=8.33% cpu : usr=0.01%, sys=2.96%, ctx=91, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144904: Mon May 18 05:56:10 2026 read: IOPS=0, BW=874KiB/s (895kB/s)(6144KiB/7033msec) clat (msec): min=65, max=233, avg=124.96, stdev=58.86 lat (msec): min=65, max=233, avg=124.96, stdev=58.86 clat percentiles (msec): | 1.00th=[ 66], 5.00th=[ 66], 10.00th=[ 66], 20.00th=[ 92], | 30.00th=[ 92], 40.00th=[ 97], 50.00th=[ 97], 60.00th=[ 130], | 70.00th=[ 133], 80.00th=[ 133], 90.00th=[ 234], 95.00th=[ 234], | 99.00th=[ 234], 99.50th=[ 234], 99.90th=[ 234], 99.95th=[ 234], | 99.99th=[ 234] bw ( KiB/s): min= 1848, max= 4087, per=91.73%, avg=2473.00, stdev=1079.04, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 write: IOPS=0, BW=874KiB/s (895kB/s)(6144KiB/7033msec); 0 zone resets clat (msec): min=237, max=3722, avg=1039.26, stdev=1332.68 lat (msec): min=237, max=3722, avg=1039.35, stdev=1332.70 clat percentiles (msec): | 1.00th=[ 239], 5.00th=[ 239], 10.00th=[ 239], 20.00th=[ 326], | 30.00th=[ 326], 40.00th=[ 456], 50.00th=[ 456], 60.00th=[ 659], | 70.00th=[ 835], 80.00th=[ 835], 90.00th=[ 3708], 95.00th=[ 3708], | 99.00th=[ 3708], 99.50th=[ 3708], 99.90th=[ 3708], 99.95th=[ 3708], | 99.99th=[ 3708] bw ( KiB/s): min= 1848, max= 2043, per=52.99%, avg=2000.00, stdev=85.13, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 lat (msec) : 100=25.00%, 250=33.33%, 500=16.67%, 750=8.33%, 1000=8.33% lat (msec) : >=2000=8.33% cpu : usr=0.00%, sys=2.49%, ctx=56, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144905: Mon May 18 05:56:10 2026 read: IOPS=0, BW=674KiB/s (690kB/s)(5120KiB/7596msec) clat (msec): min=78, max=355, avg=194.76, stdev=112.28 lat (msec): min=78, max=355, avg=194.76, stdev=112.28 clat percentiles (msec): | 1.00th=[ 80], 5.00th=[ 80], 10.00th=[ 80], 20.00th=[ 80], | 30.00th=[ 111], 40.00th=[ 111], 50.00th=[ 176], 60.00th=[ 176], | 70.00th=[ 253], 80.00th=[ 253], 90.00th=[ 355], 95.00th=[ 355], | 99.00th=[ 355], 99.50th=[ 355], 99.90th=[ 355], 99.95th=[ 355], | 99.99th=[ 355] bw ( KiB/s): min= 4087, max= 4087, per=100.00%, avg=4087.00, stdev= 0.00, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 write: IOPS=0, BW=944KiB/s (966kB/s)(7168KiB/7596msec); 0 zone resets clat (msec): min=139, max=3683, avg=942.83, stdev=1242.70 lat (msec): min=139, max=3684, avg=943.09, stdev=1243.01 clat percentiles (msec): | 1.00th=[ 140], 5.00th=[ 140], 10.00th=[ 140], 20.00th=[ 232], | 30.00th=[ 380], 40.00th=[ 380], 50.00th=[ 502], 60.00th=[ 659], | 70.00th=[ 659], 80.00th=[ 1011], 90.00th=[ 3675], 95.00th=[ 3675], | 99.00th=[ 3675], 99.50th=[ 3675], 99.90th=[ 3675], 99.95th=[ 3675], | 99.99th=[ 3675] bw ( KiB/s): min= 1848, max= 3828, per=64.59%, avg=2437.50, stdev=931.27, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (msec) : 100=8.33%, 250=33.33%, 500=25.00%, 750=16.67%, 2000=8.33% lat (msec) : >=2000=8.33% cpu : usr=0.00%, sys=2.49%, ctx=72, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2696KiB/s (2761kB/s), 271KiB/s-1013KiB/s (277kB/s-1037kB/s), io=20.0MiB (20.0MB), run=7033-7596msec WRITE: bw=3775KiB/s (3865kB/s), 724KiB/s-1355KiB/s (741kB/s-1387kB/s), io=28.0MiB (29.4MB), run=7033-7596msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144912: Mon May 18 05:56:23 2026 read: IOPS=1, BW=4136KiB/s (4235kB/s)(12.0MiB/2971msec) clat (msec): min=595, max=1225, avg=966.19, stdev=329.25 lat (msec): min=595, max=1225, avg=966.19, stdev=329.25 clat percentiles (msec): | 1.00th=[ 600], 5.00th=[ 600], 10.00th=[ 600], 20.00th=[ 600], | 30.00th=[ 600], 40.00th=[ 1083], 50.00th=[ 1083], 60.00th=[ 1083], | 70.00th=[ 1234], 80.00th=[ 1234], 90.00th=[ 1234], 95.00th=[ 1234], | 99.00th=[ 1234], 99.50th=[ 1234], 99.90th=[ 1234], 99.95th=[ 1234], | 99.99th=[ 1234] bw ( KiB/s): min= 7876, max= 8192, per=100.00%, avg=8034.00, stdev=223.45, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 750=33.33%, 2000=66.67% cpu : usr=0.00%, sys=3.27%, ctx=56, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144913: Mon May 18 05:56:23 2026 read: IOPS=0, BW=2052KiB/s (2101kB/s)(4096KiB/1996msec) clat (nsec): min=321637k, max=321637k, avg=321636818.00, stdev= 0.00 lat (nsec): min=321639k, max=321639k, avg=321638871.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 321], 5.00th=[ 321], 10.00th=[ 321], 20.00th=[ 321], | 30.00th=[ 321], 40.00th=[ 321], 50.00th=[ 321], 60.00th=[ 321], | 70.00th=[ 321], 80.00th=[ 321], 90.00th=[ 321], 95.00th=[ 321], | 99.00th=[ 321], 99.50th=[ 321], 99.90th=[ 321], 99.95th=[ 321], | 99.99th=[ 321] bw ( KiB/s): min= 6660, max= 6660, per=100.00%, avg=6660.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=1, BW=4104KiB/s (4203kB/s)(8192KiB/1996msec); 0 zone resets clat (msec): min=655, max=934, avg=794.76, stdev=197.32 lat (msec): min=657, max=934, avg=796.33, stdev=195.78 clat percentiles (msec): | 1.00th=[ 659], 5.00th=[ 659], 10.00th=[ 659], 20.00th=[ 659], | 30.00th=[ 659], 40.00th=[ 659], 50.00th=[ 659], 60.00th=[ 936], | 70.00th=[ 936], 80.00th=[ 936], 90.00th=[ 936], 95.00th=[ 936], | 99.00th=[ 936], 99.50th=[ 936], 99.90th=[ 936], 99.95th=[ 936], | 99.99th=[ 936] bw ( KiB/s): min= 8110, max= 8110, per=49.77%, avg=8110.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 750=33.33%, 1000=33.33% cpu : usr=0.05%, sys=5.36%, ctx=81, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144914: Mon May 18 05:56:23 2026 write: IOPS=1, BW=6110KiB/s (6257kB/s)(12.0MiB/2011msec); 0 zone resets clat (msec): min=537, max=770, avg=637.87, stdev=119.98 lat (msec): min=538, max=772, avg=639.83, stdev=119.89 clat percentiles (msec): | 1.00th=[ 542], 5.00th=[ 542], 10.00th=[ 542], 20.00th=[ 542], | 30.00th=[ 542], 40.00th=[ 609], 50.00th=[ 609], 60.00th=[ 609], | 70.00th=[ 768], 80.00th=[ 768], 90.00th=[ 768], 95.00th=[ 768], | 99.00th=[ 768], 99.50th=[ 768], 99.90th=[ 768], 99.95th=[ 768], | 99.99th=[ 768] bw ( KiB/s): min= 8110, max= 8192, per=50.02%, avg=8151.00, stdev=57.98, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 750=66.67%, 1000=33.33% cpu : usr=0.00%, sys=4.83%, ctx=46, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144915: Mon May 18 05:56:23 2026 write: IOPS=1, BW=7297KiB/s (7472kB/s)(12.0MiB/1684msec); 0 zone resets clat (msec): min=401, max=616, avg=520.82, stdev=109.16 lat (msec): min=402, max=624, avg=523.77, stdev=112.42 clat percentiles (msec): | 1.00th=[ 401], 5.00th=[ 401], 10.00th=[ 401], 20.00th=[ 401], | 30.00th=[ 401], 40.00th=[ 542], 50.00th=[ 542], 60.00th=[ 542], | 70.00th=[ 617], 80.00th=[ 617], 90.00th=[ 617], 95.00th=[ 617], | 99.00th=[ 617], 99.50th=[ 617], 99.90th=[ 617], 99.95th=[ 617], | 99.99th=[ 617] bw ( KiB/s): min= 6168, max= 8110, per=43.81%, avg=7139.00, stdev=1373.20, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 750=66.67% cpu : usr=0.00%, sys=6.60%, ctx=54, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5515KiB/s (5647kB/s), 2052KiB/s-4136KiB/s (2101kB/s-4235kB/s), io=16.0MiB (16.8MB), run=1996-2971msec WRITE: bw=15.9MiB/s (16.7MB/s), 4104KiB/s-7297KiB/s (4203kB/s-7472kB/s), io=32.0MiB (33.6MB), run=1684-2011msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144918: Mon May 18 05:56:26 2026 read: IOPS=0, BW=3777KiB/s (3868kB/s)(12.0MiB/3253msec) clat (msec): min=1023, max=1178, avg=1083.96, stdev=82.89 lat (msec): min=1023, max=1178, avg=1083.96, stdev=82.89 clat percentiles (msec): | 1.00th=[ 1020], 5.00th=[ 1020], 10.00th=[ 1020], 20.00th=[ 1020], | 30.00th=[ 1020], 40.00th=[ 1053], 50.00th=[ 1053], 60.00th=[ 1053], | 70.00th=[ 1183], 80.00th=[ 1183], 90.00th=[ 1183], 95.00th=[ 1183], | 99.00th=[ 1183], 99.50th=[ 1183], 99.90th=[ 1183], 99.95th=[ 1183], | 99.99th=[ 1183] bw ( KiB/s): min= 7816, max= 7984, per=100.00%, avg=7900.00, stdev=118.79, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 2000=100.00% cpu : usr=0.00%, sys=10.76%, ctx=212, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144919: Mon May 18 05:56:26 2026 read: IOPS=0, BW=1358KiB/s (1391kB/s)(4096KiB/3016msec) clat (nsec): min=924496k, max=924496k, avg=924495712.00, stdev= 0.00 lat (nsec): min=924498k, max=924498k, avg=924498160.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 927], 5.00th=[ 927], 10.00th=[ 927], 20.00th=[ 927], | 30.00th=[ 927], 40.00th=[ 927], 50.00th=[ 927], 60.00th=[ 927], | 70.00th=[ 927], 80.00th=[ 927], 90.00th=[ 927], 95.00th=[ 927], | 99.00th=[ 927], 99.50th=[ 927], 99.90th=[ 927], 99.95th=[ 927], | 99.99th=[ 927] bw ( KiB/s): min= 7816, max= 7816, per=100.00%, avg=7816.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2716KiB/s (2781kB/s)(8192KiB/3016msec); 0 zone resets clat (msec): min=937, max=1148, avg=1042.93, stdev=149.70 lat (msec): min=937, max=1149, avg=1043.36, stdev=149.69 clat percentiles (msec): | 1.00th=[ 936], 5.00th=[ 936], 10.00th=[ 936], 20.00th=[ 936], | 30.00th=[ 936], 40.00th=[ 936], 50.00th=[ 936], 60.00th=[ 1150], | 70.00th=[ 1150], 80.00th=[ 1150], 90.00th=[ 1150], 95.00th=[ 1150], | 99.00th=[ 1150], 99.50th=[ 1150], 99.90th=[ 1150], 99.95th=[ 1150], | 99.99th=[ 1150] bw ( KiB/s): min= 7984, max= 7984, per=82.53%, avg=7984.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 1000=66.67%, 2000=33.33% cpu : usr=0.00%, sys=3.15%, ctx=81, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144920: Mon May 18 05:56:26 2026 write: IOPS=0, BW=3628KiB/s (3715kB/s)(12.0MiB/3387msec); 0 zone resets clat (msec): min=875, max=1351, avg=1127.97, stdev=239.16 lat (msec): min=876, max=1352, avg=1128.59, stdev=239.32 clat percentiles (msec): | 1.00th=[ 877], 5.00th=[ 877], 10.00th=[ 877], 20.00th=[ 877], | 30.00th=[ 877], 40.00th=[ 1150], 50.00th=[ 1150], 60.00th=[ 1150], | 70.00th=[ 1351], 80.00th=[ 1351], 90.00th=[ 1351], 95.00th=[ 1351], | 99.00th=[ 1351], 99.50th=[ 1351], 99.90th=[ 1351], 99.95th=[ 1351], | 99.99th=[ 1351] bw ( KiB/s): min= 7670, max= 8000, per=80.99%, avg=7835.00, stdev=233.35, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=33.33%, 2000=66.67% cpu : usr=0.00%, sys=6.17%, ctx=97, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144921: Mon May 18 05:56:26 2026 write: IOPS=1, BW=7241KiB/s (7415kB/s)(12.0MiB/1697msec); 0 zone resets clat (msec): min=448, max=630, avg=563.87, stdev=100.27 lat (msec): min=450, max=630, avg=564.86, stdev=99.16 clat percentiles (msec): | 1.00th=[ 447], 5.00th=[ 447], 10.00th=[ 447], 20.00th=[ 447], | 30.00th=[ 447], 40.00th=[ 617], 50.00th=[ 617], 60.00th=[ 617], | 70.00th=[ 634], 80.00th=[ 634], 90.00th=[ 634], 95.00th=[ 634], | 99.00th=[ 634], 99.50th=[ 634], 99.90th=[ 634], 99.95th=[ 634], | 99.99th=[ 634] bw ( KiB/s): min= 6168, max= 7670, per=71.52%, avg=6919.00, stdev=1062.07, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 750=66.67% cpu : usr=0.00%, sys=5.60%, ctx=36, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5037KiB/s (5157kB/s), 1358KiB/s-3777KiB/s (1391kB/s-3868kB/s), io=16.0MiB (16.8MB), run=3016-3253msec WRITE: bw=9675KiB/s (9907kB/s), 2716KiB/s-7241KiB/s (2781kB/s-7415kB/s), io=32.0MiB (33.6MB), run=1697-3387msec