== sanity test 398b: DIO and buffer IO race ============== 22:28:36 (1788748116) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 5.50412 s, 9.1 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=145351: Sun Sep 6 22:31:03 2026 read: IOPS=11, BW=47.7KiB/s (48.8kB/s)(5992KiB/125707msec) clat (usec): min=33, max=607993, avg=41503.00, stdev=37423.93 lat (usec): min=33, max=607995, avg=41505.59, stdev=37423.46 clat percentiles (usec): | 1.00th=[ 51], 5.00th=[ 59], 10.00th=[ 93], 20.00th=[ 17433], | 30.00th=[ 23987], 40.00th=[ 28705], 50.00th=[ 34341], 60.00th=[ 40633], | 70.00th=[ 49546], 80.00th=[ 61080], 90.00th=[ 80217], 95.00th=[ 99091], | 99.00th=[164627], 99.50th=[200279], 99.90th=[408945], 99.95th=[608175], | 99.99th=[608175] bw ( KiB/s): min= 7, max= 126, per=25.48%, avg=47.40, stdev=20.57, samples=247 iops : min= 1, max= 31, avg=11.24, stdev= 5.16, samples=247 write: IOPS=12, BW=50.1KiB/s (51.3kB/s)(6296KiB/125707msec); 0 zone resets clat (usec): min=884, max=290511, avg=40266.45, stdev=41149.22 lat (usec): min=886, max=290511, avg=40278.19, stdev=41171.40 clat percentiles (usec): | 1.00th=[ 1074], 5.00th=[ 1205], 10.00th=[ 1516], 20.00th=[ 3687], | 30.00th=[ 8356], 40.00th=[ 17433], 50.00th=[ 28443], 60.00th=[ 41157], | 70.00th=[ 54264], 80.00th=[ 70779], 90.00th=[ 95945], 95.00th=[121111], | 99.00th=[170918], 99.50th=[200279], 99.90th=[242222], 99.95th=[291505], | 99.99th=[291505] bw ( KiB/s): min= 7, max= 110, per=25.49%, avg=49.71, stdev=21.70, samples=247 iops : min= 1, max= 27, avg=11.82, stdev= 5.49, samples=247 lat (usec) : 50=0.46%, 100=4.56%, 250=0.46%, 500=0.16%, 1000=0.16% lat (msec) : 2=7.00%, 4=3.81%, 10=6.38%, 20=10.25%, 50=35.16% lat (msec) : 100=24.54%, 250=6.90%, 500=0.13%, 750=0.03% cpu : usr=0.07%, sys=5.53%, ctx=6301, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145352: Sun Sep 6 22:31:03 2026 read: IOPS=11, BW=46.8KiB/s (47.9kB/s)(5940KiB/127013msec) clat (usec): min=31, max=450791, avg=40520.11, stdev=37006.10 lat (usec): min=31, max=450792, avg=40522.24, stdev=37006.58 clat percentiles (usec): | 1.00th=[ 45], 5.00th=[ 58], 10.00th=[ 78], 20.00th=[ 15926], | 30.00th=[ 21890], 40.00th=[ 27132], 50.00th=[ 32637], 60.00th=[ 40109], | 70.00th=[ 48497], 80.00th=[ 62129], 90.00th=[ 80217], 95.00th=[ 99091], | 99.00th=[158335], 99.50th=[219153], 99.90th=[421528], 99.95th=[450888], | 99.99th=[450888] bw ( KiB/s): min= 7, max= 118, per=25.00%, avg=46.49, stdev=22.37, samples=248 iops : min= 1, max= 29, avg=11.01, stdev= 5.65, samples=248 write: IOPS=12, BW=49.0KiB/s (51.2kB/s)(6348KiB/127013msec); 0 zone resets clat (usec): min=934, max=351444, avg=42027.84, stdev=44410.56 lat (usec): min=935, max=351446, avg=42029.72, stdev=44410.51 clat percentiles (usec): | 1.00th=[ 1106], 5.00th=[ 1205], 10.00th=[ 1483], 20.00th=[ 3621], | 30.00th=[ 7308], 40.00th=[ 16581], 50.00th=[ 29230], 60.00th=[ 41157], | 70.00th=[ 57410], 80.00th=[ 73925], 90.00th=[104334], 95.00th=[127402], | 99.00th=[187696], 99.50th=[221250], 99.90th=[312476], 99.95th=[350225], | 99.99th=[350225] bw ( KiB/s): min= 7, max= 165, per=25.37%, avg=49.47, stdev=22.27, samples=249 iops : min= 1, max= 41, avg=11.76, stdev= 5.61, samples=249 lat (usec) : 50=0.85%, 100=4.69%, 250=0.55%, 500=0.07%, 750=0.07% lat (usec) : 1000=0.10% lat (msec) : 2=6.77%, 4=4.52%, 10=7.00%, 20=10.19%, 50=33.59% lat (msec) : 100=23.37%, 250=8.01%, 500=0.23% cpu : usr=0.08%, sys=5.49%, ctx=6377, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145353: Sun Sep 6 22:31:03 2026 read: IOPS=11, BW=47.4KiB/s (48.6kB/s)(6028KiB/127126msec) clat (usec): min=36, max=261846, avg=39836.85, stdev=32402.99 lat (usec): min=36, max=261847, avg=39838.48, stdev=32402.78 clat percentiles (usec): | 1.00th=[ 48], 5.00th=[ 58], 10.00th=[ 80], 20.00th=[ 15270], | 30.00th=[ 22414], 40.00th=[ 27132], 50.00th=[ 32900], 60.00th=[ 40109], | 70.00th=[ 49546], 80.00th=[ 63177], 90.00th=[ 80217], 95.00th=[ 99091], | 99.00th=[143655], 99.50th=[170918], 99.90th=[250610], 99.95th=[261096], | 99.99th=[261096] bw ( KiB/s): min= 7, max= 110, per=25.39%, avg=47.23, stdev=21.00, samples=247 iops : min= 1, max= 27, avg=11.19, stdev= 5.29, samples=247 write: IOPS=12, BW=49.2KiB/s (50.4kB/s)(6260KiB/127126msec); 0 zone resets clat (usec): min=873, max=563098, avg=42766.55, stdev=49059.05 lat (usec): min=874, max=563099, avg=42774.18, stdev=49064.74 clat percentiles (usec): | 1.00th=[ 1074], 5.00th=[ 1221], 10.00th=[ 1729], 20.00th=[ 3752], | 30.00th=[ 7832], 40.00th=[ 17695], 50.00th=[ 29754], 60.00th=[ 40633], | 70.00th=[ 55313], 80.00th=[ 76022], 90.00th=[102237], 95.00th=[125305], | 99.00th=[212861], 99.50th=[254804], 99.90th=[557843], 99.95th=[566232], | 99.99th=[566232] bw ( KiB/s): min= 6, max= 111, per=24.87%, avg=48.51, stdev=20.55, samples=249 iops : min= 1, max= 27, avg=11.51, stdev= 5.18, samples=249 lat (usec) : 50=0.62%, 100=5.08%, 250=0.42%, 500=0.16%, 750=0.07% lat (usec) : 1000=0.20% lat (msec) : 2=6.32%, 4=4.36%, 10=7.06%, 20=9.77%, 50=34.57% lat (msec) : 100=23.54%, 250=7.49%, 500=0.29%, 750=0.07% cpu : usr=0.07%, sys=5.60%, ctx=6462, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145354: Sun Sep 6 22:31:03 2026 read: IOPS=11, BW=47.1KiB/s (48.2kB/s)(6052KiB/128519msec) clat (usec): min=34, max=431989, avg=39773.16, stdev=36107.01 lat (usec): min=34, max=431991, avg=39778.95, stdev=36105.13 clat percentiles (usec): | 1.00th=[ 47], 5.00th=[ 58], 10.00th=[ 80], 20.00th=[ 16057], | 30.00th=[ 21365], 40.00th=[ 26346], 50.00th=[ 31327], 60.00th=[ 38536], | 70.00th=[ 47973], 80.00th=[ 61080], 90.00th=[ 80217], 95.00th=[101188], | 99.00th=[147850], 99.50th=[217056], 99.90th=[383779], 99.95th=[429917], | 99.99th=[429917] bw ( KiB/s): min= 7, max= 152, per=25.40%, avg=47.25, stdev=22.13, samples=249 iops : min= 1, max= 38, avg=11.20, stdev= 5.57, samples=249 write: IOPS=12, BW=48.5KiB/s (49.7kB/s)(6236KiB/128519msec); 0 zone resets clat (usec): min=911, max=500315, avg=43748.67, stdev=48114.60 lat (usec): min=912, max=500316, avg=43753.34, stdev=48117.30 clat percentiles (usec): | 1.00th=[ 1106], 5.00th=[ 1237], 10.00th=[ 1827], 20.00th=[ 4293], | 30.00th=[ 9241], 40.00th=[ 20317], 50.00th=[ 30540], 60.00th=[ 41157], | 70.00th=[ 56886], 80.00th=[ 76022], 90.00th=[102237], 95.00th=[135267], | 99.00th=[206570], 99.50th=[233833], 99.90th=[446694], 99.95th=[501220], | 99.99th=[501220] bw ( KiB/s): min= 6, max= 136, per=24.74%, avg=48.24, stdev=21.87, samples=251 iops : min= 1, max= 34, avg=11.45, stdev= 5.52, samples=251 lat (usec) : 50=0.85%, 100=4.62%, 250=0.46%, 500=0.23%, 750=0.07% lat (usec) : 1000=0.10% lat (msec) : 2=5.50%, 4=4.30%, 10=6.35%, 20=10.97%, 50=35.32% lat (msec) : 100=23.18%, 250=7.71%, 500=0.33%, 750=0.03% cpu : usr=0.09%, sys=5.54%, ctx=6457, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=187KiB/s (191kB/s), 46.8KiB/s-47.7KiB/s (47.9kB/s-48.8kB/s), io=23.4MiB (24.6MB), run=125707-128519msec WRITE: bw=196KiB/s (200kB/s), 48.5KiB/s-50.1KiB/s (49.7kB/s-51.3kB/s), io=24.6MiB (25.7MB), run=125707-128519msec rand-rw: (groupid=0, jobs=1): err= 0: pid=145346: Sun Sep 6 22:33:02 2026 read: IOPS=6, BW=24.2KiB/s (24.8kB/s)(5992KiB/247458msec) clat (msec): min=5, max=904, avg=32.64, stdev=42.03 lat (msec): min=5, max=904, avg=32.64, stdev=42.03 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 10], 20.00th=[ 12], | 30.00th=[ 14], 40.00th=[ 17], 50.00th=[ 20], 60.00th=[ 23], | 70.00th=[ 29], 80.00th=[ 45], 90.00th=[ 74], 95.00th=[ 104], | 99.00th=[ 169], 99.50th=[ 230], 99.90th=[ 372], 99.95th=[ 902], | 99.99th=[ 902] bw ( KiB/s): min= 7, max= 104, per=27.69%, avg=26.59, stdev=19.32, samples=436 iops : min= 1, max= 26, avg= 6.04, stdev= 4.90, samples=436 write: IOPS=6, BW=25.4KiB/s (26.1kB/s)(6296KiB/247458msec); 0 zone resets clat (msec): min=37, max=548, avg=125.88, stdev=68.98 lat (msec): min=37, max=548, avg=125.88, stdev=68.98 clat percentiles (msec): | 1.00th=[ 47], 5.00th=[ 57], 10.00th=[ 65], 20.00th=[ 74], | 30.00th=[ 84], 40.00th=[ 93], 50.00th=[ 104], 60.00th=[ 117], | 70.00th=[ 136], 80.00th=[ 171], 90.00th=[ 224], 95.00th=[ 268], | 99.00th=[ 363], 99.50th=[ 397], 99.90th=[ 506], 99.95th=[ 550], | 99.99th=[ 550] bw ( KiB/s): min= 7, max= 63, per=24.85%, avg=25.10, stdev=12.69, samples=484 iops : min= 1, max= 15, avg= 5.67, stdev= 3.25, samples=484 lat (msec) : 10=5.50%, 20=20.25%, 50=15.40%, 100=28.94%, 250=26.30% lat (msec) : 500=3.52%, 750=0.07%, 1000=0.03% cpu : usr=0.04%, sys=1.20%, ctx=5263, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145347: Sun Sep 6 22:33:02 2026 read: IOPS=5, BW=23.9KiB/s (24.5kB/s)(5940KiB/248059msec) clat (msec): min=4, max=713, avg=33.12, stdev=41.54 lat (msec): min=4, max=713, avg=33.12, stdev=41.54 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 10], 20.00th=[ 12], | 30.00th=[ 14], 40.00th=[ 17], 50.00th=[ 19], 60.00th=[ 23], | 70.00th=[ 29], 80.00th=[ 44], 90.00th=[ 79], 95.00th=[ 106], | 99.00th=[ 188], 99.50th=[ 241], 99.90th=[ 460], 99.95th=[ 718], | 99.99th=[ 718] bw ( KiB/s): min= 7, max= 96, per=28.46%, avg=27.32, stdev=18.21, samples=422 iops : min= 1, max= 24, avg= 6.23, stdev= 4.60, samples=422 write: IOPS=6, BW=25.6KiB/s (26.2kB/s)(6348KiB/248059msec); 0 zone resets clat (msec): min=29, max=580, avg=125.05, stdev=68.72 lat (msec): min=29, max=580, avg=125.06, stdev=68.73 clat percentiles (msec): | 1.00th=[ 46], 5.00th=[ 54], 10.00th=[ 64], 20.00th=[ 74], | 30.00th=[ 84], 40.00th=[ 93], 50.00th=[ 104], 60.00th=[ 117], | 70.00th=[ 136], 80.00th=[ 169], 90.00th=[ 220], 95.00th=[ 259], | 99.00th=[ 363], 99.50th=[ 418], 99.90th=[ 506], 99.95th=[ 584], | 99.99th=[ 584] bw ( KiB/s): min= 7, max= 56, per=25.23%, avg=25.49, stdev=12.74, samples=482 iops : min= 1, max= 14, avg= 5.76, stdev= 3.26, samples=482 lat (msec) : 10=6.05%, 20=20.18%, 50=15.23%, 100=28.22%, 250=27.18% lat (msec) : 500=3.03%, 750=0.10% cpu : usr=0.04%, sys=1.18%, ctx=5326, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145348: Sun Sep 6 22:33:02 2026 read: IOPS=6, BW=24.4KiB/s (24.9kB/s)(6028KiB/247494msec) clat (msec): min=5, max=276, avg=32.91, stdev=33.90 lat (msec): min=5, max=276, avg=32.92, stdev=33.90 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 10], 20.00th=[ 13], | 30.00th=[ 15], 40.00th=[ 17], 50.00th=[ 21], 60.00th=[ 25], | 70.00th=[ 31], 80.00th=[ 46], 90.00th=[ 78], 95.00th=[ 105], | 99.00th=[ 171], 99.50th=[ 186], 99.90th=[ 266], 99.95th=[ 275], | 99.99th=[ 275] bw ( KiB/s): min= 7, max= 119, per=27.89%, avg=26.78, stdev=18.43, samples=437 iops : min= 1, max= 29, avg= 6.09, stdev= 4.65, samples=437 write: IOPS=6, BW=25.3KiB/s (25.9kB/s)(6260KiB/247494msec); 0 zone resets clat (msec): min=37, max=852, avg=126.17, stdev=75.23 lat (msec): min=37, max=852, avg=126.17, stdev=75.23 clat percentiles (msec): | 1.00th=[ 49], 5.00th=[ 58], 10.00th=[ 64], 20.00th=[ 73], | 30.00th=[ 83], 40.00th=[ 92], 50.00th=[ 104], 60.00th=[ 116], | 70.00th=[ 136], 80.00th=[ 165], 90.00th=[ 226], 95.00th=[ 271], | 99.00th=[ 384], 99.50th=[ 426], 99.90th=[ 776], 99.95th=[ 852], | 99.99th=[ 852] bw ( KiB/s): min= 7, max= 64, per=24.89%, avg=25.14, stdev=12.90, samples=482 iops : min= 1, max= 16, avg= 5.67, stdev= 3.30, samples=482 lat (msec) : 10=5.24%, 20=19.14%, 50=16.47%, 100=29.62%, 250=25.88% lat (msec) : 500=3.48%, 750=0.10%, 1000=0.07% cpu : usr=0.04%, sys=1.20%, ctx=5294, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145349: Sun Sep 6 22:33:02 2026 read: IOPS=6, BW=24.5KiB/s (25.1kB/s)(6052KiB/247330msec) clat (msec): min=5, max=244, avg=32.02, stdev=33.07 lat (msec): min=5, max=244, avg=32.02, stdev=33.07 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 10], 20.00th=[ 12], | 30.00th=[ 14], 40.00th=[ 16], 50.00th=[ 19], 60.00th=[ 23], | 70.00th=[ 30], 80.00th=[ 47], 90.00th=[ 77], 95.00th=[ 105], | 99.00th=[ 165], 99.50th=[ 186], 99.90th=[ 243], 99.95th=[ 245], | 99.99th=[ 245] bw ( KiB/s): min= 7, max= 119, per=28.43%, avg=27.29, stdev=18.91, samples=430 iops : min= 1, max= 29, avg= 6.21, stdev= 4.75, samples=430 write: IOPS=6, BW=25.2KiB/s (25.8kB/s)(6236KiB/247330msec); 0 zone resets clat (msec): min=35, max=789, avg=127.29, stdev=74.27 lat (msec): min=35, max=789, avg=127.29, stdev=74.27 clat percentiles (msec): | 1.00th=[ 44], 5.00th=[ 56], 10.00th=[ 63], 20.00th=[ 74], | 30.00th=[ 84], 40.00th=[ 94], 50.00th=[ 107], 60.00th=[ 120], | 70.00th=[ 140], 80.00th=[ 171], 90.00th=[ 222], 95.00th=[ 279], | 99.00th=[ 368], 99.50th=[ 435], 99.90th=[ 776], 99.95th=[ 793], | 99.99th=[ 793] bw ( KiB/s): min= 7, max= 63, per=24.85%, avg=25.10, stdev=12.90, samples=480 iops : min= 1, max= 15, avg= 5.66, stdev= 3.31, samples=480 lat (msec) : 10=5.73%, 20=21.09%, 50=14.58%, 100=27.73%, 250=27.54% lat (msec) : 500=3.22%, 1000=0.10% cpu : usr=0.04%, sys=1.19%, ctx=5307, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=96.8KiB/s (99.1kB/s), 23.9KiB/s-24.5KiB/s (24.5kB/s-25.1kB/s), io=23.4MiB (24.6MB), run=247330-248059msec WRITE: bw=101KiB/s (104kB/s), 25.2KiB/s-25.6KiB/s (25.8kB/s-26.2kB/s), io=24.6MiB (25.7MB), run=247330-248059msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=145418: Sun Sep 6 22:33:36 2026 read: IOPS=15, BW=254KiB/s (260kB/s)(5920KiB/23333msec) clat (usec): min=35, max=100877, avg=30824.54, stdev=23929.10 lat (usec): min=35, max=100877, avg=30825.89, stdev=23929.34 clat percentiles (usec): | 1.00th=[ 41], 5.00th=[ 58], 10.00th=[ 64], 20.00th=[ 90], | 30.00th=[ 19530], 40.00th=[ 24773], 50.00th=[ 30802], 60.00th=[ 34866], | 70.00th=[ 41157], 80.00th=[ 49021], 90.00th=[ 62653], 95.00th=[ 77071], | 99.00th=[ 93848], 99.50th=[ 96994], 99.90th=[101188], 99.95th=[101188], | 99.99th=[101188] bw ( KiB/s): min= 63, max= 443, per=24.02%, avg=246.47, stdev=86.18, samples=45 iops : min= 3, max= 27, avg=14.67, stdev= 5.43, samples=45 write: IOPS=17, BW=273KiB/s (279kB/s)(6368KiB/23333msec); 0 zone resets clat (usec): min=1406, max=281860, avg=29872.02, stdev=31304.14 lat (usec): min=1408, max=281862, avg=29876.37, stdev=31303.16 clat percentiles (usec): | 1.00th=[ 1500], 5.00th=[ 1909], 10.00th=[ 3097], 20.00th=[ 5276], | 30.00th=[ 7963], 40.00th=[ 11731], 50.00th=[ 20055], 60.00th=[ 28705], | 70.00th=[ 38536], 80.00th=[ 52167], 90.00th=[ 70779], 95.00th=[ 87557], | 99.00th=[126354], 99.50th=[149947], 99.90th=[283116], 99.95th=[283116], | 99.99th=[283116] bw ( KiB/s): min= 95, max= 476, per=25.07%, avg=270.80, stdev=89.44, samples=45 iops : min= 5, max= 29, avg=16.20, stdev= 5.55, samples=45 lat (usec) : 50=1.04%, 100=8.59%, 250=1.04%, 500=0.39%, 750=0.13% lat (msec) : 2=2.86%, 4=5.47%, 10=10.81%, 20=10.81%, 50=38.28% lat (msec) : 100=18.62%, 250=1.82%, 500=0.13% cpu : usr=0.11%, sys=7.53%, ctx=1502, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145419: Sun Sep 6 22:33:36 2026 read: IOPS=15, BW=250KiB/s (256kB/s)(5744KiB/22944msec) clat (usec): min=35, max=171766, avg=30580.09, stdev=25008.06 lat (usec): min=35, max=171767, avg=30581.20, stdev=25008.02 clat percentiles (usec): | 1.00th=[ 48], 5.00th=[ 59], 10.00th=[ 69], 20.00th=[ 131], | 30.00th=[ 18744], 40.00th=[ 25035], 50.00th=[ 29230], 60.00th=[ 34866], | 70.00th=[ 40109], 80.00th=[ 47973], 90.00th=[ 60556], 95.00th=[ 73925], | 99.00th=[106431], 99.50th=[137364], 99.90th=[170918], 99.95th=[170918], | 99.99th=[170918] bw ( KiB/s): min= 47, max= 403, per=24.57%, avg=252.13, stdev=84.69, samples=45 iops : min= 2, max= 25, avg=15.02, stdev= 5.35, samples=45 write: IOPS=17, BW=285KiB/s (292kB/s)(6544KiB/22944msec); 0 zone resets clat (usec): min=1361, max=239336, avg=29175.22, stdev=31671.73 lat (usec): min=1362, max=239336, avg=29178.10, stdev=31671.48 clat percentiles (usec): | 1.00th=[ 1663], 5.00th=[ 2343], 10.00th=[ 3359], 20.00th=[ 5407], | 30.00th=[ 7832], 40.00th=[ 11863], 50.00th=[ 19006], 60.00th=[ 26608], | 70.00th=[ 34341], 80.00th=[ 48497], 90.00th=[ 69731], 95.00th=[ 86508], | 99.00th=[154141], 99.50th=[166724], 99.90th=[240124], 99.95th=[240124], | 99.99th=[240124] bw ( KiB/s): min= 31, max= 476, per=26.39%, avg=285.04, stdev=103.17, samples=45 iops : min= 1, max= 29, avg=17.11, stdev= 6.52, samples=45 lat (usec) : 50=0.65%, 100=7.29%, 250=2.08%, 500=0.52%, 1000=0.26% lat (msec) : 2=2.60%, 4=4.69%, 10=12.50%, 20=11.46%, 50=38.54% lat (msec) : 100=17.19%, 250=2.21% cpu : usr=0.09%, sys=7.26%, ctx=1485, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145420: Sun Sep 6 22:33:36 2026 read: IOPS=16, BW=270KiB/s (277kB/s)(6256KiB/23144msec) clat (usec): min=35, max=182394, avg=30468.35, stdev=26459.70 lat (usec): min=36, max=182396, avg=30469.64, stdev=26459.71 clat percentiles (usec): | 1.00th=[ 41], 5.00th=[ 60], 10.00th=[ 67], 20.00th=[ 114], | 30.00th=[ 16909], 40.00th=[ 23200], 50.00th=[ 28181], 60.00th=[ 32113], | 70.00th=[ 40633], 80.00th=[ 49546], 90.00th=[ 63177], 95.00th=[ 79168], | 99.00th=[108528], 99.50th=[141558], 99.90th=[181404], 99.95th=[181404], | 99.99th=[181404] bw ( KiB/s): min= 95, max= 571, per=26.62%, avg=273.16, stdev=98.94, samples=45 iops : min= 5, max= 35, avg=16.33, stdev= 6.26, samples=45 write: IOPS=16, BW=261KiB/s (267kB/s)(6032KiB/23144msec); 0 zone resets clat (usec): min=1406, max=199991, avg=29646.09, stdev=29015.22 lat (usec): min=1408, max=199994, avg=29667.14, stdev=29003.02 clat percentiles (usec): | 1.00th=[ 1565], 5.00th=[ 1909], 10.00th=[ 3392], 20.00th=[ 5669], | 30.00th=[ 8848], 40.00th=[ 14877], 50.00th=[ 21890], 60.00th=[ 28705], | 70.00th=[ 36439], 80.00th=[ 52167], 90.00th=[ 67634], 95.00th=[ 82314], | 99.00th=[127402], 99.50th=[198181], 99.90th=[200279], 99.95th=[200279], | 99.99th=[200279] bw ( KiB/s): min= 94, max= 544, per=23.94%, avg=258.56, stdev=95.53, samples=45 iops : min= 5, max= 34, avg=15.42, stdev= 6.10, samples=45 lat (usec) : 50=1.17%, 100=8.46%, 250=1.69%, 500=0.65%, 750=0.26% lat (usec) : 1000=0.13% lat (msec) : 2=2.73%, 4=4.56%, 10=9.11%, 20=12.37%, 50=38.28% lat (msec) : 100=18.49%, 250=2.08% cpu : usr=0.10%, sys=7.43%, ctx=1532, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145421: Sun Sep 6 22:33:36 2026 read: IOPS=16, BW=259KiB/s (265kB/s)(6032KiB/23317msec) clat (usec): min=39, max=117201, avg=29739.49, stdev=25844.63 lat (usec): min=39, max=117202, avg=29740.90, stdev=25844.75 clat percentiles (usec): | 1.00th=[ 42], 5.00th=[ 60], 10.00th=[ 64], 20.00th=[ 91], | 30.00th=[ 10290], 40.00th=[ 21627], 50.00th=[ 28705], 60.00th=[ 34341], | 70.00th=[ 43779], 80.00th=[ 52167], 90.00th=[ 62653], 95.00th=[ 74974], | 99.00th=[109577], 99.50th=[116917], 99.90th=[116917], 99.95th=[116917], | 99.99th=[116917] bw ( KiB/s): min= 31, max= 540, per=24.68%, avg=253.24, stdev=110.92, samples=45 iops : min= 1, max= 33, avg=15.11, stdev= 6.96, samples=45 write: IOPS=16, BW=268KiB/s (275kB/s)(6256KiB/23317msec); 0 zone resets clat (usec): min=1458, max=197561, avg=30886.10, stdev=32383.38 lat (usec): min=1459, max=197563, avg=30892.89, stdev=32386.71 clat percentiles (usec): | 1.00th=[ 1532], 5.00th=[ 2008], 10.00th=[ 2999], 20.00th=[ 5080], | 30.00th=[ 7701], 40.00th=[ 11469], 50.00th=[ 19268], 60.00th=[ 27919], | 70.00th=[ 39584], 80.00th=[ 57410], 90.00th=[ 70779], 95.00th=[ 86508], | 99.00th=[154141], 99.50th=[160433], 99.90th=[198181], 99.95th=[198181], | 99.99th=[198181] bw ( KiB/s): min= 63, max= 413, per=24.47%, avg=264.22, stdev=83.62, samples=45 iops : min= 3, max= 25, avg=15.80, stdev= 5.27, samples=45 lat (usec) : 50=1.04%, 100=9.51%, 250=2.34%, 500=0.26%, 750=0.52% lat (usec) : 1000=0.39% lat (msec) : 2=2.99%, 4=5.21%, 10=11.98%, 20=10.03%, 50=32.29% lat (msec) : 100=20.96%, 250=2.47% cpu : usr=0.08%, sys=7.07%, ctx=1479, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1027KiB/s (1051kB/s), 250KiB/s-270KiB/s (256kB/s-277kB/s), io=23.4MiB (24.5MB), run=22944-23333msec WRITE: bw=1080KiB/s (1106kB/s), 261KiB/s-285KiB/s (267kB/s-292kB/s), io=24.6MiB (25.8MB), run=22944-23333msec rand-rw: (groupid=0, jobs=1): err= 0: pid=145413: Sun Sep 6 22:34:13 2026 read: IOPS=6, BW=98.3KiB/s (101kB/s)(5920KiB/60247msec) clat (msec): min=6, max=200, avg=32.07, stdev=27.87 lat (msec): min=6, max=200, avg=32.07, stdev=27.87 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 14], 20.00th=[ 16], | 30.00th=[ 18], 40.00th=[ 20], 50.00th=[ 23], 60.00th=[ 26], | 70.00th=[ 31], 80.00th=[ 43], 90.00th=[ 61], 95.00th=[ 87], | 99.00th=[ 157], 99.50th=[ 178], 99.90th=[ 201], 99.95th=[ 201], | 99.99th=[ 201] bw ( KiB/s): min= 30, max= 320, per=27.18%, avg=106.83, stdev=59.70, samples=109 iops : min= 1, max= 20, avg= 5.96, stdev= 3.84, samples=109 write: IOPS=6, BW=106KiB/s (108kB/s)(6368KiB/60247msec); 0 zone resets clat (msec): min=46, max=315, avg=121.28, stdev=44.93 lat (msec): min=46, max=315, avg=121.30, stdev=44.94 clat percentiles (msec): | 1.00th=[ 53], 5.00th=[ 67], 10.00th=[ 73], 20.00th=[ 86], | 30.00th=[ 93], 40.00th=[ 104], 50.00th=[ 111], 60.00th=[ 123], | 70.00th=[ 138], 80.00th=[ 155], 90.00th=[ 178], 95.00th=[ 205], | 99.00th=[ 279], 99.50th=[ 296], 99.90th=[ 317], 99.95th=[ 317], | 99.99th=[ 317] bw ( KiB/s): min= 30, max= 160, per=25.39%, avg=105.10, stdev=37.43, samples=119 iops : min= 1, max= 10, avg= 5.85, stdev= 2.37, samples=119 lat (msec) : 10=1.43%, 20=18.10%, 50=21.74%, 100=23.57%, 250=34.11% lat (msec) : 500=1.04% cpu : usr=0.05%, sys=1.45%, ctx=1377, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145414: Sun Sep 6 22:34:13 2026 read: IOPS=5, BW=94.4KiB/s (96.7kB/s)(5744KiB/60830msec) clat (msec): min=7, max=341, avg=32.19, stdev=30.76 lat (msec): min=7, max=341, avg=32.19, stdev=30.76 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 15], | 30.00th=[ 18], 40.00th=[ 20], 50.00th=[ 24], 60.00th=[ 28], | 70.00th=[ 34], 80.00th=[ 41], 90.00th=[ 62], 95.00th=[ 87], | 99.00th=[ 148], 99.50th=[ 211], 99.90th=[ 342], 99.95th=[ 342], | 99.99th=[ 342] bw ( KiB/s): min= 30, max= 347, per=25.52%, avg=100.29, stdev=68.08, samples=112 iops : min= 1, max= 21, avg= 5.55, stdev= 4.34, samples=112 write: IOPS=6, BW=108KiB/s (110kB/s)(6544KiB/60830msec); 0 zone resets clat (msec): min=44, max=300, avg=120.34, stdev=46.54 lat (msec): min=44, max=300, avg=120.34, stdev=46.54 clat percentiles (msec): | 1.00th=[ 48], 5.00th=[ 62], 10.00th=[ 69], 20.00th=[ 83], | 30.00th=[ 90], 40.00th=[ 102], 50.00th=[ 110], 60.00th=[ 121], | 70.00th=[ 138], 80.00th=[ 157], 90.00th=[ 188], 95.00th=[ 213], | 99.00th=[ 249], 99.50th=[ 253], 99.90th=[ 300], 99.95th=[ 300], | 99.99th=[ 300] bw ( KiB/s): min= 31, max= 192, per=25.75%, avg=106.59, stdev=38.60, samples=120 iops : min= 1, max= 12, avg= 5.94, stdev= 2.48, samples=120 lat (msec) : 10=2.47%, 20=16.67%, 50=22.14%, 100=24.22%, 250=33.98% lat (msec) : 500=0.52% cpu : usr=0.05%, sys=1.52%, ctx=1331, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145415: Sun Sep 6 22:34:13 2026 read: IOPS=6, BW=106KiB/s (109kB/s)(6256KiB/58816msec) clat (msec): min=6, max=337, avg=31.00, stdev=29.16 lat (msec): min=6, max=337, avg=31.00, stdev=29.15 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 12], 20.00th=[ 15], | 30.00th=[ 17], 40.00th=[ 20], 50.00th=[ 23], 60.00th=[ 27], | 70.00th=[ 32], 80.00th=[ 40], 90.00th=[ 57], 95.00th=[ 79], | 99.00th=[ 176], 99.50th=[ 178], 99.90th=[ 338], 99.95th=[ 338], | 99.99th=[ 338] bw ( KiB/s): min= 31, max= 318, per=27.87%, avg=109.54, stdev=71.35, samples=113 iops : min= 1, max= 19, avg= 6.14, stdev= 4.45, samples=113 write: IOPS=6, BW=103KiB/s (105kB/s)(6032KiB/58816msec); 0 zone resets clat (msec): min=50, max=311, avg=123.54, stdev=47.70 lat (msec): min=50, max=311, avg=123.55, stdev=47.70 clat percentiles (msec): | 1.00th=[ 55], 5.00th=[ 64], 10.00th=[ 74], 20.00th=[ 86], | 30.00th=[ 96], 40.00th=[ 104], 50.00th=[ 114], 60.00th=[ 127], | 70.00th=[ 138], 80.00th=[ 153], 90.00th=[ 188], 95.00th=[ 224], | 99.00th=[ 284], 99.50th=[ 309], 99.90th=[ 313], 99.95th=[ 313], | 99.99th=[ 313] bw ( KiB/s): min= 30, max= 192, per=24.81%, avg=102.70, stdev=35.83, samples=115 iops : min= 1, max= 12, avg= 5.70, stdev= 2.34, samples=115 lat (msec) : 10=2.21%, 20=18.75%, 50=23.05%, 100=23.05%, 250=31.12% lat (msec) : 500=1.82% cpu : usr=0.03%, sys=1.52%, ctx=1327, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145416: Sun Sep 6 22:34:13 2026 read: IOPS=6, BW=101KiB/s (103kB/s)(6032KiB/59730msec) clat (msec): min=8, max=343, avg=34.03, stdev=35.11 lat (msec): min=8, max=343, avg=34.04, stdev=35.12 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 16], | 30.00th=[ 18], 40.00th=[ 20], 50.00th=[ 23], 60.00th=[ 28], | 70.00th=[ 33], 80.00th=[ 47], 90.00th=[ 65], 95.00th=[ 87], | 99.00th=[ 184], 99.50th=[ 305], 99.90th=[ 342], 99.95th=[ 342], | 99.99th=[ 342] bw ( KiB/s): min= 30, max= 319, per=26.23%, avg=103.07, stdev=66.63, samples=114 iops : min= 1, max= 19, avg= 5.73, stdev= 4.23, samples=114 write: IOPS=6, BW=105KiB/s (107kB/s)(6256KiB/59730msec); 0 zone resets clat (msec): min=49, max=324, avg=119.67, stdev=42.88 lat (msec): min=49, max=324, avg=119.68, stdev=42.88 clat percentiles (msec): | 1.00th=[ 54], 5.00th=[ 67], 10.00th=[ 73], 20.00th=[ 86], | 30.00th=[ 94], 40.00th=[ 103], 50.00th=[ 111], 60.00th=[ 122], | 70.00th=[ 136], 80.00th=[ 150], 90.00th=[ 176], 95.00th=[ 209], | 99.00th=[ 257], 99.50th=[ 264], 99.90th=[ 326], 99.95th=[ 326], | 99.99th=[ 326] bw ( KiB/s): min= 31, max= 191, per=25.21%, avg=104.36, stdev=37.70, samples=118 iops : min= 1, max= 11, avg= 5.81, stdev= 2.40, samples=118 lat (msec) : 10=1.04%, 20=19.53%, 50=20.18%, 100=25.00%, 250=33.20% lat (msec) : 500=1.04% cpu : usr=0.06%, sys=1.42%, ctx=1269, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=394KiB/s (403kB/s), 94.4KiB/s-106KiB/s (96.7kB/s-109kB/s), io=23.4MiB (24.5MB), run=58816-60830msec WRITE: bw=414KiB/s (424kB/s), 103KiB/s-108KiB/s (105kB/s-110kB/s), io=24.6MiB (25.8MB), run=58816-60830msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=145442: Sun Sep 6 22:34:32 2026 read: IOPS=1, BW=1228KiB/s (1258kB/s)(7168KiB/5835msec) clat (usec): min=658, max=542382, avg=183766.09, stdev=202600.36 lat (usec): min=659, max=542383, avg=183767.68, stdev=202600.19 clat percentiles (usec): | 1.00th=[ 660], 5.00th=[ 660], 10.00th=[ 660], 20.00th=[ 2769], | 30.00th=[108528], 40.00th=[108528], 50.00th=[116917], 60.00th=[133694], | 70.00th=[133694], 80.00th=[379585], 90.00th=[541066], 95.00th=[541066], | 99.00th=[541066], 99.50th=[541066], 99.90th=[541066], 99.95th=[541066], | 99.99th=[541066] bw ( KiB/s): min= 2023, max= 5145, per=100.00%, avg=3749.00, stdev=1586.95, samples=3 iops : min= 1, max= 5, avg= 3.00, stdev= 2.00, samples=3 write: IOPS=0, BW=877KiB/s (899kB/s)(5120KiB/5835msec); 0 zone resets clat (msec): min=145, max=2741, avg=889.11, stdev=1050.85 lat (msec): min=145, max=2741, avg=889.21, stdev=1050.87 clat percentiles (msec): | 1.00th=[ 146], 5.00th=[ 146], 10.00th=[ 146], 20.00th=[ 146], | 30.00th=[ 393], 40.00th=[ 393], 50.00th=[ 584], 60.00th=[ 584], | 70.00th=[ 592], 80.00th=[ 592], 90.00th=[ 2735], 95.00th=[ 2735], | 99.00th=[ 2735], 99.50th=[ 2735], 99.90th=[ 2735], 99.95th=[ 2735], | 99.99th=[ 2735] bw ( KiB/s): min= 1822, max= 2023, per=46.71%, avg=1949.50, stdev=89.21, samples=4 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=4 lat (usec) : 750=8.33% lat (msec) : 4=8.33%, 250=33.33%, 500=16.67%, 750=25.00%, >=2000=8.33% cpu : usr=0.00%, sys=7.42%, ctx=226, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145443: Sun Sep 6 22:34:32 2026 read: IOPS=0, BW=298KiB/s (305kB/s)(2048KiB/6868msec) clat (usec): min=495, max=2605.6k, avg=1303058.28, stdev=1842102.63 lat (usec): min=496, max=2605.6k, avg=1303060.34, stdev=1842103.72 clat percentiles (usec): | 1.00th=[ 494], 5.00th=[ 494], 10.00th=[ 494], | 20.00th=[ 494], 30.00th=[ 494], 40.00th=[ 494], | 50.00th=[ 494], 60.00th=[2600469], 70.00th=[2600469], | 80.00th=[2600469], 90.00th=[2600469], 95.00th=[2600469], | 99.00th=[2600469], 99.50th=[2600469], 99.90th=[2600469], | 99.95th=[2600469], 99.99th=[2600469] bw ( KiB/s): min= 1965, max= 2023, per=66.89%, avg=1994.00, stdev=41.01, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1491KiB/s (1527kB/s)(10.0MiB/6868msec); 0 zone resets clat (msec): min=93, max=1463, avg=415.95, stdev=412.01 lat (msec): min=93, max=1463, avg=416.09, stdev=412.04 clat percentiles (msec): | 1.00th=[ 94], 5.00th=[ 94], 10.00th=[ 94], 20.00th=[ 114], | 30.00th=[ 144], 40.00th=[ 226], 50.00th=[ 243], 60.00th=[ 317], | 70.00th=[ 338], 80.00th=[ 584], 90.00th=[ 642], 95.00th=[ 1469], | 99.00th=[ 1469], 99.50th=[ 1469], 99.90th=[ 1469], 99.95th=[ 1469], | 99.99th=[ 1469] bw ( KiB/s): min= 1822, max= 4096, per=72.10%, avg=3009.33, stdev=1179.77, samples=6 iops : min= 1, max= 4, avg= 2.17, stdev= 1.33, samples=6 lat (usec) : 500=8.33% lat (msec) : 100=8.33%, 250=33.33%, 500=16.67%, 750=16.67%, 2000=8.33% lat (msec) : >=2000=8.33% cpu : usr=0.00%, sys=9.39%, ctx=605, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145444: Sun Sep 6 22:34:32 2026 read: IOPS=1, BW=1048KiB/s (1074kB/s)(6144KiB/5860msec) clat (usec): min=515, max=326991, avg=140746.22, stdev=155852.31 lat (usec): min=517, max=326992, avg=140747.55, stdev=155852.38 clat percentiles (usec): | 1.00th=[ 515], 5.00th=[ 515], 10.00th=[ 515], 20.00th=[ 570], | 30.00th=[ 570], 40.00th=[ 8225], 50.00th=[ 8225], 60.00th=[208667], | 70.00th=[299893], 80.00th=[299893], 90.00th=[325059], 95.00th=[325059], | 99.00th=[325059], 99.50th=[325059], 99.90th=[325059], 99.95th=[325059], | 99.99th=[325059] bw ( KiB/s): min= 2023, max= 4079, per=100.00%, avg=3248.67, stdev=1083.51, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 write: IOPS=1, BW=1048KiB/s (1074kB/s)(6144KiB/5860msec); 0 zone resets clat (msec): min=324, max=2977, avg=804.57, stdev=1065.20 lat (msec): min=325, max=2977, avg=804.68, stdev=1065.20 clat percentiles (msec): | 1.00th=[ 326], 5.00th=[ 326], 10.00th=[ 326], 20.00th=[ 338], | 30.00th=[ 338], 40.00th=[ 363], 50.00th=[ 363], 60.00th=[ 393], | 70.00th=[ 430], 80.00th=[ 430], 90.00th=[ 2970], 95.00th=[ 2970], | 99.00th=[ 2970], 99.50th=[ 2970], 99.90th=[ 2970], 99.95th=[ 2970], | 99.99th=[ 2970] bw ( KiB/s): min= 1822, max= 2039, per=46.78%, avg=1952.80, stdev=81.29, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 lat (usec) : 750=16.67% lat (msec) : 10=8.33%, 250=8.33%, 500=58.33%, >=2000=8.33% cpu : usr=0.00%, sys=7.78%, ctx=182, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145445: Sun Sep 6 22:34:32 2026 read: IOPS=0, BW=903KiB/s (925kB/s)(5120KiB/5668msec) clat (usec): min=454, max=471535, avg=152905.83, stdev=218057.09 lat (usec): min=455, max=471536, avg=152906.99, stdev=218057.22 clat percentiles (usec): | 1.00th=[ 457], 5.00th=[ 457], 10.00th=[ 457], 20.00th=[ 457], | 30.00th=[ 594], 40.00th=[ 594], 50.00th=[ 832], 60.00th=[ 832], | 70.00th=[291505], 80.00th=[291505], 90.00th=[471860], 95.00th=[471860], | 99.00th=[471860], 99.50th=[471860], 99.90th=[471860], 99.95th=[471860], | 99.99th=[471860] bw ( KiB/s): min= 7288, max= 7288, per=100.00%, avg=7288.00, stdev= 0.00, samples=1 iops : min= 7, max= 7, avg= 7.00, stdev= 0.00, samples=1 write: IOPS=1, BW=1265KiB/s (1295kB/s)(7168KiB/5668msec); 0 zone resets clat (msec): min=118, max=2991, avg=684.12, stdev=1022.67 lat (msec): min=118, max=2991, avg=684.96, stdev=1022.38 clat percentiles (msec): | 1.00th=[ 118], 5.00th=[ 118], 10.00th=[ 118], 20.00th=[ 224], | 30.00th=[ 309], 40.00th=[ 309], 50.00th=[ 351], 60.00th=[ 372], | 70.00th=[ 372], 80.00th=[ 422], 90.00th=[ 3004], 95.00th=[ 3004], | 99.00th=[ 3004], 99.50th=[ 3004], 99.90th=[ 3004], 99.95th=[ 3004], | 99.99th=[ 3004] bw ( KiB/s): min= 1950, max= 3992, per=71.25%, avg=2974.00, stdev=1132.05, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 1.15, samples=4 lat (usec) : 500=8.33%, 750=8.33%, 1000=8.33% lat (msec) : 250=16.67%, 500=50.00%, >=2000=8.33% cpu : usr=0.00%, sys=9.16%, ctx=199, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2982KiB/s (3054kB/s), 298KiB/s-1228KiB/s (305kB/s-1258kB/s), io=20.0MiB (20.0MB), run=5668-6868msec WRITE: bw=4175KiB/s (4275kB/s), 877KiB/s-1491KiB/s (899kB/s-1527kB/s), io=28.0MiB (29.4MB), run=5668-6868msec rand-rw: (groupid=0, jobs=1): err= 0: pid=145446: Sun Sep 6 22:34:33 2026 read: IOPS=1, BW=1306KiB/s (1337kB/s)(7168KiB/5489msec) clat (msec): min=85, max=746, avg=210.40, stdev=237.39 lat (msec): min=85, max=746, avg=210.40, stdev=237.39 clat percentiles (msec): | 1.00th=[ 86], 5.00th=[ 86], 10.00th=[ 86], 20.00th=[ 103], | 30.00th=[ 117], 40.00th=[ 117], 50.00th=[ 138], 60.00th=[ 140], | 70.00th=[ 140], 80.00th=[ 144], 90.00th=[ 743], 95.00th=[ 743], | 99.00th=[ 743], 99.50th=[ 743], 99.90th=[ 743], 99.95th=[ 743], | 99.99th=[ 743] bw ( KiB/s): min= 2027, max= 4219, per=100.00%, avg=3332.00, stdev=1154.24, samples=3 iops : min= 1, max= 4, avg= 2.67, stdev= 1.53, samples=3 write: IOPS=0, BW=933KiB/s (955kB/s)(5120KiB/5489msec); 0 zone resets clat (msec): min=210, max=2494, avg=786.27, stdev=969.29 lat (msec): min=211, max=2494, avg=786.57, stdev=969.16 clat percentiles (msec): | 1.00th=[ 211], 5.00th=[ 211], 10.00th=[ 211], 20.00th=[ 211], | 30.00th=[ 215], 40.00th=[ 215], 50.00th=[ 393], 60.00th=[ 393], | 70.00th=[ 617], 80.00th=[ 617], 90.00th=[ 2500], 95.00th=[ 2500], | 99.00th=[ 2500], 99.50th=[ 2500], 99.90th=[ 2500], 99.95th=[ 2500], | 99.99th=[ 2500] bw ( KiB/s): min= 1954, max= 4096, per=72.24%, avg=2692.33, stdev=1216.16, samples=3 iops : min= 1, max= 4, avg= 2.00, stdev= 1.73, samples=3 lat (msec) : 100=8.33%, 250=58.33%, 500=8.33%, 750=16.67%, >=2000=8.33% cpu : usr=0.02%, sys=2.99%, ctx=125, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145447: Sun Sep 6 22:34:33 2026 read: IOPS=0, BW=270KiB/s (276kB/s)(2048KiB/7597msec) clat (msec): min=92, max=2552, avg=1322.44, stdev=1739.40 lat (msec): min=92, max=2552, avg=1322.45, stdev=1739.40 clat percentiles (msec): | 1.00th=[ 93], 5.00th=[ 93], 10.00th=[ 93], 20.00th=[ 93], | 30.00th=[ 93], 40.00th=[ 93], 50.00th=[ 93], 60.00th=[ 2567], | 70.00th=[ 2567], 80.00th=[ 2567], 90.00th=[ 2567], 95.00th=[ 2567], | 99.00th=[ 2567], 99.50th=[ 2567], 99.90th=[ 2567], 99.95th=[ 2567], | 99.99th=[ 2567] bw ( KiB/s): min= 1954, max= 2048, per=75.17%, avg=2001.00, stdev=66.47, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 write: IOPS=1, BW=1348KiB/s (1380kB/s)(10.0MiB/7597msec); 0 zone resets clat (msec): min=145, max=1016, avg=475.77, stdev=314.86 lat (msec): min=145, max=1016, avg=475.87, stdev=314.86 clat percentiles (msec): | 1.00th=[ 146], 5.00th=[ 146], 10.00th=[ 146], 20.00th=[ 157], | 30.00th=[ 241], 40.00th=[ 313], 50.00th=[ 342], 60.00th=[ 409], | 70.00th=[ 542], 80.00th=[ 609], 90.00th=[ 986], 95.00th=[ 1020], | 99.00th=[ 1020], 99.50th=[ 1020], 99.90th=[ 1020], 99.95th=[ 1020], | 99.99th=[ 1020] bw ( KiB/s): min= 1875, max= 4096, per=72.14%, avg=2688.67, stdev=1076.13, samples=6 iops : min= 1, max= 4, avg= 2.00, stdev= 1.26, samples=6 lat (msec) : 100=8.33%, 250=25.00%, 500=25.00%, 750=16.67%, 1000=8.33% lat (msec) : 2000=8.33%, >=2000=8.33% cpu : usr=0.03%, sys=2.94%, ctx=107, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145448: Sun Sep 6 22:34:33 2026 read: IOPS=0, BW=829KiB/s (849kB/s)(6144KiB/7408msec) clat (msec): min=87, max=527, avg=189.62, stdev=166.84 lat (msec): min=87, max=527, avg=189.62, stdev=166.84 clat percentiles (msec): | 1.00th=[ 88], 5.00th=[ 88], 10.00th=[ 88], 20.00th=[ 121], | 30.00th=[ 121], 40.00th=[ 124], 50.00th=[ 124], 60.00th=[ 131], | 70.00th=[ 148], 80.00th=[ 148], 90.00th=[ 527], 95.00th=[ 527], | 99.00th=[ 527], 99.50th=[ 527], 99.90th=[ 527], 99.95th=[ 527], | 99.99th=[ 527] bw ( KiB/s): min= 2027, max= 4096, per=95.81%, avg=2550.50, stdev=1030.37, samples=4 iops : min= 1, max= 4, avg= 2.00, stdev= 1.41, samples=4 write: IOPS=0, BW=829KiB/s (849kB/s)(6144KiB/7408msec); 0 zone resets clat (msec): min=201, max=3356, avg=1011.96, stdev=1264.27 lat (msec): min=201, max=3356, avg=1012.30, stdev=1264.28 clat percentiles (msec): | 1.00th=[ 203], 5.00th=[ 203], 10.00th=[ 203], 20.00th=[ 296], | 30.00th=[ 296], 40.00th=[ 309], 50.00th=[ 309], 60.00th=[ 317], | 70.00th=[ 1603], 80.00th=[ 1603], 90.00th=[ 3373], 95.00th=[ 3373], | 99.00th=[ 3373], 99.50th=[ 3373], 99.90th=[ 3373], 99.95th=[ 3373], | 99.99th=[ 3373] bw ( KiB/s): min= 1875, max= 4055, per=64.47%, avg=2402.80, stdev=926.30, samples=5 iops : min= 1, max= 3, avg= 1.80, stdev= 0.84, samples=5 lat (msec) : 100=8.33%, 250=41.67%, 500=25.00%, 750=8.33%, 2000=8.33% lat (msec) : >=2000=8.33% cpu : usr=0.00%, sys=2.57%, ctx=91, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145449: Sun Sep 6 22:34:33 2026 read: IOPS=0, BW=666KiB/s (682kB/s)(5120KiB/7691msec) clat (msec): min=45, max=655, avg=324.51, stdev=250.03 lat (msec): min=45, max=655, avg=324.51, stdev=250.03 clat percentiles (msec): | 1.00th=[ 46], 5.00th=[ 46], 10.00th=[ 46], 20.00th=[ 46], | 30.00th=[ 192], 40.00th=[ 192], 50.00th=[ 220], 60.00th=[ 220], | 70.00th=[ 510], 80.00th=[ 510], 90.00th=[ 659], 95.00th=[ 659], | 99.00th=[ 659], 99.50th=[ 659], 99.90th=[ 659], 99.95th=[ 659], | 99.99th=[ 659] bw ( KiB/s): min= 2027, max= 2048, per=76.58%, avg=2038.50, stdev=11.09, samples=4 iops : min= 1, max= 2, avg= 1.50, stdev= 0.58, samples=4 write: IOPS=0, BW=932KiB/s (954kB/s)(7168KiB/7691msec); 0 zone resets clat (msec): min=137, max=3376, avg=834.65, stdev=1149.39 lat (msec): min=137, max=3376, avg=834.75, stdev=1149.41 clat percentiles (msec): | 1.00th=[ 138], 5.00th=[ 138], 10.00th=[ 138], 20.00th=[ 194], | 30.00th=[ 279], 40.00th=[ 279], 50.00th=[ 460], 60.00th=[ 493], | 70.00th=[ 493], 80.00th=[ 902], 90.00th=[ 3373], 95.00th=[ 3373], | 99.00th=[ 3373], 99.50th=[ 3373], 99.90th=[ 3373], 99.95th=[ 3373], | 99.99th=[ 3373] bw ( KiB/s): min= 1875, max= 2048, per=53.80%, avg=2005.00, stdev=73.43, samples=5 iops : min= 1, max= 2, avg= 1.40, stdev= 0.55, samples=5 lat (msec) : 50=8.33%, 250=33.33%, 500=25.00%, 750=16.67%, 1000=8.33% lat (msec) : >=2000=8.33% cpu : usr=0.00%, sys=2.73%, ctx=203, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2663KiB/s (2727kB/s), 270KiB/s-1306KiB/s (276kB/s-1337kB/s), io=20.0MiB (20.0MB), run=5489-7691msec WRITE: bw=3728KiB/s (3817kB/s), 829KiB/s-1348KiB/s (849kB/s-1380kB/s), io=28.0MiB (29.4MB), run=5489-7691msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=145457: Sun Sep 6 22:34:47 2026 read: IOPS=1, BW=4909KiB/s (5027kB/s)(12.0MiB/2503msec) clat (msec): min=396, max=1022, avg=778.15, stdev=334.49 lat (msec): min=396, max=1022, avg=778.16, stdev=334.49 clat percentiles (msec): | 1.00th=[ 397], 5.00th=[ 397], 10.00th=[ 397], 20.00th=[ 397], | 30.00th=[ 397], 40.00th=[ 919], 50.00th=[ 919], 60.00th=[ 919], | 70.00th=[ 1020], 80.00th=[ 1020], 90.00th=[ 1020], 95.00th=[ 1020], | 99.00th=[ 1020], 99.50th=[ 1020], 99.90th=[ 1020], 99.95th=[ 1020], | 99.99th=[ 1020] bw ( KiB/s): min= 5885, max= 8175, per=100.00%, avg=7030.00, stdev=1619.27, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=14.21%, ctx=528, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145458: Sun Sep 6 22:34:47 2026 read: IOPS=0, BW=1054KiB/s (1080kB/s)(4096KiB/3885msec) clat (nsec): min=627642k, max=627642k, avg=627641924.00, stdev= 0.00 lat (nsec): min=627645k, max=627645k, avg=627645243.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 625], 5.00th=[ 625], 10.00th=[ 625], 20.00th=[ 625], | 30.00th=[ 625], 40.00th=[ 625], 50.00th=[ 625], 60.00th=[ 625], | 70.00th=[ 625], 80.00th=[ 625], 90.00th=[ 625], 95.00th=[ 625], | 99.00th=[ 625], 99.50th=[ 625], 99.90th=[ 625], 99.95th=[ 625], | 99.99th=[ 625] bw ( KiB/s): min= 8192, max= 8192, per=100.00%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2109KiB/s (2159kB/s)(8192KiB/3885msec); 0 zone resets clat (msec): min=1572, max=1606, avg=1589.74, stdev=24.09 lat (msec): min=1573, max=1607, avg=1590.39, stdev=24.31 clat percentiles (msec): | 1.00th=[ 1569], 5.00th=[ 1569], 10.00th=[ 1569], 20.00th=[ 1569], | 30.00th=[ 1569], 40.00th=[ 1569], 50.00th=[ 1569], 60.00th=[ 1603], | 70.00th=[ 1603], 80.00th=[ 1603], 90.00th=[ 1603], 95.00th=[ 1603], | 99.00th=[ 1603], 99.50th=[ 1603], 99.90th=[ 1603], 99.95th=[ 1603], | 99.99th=[ 1603] bw ( KiB/s): min= 7937, max= 7937, per=94.11%, avg=7937.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, 2000=66.67% cpu : usr=0.03%, sys=5.79%, ctx=141, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145459: Sun Sep 6 22:34:47 2026 write: IOPS=0, BW=3286KiB/s (3365kB/s)(12.0MiB/3739msec); 0 zone resets clat (msec): min=364, max=2110, avg=1236.83, stdev=873.13 lat (msec): min=365, max=2110, avg=1237.79, stdev=872.49 clat percentiles (msec): | 1.00th=[ 363], 5.00th=[ 363], 10.00th=[ 363], 20.00th=[ 363], | 30.00th=[ 363], 40.00th=[ 1234], 50.00th=[ 1234], 60.00th=[ 1234], | 70.00th=[ 2106], 80.00th=[ 2106], 90.00th=[ 2106], 95.00th=[ 2106], | 99.00th=[ 2106], 99.50th=[ 2106], 99.90th=[ 2106], 99.95th=[ 2106], | 99.99th=[ 2106] bw ( KiB/s): min= 7937, max= 8192, per=95.62%, avg=8064.50, stdev=180.31, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 500=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.05%, sys=3.99%, ctx=145, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145460: Sun Sep 6 22:34:47 2026 write: IOPS=1, BW=5159KiB/s (5282kB/s)(12.0MiB/2382msec); 0 zone resets clat (msec): min=615, max=1018, avg=753.88, stdev=229.53 lat (msec): min=616, max=1019, avg=754.47, stdev=229.37 clat percentiles (msec): | 1.00th=[ 617], 5.00th=[ 617], 10.00th=[ 617], 20.00th=[ 617], | 30.00th=[ 617], 40.00th=[ 625], 50.00th=[ 625], 60.00th=[ 625], | 70.00th=[ 1020], 80.00th=[ 1020], 90.00th=[ 1020], 95.00th=[ 1020], | 99.00th=[ 1020], 99.50th=[ 1020], 99.90th=[ 1020], 99.95th=[ 1020], | 99.99th=[ 1020] bw ( KiB/s): min= 8159, max= 8175, per=96.83%, avg=8167.00, stdev=11.31, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=66.67%, 2000=33.33% cpu : usr=0.00%, sys=8.06%, ctx=64, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4217KiB/s (4318kB/s), 1054KiB/s-4909KiB/s (1080kB/s-5027kB/s), io=16.0MiB (16.8MB), run=2503-3885msec WRITE: bw=8434KiB/s (8637kB/s), 2109KiB/s-5159KiB/s (2159kB/s-5282kB/s), io=32.0MiB (33.6MB), run=2382-3885msec rand-rw: (groupid=0, jobs=1): err= 0: pid=145461: Sun Sep 6 22:34:48 2026 read: IOPS=1, BW=4122KiB/s (4221kB/s)(12.0MiB/2981msec) clat (msec): min=357, max=1283, avg=938.67, stdev=505.94 lat (msec): min=357, max=1283, avg=938.67, stdev=505.94 clat percentiles (msec): | 1.00th=[ 359], 5.00th=[ 359], 10.00th=[ 359], 20.00th=[ 359], | 30.00th=[ 359], 40.00th=[ 1183], 50.00th=[ 1183], 60.00th=[ 1183], | 70.00th=[ 1284], 80.00th=[ 1284], 90.00th=[ 1284], 95.00th=[ 1284], | 99.00th=[ 1284], 99.50th=[ 1284], 99.90th=[ 1284], 99.95th=[ 1284], | 99.99th=[ 1284] bw ( KiB/s): min= 8031, max= 8175, per=100.00%, avg=8103.00, stdev=101.82, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.00%, sys=4.60%, ctx=68, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145462: Sun Sep 6 22:34:48 2026 read: IOPS=0, BW=1012KiB/s (1036kB/s)(4096KiB/4049msec) clat (nsec): min=1043.9M, max=1043.9M, avg=1043948974.00, stdev= 0.00 lat (nsec): min=1043.0M, max=1043.0M, avg=1043951825.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1045], 5.00th=[ 1045], 10.00th=[ 1045], 20.00th=[ 1045], | 30.00th=[ 1045], 40.00th=[ 1045], 50.00th=[ 1045], 60.00th=[ 1045], | 70.00th=[ 1045], 80.00th=[ 1045], 90.00th=[ 1045], 95.00th=[ 1045], | 99.00th=[ 1045], 99.50th=[ 1045], 99.90th=[ 1045], 99.95th=[ 1045], | 99.99th=[ 1045] bw ( KiB/s): min= 8126, max= 8126, per=100.00%, avg=8126.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2023KiB/s (2072kB/s)(8192KiB/4049msec); 0 zone resets clat (msec): min=1282, max=1656, avg=1469.05, stdev=264.50 lat (msec): min=1282, max=1657, avg=1469.74, stdev=264.92 clat percentiles (msec): | 1.00th=[ 1284], 5.00th=[ 1284], 10.00th=[ 1284], 20.00th=[ 1284], | 30.00th=[ 1284], 40.00th=[ 1284], 50.00th=[ 1284], 60.00th=[ 1653], | 70.00th=[ 1653], 80.00th=[ 1653], 90.00th=[ 1653], 95.00th=[ 1653], | 99.00th=[ 1653], 99.50th=[ 1653], 99.90th=[ 1653], 99.95th=[ 1653], | 99.99th=[ 1653] bw ( KiB/s): min= 8175, max= 8175, per=100.00%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 2000=100.00% cpu : usr=0.00%, sys=3.93%, ctx=74, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145463: Sun Sep 6 22:34:48 2026 write: IOPS=0, BW=3747KiB/s (3837kB/s)(12.0MiB/3279msec); 0 zone resets clat (msec): min=308, max=1607, avg=1043.13, stdev=666.16 lat (msec): min=313, max=1610, avg=1046.70, stdev=665.11 clat percentiles (msec): | 1.00th=[ 309], 5.00th=[ 309], 10.00th=[ 309], 20.00th=[ 309], | 30.00th=[ 309], 40.00th=[ 1217], 50.00th=[ 1217], 60.00th=[ 1217], | 70.00th=[ 1603], 80.00th=[ 1603], 90.00th=[ 1603], 95.00th=[ 1603], | 99.00th=[ 1603], 99.50th=[ 1603], 99.90th=[ 1603], 99.95th=[ 1603], | 99.99th=[ 1603] bw ( KiB/s): min= 8175, max= 8175, per=100.00%, avg=8175.00, stdev= 0.00, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.00%, sys=3.78%, ctx=64, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145464: Sun Sep 6 22:34:48 2026 write: IOPS=1, BW=4644KiB/s (4755kB/s)(12.0MiB/2646msec); 0 zone resets clat (msec): min=557, max=1074, avg=841.06, stdev=262.27 lat (msec): min=557, max=1075, avg=841.88, stdev=262.56 clat percentiles (msec): | 1.00th=[ 558], 5.00th=[ 558], 10.00th=[ 558], 20.00th=[ 558], | 30.00th=[ 558], 40.00th=[ 894], 50.00th=[ 894], 60.00th=[ 894], | 70.00th=[ 1083], 80.00th=[ 1083], 90.00th=[ 1083], 95.00th=[ 1083], | 99.00th=[ 1083], 99.50th=[ 1083], 99.90th=[ 1083], 99.95th=[ 1083], | 99.99th=[ 1083] bw ( KiB/s): min= 8175, max= 8175, per=100.00%, avg=8175.00, stdev= 0.00, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=4.35%, ctx=71, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4046KiB/s (4144kB/s), 1012KiB/s-4122KiB/s (1036kB/s-4221kB/s), io=16.0MiB (16.8MB), run=2981-4049msec WRITE: bw=8093KiB/s (8287kB/s), 2023KiB/s-4644KiB/s (2072kB/s-4755kB/s), io=32.0MiB (33.6MB), run=2646-4049msec