== sanity test 398b: DIO and buffer IO race ============== 20:55:16 (1788656116) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 5.65583 s, 8.9 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144967: Sat Sep 5 20:57:41 2026 read: IOPS=11, BW=47.7KiB/s (48.8kB/s)(5992KiB/125642msec) clat (usec): min=32, max=1144.9k, avg=42270.40, stdev=40201.73 lat (usec): min=32, max=1144.9k, avg=42271.94, stdev=40201.75 clat percentiles (usec): | 1.00th=[ 53], 5.00th=[ 69], 10.00th=[ 9110], | 20.00th=[ 20579], 30.00th=[ 26346], 40.00th=[ 31851], | 50.00th=[ 36439], 60.00th=[ 43254], 70.00th=[ 51643], | 80.00th=[ 61080], 90.00th=[ 77071], 95.00th=[ 93848], | 99.00th=[ 129500], 99.50th=[ 158335], 99.90th=[ 240124], | 99.95th=[1149240], 99.99th=[1149240] bw ( KiB/s): min= 7, max= 95, per=25.36%, avg=47.93, stdev=17.87, samples=244 iops : min= 1, max= 23, avg=11.33, stdev= 4.49, samples=244 write: IOPS=12, BW=50.1KiB/s (51.3kB/s)(6296KiB/125642msec); 0 zone resets clat (usec): min=1090, max=304227, avg=39277.58, stdev=40098.85 lat (usec): min=1091, max=304229, avg=39292.51, stdev=40102.98 clat percentiles (usec): | 1.00th=[ 1205], 5.00th=[ 1385], 10.00th=[ 2114], 20.00th=[ 4817], | 30.00th=[ 8717], 40.00th=[ 18220], 50.00th=[ 28967], 60.00th=[ 39584], | 70.00th=[ 51119], 80.00th=[ 66847], 90.00th=[ 91751], 95.00th=[115868], | 99.00th=[179307], 99.50th=[212861], 99.90th=[291505], 99.95th=[304088], | 99.99th=[304088] bw ( KiB/s): min= 7, max= 119, per=25.20%, avg=49.89, stdev=21.95, samples=246 iops : min= 1, max= 29, avg=11.83, stdev= 5.51, samples=246 lat (usec) : 50=0.33%, 100=3.58%, 250=0.39%, 500=0.16%, 750=0.07% lat (msec) : 2=4.92%, 4=4.07%, 10=7.49%, 20=9.44%, 50=38.18% lat (msec) : 100=25.62%, 250=5.63%, 500=0.10%, 2000=0.03% cpu : usr=0.11%, sys=5.86%, ctx=6820, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144969: Sat Sep 5 20:57:41 2026 read: IOPS=11, BW=47.3KiB/s (48.4kB/s)(5940KiB/125695msec) clat (usec): min=25, max=222017, avg=40807.56, stdev=30248.06 lat (usec): min=26, max=222019, avg=40809.32, stdev=30248.33 clat percentiles (usec): | 1.00th=[ 57], 5.00th=[ 68], 10.00th=[ 196], 20.00th=[ 19006], | 30.00th=[ 23987], 40.00th=[ 29230], 50.00th=[ 34341], 60.00th=[ 42206], | 70.00th=[ 50594], 80.00th=[ 61604], 90.00th=[ 78119], 95.00th=[ 94897], | 99.00th=[145753], 99.50th=[168821], 99.90th=[217056], 99.95th=[221250], | 99.99th=[221250] bw ( KiB/s): min= 7, max= 119, per=24.94%, avg=47.14, stdev=20.72, samples=246 iops : min= 1, max= 29, avg=11.13, stdev= 5.21, samples=246 write: IOPS=12, BW=50.5KiB/s (51.7kB/s)(6348KiB/125695msec); 0 zone resets clat (usec): min=1074, max=1144.8k, avg=40685.75, stdev=49570.61 lat (usec): min=1074, max=1144.8k, avg=40688.14, stdev=49570.90 clat percentiles (usec): | 1.00th=[ 1237], 5.00th=[ 1418], 10.00th=[ 2311], | 20.00th=[ 5211], 30.00th=[ 10028], 40.00th=[ 20055], | 50.00th=[ 30016], 60.00th=[ 39584], 70.00th=[ 51643], | 80.00th=[ 67634], 90.00th=[ 94897], 95.00th=[ 113771], | 99.00th=[ 177210], 99.50th=[ 221250], 99.90th=[ 450888], | 99.95th=[1149240], 99.99th=[1149240] bw ( KiB/s): min= 7, max= 140, per=25.38%, avg=50.25, stdev=23.27, samples=247 iops : min= 1, max= 35, avg=11.91, stdev= 5.85, samples=247 lat (usec) : 50=0.26%, 100=3.94%, 250=0.81%, 500=0.10%, 750=0.10% lat (usec) : 1000=0.07% lat (msec) : 2=4.82%, 4=3.97%, 10=7.29%, 20=9.83%, 50=37.66% lat (msec) : 100=25.16%, 250=5.83%, 500=0.13%, 2000=0.03% cpu : usr=0.11%, sys=5.67%, ctx=6665, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144971: Sat Sep 5 20:57:41 2026 read: IOPS=11, BW=47.6KiB/s (48.7kB/s)(6028KiB/126711msec) clat (usec): min=33, max=1187.9k, avg=40288.75, stdev=41105.26 lat (usec): min=33, max=1187.9k, avg=40293.75, stdev=41109.27 clat percentiles (usec): | 1.00th=[ 55], 5.00th=[ 69], 10.00th=[ 235], | 20.00th=[ 18744], 30.00th=[ 23987], 40.00th=[ 29230], | 50.00th=[ 34341], 60.00th=[ 41157], 70.00th=[ 49546], | 80.00th=[ 60556], 90.00th=[ 74974], 95.00th=[ 89654], | 99.00th=[ 128451], 99.50th=[ 154141], 99.90th=[ 304088], | 99.95th=[1182794], 99.99th=[1182794] bw ( KiB/s): min= 7, max= 111, per=24.93%, avg=47.11, stdev=20.75, samples=249 iops : min= 1, max= 27, avg=11.13, stdev= 5.19, samples=249 write: IOPS=12, BW=49.4KiB/s (50.6kB/s)(6260KiB/126711msec); 0 zone resets clat (usec): min=1075, max=268172, avg=41854.61, stdev=40789.15 lat (usec): min=1077, max=268173, avg=41860.39, stdev=40793.07 clat percentiles (usec): | 1.00th=[ 1188], 5.00th=[ 1401], 10.00th=[ 2343], 20.00th=[ 5407], | 30.00th=[ 11207], 40.00th=[ 21365], 50.00th=[ 32113], 60.00th=[ 42206], | 70.00th=[ 53216], 80.00th=[ 70779], 90.00th=[ 99091], 95.00th=[123208], | 99.00th=[170918], 99.50th=[183501], 99.90th=[265290], 99.95th=[267387], | 99.99th=[267387] bw ( KiB/s): min= 7, max= 103, per=24.85%, avg=49.21, stdev=18.64, samples=247 iops : min= 1, max= 25, avg=11.65, stdev= 4.68, samples=247 lat (usec) : 50=0.29%, 100=3.78%, 250=0.88%, 500=0.16%, 750=0.10% lat (usec) : 1000=0.03% lat (msec) : 2=4.69%, 4=3.68%, 10=6.64%, 20=10.09%, 50=38.70% lat (msec) : 100=24.41%, 250=6.41%, 500=0.10%, 2000=0.03% cpu : usr=0.10%, sys=5.73%, ctx=6759, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144973: Sat Sep 5 20:57:41 2026 read: IOPS=12, BW=48.0KiB/s (49.2kB/s)(6052KiB/126050msec) clat (usec): min=35, max=406109, avg=39506.01, stdev=30216.14 lat (usec): min=35, max=406111, avg=39508.15, stdev=30215.81 clat percentiles (usec): | 1.00th=[ 53], 5.00th=[ 67], 10.00th=[ 167], 20.00th=[ 19006], | 30.00th=[ 24249], 40.00th=[ 28967], 50.00th=[ 33424], 60.00th=[ 39584], | 70.00th=[ 48497], 80.00th=[ 59507], 90.00th=[ 76022], 95.00th=[ 90702], | 99.00th=[133694], 99.50th=[160433], 99.90th=[278922], 99.95th=[404751], | 99.99th=[404751] bw ( KiB/s): min= 7, max= 104, per=25.75%, avg=48.67, stdev=20.11, samples=243 iops : min= 1, max= 26, avg=11.51, stdev= 5.05, samples=243 write: IOPS=12, BW=49.5KiB/s (50.7kB/s)(6236KiB/126050msec); 0 zone resets clat (usec): min=1053, max=1378.4k, avg=42182.89, stdev=54232.44 lat (usec): min=1053, max=1378.5k, avg=42189.80, stdev=54234.60 clat percentiles (usec): | 1.00th=[ 1205], 5.00th=[ 1401], 10.00th=[ 2245], | 20.00th=[ 4752], 30.00th=[ 8848], 40.00th=[ 19006], | 50.00th=[ 30802], 60.00th=[ 42206], 70.00th=[ 55837], | 80.00th=[ 70779], 90.00th=[ 96994], 95.00th=[ 119014], | 99.00th=[ 193987], 99.50th=[ 238027], 99.90th=[ 325059], | 99.95th=[1384121], 99.99th=[1384121] bw ( KiB/s): min= 7, max= 127, per=25.18%, avg=49.85, stdev=20.38, samples=244 iops : min= 1, max= 31, avg=11.81, stdev= 5.16, samples=244 lat (usec) : 50=0.36%, 100=4.00%, 250=0.75%, 500=0.10%, 750=0.10% lat (usec) : 1000=0.13% lat (msec) : 2=4.65%, 4=4.65%, 10=7.00%, 20=9.18%, 50=37.66% lat (msec) : 100=25.26%, 250=5.89%, 500=0.23%, 2000=0.03% cpu : usr=0.08%, sys=5.63%, ctx=6602, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=190KiB/s (194kB/s), 47.3KiB/s-48.0KiB/s (48.4kB/s-49.2kB/s), io=23.4MiB (24.6MB), run=125642-126711msec WRITE: bw=198KiB/s (203kB/s), 49.4KiB/s-50.5KiB/s (50.6kB/s-51.7kB/s), io=24.6MiB (25.7MB), run=125642-126711msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144968: Sat Sep 5 20:59:39 2026 read: IOPS=6, BW=24.6KiB/s (25.2kB/s)(5992KiB/243528msec) clat (msec): min=5, max=1183, avg=34.72, stdev=46.71 lat (msec): min=5, max=1183, avg=34.72, stdev=46.71 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 13], | 30.00th=[ 15], 40.00th=[ 18], 50.00th=[ 21], 60.00th=[ 26], | 70.00th=[ 34], 80.00th=[ 46], 90.00th=[ 78], 95.00th=[ 108], | 99.00th=[ 167], 99.50th=[ 222], 99.90th=[ 426], 99.95th=[ 1183], | 99.99th=[ 1183] bw ( KiB/s): min= 7, max= 96, per=27.69%, avg=27.13, stdev=18.54, samples=428 iops : min= 1, max= 24, avg= 6.16, stdev= 4.70, samples=428 write: IOPS=6, BW=25.9KiB/s (26.5kB/s)(6296KiB/243528msec); 0 zone resets clat (msec): min=31, max=507, avg=121.42, stdev=62.09 lat (msec): min=31, max=507, avg=121.42, stdev=62.09 clat percentiles (msec): | 1.00th=[ 47], 5.00th=[ 56], 10.00th=[ 64], 20.00th=[ 74], | 30.00th=[ 84], 40.00th=[ 93], 50.00th=[ 104], 60.00th=[ 118], | 70.00th=[ 136], 80.00th=[ 161], 90.00th=[ 207], 95.00th=[ 245], | 99.00th=[ 351], 99.50th=[ 388], 99.90th=[ 464], 99.95th=[ 506], | 99.99th=[ 506] bw ( KiB/s): min= 7, max= 56, per=25.14%, avg=25.65, stdev=12.02, samples=474 iops : min= 1, max= 14, avg= 5.78, stdev= 3.07, samples=474 lat (msec) : 10=4.00%, 20=19.24%, 50=17.48%, 100=28.74%, 250=28.03% lat (msec) : 500=2.44%, 750=0.03%, 2000=0.03% cpu : usr=0.05%, sys=1.32%, ctx=5299, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144970: Sat Sep 5 20:59:39 2026 read: IOPS=6, BW=24.3KiB/s (24.9kB/s)(5940KiB/244251msec) clat (msec): min=5, max=1233, avg=33.83, stdev=49.02 lat (msec): min=5, max=1233, avg=33.83, stdev=49.02 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 13], | 30.00th=[ 15], 40.00th=[ 17], 50.00th=[ 20], 60.00th=[ 24], | 70.00th=[ 31], 80.00th=[ 44], 90.00th=[ 74], 95.00th=[ 102], | 99.00th=[ 199], 99.50th=[ 257], 99.90th=[ 502], 99.95th=[ 1234], | 99.99th=[ 1234] bw ( KiB/s): min= 7, max= 95, per=27.99%, avg=27.43, stdev=18.62, samples=419 iops : min= 1, max= 23, avg= 6.23, stdev= 4.69, samples=419 write: IOPS=6, BW=25.0KiB/s (26.6kB/s)(6348KiB/244251msec); 0 zone resets clat (msec): min=33, max=513, avg=122.01, stdev=61.84 lat (msec): min=33, max=513, avg=122.01, stdev=61.84 clat percentiles (msec): | 1.00th=[ 42], 5.00th=[ 56], 10.00th=[ 63], 20.00th=[ 75], | 30.00th=[ 85], 40.00th=[ 95], 50.00th=[ 105], 60.00th=[ 118], | 70.00th=[ 136], 80.00th=[ 163], 90.00th=[ 205], 95.00th=[ 247], | 99.00th=[ 342], 99.50th=[ 376], 99.90th=[ 460], 99.95th=[ 514], | 99.99th=[ 514] bw ( KiB/s): min= 7, max= 64, per=25.49%, avg=26.00, stdev=12.48, samples=472 iops : min= 1, max= 16, avg= 5.87, stdev= 3.20, samples=472 lat (msec) : 10=4.82%, 20=20.02%, 50=16.37%, 100=28.19%, 250=27.93% lat (msec) : 500=2.57%, 750=0.07%, 2000=0.03% cpu : usr=0.05%, sys=1.30%, ctx=5272, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144972: Sat Sep 5 20:59:39 2026 read: IOPS=6, BW=24.7KiB/s (25.3kB/s)(6028KiB/244402msec) clat (msec): min=6, max=312, avg=33.33, stdev=33.90 lat (msec): min=6, max=312, avg=33.33, stdev=33.90 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 11], 20.00th=[ 13], | 30.00th=[ 15], 40.00th=[ 18], 50.00th=[ 21], 60.00th=[ 26], | 70.00th=[ 32], 80.00th=[ 47], 90.00th=[ 74], 95.00th=[ 102], | 99.00th=[ 169], 99.50th=[ 197], 99.90th=[ 275], 99.95th=[ 313], | 99.99th=[ 313] bw ( KiB/s): min= 7, max= 104, per=26.74%, avg=26.20, stdev=18.29, samples=445 iops : min= 1, max= 26, avg= 5.91, stdev= 4.65, samples=445 write: IOPS=6, BW=25.6KiB/s (26.2kB/s)(6260KiB/244402msec); 0 zone resets clat (msec): min=37, max=1435, avg=123.84, stdev=71.44 lat (msec): min=37, max=1435, avg=123.85, stdev=71.44 clat percentiles (msec): | 1.00th=[ 48], 5.00th=[ 58], 10.00th=[ 66], 20.00th=[ 75], | 30.00th=[ 84], 40.00th=[ 93], 50.00th=[ 105], 60.00th=[ 118], | 70.00th=[ 136], 80.00th=[ 167], 90.00th=[ 205], 95.00th=[ 251], | 99.00th=[ 338], 99.50th=[ 388], 99.90th=[ 592], 99.95th=[ 1435], | 99.99th=[ 1435] bw ( KiB/s): min= 7, max= 56, per=25.02%, avg=25.52, stdev=12.47, samples=474 iops : min= 1, max= 14, avg= 5.74, stdev= 3.18, samples=474 lat (msec) : 10=4.00%, 20=19.86%, 50=17.12%, 100=28.97%, 250=27.25% lat (msec) : 500=2.73%, 750=0.03%, 2000=0.03% cpu : usr=0.05%, sys=1.28%, ctx=5161, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144974: Sat Sep 5 20:59:39 2026 read: IOPS=6, BW=24.8KiB/s (25.4kB/s)(6052KiB/243625msec) clat (msec): min=5, max=425, avg=33.55, stdev=38.89 lat (msec): min=5, max=425, avg=33.56, stdev=38.89 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 13], | 30.00th=[ 16], 40.00th=[ 18], 50.00th=[ 21], 60.00th=[ 24], | 70.00th=[ 31], 80.00th=[ 44], 90.00th=[ 74], 95.00th=[ 103], | 99.00th=[ 190], 99.50th=[ 255], 99.90th=[ 388], 99.95th=[ 426], | 99.99th=[ 426] bw ( KiB/s): min= 7, max= 119, per=27.91%, avg=27.35, stdev=18.85, samples=429 iops : min= 1, max= 29, avg= 6.21, stdev= 4.78, samples=429 write: IOPS=6, BW=25.6KiB/s (26.2kB/s)(6236KiB/243625msec); 0 zone resets clat (msec): min=41, max=1356, avg=123.46, stdev=68.21 lat (msec): min=41, max=1356, avg=123.47, stdev=68.22 clat percentiles (msec): | 1.00th=[ 48], 5.00th=[ 59], 10.00th=[ 66], 20.00th=[ 75], | 30.00th=[ 87], 40.00th=[ 95], 50.00th=[ 107], 60.00th=[ 120], | 70.00th=[ 136], 80.00th=[ 161], 90.00th=[ 207], 95.00th=[ 243], | 99.00th=[ 326], 99.50th=[ 393], 99.90th=[ 592], 99.95th=[ 1351], | 99.99th=[ 1351] bw ( KiB/s): min= 7, max= 48, per=25.17%, avg=25.67, stdev=11.53, samples=470 iops : min= 1, max= 12, avg= 5.79, stdev= 2.96, samples=470 lat (msec) : 10=3.97%, 20=20.28%, 50=17.19%, 100=27.77%, 250=28.26% lat (msec) : 500=2.44%, 750=0.07%, 2000=0.03% cpu : usr=0.05%, sys=1.31%, ctx=5155, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=98.2KiB/s (101kB/s), 24.3KiB/s-24.8KiB/s (24.9kB/s-25.4kB/s), io=23.4MiB (24.6MB), run=243528-244402msec WRITE: bw=103KiB/s (105kB/s), 25.6KiB/s-25.0KiB/s (26.2kB/s-26.6kB/s), io=24.6MiB (25.7MB), run=243528-244402msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=145026: Sat Sep 5 21:00:18 2026 read: IOPS=13, BW=222KiB/s (227kB/s)(5920KiB/26674msec) clat (usec): min=30, max=262882, avg=35797.44, stdev=29295.82 lat (usec): min=31, max=262884, avg=35799.87, stdev=29296.08 clat percentiles (usec): | 1.00th=[ 44], 5.00th=[ 62], 10.00th=[ 71], 20.00th=[ 14746], | 30.00th=[ 22152], 40.00th=[ 28443], 50.00th=[ 33817], 60.00th=[ 38536], | 70.00th=[ 44827], 80.00th=[ 53216], 90.00th=[ 68682], 95.00th=[ 79168], | 99.00th=[108528], 99.50th=[240124], 99.90th=[263193], 99.95th=[263193], | 99.99th=[263193] bw ( KiB/s): min= 61, max= 474, per=25.53%, avg=222.90, stdev=96.02, samples=52 iops : min= 3, max= 29, avg=13.17, stdev= 6.05, samples=52 write: IOPS=14, BW=239KiB/s (244kB/s)(6368KiB/26674msec); 0 zone resets clat (usec): min=1504, max=211747, avg=33656.19, stdev=37162.17 lat (usec): min=1506, max=211749, avg=33660.33, stdev=37162.59 clat percentiles (usec): | 1.00th=[ 1549], 5.00th=[ 1975], 10.00th=[ 3195], 20.00th=[ 5145], | 30.00th=[ 8029], 40.00th=[ 11731], 50.00th=[ 20841], 60.00th=[ 30278], | 70.00th=[ 41681], 80.00th=[ 56361], 90.00th=[ 81265], 95.00th=[106431], | 99.00th=[168821], 99.50th=[183501], 99.90th=[210764], 99.95th=[210764], | 99.99th=[210764] bw ( KiB/s): min= 64, max= 443, per=26.05%, avg=239.37, stdev=75.80, samples=52 iops : min= 4, max= 27, avg=14.23, stdev= 4.72, samples=52 lat (usec) : 50=0.91%, 100=6.25%, 250=1.30%, 500=0.26% lat (msec) : 2=2.86%, 4=5.34%, 10=10.94%, 20=9.51%, 50=39.32% lat (msec) : 100=19.01%, 250=4.17%, 500=0.13% cpu : usr=0.10%, sys=7.06%, ctx=1635, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145027: Sat Sep 5 21:00:18 2026 read: IOPS=13, BW=210KiB/s (215kB/s)(5744KiB/27406msec) clat (usec): min=39, max=162171, avg=37840.47, stdev=31578.10 lat (usec): min=40, max=162172, avg=37844.57, stdev=31578.03 clat percentiles (usec): | 1.00th=[ 48], 5.00th=[ 63], 10.00th=[ 80], 20.00th=[ 1631], | 30.00th=[ 21890], 40.00th=[ 27919], 50.00th=[ 32900], 60.00th=[ 40109], | 70.00th=[ 47449], 80.00th=[ 60031], 90.00th=[ 78119], 95.00th=[105382], | 99.00th=[139461], 99.50th=[145753], 99.90th=[162530], 99.95th=[162530], | 99.99th=[162530] bw ( KiB/s): min= 25, max= 436, per=24.35%, avg=212.56, stdev=92.17, samples=52 iops : min= 1, max= 27, avg=12.52, stdev= 5.82, samples=52 write: IOPS=14, BW=239KiB/s (245kB/s)(6544KiB/27406msec); 0 zone resets clat (usec): min=1490, max=277409, avg=33673.78, stdev=37546.35 lat (usec): min=1493, max=277412, avg=33686.67, stdev=37587.25 clat percentiles (usec): | 1.00th=[ 1631], 5.00th=[ 2008], 10.00th=[ 2999], 20.00th=[ 5932], | 30.00th=[ 9110], 40.00th=[ 13960], 50.00th=[ 22152], 60.00th=[ 30278], | 70.00th=[ 40633], 80.00th=[ 53216], 90.00th=[ 82314], 95.00th=[100140], | 99.00th=[173016], 99.50th=[219153], 99.90th=[278922], 99.95th=[278922], | 99.99th=[278922] bw ( KiB/s): min= 63, max= 383, per=25.56%, avg=234.91, stdev=79.73, samples=53 iops : min= 3, max= 23, avg=13.94, stdev= 4.99, samples=53 lat (usec) : 50=0.52%, 100=6.12%, 250=1.69%, 500=0.39%, 750=0.13% lat (usec) : 1000=0.13% lat (msec) : 2=3.12%, 4=4.69%, 10=9.64%, 20=11.72%, 50=37.50% lat (msec) : 100=19.14%, 250=4.95%, 500=0.26% cpu : usr=0.08%, sys=6.72%, ctx=1605, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145028: Sat Sep 5 21:00:18 2026 read: IOPS=14, BW=239KiB/s (245kB/s)(6256KiB/26165msec) clat (usec): min=36, max=168095, avg=34215.96, stdev=28516.52 lat (usec): min=36, max=168097, avg=34217.72, stdev=28516.16 clat percentiles (usec): | 1.00th=[ 40], 5.00th=[ 60], 10.00th=[ 68], 20.00th=[ 106], | 30.00th=[ 20055], 40.00th=[ 25297], 50.00th=[ 31851], 60.00th=[ 37487], | 70.00th=[ 44827], 80.00th=[ 55313], 90.00th=[ 69731], 95.00th=[ 79168], | 99.00th=[135267], 99.50th=[166724], 99.90th=[168821], 99.95th=[168821], | 99.99th=[168821] bw ( KiB/s): min= 95, max= 497, per=27.58%, avg=240.80, stdev=87.13, samples=51 iops : min= 5, max= 31, avg=14.31, stdev= 5.54, samples=51 write: IOPS=14, BW=231KiB/s (236kB/s)(6032KiB/26165msec); 0 zone resets clat (usec): min=1448, max=228848, avg=33835.42, stdev=36047.96 lat (usec): min=1451, max=228852, avg=33839.11, stdev=36049.34 clat percentiles (usec): | 1.00th=[ 1778], 5.00th=[ 2704], 10.00th=[ 3621], 20.00th=[ 6390], | 30.00th=[ 9110], 40.00th=[ 12649], 50.00th=[ 20579], 60.00th=[ 30016], | 70.00th=[ 41681], 80.00th=[ 57410], 90.00th=[ 81265], 95.00th=[108528], | 99.00th=[168821], 99.50th=[200279], 99.90th=[229639], 99.95th=[229639], | 99.99th=[229639] bw ( KiB/s): min= 63, max= 474, per=25.04%, avg=230.08, stdev=95.77, samples=51 iops : min= 3, max= 29, avg=13.63, stdev= 6.05, samples=51 lat (usec) : 50=1.43%, 100=8.59%, 250=1.04%, 500=0.39%, 750=0.26% lat (usec) : 1000=0.13% lat (msec) : 2=1.17%, 4=4.56%, 10=10.29%, 20=11.59%, 50=36.07% lat (msec) : 100=20.05%, 250=4.43% cpu : usr=0.10%, sys=6.98%, ctx=1555, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145029: Sat Sep 5 21:00:18 2026 read: IOPS=14, BW=227KiB/s (232kB/s)(6032KiB/26585msec) clat (usec): min=36, max=223318, avg=34051.56, stdev=29442.13 lat (usec): min=36, max=223318, avg=34053.15, stdev=29441.96 clat percentiles (usec): | 1.00th=[ 43], 5.00th=[ 61], 10.00th=[ 69], 20.00th=[ 101], | 30.00th=[ 19792], 40.00th=[ 25297], 50.00th=[ 30278], 60.00th=[ 39060], | 70.00th=[ 44827], 80.00th=[ 54264], 90.00th=[ 69731], 95.00th=[ 84411], | 99.00th=[132645], 99.50th=[164627], 99.90th=[223347], 99.95th=[223347], | 99.99th=[223347] bw ( KiB/s): min= 61, max= 447, per=26.43%, avg=230.75, stdev=96.02, samples=51 iops : min= 3, max= 27, avg=13.67, stdev= 6.05, samples=51 write: IOPS=14, BW=235KiB/s (241kB/s)(6256KiB/26585msec); 0 zone resets clat (usec): min=1430, max=349145, avg=35048.36, stdev=44315.85 lat (usec): min=1432, max=349150, avg=35076.31, stdev=44317.73 clat percentiles (usec): | 1.00th=[ 1663], 5.00th=[ 2474], 10.00th=[ 3326], 20.00th=[ 5211], | 30.00th=[ 8586], 40.00th=[ 12256], 50.00th=[ 19530], 60.00th=[ 30278], | 70.00th=[ 42730], 80.00th=[ 56886], 90.00th=[ 79168], 95.00th=[101188], | 99.00th=[258999], 99.50th=[278922], 99.90th=[350225], 99.95th=[350225], | 99.99th=[350225] bw ( KiB/s): min= 31, max= 572, per=25.67%, avg=235.94, stdev=103.47, samples=52 iops : min= 1, max= 35, avg=14.00, stdev= 6.48, samples=52 lat (usec) : 50=1.04%, 100=8.72%, 250=1.17%, 500=0.13%, 750=0.13% lat (msec) : 2=2.34%, 4=5.34%, 10=11.46%, 20=10.42%, 50=34.90% lat (msec) : 100=20.44%, 250=3.26%, 500=0.65% cpu : usr=0.08%, sys=6.91%, ctx=1486, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=874KiB/s (895kB/s), 210KiB/s-239KiB/s (215kB/s-245kB/s), io=23.4MiB (24.5MB), run=26165-27406msec WRITE: bw=920KiB/s (942kB/s), 231KiB/s-239KiB/s (236kB/s-245kB/s), io=24.6MiB (25.8MB), run=26165-27406msec rand-rw: (groupid=0, jobs=1): err= 0: pid=145021: Sat Sep 5 21:00:59 2026 read: IOPS=5, BW=86.8KiB/s (88.8kB/s)(5920KiB/68234msec) clat (msec): min=7, max=248, avg=42.64, stdev=33.44 lat (msec): min=7, max=248, avg=42.64, stdev=33.44 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 12], 10.00th=[ 16], 20.00th=[ 21], | 30.00th=[ 24], 40.00th=[ 29], 50.00th=[ 34], 60.00th=[ 39], | 70.00th=[ 46], 80.00th=[ 55], 90.00th=[ 78], 95.00th=[ 113], | 99.00th=[ 190], 99.50th=[ 239], 99.90th=[ 249], 99.95th=[ 249], | 99.99th=[ 249] bw ( KiB/s): min= 30, max= 318, per=26.93%, avg=94.53, stdev=55.15, samples=122 iops : min= 1, max= 19, avg= 5.08, stdev= 3.44, samples=122 write: IOPS=5, BW=93.3KiB/s (95.6kB/s)(6368KiB/68234msec); 0 zone resets clat (msec): min=51, max=405, avg=131.33, stdev=55.29 lat (msec): min=51, max=405, avg=131.34, stdev=55.32 clat percentiles (msec): | 1.00th=[ 54], 5.00th=[ 70], 10.00th=[ 80], 20.00th=[ 90], | 30.00th=[ 97], 40.00th=[ 108], 50.00th=[ 117], 60.00th=[ 128], | 70.00th=[ 146], 80.00th=[ 169], 90.00th=[ 197], 95.00th=[ 239], | 99.00th=[ 376], 99.50th=[ 393], 99.90th=[ 405], 99.95th=[ 405], | 99.99th=[ 405] bw ( KiB/s): min= 30, max= 192, per=25.13%, avg=92.75, stdev=37.97, samples=134 iops : min= 1, max= 12, avg= 4.97, stdev= 2.43, samples=134 lat (msec) : 10=0.65%, 20=8.59%, 50=26.69%, 100=26.04%, 250=35.94% lat (msec) : 500=2.08% cpu : usr=0.04%, sys=1.45%, ctx=1366, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145022: Sat Sep 5 21:00:59 2026 read: IOPS=5, BW=84.2KiB/s (86.2kB/s)(5744KiB/68208msec) clat (msec): min=9, max=219, avg=40.90, stdev=29.01 lat (msec): min=9, max=219, avg=40.91, stdev=29.01 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 13], 10.00th=[ 16], 20.00th=[ 19], | 30.00th=[ 24], 40.00th=[ 28], 50.00th=[ 34], 60.00th=[ 40], | 70.00th=[ 48], 80.00th=[ 57], 90.00th=[ 72], 95.00th=[ 105], | 99.00th=[ 146], 99.50th=[ 197], 99.90th=[ 220], 99.95th=[ 220], | 99.99th=[ 220] bw ( KiB/s): min= 21, max= 319, per=26.56%, avg=93.22, stdev=58.73, samples=120 iops : min= 1, max= 19, avg= 5.01, stdev= 3.70, samples=120 write: IOPS=5, BW=95.9KiB/s (98.2kB/s)(6544KiB/68208msec); 0 zone resets clat (msec): min=48, max=397, avg=130.44, stdev=56.86 lat (msec): min=48, max=397, avg=130.44, stdev=56.86 clat percentiles (msec): | 1.00th=[ 54], 5.00th=[ 64], 10.00th=[ 73], 20.00th=[ 88], | 30.00th=[ 99], 40.00th=[ 108], 50.00th=[ 118], 60.00th=[ 129], | 70.00th=[ 144], 80.00th=[ 165], 90.00th=[ 205], 95.00th=[ 257], | 99.00th=[ 355], 99.50th=[ 368], 99.90th=[ 397], 99.95th=[ 397], | 99.99th=[ 397] bw ( KiB/s): min= 30, max= 191, per=25.82%, avg=95.28, stdev=37.75, samples=134 iops : min= 1, max= 11, avg= 5.13, stdev= 2.40, samples=134 lat (msec) : 10=0.52%, 20=10.29%, 50=23.70%, 100=26.30%, 250=36.20% lat (msec) : 500=2.99% cpu : usr=0.04%, sys=1.49%, ctx=1403, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145023: Sat Sep 5 21:00:59 2026 read: IOPS=5, BW=94.7KiB/s (96.9kB/s)(6256KiB/66093msec) clat (msec): min=6, max=252, avg=40.55, stdev=28.85 lat (msec): min=6, max=252, avg=40.55, stdev=28.85 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 15], 20.00th=[ 20], | 30.00th=[ 25], 40.00th=[ 29], 50.00th=[ 34], 60.00th=[ 39], | 70.00th=[ 45], 80.00th=[ 56], 90.00th=[ 72], 95.00th=[ 95], | 99.00th=[ 153], 99.50th=[ 186], 99.90th=[ 253], 99.95th=[ 253], | 99.99th=[ 253] bw ( KiB/s): min= 30, max= 412, per=28.28%, avg=99.26, stdev=64.73, samples=124 iops : min= 1, max= 25, avg= 5.38, stdev= 4.09, samples=124 write: IOPS=5, BW=91.3KiB/s (93.5kB/s)(6032KiB/66093msec); 0 zone resets clat (msec): min=50, max=335, avg=132.76, stdev=54.33 lat (msec): min=50, max=336, avg=132.76, stdev=54.33 clat percentiles (msec): | 1.00th=[ 55], 5.00th=[ 68], 10.00th=[ 81], 20.00th=[ 90], | 30.00th=[ 101], 40.00th=[ 111], 50.00th=[ 121], 60.00th=[ 132], | 70.00th=[ 146], 80.00th=[ 165], 90.00th=[ 205], 95.00th=[ 253], | 99.00th=[ 321], 99.50th=[ 334], 99.90th=[ 338], 99.95th=[ 338], | 99.99th=[ 338] bw ( KiB/s): min= 31, max= 160, per=24.54%, avg=90.54, stdev=33.50, samples=130 iops : min= 1, max= 10, avg= 4.83, stdev= 2.15, samples=130 lat (msec) : 10=1.04%, 20=9.51%, 50=27.08%, 100=26.04%, 250=33.72% lat (msec) : 500=2.60% cpu : usr=0.05%, sys=1.44%, ctx=1381, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145024: Sat Sep 5 21:00:59 2026 read: IOPS=5, BW=88.8KiB/s (90.9kB/s)(6032KiB/67932msec) clat (msec): min=7, max=281, avg=41.36, stdev=35.10 lat (msec): min=7, max=281, avg=41.36, stdev=35.10 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 13], 10.00th=[ 15], 20.00th=[ 20], | 30.00th=[ 24], 40.00th=[ 28], 50.00th=[ 33], 60.00th=[ 39], | 70.00th=[ 44], 80.00th=[ 53], 90.00th=[ 73], 95.00th=[ 103], | 99.00th=[ 220], 99.50th=[ 271], 99.90th=[ 284], 99.95th=[ 284], | 99.99th=[ 284] bw ( KiB/s): min= 31, max= 284, per=28.32%, avg=99.40, stdev=56.81, samples=118 iops : min= 1, max= 17, avg= 5.39, stdev= 3.60, samples=118 write: IOPS=5, BW=92.1KiB/s (94.3kB/s)(6256KiB/67932msec); 0 zone resets clat (msec): min=46, max=467, avg=133.67, stdev=56.92 lat (msec): min=46, max=467, avg=133.67, stdev=56.92 clat percentiles (msec): | 1.00th=[ 55], 5.00th=[ 68], 10.00th=[ 78], 20.00th=[ 89], | 30.00th=[ 101], 40.00th=[ 111], 50.00th=[ 123], 60.00th=[ 133], | 70.00th=[ 146], 80.00th=[ 171], 90.00th=[ 215], 95.00th=[ 243], | 99.00th=[ 326], 99.50th=[ 376], 99.90th=[ 468], 99.95th=[ 468], | 99.99th=[ 468] bw ( KiB/s): min= 30, max= 191, per=24.86%, avg=91.72, stdev=35.73, samples=134 iops : min= 1, max= 11, avg= 4.90, stdev= 2.26, samples=134 lat (msec) : 10=0.65%, 20=9.90%, 50=27.60%, 100=23.31%, 250=36.07% lat (msec) : 500=2.47% cpu : usr=0.03%, sys=1.50%, ctx=1408, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=351KiB/s (359kB/s), 84.2KiB/s-94.7KiB/s (86.2kB/s-96.9kB/s), io=23.4MiB (24.5MB), run=66093-68234msec WRITE: bw=369KiB/s (378kB/s), 91.3KiB/s-95.9KiB/s (93.5kB/s-98.2kB/s), io=24.6MiB (25.8MB), run=66093-68234msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=145058: Sat Sep 5 21:01:17 2026 read: IOPS=1, BW=1446KiB/s (1481kB/s)(7168KiB/4956msec) clat (msec): min=90, max=538, avg=278.69, stdev=152.93 lat (msec): min=90, max=538, avg=278.69, stdev=152.93 clat percentiles (msec): | 1.00th=[ 91], 5.00th=[ 91], 10.00th=[ 91], 20.00th=[ 116], | 30.00th=[ 251], 40.00th=[ 251], 50.00th=[ 259], 60.00th=[ 342], | 70.00th=[ 342], 80.00th=[ 359], 90.00th=[ 542], 95.00th=[ 542], | 99.00th=[ 542], 99.50th=[ 542], 99.90th=[ 542], 99.95th=[ 542], | 99.99th=[ 542] bw ( KiB/s): min= 2000, max= 4278, per=65.98%, avg=2583.00, stdev=1130.11, samples=4 iops : min= 1, max= 4, avg= 1.75, stdev= 1.50, samples=4 write: IOPS=1, BW=1033KiB/s (1058kB/s)(5120KiB/4956msec); 0 zone resets clat (msec): min=150, max=840, avg=574.28, stdev=277.34 lat (msec): min=150, max=840, avg=574.41, stdev=277.33 clat percentiles (msec): | 1.00th=[ 150], 5.00th=[ 150], 10.00th=[ 150], 20.00th=[ 150], | 30.00th=[ 460], 40.00th=[ 460], 50.00th=[ 651], 60.00th=[ 651], | 70.00th=[ 768], 80.00th=[ 768], 90.00th=[ 844], 95.00th=[ 844], | 99.00th=[ 844], 99.50th=[ 844], 99.90th=[ 844], 99.95th=[ 844], | 99.99th=[ 844] bw ( KiB/s): min= 1965, max= 3419, per=43.17%, avg=2366.50, stdev=702.58, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (msec) : 100=8.33%, 250=16.67%, 500=41.67%, 750=16.67%, 1000=16.67% cpu : usr=0.00%, sys=4.02%, ctx=79, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145059: Sat Sep 5 21:01:17 2026 read: IOPS=0, BW=392KiB/s (401kB/s)(2048KiB/5230msec) clat (msec): min=99, max=115, avg=107.83, stdev=11.36 lat (msec): min=99, max=115, avg=107.83, stdev=11.36 clat percentiles (msec): | 1.00th=[ 101], 5.00th=[ 101], 10.00th=[ 101], 20.00th=[ 101], | 30.00th=[ 101], 40.00th=[ 101], 50.00th=[ 101], 60.00th=[ 116], | 70.00th=[ 116], 80.00th=[ 116], 90.00th=[ 116], 95.00th=[ 116], | 99.00th=[ 116], 99.50th=[ 116], 99.90th=[ 116], 99.95th=[ 116], | 99.99th=[ 116] bw ( KiB/s): min= 1444, max= 1709, per=40.27%, avg=1576.50, stdev=187.38, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1958KiB/s (2005kB/s)(10.0MiB/5230msec); 0 zone resets clat (msec): min=180, max=1519, avg=488.51, stdev=385.66 lat (msec): min=180, max=1520, avg=488.63, stdev=385.68 clat percentiles (msec): | 1.00th=[ 180], 5.00th=[ 180], 10.00th=[ 180], 20.00th=[ 203], | 30.00th=[ 275], 40.00th=[ 309], 50.00th=[ 401], 60.00th=[ 439], | 70.00th=[ 464], 80.00th=[ 518], 90.00th=[ 584], 95.00th=[ 1519], | 99.00th=[ 1519], 99.50th=[ 1519], 99.90th=[ 1519], 99.95th=[ 1519], | 99.99th=[ 1519] bw ( KiB/s): min= 1709, max= 4087, per=44.66%, avg=2448.00, stdev=897.48, samples=6 iops : min= 1, max= 3, avg= 1.50, stdev= 0.84, samples=6 lat (msec) : 100=8.33%, 250=25.00%, 500=41.67%, 750=16.67%, 2000=8.33% cpu : usr=0.00%, sys=4.00%, ctx=104, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145060: Sat Sep 5 21:01:17 2026 read: IOPS=1, BW=1316KiB/s (1348kB/s)(6144KiB/4668msec) clat (msec): min=104, max=304, avg=206.08, stdev=83.25 lat (msec): min=104, max=304, avg=206.09, stdev=83.25 clat percentiles (msec): | 1.00th=[ 105], 5.00th=[ 105], 10.00th=[ 105], 20.00th=[ 112], | 30.00th=[ 112], 40.00th=[ 199], 50.00th=[ 199], 60.00th=[ 255], | 70.00th=[ 264], 80.00th=[ 264], 90.00th=[ 305], 95.00th=[ 305], | 99.00th=[ 305], 99.50th=[ 305], 99.90th=[ 305], 99.95th=[ 305], | 99.99th=[ 305] bw ( KiB/s): min= 2039, max= 3930, per=79.93%, avg=3129.33, stdev=978.21, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 write: IOPS=1, BW=1316KiB/s (1348kB/s)(6144KiB/4668msec); 0 zone resets clat (msec): min=128, max=1719, avg=560.29, stdev=617.27 lat (msec): min=128, max=1719, avg=560.37, stdev=617.27 clat percentiles (msec): | 1.00th=[ 129], 5.00th=[ 129], 10.00th=[ 129], 20.00th=[ 155], | 30.00th=[ 155], 40.00th=[ 279], 50.00th=[ 279], 60.00th=[ 288], | 70.00th=[ 793], 80.00th=[ 793], 90.00th=[ 1720], 95.00th=[ 1720], | 99.00th=[ 1720], 99.50th=[ 1720], 99.90th=[ 1720], 99.95th=[ 1720], | 99.99th=[ 1720] bw ( KiB/s): min= 1709, max= 4517, per=50.26%, avg=2755.00, stdev=1534.83, samples=3 iops : min= 1, max= 4, avg= 2.00, stdev= 1.73, samples=3 lat (msec) : 250=41.67%, 500=41.67%, 1000=8.33%, 2000=8.33% cpu : usr=0.02%, sys=3.84%, ctx=88, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145061: Sat Sep 5 21:01:17 2026 read: IOPS=0, BW=1007KiB/s (1032kB/s)(5120KiB/5082msec) clat (msec): min=63, max=1325, avg=408.58, stdev=535.95 lat (msec): min=63, max=1325, avg=408.58, stdev=535.95 clat percentiles (msec): | 1.00th=[ 64], 5.00th=[ 64], 10.00th=[ 64], 20.00th=[ 64], | 30.00th=[ 90], 40.00th=[ 90], 50.00th=[ 116], 60.00th=[ 116], | 70.00th=[ 451], 80.00th=[ 451], 90.00th=[ 1334], 95.00th=[ 1334], | 99.00th=[ 1334], 99.50th=[ 1334], 99.90th=[ 1334], 99.95th=[ 1334], | 99.99th=[ 1334] bw ( KiB/s): min= 1965, max= 4087, per=68.56%, avg=2684.00, stdev=1215.16, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 write: IOPS=1, BW=1410KiB/s (1444kB/s)(7168KiB/5082msec); 0 zone resets clat (msec): min=134, max=1096, avg=427.83, stdev=366.77 lat (msec): min=134, max=1097, avg=428.26, stdev=366.52 clat percentiles (msec): | 1.00th=[ 136], 5.00th=[ 136], 10.00th=[ 136], 20.00th=[ 167], | 30.00th=[ 184], 40.00th=[ 184], 50.00th=[ 279], 60.00th=[ 368], | 70.00th=[ 368], 80.00th=[ 768], 90.00th=[ 1099], 95.00th=[ 1099], | 99.00th=[ 1099], 99.50th=[ 1099], 99.90th=[ 1099], 99.95th=[ 1099], | 99.99th=[ 1099] bw ( KiB/s): min= 1965, max= 4213, per=46.79%, avg=2565.00, stdev=1099.25, samples=4 iops : min= 1, max= 4, avg= 1.75, stdev= 1.50, samples=4 lat (msec) : 100=16.67%, 250=33.33%, 500=25.00%, 1000=8.33%, 2000=16.67% cpu : usr=0.00%, sys=3.15%, ctx=77, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3916KiB/s (4010kB/s), 392KiB/s-1446KiB/s (401kB/s-1481kB/s), io=20.0MiB (20.0MB), run=4668-5230msec WRITE: bw=5482KiB/s (5614kB/s), 1033KiB/s-1958KiB/s (1058kB/s-2005kB/s), io=28.0MiB (29.4MB), run=4668-5230msec rand-rw: (groupid=0, jobs=1): err= 0: pid=145063: Sat Sep 5 21:01:18 2026 read: IOPS=1, BW=1928KiB/s (1975kB/s)(7168KiB/3717msec) clat (usec): min=665, max=1006.2k, avg=259344.85, stdev=345076.45 lat (usec): min=666, max=1006.2k, avg=259345.99, stdev=345076.44 clat percentiles (usec): | 1.00th=[ 668], 5.00th=[ 668], 10.00th=[ 668], | 20.00th=[ 898], 30.00th=[ 152044], 40.00th=[ 152044], | 50.00th=[ 158335], 60.00th=[ 225444], 70.00th=[ 225444], | 80.00th=[ 270533], 90.00th=[1002439], 95.00th=[1002439], | 99.00th=[1002439], 99.50th=[1002439], 99.90th=[1002439], | 99.95th=[1002439], 99.99th=[1002439] bw ( KiB/s): min= 2031, max= 4484, per=82.10%, avg=3531.33, stdev=1315.01, samples=3 iops : min= 1, max= 4, avg= 2.67, stdev= 1.53, samples=3 write: IOPS=1, BW=1377KiB/s (1411kB/s)(5120KiB/3717msec); 0 zone resets clat (msec): min=269, max=641, avg=379.02, stdev=154.31 lat (msec): min=269, max=642, avg=379.10, stdev=154.33 clat percentiles (msec): | 1.00th=[ 271], 5.00th=[ 271], 10.00th=[ 271], 20.00th=[ 271], | 30.00th=[ 271], 40.00th=[ 271], 50.00th=[ 330], 60.00th=[ 330], | 70.00th=[ 384], 80.00th=[ 384], 90.00th=[ 642], 95.00th=[ 642], | 99.00th=[ 642], 99.50th=[ 642], 99.90th=[ 642], 99.95th=[ 642], | 99.99th=[ 642] bw ( KiB/s): min= 2015, max= 2043, per=33.74%, avg=2032.00, stdev=12.38, samples=4 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=4 lat (usec) : 750=8.33%, 1000=8.33% lat (msec) : 250=25.00%, 500=41.67%, 750=8.33%, 2000=8.33% cpu : usr=0.00%, sys=12.46%, ctx=229, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145064: Sat Sep 5 21:01:18 2026 read: IOPS=0, BW=430KiB/s (440kB/s)(2048KiB/4761msec) clat (usec): min=1011, max=203597, avg=102304.64, stdev=143249.80 lat (usec): min=1013, max=203599, avg=102306.49, stdev=143250.60 clat percentiles (usec): | 1.00th=[ 1012], 5.00th=[ 1012], 10.00th=[ 1012], 20.00th=[ 1012], | 30.00th=[ 1012], 40.00th=[ 1012], 50.00th=[ 1012], 60.00th=[204473], | 70.00th=[204473], 80.00th=[204473], 90.00th=[204473], 95.00th=[204473], | 99.00th=[204473], 99.50th=[204473], 99.90th=[204473], 99.95th=[204473], | 99.99th=[204473] bw ( KiB/s): min= 1469, max= 2039, per=40.78%, avg=1754.00, stdev=403.05, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2151KiB/s (2202kB/s)(10.0MiB/4761msec); 0 zone resets clat (msec): min=188, max=1444, avg=455.10, stdev=371.71 lat (msec): min=188, max=1444, avg=455.18, stdev=371.71 clat percentiles (msec): | 1.00th=[ 190], 5.00th=[ 190], 10.00th=[ 190], 20.00th=[ 249], | 30.00th=[ 259], 40.00th=[ 262], 50.00th=[ 284], 60.00th=[ 376], | 70.00th=[ 384], 80.00th=[ 468], 90.00th=[ 642], 95.00th=[ 1452], | 99.00th=[ 1452], 99.50th=[ 1452], 99.90th=[ 1452], 99.95th=[ 1452], | 99.99th=[ 1452] bw ( KiB/s): min= 1469, max= 4087, per=45.49%, avg=2739.40, stdev=1247.81, samples=5 iops : min= 1, max= 3, avg= 1.80, stdev= 1.10, samples=5 lat (msec) : 2=8.33%, 250=25.00%, 500=50.00%, 750=8.33%, 2000=8.33% cpu : usr=0.00%, sys=11.64%, ctx=125, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145065: Sat Sep 5 21:01:18 2026 read: IOPS=1, BW=1447KiB/s (1481kB/s)(6144KiB/4247msec) clat (usec): min=639, max=656844, avg=203408.55, stdev=251569.25 lat (usec): min=641, max=656845, avg=203409.71, stdev=251569.15 clat percentiles (usec): | 1.00th=[ 644], 5.00th=[ 644], 10.00th=[ 644], 20.00th=[ 2024], | 30.00th=[ 2024], 40.00th=[ 49546], 50.00th=[ 49546], 60.00th=[252707], | 70.00th=[258999], 80.00th=[258999], 90.00th=[658506], 95.00th=[658506], | 99.00th=[658506], 99.50th=[658506], 99.90th=[658506], 99.95th=[658506], | 99.99th=[658506] bw ( KiB/s): min= 2015, max= 6095, per=78.69%, avg=3384.33, stdev=2347.55, samples=3 iops : min= 1, max= 5, avg= 2.33, stdev= 2.31, samples=3 write: IOPS=1, BW=1447KiB/s (1481kB/s)(6144KiB/4247msec); 0 zone resets clat (msec): min=113, max=1706, avg=503.71, stdev=607.56 lat (msec): min=113, max=1706, avg=503.99, stdev=607.56 clat percentiles (msec): | 1.00th=[ 114], 5.00th=[ 114], 10.00th=[ 114], 20.00th=[ 153], | 30.00th=[ 153], 40.00th=[ 167], 50.00th=[ 167], 60.00th=[ 414], | 70.00th=[ 472], 80.00th=[ 472], 90.00th=[ 1703], 95.00th=[ 1703], | 99.00th=[ 1703], 99.50th=[ 1703], 99.90th=[ 1703], 99.95th=[ 1703], | 99.99th=[ 1703] bw ( KiB/s): min= 1556, max= 4087, per=38.96%, avg=2346.40, stdev=994.46, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 lat (usec) : 750=8.33% lat (msec) : 4=8.33%, 50=8.33%, 250=25.00%, 500=33.33%, 750=8.33% lat (msec) : 2000=8.33% cpu : usr=0.02%, sys=12.93%, ctx=163, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145066: Sat Sep 5 21:01:18 2026 read: IOPS=1, BW=1565KiB/s (1603kB/s)(5120KiB/3271msec) clat (msec): min=108, max=439, avg=217.86, stdev=128.97 lat (msec): min=108, max=439, avg=217.86, stdev=128.97 clat percentiles (msec): | 1.00th=[ 109], 5.00th=[ 109], 10.00th=[ 109], 20.00th=[ 109], | 30.00th=[ 153], 40.00th=[ 153], 50.00th=[ 192], 60.00th=[ 192], | 70.00th=[ 199], 80.00th=[ 199], 90.00th=[ 439], 95.00th=[ 439], | 99.00th=[ 439], 99.50th=[ 439], 99.90th=[ 439], 99.95th=[ 439], | 99.99th=[ 439] bw ( KiB/s): min= 2031, max= 6119, per=94.75%, avg=4075.00, stdev=2890.65, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 write: IOPS=2, BW=2191KiB/s (2244kB/s)(7168KiB/3271msec); 0 zone resets clat (msec): min=171, max=584, avg=311.34, stdev=140.82 lat (msec): min=171, max=584, avg=311.42, stdev=140.82 clat percentiles (msec): | 1.00th=[ 171], 5.00th=[ 171], 10.00th=[ 171], 20.00th=[ 207], | 30.00th=[ 249], 40.00th=[ 249], 50.00th=[ 257], 60.00th=[ 317], | 70.00th=[ 317], 80.00th=[ 393], 90.00th=[ 584], 95.00th=[ 584], | 99.00th=[ 584], 99.50th=[ 584], 99.90th=[ 584], 99.95th=[ 584], | 99.99th=[ 584] bw ( KiB/s): min= 1577, max= 4063, per=45.68%, avg=2750.60, stdev=1198.56, samples=5 iops : min= 1, max= 3, avg= 1.80, stdev= 1.10, samples=5 lat (msec) : 250=58.33%, 500=33.33%, 750=8.33% cpu : usr=0.00%, sys=16.82%, ctx=228, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4302KiB/s (4405kB/s), 430KiB/s-1928KiB/s (440kB/s-1975kB/s), io=20.0MiB (20.0MB), run=3271-4761msec WRITE: bw=6022KiB/s (6167kB/s), 1377KiB/s-2191KiB/s (1411kB/s-2244kB/s), io=28.0MiB (29.4MB), run=3271-4761msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=145072: Sat Sep 5 21:01:33 2026 read: IOPS=1, BW=4262KiB/s (4365kB/s)(12.0MiB/2883msec) clat (msec): min=799, max=943, avg=883.94, stdev=75.21 lat (msec): min=799, max=943, avg=883.95, stdev=75.21 clat percentiles (msec): | 1.00th=[ 802], 5.00th=[ 802], 10.00th=[ 802], 20.00th=[ 802], | 30.00th=[ 802], 40.00th=[ 911], 50.00th=[ 911], 60.00th=[ 911], | 70.00th=[ 944], 80.00th=[ 944], 90.00th=[ 944], 95.00th=[ 944], | 99.00th=[ 944], 99.50th=[ 944], 99.90th=[ 944], 99.95th=[ 944], | 99.99th=[ 944] bw ( KiB/s): min= 7641, max= 8126, per=100.00%, avg=7883.50, stdev=342.95, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=100.00% cpu : usr=0.00%, sys=15.72%, ctx=361, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145073: Sat Sep 5 21:01:33 2026 read: IOPS=0, BW=1933KiB/s (1979kB/s)(4096KiB/2119msec) clat (nsec): min=784913k, max=784913k, avg=784912630.00, stdev= 0.00 lat (nsec): min=784916k, max=784916k, avg=784916012.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 785], 5.00th=[ 785], 10.00th=[ 785], 20.00th=[ 785], | 30.00th=[ 785], 40.00th=[ 785], 50.00th=[ 785], 60.00th=[ 785], | 70.00th=[ 785], 80.00th=[ 785], 90.00th=[ 785], 95.00th=[ 785], | 99.00th=[ 785], 99.50th=[ 785], 99.90th=[ 785], 99.95th=[ 785], | 99.99th=[ 785] bw ( KiB/s): min= 8126, max= 8126, per=100.00%, avg=8126.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=3866KiB/s (3959kB/s)(8192KiB/2119msec); 0 zone resets clat (msec): min=424, max=761, avg=593.03, stdev=238.87 lat (msec): min=425, max=762, avg=593.85, stdev=238.44 clat percentiles (msec): | 1.00th=[ 426], 5.00th=[ 426], 10.00th=[ 426], 20.00th=[ 426], | 30.00th=[ 426], 40.00th=[ 426], 50.00th=[ 426], 60.00th=[ 760], | 70.00th=[ 760], 80.00th=[ 760], 90.00th=[ 760], 95.00th=[ 760], | 99.00th=[ 760], 99.50th=[ 760], 99.90th=[ 760], 99.95th=[ 760], | 99.99th=[ 760] bw ( KiB/s): min= 8126, max= 8126, per=90.30%, avg=8126.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 1000=66.67% cpu : usr=0.00%, sys=10.48%, ctx=235, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145074: Sat Sep 5 21:01:33 2026 write: IOPS=0, BW=3375KiB/s (3456kB/s)(12.0MiB/3641msec); 0 zone resets clat (msec): min=430, max=1628, avg=1193.79, stdev=663.14 lat (msec): min=430, max=1629, avg=1194.46, stdev=663.48 clat percentiles (msec): | 1.00th=[ 430], 5.00th=[ 430], 10.00th=[ 430], 20.00th=[ 430], | 30.00th=[ 430], 40.00th=[ 1519], 50.00th=[ 1519], 60.00th=[ 1519], | 70.00th=[ 1636], 80.00th=[ 1636], 90.00th=[ 1636], 95.00th=[ 1636], | 99.00th=[ 1636], 99.50th=[ 1636], 99.90th=[ 1636], 99.95th=[ 1636], | 99.99th=[ 1636] bw ( KiB/s): min= 7641, max= 8175, per=87.88%, avg=7908.00, stdev=377.60, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.00%, sys=4.34%, ctx=80, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145075: Sat Sep 5 21:01:33 2026 write: IOPS=1, BW=7953KiB/s (8144kB/s)(12.0MiB/1545msec); 0 zone resets clat (msec): min=362, max=575, avg=443.42, stdev=115.26 lat (msec): min=363, max=575, avg=444.16, stdev=114.88 clat percentiles (msec): | 1.00th=[ 363], 5.00th=[ 363], 10.00th=[ 363], 20.00th=[ 363], | 30.00th=[ 363], 40.00th=[ 393], 50.00th=[ 393], 60.00th=[ 393], | 70.00th=[ 575], 80.00th=[ 575], 90.00th=[ 575], 95.00th=[ 575], | 99.00th=[ 575], 99.50th=[ 575], 99.90th=[ 575], 99.95th=[ 575], | 99.99th=[ 575] bw ( KiB/s): min= 5902, max= 8126, per=77.94%, avg=7014.00, stdev=1572.61, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=66.67%, 750=33.33% cpu : usr=0.19%, sys=9.33%, ctx=56, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5683KiB/s (5819kB/s), 1933KiB/s-4262KiB/s (1979kB/s-4365kB/s), io=16.0MiB (16.8MB), run=2119-2883msec WRITE: bw=9000KiB/s (9216kB/s), 3375KiB/s-7953KiB/s (3456kB/s-8144kB/s), io=32.0MiB (33.6MB), run=1545-3641msec rand-rw: (groupid=0, jobs=1): err= 0: pid=145077: Sat Sep 5 21:01:33 2026 read: IOPS=1, BW=4531KiB/s (4640kB/s)(12.0MiB/2712msec) clat (msec): min=294, max=1468, avg=893.31, stdev=587.21 lat (msec): min=294, max=1468, avg=893.32, stdev=587.21 clat percentiles (msec): | 1.00th=[ 296], 5.00th=[ 296], 10.00th=[ 296], 20.00th=[ 296], | 30.00th=[ 296], 40.00th=[ 919], 50.00th=[ 919], 60.00th=[ 919], | 70.00th=[ 1469], 80.00th=[ 1469], 90.00th=[ 1469], 95.00th=[ 1469], | 99.00th=[ 1469], 99.50th=[ 1469], 99.90th=[ 1469], 99.95th=[ 1469], | 99.99th=[ 1469] bw ( KiB/s): min= 8192, max= 8192, per=100.00%, avg=8192.00, stdev= 0.00, samples=2 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=3.10%, ctx=44, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145078: Sat Sep 5 21:01:33 2026 read: IOPS=0, BW=1350KiB/s (1382kB/s)(4096KiB/3035msec) clat (nsec): min=774589k, max=774589k, avg=774588786.00, stdev= 0.00 lat (nsec): min=774591k, max=774591k, avg=774591433.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 776], 5.00th=[ 776], 10.00th=[ 776], 20.00th=[ 776], | 30.00th=[ 776], 40.00th=[ 776], 50.00th=[ 776], 60.00th=[ 776], | 70.00th=[ 776], 80.00th=[ 776], 90.00th=[ 776], 95.00th=[ 776], | 99.00th=[ 776], 99.50th=[ 776], 99.90th=[ 776], 99.95th=[ 776], | 99.99th=[ 776] bw ( KiB/s): min= 8192, max= 8192, per=100.00%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2699KiB/s (2764kB/s)(8192KiB/3035msec); 0 zone resets clat (msec): min=1046, max=1180, avg=1113.77, stdev=94.50 lat (msec): min=1047, max=1181, avg=1114.20, stdev=94.51 clat percentiles (msec): | 1.00th=[ 1045], 5.00th=[ 1045], 10.00th=[ 1045], 20.00th=[ 1045], | 30.00th=[ 1045], 40.00th=[ 1045], 50.00th=[ 1045], 60.00th=[ 1183], | 70.00th=[ 1183], 80.00th=[ 1183], 90.00th=[ 1183], 95.00th=[ 1183], | 99.00th=[ 1183], 99.50th=[ 1183], 99.90th=[ 1183], 99.95th=[ 1183], | 99.99th=[ 1183] bw ( KiB/s): min= 7953, max= 7953, per=73.67%, avg=7953.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 1000=33.33%, 2000=66.67% cpu : usr=0.00%, sys=5.44%, ctx=68, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145079: Sat Sep 5 21:01:33 2026 write: IOPS=1, BW=4110KiB/s (4208kB/s)(12.0MiB/2990msec); 0 zone resets clat (msec): min=313, max=1477, avg=993.58, stdev=605.97 lat (msec): min=314, max=1477, avg=994.05, stdev=606.00 clat percentiles (msec): | 1.00th=[ 313], 5.00th=[ 313], 10.00th=[ 313], 20.00th=[ 313], | 30.00th=[ 313], 40.00th=[ 1183], 50.00th=[ 1183], 60.00th=[ 1183], | 70.00th=[ 1485], 80.00th=[ 1485], 90.00th=[ 1485], 95.00th=[ 1485], | 99.00th=[ 1485], 99.50th=[ 1485], 99.90th=[ 1485], 99.95th=[ 1485], | 99.99th=[ 1485] bw ( KiB/s): min= 8159, max= 8159, per=75.57%, avg=8159.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.03%, sys=3.91%, ctx=50, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145080: Sat Sep 5 21:01:33 2026 write: IOPS=1, BW=5868KiB/s (6009kB/s)(12.0MiB/2094msec); 0 zone resets clat (msec): min=310, max=1182, avg=695.99, stdev=444.73 lat (msec): min=313, max=1183, avg=697.58, stdev=443.78 clat percentiles (msec): | 1.00th=[ 309], 5.00th=[ 309], 10.00th=[ 309], 20.00th=[ 309], | 30.00th=[ 309], 40.00th=[ 592], 50.00th=[ 592], 60.00th=[ 592], | 70.00th=[ 1183], 80.00th=[ 1183], 90.00th=[ 1183], 95.00th=[ 1183], | 99.00th=[ 1183], 99.50th=[ 1183], 99.90th=[ 1183], 99.95th=[ 1183], | 99.99th=[ 1183] bw ( KiB/s): min= 5851, max= 5851, per=54.20%, avg=5851.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.00%, sys=5.06%, ctx=49, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5398KiB/s (5528kB/s), 1350KiB/s-4531KiB/s (1382kB/s-4640kB/s), io=16.0MiB (16.8MB), run=2712-3035msec WRITE: bw=10.5MiB/s (11.1MB/s), 2699KiB/s-5868KiB/s (2764kB/s-6009kB/s), io=32.0MiB (33.6MB), run=2094-3035msec