== sanity test 398b: DIO and buffer IO race ============== 15:48:39 (1782762519) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 5.87214 s, 8.6 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179233: Mon Jun 29 15:50:59 2026 read: IOPS=12, BW=49.7KiB/s (50.9kB/s)(5992KiB/120521msec) clat (usec): min=32, max=1101.9k, avg=44586.98, stdev=38837.53 lat (usec): min=33, max=1101.9k, avg=44592.04, stdev=38833.89 clat percentiles (usec): | 1.00th=[ 54], 5.00th=[ 11994], 10.00th=[ 17957], | 20.00th=[ 23462], 30.00th=[ 27919], 40.00th=[ 32900], | 50.00th=[ 38011], 60.00th=[ 44827], 70.00th=[ 51643], | 80.00th=[ 62129], 90.00th=[ 78119], 95.00th=[ 92799], | 99.00th=[ 143655], 99.50th=[ 179307], 99.90th=[ 240124], | 99.95th=[1098908], 99.99th=[1098908] bw ( KiB/s): min= 15, max= 95, per=25.21%, avg=49.67, stdev=16.83, samples=236 iops : min= 3, max= 23, avg=11.75, stdev= 4.23, samples=236 write: IOPS=13, BW=52.2KiB/s (53.5kB/s)(6296KiB/120521msec); 0 zone resets clat (usec): min=1193, max=265012, avg=33833.37, stdev=34444.24 lat (usec): min=1193, max=265014, avg=33836.03, stdev=34444.30 clat percentiles (usec): | 1.00th=[ 1287], 5.00th=[ 1450], 10.00th=[ 2040], 20.00th=[ 4490], | 30.00th=[ 8160], 40.00th=[ 15795], 50.00th=[ 24511], 60.00th=[ 32900], | 70.00th=[ 42206], 80.00th=[ 57934], 90.00th=[ 80217], 95.00th=[ 99091], | 99.00th=[154141], 99.50th=[175113], 99.90th=[252707], 99.95th=[265290], | 99.99th=[265290] bw ( KiB/s): min= 7, max= 119, per=25.29%, avg=52.10, stdev=22.50, samples=236 iops : min= 1, max= 29, avg=12.36, stdev= 5.65, samples=236 lat (usec) : 50=0.23%, 100=1.37%, 250=0.23%, 500=0.07% lat (msec) : 2=5.01%, 4=4.43%, 10=7.75%, 20=9.70%, 50=43.00% lat (msec) : 100=23.99%, 250=4.13%, 500=0.07%, 2000=0.03% cpu : usr=0.07%, sys=5.97%, ctx=6814, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179234: Mon Jun 29 15:50:59 2026 read: IOPS=12, BW=48.8KiB/s (49.0kB/s)(5940KiB/121746msec) clat (usec): min=36, max=1051.1k, avg=44856.66, stdev=37036.82 lat (usec): min=36, max=1051.1k, avg=44858.11, stdev=37036.86 clat percentiles (usec): | 1.00th=[ 55], 5.00th=[ 13304], 10.00th=[ 18220], | 20.00th=[ 23987], 30.00th=[ 28443], 40.00th=[ 33817], | 50.00th=[ 39060], 60.00th=[ 44827], 70.00th=[ 52691], | 80.00th=[ 62129], 90.00th=[ 77071], 95.00th=[ 91751], | 99.00th=[ 139461], 99.50th=[ 158335], 99.90th=[ 223347], | 99.95th=[1052771], 99.99th=[1052771] bw ( KiB/s): min= 7, max= 95, per=24.58%, avg=48.43, stdev=17.80, samples=239 iops : min= 1, max= 23, avg=11.45, stdev= 4.50, samples=239 write: IOPS=13, BW=52.1KiB/s (53.4kB/s)(6348KiB/121746msec); 0 zone resets clat (usec): min=1144, max=213238, avg=34451.73, stdev=33501.64 lat (usec): min=1146, max=213239, avg=34461.24, stdev=33502.65 clat percentiles (usec): | 1.00th=[ 1287], 5.00th=[ 1450], 10.00th=[ 2073], 20.00th=[ 4490], | 30.00th=[ 8160], 40.00th=[ 16450], 50.00th=[ 26346], 60.00th=[ 34866], | 70.00th=[ 45351], 80.00th=[ 58983], 90.00th=[ 79168], 95.00th=[101188], | 99.00th=[143655], 99.50th=[158335], 99.90th=[193987], 99.95th=[212861], | 99.99th=[212861] bw ( KiB/s): min= 7, max= 128, per=25.19%, avg=51.90, stdev=21.58, samples=238 iops : min= 1, max= 32, avg=12.32, stdev= 5.44, samples=238 lat (usec) : 50=0.16%, 100=1.30%, 250=0.13% lat (msec) : 2=4.98%, 4=4.75%, 10=7.58%, 20=9.51%, 50=41.44% lat (msec) : 100=25.78%, 250=4.33%, 2000=0.03% cpu : usr=0.08%, sys=5.69%, ctx=6909, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179235: Mon Jun 29 15:50:59 2026 read: IOPS=12, BW=50.5KiB/s (51.7kB/s)(6028KiB/119461msec) clat (usec): min=35, max=237278, avg=43696.85, stdev=26724.40 lat (usec): min=35, max=237279, avg=43702.52, stdev=26722.93 clat percentiles (usec): | 1.00th=[ 56], 5.00th=[ 12911], 10.00th=[ 17957], 20.00th=[ 23725], | 30.00th=[ 28443], 40.00th=[ 33817], 50.00th=[ 38536], 60.00th=[ 44303], | 70.00th=[ 51119], 80.00th=[ 60556], 90.00th=[ 76022], 95.00th=[ 90702], | 99.00th=[133694], 99.50th=[164627], 99.90th=[210764], 99.95th=[238027], | 99.99th=[238027] bw ( KiB/s): min= 7, max= 126, per=25.57%, avg=50.37, stdev=18.63, samples=234 iops : min= 1, max= 31, avg=11.93, stdev= 4.67, samples=234 write: IOPS=13, BW=52.4KiB/s (53.7kB/s)(6260KiB/119461msec); 0 zone resets clat (usec): min=1206, max=1026.9k, avg=33946.47, stdev=42018.30 lat (usec): min=1207, max=1026.9k, avg=33957.49, stdev=42012.86 clat percentiles (usec): | 1.00th=[ 1303], 5.00th=[ 1500], 10.00th=[ 2180], | 20.00th=[ 4228], 30.00th=[ 7504], 40.00th=[ 15926], | 50.00th=[ 25560], 60.00th=[ 32375], 70.00th=[ 42206], | 80.00th=[ 56886], 90.00th=[ 81265], 95.00th=[ 98042], | 99.00th=[ 152044], 99.50th=[ 166724], 99.90th=[ 295699], | 99.95th=[1027605], 99.99th=[1027605] bw ( KiB/s): min= 7, max= 128, per=25.26%, avg=52.03, stdev=20.62, samples=235 iops : min= 1, max= 32, avg=12.35, stdev= 5.22, samples=235 lat (usec) : 50=0.16%, 100=1.50%, 250=0.16%, 500=0.03%, 750=0.03% lat (msec) : 2=4.30%, 4=5.37%, 10=7.85%, 20=9.34%, 50=43.03% lat (msec) : 100=24.09%, 250=4.07%, 500=0.03%, 2000=0.03% cpu : usr=0.09%, sys=5.96%, ctx=6807, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179236: Mon Jun 29 15:50:59 2026 read: IOPS=12, BW=50.6KiB/s (51.8kB/s)(6052KiB/119651msec) clat (usec): min=37, max=238246, avg=44220.52, stdev=28196.90 lat (usec): min=37, max=238247, avg=44225.26, stdev=28194.93 clat percentiles (usec): | 1.00th=[ 56], 5.00th=[ 8717], 10.00th=[ 17957], 20.00th=[ 23462], | 30.00th=[ 27919], 40.00th=[ 33424], 50.00th=[ 38536], 60.00th=[ 44827], | 70.00th=[ 52167], 80.00th=[ 61604], 90.00th=[ 78119], 95.00th=[ 93848], | 99.00th=[139461], 99.50th=[160433], 99.90th=[210764], 99.95th=[238027], | 99.99th=[238027] bw ( KiB/s): min= 15, max= 103, per=25.54%, avg=50.32, stdev=17.66, samples=235 iops : min= 3, max= 25, avg=11.92, stdev= 4.43, samples=235 write: IOPS=13, BW=52.1KiB/s (53.4kB/s)(6236KiB/119651msec); 0 zone resets clat (usec): min=1085, max=1048.8k, avg=33532.69, stdev=40964.70 lat (usec): min=1086, max=1048.8k, avg=33539.54, stdev=40975.77 clat percentiles (usec): | 1.00th=[ 1287], 5.00th=[ 1450], 10.00th=[ 2147], | 20.00th=[ 4621], 30.00th=[ 7701], 40.00th=[ 17171], | 50.00th=[ 25297], 60.00th=[ 32375], 70.00th=[ 42206], | 80.00th=[ 57934], 90.00th=[ 78119], 95.00th=[ 96994], | 99.00th=[ 133694], 99.50th=[ 147850], 99.90th=[ 219153], | 99.95th=[1052771], 99.99th=[1052771] bw ( KiB/s): min= 7, max= 118, per=25.15%, avg=51.80, stdev=19.76, samples=235 iops : min= 1, max= 29, avg=12.30, stdev= 4.97, samples=235 lat (usec) : 50=0.23%, 100=2.02%, 500=0.03%, 750=0.03%, 1000=0.03% lat (msec) : 2=4.75%, 4=4.23%, 10=8.20%, 20=9.15%, 50=42.94% lat (msec) : 100=24.41%, 250=3.94%, 2000=0.03% cpu : usr=0.10%, sys=5.88%, ctx=6876, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=197KiB/s (202kB/s), 48.8KiB/s-50.6KiB/s (49.0kB/s-51.8kB/s), io=23.4MiB (24.6MB), run=119461-121746msec WRITE: bw=206KiB/s (211kB/s), 52.1KiB/s-52.4KiB/s (53.4kB/s-53.7kB/s), io=24.6MiB (25.7MB), run=119461-121746msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179238: Mon Jun 29 15:51:41 2026 read: IOPS=9, BW=36.7KiB/s (37.6kB/s)(5992KiB/163240msec) clat (msec): min=5, max=1076, avg=43.49, stdev=44.74 lat (msec): min=5, max=1076, avg=43.49, stdev=44.74 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 15], 20.00th=[ 18], | 30.00th=[ 22], 40.00th=[ 26], 50.00th=[ 31], 60.00th=[ 36], | 70.00th=[ 46], 80.00th=[ 62], 90.00th=[ 90], 95.00th=[ 122], | 99.00th=[ 182], 99.50th=[ 194], 99.90th=[ 330], 99.95th=[ 1083], | 99.99th=[ 1083] bw ( KiB/s): min= 7, max= 142, per=25.40%, avg=37.08, stdev=23.97, samples=315 iops : min= 1, max= 35, avg= 8.60, stdev= 6.03, samples=315 write: IOPS=9, BW=38.6KiB/s (39.5kB/s)(6296KiB/163240msec); 0 zone resets clat (msec): min=9, max=317, avg=62.22, stdev=40.05 lat (msec): min=9, max=317, avg=62.22, stdev=40.04 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 22], 10.00th=[ 25], 20.00th=[ 31], | 30.00th=[ 36], 40.00th=[ 42], 50.00th=[ 48], 60.00th=[ 59], | 70.00th=[ 75], 80.00th=[ 92], 90.00th=[ 118], 95.00th=[ 140], | 99.00th=[ 192], 99.50th=[ 220], 99.90th=[ 309], 99.95th=[ 317], | 99.99th=[ 317] bw ( KiB/s): min= 7, max= 103, per=25.06%, avg=38.34, stdev=21.34, samples=320 iops : min= 1, max= 25, avg= 8.92, stdev= 5.37, samples=320 lat (msec) : 10=1.53%, 20=12.89%, 50=47.82%, 100=25.75%, 250=11.85% lat (msec) : 500=0.13%, 2000=0.03% cpu : usr=0.06%, sys=2.23%, ctx=5075, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179239: Mon Jun 29 15:51:41 2026 read: IOPS=9, BW=36.3KiB/s (37.1kB/s)(5940KiB/163731msec) clat (msec): min=5, max=1084, avg=42.25, stdev=44.41 lat (msec): min=5, max=1084, avg=42.25, stdev=44.41 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 18], | 30.00th=[ 21], 40.00th=[ 26], 50.00th=[ 30], 60.00th=[ 35], | 70.00th=[ 44], 80.00th=[ 60], 90.00th=[ 88], 95.00th=[ 116], | 99.00th=[ 180], 99.50th=[ 197], 99.90th=[ 347], 99.95th=[ 1083], | 99.99th=[ 1083] bw ( KiB/s): min= 7, max= 127, per=25.15%, avg=36.71, stdev=24.13, samples=315 iops : min= 1, max= 31, avg= 8.51, stdev= 6.05, samples=315 write: IOPS=9, BW=38.8KiB/s (39.7kB/s)(6348KiB/163731msec); 0 zone resets clat (msec): min=12, max=385, avg=63.55, stdev=42.41 lat (msec): min=12, max=385, avg=63.55, stdev=42.41 clat percentiles (msec): | 1.00th=[ 18], 5.00th=[ 22], 10.00th=[ 26], 20.00th=[ 31], | 30.00th=[ 37], 40.00th=[ 43], 50.00th=[ 51], 60.00th=[ 60], | 70.00th=[ 74], 80.00th=[ 93], 90.00th=[ 120], 95.00th=[ 148], | 99.00th=[ 207], 99.50th=[ 239], 99.90th=[ 313], 99.95th=[ 384], | 99.99th=[ 384] bw ( KiB/s): min= 7, max= 119, per=25.29%, avg=38.70, stdev=21.99, samples=320 iops : min= 1, max= 29, avg= 9.00, stdev= 5.52, samples=320 lat (msec) : 10=1.30%, 20=13.51%, 50=46.71%, 100=26.46%, 250=11.82% lat (msec) : 500=0.16%, 2000=0.03% cpu : usr=0.06%, sys=2.22%, ctx=4973, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179240: Mon Jun 29 15:51:41 2026 read: IOPS=9, BW=36.8KiB/s (37.7kB/s)(6028KiB/163616msec) clat (msec): min=6, max=242, avg=42.73, stdev=35.15 lat (msec): min=6, max=242, avg=42.73, stdev=35.15 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 18], | 30.00th=[ 22], 40.00th=[ 26], 50.00th=[ 31], 60.00th=[ 36], | 70.00th=[ 46], 80.00th=[ 62], 90.00th=[ 94], 95.00th=[ 114], | 99.00th=[ 169], 99.50th=[ 190], 99.90th=[ 234], 99.95th=[ 243], | 99.99th=[ 243] bw ( KiB/s): min= 7, max= 143, per=25.38%, avg=37.05, stdev=23.45, samples=316 iops : min= 1, max= 35, avg= 8.59, stdev= 5.88, samples=316 write: IOPS=9, BW=38.3KiB/s (39.2kB/s)(6260KiB/163616msec); 0 zone resets clat (msec): min=8, max=1115, avg=63.29, stdev=49.56 lat (msec): min=8, max=1115, avg=63.29, stdev=49.56 clat percentiles (msec): | 1.00th=[ 18], 5.00th=[ 23], 10.00th=[ 26], 20.00th=[ 32], | 30.00th=[ 36], 40.00th=[ 42], 50.00th=[ 49], 60.00th=[ 59], | 70.00th=[ 71], 80.00th=[ 92], 90.00th=[ 120], 95.00th=[ 148], | 99.00th=[ 201], 99.50th=[ 249], 99.90th=[ 359], 99.95th=[ 1116], | 99.99th=[ 1116] bw ( KiB/s): min= 7, max= 111, per=24.89%, avg=38.08, stdev=22.06, samples=319 iops : min= 1, max= 27, avg= 8.85, stdev= 5.54, samples=319 lat (msec) : 10=1.11%, 20=12.86%, 50=48.27%, 100=25.20%, 250=12.34% lat (msec) : 500=0.20%, 2000=0.03% cpu : usr=0.07%, sys=2.32%, ctx=5043, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179242: Mon Jun 29 15:51:41 2026 read: IOPS=9, BW=36.9KiB/s (37.8kB/s)(6052KiB/163806msec) clat (msec): min=5, max=439, avg=42.52, stdev=36.12 lat (msec): min=5, max=439, avg=42.52, stdev=36.11 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 14], 20.00th=[ 18], | 30.00th=[ 22], 40.00th=[ 26], 50.00th=[ 31], 60.00th=[ 37], | 70.00th=[ 47], 80.00th=[ 64], 90.00th=[ 88], 95.00th=[ 112], | 99.00th=[ 180], 99.50th=[ 199], 99.90th=[ 321], 99.95th=[ 439], | 99.99th=[ 439] bw ( KiB/s): min= 7, max= 119, per=25.55%, avg=37.30, stdev=23.47, samples=316 iops : min= 1, max= 29, avg= 8.65, stdev= 5.89, samples=316 write: IOPS=9, BW=38.1KiB/s (38.0kB/s)(6236KiB/163806msec); 0 zone resets clat (msec): min=14, max=1116, avg=63.71, stdev=48.97 lat (msec): min=14, max=1116, avg=63.71, stdev=48.97 clat percentiles (msec): | 1.00th=[ 20], 5.00th=[ 23], 10.00th=[ 27], 20.00th=[ 32], | 30.00th=[ 37], 40.00th=[ 43], 50.00th=[ 51], 60.00th=[ 59], | 70.00th=[ 73], 80.00th=[ 91], 90.00th=[ 120], 95.00th=[ 142], | 99.00th=[ 211], 99.50th=[ 264], 99.90th=[ 317], 99.95th=[ 1116], | 99.99th=[ 1116] bw ( KiB/s): min= 7, max= 103, per=24.96%, avg=38.19, stdev=21.22, samples=318 iops : min= 1, max= 25, avg= 8.87, stdev= 5.32, samples=318 lat (msec) : 10=1.63%, 20=12.66%, 50=46.78%, 100=27.41%, 250=11.13% lat (msec) : 500=0.36%, 2000=0.03% cpu : usr=0.06%, sys=2.21%, ctx=5031, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=147KiB/s (150kB/s), 36.3KiB/s-36.9KiB/s (37.1kB/s-37.8kB/s), io=23.4MiB (24.6MB), run=163240-163806msec WRITE: bw=153KiB/s (157kB/s), 38.1KiB/s-38.8KiB/s (38.0kB/s-39.7kB/s), io=24.6MiB (25.7MB), run=163240-163806msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179281: Mon Jun 29 15:52:27 2026 read: IOPS=10, BW=172KiB/s (177kB/s)(5920KiB/34344msec) clat (usec): min=39, max=232412, avg=49464.97, stdev=34941.29 lat (usec): min=40, max=232413, avg=49467.98, stdev=34940.77 clat percentiles (usec): | 1.00th=[ 56], 5.00th=[ 75], 10.00th=[ 1172], 20.00th=[ 24773], | 30.00th=[ 30802], 40.00th=[ 35914], 50.00th=[ 43254], 60.00th=[ 49546], | 70.00th=[ 58459], 80.00th=[ 73925], 90.00th=[ 95945], 95.00th=[119014], | 99.00th=[152044], 99.50th=[185598], 99.90th=[231736], 99.95th=[231736], | 99.99th=[231736] bw ( KiB/s): min= 63, max= 351, per=25.46%, avg=170.07, stdev=68.46, samples=67 iops : min= 3, max= 21, avg= 9.81, stdev= 4.30, samples=67 write: IOPS=11, BW=185KiB/s (190kB/s)(6368KiB/34344msec); 0 zone resets clat (usec): min=1757, max=209850, avg=39940.97, stdev=38302.12 lat (usec): min=1759, max=209851, avg=39952.40, stdev=38310.54 clat percentiles (usec): | 1.00th=[ 1909], 5.00th=[ 2900], 10.00th=[ 4752], 20.00th=[ 7832], | 30.00th=[ 11994], 40.00th=[ 19530], 50.00th=[ 28181], 60.00th=[ 36439], | 70.00th=[ 50070], 80.00th=[ 65799], 90.00th=[ 94897], 95.00th=[123208], | 99.00th=[168821], 99.50th=[173016], 99.90th=[210764], 99.95th=[210764], | 99.99th=[210764] bw ( KiB/s): min= 31, max= 414, per=26.30%, avg=184.66, stdev=78.68, samples=67 iops : min= 1, max= 25, avg=10.73, stdev= 4.95, samples=67 lat (usec) : 50=0.26%, 100=3.65%, 250=0.39%, 500=0.26%, 750=0.13% lat (msec) : 2=1.04%, 4=3.26%, 10=9.51%, 20=9.64%, 50=37.11% lat (msec) : 100=26.30%, 250=8.46% cpu : usr=0.07%, sys=5.79%, ctx=1691, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179282: Mon Jun 29 15:52:27 2026 read: IOPS=10, BW=163KiB/s (167kB/s)(5744KiB/35185msec) clat (usec): min=41, max=296458, avg=52902.33, stdev=36359.60 lat (usec): min=42, max=296460, avg=52906.52, stdev=36357.67 clat percentiles (usec): | 1.00th=[ 56], 5.00th=[ 71], 10.00th=[ 14222], 20.00th=[ 28443], | 30.00th=[ 34866], 40.00th=[ 40633], 50.00th=[ 46924], 60.00th=[ 55837], | 70.00th=[ 63177], 80.00th=[ 72877], 90.00th=[ 94897], 95.00th=[116917], | 99.00th=[166724], 99.50th=[221250], 99.90th=[295699], 99.95th=[295699], | 99.99th=[295699] bw ( KiB/s): min= 31, max= 287, per=24.45%, avg=163.35, stdev=62.65, samples=69 iops : min= 1, max= 17, avg= 9.38, stdev= 3.96, samples=69 write: IOPS=11, BW=186KiB/s (190kB/s)(6544KiB/35185msec); 0 zone resets clat (usec): min=1553, max=277810, avg=39424.34, stdev=38657.18 lat (usec): min=1555, max=277813, avg=39431.75, stdev=38655.93 clat percentiles (msec): | 1.00th=[ 3], 5.00th=[ 4], 10.00th=[ 6], 20.00th=[ 9], | 30.00th=[ 13], 40.00th=[ 20], 50.00th=[ 29], 60.00th=[ 36], | 70.00th=[ 50], 80.00th=[ 67], 90.00th=[ 92], 95.00th=[ 109], | 99.00th=[ 171], 99.50th=[ 220], 99.90th=[ 279], 99.95th=[ 279], | 99.99th=[ 279] bw ( KiB/s): min= 31, max= 473, per=26.50%, avg=186.00, stdev=87.32, samples=69 iops : min= 1, max= 29, avg=10.83, stdev= 5.55, samples=69 lat (usec) : 50=0.39%, 100=2.99%, 250=0.26%, 500=0.26%, 750=0.13% lat (msec) : 2=0.78%, 4=2.73%, 10=9.51%, 20=10.29%, 50=35.81% lat (msec) : 100=29.43%, 250=7.03%, 500=0.39% cpu : usr=0.07%, sys=5.93%, ctx=1864, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179283: Mon Jun 29 15:52:27 2026 read: IOPS=10, BW=175KiB/s (179kB/s)(6256KiB/35851msec) clat (usec): min=40, max=221372, avg=50140.48, stdev=32323.79 lat (usec): min=40, max=221374, avg=50143.10, stdev=32324.14 clat percentiles (usec): | 1.00th=[ 59], 5.00th=[ 73], 10.00th=[ 19530], 20.00th=[ 26608], | 30.00th=[ 32637], 40.00th=[ 38011], 50.00th=[ 43254], 60.00th=[ 50594], | 70.00th=[ 60556], 80.00th=[ 72877], 90.00th=[ 90702], 95.00th=[109577], | 99.00th=[160433], 99.50th=[206570], 99.90th=[221250], 99.95th=[221250], | 99.99th=[221250] bw ( KiB/s): min= 62, max= 348, per=25.91%, avg=173.06, stdev=65.16, samples=70 iops : min= 3, max= 21, avg=10.00, stdev= 4.11, samples=70 write: IOPS=10, BW=168KiB/s (172kB/s)(6032KiB/35851msec); 0 zone resets clat (usec): min=1700, max=218904, avg=42719.33, stdev=41678.32 lat (usec): min=1703, max=218908, avg=42730.92, stdev=41676.84 clat percentiles (usec): | 1.00th=[ 1926], 5.00th=[ 2343], 10.00th=[ 4113], 20.00th=[ 7767], | 30.00th=[ 13304], 40.00th=[ 21103], 50.00th=[ 31589], 60.00th=[ 39060], | 70.00th=[ 54264], 80.00th=[ 69731], 90.00th=[104334], 95.00th=[124257], | 99.00th=[187696], 99.50th=[214959], 99.90th=[219153], 99.95th=[219153], | 99.99th=[219153] bw ( KiB/s): min= 30, max= 378, per=23.46%, avg=164.67, stdev=78.04, samples=70 iops : min= 1, max= 23, avg= 9.46, stdev= 4.96, samples=70 lat (usec) : 50=0.13%, 100=2.99%, 250=0.39%, 500=0.13% lat (msec) : 2=1.30%, 4=3.39%, 10=7.68%, 20=8.33%, 50=38.67% lat (msec) : 100=28.13%, 250=8.85% cpu : usr=0.08%, sys=5.75%, ctx=1866, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179284: Mon Jun 29 15:52:27 2026 read: IOPS=10, BW=174KiB/s (179kB/s)(6032KiB/34581msec) clat (usec): min=36, max=273998, avg=49083.60, stdev=36853.46 lat (usec): min=36, max=273999, avg=49122.30, stdev=36830.40 clat percentiles (usec): | 1.00th=[ 57], 5.00th=[ 79], 10.00th=[ 124], 20.00th=[ 23987], | 30.00th=[ 31327], 40.00th=[ 36963], 50.00th=[ 45351], 60.00th=[ 51643], | 70.00th=[ 57934], 80.00th=[ 69731], 90.00th=[ 84411], 95.00th=[106431], | 99.00th=[202376], 99.50th=[248513], 99.90th=[274727], 99.95th=[274727], | 99.99th=[274727] bw ( KiB/s): min= 31, max= 350, per=25.76%, avg=172.07, stdev=63.31, samples=68 iops : min= 1, max= 21, avg= 9.94, stdev= 4.01, samples=68 write: IOPS=11, BW=181KiB/s (185kB/s)(6256KiB/34581msec); 0 zone resets clat (usec): min=1778, max=242307, avg=40736.06, stdev=40073.74 lat (usec): min=1780, max=242309, avg=40749.52, stdev=40077.27 clat percentiles (usec): | 1.00th=[ 1909], 5.00th=[ 2507], 10.00th=[ 4113], 20.00th=[ 7504], | 30.00th=[ 10945], 40.00th=[ 17171], 50.00th=[ 28443], 60.00th=[ 38536], | 70.00th=[ 49546], 80.00th=[ 70779], 90.00th=[ 98042], 95.00th=[125305], | 99.00th=[154141], 99.50th=[193987], 99.90th=[242222], 99.95th=[242222], | 99.99th=[242222] bw ( KiB/s): min= 31, max= 350, per=25.60%, avg=179.72, stdev=79.97, samples=68 iops : min= 1, max= 21, avg=10.41, stdev= 5.03, samples=68 lat (usec) : 50=0.26%, 100=3.78%, 250=1.43%, 500=0.26% lat (msec) : 2=1.17%, 4=4.17%, 10=9.38%, 20=8.59%, 50=34.90% lat (msec) : 100=28.26%, 250=7.68%, 500=0.13% cpu : usr=0.08%, sys=6.15%, ctx=1793, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=668KiB/s (684kB/s), 163KiB/s-175KiB/s (167kB/s-179kB/s), io=23.4MiB (24.5MB), run=34344-35851msec WRITE: bw=703KiB/s (720kB/s), 168KiB/s-186KiB/s (172kB/s-190kB/s), io=24.6MiB (25.8MB), run=34344-35851msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179286: Mon Jun 29 15:52:40 2026 read: IOPS=7, BW=123KiB/s (126kB/s)(5920KiB/48010msec) clat (msec): min=6, max=335, avg=52.01, stdev=43.76 lat (msec): min=6, max=335, avg=52.01, stdev=43.76 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 14], 10.00th=[ 17], 20.00th=[ 23], | 30.00th=[ 26], 40.00th=[ 32], 50.00th=[ 37], 60.00th=[ 45], | 70.00th=[ 57], 80.00th=[ 73], 90.00th=[ 112], 95.00th=[ 144], | 99.00th=[ 209], 99.50th=[ 305], 99.90th=[ 334], 99.95th=[ 334], | 99.99th=[ 334] bw ( KiB/s): min= 30, max= 411, per=24.91%, avg=123.55, stdev=76.94, samples=93 iops : min= 1, max= 25, avg= 6.92, stdev= 4.89, samples=93 write: IOPS=8, BW=133KiB/s (136kB/s)(6368KiB/48010msec); 0 zone resets clat (msec): min=13, max=273, avg=72.07, stdev=46.45 lat (msec): min=13, max=273, avg=72.10, stdev=46.47 clat percentiles (msec): | 1.00th=[ 21], 5.00th=[ 26], 10.00th=[ 30], 20.00th=[ 37], | 30.00th=[ 42], 40.00th=[ 48], 50.00th=[ 58], 60.00th=[ 68], | 70.00th=[ 84], 80.00th=[ 103], 90.00th=[ 140], 95.00th=[ 174], | 99.00th=[ 230], 99.50th=[ 271], 99.90th=[ 275], 99.95th=[ 275], | 99.99th=[ 275] bw ( KiB/s): min= 31, max= 380, per=25.33%, avg=132.23, stdev=75.71, samples=94 iops : min= 1, max= 23, avg= 7.47, stdev= 4.80, samples=94 lat (msec) : 10=0.78%, 20=7.16%, 50=46.22%, 100=28.52%, 250=16.80% lat (msec) : 500=0.52% cpu : usr=0.06%, sys=2.09%, ctx=1207, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179287: Mon Jun 29 15:52:40 2026 read: IOPS=7, BW=119KiB/s (122kB/s)(5744KiB/48143msec) clat (msec): min=7, max=300, avg=49.90, stdev=42.60 lat (msec): min=7, max=300, avg=49.90, stdev=42.60 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 15], 10.00th=[ 18], 20.00th=[ 21], | 30.00th=[ 25], 40.00th=[ 30], 50.00th=[ 35], 60.00th=[ 42], | 70.00th=[ 51], 80.00th=[ 72], 90.00th=[ 109], 95.00th=[ 142], | 99.00th=[ 199], 99.50th=[ 279], 99.90th=[ 300], 99.95th=[ 300], | 99.99th=[ 300] bw ( KiB/s): min= 30, max= 384, per=24.32%, avg=120.62, stdev=80.33, samples=92 iops : min= 1, max= 24, avg= 6.74, stdev= 5.10, samples=92 write: IOPS=8, BW=136KiB/s (139kB/s)(6544KiB/48143msec); 0 zone resets clat (msec): min=16, max=262, avg=73.69, stdev=46.22 lat (msec): min=16, max=262, avg=73.70, stdev=46.23 clat percentiles (msec): | 1.00th=[ 19], 5.00th=[ 26], 10.00th=[ 31], 20.00th=[ 36], | 30.00th=[ 43], 40.00th=[ 49], 50.00th=[ 58], 60.00th=[ 70], | 70.00th=[ 89], 80.00th=[ 110], 90.00th=[ 148], 95.00th=[ 165], | 99.00th=[ 224], 99.50th=[ 234], 99.90th=[ 264], 99.95th=[ 264], | 99.99th=[ 264] bw ( KiB/s): min= 30, max= 318, per=25.73%, avg=134.31, stdev=78.60, samples=94 iops : min= 1, max= 19, avg= 7.60, stdev= 4.97, samples=94 lat (msec) : 10=0.39%, 20=8.46%, 50=45.96%, 100=26.69%, 250=17.97% lat (msec) : 500=0.52% cpu : usr=0.05%, sys=2.10%, ctx=1232, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179288: Mon Jun 29 15:52:40 2026 read: IOPS=8, BW=130KiB/s (134kB/s)(6256KiB/47966msec) clat (msec): min=7, max=350, avg=50.06, stdev=45.61 lat (msec): min=7, max=350, avg=50.06, stdev=45.61 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 14], 10.00th=[ 16], 20.00th=[ 20], | 30.00th=[ 24], 40.00th=[ 29], 50.00th=[ 34], 60.00th=[ 40], | 70.00th=[ 50], 80.00th=[ 70], 90.00th=[ 113], 95.00th=[ 157], | 99.00th=[ 213], 99.50th=[ 243], 99.90th=[ 351], 99.95th=[ 351], | 99.99th=[ 351] bw ( KiB/s): min= 30, max= 479, per=26.95%, avg=133.65, stdev=94.76, samples=92 iops : min= 1, max= 29, avg= 7.55, stdev= 5.99, samples=92 write: IOPS=7, BW=126KiB/s (129kB/s)(6032KiB/47966msec); 0 zone resets clat (msec): min=17, max=292, avg=75.07, stdev=49.77 lat (msec): min=17, max=292, avg=75.08, stdev=49.77 clat percentiles (msec): | 1.00th=[ 21], 5.00th=[ 27], 10.00th=[ 31], 20.00th=[ 37], | 30.00th=[ 43], 40.00th=[ 50], 50.00th=[ 57], 60.00th=[ 70], | 70.00th=[ 88], 80.00th=[ 111], 90.00th=[ 150], 95.00th=[ 180], | 99.00th=[ 245], 99.50th=[ 257], 99.90th=[ 292], 99.95th=[ 292], | 99.99th=[ 292] bw ( KiB/s): min= 30, max= 380, per=23.87%, avg=124.61, stdev=73.02, samples=94 iops : min= 1, max= 23, avg= 6.99, stdev= 4.62, samples=94 lat (msec) : 10=0.39%, 20=10.55%, 50=45.05%, 100=26.17%, 250=17.32% lat (msec) : 500=0.52% cpu : usr=0.04%, sys=2.12%, ctx=1223, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179289: Mon Jun 29 15:52:40 2026 read: IOPS=7, BW=125KiB/s (128kB/s)(6032KiB/48239msec) clat (msec): min=7, max=303, avg=54.18, stdev=49.37 lat (msec): min=7, max=303, avg=54.18, stdev=49.37 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 14], 10.00th=[ 17], 20.00th=[ 21], | 30.00th=[ 26], 40.00th=[ 31], 50.00th=[ 35], 60.00th=[ 43], | 70.00th=[ 53], 80.00th=[ 83], 90.00th=[ 130], 95.00th=[ 157], | 99.00th=[ 257], 99.50th=[ 288], 99.90th=[ 305], 99.95th=[ 305], | 99.99th=[ 305] bw ( KiB/s): min= 31, max= 382, per=25.41%, avg=126.05, stdev=83.47, samples=94 iops : min= 1, max= 23, avg= 7.09, stdev= 5.26, samples=94 write: IOPS=8, BW=130KiB/s (133kB/s)(6256KiB/48239msec); 0 zone resets clat (msec): min=16, max=301, avg=70.97, stdev=46.10 lat (msec): min=16, max=301, avg=70.97, stdev=46.10 clat percentiles (msec): | 1.00th=[ 20], 5.00th=[ 26], 10.00th=[ 30], 20.00th=[ 36], | 30.00th=[ 42], 40.00th=[ 47], 50.00th=[ 54], 60.00th=[ 64], | 70.00th=[ 83], 80.00th=[ 104], 90.00th=[ 140], 95.00th=[ 163], | 99.00th=[ 220], 99.50th=[ 249], 99.90th=[ 300], 99.95th=[ 300], | 99.99th=[ 300] bw ( KiB/s): min= 31, max= 380, per=25.11%, avg=131.07, stdev=79.55, samples=94 iops : min= 1, max= 23, avg= 7.39, stdev= 5.04, samples=94 lat (msec) : 10=0.65%, 20=8.46%, 50=46.22%, 100=26.56%, 250=17.45% lat (msec) : 500=0.65% cpu : usr=0.04%, sys=2.14%, ctx=1278, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=497KiB/s (508kB/s), 119KiB/s-130KiB/s (122kB/s-134kB/s), io=23.4MiB (24.5MB), run=47966-48239msec WRITE: bw=522KiB/s (535kB/s), 126KiB/s-136KiB/s (129kB/s-139kB/s), io=24.6MiB (25.8MB), run=47966-48239msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179303: Mon Jun 29 15:52:56 2026 read: IOPS=1, BW=1981KiB/s (2028kB/s)(7168KiB/3619msec) clat (msec): min=140, max=217, avg=182.73, stdev=32.12 lat (msec): min=140, max=217, avg=182.73, stdev=32.12 clat percentiles (msec): | 1.00th=[ 140], 5.00th=[ 140], 10.00th=[ 140], 20.00th=[ 142], | 30.00th=[ 174], 40.00th=[ 174], 50.00th=[ 192], 60.00th=[ 201], | 70.00th=[ 201], 80.00th=[ 215], 90.00th=[ 218], 95.00th=[ 218], | 99.00th=[ 218], 99.50th=[ 218], 99.90th=[ 218], 99.95th=[ 218], | 99.99th=[ 218] bw ( KiB/s): min= 1961, max= 4168, per=76.30%, avg=3408.33, stdev=1253.94, samples=3 iops : min= 1, max= 4, avg= 3.00, stdev= 1.73, samples=3 write: IOPS=1, BW=1415KiB/s (1449kB/s)(5120KiB/3619msec); 0 zone resets clat (msec): min=267, max=904, avg=456.16, stdev=267.74 lat (msec): min=268, max=904, avg=456.96, stdev=267.19 clat percentiles (msec): | 1.00th=[ 268], 5.00th=[ 268], 10.00th=[ 268], 20.00th=[ 268], | 30.00th=[ 292], 40.00th=[ 292], 50.00th=[ 317], 60.00th=[ 317], | 70.00th=[ 506], 80.00th=[ 506], 90.00th=[ 902], 95.00th=[ 902], | 99.00th=[ 902], 99.50th=[ 902], 99.90th=[ 902], 99.95th=[ 902], | 99.99th=[ 902] bw ( KiB/s): min= 2003, max= 4071, per=43.29%, avg=2707.33, stdev=1181.18, samples=3 iops : min= 1, max= 3, avg= 2.00, stdev= 1.00, samples=3 lat (msec) : 250=58.33%, 500=25.00%, 750=8.33%, 1000=8.33% cpu : usr=0.00%, sys=17.00%, ctx=263, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179304: Mon Jun 29 15:52:56 2026 read: IOPS=0, BW=454KiB/s (465kB/s)(2048KiB/4511msec) clat (msec): min=2, max=160, avg=81.19, stdev=111.46 lat (msec): min=2, max=160, avg=81.20, stdev=111.46 clat percentiles (msec): | 1.00th=[ 3], 5.00th=[ 3], 10.00th=[ 3], 20.00th=[ 3], | 30.00th=[ 3], 40.00th=[ 3], 50.00th=[ 3], 60.00th=[ 161], | 70.00th=[ 161], 80.00th=[ 161], 90.00th=[ 161], 95.00th=[ 161], | 99.00th=[ 161], 99.50th=[ 161], 99.90th=[ 161], 99.95th=[ 161], | 99.99th=[ 161] bw ( KiB/s): min= 1368, max= 2035, per=38.09%, avg=1701.50, stdev=471.64, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2270KiB/s (2324kB/s)(10.0MiB/4511msec); 0 zone resets clat (msec): min=234, max=794, avg=419.35, stdev=199.50 lat (msec): min=234, max=794, avg=419.46, stdev=199.49 clat percentiles (msec): | 1.00th=[ 234], 5.00th=[ 234], 10.00th=[ 234], 20.00th=[ 245], | 30.00th=[ 279], 40.00th=[ 313], 50.00th=[ 321], 60.00th=[ 359], | 70.00th=[ 384], 80.00th=[ 542], 90.00th=[ 718], 95.00th=[ 793], | 99.00th=[ 793], 99.50th=[ 793], 99.90th=[ 793], 99.95th=[ 793], | 99.99th=[ 793] bw ( KiB/s): min= 1961, max= 4096, per=48.49%, avg=3032.33, stdev=1152.88, samples=6 iops : min= 1, max= 4, avg= 2.17, stdev= 1.33, samples=6 lat (msec) : 4=8.33%, 250=25.00%, 500=41.67%, 750=16.67%, 1000=8.33% cpu : usr=0.00%, sys=15.85%, ctx=185, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179305: Mon Jun 29 15:52:56 2026 read: IOPS=1, BW=1845KiB/s (1889kB/s)(6144KiB/3330msec) clat (usec): min=357, max=407044, avg=166425.79, stdev=154536.43 lat (usec): min=357, max=407046, avg=166427.17, stdev=154536.85 clat percentiles (usec): | 1.00th=[ 359], 5.00th=[ 359], 10.00th=[ 359], 20.00th=[ 586], | 30.00th=[ 586], 40.00th=[156238], 50.00th=[156238], 60.00th=[191890], | 70.00th=[242222], 80.00th=[242222], 90.00th=[408945], 95.00th=[408945], | 99.00th=[408945], 99.50th=[408945], 99.90th=[408945], 99.95th=[408945], | 99.99th=[408945] bw ( KiB/s): min= 1961, max= 4087, per=75.03%, avg=3351.67, stdev=1205.02, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 write: IOPS=1, BW=1845KiB/s (1889kB/s)(6144KiB/3330msec); 0 zone resets clat (msec): min=206, max=570, avg=355.97, stdev=135.38 lat (msec): min=206, max=570, avg=356.06, stdev=135.39 clat percentiles (msec): | 1.00th=[ 207], 5.00th=[ 207], 10.00th=[ 207], 20.00th=[ 262], | 30.00th=[ 262], 40.00th=[ 292], 50.00th=[ 292], 60.00th=[ 347], | 70.00th=[ 460], 80.00th=[ 460], 90.00th=[ 575], 95.00th=[ 575], | 99.00th=[ 575], 99.50th=[ 575], 99.90th=[ 575], 99.95th=[ 575], | 99.99th=[ 575] bw ( KiB/s): min= 1391, max= 4007, per=36.59%, avg=2288.40, stdev=998.51, samples=5 iops : min= 1, max= 3, avg= 1.60, stdev= 0.89, samples=5 lat (usec) : 500=8.33%, 750=8.33% lat (msec) : 250=33.33%, 500=41.67%, 750=8.33% cpu : usr=0.03%, sys=16.94%, ctx=187, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179306: Mon Jun 29 15:52:56 2026 read: IOPS=1, BW=1117KiB/s (1144kB/s)(5120KiB/4584msec) clat (usec): min=605, max=347637, avg=159669.88, stdev=153993.95 lat (usec): min=606, max=347638, avg=159671.33, stdev=153993.84 clat percentiles (usec): | 1.00th=[ 603], 5.00th=[ 603], 10.00th=[ 603], 20.00th=[ 603], | 30.00th=[ 1139], 40.00th=[ 1139], 50.00th=[206570], 60.00th=[206570], | 70.00th=[242222], 80.00th=[242222], 90.00th=[346031], 95.00th=[346031], | 99.00th=[346031], 99.50th=[346031], 99.90th=[346031], 99.95th=[346031], | 99.99th=[346031] bw ( KiB/s): min= 8143, max= 8143, per=100.00%, avg=8143.00, stdev= 0.00, samples=1 iops : min= 7, max= 7, avg= 7.00, stdev= 0.00, samples=1 write: IOPS=1, BW=1564KiB/s (1601kB/s)(7168KiB/4584msec); 0 zone resets clat (msec): min=156, max=828, avg=509.95, stdev=299.69 lat (msec): min=156, max=828, avg=510.04, stdev=299.68 clat percentiles (msec): | 1.00th=[ 157], 5.00th=[ 157], 10.00th=[ 157], 20.00th=[ 259], | 30.00th=[ 271], 40.00th=[ 271], 50.00th=[ 426], 60.00th=[ 802], | 70.00th=[ 802], 80.00th=[ 827], 90.00th=[ 827], 95.00th=[ 827], | 99.00th=[ 827], 99.50th=[ 827], 99.90th=[ 827], 99.95th=[ 827], | 99.99th=[ 827] bw ( KiB/s): min= 1976, max= 4087, per=37.82%, avg=2365.33, stdev=843.89, samples=6 iops : min= 1, max= 3, avg= 1.50, stdev= 0.84, samples=6 lat (usec) : 750=8.33% lat (msec) : 2=8.33%, 250=25.00%, 500=33.33%, 1000=25.00% cpu : usr=0.00%, sys=13.94%, ctx=132, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4468KiB/s (4575kB/s), 454KiB/s-1981KiB/s (465kB/s-2028kB/s), io=20.0MiB (20.0MB), run=3330-4584msec WRITE: bw=6255KiB/s (6405kB/s), 1415KiB/s-2270KiB/s (1449kB/s-2324kB/s), io=28.0MiB (29.4MB), run=3330-4584msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179307: Mon Jun 29 15:52:57 2026 read: IOPS=1, BW=1780KiB/s (1823kB/s)(7168KiB/4027msec) clat (msec): min=122, max=192, avg=148.61, stdev=22.38 lat (msec): min=122, max=192, avg=148.61, stdev=22.38 clat percentiles (msec): | 1.00th=[ 123], 5.00th=[ 123], 10.00th=[ 123], 20.00th=[ 133], | 30.00th=[ 144], 40.00th=[ 144], 50.00th=[ 146], 60.00th=[ 146], | 70.00th=[ 146], 80.00th=[ 157], 90.00th=[ 192], 95.00th=[ 192], | 99.00th=[ 192], 99.50th=[ 192], 99.90th=[ 192], 99.95th=[ 192], | 99.99th=[ 192] bw ( KiB/s): min= 2031, max= 4134, per=82.74%, avg=3417.33, stdev=1200.83, samples=3 iops : min= 1, max= 4, avg= 2.67, stdev= 1.53, samples=3 write: IOPS=1, BW=1271KiB/s (1302kB/s)(5120KiB/4027msec); 0 zone resets clat (msec): min=326, max=801, avg=564.74, stdev=196.84 lat (msec): min=326, max=801, avg=564.85, stdev=196.83 clat percentiles (msec): | 1.00th=[ 326], 5.00th=[ 326], 10.00th=[ 326], 20.00th=[ 326], | 30.00th=[ 477], 40.00th=[ 477], 50.00th=[ 485], 60.00th=[ 485], | 70.00th=[ 735], 80.00th=[ 735], 90.00th=[ 802], 95.00th=[ 802], | 99.00th=[ 802], 99.50th=[ 802], 99.90th=[ 802], 99.95th=[ 802], | 99.99th=[ 802] bw ( KiB/s): min= 1878, max= 4063, per=46.03%, avg=2661.33, stdev=1216.68, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (msec) : 250=58.33%, 500=25.00%, 750=8.33%, 1000=8.33% cpu : usr=0.00%, sys=5.64%, ctx=193, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179308: Mon Jun 29 15:52:57 2026 read: IOPS=0, BW=413KiB/s (423kB/s)(2048KiB/4958msec) clat (msec): min=134, max=541, avg=338.05, stdev=288.03 lat (msec): min=134, max=541, avg=338.05, stdev=288.03 clat percentiles (msec): | 1.00th=[ 136], 5.00th=[ 136], 10.00th=[ 136], 20.00th=[ 136], | 30.00th=[ 136], 40.00th=[ 136], 50.00th=[ 136], 60.00th=[ 542], | 70.00th=[ 542], 80.00th=[ 542], 90.00th=[ 542], 95.00th=[ 542], | 99.00th=[ 542], 99.50th=[ 542], 99.90th=[ 542], 99.95th=[ 542], | 99.99th=[ 542] bw ( KiB/s): min= 1412, max= 2031, per=41.68%, avg=1721.50, stdev=437.70, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2065KiB/s (2115kB/s)(10.0MiB/4958msec); 0 zone resets clat (msec): min=111, max=1079, avg=411.84, stdev=330.44 lat (msec): min=111, max=1079, avg=412.03, stdev=330.42 clat percentiles (msec): | 1.00th=[ 112], 5.00th=[ 112], 10.00th=[ 112], 20.00th=[ 142], | 30.00th=[ 182], 40.00th=[ 188], 50.00th=[ 266], 60.00th=[ 279], | 70.00th=[ 409], 80.00th=[ 609], 90.00th=[ 852], 95.00th=[ 1083], | 99.00th=[ 1083], 99.50th=[ 1083], 99.90th=[ 1083], 99.95th=[ 1083], | 99.99th=[ 1083] bw ( KiB/s): min= 2019, max= 6131, per=62.31%, avg=3602.60, stdev=1700.64, samples=5 iops : min= 1, max= 5, avg= 2.60, stdev= 1.67, samples=5 lat (msec) : 250=41.67%, 500=25.00%, 750=16.67%, 1000=8.33%, 2000=8.33% cpu : usr=0.04%, sys=6.42%, ctx=136, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179309: Mon Jun 29 15:52:57 2026 read: IOPS=1, BW=1333KiB/s (1365kB/s)(6144KiB/4610msec) clat (msec): min=100, max=808, avg=375.20, stdev=272.19 lat (msec): min=100, max=808, avg=375.20, stdev=272.19 clat percentiles (msec): | 1.00th=[ 101], 5.00th=[ 101], 10.00th=[ 101], 20.00th=[ 127], | 30.00th=[ 127], 40.00th=[ 239], 50.00th=[ 239], 60.00th=[ 481], | 70.00th=[ 498], 80.00th=[ 498], 90.00th=[ 810], 95.00th=[ 810], | 99.00th=[ 810], 99.50th=[ 810], 99.90th=[ 810], 99.95th=[ 810], | 99.99th=[ 810] bw ( KiB/s): min= 1882, max= 4071, per=60.53%, avg=2499.75, stdev=1049.63, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 write: IOPS=1, BW=1333KiB/s (1365kB/s)(6144KiB/4610msec); 0 zone resets clat (msec): min=109, max=959, avg=387.81, stdev=314.66 lat (msec): min=109, max=959, avg=387.91, stdev=314.66 clat percentiles (msec): | 1.00th=[ 110], 5.00th=[ 110], 10.00th=[ 110], 20.00th=[ 129], | 30.00th=[ 129], 40.00th=[ 264], 50.00th=[ 264], 60.00th=[ 388], | 70.00th=[ 481], 80.00th=[ 481], 90.00th=[ 961], 95.00th=[ 961], | 99.00th=[ 961], 99.50th=[ 961], 99.90th=[ 961], 99.95th=[ 961], | 99.99th=[ 961] bw ( KiB/s): min= 1882, max= 4079, per=41.65%, avg=2408.40, stdev=936.01, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 lat (msec) : 250=41.67%, 500=41.67%, 1000=16.67% cpu : usr=0.00%, sys=4.97%, ctx=97, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179310: Mon Jun 29 15:52:57 2026 read: IOPS=1, BW=1422KiB/s (1456kB/s)(5120KiB/3601msec) clat (msec): min=94, max=254, avg=168.80, stdev=64.12 lat (msec): min=94, max=254, avg=168.80, stdev=64.12 clat percentiles (msec): | 1.00th=[ 95], 5.00th=[ 95], 10.00th=[ 95], 20.00th=[ 95], | 30.00th=[ 123], 40.00th=[ 123], 50.00th=[ 167], 60.00th=[ 167], | 70.00th=[ 207], 80.00th=[ 207], 90.00th=[ 255], 95.00th=[ 255], | 99.00th=[ 255], 99.50th=[ 255], 99.90th=[ 255], 99.95th=[ 255], | 99.99th=[ 255] bw ( KiB/s): min= 3757, max= 4087, per=94.96%, avg=3922.00, stdev=233.35, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1991KiB/s (2038kB/s)(7168KiB/3601msec); 0 zone resets clat (msec): min=108, max=944, avg=381.14, stdev=295.20 lat (msec): min=108, max=944, avg=381.33, stdev=295.15 clat percentiles (msec): | 1.00th=[ 109], 5.00th=[ 109], 10.00th=[ 109], 20.00th=[ 203], | 30.00th=[ 207], 40.00th=[ 207], 50.00th=[ 288], 60.00th=[ 300], | 70.00th=[ 300], 80.00th=[ 617], 90.00th=[ 944], 95.00th=[ 944], | 99.00th=[ 944], 99.50th=[ 944], 99.90th=[ 944], 99.95th=[ 944], | 99.99th=[ 944] bw ( KiB/s): min= 1878, max= 2892, per=38.24%, avg=2211.00, stdev=460.17, samples=4 iops : min= 1, max= 2, avg= 1.25, stdev= 0.50, samples=4 lat (msec) : 100=8.33%, 250=50.00%, 500=25.00%, 750=8.33%, 1000=8.33% cpu : usr=0.00%, sys=6.06%, ctx=103, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4131KiB/s (4230kB/s), 413KiB/s-1780KiB/s (423kB/s-1823kB/s), io=20.0MiB (20.0MB), run=3601-4958msec WRITE: bw=5783KiB/s (5922kB/s), 1271KiB/s-2065KiB/s (1302kB/s-2115kB/s), io=28.0MiB (29.4MB), run=3601-4958msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179319: Mon Jun 29 15:53:11 2026 read: IOPS=1, BW=4247KiB/s (4349kB/s)(12.0MiB/2893msec) clat (msec): min=752, max=1082, avg=933.14, stdev=167.60 lat (msec): min=752, max=1082, avg=933.16, stdev=167.61 clat percentiles (msec): | 1.00th=[ 751], 5.00th=[ 751], 10.00th=[ 751], 20.00th=[ 751], | 30.00th=[ 751], 40.00th=[ 961], 50.00th=[ 961], 60.00th=[ 961], | 70.00th=[ 1083], 80.00th=[ 1083], 90.00th=[ 1083], 95.00th=[ 1083], | 99.00th=[ 1083], 99.50th=[ 1083], 99.90th=[ 1083], 99.95th=[ 1083], | 99.99th=[ 1083] bw ( KiB/s): min= 7876, max= 8175, per=100.00%, avg=8025.50, stdev=211.42, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=66.67%, 2000=33.33% cpu : usr=0.00%, sys=11.86%, ctx=369, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179320: Mon Jun 29 15:53:11 2026 read: IOPS=0, BW=1316KiB/s (1348kB/s)(4096KiB/3112msec) clat (nsec): min=754536k, max=754536k, avg=754536365.00, stdev= 0.00 lat (nsec): min=754539k, max=754539k, avg=754538910.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 751], 5.00th=[ 751], 10.00th=[ 751], 20.00th=[ 751], | 30.00th=[ 751], 40.00th=[ 751], 50.00th=[ 751], 60.00th=[ 751], | 70.00th=[ 751], 80.00th=[ 751], 90.00th=[ 751], 95.00th=[ 751], | 99.00th=[ 751], 99.50th=[ 751], 99.90th=[ 751], 99.95th=[ 751], | 99.99th=[ 751] bw ( KiB/s): min= 7876, max= 7876, per=100.00%, avg=7876.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2632KiB/s (2696kB/s)(8192KiB/3112msec); 0 zone resets clat (msec): min=1110, max=1184, avg=1147.19, stdev=52.38 lat (msec): min=1112, max=1186, avg=1149.77, stdev=52.25 clat percentiles (msec): | 1.00th=[ 1116], 5.00th=[ 1116], 10.00th=[ 1116], 20.00th=[ 1116], | 30.00th=[ 1116], 40.00th=[ 1116], 50.00th=[ 1116], 60.00th=[ 1183], | 70.00th=[ 1183], 80.00th=[ 1183], 90.00th=[ 1183], 95.00th=[ 1183], | 99.00th=[ 1183], 99.50th=[ 1183], 99.90th=[ 1183], 99.95th=[ 1183], | 99.99th=[ 1183] bw ( KiB/s): min= 8175, max= 8175, per=94.11%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 1000=33.33%, 2000=66.67% cpu : usr=0.00%, sys=6.33%, ctx=170, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179322: Mon Jun 29 15:53:11 2026 write: IOPS=0, BW=3258KiB/s (3336kB/s)(12.0MiB/3772msec); 0 zone resets clat (msec): min=256, max=2092, avg=1190.05, stdev=918.24 lat (msec): min=257, max=2093, avg=1190.61, stdev=918.26 clat percentiles (msec): | 1.00th=[ 257], 5.00th=[ 257], 10.00th=[ 257], 20.00th=[ 257], | 30.00th=[ 257], 40.00th=[ 1217], 50.00th=[ 1217], 60.00th=[ 1217], | 70.00th=[ 2089], 80.00th=[ 2089], 90.00th=[ 2089], 95.00th=[ 2089], | 99.00th=[ 2089], 99.50th=[ 2089], 99.90th=[ 2089], 99.95th=[ 2089], | 99.99th=[ 2089] bw ( KiB/s): min= 7953, max= 8192, per=92.93%, avg=8072.50, stdev=169.00, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 500=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=3.69%, ctx=56, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179324: Mon Jun 29 15:53:11 2026 write: IOPS=1, BW=4414KiB/s (4520kB/s)(12.0MiB/2784msec); 0 zone resets clat (msec): min=810, max=1037, avg=889.37, stdev=128.33 lat (msec): min=812, max=1038, avg=891.10, stdev=127.37 clat percentiles (msec): | 1.00th=[ 810], 5.00th=[ 810], 10.00th=[ 810], 20.00th=[ 810], | 30.00th=[ 810], 40.00th=[ 818], 50.00th=[ 818], 60.00th=[ 818], | 70.00th=[ 1036], 80.00th=[ 1036], 90.00th=[ 1036], 95.00th=[ 1036], | 99.00th=[ 1036], 99.50th=[ 1036], 99.90th=[ 1036], 99.95th=[ 1036], | 99.99th=[ 1036] bw ( KiB/s): min= 7876, max= 8175, per=92.39%, avg=8025.50, stdev=211.42, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=66.67%, 2000=33.33% cpu : usr=0.00%, sys=5.28%, ctx=65, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5265KiB/s (5391kB/s), 1316KiB/s-4247KiB/s (1348kB/s-4349kB/s), io=16.0MiB (16.8MB), run=2893-3112msec WRITE: bw=8687KiB/s (8896kB/s), 2632KiB/s-4414KiB/s (2696kB/s-4520kB/s), io=32.0MiB (33.6MB), run=2784-3772msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179321: Mon Jun 29 15:53:11 2026 read: IOPS=0, BW=3677KiB/s (3765kB/s)(12.0MiB/3342msec) clat (msec): min=187, max=1732, avg=1040.21, stdev=785.09 lat (msec): min=187, max=1732, avg=1040.22, stdev=785.09 clat percentiles (msec): | 1.00th=[ 188], 5.00th=[ 188], 10.00th=[ 188], 20.00th=[ 188], | 30.00th=[ 188], 40.00th=[ 1200], 50.00th=[ 1200], 60.00th=[ 1200], | 70.00th=[ 1737], 80.00th=[ 1737], 90.00th=[ 1737], 95.00th=[ 1737], | 99.00th=[ 1737], 99.50th=[ 1737], 99.90th=[ 1737], 99.95th=[ 1737], | 99.99th=[ 1737] bw ( KiB/s): min= 8078, max= 8078, per=100.00%, avg=8078.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 2000=66.67% cpu : usr=0.00%, sys=2.72%, ctx=52, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179323: Mon Jun 29 15:53:11 2026 read: IOPS=0, BW=1127KiB/s (1154kB/s)(4096KiB/3635msec) clat (nsec): min=1059.5M, max=1059.5M, avg=1059526099.00, stdev= 0.00 lat (nsec): min=1059.5M, max=1059.5M, avg=1059528700.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1062], 5.00th=[ 1062], 10.00th=[ 1062], 20.00th=[ 1062], | 30.00th=[ 1062], 40.00th=[ 1062], 50.00th=[ 1062], 60.00th=[ 1062], | 70.00th=[ 1062], 80.00th=[ 1062], 90.00th=[ 1062], 95.00th=[ 1062], | 99.00th=[ 1062], 99.50th=[ 1062], 99.90th=[ 1062], 99.95th=[ 1062], | 99.99th=[ 1062] bw ( KiB/s): min= 8110, max= 8110, per=100.00%, avg=8110.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2254KiB/s (2308kB/s)(8192KiB/3635msec); 0 zone resets clat (msec): min=897, max=1600, avg=1249.05, stdev=497.05 lat (msec): min=898, max=1600, avg=1249.54, stdev=497.03 clat percentiles (msec): | 1.00th=[ 902], 5.00th=[ 902], 10.00th=[ 902], 20.00th=[ 902], | 30.00th=[ 902], 40.00th=[ 902], 50.00th=[ 902], 60.00th=[ 1603], | 70.00th=[ 1603], 80.00th=[ 1603], 90.00th=[ 1603], 95.00th=[ 1603], | 99.00th=[ 1603], 99.50th=[ 1603], 99.90th=[ 1603], 99.95th=[ 1603], | 99.99th=[ 1603] bw ( KiB/s): min= 7907, max= 7907, per=87.72%, avg=7907.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 1000=33.33%, 2000=66.67% cpu : usr=0.00%, sys=3.63%, ctx=46, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179325: Mon Jun 29 15:53:11 2026 write: IOPS=0, BW=4012KiB/s (4108kB/s)(12.0MiB/3063msec); 0 zone resets clat (msec): min=529, max=1515, avg=951.66, stdev=508.05 lat (msec): min=530, max=1516, avg=953.10, stdev=507.68 clat percentiles (msec): | 1.00th=[ 531], 5.00th=[ 531], 10.00th=[ 531], 20.00th=[ 531], | 30.00th=[ 531], 40.00th=[ 810], 50.00th=[ 810], 60.00th=[ 810], | 70.00th=[ 1519], 80.00th=[ 1519], 90.00th=[ 1519], 95.00th=[ 1519], | 99.00th=[ 1519], 99.50th=[ 1519], 99.90th=[ 1519], 99.95th=[ 1519], | 99.99th=[ 1519] bw ( KiB/s): min= 8078, max= 8110, per=89.79%, avg=8094.00, stdev=22.63, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=5.23%, ctx=73, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179326: Mon Jun 29 15:53:11 2026 write: IOPS=1, BW=4108KiB/s (4207kB/s)(12.0MiB/2991msec); 0 zone resets clat (msec): min=794, max=1206, avg=944.39, stdev=227.80 lat (msec): min=796, max=1206, avg=945.42, stdev=227.15 clat percentiles (msec): | 1.00th=[ 793], 5.00th=[ 793], 10.00th=[ 793], 20.00th=[ 793], | 30.00th=[ 793], 40.00th=[ 835], 50.00th=[ 835], 60.00th=[ 835], | 70.00th=[ 1200], 80.00th=[ 1200], 90.00th=[ 1200], 95.00th=[ 1200], | 99.00th=[ 1200], 99.50th=[ 1200], 99.90th=[ 1200], 99.95th=[ 1200], | 99.99th=[ 1200] bw ( KiB/s): min= 8015, max= 8143, per=89.63%, avg=8079.00, stdev=90.51, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=66.67%, 2000=33.33% cpu : usr=0.03%, sys=4.01%, ctx=67, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4507KiB/s (4615kB/s), 1127KiB/s-3677KiB/s (1154kB/s-3765kB/s), io=16.0MiB (16.8MB), run=3342-3635msec WRITE: bw=9015KiB/s (9231kB/s), 2254KiB/s-4108KiB/s (2308kB/s-4207kB/s), io=32.0MiB (33.6MB), run=2991-3635msec