CYBER WATCH / EQUINOXE INTELLIGENCE
← All articles
b12181: hexagon: fuse post‑norm residual add into RMS_NORM_MUL (#31822)
llama.cpp Releases · 2026-11-07 04:01:11
The post‑norm residual addition has been fused into RMS_NORM_MUL, with a refactor of RMS_NORM fusion and the addition of a dedicated RMS_NORM_MUL_ADD opcode. This improves performance by keeping operations in HVX registers and simplifies fusion logic and logging.Read original source ↗