CYBER WATCH / EQUINOXE INTELLIGENCE

← All articles

b12181: hexagon: fuse post‑norm residual add into RMS_NORM_MUL (#31822)

llama.cpp Releases · 2026-11-07 04:01:11

The post‑norm residual addition has been fused into RMS_NORM_MUL, with a refactor of RMS_NORM fusion and the addition of a dedicated RMS_NORM_MUL_ADD opcode. This improves performance by keeping operations in HVX registers and simplifies fusion logic and logging.

Read original source ↗