CYBER WATCH / EQUINOXE INTELLIGENCE
← All articles
b12127: metal: keep fusable node groups inside one command buffer (#31688)
llama.cpp Releases · 2026-11-05 14:00:59
The first command buffer holds the first 10 % of the graph nodes, while the remaining nodes are evenly split across the additional buffers. A fusion cannot span two buffers, so a boundary that falls inside a fusable group causes that group to run unfused, making the output depend on the graph’s node count. By moving each boundary to the end of the fusable group it falls into, the encoders will fuse the same nodes as they would with a single command buffer.Read original source ↗