CYBER WATCH / EQUINOXE INTELLIGENCE

← All articles

b12128: tests: fix CI flakes of TOPK_MOE caused by near ties (#31426)

llama.cpp Releases · 2026-11-05 14:00:47

The patch removes intermittent CI test failures in TOPK_MOE that occurred when uniform random logits produced two experts within one ulp of each other, especially with the sqrt_softplus gating function. Backend precision differences caused each backend to pick a different expert, leading to test failures. The fix regenerates logits until a relative margin of 1e‑4 is achieved, builds logits by inverting the gating function, and aligns expert decisions across all back‑ends. Softmax probabilities are normalized to stay consistent, preventing recomputation of routing.

Read original source ↗