← All AI terms
What does Mixture of experts mean?
Mixture of experts (MoE)
A model design that splits the network into many 'experts' and uses only a few for each word, making large models cheaper to run.
News that mentions Mixture of experts
- llama.cpp release b11755 adds missing MoE kernel for 9‑expert tokens
- llama.cpp adds per‑expert token scaling for MoE models
- llama.cpp adds GPU cache for MoE experts
- Ollama adds Flint coding model in v0.40.8‑rc0
- Recursive launches Flint, a 40B open-weight coding model
- Meta releases Muse Spark Open, a 816 B multimodal MoE model