MoE Architecture Cuts LLM Inference Costs by Up to 60%
A new study reveals Mixture-of-Experts models activate only a fraction of parameters during inference, slashing compute …
🏷️ mixture-of-experts
14 articles about 'mixture-of-experts'
Meta Launches Llama 4 Maverick With 128 Experts
Meta releases Llama 4 Maverick, an open-weight model using a massive 128-expert mixture-of-experts architecture that cha…