🏷️ sparse-models

1 articles about 'sparse-models'

Google Scales Sparse MoE Models to Trillion Params

2026-05-06 research 👁 9

Google Research introduces Sparse Mixture of Experts architecture that scales language models to over 1 trillion paramet…