Google Scales Sparse MoE Models to Trillion Params
Google Research introduces Sparse Mixture of Experts architecture that scales language models to over 1 trillion paramet…
🏷️ switch-transformer
1 articles about 'switch-transformer'
1