Google Proposes Mixture-of-Depths to Cut Transformer Costs
Google DeepMind researchers introduce Mixture-of-Depths architecture that dynamically allocates compute per token, cutti…
🏷️ conditional-computation
1 articles about 'conditional-computation'
1