SpecTr-GBV: Multi-Draft Block Verification Accelerates Speculative Decoding
A new study proposes SpecTr-GBV, the first method to combine multi-draft strategies with block verification techniques, …
🏷️ Large Model Inference Acceleration
1 articles about 'Large Model Inference Acceleration'
1