JD.com Unveils xLLM Speculative Inference Architecture
JD.com reveals its xLLM speculative inference system at AICon Shanghai, promising magnitude-level speedups for LLM infer…
🏷️ inference-optimization
1 articles about 'inference-optimization'
1