δ-mem: Cutting LLM Memory Costs by 90%
New δ-mem framework slashes GPU memory usage for LLMs by 90%, enabling efficient online inference on consumer hardware.
🏷️ δ-mem
1 articles about 'δ-mem'
1
GogoAI News