Efficient CPU-GPU Collaborative Inference for MoE-based LLMs on Memory-Limited Systems.

En-Ming Huang, Li-Shang Lin, Chun-Yi Lee

Browse the full ASPDAC paper archive.