Ghidorah: Fast LLM Inference on Edge with Speculative Decoding and Hetero-Core Parallelism.

Jinhui Wei, Ye Huang, Yuhui Zhou, Jiazhi Jiang, Jiangsu Du

Browse the full ICCD paper archive.