HybridSpec: Exploiting Hybrid-Bonding Memory to Accelerate LLM Serving Through Heterogeneous Architecture and Speculative Decoding.

Zongle Huang, Wenbin Jia, Yaolei Li, Xinyuan Lin, Shupei Fan, Chen Tang, Shuwen Deng, Yongpan Liu

Browse the full ISCA paper archive.