Device-Server Collaborative Speculative Decoding for Real-Time LLM Streaming.

Bishakha Rani Biswas, Yongjie Guan, Mingrui Yin, Tao Han, Xueyu Hou

Browse the full GLOBECOM paper archive.