MARS: Unleashing the Power of Speculative Decoding via Margin-Aware Verification.

Jingwei Song, Xinyu Wang, Hanbin Wang, Xiaoxuan Lei, Tianyu Shi, Shixin Han, Eric Yang, Xiao-Wen Chang, Lynn Ai

Browse the full ACL paper archive.