Draft& Verify: Lossless Large Language Model Acceleration via Self-Speculative Decoding.
Jun Zhang, Jue Wang, Huan Li, Lidan Shou, Ke Chen, Gang Chen, Sharad Mehrotra
Browse the full ACL paper archive.
Jun Zhang, Jue Wang, Huan Li, Lidan Shou, Ke Chen, Gang Chen, Sharad Mehrotra
Browse the full ACL paper archive.