SPECTRA: Faster Large Language Model Inference with Optimized Internal and External Speculation.

Nguyen-Khang Le, Truong Dinh Do, Le-Minh Nguyen

Browse the full ACL paper archive.