PipeInfer: Accelerating LLM Inference using Asynchronous Pipelined Speculation.

Branden Butler, Sixing Yu, Arya Mazaheri, Ali Jannesari

Browse the full SC paper archive.