RelayAttention for Efficient Large Language Model Serving with Long System Prompts.

Lei Zhu, Xinjiang Wang, Wayne Zhang, Rynson W. H. Lau

Browse the full ACL paper archive.