Prompt Compression with Context-Aware Sentence Encoding for Fast and Improved LLM Inference.

Barys Liskavets, Maxim Ushakov, Shuvendu Roy, Mark Klibanov, Ali Etemad, Shane K. Luke

Browse the full AAAI paper archive.