Prompt Compression in the Wild: Measuring Latency, Rate Adherence, and Quality for Faster LLM Inference.

Cornelius Kummer, Lena Jurkschat, Michael Frber, Sahar Vahdati

Browse the full ECIR paper archive.