Parrot: Efficient Serving of LLM-based Applications with Semantic Variable.

Chaofan Lin, Zhenhua Han, Chengruidong Zhang, Yuqing Yang, Fan Yang, Chen Chen, Lili Qiu

Browse the full OSDI paper archive.