Stateful Large Language Model Serving with Pensieve.

Lingfan Yu, Jinkun Lin, Jinyang Li

Browse the full EuroSys paper archive.