Cache Your Prompt When It's Green - Carbon-aware Caching for Large Language Model Serving.

Yuyang Tian, Desen Sun, Yi Ding, Sihang Liu

Browse the full SIGMETRICS paper archive.