LLaMCAT: Optimizing Large Language Model Inference with Cache Arbitration and Throttling.

Zhongchun Zhou, Chengtao Lai, Wei Zhang

Browse the full ICPP paper archive.