Serving Long-Context LLMs at the Mobile Edge: Test-Time Reinforcement Learning-based Model Caching and Inference Offloading.

Minrui Xu, Dusit Niyato, Christopher G. Brinton

Browse the full GLOBECOM paper archive.