Accuracy-Delay Trade-Off in LLM Offloading via Token-Level Uncertainty.

Yumin Kim, Hyeonsu Lyu, Minjae Lee, Hyun Jong Yang

Browse the full GLOBECOM paper archive.