Layer-Wise CPU-GPU Scheduling for LLM Inference on Memory-Limited Consumer GPUs.

Naoto Sugiura, Yuta Tokusashi, Hiroki Matsutani

Browse the full EuroPar paper archive.