Improving the Performance of LLM Inference: Understanding the Role of CUDA Graphs.

Angel Franco, Isaias Noel Villanueva, Songyu Zhang, K. K. Ramakrishnan

Browse the full LANMAN paper archive.