AMALI: An Analytical Model for Accurately Modeling LLM Inference on Modern GPUs.

Shiheng Cao, Junmin Wu, Junshi Chen, Hong An, Zhibin Yu

Browse the full ISCA paper archive.