TaxBreak: Unmasking the Hidden Costs of LLM Inference Through Overhead Decomposition.

Prabhu Vellaisamy, Shreesh Tripathi, Vignesh Natarajan, Surya Santhan Thenarasu, Shawn Blanton, John Paul Shen

Browse the full ISPASS paper archive.