Splitwise: Efficient Generative LLM Inference Using Phase Splitting.

Pratyush Patel, Esha Choukse, Chaojie Zhang, Aashaka Shah, igo Goiri, Saeed Maleki, Ricardo Bianchini

Browse the full ISCA paper archive.