POSTER: LLM-PQ: Serving LLM on Heterogeneous Clusters with Phase-Aware Partition and Adaptive Quantization.

Juntao Zhao, Borui Wan, Chuan Wu, Yanghua Peng, Haibin Lin

Browse the full PPoPP paper archive.