AdaDecode: Accelerating LLM Decoding with Adaptive Layer Parallelism.

Zhepei Wei, Wei-Lin Chen, Xinyu Zhu, Yu Meng

Browse the full ICML paper archive.