ProPD: Dynamic Token Tree Pruning and Generation for LLM Parallel Decoding.

Shuzhang Zhong, Zebin Yang, Ruihao Gong, Runsheng Wang, Ru Huang, Meng Li

Browse the full ICCAD paper archive.