Prepacking: A Simple Method for Fast Prefilling and Increased Throughput in Large Language Models.

Siyan Zhao, Daniel Israel, Guy Van den Broeck, Aditya Grover

Browse the full AISTATS paper archive.