PROMTEC: Fast LLM Inference Decoding using Prompt Multi-Lookup with Template Database and Common Sequences.

Alan Chi-Man Lee, Wing-Sun Cheng, Calvin Chun-Kit Chan

Browse the full ACL paper archive.