InferCept: Efficient Intercept Support for Augmented Large Language Model Inference.

Reyna Abhyankar, Zijian He, Vikranth Srivatsa, Hao Zhang, Yiying Zhang

Browse the full ICML paper archive.