Cocktail: Chunk-Adaptive Mixed-Precision Quantization for Long-Context LLM Inference.

Wei Tao, Bin Zhang, Xiaoyang Qu, Jiguang Wan, Jianzong Wang

Browse the full DATE paper archive.