ITERA-LLM: Boosting Sub-8-Bit Large Language Model Inference via Iterative Tensor Decomposition.

Yinting Huang, Keran Zheng, Zhewen Yu, Christos-Savvas Bouganis

Browse the full FCCM paper archive.