InferFast: Bridging the Gap Between Unstructured LLM Sparsity and Practical GPU Throughput.

Zijie Shen, Weifeng Bu, Kai Sheng, Hao Chen, Xin He

Browse the full ICS paper archive.