Firewall Routing: Blocking Leads to Better Hybrid Inference for LLMs.

Runyu Peng, Yunhua Zhou, Kai Lv, Yang Gao, Qipeng Guo, Xipeng Qiu

Browse the full EMNLP paper archive.