FLARE: Fine-Grained Length-Aware Routing for Resource-Efficient Heterogeneous LLM Serving.

Yujia Fu, Heming Zhong, Dan Huang, Yutong Lu

Browse the full ACL paper archive.