TensorOpera Router: A Multi-Model Router for Efficient LLM Inference.

Dimitris Stripelis, Zhaozhuo Xu, Zijian Hu, Alay Dilipbhai Shah, Han Jin, Yuhang Yao, Jipeng Zhang, Tong Zhang, Salman Avestimehr, Chaoyang He

Browse the full EMNLP paper archive.