QoS-Efficient Serving of Multiple Mixture-of-Expert LLMs Using Partial Runtime Reconfiguration.

Hamid Reza Imani, Jiaxin Peng, Peiman Mohseni, Abdolah Amirany, Tarek A. El-Ghazawi

Browse the full ICML paper archive.