Enabling Efficient Batch Serving for LMaaS via Generation Length Prediction.

Ke Cheng, Wen Hu, Zhi Wang, Peng Du, Jianguo Li, Sheng Zhang

Browse the full ICWS paper archive.