Arlo: Serving Transformer-based Language Models with Dynamic Input Lengths.

Xin Tan, Jiamin Li, Yitao Yang, Jingzong Li, Hong Xu

Browse the full ICPP paper archive.