OTAS: An Elastic Transformer Serving System via Token Adaptation.

Jinyu Chen, Wenchao Xu, Zicong Hong, Song Guo, Haozhao Wang, Jie Zhang, Deze Zeng

Browse the full INFOCOM paper archive.