TCB: Accelerating Transformer Inference Services with Request Concatenation.

Boqian Fu, Fahao Chen, Peng Li, Deze Zeng

Browse the full ICPP paper archive.