Tetris: Efficient Long-context LLM Serving with Chunkwise Dynamic Sequence Parallelism.

Cong Li, Yuzhe Yang, Xuegui Zheng, Qifan Yang, Yijin Guan, Size Zheng, Li-Wen Chang, Shufan Liu, Xin Liu, Guangyu Sun

Browse the full ISCA paper archive.