SlimPipe: Memory-Thrifty and Efficient Pipeline Parallelism for Long-Context LLM Training.

Zhouyang Li, Yuliang Liu, Wei Zhang, Tailing Yuan, Bin Chen, Chengru Song

Browse the full SC paper archive.