Optimus-CC: Efficient Large NLP Model Training with 3D Parallelism Aware Communication Compression.

Jaeyong Song, Jinkyu Yim, Jaewon Jung, Hongsun Jang, Hyung-Jin Kim, Youngsok Kim, Jinho Lee

Browse the full ASPLOS paper archive.