Sequence Parallelism: Long Sequence Training from System Perspective.

Shenggui Li, Fuzhao Xue, Chaitanya Baranwal, Yongbin Li, Yang You

Browse the full ACL paper archive.