DHeLlam: General-Purpose, Automatic Micro-Batch Co-Execution for Distributed LLM Training.

Haiquan Wang, Chaoyi Ruan, Jia He, Jiaqi Ruan, Chengjie Tang, Xiaosong Ma, Cheng Li

Browse the full ICCD paper archive.