Efficient Large Models Fine-tuning on Commodity Servers via Memory-balanced Pipeline Parallelism.

Yujie Liu, Zhiquan Lai, Weijie Liu, Wei Wang, Dongsheng Li

Browse the full HPCC paper archive.