MoE-Pipe: A Pipelined MoE Model Loading Framework for Reducing the Cold Start Delays in Serverless Inference.

Zhan-Wei Wu, Chih-Tai Tsai, Sao-Hsuan Lin, Yi-Syuan Ke, Jerry Chou

Browse the full CLOSER paper archive.