Collaborative Multi-Device Edge Inference for Vision-Language Models with Speculative Decoding.

Luteng Qiao, Jiawei Shao, Yong Zhou, Yuanming Shi, Xuelong Li, Khaled B. Letaief

Browse the full PIMRC paper archive.