APB: Accelerating Distributed Long-Context Inference by Passing Compressed Context Blocks across GPUs.

Yuxiang Huang, Mingye Li, Xu Han, Chaojun Xiao, Weilin Zhao, Sun Ao, Hao Zhou, Jie Zhou, Zhiyuan Liu, Maosong Sun

Browse the full ACL paper archive.