LARK: Layer-Aware Routing with K-Ary Dynamic Pruning Tree for Self-speculative Decoding.
Baizhou Xu, Zhaoning Zhang, Zhen Huang, Libo Zhang
Browse the full KSEM paper archive.
Baizhou Xu, Zhaoning Zhang, Zhen Huang, Libo Zhang
Browse the full KSEM paper archive.