DynaMo: Accelerating Language Model Inference with Dynamic Multi-Token Sampling.
Shikhar Tuli, Chi-Heng Lin, Yen-Chang Hsu, Niraj K. Jha, Yilin Shen, Hongxia Jin
Browse the full NAACL paper archive.
Shikhar Tuli, Chi-Heng Lin, Yen-Chang Hsu, Niraj K. Jha, Yilin Shen, Hongxia Jin
Browse the full NAACL paper archive.