Sparse Logit Sampling: Accelerating Knowledge Distillation in LLMs.

Anshumann, Mohd Abbas Zaidi, Akhil Kedia, Jinwoo Ahn, Taehwak Kwon, Kangwook Lee, Haejun Lee, Joohyung Lee

Browse the full ACL paper archive.