TAID: Temporally Adaptive Interpolated Distillation for Efficient Knowledge Transfer in Language Models.

Makoto Shing, Kou Misaki, Han Bao, Sho Yokoi, Takuya Akiba

Browse the full ICLR paper archive.