Overlapping Context with Variable-Length Stride Increases Diversity when Training Large Language Model for Code.

Geonmo Gu, Jaeho Kwak, Haksoo Moon, Hyun Seung Shim, Yu Jin Kim, Byoungjip Kim, Moontae Lee, Hyejeong Jeon

Browse the full ACL paper archive.