In-Context Pretraining: Language Modeling Beyond Document Boundaries.

Weijia Shi, Sewon Min, Maria Lomeli, Chunting Zhou, Margaret Li, Xi Victoria Lin, Noah A. Smith, Luke Zettlemoyer, Wen-tau Yih, Mike Lewis

Browse the full ICLR paper archive.