Analysing The Impact of Sequence Composition on Language Model Pre-Training.

Yu Zhao, Yuanbin Qu, Konrad Staniszewski, Szymon Tworkowski, Wei Liu, Piotr Milos, Yuxiang Wu, Pasquale Minervini

Browse the full ACL paper archive.