Structured Packing in LLM Training Improves Long Context Utilization.

Konrad Staniszewski, Szymon Tworkowski, Sebastian Jaszczur, Yu Zhao, Henryk Michalewski, Lukasz Kucinski, Piotr Milos

Browse the full AAAI paper archive.