Distributed Dataset Framework for Large Language Models Pre-training.

Nao Souma, Yui Obara, Yasuhiko Yokote, Yutaka Ishikawa, Kimio Kuramitsu

Browse the full PKAW paper archive.