Suppressing Final Layer Hidden State Jumps in Transformer Pretraining.

Keigo Shibata, Kazuki Yano, Ryosuke Takahashi, Jaesung Lee, Wataru Ikeda, Jun Suzuki

Browse the full EACL paper archive.