HybridBERT - Making BERT Pretraining More Efficient Through Hybrid Mixture of Attention Mechanisms.
Gokul Srinivasagan, Simon Ostermann
VenueANAACL
Year2024
ProceedingsNAACL (Student Research Workshop)
DBLP recordconf/naacl/SrinivasaganO24 ↗
Browse the full NAACL paper archive.