INGENIOUS: Using Informative Data Subsets for Efficient Pre-Training of Language Models.
H. S. V. N. S. Kowndinya Renduchintala, Krishnateja Killamsetty, Sumit Bhatia, Milan Aggarwal, Ganesh Ramakrishnan, Rishabh K. Iyer, Balaji Krishnamurthy
Browse the full EMNLP paper archive.