Sumit Sanghai
Publication record assembled from the DBLP archive of ranked conferences.
Papers indexed
11
Venues
8
Active years
2020–2024
Best venue rank
A*
Where they publish
Papers
11 indexed papers, newest first.
| Year | Venue | Title | Authors |
|---|---|---|---|
| 2024 | ICLR | Functional Interpolation for Relative Positions improves Long Context Transformers. | Shanda Li, Chong You, Guru Guruganesh, Joshua Ainslie, Santiago Ontan, Manzil Zaheer, Sumit Sanghai, Yiming Yang, Sanjiv Kumar, Srinadh Bhojanapalli |
| 2024 | NAACL | MEMORY-VQ: Compression for Tractable Internet-Scale Memory. | Yury Zemlyanskiy, Michiel de Jong, Luke Vilnis, Santiago Ontan, William W. Cohen, Sumit Sanghai, Joshua Ainslie |
| 2023 | ACL | FiDO: Fusion-in-Decoder optimized for stronger performance and faster inference. | Michiel de Jong, Yury Zemlyanskiy, Joshua Ainslie, Nicholas FitzGerald, Sumit Sanghai, Fei Sha, William W. Cohen |
| 2023 | EMNLP | CoLT5: Faster Long-Range Transformers with Conditional Computation. | Joshua Ainslie, Tao Lei, Michiel de Jong, Santiago Ontan, Siddhartha Brahma, Yury Zemlyanskiy, David C. Uthus, Mandy Guo, James Lee-Thorp, Yi Tay, Yun-Hsuan Sung, Sumit Sanghai |
| 2023 | EMNLP | GQA: Training Generalized Multi-Query Transformer Models from Multi-Head Checkpoints. | Joshua Ainslie, James Lee-Thorp, Michiel de Jong, Yury Zemlyanskiy, Federico Lebrn, Sumit Sanghai |
| 2023 | ICML | Pre-computed memory or on-the-fly encoding? A hybrid approach to retrieval augmentation makes the most of your compute. | Michiel de Jong, Yury Zemlyanskiy, Nicholas FitzGerald, Joshua Ainslie, Sumit Sanghai, Fei Sha, William W. Cohen |
| 2023 | ICML | Arithmetic Sampling: Parallel Diverse Decoding for Large Language Models. | Luke Vilnis, Yury Zemlyanskiy, Patrick Murray, Alexandre Tachard Passos, Sumit Sanghai |
| 2022 | COLING | Generate-and-Retrieve: Use Your Predictions to Improve Retrieval for Semantic Parsing. | Yury Zemlyanskiy, Michiel de Jong, Joshua Ainslie, Panupong Pasupat, Peter Shaw, Linlu Qiu, Sumit Sanghai, Fei Sha |
| 2022 | WSDM | MAVE: A Product Dataset for Multi-source Attribute Value Extraction. | Li Yang, Qifan Wang, Zac Yu, Anand Kulkarni, Sumit Sanghai, Bin Shu, Jon Elsas, Bhargav Kanagal |
| 2020 | EMNLP | ETC: Encoding Long and Structured Inputs in Transformers. | Joshua Ainslie, Santiago Ontan, Chris Alberti, Vaclav Cvicek, Zachary Fisher, Philip Pham, Anirudh Ravula, Sumit Sanghai, Qifan Wang, Li Yang |
| 2020 | KDD | Learning to Extract Attribute Value from Product via Question Answering: A Multi-task Approach. | Qifan Wang, Li Yang, Bhargav Kanagal, Sumit Sanghai, D. Sivakumar, Bin Shu, Zac Yu, Jon Elsas |