James Lee-Thorp
Publication record assembled from the DBLP archive of ranked conferences.
Papers indexed
6
Venues
3
Active years
2022–2024
Best venue rank
A*
Where they publish
Papers
6 indexed papers, newest first.
| Year | Venue | Title | Authors |
|---|---|---|---|
| 2024 | NAACL | Memory Augmented Language Models through Mixture of Word Experts. | Ccero Nogueira dos Santos, James Lee-Thorp, Isaac Noble, Chung-Ching Chang, David C. Uthus |
| 2023 | EMNLP | CoLT5: Faster Long-Range Transformers with Conditional Computation. | Joshua Ainslie, Tao Lei, Michiel de Jong, Santiago Ontan, Siddhartha Brahma, Yury Zemlyanskiy, David C. Uthus, Mandy Guo, James Lee-Thorp, Yi Tay, Yun-Hsuan Sung, Sumit Sanghai |
| 2023 | EMNLP | GQA: Training Generalized Multi-Query Transformer Models from Multi-Head Checkpoints. | Joshua Ainslie, James Lee-Thorp, Michiel de Jong, Yury Zemlyanskiy, Federico Lebrn, Sumit Sanghai |
| 2023 | ICLR | Sparse Upcycling: Training Mixture-of-Experts from Dense Checkpoints. | Aran Komatsuzaki, Joan Puigcerver, James Lee-Thorp, Carlos Riquelme Ruiz, Basil Mustafa, Joshua Ainslie, Yi Tay, Mostafa Dehghani, Neil Houlsby |
| 2022 | EMNLP | Sparse Mixers: Combining MoE and Mixing to build a more efficient BERT. | James Lee-Thorp, Joshua Ainslie |
| 2022 | NAACL | FNet: Mixing Tokens with Fourier Transforms. | James Lee-Thorp, Joshua Ainslie, Ilya Eckstein, Santiago Ontan |