Hyung Won Chung
Publication record assembled from the DBLP archive of ranked conferences.
Papers indexed
16
Venues
4
Active years
2020–2024
Best venue rank
A*
Where they publish
Papers
16 indexed papers, newest first.
| Year | Venue | Title | Authors |
|---|---|---|---|
| 2024 | ICLR | Mixture-of-Experts Meets Instruction Tuning: A Winning Combination for Large Language Models. | Sheng Shen, Le Hou, Yanqi Zhou, Nan Du, Shayne Longpre, Jason Wei, Hyung Won Chung, Barret Zoph, William Fedus, Xinyun Chen, Tu Vu, Yuexin Wu, Wuyang Chen, Albert Webson, Yunxuan Li, Vincent Y. Zhao, Hongkun Yu, Kurt Keutzer, Trevor Darrell, Denny Zhou |
| 2023 | ACL | Challenging BIG-Bench Tasks and Whether Chain-of-Thought Can Solve Them. | Mirac Suzgun, Nathan Scales, Nathanael Schrli, Sebastian Gehrmann, Yi Tay, Hyung Won Chung, Aakanksha Chowdhery, Quoc V. Le, Ed H. Chi, Denny Zhou, Jason Wei |
| 2023 | EMNLP | Scaling Laws vs Model Architectures: How does Inductive Bias Influence Scaling? | Yi Tay, Mostafa Dehghani, Samira Abnar, Hyung Won Chung, William Fedus, Jinfeng Rao, Sharan Narang, Vinh Q. Tran, Dani Yogatama, Donald Metzler |
| 2023 | EMNLP | Transcending Scaling Laws with 0.1% Extra Compute. | Yi Tay, Jason Wei, Hyung Won Chung, Vinh Q. Tran, David R. So, Siamak Shakeri, Xavier Garcia, Huaixiu Steven Zheng, Jinfeng Rao, Aakanksha Chowdhery, Denny Zhou, Donald Metzler, Slav Petrov, Neil Houlsby, Quoc V. Le, Mostafa Dehghani |
| 2023 | ICLR | UniMax: Fairer and More Effective Language Sampling for Large-Scale Multilingual Pretraining. | Hyung Won Chung, Xavier Garcia, Adam Roberts, Yi Tay, Orhan Firat, Sharan Narang, Noah Constant |
| 2023 | ICLR | Language models are multilingual chain-of-thought reasoners. | Freda Shi, Mirac Suzgun, Markus Freitag, Xuezhi Wang, Suraj Srivats, Soroush Vosoughi, Hyung Won Chung, Yi Tay, Sebastian Ruder, Denny Zhou, Dipanjan Das, Jason Wei |
| 2023 | ICLR | UL2: Unifying Language Learning Paradigms. | Yi Tay, Mostafa Dehghani, Vinh Q. Tran, Xavier Garcia, Jason Wei, Xuezhi Wang, Hyung Won Chung, Dara Bahri, Tal Schuster, Huaixiu Steven Zheng, Denny Zhou, Neil Houlsby, Donald Metzler |
| 2023 | ICML | The Flan Collection: Designing Data and Methods for Effective Instruction Tuning. | Shayne Longpre, Le Hou, Tu Vu, Albert Webson, Hyung Won Chung, Yi Tay, Denny Zhou, Quoc V. Le, Barret Zoph, Jason Wei, Adam Roberts |
| 2022 | ICLR | Scale Efficiently: Insights from Pretraining and Finetuning Transformers. | Yi Tay, Mostafa Dehghani, Jinfeng Rao, William Fedus, Samira Abnar, Hyung Won Chung, Sharan Narang, Dani Yogatama, Ashish Vaswani, Donald Metzler |
| 2022 | ICLR | Charformer: Fast Character Transformers via Gradient-based Subword Tokenization. | Yi Tay, Vinh Q. Tran, Sebastian Ruder, Jai Prakash Gupta, Hyung Won Chung, Dara Bahri, Zhen Qin, Simon Baumgartner, Cong Yu, Donald Metzler |
| 2022 | ICML | What Language Model Architecture and Pretraining Objective Works Best for Zero-Shot Generalization? | Thomas Wang, Adam Roberts, Daniel Hesslow, Teven Le Scao, Hyung Won Chung, Iz Beltagy, Julien Launay, Colin Raffel |
| 2021 | EMNLP | A Simple and Effective Positional Encoding for Transformers. | Pu-Chin Chen, Henry Tsai, Srinadh Bhojanapalli, Hyung Won Chung, Yin-Wen Chang, Chun-Sung Ferng |
| 2021 | EMNLP | Do Transformer Modifications Transfer Across Implementations and Applications? | Sharan Narang, Hyung Won Chung, Yi Tay, Liam Fedus, Thibault Fvry, Michael Matena, Karishma Malkan, Noah Fiedel, Noam Shazeer, Zhenzhong Lan, Yanqi Zhou, Wei Li, Nan Ding, Jake Marcus, Adam Roberts, Colin Raffel |
| 2021 | EMNLP | Learning Compact Metrics for MT. | Amy Pu, Hyung Won Chung, Ankur P. Parikh, Sebastian Gehrmann, Thibault Sellam |
| 2021 | ICLR | Rethinking Embedding Coupling in Pre-trained Language Models. | Hyung Won Chung, Thibault Fvry, Henry Tsai, Melvin Johnson, Sebastian Ruder |
| 2020 | EMNLP | Improving Multilingual Models with Language-Clustered Vocabularies. | Hyung Won Chung, Dan Garrette, Kiat Chuan Tan, Jason Riesa |