Duplex: A Device for Large Language Models with Mixture of Experts, Grouped Query Attention, and Continuous Batching.

Sungmin Yun, Kwanhee Kyung, Juhwan Cho, Jaewan Choi, Jongmin Kim, Byeongho Kim, Sukhan Lee, Kyomin Sohn, Jung Ho Ahn

Browse the full MICRO paper archive.