HyperRouter: Towards Efficient Training and Inference of Sparse Mixture of Experts
Truong Do, Le Huy Khiem, Quang Pham, TrungTin Nguyen, Thanh-Nam Doan, Binh Nguyen, Chenghao Liu, Savitha Ramasamy, Xiaoli Li, Steven C. H. Hoi · 2023
Truong Do, Le Khiem, Quang Pham, TrungTin Nguyen, Thanh-Nam Doan, Binh Nguyen, Chenghao Liu, Savitha Ramasamy, Xiaoli Li, Steven Hoi. Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing. 2023.