Pangu Pro MoE: Mixture of Grouped Experts for Efficient Sparsity

Preprint on arXiv, 2025

Recommended citation: Yehui Tang, Xiaosong Li, Fangcheng Liu, Wei Guo, Hang Zhou, Yaoyuan Wang, Kai Han, Xianzhi Yu, Jinpeng Li, Hui Zang, Fei Mi, Xiaojun Meng, Zhicheng Liu, Hanting Chen, Binfan Zheng, Can Chen, Youliang Yan, Ruiming Tang, Peifeng Qin, Xinghao Chen, Dacheng Tao, Yunhe Wang. (2025). Pangu Pro MoE: Mixture of Grouped Experts for Efficient Sparsity. arXiv preprint 2505.21411. https://arxiv.org/abs/2505.21411