RailS: Load Balancing for All-to-All Communication in Distributed Mixture-of-Experts Training

Heng Xu, Zhiwei Yu, Chengze Du, Ying Zhou, Letian Li, Haojie Wang, Weiqiang Cheng, Jialong Li

October 22, 2025