Astral 3.0: Design and Practice of High-Performance Network Infrastructure for Large-Scale MoE Training and Inference

With the evolution of large model architectures towards the sparse Mixture-of-Experts (MoE), the proportion of communication overhead in end-to-end latency was observed to rise significantly in both training and inference scenarios, and communication performance gradually became a critical factor co...

Бүрэн тодорхойлолт

Номзүйн дэлгэрэнгүй

Үндсэн зохиолчид:	WANG Yachen, XIA Yinben, WANG Zibo, CAO Peirui, WANG Zhibin
Формат:	Artigo
Хэл сонгох:	Chinês
Хэвлэсэн:	Beijing Xintong Media Co., Ltd 2026-01-01
Цуврал:	Dianxin kexue
Нөхцлүүд:	Mixture of Experts (MoE) Astral 3.0 Network Architecture All-to-All Communication AIOps Inference System
Онлайн хандалт:	http://www.telecomsci.com/thesisDetails#10.11959/j.issn.1000-0801.DXKX260015
Шошгууд:	Шошго нэмэх Шошго байхгүй, Энэхүү баримтыг шошголох эхний хүн болох!