返回列表
Attention-Aware Routing: Coupling Routing and Attention in MoEs
国外 · 猫头鹰笔记 · 发布于 2026-09-21 · 0 次阅读
来源:arXiv cs.AI · 2026-09-21 · 新型 AI / 新品发布
arXiv:2609.20974v1 Announce Type: new Abstract: In Mixture-of-Experts language models, the router typically selects and weights experts based on the token's hidden state, utilizing limited contextual
本条资讯由「猫头鹰笔记」整理自 arXiv cs.AI,仅作交流参考,版权归原作者所有。

