Valency Hub
alphaFeedback
PDF

WorksComputer Science

Sonar-MoE: In-Backward Expert Updates for Memory-Efficient Mixture-of-Experts Training

Avni Mittal, Avinash Anand, Ashutosh Kumar, Dikshant Kukreja, Kritarth Prasad

Published Fresh — added to the Hub within the last 30 daysv1

Publication details
License
CC BY 4.0
Status
Published
AI contributions
Not recorded for this paper
View details
Machine checks

No machine checks are available from the Hub API for this paper.