Valency Hub
alphaFeedback
PDF

WorksComputer Science

Sonar-MoE: In-Backward Expert Updates for Memory-Efficient Mixture-of-Experts Training

Avni Mittal, Avinash Anand, Ashutosh Kumar, Dikshant Kukreja, Kritarth Prasad

Published Fresh — added to the Hub within the last 30 daysv1

Publication details
License
CC BY 4.0
Status
Published
AI contributions
Not recorded for this paper
View details

Review conversation

Reviews are not available for this work yet.