Valency Hub
alphaFeedback
PDF

WorksComputer Science

Don't Stop Long-Context Continual Pre-Training Too Early: An Empirical Scaling Law

Ziqing Qiao, Xiaoyue Xu, Sikui Zhang, Yinuo Xu, Bingxiang He

Published Fresh — added to the Hub within the last 30 daysv1

Publication details
License
CC BY-SA 4.0
Status
Published
AI contributions
  • generative AI tools
View details
Ancillary data
1 code link
View
Machine checks

No machine checks are available from the Hub API for this paper.