#Curvature-aware algorithms
Latest news articles tagged with "Curvature-aware algorithms". Follow the timeline of events, related topics, and entities.
Articles (1)
-
🇺🇸 On Surprising Effectiveness of Masking Updates in Adaptive Optimizers
[USA]
arXiv:2602.15322v1 Announce Type: cross Abstract: Training large language models (LLMs) relies almost exclusively on dense adaptive optimizers with increasingly sophisticated preconditioners. We chal...
Related: #Machine learning optimization, #Large language model training, #Adaptive optimizers, #Regularization techniques