#Transformers
Latest news articles tagged with "Transformers". Follow the timeline of events, related topics, and entities.
Articles (2)
-
🇺🇸 Understanding Transformer Optimization via Gradient Heterogeneity
[USA]
arXiv:2502.00213v4 Announce Type: replace-cross Abstract: Transformers are difficult to optimize with stochastic gradient descent (SGD) and largely rely on adaptive optimizers such as Adam. Despite t...
Related: #Optimization, #Gradient heterogeneity, #Adaptive optimizers, #Stochastic gradient descent -
🇺🇸 Transformers can do Bayesian Clustering
[USA]
arXiv:2510.24318v3 Announce Type: replace-cross Abstract: Bayesian clustering accounts for uncertainty but is computationally demanding at scale. Furthermore, real-world datasets often contain missin...
Related: #Machine Learning, #Bayesian Methods, #Uncertainty Quantification, #Data Imputation