Partially Adaptive Momentum Estimation method in the paper "Closing the Generalization Gap of Adaptive Gradient Methods in Training Deep Neural Networks" (accepted by IJCAI 2020)
-
Updated
Apr 13, 2023 - Python
#
adaptive-gradient-method
Here are 2 public repositories matching this topic...
The repository contains code to reproduce the experiments from our paper Error Feedback Can Accurately Compress Preconditioners available below:
computer-vision
deep-learning
top-k
language-model
low-rank-approximation
second-order-optimization
ggt
adaptive-gradient-method
full-matrix-preconditioning
m-fac
-
Updated
Sep 12, 2023 - Python
Improve this page
Add a description, image, and links to the adaptive-gradient-method topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the adaptive-gradient-method topic, visit your repo's landing page and select "manage topics."