AdamP: Slowing Down the Slowdown for Momentum Optimizers on Scale-invariant Weights (ICLR 2021)
-
Updated
Jan 13, 2021 - Python
#
optimizer-algorithms
Here are 15 public repositories matching this topic...
Pytorch library to test optimizers by visualizing how they descend on a your images. You can draw your own custom loss landscape and see what different optimizers do.
visualization python pytorch gradient-descent optimization-algorithms optimizer-visualization optimizers optimizer-algorithms
-
Updated
Jul 6, 2024 - Jupyter Notebook
AeroAttention is an innovative, quantum-enhanced attention mechanism designed for transformer models. It offers optimized memory usage and accelerated computations, enabling scalable and efficient training for advanced neural network architectures
-
Updated
Oct 14, 2024 - Python
Learning about the algorithms used in machine learning, along with techniques for training and testing models.
python nlp html learning data-science gradient-descent backpropagation-learning-algorithm ia feature-engineering regression-models loss-functions metrics-visualization normalization-techniques optimizer-algorithms neuronal-networks preprocessing-data
-
Updated
Jul 2, 2024 - Jupyter Notebook
AixrOptima is an artificial intelligence startup that speeds up the process process by integrating quantum circuits.
machine-learning quantum machine-learning-algorithms optimizer quantum-algorithms quantum-machine-learning artifical-neural-network artifical-intelligence optimizer-algorithms quantumalgorithms
-
Updated
Dec 18, 2024 - Python
Training the fully connected neural network (FCNN) using different optimizers for the backpropagation algorithm and compare the number of epochs that it takes for convergence along with their classification performance. Also building an autoencoder to obtain the hidden representation and use it for classification.
-
Updated
Jul 13, 2022 - Jupyter Notebook
Generating a TensorFlow model that predicts values in a sinewave
-
Updated
Dec 8, 2021 - Jupyter Notebook
COVID-19-Xray-Dataset Deep Learning using 3 models
deep-learning metrics tensorflow keras warnings cnn-model loss-functions imagedatagenerator optimizer-algorithms mobilenetv2-model resnet50-model
-
Updated
Oct 7, 2024 - Jupyter Notebook
Optimizers for TensorFlow and Keras.
machine-learning deep-learning tensorflow keras optimizer machinelearning deeplearning optimizer-algorithms
-
Updated
Jan 3, 2025 - Python
The Bird Species Classifier is an application built using a Convolutional Neural Network (CNN) to classify images of birds into one of 525 different species. It allows users to upload an image of a bird and receive a prediction of the bird species. Along with analysing the performance of various optimising algorithms.
-
Updated
Jun 28, 2024 - Jupyter Notebook
A NumPy based Neural Network Package Implementation
python neural-network numpy optimizer derivatives loss-functions activation-functions optimizer-algorithms
-
Updated
Jun 22, 2022 - Python
Unofficial implementation of the Adan optimizer with Schedule-Free
-
Updated
Jul 8, 2024 - Python
En el siguiente repositorio encontrarás material relacionado con optimizadores usados en metodologías de aprendizaje de maquina. In the following repository you'll find examples of optimizers used in machine learning methods
machine-learning simulation linear-algebra neural-networks gradient-descent optimization-methods optimization-algorithms convex-optimization optimizer-visualization optimizer-algorithms optimizar
-
Updated
Mar 11, 2023 - Python
Introduction to the Adam Optimizer with examples
-
Updated
Dec 21, 2022 - Jupyter Notebook
Experimented with and compared DFW neural network optimizer with SGD and ADAM on both vision and language tasks
pytorch densenet dfw cifar10 back-propagation wide-resnet bilstm infersent optimizer-algorithms deep-frank-wolfie
-
Updated
May 21, 2021 - Jupyter Notebook
Improve this page
Add a description, image, and links to the optimizer-algorithms topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the optimizer-algorithms topic, visit your repo's landing page and select "manage topics."