kozistr / pytorch_optimizer Star 212 Code Issues Pull requests Discussions optimizer & lr scheduler & loss function collections in PyTorch deep-learning sam optimizer pytorch ranger loss-functions chebyshev lookahead nero adabound learning-rate-scheduling radam diffgrad gradient-centralization adamp adabelief madgrad adamd adan adai Updated Jul 14, 2024 Python
OptimalFoundation / nadir Star 12 Code Issues Pull requests Nadir: Cutting-edge PyTorch optimizers for simplicity & composability! 🔥🚀💻 machine-learning optimization pytorch lion adam-optimizer adamax sgd-optimizer amsgrad adamw radam adamp adabelief Updated Jun 15, 2024 Python
OptimalFoundation / awesome-optimizers Star 9 Code Issues Pull requests Literature survey of convex optimizers and optimisation methods for deep-learning; made especially for optimisation researchers with ❤️ awesome eve awesome-list optimization-algorithms adam shampoo adamw radam adamp Updated Mar 9, 2023