pytorch-optimizer v3.1.1

Change Log

Feature

• Implement TRAC optimizer. (#263)
  • Fast TRAC: A Parameter-Free Optimizer for Lifelong Reinforcement Learning
• Support AdamW optimizer via create_optimizer(). (#263)
• Implement AdamG optimizer. (#264, #265)
  • Towards Stability of Parameter-free Optimization

Bug

• Handle the optimizers that only take the model instead of the parameters in create_optimizer(). (#263)
• Move the variable to the same device with the parameter. (#266, #267)