Skip to content

Latest commit

 

History

History
37 lines (24 loc) · 1.42 KB

README.md

File metadata and controls

37 lines (24 loc) · 1.42 KB

Deep-Q-Learning-PACMAN

In this project, I used Deep Reinforcement Learning to combine artificial neural networks with reinforcement learning.

final_gif

Deep Neural Network

I have created 2 hidden (Dense) layers with 128 neurons in each to create my DQN. My input layer is directly feeded by states of the environment. There are 9 possible actions that my agent can take, so my output layer consists of 9 neurons in total.

Same applied for my target network.

Epsilon Greedy Strategy

My agent takes its actions based on epsilon greedy strategy, where I initialized epsilon as 1.0 and decayed it gradually.

Initial Parameters

  • Epsilon: 0.99
  • Epsilon decay: 0.9998
  • Discount factor: 0.99
  • Learning rate: 0.0001

  • Even though initial results are promising, the model has only trained around 70 hours now, whereas I need weeks to complete full training.

    Requirements

  • Python==3.8.6
  • tensorFlow==2.0.0
  • Keras==2.3.0
  • numpy==1.17.2
  • Links

    GitHub : Link
    Presentation : Here

    Authors

    Gorkem Guneser