Skip to content

In this project, I used Deep Reinforcement Learning to combine artificial neural networks with reinforcement learning.

Notifications You must be signed in to change notification settings

gorkemguneser/Deep-Q-Learning-PACMAN

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

15 Commits
 
 
 
 
 
 

Repository files navigation

Deep-Q-Learning-PACMAN

In this project, I used Deep Reinforcement Learning to combine artificial neural networks with reinforcement learning.

final_gif

Deep Neural Network

I have created 2 hidden (Dense) layers with 128 neurons in each to create my DQN. My input layer is directly feeded by states of the environment. There are 9 possible actions that my agent can take, so my output layer consists of 9 neurons in total.

Same applied for my target network.

Epsilon Greedy Strategy

My agent takes its actions based on epsilon greedy strategy, where I initialized epsilon as 1.0 and decayed it gradually.

Initial Parameters

  • Epsilon: 0.99
  • Epsilon decay: 0.9998
  • Discount factor: 0.99
  • Learning rate: 0.0001

  • Even though initial results are promising, the model has only trained around 70 hours now, whereas I need weeks to complete full training.

    Requirements

  • Python==3.8.6
  • tensorFlow==2.0.0
  • Keras==2.3.0
  • numpy==1.17.2
  • Links

    GitHub : Link
    Presentation : Here

    Authors

    Gorkem Guneser