Replies: 1 comment
-
It is unlikely you get pertinent feedback here, as this forum is a place for discussions around Upkie robots, while your question is about reinforcement learning in a different context. Maybe try asking your question on /r/reinforcementlearning, or on a Discord channel about reinforcement learning such as this one? Hoping this helps and all the best for your project. |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
I've been working on a Connect Four AI project, developed primarily as a learning opportunity to explore reinforcement learning (RL) in a two-agent gameplay environment. The project is structured around training and testing AI models to master Connect Four, using a Python-based setup.
Initially, I approached the problem by feeding a flattened 6x7 array representing the board into a multi-layer fully connected neural network (FC NN). Realizing the need for improvement, I integrated a convolutional neural network (CNN) layer to process the grid before passing it into the fully connected layers, aiming to better capture spatial relationships.
Despite experimenting with both large and small network architectures, the performance of the trained models has been underwhelming, and I'm currently unable to pinpoint the exact causes of this limitation. Each training session is managed through a hyperparameters.txt file, which not only sets the initial conditions but also logs the outcomes, ensuring transparency and traceability of what inputs lead to specific results.
The GitHub repository for this project is available here: Connect Four AI Project. I am eager to get feedback or suggestions on how to improve the model's performance to reach a master-level capability in Connect Four.
If you have experience with deep reinforcement learning, especially in game environments, or have insights into how I might enhance the training process or model architecture, I would greatly appreciate your input.
The repo is located here: https://github.com/walt-neb/connect_four
Below is an example output from the training session:
Beta Was this translation helpful? Give feedback.
All reactions