Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Reproducing results #3

Open
zerobayes opened this issue Apr 25, 2023 · 3 comments
Open

Reproducing results #3

zerobayes opened this issue Apr 25, 2023 · 3 comments

Comments

@zerobayes
Copy link

Hi,

Thank you for open-sourcing your work! I have a question regarding reproduciblity.

I tried running the code on the Atari 100k benchmark and I did not manage to reproduce the results. Here are the results I am obtaining:

Obtained Reported in paper
Boxing 0.5 78
Breakout 10 20
CrazyClimber 3188 71820
Krull 3414 6349
Pong -20 19

Is there a step I’m missing here? I installed the dependencies specified in the requirements file and ran the training command specified in the README file. The results I am reporting come from the eval/final_score_mean chart.

Thanks!

@yingchengyang
Copy link

Hi, I also have the same problem. I run Pong and the result is -21, are there any possible reasons? Thanks a lot!

@fancy1223
Copy link

Hi, where is the eval/final_score_mean chart?

@fancy1223
Copy link

Hi,

Thank you for open-sourcing your work! I have a question regarding reproduciblity.

I tried running the code on the Atari 100k benchmark and I did not manage to reproduce the results. Here are the results I am obtaining:

Obtained Reported in paper
Boxing 0.5 78
Breakout 10 20
CrazyClimber 3188 71820
Krull 3414 6349
Pong -20 19
Is there a step I’m missing here? I installed the dependencies specified in the requirements file and ran the training command specified in the README file. The results I am reporting come from the eval/final_score_mean chart.

Thanks!

Hi, where is the eval/final_score_mean chart?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants