Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Unable to reproduce Figure 6 on memorization effects #9

Open
gordon-lim opened this issue Jun 28, 2024 · 0 comments
Open

Unable to reproduce Figure 6 on memorization effects #9

gordon-lim opened this issue Jun 28, 2024 · 0 comments

Comments

@gordon-lim
Copy link

gordon-lim commented Jun 28, 2024

I am not able to reproduce the trends in Figure 6. My ResNet50 only starts fitting to the noisy labels after a learning rate update. Could you share additional hyperparameters perhaps not discussed in the paper that I would need to reproduce your result? I also have the following questions regarding the split:

  1. "we split the train data into two parts: images with clean labels (the annotation matches the clean label) and wrong labels (the rest)". Are there then actually 4 splits total? 2 splits for human noised and another 2 splits for synthetic noised?
  2. If the top row figures are the split where the noised labels match the clean labels (i.e these splits have clean labels) why is there a difference between the trends for real vs. synthetic?

If possible, I think providing code that generated those plots is the best way to bring full clarity. Thank you.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant