Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Question about the learning rate η #6

Open
TTTREE opened this issue Jun 11, 2020 · 1 comment
Open

Question about the learning rate η #6

TTTREE opened this issue Jun 11, 2020 · 1 comment

Comments

@TTTREE
Copy link

TTTREE commented Jun 11, 2020

Hi!
This is a nice work! I am studying your paper and trying to running the DSPN method on my own dataset. However, I find the repr_loss and set_loss can not convergence after some epoches.
So I wonder if the learning rate η = 800 is suit to my dataset, which is CrowdHuman dataset.
Or can you tell me how you adjust the learning rate in your experiments.
Or could you please give me any advice about using DSPN on custom dataset?
Thanks a lot!

@Cyanogenoid
Copy link
Owner

The way I set η is by looking what happens when the weights are randomly initialised, i.e. at the start of training. I started with a low η and increased it until I saw in the Tensorboard plots that with random init, the set elements were visible changing when doing the inner optimisation loop.
For my datasets, I normalised all the set elements to be either in the range [0, 1] or [-1, 1]. Let me know if that helps.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants