Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

About DF-VAE #8

Open
NNNNAI opened this issue Feb 24, 2021 · 5 comments
Open

About DF-VAE #8

NNNNAI opened this issue Feb 24, 2021 · 5 comments

Comments

@NNNNAI
Copy link

NNNNAI commented Feb 24, 2021

Thank you for your work!

Do you intend to release the relevant code and training scripts about the DF-VAE?

@NNNNAI
Copy link
Author

NNNNAI commented Feb 26, 2021

Btw, as you mentioned in the paper,you use the stacked hourglass networks to extract landmarks. But I found the oringal implementation in the "Stacked hourglass networks for human pose estimation" did not include the landmarks detection. Could you tell me which version of stack hourglass you used in the paper? Thank you very much.

@NNNNAI
Copy link
Author

NNNNAI commented Mar 15, 2021

May I ask whether the stacked hourglass of the structure extraction module in dfvae will be trained together, that is, whether the parameters of the stacked hourglass will undergo gradient back propagation.

@EndlessSora
Copy link
Owner

May I ask whether the stacked hourglass of the structure extraction module in dfvae will be trained together, that is, whether the parameters of the stacked hourglass will undergo gradient back propagation.

The answer is no. The gradient is locked for the stacked hourglass module.

@NNNNAI
Copy link
Author

NNNNAI commented Mar 15, 2021

Thank you for your quick answer! BTW, in appendix, you mentioned using kl loss as one of the training losses of dfvae. Does the kl loss here mean that the structure encoder and appearance encoder both do kl loss? Or do you concatenate the latent representations from the structure encoder and appearance encoder, and then predict the mean and variance from the concatenated latent representations to calculate the kl loss ?

@NNNNAI
Copy link
Author

NNNNAI commented Mar 23, 2021

Could you further explain how the df-vae combined the structure imformation and appearance and how did the mean and variance in this part of klloss come from? I reproduced your Disentangled module and used 2DFAN in the structure extraction module to extract landmarks information, but the effect has not been good, and even the appearance of a complete face cannot be generated.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants