Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

VampPrior Generation #3

Open
Manslow opened this issue Jun 19, 2019 · 1 comment
Open

VampPrior Generation #3

Manslow opened this issue Jun 19, 2019 · 1 comment

Comments

@Manslow
Copy link

Manslow commented Jun 19, 2019

I'm unsure of the role the pseudo inputs play in generation using a Vamp Propr. This is likey my lack of understanding of your paper because I find it hard to reconcile these implementation details with your paper (my lack of expertise in this area).

It seems that when you generate, you generate using a subset of the pseudo inputs as per:

means = self.means(self.idle_input)[0:N] z_sample_gen_mean, z_sample_gen_logvar = self.q_z(means) z_sample_rand = self.reparameterize(z_sample_gen_mean, z_sample_gen_logvar)

I understand how to generate from these pseudo inputs using reparameterization but how would I sample from the aggregated prior itself? After all, it is this prior that one would normally sample from in a VAE after all (though it wouldn't be aggregated in the vanilla VAE).

@FabricioArendTorres
Copy link

Isn't p(z2) simply a uniform mixture? So you could just uniformly sample one of the pseudo inputs u and then pass it through the encoder for getting a prior sample from p(z2).

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants