Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Pretrained embeddings, reward implementation and evaluation metrics #6

Open
cnj1999 opened this issue Nov 24, 2022 · 1 comment
Open

Comments

@cnj1999
Copy link

cnj1999 commented Nov 24, 2022

Thanks for releasing the codes.
Here are some details I'm wondering. Would you please make me some explanation?
Firstly, the pretrained embeddings are not used by the two agents. So does it mean that there is no association between cluster embeddings and entity embeddings?
Secondly, the reward mechanism shown in the code is not implemented as the paper said. Could you please tell me what the correct implementation looks like?
Thirdly, MRR and MAP are not given by the code. Does the auc output actually mean MAP?
I'd appreciate it if you can solve my puzzles or you can offer a piece of correct version of that project. Thank you very much in advance.

@xiaoyu0701
Copy link

我看了也没找到MRR评价指标,但是MAP是有的,只能对分任务进行评价,写在nell_eval.py

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants