Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

How to decide number of candidates #56

Open
alishan2040 opened this issue Jun 26, 2022 · 1 comment
Open

How to decide number of candidates #56

alishan2040 opened this issue Jun 26, 2022 · 1 comment

Comments

@alishan2040
Copy link

I trained the model on my custom dataset in which each line contains 3 events (e1, e2, e3) (a tri-gram) where I want to predict e3 based on e1 and e2. An example is shown below:
image
After training for 50 epochs I got:
image

On the predict stage, I kept num_candidates=1, then I got very low F1-score
image

num_classes in my dataset are 9. If I increase, num_candidates, divide by zero error occurred. What is the best approach to choose num_candidates for given dataset?

Thanks

@shoaib-intro
Copy link

If I try to address this increasing candidate size will increase accuracy and will be less sensitive to anomalies vise versa. threshold here is window size.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants