-
Notifications
You must be signed in to change notification settings - Fork 81
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Inference got error "probability tensor contains either inf
, nan
or element < 0" while using beams=2 with temperature=0.1
#5
Comments
Same on the trained LoRA model:
|
@paplorinc I think that's another error that I forgot to update the return value at some point of the |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Using
decapoda-research/llama-7b-hf
,beams
=2
withtemperature
=0.1
:Note: Error will not be shown if Stream Output is enabled. If Stream Output is enabled, it will just output nothing.
beams
=2
withtemperature
=0.4
also got this error, however,beams
=2
withtemperature
=0.5
will not.(
unhelpful-ai-v01-3
)The text was updated successfully, but these errors were encountered: