Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Expose the number of generated tokens for FreePromptProvider as an admin setting #48

Open
MB-Finski opened this issue Oct 2, 2023 · 0 comments
Labels
enhancement New feature or request

Comments

@MB-Finski
Copy link
Contributor

Describe the feature you'd like to request

Currently the responses from the text processing provider are limited to 100 tokens due to a hardcoded limit in FreePromptProvider.php. I'd propose exposing it as an admin option.

Describe the solution you'd like

Expose the token limit for FreePromptProvider.php as an admin option.

Describe alternatives you've considered

One alternative could be to provide the consumer of the FreePromptProvider with the ability request a token limit. However, I believe this would be a breaking change given the current architecture of text processing provider tasks. Therefore, introducing a new "v2" freeprompt task type would be necessary..?

@MB-Finski MB-Finski added the enhancement New feature or request label Oct 2, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

1 participant