maxContextTokens for existing EndPoint (OpenAI)? #4004
ViolentVotan
started this conversation in
Help Wanted
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
Hi there,
I googled and found on the wiki on how to set maxContextTokens for custom endpoints in the yaml, but how can I set a maxContextTokens for the standard OpenAI endpoint?
I want that all my users are automatically set to a set maxContextTokens value without them having to set it on every new chat.
Beta Was this translation helpful? Give feedback.
All reactions