Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

近期chatgpt 老崩掉,是否可以加设置 openai_api_base 的选项? #4

Open
wingjoezhou opened this issue Nov 22, 2023 · 1 comment

Comments

@wingjoezhou
Copy link

现在不支持本地 LLM,例如 chatglm3, 但我有其他兼容openai 的api 服务,例如fastchat 做 llm 后端,但没有地方设置 openai base url 的地方,是否能增加这个参数设置,这样可以不用直接访问chatgpt,而用本地的llm ?

@zhoudaquan
Copy link
Owner

现在不支持本地 LLM,例如 chatglm3, 但我有其他兼容openai 的api 服务,例如fastchat 做 llm 后端,但没有地方设置 openai base url 的地方,是否能增加这个参数设置,这样可以不用直接访问chatgpt,而用本地的llm ?

感谢您的关注。我们会在近期添加支持local LLM的选项。

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants