Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Support for Upstage LLM and Embeddings #218

Open
JuHyung-Son opened this issue Jun 23, 2024 · 1 comment
Open

Support for Upstage LLM and Embeddings #218

JuHyung-Son opened this issue Jun 23, 2024 · 1 comment
Labels
enhancement New feature or request

Comments

@JuHyung-Son
Copy link

JuHyung-Son commented Jun 23, 2024

Is your feature request related to a problem? Please describe.
Feature request about adding llm and embedding provider Solar. It is number one llm provider in APAC. Can be used by their API or aws jumpstart.

Solar shows very nice performance in Korean and Japanese. And Thai is coming soon.

If you agree, I'll work on it and give you a PR.

Additional context
See more about Solar.

https://www.predibase.com/blog/solar-llm-on-predibase-the-best-llm-for-fine-tuning?utm_medium=partner&utm_source=upstage
https://www.linkedin.com/posts/leohp_openai-activity-7205473539208998912-w8-W/

@JuHyung-Son JuHyung-Son added the enhancement New feature or request label Jun 23, 2024
@ItzCrazyKns
Copy link
Owner

ItzCrazyKns commented Jul 23, 2024

Hi @JuHyung-Son, we've restructured how providers are created in Perplexica, you can now add (and maintain) the Solar provider. Here are the steps to add it:

  1. First add the provider in the src/lib/providers folder, you can see how other providers are implemented and follow the same format to add the Solar provider.
  2. Once that is done, you can add the provider into the providers list in the src/lib/providers/index.ts file.
  3. After that, you need to add an input in the settings menu for the API key and pass it with the config, for more details see ui/components/SettingsDialog.tsx, src/config.ts, src/routes/config.ts.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

2 participants