Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Support for Amazon Bedrock #306

Open
QuinnGT opened this issue Jan 24, 2024 · 2 comments
Open

Support for Amazon Bedrock #306

QuinnGT opened this issue Jan 24, 2024 · 2 comments
Labels
enhancement New feature or request

Comments

@QuinnGT
Copy link

QuinnGT commented Jan 24, 2024

Is your feature request related to a problem? Please describe.
No current support for Amazon Bedrock

Describe the solution you'd like
Support added for Amazon Bedrock

Due to privacy concerns with OpenAI and it's sub products, I'd love to use this with Amazon Bedrock. Direct integration with the go SDK would be awesome but either way, love to see this added.

@danielchalef
Copy link
Member

Hey @QuinnGT, thanks for the suggestion. We're refactoring how LLM inference works in Zep. We'll consider how Bedrock might be supported. We already support Anthropic models, albeit directly via the Anthropic API and not necessarily via AWS.

@danielchalef danielchalef added the enhancement New feature or request label Jan 31, 2024
@danielchalef
Copy link
Member

Amazon Bedrock and other inference providers are now supported via a proxy such as LiteLLM.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

2 participants