-
Notifications
You must be signed in to change notification settings - Fork 5.4k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Add OCI Data Science Model Deployment LLM Integration #17241
base: main
Are you sure you want to change the base?
Conversation
Check out this pull request on See visual diffs & provide feedback on Jupyter Notebooks. Powered by ReviewNB |
Hi @logan-markewich, I wanted to kindly ask for your help with the review of this PR. The changes introduce integration for invoking LLMs on OCI Data Science, and I’d greatly appreciate your feedback and insights. Additionally, I’ve encountered an issue with failing tests during the CI pipeline due to the absence of the oracle-ads library, despite it being listed in the When you have time, could you please take a look at this and share your thoughts on what might be causing this discrepancy? Your guidance would be incredibly helpful. Thank you in advance for your time and support! |
Description
Oracle Cloud Infrastructure (OCI) Data Science is a fully managed, serverless platform for data science teams to build, train, and manage machine learning models in Oracle Cloud Infrastructure. This PR introduces a new LLM integration with (OCI) Data Science Model Deployment endpoints. It includes synchronous and asynchronous clients, built-in retry logic using tenacity, and direct authentication via the OCI Signer.
llama_index_test_base.pdf
New Package?
Did I fill in the
tool.llamahub
section in thepyproject.toml
and provide a detailed README.md for my new integration or package?Version Bump?
Did I bump the version in the
pyproject.toml
file of the package I am updating? (Except for thellama-index-core
package)Type of Change
Please delete options that are not relevant.
How Has This Been Tested?
Suggested Checklist:
make format; make lint
to appease the lint gods