-
Notifications
You must be signed in to change notification settings - Fork 171
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Add Image to text AI pipeline support #3202
Conversation
Codecov ReportAttention: Patch coverage is
Additional details and impacted files@@ Coverage Diff @@
## ai-video #3202 +/- ##
===================================================
- Coverage 36.07820% 35.92244% -0.15576%
===================================================
Files 124 124
Lines 34525 34658 +133
===================================================
- Hits 12456 12450 -6
- Misses 21381 21520 +139
Partials 688 688
... and 1 file with indirect coverage changes Continue to review full report in Codecov by Sentry.
|
I've merged in the latest |
@mjh1 I tested that his works on-chain. Very fast and strong pipeline (i.e. 200ms). |
What does this pull request do? Explain your changes. (required)
Adds support for the ai-worker pipeline which implements a image-to-text model (default https://huggingface.co/Salesforce/blip-image-captioning-large)
Corresponding AI-Worker PR:
livepeer/ai-worker#223
Specific updates (required)
How did you test each of these updates (required)
Tested by running the gateway and worker locally.
Does this pull request close any open issues?
Checklist:
make
runs successfully./test.sh
pass