Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

VideoProcessors v3 (Preview 1) #80

Open
wants to merge 29 commits into
base: master
Choose a base branch
from
Open

VideoProcessors v3 (Preview 1) #80

wants to merge 29 commits into from

Conversation

manjeshbhargav
Copy link
Collaborator

Contributing to Twilio

All third party contributors acknowledge that any contributions they provide will be made under the same open source license that the open source project is provided under.

  • I acknowledge that all my contributions will be made under the project's license.

Pull Request Details

Description

This PR implements the API changes and the new object model (for both main thread and web worker) specified in this document.

Burndown

Before review

  • Updated CHANGELOG.md if necessary
  • Added unit tests if necessary
  • Updated affected documentation
  • Verified locally with npm test
  • Manually sanity tested running locally
  • Included screenshot as PR comment (if needed)
  • Ready for review

@manjeshbhargav
Hybrid pipeline POC: Only the person mask upscale stage is based on a…
c157012 
… WebGL2-based fast bilateral filter implementation.
@manjeshbhargav
Hybrid pipeline POC: Working around lack of Canvas2D blur filter feat…
8e836c6 
…ure support in Safari by using a WebGL2 alternative.
@manjeshbhargav
Some refactoring.
5056970
@manjeshbhargav
Refactor to implement a 2-pass bilateral filter.
c7617ec
@manjeshbhargav
Add logarithmic stepping to bilateral filter and pre-calculate color …
a8bd626 
…weights.
@manjeshbhargav
Refactor gaussian blur fragment shader.
fed0dea
@manjeshbhargav
* Support bitmaprenderer output frame buffer context.
fff49be 
* Support VideoFrame type for input frame buffer.
@manjeshbhargav
Refactoring the processing code into a separate BackgroundProcessorPi…
2756056 
…peline class, which can be called either from the main thread or a web worker (to be implemented). The public classes invoke the pipeline's render() method to process every video frame.
@manjeshbhargav
Implementing configurable web workers for the background processing p…
2bc2467 
…ipelines.
@manjeshbhargav
Some refactoring.
d04276c
@manjeshbhargav
* Fixing assets path for web workers.
0e7de0e 
* Fix useWebWorker flag in example app.
@manjeshbhargav
* Some refactoring and adding the option to defer input frame downscale.
fd65db7
@manjeshbhargav
* Removing pipeline from stats.
74c0f22
@manjeshbhargav
* Merging web worker benchmark with the one on the main thread.
56f4bba
@manjeshbhargav manjeshbhargav self-assigned this Aug 3, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@charliesantos charliesantos Awaiting requested review from charliesantos

Assignees

@manjeshbhargav manjeshbhargav

Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
2 participants
@manjeshbhargav @twilio-ci