Apply Vision algorithms to track an object from live capture and have Movi keep it centered in frame using its gimbal. See it in action.
Originally developed for use in a Freefly Project Challenge.
Requires Movi firmware V1.3+.
Limited development time to eight consecutive hours.
Use your finger to drag a rectangle over the object you want to track. It will turn orange to indicate it is currently attempting to track the detected object observation. When connected to the Movi, it will center the object in frame using its gimbal.
- TOP: Toggle thirds demo. This is just a quick feature idea that will lock the track to rule of thirds on the Y axis, instead of center. View in Source
- TRIGGER: Reset track.
- CENTER: Toggle recording.
VisionTrackerProcessordoes not handle losing confidence of the track very well.- Overall, the processor is not robust enough to handle an extensive array of dynamic frame sizes.
- No current user adjustable settings for how the Movi attempts to center an object in frame.
- Does not handle orientation changes, so I've locked in Landscape Right.
- Does not handle user permissions errors.
- Only tested on iPhone X and iPhone XR.
- Currently, I am using a linear speed ramp when moving the Movi. However, there may be another solution that may offer increased effectiveness when tracking. View in Source
- Interactive 'Rule of Thirds' grid to dial in exact position of your track in frame.
- General performance improvements.
- More robust control over Movi connection.
From habit, I encapsulated my project in a workspace to allow for CocoaPods, though I did not end up using any in this demo.
Thank you, Freefly team for letting me have some fun with your API and Movi CR! Stemming from my serious excitement over this project, it was really hard to stop development as I just kept wanting to explore and add features.
For more, visit https://frodes.io