Tracks the eye pupil's movement and effectively detects the blinking of eye. Blinking of eye can be easily detected when eye(facial) landmarks are available, Eye is a computer vision application which can effectively tracks the pupil and find the eye blinking based on heuristics powered by data.
Clone the project
$ git clone https://github.com/aditya98ak/Eye.gitInstall the dependencies, create a virtual environment (recommended)
$ cd Eye
$ pip install -r requirements.txt$ python main.pyI've added a video file in order to show how it works. As of now, this application works on closely cropped eye videos stacked side by side (horizontally). The aim of this application is to apply heuristics to find blinking of the eye in case where eye(facial) landmarks are not available or can not be generated. This is just a POC and it's performace can definately be improved!
- Sample frame
- Detection of pupil
- Detection of blink
- SSIM Difference
This approach can be helpful in cases where data is obtained from devices in healthcare domain and we may still need to track, capture blink of eye and not whole face is visible. If whole face is visible, then eye blink can be easily detected with help of (eye) facial landmarks!
All patches welcome!