Skip to content

Reconstruct visual stimuli from EEG data using Deep Learning

Notifications You must be signed in to change notification settings

stefanches7/DeepVisual

Repository files navigation

DeepVisual - EEG-based picture reconstruction

Connect

Goals

Tier 1 goal is to predict seen image category based on EEG time series produced during visual perception of the former. The ultimate goal is try to reconstruct whole image (i.e., pixel to pixel) from EEG time series. Here, we are using Deep Learning approach.

Data

Data suitable for the first goal is e.g. from Rashkov G. et al. (2019) https://doi.org/10.1101/787101. Dataset is openly accessible at https://data.mendeley.com/datasets/s2dxrv45fr/1. Pitily, the researchers couldn't include whole shown video clips because of copyright issues, only screenshots - so the second goal is only achievable after some data transformation. The second goal affine dataset should at some point be uploaded by instigators of Brainhack Geneva 2019 project (see Credentials) and be made publically available. We are welcoming any clues about further suitable dataset - don't hesitate to drop a message on Mattermost channel, or open an issue here!

Methods

Year 2019 appears to be bursting even with review articles on Deep Learning using EEG data. One of the reviews finds CNN, Deep Belief Networks and Multilayer Perceptrons to be the most often used models for learning on EEG data. If we consider "emotion recognition" task setup to naturally correlate with at least the first task setting (classification of seen image), it is indeed interesting to try Deep Belief Networks on our data.

Credits

This project was begun during Brainhack Geneva 2019. Credits for the scientific idea go to the Team 10 of instigators of Brainhack Geneva 2019 (Konstantinos S.-T., Timokleia K., Florian L. and Carolina L.). Technical idea and way of implementation is of the owner of this repository, Stefan Dvoretskii.

About

Reconstruct visual stimuli from EEG data using Deep Learning

Topics

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages