GlitchView is a Diminished Reality (DR)/Mixed Reality (MR) HoloLens application that changes how we socially interact. Inspired by a dystopian application of future Extended Reality (xR) tools found in Black Mirror's White Christmas episode, we built a tool that allows you to block those you no longer want to see or listen to. Considering how well people take to dystopian futures, we also implemented an interface that augments users with animated emojis descriptive of a user's emotional state.
We use audio commands as our main mode of interface. Bellow are the three voice commands. We also utilize a gaze cursor to visualize the user's center of gaze.
This command causes other persons in the vicinity of the user to be blocked out from head to toe. We use a camouflage/static-like texture to remove the user. We also distort the audio coming from the blocked user's direction with disruptive white noise. We utilize the HoloLen's spatial mapping feature to apply the distortion onto the person's body.
This command augments a user's view of other persons by detecting a person's emotion and attaching an animated emoji that describes that emotion above their head. We currently support three main emotions, Happiness, Sadness, and Anger. We utilize Azure's Emotion API to detect the emotional state of an individual. We also use Vuforia to track and position the emoji above the individual's head. There is an artifact of a dark background that appears only in the video capture. It does not appear when using the application.
This command is used to remove any xR effects that were already applied. It returns you to the normal state.
Our team met at the HoloLens hackathon and built this in two days.
Lauren Chun (Art/Animation), Chris Oats (Shaders/Programming), Talal Alothman (UI/Programming), Krzysztof Barczynski (Cloud/Programing)