Inspiration
Coming into the Reality Hack, all of our team members shared a belief that data-driven storytelling can strengthen people’s ability to empathize with one another. This, in tandem with the Reality Hack’s theme of “Fusion”, inspired us to create an experience that can provoke intimacy with one another and a deeper understanding of oneself. Some questions that inspired us were:
- How can technology ease pain points in conversation
- How can technology help bridge the gap between verbal and non-verbal communication
- How can technology serve as a vessel for self-reflection in how we communicate with other
- How can Arctop (EEG) supplement emotional learning
What it does
- Amplify the immersion of active and effective communication by mimicking the energies of the participants through real-time visual ambience
- Explore the data visualization of the conversation and pinpoint disparities in internal states.
- MoodSpace provokes a “conversation about the conversation” by revisiting moments of the talk with every participant’s internal state visuals overlaid simultaneously.
- Orrb’s Opacity = Focus
- Orb’s Color Intensity = Enjoyment
- Orb’s Pulse = Heart Rate
Moodspace creates vessels that afford more intimate experience of self-dis
We gather the participant’s heart rate, focus, and
Uses
- Between Friends
- Between partners
- Marriage Counseling
- Autism
- Workspace Team Building
- Leadership training
How we built it
Using three.js and WebXR intended for HoloLens 2 Edge browser. Arctop’s Neuos connected to Android devices connected to Firebasefor transmitting data.
Challenges we ran into
Technical & Development Challenges
- Unsuccessful in getting the application running on the HoloLens 2 which made us change direction to WebXR. - Working with Neuos (EEG wearable) had its challenges in setup and Unity integration
Design Challenges
Balancing the amount of feedback & output from the experience to the people using it without distracting from their primary activity.
Project Management
Feature Prioritization and defining the most we can do in a short amount of time to solve the problem we set out to solve.
Accomplishments that we're proud of
Capturing the overall essence of the problem we are trying to solve and the overall space of seeing visualizing data. The future potential of the problem space and the known and unknown possibilities of a project like this. (Gheric Speiginer, Developer)
What we learned
Working with data from a brain-computer interface and integrating it into a shared embodied XR experience that can be a very emotional, informative and personal ritual. Seeing the data of another person from Neuos visualized in real time had some exciting & fascinating.affects among the team.
What's next for MoodSpace
A reflection mode where we can Design for other input data from the HoloLens 2 & Neuos. We will want to incorporate eye-tracking and also implement GPT3
Built With WebXR
Try it out https://github.com/Reality-Hack-2022
Built With
- javascript
- microsoft-hololens
- neuos
- three.js
- webxr
Log in or sign up for Devpost to join the conversation.