Inspiration

Coming into the Reality Hack, all of our team members shared a belief that data-driven storytelling can strengthen people’s ability to empathize with one another. This, in tandem with the Reality Hack’s theme of “Fusion”, inspired us to create an experience that can provoke intimacy with one another and a deeper understanding of oneself. Some questions that inspired us were:

  • How can technology ease pain points in conversation
  • How can technology help bridge the gap between verbal and non-verbal communication
  • How can technology serve as a vessel for self-reflection in how we communicate with other
  • How can Arctop (EEG) supplement emotional learning

What it does

  1. Amplify the immersion of active and effective communication by mimicking the energies of the participants through real-time visual ambience
  2. Explore the data visualization of the conversation and pinpoint disparities in internal states.
  3. MoodSpace provokes a “conversation about the conversation” by revisiting moments of the talk with every participant’s internal state visuals overlaid simultaneously.
  4. Orrb’s Opacity = Focus
  5. Orb’s Color Intensity = Enjoyment
  6. Orb’s Pulse = Heart Rate

Moodspace creates vessels that afford more intimate experience of self-dis

We gather the participant’s heart rate, focus, and

Uses

  • Between Friends
  • Between partners
  • Marriage Counseling
  • Autism
  • Workspace Team Building
  • Leadership training

How we built it

Using three.js and WebXR intended for HoloLens 2 Edge browser. Arctop’s Neuos connected to Android devices connected to Firebasefor transmitting data.

Challenges we ran into

Technical & Development Challenges

  • Unsuccessful in getting the application running on the HoloLens 2 which made us change direction to WebXR. - Working with Neuos (EEG wearable) had its challenges in setup and Unity integration

Design Challenges

Balancing the amount of feedback & output from the experience to the people using it without distracting from their primary activity.

Project Management

Feature Prioritization and defining the most we can do in a short amount of time to solve the problem we set out to solve.

Accomplishments that we're proud of

Capturing the overall essence of the problem we are trying to solve and the overall space of seeing visualizing data. The future potential of the problem space and the known and unknown possibilities of a project like this. (Gheric Speiginer, Developer)

What we learned

Working with data from a brain-computer interface and integrating it into a shared embodied XR experience that can be a very emotional, informative and personal ritual. Seeing the data of another person from Neuos visualized in real time had some exciting & fascinating.affects among the team.

What's next for MoodSpace

A reflection mode where we can Design for other input data from the HoloLens 2 & Neuos. We will want to incorporate eye-tracking and also implement GPT3

Built With WebXR

Try it out https://github.com/Reality-Hack-2022

Share this project:

Updates