MIT Reality Hack 2026
Phone + Headset synchronized view
Cooking a new recipe over Samsung Video Call is frustrating. You have to hold your phone with messy hands, prop it up precariously, and your mom can't easily point to things in your actual kitchen ("No, the other pot!"). You spend more time managing the phone than managing the stove.
Our solution harnesses the power of Galaxy XR to seamlessly integrate assistance directly into your virtual calls. Instantly connect with 2D users and let them guide you, both vocally and visually, through every step of the cooking process.
We built this project for the Android XR ecosystem, utilizing Unity and the Galaxy XR platform. Android XR's open architecture gave us direct access to the camera feed and websockets, dramatically streamlining video stream development.
We faced challenges connecting the headset to the mobile app, but through creative problem-solving and determination, we achieved a seamless integration.
Maybe, the real treasure was the friends we made along the way :0
- Vertical Expansion
- Switching Gemini from reactive to proactive
- Saving Memories
- Multi-Users