-
-
-
The spatial 3D map collects memorial posts along with the spot’s location
-
Click "Memory Retouch" to generate a new impressive image of the travel spot
-
Click on each mark to read the post written previously
Inspiration
Saving travel memory through 2D mobile journal apps is often inefficient and uninteresting, leading users to stop recording their experiences. Inspired by the rewarding systems in education and health apps, we created “Spatial Moments” to motivate users to keep documenting their travels and showcasing through XR. By rewarding them with impressive, AI-generated images representing key moments of their trips, we make reviewing and reliving these experiences easier and more enjoyable.
What it does
“Spatial Moments” transforms simple travel logs into dynamic 3D memories. Users can input their travel posts, including text and images with timestamps, and the platform uses generative AI to create stunning visuals that capture the essence of their experiences. These visuals make revisiting memories more engaging and meaningful.
How we built it
We used Unity and the XR Interaction Toolkit to implement the scene in Meta Quest 3. To interact with large language models (LLMs) like Claude Sonnet 3 and Stability, we leveraged AWS Bedrock. When users trigger the retouch function, a customized prompt based on their travel post is sent to the LLMs via the AWS Bedrock server. The returned output, including text and images, is then processed locally in Unity, enabling the creation of dynamic and immersive 3D memories.
What we learned
We learned the importance of user engagement in the development of digital tools, especially when merging new technologies like XR and GenAI. Our experience highlighted the value of iterative testing and user feedback in creating a product that is both innovative and easy to use.
What's next for Spatial Moments: Enlightening your travel memories
Our next steps include expanding the platform’s features to include more interactive elements and enhancing the realism of the generated memories. We plan to leverage more XR capabilities to enable users to document, review, and share their valuable memories in an even more immersive and engaging way.
Log in or sign up for Devpost to join the conversation.