Inspiration
Even with the advancement of technology, communication with people is still important. However, there are still some things that have not been resolved. For example, when a person is unable to go out with a friend due to illness or old age, we believe that simply sharing photos is not enough for good communication. Therefore, we developed a system that uses Mixed Reality and Virtual Reality to allow people to relive other people's travels and other activities.
What it does
Spatial Cityscape is an application mixing with smartphone and Meta Quest3.
Smartphone users just use a web application. They take pictures, send pictures with geolocations to Azure clouds.
Quest3 users can not only oversee miniature city but also dive into real scale city with friend's track.
How we built it
Spatial Cityscape is composed of smartphone, cloud environment, and Quest3.
Smartphones has feature of taking picture, sending picture with geolocation to cloud environment.
Cloud environment is Azure. The Node.js sever based application gathers picture and geolocation data. It provide these data to our Quest3 application.
Challenges we ran into
Designing "Spatial Cityscape" has several unique challenges:
Use real 3D city model: PLATEAU is an free 3D city model provided by Ministry of Land, Infrastructure, Transport and Tourism in Japan. We can easily reproduce real scene with MR and VR. Such city models are provided from not only Japan but also other countries like Germany, Singapore, and United States.
Combination with geolocation based smartphone: Providing real experience with Quest3 users who are in Mixed Reality, we adapted a web application for smartphone. We can use it anywhere because the server has been configured on Azure cloud. Mixing other devices can provide new feature with Quest3 users.
Seamlessly switch Mixed and Virtual Reality: Oversee dive into city models can provide a new re-experience with Quest3 users.
Accomplishments that we're proud of
Our recent problem-fast approach: We discussed what were recent our problem in daily lives before implementation. Providing more immersive re-experience with elder, sick, and urgent task persons who were not be able to join their preferable events. We addressed new communication style with MR and VR.
Multiple devices: We're particular about new concept that not be aware from anyone. Especially mixing smartphones, more users can use MR applications. We believe that our application can be used for multiple users.
What we learned
Multiple devices and cloud environments: It's not easy to utilize multiple language and runtime in limited hackathon time.
Passthrough and scene API: Light and room environments sometimes had cause of tracking loss. We continued try and error and solved them.
What's next for
Dynamic loading city model: In this hackathon application, a fixed city model around hackathon venue was showed. We can load other city model from anywhere and show it on Quest3. Our smartphone application has already send pictures with geolocation. We can use it for not only fixed hackathon venue.
New service concepts: If the city models are released to public and everyone can upload pictures and can access them, people can re-experience for other people's track. Attaching "like", sharing people's track and related activities may provide a new social communication.
Log in or sign up for Devpost to join the conversation.