Inspiration
Our inspiration came from Rudransh’s experience moving to Canada. Living in a French-speaking province, exploring his new neighborhood was difficult and isolating—signs provided little information in a language he understood. Exploration of new places can be one of the most powerful sources of growth, so we set out to augment those experiences.
Our goal: let anyone, anywhere, from any language background, seamlessly learn about the history and context of their surroundings.
What It Does
roamer.ai provides an audio stream of information and history about your immediate surroundings. Simply open the website, allow location sharing, and receive tour-guide-style descriptions—in any language.
Key Features
🌍 Omnilanguage selection 🎧 Seamless audio narration 📍 Geographically tailored information
The Build
Frontend:
- React, Vite
Backend:
- Flask, Python, Google Maps API, Google Gemini 2.5 API, Eleven Labs API, Gunicorn
Key Partners:
- Eleven Labs – AI-powered text-to-speech
- Google Gemini 2.5 – LLM-based historical + contextual descriptions
Challenges We Faced
- Adding accessible features, creating captions and multiple language options within the existing design led to a difficult retrofit.
- Integrating frontend and backend smoothly, the constant need for updated coordinates provided a unique challenge.
- Handling query latency from API requests, due to the complexity of the prompts asked we had to navigate how a user would be affected by delay.
- Preventing repeated information when standing still, we had to ensure the system was not repeating itself if users did not move location.
Accomplishments We’re Proud Of
- 3 out of 4 members’ first hackathon project—and it worked!
- Built something we’d all personally use
- Learned entirely new parts of the tech stack in <48 hours
What We Learned
- The importance of teamwork under pressure
- How to start simple and iterate fast
- Adapting quickly when things break
What’s Next
- User-to-user interaction to enhance exploration
- Computer vision to describe specific buildings/statues
- More accessibility features
- Smart notifications when passing "iconic experiences"
✨ Built with passion at HackHarvard 2025 ✨
Built With
- eleven-labs
- flask
- google-gemini
- google-gemini-2.5-api
- google-maps
- gunicorn
- leaflet.js
- python
- react
- vite
- vite-backend:-flask

Log in or sign up for Devpost to join the conversation.