Inspiration
Something as simple as catching a bus is a massive challenge for the 253 million visually impaired people in the world. No app solves this. We wanted to change that.
What it does
Point your phone at the world and Aegis tells you what's ahead. It reads bus numbers, detects obstacles, and speaks to you in a calm human voice — giving visually impaired people the independence they deserve.
How we built it
- Gemini watches the camera feed and identifies buses and obstacles
- ElevenLabs speaks Gemini's analysis out loud in real time
- Snowflake stores path data so the app gets smarter with every user
Challenges
Getting Gemini to analyze live camera frames fast enough to be useful in real time was our biggest technical challenge. We also had to keep the voice prompts short and calm so they don't overwhelm the user.
What we learned
The best ideas solve one specific moment in one person's life and do it perfectly.
What's next
Google Maps integration, Auth0 user profiles, and Solana incentives for users who contribute new mapped paths.
Built With
- elevenlabs
- gemini
- javascript
- snowflake
Log in or sign up for Devpost to join the conversation.