Skip to content

JonesMays/wander

Repository files navigation

🌳 TreeHacks Submission: Wander

Banner Image


🚀 About the Project

Wander is a smart wearable system designed to enhance the safety and independence of elderly individuals with dementia. Built during TreeHacks 2023, our solution addresses the growing challenges of dementia care by empowering caregivers and ensuring patient safety.


💡 Inspiration

With over 55 million people worldwide living with dementia, caregivers often face immense challenges in ensuring the safety and well-being of their loved ones. Inspired by Jones grandmother, we created Wander to provide a seamless, AI-driven solution that reduces caregiver stress and enhances patient safety.


🛠️ How It Works

  • Real-Time GPS Tracking: The Wander Bracelet tracks the wearer’s location in real-time using an ESP32 microcontroller and GT-U7 GPS module
  • AI-Powered Guidance: Leveraging OpenAI and ElevenLabs, the system plays personalized audio prompts to gently guide users back to safety.
  • Caregiver Notifications: Integrated with Twilio, caregivers receive instant SMS alerts and activity reports.
  • Seamless Connectivity: Data flows between the hardware and software layers via MQTT and Firebase, ensuring real-time updates and analytics.

🎥 Demo Video

Demo Video

Click the image above to watch the demo!


🛠️ Tech Stack

C++
ESP32
Firebase
OpenAI
Twilio


🧠 Challenges We Faced

  • Hardware-Software Integration: Connecting the ESP32 microcontroller with Firebase and MQTT required extensive debugging and optimization.
  • AI Personalization: Generating realistic and comforting audio prompts using ElevenLabs posed initial challenges in achieving the right tone and clarity.

Accomplishments We’re Proud Of

  • Successfully built a functional hardware prototype in under 36 hours.
  • Integrated three different AI platforms (OpenAI, ElevenLabs, Twilio) to create a seamless user experience.
  • Designed a user-friendly interface for caregivers to monitor their loved ones effortlessly.

📚 What We Learned

  • The importance of iterative design and rapid prototyping.
  • How to effectively integrate hardware and software systems in a limited timeframe.
  • The power of AI in creating personalized, empathetic solutions.

🚀 What’s Next for Wander

  • Expand the system to include fall detection and health monitoring features.
  • Conduct user testing with caregivers and dementia patients to refine the design.
  • Explore partnerships with healthcare organizations to bring the solution to market.

👥 Team

Name Role Fun Fact
Heanan Bird Hardware Engineer Loves building robots in free time
Jones Mays AI/ML Specialist Once coded for 48 hours straight
Anna Wang UX Designer Avid painter and illustrator

🙏 Acknowledgments

  • A huge shoutout to the TreeHacks organizers for putting together an incredible event!
  • Special thanks to ElevenLabs for their guidance and support.
  • We used OpenAI to bring our project to life.

📄 License

This project is licensed under the MIT License


Thanks for checking out our project! We’d love to hear your feedback.

About

No description, website, or topics provided.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

 
 
 

Contributors