Inspiration

Thousands of children with learning differences struggle to build foundational vocabulary, often due to limited access to personalized resources. Meanwhile, parents juggling work and family life find it challenging to dedicate time to their child’s education. We created WordBuddy.ai to democratize language learning by transforming it into an interactive, AI-driven adventure that empowers kids to learn independently while fostering inclusivity.

What it does

WordBuddy is an AI-powered platform that turns vocabulary building into a story-driven game. Here’s how it works: Kids progress through imaginative stories (pirate quests, space adventures) by pronouncing words correctly, validated via AI speech recognition. Each word is taught with phonetic breakdowns, sign language visuals (ASL), and location-based disaster awareness (e.g., "hurricane" in Miami 🌪️). Features include multilingual support (English/Spanish), dyslexia-friendly fonts, and mini-games that reward progress with digital pets or story unlocks.

How we built it

AI Story Generation: OpenAI’s API crafts dynamic, level-appropriate stories.

Voice Synthesis & Recognition: ElevenLabs API generates playful character voices and analyzes pronunciation.

Frontend: React.js + Tailwind CSS for a kid-friendly, animated interface (think tap-to-listen phonemes and ASL gesture buttons).

Backend: Node.js/Express handles user progress tracking, story logic, and AI integration.

Database: MySQL stores user profiles, word libraries, and sign language gesture data.

State Management: Zustand ensures seamless transitions between games, stories, and settings.

Challenges We Ran Into

One of the biggest hurdles was assigning clear roles. With everyone being full-stack developers, we all jumped into whatever needed doing. Whether it was debugging the backend, tweaking the UI, or fixing AI integrations. While it was great to have so much flexibility, it also led to some chaos as we tried to figure out who was doing what. In the end, we learned to communicate better and divide tasks more effectively, but it was definitely a learning curve!

Accomplishments that we are proud of

Beyond the technical achievements, we’re proud of the journey itself. Traveling all the way from Mississippi to Miami for this hackathon wasn’t just a trip. It was a reminder of why we build. Seeing the diversity of people and challenges out there pushed us to think bigger. We didn’t just want to make another app; we wanted to solve a real, meaningful problem and bridge the gap in education for kids who are often left behind.

What we learned

  • Teamwork makes the dream work: Combining AI, voice tech, and accessibility features wasn’t easy, but
    working together made it possible.
  • Hackathons are intense: With just one day to build, we had to focus on what mattered most and let go of perfection.
  • Inclusivity is worth the effort: Adding ASL and dyslexia tools wasn’t just about helping specific groups. It pushed us to think bigger and work harder, even if it meant sacrificing sleep.

What’s next for WordBuddy

  • Real-Time Accessibility with Machine Learning for Deaf Learners Our vision for WordBuddy goes beyond vocabulary. It’s about breaking communication barriers. In the future, we plan to integrate real-time machine learning models to support deaf learners by recognizing and translating sign languages like ASL (American Sign Language) and BSL (British Sign Language). Imagine a child signing “BOOK,” and WordBuddy instantly responds with a cheerful, “Yes! 📖 Now let’s spell B-O-O-K!”

Built with AI: OpenAI, ElevenLabs Frontend: React.js, Tailwind CSS, Zustand Backend: Node.js, Express Database: MySQL Design: Figma, OpenDyslexic Font

Built With

Share this project:

Updates