Inspiration
Our innovative platform combines the power of conversational AI with the fun of interactive games, transforming traditional language learning into an engaging and playful experience. With a vibrant, child-friendly interface and exciting games like 'Fruit Slash' for vocabulary building and a math challenge that lets kids solve basic arithmetic problems in Spanish, we make learning feel like play. The magic lies in our use of voice technology.
What it does
Kids respond to challenges by speaking, and our integration with Gladia’s speech-to-text engine ensures that their responses are instantly processed and validated. This conversation-based approach allows young learners to practice speaking Spanish in a natural and fun way, making language learning more interactive than ever. We believe that the best learning happens when you're having fun, and we’re changing the way kids learn languages—one conversation at a time.
How we built it
• Design & Prototyping: Used Figma to create a fun and interactive user interface, focusing on a kid-friendly design. • Frontend Development: Built the frontend using React and Next.js, implementing responsive components and game interfaces. • Speech-to-Text Integration: Integrated Gladia for live audio processing, converting speech into text in real time. • Text Processing Logic: Implemented simpdjson to handle JSON queries and manage data from the speech-to-text responses. • Game Functionality: Developed game UIs that utilize the processed text to validate responses and provide feedback within interactive games.
Challenges we ran into
• Limited Time and Expertise: Couldn't fine-tune voice models to the desired accuracy due to time constraints and lack of expertise. • Latency Issues: Experienced delays with API calls between the speech-to-text service and the conversational agent, affecting response times. • Poor Internet Connectivity: Encountered frequent connectivity issues throughout the hackathon, costing valuable development time. • Limited Workspace: Faced difficulties collaborating effectively due to cramped working conditions and lack of sufficient space.
Accomplishments that we're proud of
• Team Collaboration: Successfully worked together despite various struggles, demonstrating strong teamwork and resilience. • Rapid Prototyping: Quickly tested different voice software to validate the idea and identify a feasible solution. • UI Design and User Experience: Created a friendly, appealing, and fun interface that makes learning enjoyable for kids. • Clean and Interactive Interface: Developed a clean, user-friendly interface that enhances the learning experience through engaging interactions.
What we learned
• Real time streaming ain't easy, if you want low latency! We promise awesome latency streaming!
What's next for Funlingo
• Character-Based Conversation Agents: Train voice models to incorporate popular TV and movie characters, allowing kids to learn from their favorite personalities and making the experience more engaging. • Personalized Pronunciation Tutor: Develop a conversation agent that listens to kids’ pronunciation and provides real-time feedback, acting as a personalized tutor to help them improve their speaking skills.
• Research-Backed Educational Content: Collaborate with educators and researchers to design games that are not only fun but also scientifically proven to enhance language learning outcomes.
Built With
- gladia
- nextjs
- simdjson



Log in or sign up for Devpost to join the conversation.