Inspiration
The project is an educational learning app designed to teach English through a structured roadmap, particularly targeting youth and students with learning disabilities. It breaks down English learning into multiple levels, starting from the basics like alphabets and progressing to reading full sentences. Each level contains a variety of mini-games that engage different senses, using visual and auditory cues to enhance understanding and maintain the attention of students.
Successfully completing games rewards students with coins, which they can use to purchase AI-generated books tailored to their preferences. The app provides continuous guidance and motivation through audio support, helping students when they get stuck, and offering a clear path for next steps in their learning journey.
What our project does
The project is an innovative educational learning app designed to address the unique challenges faced by youth, especially those with learning disabilities, in mastering English. It provides a comprehensive, structured approach to language learning, starting with the very basics like*alphabets and gradually progressing to more advanced skills, such as reading and comprehending full sentences. The app is divided into multiple levels, each focused on specific topics, ensuring that students build a solid foundation before moving on to more complex concepts.
Unlike existing educational games, this app offers a concise and effective roadmap that guides students step-by-step through the learning process, reducing the overwhelming choice that can hinder progress for students with learning disabilities. Each level includes a variety of mini-games, designed to be highly engaging and interactive, using a combination of visual and auditory cues to captivate students' attention. These games not only test knowledge but also promote multi-sensory learning, catering to short attention spans by being visually appealing and concise.
A unique feature of the app is its reward system: when students successfully complete games, they earn coins that can be used to purchase AI-generated books within the app. These books are custom-made based on the student's preferences in topics, genres, and styles, offering personalized content that further strengthens their reading skills. Additionally, the app provides motivational support through audio guidance, helping students when they struggle and encouraging them to continue learning.
Through this systematic, engaging, and supportive approach, the project empowers students to improve their literacy skills while making learning fun and rewarding.
Key Features:
- Structured roadmap: Guides students from basic to advanced English learning.
- Multi-sensory engagement: Visual and auditory cues enhance the learning experience.
- Reward system: Earn coins to purchase personalized AI-generated books.
- Inclusivity: Audio support helps students when they face challenges.
- Motivational design: Short attention span-friendly and visually appealing games.
How we built it
The project was built using NextJS and React for both the frontend and backend. We integrated GPT-4o, DALL-E 3 and Google's Web Speech APIs for generating AI images, AI-powered stories, and speech recognition functionalities. To manage user data and in-game currency within the application, we utilized the Prisma library and SQLite for our database system.
In addition, we developed an Adobe Add-on using JavaScript, enabling users to easily upload avatars by leveraging React's built-in camera library. This seamless integration enhances user interaction by providing a smooth, intuitive experience for customizing avatars.
Challenges we ran into
One of the hardest was working with Adobe Express. We set out to create our own add-on, but the process was far more complex and time-consuming than we expected. The limited documentation made things even trickier, and connecting the playground with our code led to a lot of trial and error. After hours of hard work, we finally got it working, and that moment felt like a huge win! We were definitely overambitious at the start of the hackathon. We had all these big ideas and plans, but as we got deeper into the project, it became clear that some of them were far more complicated than we anticipated. This forced us to take a step back and re-evaluate what was actually achievable within the time limit. We had to compromise and shift our focus to more realistic goals, scaling back some features while making sure we could still deliver a polished final product. It was a tough decision, but it taught us the importance of balancing ambition with practicality. Even though these challenges pushed us to the limit, solving them was incredibly rewarding. We learned so much along the way, and by the end of it, we were proud of what we achieved!
What we learned
Looking ahead, we have some exciting plans for the future of our project. One of our main goals is to expand the game to support teaching in multiple different languages, making it accessible to a wider audience. We also want to integrate more AI features to make the application even more responsive and efficient. By doing this, we hope to offer users more personalized support and improve accessibility, helping them on their learning journey in an even more interactive and engaging way. The possibilities are endless, and we’re excited to see where we can take it next!
We’re incredibly passionate about the impact this project can have. With literacy rates dropping and children with special needs not always having access to the extra resources they need, we believe this tool can play a crucial role in supporting their success. Education is the foundation of opportunity, and by expanding our game to offer multi-language teaching and integrating AI for more personalized support, we hope to bridge some of those gaps. We see this project as more than just a game—it’s a way to give children, especially those who need extra help, the tools they need to thrive in their learning journey.
Built With
- adobe-express
- css
- dall-e-3
- gpt-4o
- javascript
- nextjs
- prisma
- react
- web-speech-api
Log in or sign up for Devpost to join the conversation.