Inspiration
After being immersed in the RIT community for less than a month, we realized how prominent the deaf and hard of hearing community is. Most people in general do not know how to sign, therefore we came up with Signiverse to solve this problem.
What it does
Signiverse is an innovative educational platform designed to teach American Sign Language (ASL) by engaging users through interactive learning and gamification. Signiverse has many lessons and tutorials that users can learn ASL with no experience. Users will be able to truly learn due to the real-time AI camera detection! Users can practice signing and receive instant feedback on their signing accuracy by using their camera on their device. Unlike many normal language apps, Signiverse has unique gamification implemented into it. Users can immerse themselves in the virtual environment and have conversations with characters using ASL in various contexts and scenarios. Finally users can collaborate with others, compete against friends and have fun!
How we built it
We created Signiverse using a combination of different software. The main ones include Vue, a teachable AI model, HTML, Monaca and CSS.
Challenges we ran into
Due to the time constraints, we ran into a few problems. The team had many ideas and it was challenging to combine all of the in a limited time. Moreover, preparing a dataset for the AI model was time consuming. To solve these problems we prioritized certain work, relied heavily on good time management, and worked in groups of two.
Accomplishments that we're proud of
We think the biggest thing that we are proud of is that we worked as a team to produce something awesome!
What we learned
Through our experience of participating in our first RIT hackathon we learned how much fun it is! We learned about using certain websites including Figma. Most of all, we learned how to collaborate to create a functional project within a limited time frame.
What's next for Signiverse
We want to expand Signiverse and make it available for different devices including Android. Moreover we want to work with other platforms to showcase a certification that users can get if the complete the full course within Signiverse. It would also be cool to improve the app and make it available to the public.
Log in or sign up for Devpost to join the conversation.