Over 400M people struggle with fine motor skills. This interactive platform gamifies therapy, allowing users to have fun while improving dexterity through engaging activities tailored to their needs.
Inspiration: The members of our team are affiliated with sports, and surprisingly, we've had one common problem - a hand injury. A small injury on our hand was the root cause of missed games or other such issues. We did further research and realized that not everyone has short-term problems. Some people have the problem for a long time.
What it does: Using OpenCV and Mediapipe in Python, the platform prompts the user for a hand gesture that they should show. Then the user will do the hand gesture and the camera will read and determine whether it is correct. Once the user is right, another hand gesture will be prompted to the user. The user will try to reach a goal that marks the end of the short therapy session.
How we built it: We used APIs in Python to ultimately create our code. We use our computer's camera to track hand movements so that
Challenges we ran into: There were multiple instances where the camera would not recognize the hand gesture although it was correct. We also saw that it took a very long process to organize and tweak our code to make it more efficient.
Accomplishments that we're proud of: We are proud to have the text on the camera screen and make it as interactive as possible with the point system. We are proud to have connected the camera to a code that works to determine the hand gesture.
What we learned: Before writing this code, our team was not too familiar with the idea of using APIs. Through this program, we were forced to expand our knowledge and incorporate new ideas into our thought process while writing the code.
What's next for FlexAbility: We plan to add more gestures and make it more user-friendly by creating an app where it will complete the tasks. We also plan to have levels and more personalized experiences for FlexAbility users based on their injuries and disabilities.
Log in or sign up for Devpost to join the conversation.