What it does
By using OpenCV, a user can create keyboard and events simply by changing the amount of fingers held up. So far, this function is represented by closing a fist to left click, but this technology and concept can be applied to many other places! For example, somebody with fine motor issues can use gesture shortcuts to open apps or navigate their cursor (not implemented yet).
How we built it
This project was built using various python libraries, mainly OpenCV, pygame, numpy, and pyautogui, as well as lots of hard work and dedication.
Challenges we ran into
Our group occasionally had difficulty running pygame consistently across platforms and users. This could've been due to different versions, or something else, but it was resolved. The process of using OpenCV was also very tedious as the arguments needed are quite specific.
What's next for FreeNav
We plan on transforming this technology to not only the mouse buttons, but also many other functions! Specific hand gestures could be helpful for those who do not have fine-motor issues as well, since it can be a convenient way to perform macros too. Building a friendly GUI, adding customizability in terms of different gestures, and other functions such as cursor manipulation are all feasible areas to expand to.
Log in or sign up for Devpost to join the conversation.