NoKeyMous

Inspiration

We wanted to make the use of computers accessible to everyone.

What it does

It replaces a typical keyboard and mouse to navigate on a computer. It uses computer vision to use your index finger as a mouse. Another feature uses voice recognition to execute commands (opening powerpoint, opening the command prompt, opening google chrome, etc.).

How we built it

We built it solely with Python

Challenges we ran into

Aligning the finger to the mouse. Using a grid to move the mouse using voice control

Accomplishments that we're proud of

We can use voice commands to interact with the computer.

What we learned

We developped our skills in Computer Vision and Speech Recognition

What's next for NoKeyMous

Full integration of both features seamlessly. Optimisation so it can be a fast and smooth experience for it's user. Training the voice-to-speech recognition system to improve the accuracy of the commands.

Built With

• opencv
• python
• speech-recognition
• tkinter