Inspiration
We wanted to design a device that can give us hands-less means to control the computer during projects presentations and also to showcase 3D designs by orienting them and also able to resize without using any other tools except for hand gestures.
What it does
A smart glass that can read our hand gestures and can send commands to our PC/laptop to control presentations(slides left, slides right.
How we built it
We built it using a Raspberry Pi 4 and a raspberry pi camera. The RPi is running Mediapipe library in python to recognize gestures using the camera feed. Then based on the hand gestures detected, it can send commands to the PC/laptop using MQTT protocol.
Challenges we ran into
Recognizing the gestures using various key points of our hands was a challenge for us. It took us almost all the time to work on detecting the gestures. The rest of the part like control of presentations was not time-consuming.
Accomplishments that we're proud of
Our smart glasses is able to control presentations and also able to control orientation and size of 3D objects.
What we learned
Using our smart glasses, we learned to work with multiple hand keypoints from the mediapipe library in python.
What's next for Smart Glasses
Built With
- mediapipe
- mqtt
- opencv
- python
- raspberry-pi
Log in or sign up for Devpost to join the conversation.