Inspiration

During our design cycle we were most heavily inspired by Alto's Adventure, a skiing game, but wanted to add a real-life twist.

What it does

The game utilizes the user's webcam and 2 hands in order to control their respective skater as they race to the finish line.

How we built it

This game uses opencv and mediapipe in a python script to create and map nodes onto the users' hands and then compares their x and y values in order to determine their hand sign which corresponds to a movement in game. We used the Godot engine to bring this game to life

Challenges we ran into

While we built this project, one of the main challenges we had to overcome was differentiating between 'backspin', 'go', and 'frontspin' with the camera as the x and y values would never be perfectly aligned. In order to fix this issue, we incorporated a threshold value which differentiated the needed x and y values to determine a frontspin from a backspin.

Accomplishments that we're proud of

Our team is most proud of being able to integrate communication between our python scripts and godot scripts by making our hand signs log a key on the user's computer, which then in turn controls the skater's movements.

What we learned

Throughout this process, we learned how to use computer vision to a greater extent, plan projects with a time contraint, and navigate uncharted territory through the depths of python libraries and godot.

What's next for SkateCam

Another feature we would like to add given time, is functionality for amputees with eye tracking.

Built With

Share this project:

Updates