What it does
Control PC games using your fingers via computer vision.
How we built it
Built using OpenCV, custom colour tracking/thresholding and gesture recognition algorithms.
Challenges we ran into
Traditional deep learning networks are relatively slow and thus introduce too much input lag into the game, resulting in it being pretty unplayable. We had to design our own algorithm from scratch for each gesture feature to map to each button press.
Member IDs
Shuen (621), Hashir (382), Pradeep (386), Rittik (144)
Log in or sign up for Devpost to join the conversation.