Inspiration
When you were a kid, did you dream of sitting down in your chair and smashing your keyboard all day? We invite you to imagine a world where you can become more than that. A world where you can ascend past your text-based code, so that the programming world may enter its next stage of evolution.
What it does
Motion-based programming language. Detects your poses and writes them into our custom stack-based language implementation.
How we built it
- Took photos of people from the hackathon for pose training data, and used OpenCV, Mediapipe, and scikit-learn for pose detection
- Made our own programming language interpreter in Python, and did the processing in a Flask backend
- Used Sveltekit + Tailwind to show the UI, consisting of a stack, the code the user’s written, and a camera
Challenges we ran into
- Gathering good training data - we had to find people of different statures
- Python 🤮 virtual 🤮 environments 🤮
Accomplishments that we're proud of
- We made a new programming language +_+
- The machine learning techniques we learned in class actually work in our Jupyter Notebook!!
What we would add with more time
- Support more numbers, conditionals, and other programming language features
- Game-like features, like taking photos based on music and a beat
Log in or sign up for Devpost to join the conversation.