Inspiration
What it does
How we built it
Challenges we ran into
Accomplishments that we're proud of
What we learned## Inspiration
We were inspired by an app called Vibedraw, which turns 2D drawings into interactive 3D models.
What it does
It reads users' dance movements using Google Gemini and feeds that into Google Lyria's live music generation software, creating music from dance.
How we built it
Using AI models like Gemini and tools like Lyria, we constructed this by chaining together Gemini-created prompts into Lyria's image generation software.
Challenges we ran into
We found it difficult to chain these prompts together, along with getting Gemini to create a suitable prompt from a video.
Accomplishments that we're proud of
Being able to be multi-nodal with AI tools, we created a codebase that was both easy to interact with and easy to expand on.
What we learned
We learned how to be efficient with our prompt engineering while also being able to work with multiple AI models simultaneously.
What's next for VibeDraw
Further improving by training our own AI models for custom prompt generation, and expanding on Lyria's custom mixer capabilities.
Built With
- css
- gemini
- html
- javascript
- lyria
- typescript
- vercel
Log in or sign up for Devpost to join the conversation.