Inspiration

What it does

How we built it

Challenges we ran into

Accomplishments that we're proud of

What we learned## Inspiration

We were inspired by an app called Vibedraw, which turns 2D drawings into interactive 3D models.

What it does

It reads users' dance movements using Google Gemini and feeds that into Google Lyria's live music generation software, creating music from dance.

How we built it

Using AI models like Gemini and tools like Lyria, we constructed this by chaining together Gemini-created prompts into Lyria's image generation software.

Challenges we ran into

We found it difficult to chain these prompts together, along with getting Gemini to create a suitable prompt from a video.

Accomplishments that we're proud of

Being able to be multi-nodal with AI tools, we created a codebase that was both easy to interact with and easy to expand on.

What we learned

We learned how to be efficient with our prompt engineering while also being able to work with multiple AI models simultaneously.

What's next for VibeDraw

Further improving by training our own AI models for custom prompt generation, and expanding on Lyria's custom mixer capabilities.

Built With

Share this project:

Updates