wabbit AI

• 

  this is wabbit!

TLDR: Give ChatGPT a body and a voice and make it accessible for everyone and reimagine companionship

Inspiration

Chances are, you've tried out ChatGPT at some point. Though generative AI is still in its early stages, we were captivated by its ability to not only educate us, but to surprisingly provide sound advice and even heartwarming companionship. However, currently, these new models are only accessible through text. We gave ChatGPT a body, so that it can be accessible to more people, including the blind and illiterate. As we are at an inflection point in generative AI technology, we sought to introduce a visual and immersive element to what we once just experienced as text on the screen, and build Wabbit AI to reimagine the way we interact with artificial intelligence.

What it does

Wabbit is an AI-powered companion that you can actually have a realistic, voice-driven conversation with that grows, learns, and conversates with you over time. This project combines state-of-the-art text synthesis, speech-to-text models, natural language processing techniques, character animation, and generative AI to create an unparalleled human-computer interaction experience.

In its current iteration, Wabbit AI is designed to teach, entertain, and provide useful information to users. But this is only the beginning. As it evolves, Wabbit AI will develop memories and form a deeper bond with users, providing proactive support to enhance various aspects of their lives. Imagine having an AI companion that remembers your preferences, anticipates your needs, and is always there for you - Wabbit is the first proof of concept of that using the latest AI models, and hopes to change the way you think about technology.

Check it out

No pre-recorded demo or screenshots can ever capture the true magic of seeing Wabbit respond to your question and talk to you directly. Come watch our live demo :)

How we built it

We put together a seemingly unlikely match — Unity and a standard React app — to create an immersive experience with a realistic AI companion that you could interact with and view conversation history with.

• Unity (@Jenny): detailed character rigging, animation transitions, game environment, lip-syncing scripts, gameObject script (C#) to tie it all together and send over information to web
• Web (@Chrissy): user microphone input, OpenAI Whisper (text synthesis), ChatGPT/LLM completion API, ElevenLabs realistic voices, connect with character scripts in Unity WebGL container, cache conversation history to enable agent to adapt to user, all in React web app

Built With

• ai
• c#
• core-animation
• llm
• openai
• react
• unity