Inspiration

I was inspired by Pokemon Go and how they used AR to further their brand.

What it does

Our project is an app that uses the camera and AR to draw a disney character on the screen, which you can interact with by talking or taking pictures.

How I built it

We used a pretrained model for the chatbot(openai-gpt), and unity for the front end interface.

Challenges I ran into

We ran into challenges setting up AR in Unity as well as connecting the chatbot model with Unity.

Accomplishments that I'm proud of

The conversation model works very well and is able to hold real conversations with people. The model is also able to adpot a personality, which we can use to represent different disney characters.

What I learned

I learned about how it's possible to train a conversation chatbot using unsupervised machine learning.

What's next for DisneyAR

We would like to add geolocation functionality to the app, which would allow the game to load different characters based on the phone's gps coordinates.