Inspiration
It's hard for a live artist to get feed-back from "introvert" people, which typically stand in the audience but won't cheer like the more extrovert guys. So we wanted to give these people a way to show their appreciation, using a cool stuffed toy, combined with an AR app and a stage display.
What it does
Uniscore is a project developed to enrich the experience of the audience at concerts, especially for introvert people. The people can give feedback to the musicians using their smartphone and a unicorn plush with a specific tag. The smartphone's camera is directed to the plush and when it is detected, a halo appears around it. People can show their appreciation by raising more or less the plush in front of the camera. Then, a rainbow grows in the bottom of the screen. When the rainbow is complete with all its colors, a running unicorn runs over the rainbow. Simultaneously, some OSC messages are sent back to the musician and might control an additional track (in this case it triggers the sound of a running unicorn). Some markers in the musician's software do also trigger the apparition of specific pictures related to the universe of magic and fairies over the unicorn.
How we built it
We used Unity and Vuforia for the AR app, NodeJS for the server backend, and Reaper + Reactor Blocks for the live music.
Challenges we ran into
Connecting to a Philips Hue Light. We wanted to show a more "subtle" way of giving feedback to the artist, by just lighting up a bulb. But the light we got didn't connect to it's base station.
Accomplishments that we're proud of
Making some nice music for the demo. Developing a functional augmented reality setup, already submitted to Google Play Store (iOS app is ready, too, but requires Apple's acceptance). Creating great drawings for the augmented reality.
What we learned
Composing very quickly a track in a musical style which we were totally unused to.
What's next for Uniscore
Turn this into a cool product that can be offered to event agencies. Add more options for feed-back.
Log in or sign up for Devpost to join the conversation.