Zylo

Zylo superimposes musical notes onto a xylophone. The aim is to help people learn and play musical instruments easily. As easy as pointing the camera at the xylophone and start playing!.

Comment 3

Inspiration

I've always wanted to learn a music instrument, but never could. It was just too tough. This was the inspiration for Zylo. To make learning an instrument way easier than what exists with the help of AR.

What it does

Zylo is a webgl project that superimposes musical notes directly onto your instrument using your smartphone's camera. All you have to do is point your device at the instrument and play along. It is an intuitive and a fun way to learn music.

How we built it

Thanks to ZapAR's Universal kit for Unity, development was really easy. The ability to test the AR components directly in Unity made testing quick and simple.

Challenges we ran into

Being new to Unity and AR, learning how to use these tools was challenging. But thanks so many tutorials on Youtube, both about Unity and ZapAR, I was able to get over those challenges.

What's next for Zylo

The next step is to build a new way to learn music with the help of AR. Particularly expand the range of instruments to include Piano, drums etc.

Instructions

  1. Scan the QR code on the pitch.com link or open this link directly on your smartphone to open the project.
  2. Hold your phone in landscape mode.
  3. You will see a home screen where you have the choice to select between a physical Xylophone or a Virtual one.
  4. If you have the exact model of Xylophone shown in the Youtube video, select Physical. If not you can choose Virtual.
  5. If you choose Virutal, you'll have to download an android app called Xylophone by Eazy Labs from the Play store.
  6. Next you'll be prompted to select one of the three songs that you want to learn.
  7. After selecting, you have to point your smartphone camera at your Xylophone/App screen. Hold it directly above your instrument/app.
  8. If the notes are too jittery, move your phone closer to the instrument/app. Move your phone around while pointing it at the instrument/app until the notes snap into place.
  9. Tap anywhere on your screen to get the song rolling.
  10. Play the note just as it disappears. You can control the speed of the notes by moving the Tempo slider.

Built With

Share this project:

Updates