WakeUpJoe

Inspiration

Smart home automation using VR

What it does

Transform your mornings with our VR interface! Seamlessly blend your smart closet with an intuitive task list, simplifying your routine and enhancing your day. Step into a virtual world where organization meets efficiency, setting the tone for a productive day ahead.

How we built it

Using a Quest 2 as a UI, we designed a morning routine system using an HDK to send commands to our VR world that we programmed using python and HTML, and Java.

Challenges we ran into

First, we tried using the Qualcomm Neural Processing SDK to run an example TensorFlow model, but even though we were able to get the app to compile and load, we ran into many Python dependency issues converting the model to Qualcomm's DLC format.

Then, we tried using the TensorFlow Lite runtime with their AudioClassifier, but although we were also able to get it loaded onto the HDK as well, we were running out of time to collect a dataset (would need about 200 samples!) for transfer training of their model.

It was also difficult to integrate shuffling of closet suggestions to the NLP.