Inspiration
The inspiration for this app was to create an app that overlays star data and constellations in virtual reality, in order to create a unique user experience.
What it does
Using the camera, it detects star information
How we built it
The backend uses Java and OpenCV for star detection from camera. We wrote an algorithm from scratch and used machine learning to train the data in order to detect star information from images of stars. The frontend is an Android app.
Challenges we ran into
Initially, we tried using ENCOG library for machine learning, and used EC2 instances to train our data, but because we were writing the machine learning part without using a machine learning API and training it ourselves, we kept running out of RAM and had limited system resources.
Initially we wanted to display the constellation star data on the hololens, but we could not figure out Unity in time as it took a long time to install along with Visual Studio.
Accomplishments that we're proud of
The backend to detect star data was completed relatively quickly.
What we learned
We learned a lot about using new technologies--such as hololens.
What's next for Orrery
More resources to train machine learning algorithm.
Log in or sign up for Devpost to join the conversation.