Inspiration
We wanted to build something that would aid children in their education and learning process
What it does
Using the phone's camera we built an AR system that would automatically scan for words and if it would match any of our pre-defined words a 3D Model representation of that word would appear in the AR
How we built it
We used Unity3D and Vuforia
Challenges we ran into
- Vuforia requires that you build 3D Models on Image Tracker which are usually grayscale images but we wanted to use words instead
- We wanted to select a word out of a paragraph of multiple words and identify successfully
- We wanted to be able to identify multiple words at the same time and generate multiple models
Accomplishments that we're proud of
We were able to have multiple models generated for multiple words, but as the models collided with each other we fell back to single models
What we learned
We learned new techniques to work with AR and the Unity3D and Vuforia packages
What's next for TextRecognitionAR
Multiword 3D modelling in space to better represent the models
Log in or sign up for Devpost to join the conversation.