HandTyped

• 

  Hand Typed

Inspiration

In a world with a growing amount of digitalized communication, it might be a more reasonable idea to also keep your notes digitally. Our project serves to give users a way to easily convert handwritten notes into a digital format that's easy to share and view from devices.

What it does

HandTyped is a web app that provides an easy way to convert Handwritten Notes into a digital PDF file

How we built it

We hosted our backend using Google Cloud Compute Engine for a python Flask API which used Google's Vision API and a text to speech model whereas the frontend was built using Wix Velo

Challenges we ran into

One of the big challenges for this application is trying to tell the difference between page elements such as headers, footers, graphs, etc. We overcame such difficulties by using word position and location data provided by the API, by coding highly probable scenarios where such elements would exist, such that titles usually consist of upper case letters in close proximity or where page numbers would usually appear in a smaller font size located in a corner. While this is not an ideal scenario as there are cases where a title or paragraph can be misplaced, in most cases our algorithm worked fine.

Accomplishments that we're proud of

We are proud to have released a working prototype of our project while having acquired many new skills while building this project.

What we learned

Before starting this project we had little to no experience working with Google Cloud API, and it was a big learning experience for us to build a project around this tool by using its text recognition. Also working with unfamiliar python libraries such as pyFPDF, and gtts and using many of their features made it a unique learning opportunity.

Built With

• google-cloud
• python
• wix