Yapper V3

Inspiration

I like gaming and one of the problems I encountered was communicating to others from different countries where they don't speak English. Instead of copying each word one by one into a translator, this solution is much more efficient.

What it does

It takes screenshots which then gets put into the OCR API which takes all of the text in the images, and then the text is filtered out to only include languages other than English, where it is then put into the DeepL API to be translated and then outputted back to the user almost in real time.

How we built it

I used the OCR API and DeepL API as well as a lot of help from others.

Challenges we ran into

The OCR API isn't the greatest at taking text form images, which is the main reason why the script isn't working.

Accomplishments that we're proud of

This was the first hackathon that I have competed in, and I'm proud of myself that I tried my very best, even with my limited knowledge in coding, and even thought I wasn't able to make my script work in the 48 hours.

What we learned

CODING IS HARD! Other than the fact that coding is hard, I deepened my knowledge in using different API's, and how to implement them into my projects.

What's next for Yapper V3

TO MAKE IT WORK! In all seriousness though, I think implementing some sort of AI like OpenAI's API can help filter out text in languages other than English from the text that the OCR API takes out of the screenshot. I think that this is a much better method and can potentially fix what is going wrong with my script.

Built With

• python