SCRIBELATE

Inspiration

Upon forming our team, we hopped into a discord call and began discussing project ideas for the NewHacks Hackathon 2023.

We asked ourselves and each other - what's a problem we've all come across? Because to invent solutions, we needed problems.

As students in university, we noticed many international students had trouble understanding what the professor was talking about in English. They'd have to stop listening for a minute just to go on Google Translate and rush to translate the word they thought they heard into their first language. During lecture, too! This would take time and undoubtedly disrupt their learning.

And that's not all - let's admit it, we all zone out during class once in a while. Upon realizing that the prof just went through a crucial concept in class while you were daydreaming, wouldn't you panic and go, "oH NOOO what did they say?!?!?" Wouldn't you think, "Damn, I really wish I was recording this lecture and was able to upload it to a website that transcribed it. aaAAnd maybe translated it as well. And created summary notes from it - oh, and flashcards. So I could use it to study hehe."?

Never fear, for SCRIBELATE's here, to make it clear!

What it does

With SCRIBELATE, you can:

Input a YouTube video URL or upload an mp3/mp4 for transcription.
Transcribe the lecture.
Translate the transcription into your preferred language.
Create summary notes from the transcription.
Generate flashcards based on the transcription.

How we built it

Flask Python Cohere API Google Translate API HTML + CSS

Challenges we ran into

Connecting Front End with Back End
Animations and getting them on the home page
Getting access to and implementing APIs

Accomplishments that we're proud of

Website buttons functionality
Transcription generator using Python
Translation generator using Python
Summary notes generator using Python
Getting the APIs to work
Designing the animations
Using Adobe After Effects to make the glitching effect of the logo

What we learned

How to connect APIs from the backend to the frontend
HTML and CSS
How React can be used to create a chatbot
Mentors are really swag people (thank you for pulling an all-nighter with us)
How to transcribe audio files using python
How to translate English text into multiple languages

What's next for SCRIBELATE

The SCRIBELATE you see here now is nowhere near finished! Future implementations include:

A fully functional and aesthetic summary notes generator
A fully functional and aesthetic flashcards generator which the user can be quizzed on
Expanding our transcription capabilities to handle lectures not exclusively in English, including the recognition and display of mathematical notation
Account authentication for students to save their transcriptions, translations, summary notes, and flashcards for future use
Make use of a URL bar for users to paste a link with an audio or video (e.g. YouTube) into