SummerizeMe

Our Inspiration

We were frustrated with how Quizlet requires a paid subscription to access key features like note cards. We believe learning tools should be accessible to everyone, so we set out to build our own free alternative.

What it does

The app records audio and then turns it into a summary of the audio and a few questions about the transcribed audio in the form of notecards.

How we built it

We started by designing a workflow where an audio file is transcribed into text using Whisper Distilled. Then, BART condenses the transcript into a summary. Finally, T5 Small QG HL generates structured note cards from the summary, which are sent to the iOS app for easy access and review. We then set up an IOS app that records and uploads the audio file to an API and then the API sends the audio to the Python script and then the script sends the file back to the API and back down to the IOS app with the summary and questions.

Challenges we ran into

We had to figure out how to efficiently process audio files while keeping the app relatively fast and user-friendly. Additionally, integrating everything into a smooth mobile experience required careful design and testing.

Accomplishments that we're proud of

We managed to set up 3 AIs that all work together to create studying tools. We also accomplished making an API that communicates with an IOS app and the HPC.

What we learned

Throughout this project, we gained hands-on experience with AI models like Whisper Distilled for transcription, BART for summarization, and T5 Small QG HL for note generation. We also learned how to interact with APIs like FastAPI.