Inspiration

I was recently taking a required training course on GDPR, while I was attentive throughout the video, I was only able to answer the followup Quiz with 60% correctness. And I re-did the video and took some notes, and was able to prefect score. This made me realize that - we often think we understand until we are tested and I thought it would be awesome to democratize contextual Q/A using Generative AI, on any video platform.

What it does

FLATE is a PoE Bot, that can understand any video and generate questions in context to test your knowledge about a particular concept and also attempts to generate anki flash cards which updates reactively.

How we built it

  1. Built a PoE extension, that can access any youtube transcipt
  2. Prompt Engineered to Generate Relevant Questions with access to ground truth information from Brave
  3. Using Firebase Realtime DB to index transcipts and Q/A for state management

Challenges we ran into

  1. Firebase Integration was complicated and needed some work
  2. The chrome Extension was difficult to finish

Accomplishments that we're proud of

  1. A working POE bot that is smart and can do in-context QA

What we learned

  1. How POE can be leveraged to build useful applications, leveraging existing technologies.

What's next for FLATE

a) Native support on MacOSX b) Re-ranking Anki Cards by Error Rate (Inversely Proportional) c) Notion integration.

Built With

Share this project:

Updates