Inspiration
I was recently taking a required training course on GDPR, while I was attentive throughout the video, I was only able to answer the followup Quiz with 60% correctness. And I re-did the video and took some notes, and was able to prefect score. This made me realize that - we often think we understand until we are tested and I thought it would be awesome to democratize contextual Q/A using Generative AI, on any video platform.
What it does
FLATE is a PoE Bot, that can understand any video and generate questions in context to test your knowledge about a particular concept and also attempts to generate anki flash cards which updates reactively.
How we built it
- Built a PoE extension, that can access any youtube transcipt
- Prompt Engineered to Generate Relevant Questions with access to ground truth information from Brave
- Using Firebase Realtime DB to index transcipts and Q/A for state management
Challenges we ran into
- Firebase Integration was complicated and needed some work
- The chrome Extension was difficult to finish
Accomplishments that we're proud of
- A working POE bot that is smart and can do in-context QA
What we learned
- How POE can be leveraged to build useful applications, leveraging existing technologies.
What's next for FLATE
a) Native support on MacOSX b) Re-ranking Anki Cards by Error Rate (Inversely Proportional) c) Notion integration.
Built With
- claude
- fal
- poe
- python
Log in or sign up for Devpost to join the conversation.