Inspiration

Using Google Gemini for real-time assistance when reading a document.

What it does

Tracks a user's gaze on a document. If the user is stuck, the paragraph is sent to Google Gemini to summarize.

How we built it

Built using WebGazer.js, Python, and Gemini

Challenges we ran into

Unable to use WebGazer.js to identify text to select.

Accomplishments that we're proud of

We have gaze tracking working!

What we learned

Facial recognition and gaze tracking.

What's next for FocusPoint

Properly integrating our gaze tracker with text selector.

Built With

Share this project:

Updates