Inspiration

Studying passively in a learning style that is not well-suited for you can be difficult. As a result, we wanted to create an accessible one-stop shop for students to learn in their preferred learning style.

What it does

ReMinder is a web application where you can study with Pixel, our parrot mascot, in your preferred learning style to help you remember everything! Users can converse directly with Pixel in written or spoken forms to help cover key points from uploaded files or specific topics. Pixel will identify any missing information and guide users towards covering them until the user remembers everything.

How we built it

For the front-end, we used Next.js to create the user end, where they would converse with Pixel. For the back-end, we used Gemini API to create the chat bot itself, and connected that to our front-end using typescript.

Challenges we ran into

When we began building the chatbot, we found out that the chat history was not being saved from both the model and user end. As a result, the model could continuously repeat questions and answers that had already been given. We also ran into some minor issues with the system integration where the model would speak indirectly to the user and also bring up external information that was not provided by the user's inputs.

Accomplishments that we're proud of

Since this was our first time working with Gemini API, we are proud of being able to figure out how to use multiple Gemini API tools, such as reading from a file and having chat history. Additionally, voice was not included within Gemini 1.5 Flash. We went around that by using Web Speech API with React.

What we learned

We learned all the functionalities that come with Gemini API and how to use specific tools, such as text generation and Multimodal Live API.

What's next for ReMinder

We hope to be able to bring in the visual aspect of learning through Gemini API's vision tool to read from non-txt files.

Domain Name: reminder.tech

Table: 14

Built With

Share this project:

Updates