Inspiration

We tend to take a lot of screenshots throughout the day in order to remember. Especially academic papers, clothes/shoes, and restaurants.

What it does

Curait allows users to takes pictures/screenshots and remember them. The user can then recall what they need and the assistant will take action on the users behalf based on the request. This in turn creates a knowledge base of the users preferences saved as memories. Creating a hyper-personalized everyday assistant.

Three Main Commands: "Remember this" - tells the assistant to remember this specific thing you mentioned/showed. "Recall" - User gives a vague description of what they want to remember and Curait can bring up the relevant memory. "Purchase on amazon" - purchase a something on the users behalf.

How we built it

We built this python, Langchain to handle message history and output handling, and LlamaIndex for ingesting and storing memories and RAG.

Challenges we ran into

LlamaIndex imports were the main challenge.

Accomplishments that we're proud of

Hacking together this recall assistant without previous knowledge of LlamaIndex and Langchain.

What we learned

Which imports to use and how to use MultiOn api.

What's next for Curait

Not sure well see

Built With

Share this project:

Updates