Warvis

Warvis in action

Inspiration

Being Marvel fans, we have always wanted to design our suits and be superheroes, but, due to a lack of resources, we decided to build our own Jarvis, but on Windows, hence, Warvis!

What it does

Warvis is a personal assistant that is designed to simplify your daily tasks and keep you informed, Warvis can respond to your commands, provide instant access to information from your daily schedules, play your favorite music, and even check, create and send emails. These are done with LlamaIndex fetching content from various applications and storing them as documents. These documents are then split into chunks, converted into vectors and stored in the vector storage database. Upon obtaining user input, the query is placed in the database where it pulls the context of the question. Only after this is the data (query+context) fed into the large language model, which then generates an apt response for the user.

How we built it

Our application comprises of a website built using HTML, CSS and Vanilla JS, cross-platform mobile application using Flutter and Dart, backend using Python incorporating FastAPI, Retrieval Augmented Generation using LlamaIndex, and ChatGPT 3.5 turbo.

Challenges we ran into

We built several data loaders and tools from Llama Hub. Since LlamaIndex is still relatively new, the documentation and support available is minimal. Hence, it was challenging using these loaders along with integrating various API such as Gmail, Discord, Calender, etc.

Accomplishments that we're proud of

We're very proud of the way it turned out to be. With all the challenges we faced in the making of Warvis, there were moments we almost gave up and believed we would not be able to get it working in 24 hours, but we very proudly say that all our hard work paid off.

What we learned

We learned a great deal about Dart, flutter, llamaIndex, llamaHub, and GitHub CoPilot. We also explored multiple new features and libraries in the programming languages we already knew. On top of these, we learned to be patient and trust the process.

What's next for Warvis

What's next for Warvis is voice recognition and speech recognition, once we have that set up and working efficiently, we want Warvis to be an Independent machine. We want it to be a big transparent glass touch screen computer in itself, assisting people in every possible way.