Inspiration

Inspired by the challenge we face daily to find pictures on our smartphones. Our phones are flooded with hundreds, even thousands of pictures. Find the picture we are looking for can be a great challenge sometimes, we have to scroll up and down multiple times to find a picture and this takes simply too much time. So we want to make this proccess simple and efficient.

What it does

Our app, SmartView, is an intelligent platform that revolutionizes how users interact with their photo libraries. It allows users to instantly search for pictures by entering words or phrases into the search engine, eliminating the need for tedious scrolling. Additionally, SmartView utilizes the powerful Gemini Pro model to provide additional context for each picture, including the location where the picture was taken and five relevant hashtags based on the content of the picture. The advantage to use hastags is to make it easier to search for a picture. Users can easily navigate their photo collections, saving time and simplifying the process of finding specific images. To use the app, users must register and log in, after which they can upload pictures and effortlessly organize their memories.

How we built it

We built this web app using react node and gemini api.

Challenges we ran into

  • unpredictable nature of generative models.
  • express-session was not able to persist data between requests.

Accomplishments that we're proud of

Use Gemini Pro to translate images into valuable information

What we learned

  • How to use Gemini API with pro vision model.
  • how to handle images on server side
  • fuzzy search

What's next for Smartview

Identify people on the pictures Share the pictures with other users

Share this project:

Updates