Inspiration

When our group was brainstorming the ideas, we found out how hard it is for us to understand the medicine based on the package. That leads into thinking about the struggle that people with impaired visions and elder people may have. Envision a world where visually impaired and elderly individuals no longer struggle to read medicine labels or depend on others. With MedVision Web, this vision becomes a reality. It offers a straightforward and efficient software solution that scans medication labels and instantly vocalizes the medication name, purpose, and dosage. Together, we're revolutionizing the healthcare experience, ensuring that people of all ages and visual abilities can independently and confidently manage their well-being.

What it does

Users can capture or upload an image of a medicine package label, and our software employs Google Vision AI and Together.AI to scan and extract text from the image. It then provides users with necessary information, including a text-to-speech feature, providing an efficient and user-friendly solution.

How we built it

We built a full-stack application that uses ReactJS for the front end and Python with Flask for the back end. It integrates with various AI services, including Together.AI and Google Cloud and Firebase for database functionality. Additionally, we have attempted to develop a mobile app using Flutter.

Challenges we ran into

As this is our first time implementing a full-stack app using various AI technologies and tools, we had difficulties when integrating their APIs into our app. Thanks to the workshops and mentors, we were able to quickly overcome these challenges and proceed with our work. Even though we developed the front-end and back-end separately, we struggled to integrate them due to time constraints. Also, testing a complex full-stack application with multiple AI services is definitely a challenging process.

Accomplishments that we're proud of

This project involves various parts being developed separately, and the most significant accomplishment we are proud of is successfully integrating all of them and offering impactful features to users.

What we learned

We learned a lot about how to integrate APIs, different creative ideas & tools, collaboration with teams, and finally we had fun!

What's next for MedVision

We believe that MedVision is more than just a project, it's a transformative tool for enhancing public health. Our vision for the future is to create a chatbot which can make health and medication information accessible at users' fingertips. We're dedicated to enhancing the user experience with a responsive design and user authentication, providing a secure environment for users to access a wealth of health resources. We aspire to elevate the health community by pushing the boundaries of innovation and making a positive impact in healthcare technology.

Built With

Share this project:

Updates