DermaSkan

Login Screen
Home Screen
Upload Image
Results/Diagnosis
Tech Stack Flowchart
VGG Model
Accuracy Graph
Loss Graph

Inspiration

Nearly 1 out of every 3 Americans suffer from some form of skin disease, a statistic that is alarming and underscores the potential for widespread suffering without proper care. Conditions like skin cancer, if detected early, can be largely preventable. However, in our busy day-to-day lives, we may overlook early signs. Inspired by the prevalence of skin ailments, we aimed to develop a solution that not only monitors these conditions but also provides accurate diagnoses, especially to those who lack access.

What it does

In our app, users can use their device's camera to capture images of their skin. These images are then sent to our backend via our API, which processes them using our VGG Machine Learning model and GPT-API to generate an accurate diagnosis. The resulting information is sent back to the frontend, where users can view their diagnosis. Importantly, this information is securely linked to their account through login authentication, ensuring privacy and security. This approach empowers users to seek necessary medical assistance without concerns about their privacy.

How we built it

We leveraged cutting-edge technology to build our app, starting with a user-friendly frontend designed for easy navigation across all age groups. To ensure secure login authentication, we integrated Firebase into our system. For image storage and user scan tracking, we implemented Firestore, which not only provides robust storage capabilities but also enhances security for our users' personal images. Our choice of Firebase and Firestore reflects our commitment to delivering a secure and reliable experience for our users. Additionally, we developed a VGG (Visual Geometric Group) Model using Google CoLab, achieving an impressive reliability score of 99%. To bring everything together, we seamlessly connected our model with a React frontend and hosted our application on an Apache Server, ensuring a smooth and efficient user experience.

Challenges we ran into

We encountered several challenges during the development process. Utilizing coLab to optimize our model was a significant hurdle, with each iteration taking 30-40 minutes, creating a time-sensitive environment. Additionally, creating our own API presented its own set of difficulties. Furthermore, we faced the task of implementing CRUD operations and ensuring resiliency to adhere fully to the project guidelines. These challenges pushed us to innovate and problem-solve, ultimately strengthening our skills and the quality of our final product.

Accomplishments that we're proud of

We take great pride in our achievements during the hackathon. Despite initial challenges in brainstorming ideas, we successfully pivoted to a new goal, showcasing our adaptability and determination. Our backend development was a significant feat, as we seamlessly integrated a VGG model, GPT-API, and Flask server, demonstrating our advanced technical skills. Furthermore, our minimalist UI design adds a touch of elegance to our app, a feature that we are particularly proud of. Finally, our app stands as a testament to our unwavering passion and commitment. Its creation represents our dedication to going above and beyond, resulting in an impactful product.

What we learned

At the outset, our research into skin conditions revealed their alarming prevalence, deepening our understanding of this medical domain and equipping us with valuable knowledge for the future. During this hackathon, we focused on mastering user authentication, a new area for us, and successfully implemented it using Firebase. Additionally, we delved into the use of a VGG model, learning about its application as we progressed through the project.

What's next for DermaSkan

Exciting developments are on the horizon as we strive to enhance accuracy by expanding our data set. Our upcoming features will revolutionize your skincare routine, offering whole body scans of your skin. Now, even subtle changes won't go unnoticed, ensuring your skin gets the attention it deserves. Our vision extends beyond personal care – we aim to collaborate with pharmaceutical companies to provide tailored suggestions for medical remedies, ensuring your blemishes receive the right solutions. Stay tuned for a comprehensive skincare experience that goes beyond the surface!