Fridge Ramsay

Fridge Ramsay is the new innovation of smart fridges. Samsung made a screen on a fridge? We made it so that it's through your phone since the average screen time is 7+ hours per day, now to be 8+.

Comment 2

Inspiration

We always wanted to explore the realm of AI specifically, object detection using OpenCV which was originally a small program that one of our members had created. However, we wanted to utilize it and step it up a notch by implementing a training model to detect objects in this case fruits and vegetables.

What it does

When putting in items inside the fridge, the fridge will know what's inside and give a notification to the user via their phone. The user can also ask details about the current items in the fridge such as the expiration date, nutritional facts, and potential more.

How we built it

Using an Arduino (C++), Object Detection Program (Python, VSC, OpenCV, TensorFlow, NumPy, Kaggle, MatplotLib, Keras modeling, Conv2D). Elgato camera hub and EpocCam. The Arduino handled the hardware aspect of it such as opening the door, turning on the fan and LED. The program handled the object detection which would identify what's inside the fridge which was streamed via IPhone using Elgato camera hub and EpocCam.

Challenges we ran into

Training the model was the hardest challenge that took the whole duration of the project. We were not able to get a dataset large enough since we didn't have enough time. LED was not bright enough for the whole fridge. Unfortunately, we couldn't accomplish the user interface between the fridge and iPhone. The camera wouldn't register the fruits or vegetables at all sometimes or it would mix them up.

Accomplishments that we're proud of

We got it done... but we are proud that we were able to go into this project with little to no knowledge about object detection models.

What we learned

We learned more about machine learning and communication between different platforms such as Arduino IDE and Visual Studio Code via Python, iPhone camera applications and OpenCV

What's next for Fridge Ramsay

What's next is developing an app to communicate in real time between the user and the fridge using Twilio. Making a better dataset by including a variety of more fruits and vegetables. Have Arduino communicate with the program.

Built With

Share this project:

Updates