In our smart refrigerator system, we developed a deep learning model to recognize 81 different kinds of fruits on photos taken by raspberry pie. Moreover, on top of the model, we used android application to enable better user-system interaction. In general, we realized the function of data collection in photo and weight, fruit recognition, SNS message alert, fruit recommendation and android application.
Through this project, we have become familiar with the full IoT stack, which comprises of a hardware and a cloud layer, obtained a better understanding of deep learning models and got proficient in using various AWS tools. And more importantly, by separating our system into different modules to implement them independently and add them together to make the whole system functional at the final stage, we need to improve teamwork awareness and write more readable codes.
Our further improvement includes apply stronger deep learning models as well as change image recognition into semantic segmentation to make our model more intelligent and reliable. And we can add more functions such as dietary control, nutrition monitoring, eating habit analysis, etc. We are confident that such a smart refrigerator will be an important component in future smart home.
Through this project, we have become familiar with the full IoT stack, which comprises of a hardware and a cloud layer, obtained a better understanding of deep learning models and got proficient in using various AWS tools. And more importantly, by separating our system into different modules to implement them independently and add them together to make the whole system functional at the final stage, we need to improve teamwork awareness and write more readable codes.
Our further improvement includes apply stronger deep learning models as well as change image recognition into semantic segmentation to make our model more intelligent and reliable. And we can add more functions such as dietary control, nutrition monitoring, eating habit analysis, etc. We are confident that such a smart refrigerator will be an important component in future smart home.