A lot is to be excited for when we think of the ever-increasing proclivity for implementing IoT solutions to our day-to-day activities. The prospect of integrating AI powered algorithms and machine learning into connected systems for understanding data collected from the surrounding environment by providing them with various types of sensors and cameras, as is the case in image and object recognition or NLP and voice recognition for example, means that we are heading towards a future of even greater dependency on intelligent connected devices in our daily lives.
In this project we will be automating an iRobot making it respond and execute complex voice commands as well as supplying it with the capability of recognizing its surroundings using a camera and AI-based algorithms for object detection. The iRobot will be able to give useful feedback to the user indicating its progress in executing a certain command or inability to complete it properly due to the surrounding conditions.
The project consists of the following integral parts: Google’s actions console that uses the immense google NLP libraries for voice recognition, NVIDIA Jetson Nano developer kit on which a server and a robot controller are running, and the iRobot create; an interface for serial communication with the iRobot. The robot uses a camera to understand its environment and a mini external USB speaker for vocal feedback.