Cameras and visual systems are an excellent way to close a control loop on robotics systems, giving greater precision than when just using motor feedback. For the system to be accurate, the camera needs to be calibrated so that its pose in relation to the robot base is known and this must be done whenever the camera is moved, which is very time consuming when done manually.
In this project you will create a system to automatically calibrate an Intel realsense camera and a Franka Panda robot arm. The project will be developed using robot operating system (ROS) on a simulation and with the end goal for the project to be implemented on a real robot arm that is in our lab!Brains and software: Jetson nano, ROS