Human Shadow Robot

In the rise of Artificial intelligence in last decade, one of the few first successful sectors are the integration of autonomous industrial Robot arms/manipulators in production/manufacturing. As world is going through a pandemic and most of the professionals are working from home to confirm physical distancing. But many of the industries that mostly depends on on-site work like construction, manufacturing etc that are one of the few major foundation of world economy are getting severely effected. This projects aim to develop a system that enables labours to perform works that requires on-site presence remotely with their hand direction command to the robot arm remotely from their home.

In this Project we attempted to develop a system where

hand movement and tries to replicate the movement using a video feed from a Depth(RGB-D) Camera. Cyton 300e , a Robotic Manipulator that has 7 Degree of Freedom which enables it to reach complex angle configuration as the human hand also have 7 Degree of freedom , And Xbox Kinect 2, a RGB-D camera was used to track the human hand. We demonstrated the system in a simulation of a construction site incorporating all the possible vital environmental variable using MATLAB.

Though we could not develop the system to replicate a human hand completely due to time constrain, we were able to use the wrist movement of the human to provide high level command to the robot. we believe the system can be developed to perform tasks that needs on-site physical labour can be performed remotely by field professionals from home integrating the system with virtual reality and IOT solutions .