Mechanisms for collaborative teleoperation with a team of cooperative robots

Purpose – This paper aims to present a teleoperation system that allows one to control a group of mobile robots in a collaborative manner. In order to show the capabilities of the collaborative teleoperation system, it seeks to present a task where the operator collaborates with a robot team to explore a remote environment in a coordinated manner. The system implements human‐robot interaction by means of natural language interfaces, allowing one to teleoperate multiple mobile robots in an unknown, unstructured environment. With the supervision of the operator, the robot team builds a map of the environment with a vision‐based simultaneous localization and mapping (SLAM) technique. The approach is well suited for search and rescue tasks and other applications where the operator may guide the exploration of the robots to certain areas in the map. Design/methodology/approach – In opposition with a master‐slave scheme of teleoperation, an exploration mechanism is proposed that allows one to integrate the commands expressed by a human operator in an exploration task, where the actions expressed by the human operator are taken as an advice. In consequence, the robots in the remote environment choose their movements that improve the estimation of the map and best suit the requirements of the operator. Findings – It is shown that the collaborative mechanism presented is suitable to control a robot team that explores an unstructured environment. Experimental results are presented that demonstrate the validity of the approach. Practical implications – The system implements human‐robot interaction by means of natural language interfaces. The robots are equipped with stereo heads and are able to find stable visual landmarks in the environment. Based on these visual landmarks, the robot team is able to build a map of the environment using a vision‐based SLAM technique. SONAR proximity sensors are used to avoid collisions and find traversable ways. The robot control architecture is based on common object request broker architecture technology and allows one to operate a group of robots with dissimilar features. Originality/value – This work extends the concept of collaborative teleoperation to the exploration of a remote environment using a team of mobile robots.