Virtual Reality–Integrated Telepresence Robot for Intelligent Remote Monitoring

Abstract: In the current day and age, telepresence has gained more and more recognition, and individuals cannot be physically present at two or more places simultaneously. Telepresence systems are already being used in surveillance and dangerous places where the lives of individuals are at risk. This project aims to build a gesture-controlled virtual telepresence robot, which can be used in defense, mining, and educational scenarios. The system will include a robot with a camera for real-time video streaming, a VR headset with a smartphone for viewing the video, and gesture-controlled gloves for controlling the robot’s movement. A Raspberry Pi will be used for real-time video streaming over Wi-Fi to the smartphone, which will be inserted into the VR headset. The robot will be controlled with the help of hand gestures, which will be detected with the help of an MPU6050 accelerometer connected to the user’s glove. The gestures will be detected with the help of Arduino Nano over Bluetooth and processed with the help of an Arduino Uno, which will control the robot with the help of a motor driver. A servo motor will be used to rotate the camera up to 180 degrees.

Keywords: virtual telepresence, remote controlled, VR, hand gloves, surveillance.