Control of a Drone in Virtual Reality Using MEMS Sensor Technology and Machine Learning

Micromachines (Basel). 2022 Mar 26;13(4):521. doi: 10.3390/mi13040521.

Abstract

In recent years, drones have been widely used in various applications, from entertainment, agriculture, their use in photo and video services, military applications and so on. The risk of accidents while using a drone is quite high. To meet this risk, the most important solution is to use a device that helps and simplifies the control of a drone; in addition, the training of drone pilots is very important. To train the drone pilots, both physical and virtual environments can be used, but the probability of an accident is higher for beginners, so the safest method is to train in a virtual environment. The aim of this study is to develop a new device for controlling a drone in a virtual environment. This device is attached to the upper limb of the person involved in the control of that drone. For precise control, the newly created device uses MEMS sensor technology and artificial intelligence-specific methods.

Keywords: MEMS sensors; accelerometer; gyroscope; machine learning; magnetometer; sensors fusion; virtual reality.