E-DQN-Based Path Planning Method for Drones in Airsim Simulator under Unknown Environment

Biomimetics (Basel). 2024 Apr 16;9(4):238. doi: 10.3390/biomimetics9040238.

Abstract

To improve the rapidity of path planning for drones in unknown environments, a new bio-inspired path planning method using E-DQN (event-based deep Q-network), referring to introducing event stream to reinforcement learning network, is proposed. Firstly, event data are collected through an airsim simulator for environmental perception, and an auto-encoder is presented to extract data features and generate event weights. Then, event weights are input into DQN (deep Q-network) to choose the action of the next step. Finally, simulation and verification experiments are conducted in a virtual obstacle environment built with an unreal engine and airsim. The experiment results show that the proposed algorithm is adaptable for drones to find the goal in unknown environments and can improve the rapidity of path planning compared with that of commonly used methods.

Keywords: E-DQN; airsim; biological inspiration; drone; reinforcement learning; unreal engine.