Deep Reinforcement Learning based Aggressive Collision Avoidance with Limited FOV for Unmanned Aerial Vehicles

Mehmet Hasanzade, Omar Shadeed, Emre Koyuncu, Air Vehicle

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

3 Citations (Scopus)

Abstract

As the novel lightweight sensors become more capable of providing high-level perception abilities to the small unmanned aerial vehicles for a cluttered environment, they require more capable navigation and control methodologies to push the operational limits. Such methods are bounded due to computational power requirements, limits of conservative deterministic methods, or the algorithms utilizing heuristics built upon specialized cases. Considering this discussion, in this work, we develop a trajectory re-planning algorithm for collision avoidance, combining machine learning and deterministic trajectory generation methodologies allowing the small UAVs to navigate in clutter environments aggressively. First, we utilize the deferentially flat model description of the UAVs and define the output flight trajectories through high order B-splines. Local support property of B-spline allows us to generate these evasive maneuvers without regenerating the whole B-spline trajectory, thus grants the aggressiveness. Then, assuming the small UAVs have a limited field of view, to provide instantaneous trajectory segment re-planning, we trained deep reinforcement learning agent for optimal control point reallocation through knot insertion to avoid the sensed obstacles, which also considers the feasability of the newly generated trajectory segment. The deep reinforcement learning agent can generate an optimal solution in 1.2 ms, which offers the fastest solution in the literature and allows it to be utilized on highly agile vehicles. Finally, we focus on real time platform implementations of the algorithm in order to show the performance and to build and perform aggressive collision avoidance maneuvers in highly cluttered environments can bee seen in the following video link: https://youtu.be/8IiLQFQ3V0E.

Original languageEnglish
Title of host publicationAIAA SciTech Forum 2022
PublisherAmerican Institute of Aeronautics and Astronautics Inc, AIAA
ISBN (Print)9781624106316
DOIs
Publication statusPublished - 2022
EventAIAA Science and Technology Forum and Exposition, AIAA SciTech Forum 2022 - San Diego, United States
Duration: 3 Jan 20227 Jan 2022

Publication series

NameAIAA Science and Technology Forum and Exposition, AIAA SciTech Forum 2022

Conference

ConferenceAIAA Science and Technology Forum and Exposition, AIAA SciTech Forum 2022
Country/TerritoryUnited States
CitySan Diego
Period3/01/227/01/22

Bibliographical note

Publisher Copyright:
© 2022, American Institute of Aeronautics and Astronautics Inc.. All rights reserved.

Fingerprint

Dive into the research topics of 'Deep Reinforcement Learning based Aggressive Collision Avoidance with Limited FOV for Unmanned Aerial Vehicles'. Together they form a unique fingerprint.

Cite this