Continuous Transfer Learning for UAV Communication-Aware Trajectory Design

Chenrui Sun*, Gianluca Fontanesi, Swarna Bindu Chetty*, Xuanyu Liang*, Berk Canberk, Hamed Ahmadi*

*Bu çalışma için yazışmadan sorumlu yazar

Araştırma sonucu: Kitap/Rapor/Konferans Bildirisinde BölümKonferans katkısıbilirkişi

2 Atıf (Scopus)

Özet

Deep Reinforcement Learning (DRL) emerges as a prime solution for Unmanned Aerial Vehicle (UAV) trajectory planning, offering proficiency in navigating high-dimensional spaces, adaptability to dynamic environments, and making sequential decisions based on real-time feedback. Despite these advantages, the use of DRL for UAV trajectory planning requires significant retraining when the UAV is confronted with a new environment, resulting in wasted resources and time. Therefore, it is essential to develop techniques that can reduce the overhead of retraining DRL models, enabling them to adapt to constantly changing environments. This paper presents a novel method to reduce the need for extensive retraining using a double deep Q network (DDQN) model as a pre-trained base, which is subsequently adapted to different urban environments through Continuous Transfer Learning (CTL). Our method involves transferring the learned model weights and adapting the learning parameters, including the learning and exploration rates, to suit each new environment's specific characteristics. The effectiveness of our approach is validated in three scenarios, each with different levels of similarity. CTL significantly improves learning speed and success rates compared to DDQN models initiated from scratch. For similar environments, Transfer Learning (TL) improved stability, accelerated convergence by 65%, and facilitated 35% faster adaptation in dissimilar settings.

Orijinal dilİngilizce
Ana bilgisayar yayını başlığıProceedings - 11th International Conference on Wireless Networks and Mobile Communications, WINCOM 2024
EditörlerSyed Ali Raza Zaidi, Khalil Ibrahimi, Mohamed El Kamili, Abdellatif Kobbane, Nauman Aslam
YayınlayanInstitute of Electrical and Electronics Engineers Inc.
ISBN (Elektronik)9798350377866
DOI'lar
Yayın durumuYayınlandı - 2024
Harici olarak yayınlandıEvet
Etkinlik11th International Conference on Wireless Networks and Mobile Communications, WINCOM 2024 - Leeds, United Kingdom
Süre: 23 Tem 202425 Tem 2024

Yayın serisi

AdıProceedings - 11th International Conference on Wireless Networks and Mobile Communications, WINCOM 2024

???event.eventtypes.event.conference???

???event.eventtypes.event.conference???11th International Conference on Wireless Networks and Mobile Communications, WINCOM 2024
Ülke/BölgeUnited Kingdom
ŞehirLeeds
Periyot23/07/2425/07/24

Bibliyografik not

Publisher Copyright:
© 2024 IEEE.

Parmak izi

Continuous Transfer Learning for UAV Communication-Aware Trajectory Design' araştırma başlıklarına git. Birlikte benzersiz bir parmak izi oluştururlar.

Alıntı Yap