Planning for large-scale multiagent problems via hierarchical decomposition with applications to UAV health management

Yu Fan Chen, N. Kemal Ure, Girish Chowdhary, Jonathan P. How, John Vian

Araştırma sonucu: Kitap/Rapor/Konferans Bildirisinde BölümKonferans katkısıbilirkişi

16 Atıf (Scopus)

Özet

This paper introduces a novel hierarchical decomposition approach for solving Multiagent Markov Decision Processes (MMDPs) by exploiting coupling relationships in the reward function. MMDP is a natural framework for solving stochastic multi-stage multiagent decision-making problems, such as optimizing mission performance of Unmanned Aerial Vehicles (UAVs) with stochastic health dynamics. However, computing the optimal solutions is often intractable because the state-action spaces scale exponentially with the number of agents. Approximate solution techniques do exist, but they typically rely on extensive domain knowledge. This paper presents the Hierarchically Decomposed MMDP (HD-MMDP) algorithm, which autonomously identifies different degrees of coupling in the reward function and decomposes the MMDP into a hierarchy of smaller MDPs that can be solved separately. Solutions to the smaller MDPs are embedded in an autonomously constructed tree structure to generate an approximate solution to the original problem. Simulation results show HD-MMDP obtains more cumulative reward than that of the existing algorithm for a ten-agent Persistent Search and Track (PST) mission, which is a cooperative multi-UAV mission with more than 1019 states, stochastic fuel consumption model, and health progression model.

Orijinal dilİngilizce
Ana bilgisayar yayını başlığı2014 American Control Conference, ACC 2014
YayınlayanInstitute of Electrical and Electronics Engineers Inc.
Sayfalar1279-1285
Sayfa sayısı7
ISBN (Basılı)9781479932726
DOI'lar
Yayın durumuYayınlandı - 2014
Harici olarak yayınlandıEvet
Etkinlik2014 American Control Conference, ACC 2014 - Portland, OR, United States
Süre: 4 Haz 20146 Haz 2014

Yayın serisi

AdıProceedings of the American Control Conference
ISSN (Basılı)0743-1619

???event.eventtypes.event.conference???

???event.eventtypes.event.conference???2014 American Control Conference, ACC 2014
Ülke/BölgeUnited States
ŞehirPortland, OR
Periyot4/06/146/06/14

Parmak izi

Planning for large-scale multiagent problems via hierarchical decomposition with applications to UAV health management' araştırma başlıklarına git. Birlikte benzersiz bir parmak izi oluştururlar.

Alıntı Yap