Abstract
A partially observable Markov decision process (POMDP) is a generalization of a Markov decision process where the states of the model are not completely observable by the decision maker. Noisy observations provide a belief regarding the underlying state, while the decision maker has some control over the progression of the model through the selection of actions. In this article, we introduce POMDPs and discuss the relationship between Markov models and POMDPs. A general POMDP formulation and a wide range of POMDP applications from the literature are also presented.
| Original language | English |
|---|---|
| Title of host publication | Wiley Encyclopedia of Operations Research and Management Science |
| Publisher | wiley |
| Pages | 1-20 |
| Number of pages | 20 |
| ISBN (Electronic) | 9780470400531 |
| ISBN (Print) | 9780470400630 |
| DOIs | |
| Publication status | Published - 1 Jan 2010 |
| Externally published | Yes |
Bibliographical note
Publisher Copyright:© 2010 John Wiley & Sons, Inc. All rights reserved.
Keywords
- applications of POMDP
- Decision making under uncertainty
- hidden MARKOV chain
- MDP
- POMDP
Fingerprint
Dive into the research topics of 'Partially Observable MDPS (POMDPS): Introduction and Examples'. Together they form a unique fingerprint.Cite this
- APA
- Author
- BIBTEX
- Harvard
- Standard
- RIS
- Vancouver