Markov Decision Processes

D. J. White (Author)

9780471936275, Wiley

Hardback, published 22 January 1993

240 pages
24.2 x 16.3 x 2 cm, 0.51 kg

Examines several fundamentals concerning the manner in which Markov decision problems may be properly formulated and the determination of solutions or their properties. Coverage includes optimal equations, algorithms and their characteristics, probability distributions, modern development in the Markov decision process area, namely structural policy analysis, approximation modeling, multiple objectives and Markov games. Copiously illustrated with examples.

A General Framework for Markov Decision Processes.

Algorithms.

Linear Programming Formulations for Markov DecisionProcesses.

Semi-Markov Decision Processes.

Partially Observable and Adaptive Markov Decision Processes.

Further Aspects of Markov Decision Processes.

Some Markov Decision Process Problems, Formulations and OptimalityEquations.

References.

Solutions to Exercises.

Index.

Subject Areas: Business & management [KJ]