Front Matter; Introduction; Discretetimemarkovdecisionprocesses: Total Reward; Discretetimemarkovdecisionprocesses: Average Criterion; Continuous Time Markov Decision Processes; Semi-Markov Decision Processes; Markovdecisionprocessesinsemi-Markov Environments; Optimal control of discrete event systems: I; Optimal control of discrete event systems: II; Optimal replacement under stochastic Environments; Optimalal location in sequential online Auctions; Back Matter
Summary
Examines Markov decision processes (MDPs) - also called stochastic dynamic programming - and their applications in the optimal control of discrete event systems (DESs), optimal replacement, and optimal allocations in sequential online auctions. This book offers applications of MDPs in areas such as the control of discrete event systems