The Markov chain approximation methods are used for the numerical solution of nonlinear stochastic control problems in continuous time. This book extends the methods to stochastic systems with delays. It surveys properties of various stochastic dynamical models, including singular control, and those for diffusion and reflected diffusion models
Bibliography
Includes bibliographical references (pages 267-271) and indexes