Stochastic Systems: Estimation, Identification, and Adaptive Control (Classics in Applied Mathematics, Series Number 75)

This book provides succinct and rigorous treatment of the foundations of stochastic control; a unified approach to filtering, estimation, prediction, and stochastic and adaptive control; and the conceptual framework necessary to understand current trends in stochastic control, data mining, machine learning, and robotics.

Audience: This book is recommended for those who have been introduced to probability theory and stochastic processes and want to learn more about decision making under uncertainty. It can be used as a one- or two-semester course textbook for advanced undergrad or first-year graduate students.

Contents: Chapter 1: Introduction; Chapter 2: State space models; Chapter 3: Properties of linear stochastic systems; Chapter 4: Controlled Markov chain model; Chapter 5: Input output models; Chapter 6: Dynamic programming; Chapter 7: Linear systems: estimation and control; Chapter 8: Infinite horizon dynamic programming; Chapter 9: Introduction to system identification; Chapter 10: Linear system identification; Chapter 11: Bayesian adaptive control; Chapter 12: Non-Bayesian adaptive control; Chapter 13: Self-tuning regulators for linear systems