Adaptive Dynamic Programming for Control

Adaptive Dynamic Programming for Control

Author: Huaguang Zhang

Publisher: Springer Science & Business Media

ISBN: 9781447147572

Category: Technology & Engineering

Page: 424

View: 401

Download Now
There are many methods of stable controller design for nonlinear systems. In seeking to go beyond the minimum requirement of stability, Adaptive Dynamic Programming in Discrete Time approaches the challenging topic of optimal control for nonlinear systems using the tools of adaptive dynamic programming (ADP). The range of systems treated is extensive; affine, switched, singularly perturbed and time-delay nonlinear systems are discussed as are the uses of neural networks and techniques of value and policy iteration. The text features three main aspects of ADP in which the methods proposed for stabilization and for tracking and games benefit from the incorporation of optimal control methods: • infinite-horizon control for which the difficulty of solving partial differential Hamilton–Jacobi–Bellman equations directly is overcome, and proof provided that the iterative value function updating sequence converges to the infimum of all the value functions obtained by admissible control law sequences; • finite-horizon control, implemented in discrete-time nonlinear systems showing the reader how to obtain suboptimal control solutions within a fixed number of control steps and with results more easily applied in real systems than those usually gained from infinite-horizon control; • nonlinear games for which a pair of mixed optimal policies are derived for solving games both when the saddle point does not exist, and, when it does, avoiding the existence conditions of the saddle point. Non-zero-sum games are studied in the context of a single network scheme in which policies are obtained guaranteeing system stability and minimizing the individual performance function yielding a Nash equilibrium. In order to make the coverage suitable for the student as well as for the expert reader, Adaptive Dynamic Programming in Discrete Time: • establishes the fundamental theory involved clearly with each chapter devoted to a clearly identifiable control paradigm; • demonstrates convergence proofs of the ADP algorithms to deepen understanding of the derivation of stability and convergence with the iterative computational methods used; and • shows how ADP methods can be put to use both in simulation and in real applications. This text will be of considerable interest to researchers interested in optimal control and its applications in operations research, applied mathematics computational intelligence and engineering. Graduate students working in control and operations research will also find the ideas presented here to be a source of powerful methods for furthering their study.
Adaptive Dynamic Programming for Control
Language: en
Pages: 424
Authors: Huaguang Zhang, Derong Liu, Yanhong Luo, Ding Wang
Categories: Technology & Engineering
Type: BOOK - Published: 2012-12-14 - Publisher: Springer Science & Business Media

There are many methods of stable controller design for nonlinear systems. In seeking to go beyond the minimum requirement of stability, Adaptive Dynamic Programming in Discrete Time approaches the challenging topic of optimal control for nonlinear systems using the tools of adaptive dynamic programming (ADP). The range of systems treated
Robust Adaptive Dynamic Programming
Language: en
Pages: 216
Authors: Yu Jiang, Zhong-Ping Jiang
Categories: Science
Type: BOOK - Published: 2017-04-13 - Publisher: John Wiley & Sons

A comprehensive look at state-of-the-art ADP theory and real-world applications This book fills a gap in the literature by providing a theoretical framework for integrating techniques from adaptive dynamic programming (ADP) and modern nonlinear control to address data-driven optimal control design challenges arising from both parametric and dynamic uncertainties. Traditional
Adaptive Dynamic Programming with Applications in Optimal Control
Language: en
Pages: 594
Authors: Derong Liu, Qinglai Wei, Ding Wang, Xiong Yang, Hongliang Li
Categories: Technology & Engineering
Type: BOOK - Published: 2017-01-04 - Publisher: Springer

This book covers the most recent developments in adaptive dynamic programming (ADP). The text begins with a thorough background review of ADP making sure that readers are sufficiently familiar with the fundamentals. In the core of the book, the authors address first discrete- and then continuous-time systems. Coverage of discrete-time
Reinforcement Learning and Approximate Dynamic Programming for Feedback Control
Language: en
Pages: 648
Authors: Frank L. Lewis, Derong Liu
Categories: Technology & Engineering
Type: BOOK - Published: 2013-01-28 - Publisher: John Wiley & Sons

Reinforcement learning (RL) and adaptive dynamic programming (ADP) has been one of the most critical research fields in science and engineering for modern complex systems. This book describes the latest RL and ADP techniques for decision and control in human engineered systems, covering both single player decision and control and
Adaptive Dynamic Programming: Single and Multiple Controllers
Language: en
Pages: 271
Authors: Ruizhuo Song, Qinglai Wei, Qing Li
Categories: Technology & Engineering
Type: BOOK - Published: 2018-12-28 - Publisher: Springer

This book presents a class of novel optimal control methods and games schemes based on adaptive dynamic programming techniques. For systems with one control input, the ADP-based optimal control is designed for different objectives, while for systems with multi-players, the optimal control inputs are proposed based on games. In order