-
Chapter and Conference Paper
Autonomous Decision-Making Algorithm for Multi-agent Beyond-Visual-Range Air Combat
Beyond-visual-range air combat is the mainstream form of air combat in modern air battlefields. The decision-making ability of pilots will determine the result of the war. With the development of artificial in...
-
Chapter and Conference Paper
Spiking Adaptive Dynamic Programming with Poisson Process
A new iterative spiking adaptive dynamic programming (SADP) algorithm based on the Poisson process for optimal impulsive control problems is investigated with convergence discussion of the iterative process. F...
-
Book
-
Chapter
Off-Policy Actor-Critic Structure for Optimal Control of Unknown Systems with Disturbances
An optimal control method is developed for unknown continuous time systems with unknown disturbances in this chapter. The integral reinforcement learning (IRL) algorithm is presented to obtain the iterative co...
-
Chapter
Neural-Network-Based Synchronous Iteration Learning Method for Multi-player Zero-Sum Games
In this chapter, a synchronous solution method for multi-player zero-sum (ZS) games without system dynamics is established based on neural network. The policy iteration (PI) algorithm is presented to solve the...
-
Chapter
Neural-Network-Based Approach for Finite-Time Optimal Control
This chapter proposes a novel finite-time optimal control method based on input-output data for unknown nonlinear systems using ADP algorithm. In this method, the single-hidden layer feed-forward (SLFN) with...
-
Chapter
Multi-objective Optimal Control for Time-Delay Systems
A novel multi-objective ADP method is constructed to obtain the optimal controller of a class of nonlinear time-delay systems in this chapter. Using the weighted sum technology, the original multi-objective op...
-
Chapter
Approximation-Error-ADP-Based Optimal Tracking Control for Chaotic Systems
In this chapter, an optimal tracking contrl scheme is proposed for a class of discrete-time chaotic systems using the approximation-error-based ADP algorithm. Via the system transformation, the optimal trackin...
-
Chapter and Conference Paper
A Solution of Two-Person Zero Sum Differential Games with Incomplete State Information
This paper introduces a two-player zero-sum differential game with imperfect state information, focusing on the situation with linear system, quadratic cost functional and state measurement contains white Gaus...
-
Chapter
Off-Policy Integral Reinforcement Learning Method for Multi-player Non-zero-Sum Games
This chapter establishes an off-policy integral reinforcement learning (IRL) method to solve nonlinear continuous-time non-zero-sum (NZS) games with unknown system dynamics. The IRL algorithm is presented to o...
-
Chapter
Introduction
Optimal control is one particular branch of modern control. It deals with the problem of finding a control law for a given system such that a certain optimality criterion is achieved. A control problem include...
-
Chapter
Off-Policy Neuro-Optimal Control for Unknown Complex-Valued Nonlinear Systems
This chapter establishes an optimal control of unknown complex-valued system. Policy iteration (PI) is used to obtain the solution of the Hamilton–Jacobi–Bellman (HJB) equation. Off-policy learning allows the ...
-
Chapter
Optimal Distributed Synchronization Control for Heterogeneous Multi-agent Graphical Games
In this chapter, a new optimal coordination control for the consensus problem of heterogeneous multi-agent differential graphical games by iterative ADP is developed. The main idea is to use iterative ADP tech...
-
Chapter
Optimal Control for a Class of Complex-Valued Nonlinear Systems
In this chapter, an optimal control scheme based on ADP is developed to solve infinite-horizon optimal control problems of continuous-time complex-valued nonlinear systems. A new performance index function is ...
-
Chapter
An Iterative ADP Method to Solve for a Class of Nonlinear Zero-Sum Differential Games
In this chapter, an iterative ADP method is presented to solve a class of continuous-time nonlinear two-person zero-sum differential games. The idea is to use ADP technique to obtain the optimal control pair i...
-
Chapter
Nearly Finite-Horizon Optimal Control for Nonaffine Time-Delay Nonlinear Systems
In this chapter, a novel ADP algorithm is developed to solve the nearly optimal finite-horizon control problem for a class of deterministic nonaffine nonlinear time-delay systems. The idea is to use ADP techni...
-
Chapter
Multiple Actor-Critic Optimal Control via ADP
In industrial process control, there may be multiple performance objectives, depending on salient features of the input-output data. Aiming at this situation, this chapter proposes multiple actor-critic struct...
-
Book
-
Chapter
Erratum to: Self-Learning Optimal Control of Nonlinear Systems
-
Chapter and Conference Paper
Adaptive Critic Designs of Optimal Control for Ice Storage Air Conditioning Systems
In this paper, the optimal control scheme for ice storage air conditioning system is solved via an adaptive critic design method. Adaptive critic design is also called adaptive dynamic programming (ADP). First...