Abstract
In this paper, feedback laws for a class of infinite horizon control problems under state constraints are investigated. We provide a two-player game representation for such control problems assuming time-dependent dynamics and Lagrangian and the set constraints merely compact. Using viability results recently investigated for state constrained problems in an infinite horizon setting, we extend some known results for the linear-quadratic regulator problem to a class of control problems with nonlinear dynamics in the state and affine in the control. Feedback laws are obtained under suitable controllability assumptions.
Similar content being viewed by others
Data availability
Not applicable.
References
Anderson BDO, Moore JB (1971) Linear optimal control. Prentice-Hall Inc, Englewood Cliffs, N.J
Aubin J-P (1991) Viability Theory. Birkhäuser Boston
Aubin J-P, Frankowska H (2009) Set-valued analysis. Modern Birkhäuser classics
Basco V, Cannarsa P, Frankowska H (2018) Necessary conditions for infinite horizon optimal control problems with state constraints. Math Control Relat Fields 8(3 &4):535–555
Basco V, Cannarsa P, Frankowska H (2019) Semiconcavity results and sensitivity relations for the sub-Riemannian distance. Nonlinear Anal 184:298–320
Basco V, Frankowska H (2019) Hamilton–Jacobi–Bellman equations with time-measurable data and infinite horizon. Nonlinear Differ Equ Appl 26(1):7
Basco V, Frankowska H (2019) Lipschitz continuity of the value function for the infinite horizon optimal control problem under state constraints. In: Alabau-Boussouira F et al. (Eds) Trends in control theory and partial differential equations, Springer INdAM Series
Bensoussan A, Da Prato G, Delfour MC, Mitter SK (2006) Representation and control of infinite dimensional systems. Birkhauser
Brezis H (2010) Functional analysis, Sobolev spaces and partial differential equations. Springer
Cannarsa P, Frankowska H (2018) Value function, relaxation, and transversality conditions in infinite horizon optimal control. J Math Anal Appl 457(2):1188–1217
Cannarsa P, Gazzola F (2021) Dynamic optimization for beginners. EMS press
Carlson DA, Haurie A (1987) Infinite horizon optimal control: theory and applications. Springer-Verlag, New York Inc
Curtain RF, Pritchard AJ (1978) Infinite dimensional linear systems theory. Springer-Verlag, Berlin, New York
Da Prato G, Ichikawa A (1987) Optimal control of linear systems with almost periodic inputs. SIAM J Control Optim 25(4):1007–1019
Da Prato G, Ichikawa A (1988) Quadratic control for linear periodic systems. Appl Math Optim 18(1):39–66
Dower PM, Cantoni M (2017) State constrained optimal control of linear time-varying systems. In: 2017 IEEE 56th annual conference on decision and control (CDC), IEEE, pp 1338–1343
Dower PM, McEneaney WM, Cantoni M (2023) A game representation for a finite horizon state constrained continuous time linear regulator problem. Appl Math Optim 88:19
Dower PM, McEneaney WM, Cantoni M (2016) A game representation for state constrained linear regulator problems. In: proceeding 55th IEEE conference on decision & control (Las Vegas NV, USA), pp 1074–1079
Frankowska H, Plaskacz S, Rzeżuchowski T (1995) Measurable viability theorems and the Hamilton–Jacobi–Bellman equation. J Diff Equ 116(2):265–305
Khalil HK (2002) Nonlinear systems, 2nd edn. Prentice Hall
Rockafellar RT (1970) Conjugate convex functions in optimal control and the calculus of variations. J Math Anal Appl 32(1):174–222
Rockafellar RT (1974) Conjugate duality and optimization. In: SIAM Regional Conference Series in Applied Math, 16
Rockafellar RT, and Goebel R (2008) Linear-convex control and duality. In: geometric control and nonsmooth analysis: in honor of the 73rd birthday of H Hermes and of the 71st birthday of RT Rockafellar. World Scientific
Rockafellar RT, Wets RJB (1998) Variational analysis. Springer-Verlag, Berlin
Seierstad A, Sydsæter K (1987) Optimal control theory with economic applications. North-Holland Publishing Co., Amsterdam
Soner HM (1986) Optimal control problems with state-space constraints I. SIAM J Control Optim 24:552–562
Vinter RB (2000) Optimal control. Birkhäuser, Boston, MA
Vinter RB, Pappas G (1982) A maximum principle for nonsmooth optimal-control problems with state constraints. J Math Anal Appl 89(1):212–232
Acknowledgements
The authors are indebted to the review for the helpful comments provided on an earlier draft during in the peer-review process.
Funding
Peter M. Dower is partially supported by AFOSR grants FA2386-16-1-4066 and FA2386-22-1-4074.
Author information
Authors and Affiliations
Contributions
VB is the main and the corresponding author. PMD is the co-author having supervised the work.
Corresponding author
Ethics declarations
Conflict of interest
Financial interests: The authors declare they have no financial interests.
Ethical approval
Not applicable.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
A preliminary version of this manuscript appears in ar**v:1912.08554 and an abbreviated version was accepted to be published in the proceedings of the 2020 American Control Conference. This research is partially supported by AFOSR grant FA2386-16-1-4066.
Appendix
Appendix
Lemma A.1
Adopt the assumptions of Lemma 4.6, and assume that A and B are locally absolutely continuous and \(B\in L^\infty (t,T;\mathbb {R}^{n\times m})\). Then, there exists \(\beta >0\) such that for all \(x\in \Omega \) and \(\sigma >0\) we can find \(\xi ^\sigma (\cdot )\) feasible for (3.2) on [t, T], with \(\xi ^\sigma (t)=x\), satisfying
Proof
We take the same notation as in the proof of Lemma 4.6. We show the following claim: There exist \(\varepsilon >0\) and \(\eta >0\) satisfying for all \( (s,x) \in [t, T] \times (\partial \Omega +\eta \mathbb {B}) \cap \Omega \) and all \( y \in (x+\varepsilon \mathbb {B}) \cap \Omega \)
Notice that for any \((s,x) \in [t, T] \times \partial \Omega \) and from the characterization of the interior of the Clarke tangent cone (cfr [3]), we can find \(\varepsilon \in (0,1)\) such that \(y+[0, \varepsilon ]({\hat{f}}(s,x)+2 \varepsilon \mathbb {B}) \subset \Omega \) for all \(y \in (x+2 \varepsilon \mathbb {B}) \cap \Omega \). Now, take any \({\tilde{y}} \in \left( \tilde{x}+\varepsilon \mathbb {B}\right) \cap \Omega .\) Then, since \(\tilde{x}+\varepsilon \mathbb {B} \subset x+2 \varepsilon \mathbb {B}\) and \(|{\hat{f}}({\tilde{t}},{\tilde{x}}) |\le |{\hat{f}}(s,x)|+\varepsilon ,\) we may conclude \( {\tilde{y}}+[0, \varepsilon ]\left( {\hat{f}}(\tilde{t},{\tilde{x}})+\varepsilon \mathbb {B}\right) \subset \Omega \) for all \({\tilde{y}} \in \left( {\tilde{x}}+\varepsilon \mathbb {B}\right) \cap \Omega \). So, we have shown that for any \((s,x) \in [t, T] \times \partial \Omega \) there exist \( \varepsilon _{s,x} \in (0,1)\) and \(\delta _{s,x} \in \left( 0, \varepsilon _{s,x}\right] \) such that, given any \(\left( {\tilde{t}}, {\tilde{x}}\right) \in \left( (s,x)+\delta _{s,x} \mathbb {B}\right) \cap ([t, T] \times \Omega ),\)
Using a compactness argument, we conclude that there exist \(\left( t_{i}, x_{i}\right) \in [t, T] \times \partial \Omega \) and \(0<\delta _i<\varepsilon _i\), for \(i\in \{1,...,N\}\), such that \( [t, T] \times \partial \Omega \subset \bigcup _{i=1}^{N}\left( \left( t_{i}, x_{i}\right) +\delta _{i} \text {int}\,\mathbb {B}\right) \), and, for any \(\left( {\tilde{t}}, \tilde{x}\right) \in \left( \left( t_{i}, x_{i}\right) +\delta _{i} \mathbb {B}\right) \cap ([t, T] \times \Omega ),\)
Notice also that there exists \(\eta \in \left( 0, \min _{i} \delta _{i}\right) \) satisfying \( [t, T] \times (\partial \Omega +\eta \mathbb {B}) \subset \bigcup _{i=1}^{N}((t_{i}, x_{i})\) \(+\delta _{i} \text {int}\,{B}) \). (Otherwise we could find a sequence of points \(\left( s_{j}, y_{j}\right) \notin \bigcup _{i=1}^{N}\left( \left( t_{i}, x_{i}\right) +\delta _{i} \mathbb {B}\right) \) such that \(\left( s_{j}, y_{j}\right) \rightarrow (s, y) \in [t, T] \times \partial \Omega \).) The claim (A.2) just follows taking \(\varepsilon =\min _{i} \varepsilon _{i}\). Consider now the following differential inclusion
where \(G(s,x)\doteq \{ f_0(s,x)+f_1(s,x)u\,:\, |u|\le \left\| B^\top P \right\| _{\infty ,[t,T]}\left\| h \right\| _{\infty ,\Omega }\}\) and \(f_0,f_1\) are as in (4.1). Notice that \({\hat{f}}(s,x)\in G(s,x)\) for any \((s,x)\in [t,T]\times \mathbb {R}^n\) and the trajectory \(\xi (\cdot )\) is a solution of (A.3) with \( u(s)=-B^\top (s)P(s)h(\xi (s))\). Moreover, \(\sup \{|v|\,:\, v\in G(s,x), s\in [t,T],x\in (\partial \Omega +\mathbb {B})\} =M<\infty \) and there exists \(\lambda \in L^1([t,T];{\mathbb {R}}^+)\) such that \(G(s,x)\subset G(s',x)+\int _s^{s'} \lambda (\tau )d\tau \) for all \(t\le s<s'\le T\) and \(x\in \Omega \). So, arguing in analogous way as in [7, Theorem 1] and using (A.2), we conclude that there exists \(\beta >0\) (depending on the time interval [t, T]) such that for any \(x\in \Omega \) and any \(\sigma >0\) there is a feasible trajectory \(\xi ^\sigma (\cdot )\), solving (A.3) on [t, T] and starting from x, that satisfies (A.1). Hence, the conclusion follows by applying the measurable selection theorem. \(\square \)
Rights and permissions
Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Basco, V., Dower, P.M. A two-player game representation for a class of infinite horizon control problems under state constraints. Math. Control Signals Syst. (2024). https://doi.org/10.1007/s00498-024-00380-x
Received:
Accepted:
Published:
DOI: https://doi.org/10.1007/s00498-024-00380-x