Abstract
We study the optimal control of discrete time mean filed dynamical systems under partial observations. We express the global law of the filtered process as a controlled system with its own dynamics. Following a dynamic programming approach, we prove a verification result providing a solution to the optimal control of the filtered system. As an application, we consider a general linear quadratic example for which an explicit solution is given. We also describe an algorithm for the numerical approximation of the optimal value and provide numerical experiments on a financial example.
Similar content being viewed by others
References
Ahmed, N.U., Ding, X.: Controlled McKean-Vlasov equations. Commun. Appl. Anal. 5, 183–206 (2001)
Andersson, D., Djehiche, B.: A maximum principle for sdes of mean-field type. Appl. Math. Optim. 63, 341–356 (2010)
Bensoussan, A., Frehse, J., Yam, P.: The master equation in mean-field theory. Journal de Math ématiques Pures et Appliqées 103(6), 1441–1474 (2015)
Buckdahn, R., Djehiche, B., Li, J.: A general maximum principle for sdes of mean-field type. Appl. Math. Optim. 64(2), 197–216 (2011)
Carmona, R., Delarue, F.: Forward-backward stochastic differential equations and controlled McKean-Vlasov dynamics. Ann. Probab. 43(5), 2647–2700 (2015)
Elliott, R., Li, X., Ni, Y.-H.: Discrete time mean-field stochastic linear-quadric optimal control problems. Automatica 49, 3222–3233 (2013)
Elliott, R.J., Aggoun, L., Moore, J.B.: Hidden Markov Models, Estimation and Control, volume 29 of Stochastic Modelling and Applied Probability. (Springer, Berlin, 1995)
Gompers, P.A., Lerner, J.: Risk and reward in private equity investments: the challenge of performance assessment. J. Private Equity 5–12 (1997)
Gourier, E., Phalippou, L., Westerfield, M.M.: Capital Commitment. CEPR Discussion Paper No. DP16910, (2022)
Guyon, J., Henry-Labordère, P.: Nonlinear Option Pricing. CRC Press, New York (2013)
Huang, J., Li, X., Yong, J.: A linear-quadratic optimal control problem for mean-field stochastic differential equations in infinite horizon. Math. Control Related Fields 5(1) (2015)
Huang, M., Malhamé, R.P., Caines, P.E.: Large population stochastic dynamic games: closed-loop McKean-Vlasov systems and the nash certainty equivalence principle. Commun. Inf. Syst. 6(3), 221–252 (2006)
Lasry, J.-M., Lions, Pierre-Louis.: Mean-field games. Jpn. J. Math. 2, 229–260 (2007)
Meyer-Brandis, T., Oksendal, B., Zhou, X.Y.: A mean field stochastic maximum principle via Malliavin calculus. Stochastics Int. J. Prob. Stochastic Process. 84(5) (2010)
Pagès, G.: Numerical Probability. Springer, New York (2018)
Pham, H.: Portfolio optimization under partial observation: theoretical and numerical aspects. Handbook of Nonlinear Filtering, (2011)
Pham, H., Wei, X.: Discrete time McKean-Vlasov control problem: a dynamic programming approach. Appl. Math. Optim. 74(3), 487–506 (2016)
Pham, H., Wei, X.: Bellman equation and viscosity solutions for mean-field stochastic control problem. ESAIM: COCV 24(1), 437–461 (2018)
Roméo, T., Ernest, T.: Illiquidity and Investment Decisions: A Survey. Working Paper, (2018)
Funding
The second author gratefully acknowledge financial support from the Agence Nationale de la Recherche (ReLISCoP Grant ANR-21-CE40-0001).
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of interest
The authors certify that they have no interest directly or indirectly related to the work submitted for publication.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Chichportich, J., Kharroubi, I. Discrete-Time Mean-Field Stochastic Control with Partial Observations. Appl Math Optim 88, 90 (2023). https://doi.org/10.1007/s00245-023-10068-4
Accepted:
Published:
DOI: https://doi.org/10.1007/s00245-023-10068-4