We study the Bellman equation in the Wasserstein space arising in the study of mean field control problems, namely stochastic optimal control problems for McKean-Vlasov diffusion processes. Using the standard notion of viscosity solution à la Crandall-Lions extended to our Wasserstein setting, we prove a comparison result under general conditions on the drift and reward coefficients, which coupled with the dynamic programming principle, implies that the value function is the unique viscosity solution of the Master Bellman equation. This is the first uniqueness result in such a second-order context. The classical arguments used in the standard cases of equations in finite-dimensional spaces or in infinite-dimensional separable Hilbert spaces do not extend to the present framework, due to the awkward nature of the underlying Wasserstein space. The adopted strategy is based on finite-dimensional approximations of the value function obtained in terms of the related cooperative n-player game, and on the construction of a smooth gauge-type function, built starting from a regularization of a sharp estimate of the Wasserstein metric; such a gauge-type function is used to generate maxima/minima through a suitable extension of the Borwein-Preiss generalization of Ekeland's variational principle on the Wasserstein space.

MASTER BELLMAN EQUATION IN THE WASSERSTEIN SPACE: UNIQUENESS OF VISCOSITY SOLUTIONS / A. Cosso, F. Gozzi, I. Kharroubi, H. Pham, M. Rosestolato. - In: TRANSACTIONS OF THE AMERICAN MATHEMATICAL SOCIETY. - ISSN 0002-9947. - 377:1(2024 Jan), pp. 31-83. [10.1090/tran/8986]

MASTER BELLMAN EQUATION IN THE WASSERSTEIN SPACE: UNIQUENESS OF VISCOSITY SOLUTIONS

A. Cosso
Primo
;
2024

Abstract

We study the Bellman equation in the Wasserstein space arising in the study of mean field control problems, namely stochastic optimal control problems for McKean-Vlasov diffusion processes. Using the standard notion of viscosity solution à la Crandall-Lions extended to our Wasserstein setting, we prove a comparison result under general conditions on the drift and reward coefficients, which coupled with the dynamic programming principle, implies that the value function is the unique viscosity solution of the Master Bellman equation. This is the first uniqueness result in such a second-order context. The classical arguments used in the standard cases of equations in finite-dimensional spaces or in infinite-dimensional separable Hilbert spaces do not extend to the present framework, due to the awkward nature of the underlying Wasserstein space. The adopted strategy is based on finite-dimensional approximations of the value function obtained in terms of the related cooperative n-player game, and on the construction of a smooth gauge-type function, built starting from a regularization of a sharp estimate of the Wasserstein metric; such a gauge-type function is used to generate maxima/minima through a suitable extension of the Borwein-Preiss generalization of Ekeland's variational principle on the Wasserstein space.
viscosity solutions; Bellman equation; Wasserstein space; comparison theorem; Ekeland's variational principle
Settore MAT/06 - Probabilita' e Statistica Matematica
gen-2024
https://www.ams.org/journals/tran/2024-377-01/S0002-9947-2023-08986-3/home.html
Article (author)
File in questo prodotto:
File Dimensione Formato  
S0002-9947-2023-08986-3.pdf

accesso riservato

Descrizione: Article
Tipologia: Publisher's version/PDF
Dimensione 672.19 kB
Formato Adobe PDF
672.19 kB Adobe PDF   Visualizza/Apri   Richiedi una copia
MKV_Uniq.pdf

accesso aperto

Descrizione: Accepted Paper
Tipologia: Post-print, accepted manuscript ecc. (versione accettata dall'editore)
Dimensione 1.33 MB
Formato Adobe PDF
1.33 MB Adobe PDF Visualizza/Apri
Pubblicazioni consigliate

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/2434/1025887
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 6
  • ???jsp.display-item.citation.isi??? 3
social impact