arrow
Volume 19, Issue 2-3
Reduced Approach for Stochastic Optimal Control Problems

Liuhong Chen, Meixin Xiong & Ju Ming

Int. J. Numer. Anal. Mod., 19 (2022), pp. 237-254.

Published online: 2022-04

Export citation
  • Abstract

In this paper, we develop and analyze the reduced approach for solving optimal control problems constrained by stochastic partial differential equations (SPDEs). Compared to the classical approaches based on Monte Carlo method to the solution of stochastic optimal control and optimization problems, e.g. Lagrange multiplier method, optimization methods based on sensitivity equations or adjoint equations, our strategy can take best advantage of all sorts of gradient descent algorithms used to deal with the unconstrained optimization problems but with less computational cost. Specifically, we represent the sample solutions for the constrained SPDEs or the state equations by their associated inverse-operators and plug them into the objective functional to explicitly eliminate the constrains, the constrained optimal control problems are then converted into the equivalent unconstrained ones, which implies the computational cost for solving the adjoint equations of the derived Lagrange system is avoided and faster convergent rate is expected. The stochastic Burgers’ equation with additive white noise is used to illustrate the performance of our reduced approach. It no doubt has great potential application in stochastic optimization problems.

  • AMS Subject Headings

35Q30, 65N30, 93E20

  • Copyright

COPYRIGHT: © Global Science Press

  • Email address
  • BibTex
  • RIS
  • TXT
@Article{IJNAM-19-237, author = {Chen , LiuhongXiong , Meixin and Ming , Ju}, title = {Reduced Approach for Stochastic Optimal Control Problems}, journal = {International Journal of Numerical Analysis and Modeling}, year = {2022}, volume = {19}, number = {2-3}, pages = {237--254}, abstract = {

In this paper, we develop and analyze the reduced approach for solving optimal control problems constrained by stochastic partial differential equations (SPDEs). Compared to the classical approaches based on Monte Carlo method to the solution of stochastic optimal control and optimization problems, e.g. Lagrange multiplier method, optimization methods based on sensitivity equations or adjoint equations, our strategy can take best advantage of all sorts of gradient descent algorithms used to deal with the unconstrained optimization problems but with less computational cost. Specifically, we represent the sample solutions for the constrained SPDEs or the state equations by their associated inverse-operators and plug them into the objective functional to explicitly eliminate the constrains, the constrained optimal control problems are then converted into the equivalent unconstrained ones, which implies the computational cost for solving the adjoint equations of the derived Lagrange system is avoided and faster convergent rate is expected. The stochastic Burgers’ equation with additive white noise is used to illustrate the performance of our reduced approach. It no doubt has great potential application in stochastic optimization problems.

}, issn = {2617-8710}, doi = {https://doi.org/}, url = {http://global-sci.org/intro/article_detail/ijnam/20479.html} }
TY - JOUR T1 - Reduced Approach for Stochastic Optimal Control Problems AU - Chen , Liuhong AU - Xiong , Meixin AU - Ming , Ju JO - International Journal of Numerical Analysis and Modeling VL - 2-3 SP - 237 EP - 254 PY - 2022 DA - 2022/04 SN - 19 DO - http://doi.org/ UR - https://global-sci.org/intro/article_detail/ijnam/20479.html KW - SPDEs-constrained optimization problems, Lagrange multiplier method, the reduced approach, Monte Carlo finite element method. AB -

In this paper, we develop and analyze the reduced approach for solving optimal control problems constrained by stochastic partial differential equations (SPDEs). Compared to the classical approaches based on Monte Carlo method to the solution of stochastic optimal control and optimization problems, e.g. Lagrange multiplier method, optimization methods based on sensitivity equations or adjoint equations, our strategy can take best advantage of all sorts of gradient descent algorithms used to deal with the unconstrained optimization problems but with less computational cost. Specifically, we represent the sample solutions for the constrained SPDEs or the state equations by their associated inverse-operators and plug them into the objective functional to explicitly eliminate the constrains, the constrained optimal control problems are then converted into the equivalent unconstrained ones, which implies the computational cost for solving the adjoint equations of the derived Lagrange system is avoided and faster convergent rate is expected. The stochastic Burgers’ equation with additive white noise is used to illustrate the performance of our reduced approach. It no doubt has great potential application in stochastic optimization problems.

Liuhong Chen, Meixin Xiong & Ju Ming. (2022). Reduced Approach for Stochastic Optimal Control Problems. International Journal of Numerical Analysis and Modeling. 19 (2-3). 237-254. doi:
Copy to clipboard
The citation has been copied to your clipboard