arrow
Volume 43, Issue 1
A Perturbed Quasi-Newton Algorithm for Bound-Constrained Global Optimization

Raouf Ziadi & Abdelatif Bencherif-Madani

J. Comp. Math., 43 (2025), pp. 143-173.

Published online: 2024-11

Export citation
  • Abstract

This paper presents a stochastic modification of a limited memory BFGS method to solve bound-constrained global minimization problems with a differentiable cost function with no further smoothness. The approach is a stochastic descent method where the deterministic sequence, generated by a limited memory BFGS method, is replaced by a sequence of random variables. To enhance the performance of the proposed algorithm and make sure the perturbations lie within the feasible domain, we have developed a novel perturbation technique based on truncating a multivariate double exponential distribution to deal with bound-constrained problems; the theoretical study and the simulation of the developed truncated distribution are also presented. Theoretical results ensure that the proposed method converges almost surely to the global minimum. The performance of the algorithm is demonstrated through numerical experiments on some typical test functions as well as on some further engineering problems. The numerical comparisons with stochastic and meta-heuristic methods indicate that the suggested algorithm is promising.

  • AMS Subject Headings

90C26, 90C30

  • Copyright

COPYRIGHT: © Global Science Press

  • Email address
  • BibTex
  • RIS
  • TXT
@Article{JCM-43-143, author = {Ziadi , Raouf and Bencherif-Madani , Abdelatif}, title = {A Perturbed Quasi-Newton Algorithm for Bound-Constrained Global Optimization}, journal = {Journal of Computational Mathematics}, year = {2024}, volume = {43}, number = {1}, pages = {143--173}, abstract = {

This paper presents a stochastic modification of a limited memory BFGS method to solve bound-constrained global minimization problems with a differentiable cost function with no further smoothness. The approach is a stochastic descent method where the deterministic sequence, generated by a limited memory BFGS method, is replaced by a sequence of random variables. To enhance the performance of the proposed algorithm and make sure the perturbations lie within the feasible domain, we have developed a novel perturbation technique based on truncating a multivariate double exponential distribution to deal with bound-constrained problems; the theoretical study and the simulation of the developed truncated distribution are also presented. Theoretical results ensure that the proposed method converges almost surely to the global minimum. The performance of the algorithm is demonstrated through numerical experiments on some typical test functions as well as on some further engineering problems. The numerical comparisons with stochastic and meta-heuristic methods indicate that the suggested algorithm is promising.

}, issn = {1991-7139}, doi = {https://doi.org/10.4208/jcm.2307-m2023-0016}, url = {http://global-sci.org/intro/article_detail/jcm/23533.html} }
TY - JOUR T1 - A Perturbed Quasi-Newton Algorithm for Bound-Constrained Global Optimization AU - Ziadi , Raouf AU - Bencherif-Madani , Abdelatif JO - Journal of Computational Mathematics VL - 1 SP - 143 EP - 173 PY - 2024 DA - 2024/11 SN - 43 DO - http://doi.org/10.4208/jcm.2307-m2023-0016 UR - https://global-sci.org/intro/article_detail/jcm/23533.html KW - Global optimization, Limited memory BFGS method, Stochastic perturbation, Truncated multivariate double exponential distribution. AB -

This paper presents a stochastic modification of a limited memory BFGS method to solve bound-constrained global minimization problems with a differentiable cost function with no further smoothness. The approach is a stochastic descent method where the deterministic sequence, generated by a limited memory BFGS method, is replaced by a sequence of random variables. To enhance the performance of the proposed algorithm and make sure the perturbations lie within the feasible domain, we have developed a novel perturbation technique based on truncating a multivariate double exponential distribution to deal with bound-constrained problems; the theoretical study and the simulation of the developed truncated distribution are also presented. Theoretical results ensure that the proposed method converges almost surely to the global minimum. The performance of the algorithm is demonstrated through numerical experiments on some typical test functions as well as on some further engineering problems. The numerical comparisons with stochastic and meta-heuristic methods indicate that the suggested algorithm is promising.

Ziadi , Raouf and Bencherif-Madani , Abdelatif. (2024). A Perturbed Quasi-Newton Algorithm for Bound-Constrained Global Optimization. Journal of Computational Mathematics. 43 (1). 143-173. doi:10.4208/jcm.2307-m2023-0016
Copy to clipboard
The citation has been copied to your clipboard