Volume 6, Issue 2
Model Selection of Dynamical Systems via Entropic Regression and Bayesian Information Criteria

Jinhui Li & Aiyong Chen

J. Nonl. Mod. Anal., 6 (2024), pp. 333-359.

Published online: 2024-06

[An open-access article; the PDF is free to any online user.]

Export citation
  • Abstract

Recovering system model from noisy data is a key challenge in the analysis of dynamical systems. Based on a data-driven identification approach, we develop a model selection algorithm called Entropy Regression Bayesian Information Criterion (ER-BIC). First, the entropy regression identification algorithm (ER) is used to obtain candidate models that are close to the Pareto optimum and combine as a library of candidate models. Second, BIC score in the candidate models library is calculated using the Bayesian information criterion (BIC) and ranked from smallest to largest. Third, the model with the smallest BIC score is selected as the one we need to optimize. Finally, the ER-BIC algorithm is applied to several classical dynamical systems, including one-dimensional polynomial and RC circuit systems, two-dimensional Duffing and classical ODE systems, three-dimensional Lorenz 63 and Lorenz 84 systems. The results show that the new algorithm accurately identifies the system model under noise and time variable $t,$ laying the foundation for nonlinear analysis.

  • AMS Subject Headings

37M05, 34A34, 93E24

  • Copyright

COPYRIGHT: © Global Science Press

  • Email address
  • BibTex
  • RIS
  • TXT
@Article{JNMA-6-333, author = {Li , Jinhui and Chen , Aiyong}, title = {Model Selection of Dynamical Systems via Entropic Regression and Bayesian Information Criteria}, journal = {Journal of Nonlinear Modeling and Analysis}, year = {2024}, volume = {6}, number = {2}, pages = {333--359}, abstract = {

Recovering system model from noisy data is a key challenge in the analysis of dynamical systems. Based on a data-driven identification approach, we develop a model selection algorithm called Entropy Regression Bayesian Information Criterion (ER-BIC). First, the entropy regression identification algorithm (ER) is used to obtain candidate models that are close to the Pareto optimum and combine as a library of candidate models. Second, BIC score in the candidate models library is calculated using the Bayesian information criterion (BIC) and ranked from smallest to largest. Third, the model with the smallest BIC score is selected as the one we need to optimize. Finally, the ER-BIC algorithm is applied to several classical dynamical systems, including one-dimensional polynomial and RC circuit systems, two-dimensional Duffing and classical ODE systems, three-dimensional Lorenz 63 and Lorenz 84 systems. The results show that the new algorithm accurately identifies the system model under noise and time variable $t,$ laying the foundation for nonlinear analysis.

}, issn = {2562-2862}, doi = {https://doi.org/10.12150/jnma.2024.333}, url = {http://global-sci.org/intro/article_detail/jnma/23179.html} }
TY - JOUR T1 - Model Selection of Dynamical Systems via Entropic Regression and Bayesian Information Criteria AU - Li , Jinhui AU - Chen , Aiyong JO - Journal of Nonlinear Modeling and Analysis VL - 2 SP - 333 EP - 359 PY - 2024 DA - 2024/06 SN - 6 DO - http://doi.org/10.12150/jnma.2024.333 UR - https://global-sci.org/intro/article_detail/jnma/23179.html KW - Data-driven, system identification, model selection, ER algorithm, BIC. AB -

Recovering system model from noisy data is a key challenge in the analysis of dynamical systems. Based on a data-driven identification approach, we develop a model selection algorithm called Entropy Regression Bayesian Information Criterion (ER-BIC). First, the entropy regression identification algorithm (ER) is used to obtain candidate models that are close to the Pareto optimum and combine as a library of candidate models. Second, BIC score in the candidate models library is calculated using the Bayesian information criterion (BIC) and ranked from smallest to largest. Third, the model with the smallest BIC score is selected as the one we need to optimize. Finally, the ER-BIC algorithm is applied to several classical dynamical systems, including one-dimensional polynomial and RC circuit systems, two-dimensional Duffing and classical ODE systems, three-dimensional Lorenz 63 and Lorenz 84 systems. The results show that the new algorithm accurately identifies the system model under noise and time variable $t,$ laying the foundation for nonlinear analysis.

Li , Jinhui and Chen , Aiyong. (2024). Model Selection of Dynamical Systems via Entropic Regression and Bayesian Information Criteria. Journal of Nonlinear Modeling and Analysis. 6 (2). 333-359. doi:10.12150/jnma.2024.333
Copy to clipboard
The citation has been copied to your clipboard