https://www.mdu.se/

mdu.sePublications
Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
Sensor-Driven Surrogate Modeling and Control of Nonlinear Dynamical Systems Using FAE-CAE-LSTM and Deep Reinforcement Learning
Department of Computer Engineering and IT, University of Qom, Qom, Iran.
CFD and Turbulence Research Lab., Department of Mechanical Engineering, University of Qom, Qom, Iran.
Department of Computer Engineering and IT, University of Qom, Qom, Iran.
Mälardalen University, School of Innovation, Design and Engineering, Embedded Systems.ORCID iD: 0000-0002-7755-4795
Show others and affiliations
2025 (English)In: Sensors, E-ISSN 1424-8220, Vol. 25, no 16, article id 5149Article in journal (Refereed) Published
Abstract [en]

Highlights: What are the main findings? A surrogate-based deep reinforcement learning (DRL) framework (FAE–CAE–LSTM) is proposed. Achieves higher accuracy compared to DMD, POD, and conventional autoencoders. Provides 5–10× computational speedup, enabling real-time flow control. Incorporates a CNN–MLP reward estimator that enhances policy performance. What is the implication of the main findings? Enables robust modeling of high-dimensional nonlinear flow dynamics. Reduces dependence on full-order PDE solvers, minimizing control delays. Scalable to turbulent and three-dimensional flow control problems. Offers broad applicability in fluid dynamics, energy systems, and engineering control. In cyber-physical systems governed by nonlinear partial differential equations (PDEs), real-time control is often limited by sparse sensor data and high-dimensional system dynamics. Deep reinforcement learning (DRL) has shown promise for controlling such systems, but training DRL agents directly on full-order simulations is computationally intensive. This paper presents a sensor-driven, non-intrusive reduced-order modeling (NIROM) framework called FAE-CAE-LSTM, which combines convolutional and fully connected autoencoders with a long short-term memory (LSTM) network. The model compresses high-dimensional states into a latent space and captures their temporal evolution. A DRL agent is trained entirely in this reduced space, interacting with the surrogate built from sensor-like spatiotemporal measurements, such as pressure and velocity fields. A CNN-MLP reward estimator provides data-driven feedback without requiring access to governing equations. The method is tested on benchmark systems including Burgers’ equation, the Kuramoto–Sivashinsky equation, and flow past a circular cylinder; accuracy is further validated on flow past a square cylinder. Experimental results show that the proposed approach achieves accurate reconstruction, robust control, and significant computational speedup over traditional simulation-based training. These findings confirm the effectiveness of the FAE-CAE-LSTM surrogate in enabling real-time, sensor-informed, scalable DRL-based control of nonlinear dynamical systems.

Place, publisher, year, edition, pages
MDPI AG , 2025. Vol. 25, no 16, article id 5149
Keywords [en]
Autoencoders, Control Of Dynamical Systems, Cyber-physical Systems, Deep Reinforcement Learning, Long Short-term Memory, Sensor-driven Modeling, Circular Cylinders, Computer Control Systems, Convolution, Dynamical Systems, Dynamics, Embedded Systems, Flow Control, Fuel Additives, Nonlinear Dynamical Systems, Real Time Control, Robust Control, Auto Encoders, Control Of Dynamical System, Cybe-physical Systems, High-dimensional, Higher-dimensional, Reinforcement Learning Agent, Reinforcement Learnings, Short Term Memory
National Category
Control Engineering
Identifiers
URN: urn:nbn:se:mdh:diva-73172DOI: 10.3390/s25165149ISI: 001558414700001PubMedID: 40872017Scopus ID: 2-s2.0-105014295114OAI: oai:DiVA.org:mdh-73172DiVA, id: diva2:1994786
Available from: 2025-09-03 Created: 2025-09-03 Last updated: 2026-05-13Bibliographically approved

Open Access in DiVA

fulltext(8062 kB)21 downloads
File information
File name FULLTEXT01.pdfFile size 8062 kBChecksum SHA-512
c3a2e56c6d37ccb967655f984297928bc86f690d3012455aee3bd67f0bafbdebdb65244e4449b7610952342811ca3e68243da9872266d9f877e0bcaddefa610b
Type fulltextMimetype application/pdf

Other links

Publisher's full textPubMedScopus

Authority records

Vahabi, MaryamFotouhi, Hossein

Search in DiVA

By author/editor
Vahabi, MaryamFotouhi, Hossein
By organisation
Embedded Systems
In the same journal
Sensors
Control Engineering

Search outside of DiVA

GoogleGoogle Scholar
Total: 21 downloads
The number of downloads is the sum of all downloads of full texts. It may include eg previous versions that are now no longer available

doi
pubmed
urn-nbn

Altmetric score

doi
pubmed
urn-nbn
Total: 112 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf