Search arXivSearch

arXiv · 2312.16376

Acoustics-based Active Control of Unsteady Flow Dynamics using Reinforcement Learning Driven Synthetic Jets

Abstract

Flow generated noise are caused shear flows and, hence, they can be used as feedback to control the flow. Existing flow control uses state variables like velocity, pressure, or vorticity, none use acoustic observables as the primary control signal. It is tough to model a classical control algorithm using sound level but data-driven approaches are not as do not have to explicitly model the physics. We present an acoustics-driven framework for active control of unsteady wake dynamics behind a circular cylinder, in which sound is used as the primary feedback signal for flow regulation. The approach integrates deep reinforcement learning (DRL) with synthetic jet actuation, using acoustic measurements acquired from a downstream hydrophone array to inform control decisions in real time. Unlike conventional flow control strategies that rely on velocity or pressure field sensing, the proposed method establishes a direct link between far-field acoustic emissions and near-field actuation. Within this formulation, the DRL agent learns control policies that exploit acoustic signatures of vortex shedding to modulate synthetic jet actuation on the cylinder surface. The resulting control suppresses coherent wake structures and mitigates flow-induced disturbances. Quantitative results show reductions of up to 9.5\% in radiated noise and 23.8\% in drag under the tested conditions, accompanied by a marked attenuation of wake oscillations, for a DFG 2D benchmark flow with Reynolds number 100. These findings demonstrate that acoustic sensing alone can provide sufficient information for effective closed-loop flow control and highlight its potential as a non-intrusive feedback modality for coupled aerodynamic and aeroacoustic optimization in bluff-body flows. The codes for the algorithm can be found here: https://github.com/Siddharth-Rout/FlowControlDRL.

Explore related subjects

Keep this discovery

Explore connections, maps & timelines

BibTeXRIS

Siddharth Rout, Khai Phan, Chao-An Lin. 2026-05-09. Acoustics-based Active Control of Unsteady Flow Dynamics using Reinforcement Learning Driven Synthetic Jets. https://arxiv.org/abs/2312.16376

Cite the original work for its findings. Save a collection to share your selection of sources.

KEEP EXPLORING

Related papers

Mathematical modeling on peristaltic flow of a Prandtl fluid with effects of slip conditions and inclined magnetic field

The manuscript provides a description of a theoretical analysis of a non-Newtonian Prandtl fluid subject to peristaltic flow through an inclined asymmetric channel. We explore the effect of an inclined magnetic field on the peristaltic flow. This is relevant for applications involving fluid flow in narrow, inclined (tilted) tubes similar to blood vessels or the digestive system. The model also includes thermodynamic aspects such as heat diffusion (the Soret effect) and viscous dissipation resulting from wall-fluid slip conditions, which may help optimize medical devices such as lab-on-a-chip systems and dialysis machines. In this study, the concentration of a generic chemical, temperature, and fluid velocity are taken into account through mass, heat, and momentum balances, respectively. The solution is approximated using numerical techniques suitable for long wavelengths (low frequency) and low Reynolds numbers. The study also discusses trapping phenomena, which are crucial from a clinical point of view. The developed insights can improve the understanding of physiological flows in the gastrointestinal tract and blood vessels. By understanding how the fluid moves and how particles are trapped, these insights may contribute to the design of improved medical pumps and artificial organs. Graphical visualizations are provided for the fluid velocity profile, temperature distribution, and concentration of a generic chemical. Furthermore, the numerical results are validated through comparison with a closed-form solution from a benchmark problem.

physics.flu-dyn

Discovery of a dispersion model at high Peclet numbers

Peclet number characterises the transition from classical Taylor-Aris dispersion to convection-dominated longitudinal solute transport, with the classical model becoming inadequate at extremely high radial Peclet number $Pe_r$. We develop a novel explicit-closure one-dimensional (1-D) effective dispersion model for this high-$Pe_r$ regime by introducing two closure coefficients, $θ_u$ and $θ_d$, whose functional structures are identified using low-frequency transfer-function matching and a modified Kolmogorov-Arnold network (KAN). The resulting model captures the transition from classical Taylor-Aris dispersion at low $Pe_r$ to convection-dominated dispersion at high $Pe_r$. Analysis reveals that, in the high-$Pe_r$ regime, axial transport is redistributed between the effective convection flux and the dispersive flux, resulting in a reduced macroscopic convection velocity. Numerical validation demonstrates close agreement with the convection-diffusion model over the investigated high-$Pe_r$ conditions, while the classical Taylor-Aris model exhibits substantial deviations. Application of the proposed model to averaged flow velocity inversion further demonstrates improved velocity estimation, particularly in the high-$Pe_r$ regime. These results highlight the importance of accounting for non-classical dispersion for reliable contrast-agent-based arterial blood flow velocimetry and provide new insight into high-$Pe_r$ mass transport.

physics.flu-dyn

Optimization of fluid mixing by reinforcement learning using limit cycles of a dynamical system

We propose a method to overcome the difficulties encountered when applying reinforcement learning to fluid mixing processes. The proposed method has two main features: (i) it does not require detailed measurements of the flow state, and (ii) by effectively exploiting a stable limit cycle of a two-dimensional dynamical system (the Li'enard system), it can stably perform optimization without imposing explicit constraints on the control parameters. As an illustrative example, we optimize a process in which a fluid contained in a cylindrical vessel is mixed by periodically rotating the vessel. The resulting optimal vessel motion is physically reasonable: it reverses its direction of rotation before a solid-body rotation state is established. Furthermore, even when the fluid viscosity increases with time during the mixing process, the method can continuously adapt the control parameters to the changing viscosity.

physics.flu-dyn