Search arXivSearch

arXiv subjects

Jacob Page

Publications and source records attributed to Jacob Page.

At least 19 recordsLinked to original sources

Learning dynamically consistent flow reconstructions from limited observations

A core inverse problem in the experimental sciences is the inference of a hidden dynamical state from sparse or indirect measurements. There is a natural opportunity for deep learning methods here, but machine-learnt reconstruction methods typically require full state data for training. We present Trajectory-Consistent Network Training (TraCTra), a label-free framework that trains reconstruction networks using only partial observation sequences and a differentiable forward model. TraCTra requires the network reconstruction and dynamical evolution to be mutually consistent: network-predicted states are marched forward in time to match subsequent observations and to agree in the full state space with independent reconstructions at later times. Across four fluid systems, the same objective reconstructs three-dimensional turbulence from coarse-grained fields, velocity from observations of density fluctuations, and three-dimensional density and velocity from sequences of projected two-dimensional shadowgraphs, while also recovering global vorticity from observations confined to a small spatial window. TraCTra outperforms assimilation-only and physics-informed neural approaches, preserves dynamically important multiscale structure, and remains accurate beyond the optimisation window. It transfers to held-out times in the three-dimensional shadowgraph problem and, when trained across trajectories, generalises to unseen flows in the two-dimensional problem. The results establish trajectory consistency as a general supervision principle for reconstructing hidden dynamical states without full state training targets.

physics.flu-dyn

A neural network architecture and training algorithm to predict viscoelastic stresses from vortical data

Numerical simulations of elastic turbulence in parallel shear flows of polymer solutions indicate that the phenomena is associated with the formation and instability of exact coherent states dominated by thin sheets of polymer stress. However, these ``arrowhead'' structures are yet to be seen directly in experiments, where simultaneous velocity and polymer conformation measurements are challenging to obtain. Motivated by these challenges, we introduce a method for the prediction of the polymer conformation field given a time series of vorticity measurements. Our approach consists of two components: the first is a convolutional neural network architecture which takes vorticity fields and outputs a positive definite conformation tensor. The second is the adaptation of an assimilation-based training algorithm (Zhu \& Page, 2026) which does not require a pre-generated `offline' library of reference conformation fields, but is trained only using the vorticity measurements. This is particularly important in viscoelastic problems, where the appropriate model and parameters to compare to the experiments may need to be determined as part of the solution. In training, measurements made on a time-marched network prediction are required to match the saved time series, while the output of the solver and network predictions at later times are required to be self-consistent. We apply these ideas to two-dimensional Kolmogorov flow in a range of regimes, from simple traveling waves to a fully chaotic state. In all cases, our method produces robust predictions of the polymer stretch, while standard, unregularised variational assimilation is ineffective. In the chaotic case we show that our networks generalise to much larger domains -- without further optimisation -- than the `minimal' units in which they were trained.

physics.flu-dyn

Exact coherent structures as building blocks of turbulence on large domains

Exact unstable solutions of the Navier-Stokes equations are thought to underpin the dynamics of turbulence, but are usually computed in minimal computational domains. Here, we extend this dynamical systems approach to spatially extended turbulent flows featuring multiple interacting 'substructures', and show how new simple invariant solutions can be constructed by spatial tiling of exact solutions from small-box calculations. Candidate solutions are found via gradient-based optimization of a scalar loss function which targets autorecurrence in spatially-masked regions of the flow. We apply these ideas to a vertically-extended Kolmogorov flow, where we first identify large numbers of relative periodic orbits (RPOs) which are combinations of high-dissipation, small-box solutions with laminar patches. We then show that vertically-stacked combinations of pairs of distinct small-box RPOs can form robust guesses for dynamically-relevant two-tori in the larger domain. Finally, we show how our optimization procedure can identify 'turbulent' trajectories which locally shadow a small-box RPO for multiple periods in a subdomain. These small-box combinations are possible as the flow spends prolonged periods in a regime where it can be effectively considered as a pair of weakly-coupled small-box systems, due to shielding effects associated with higher-dissipation flow structures.

physics.flu-dyn

State estimation in homogeneous isotropic turbulence using super-resolution with a 4DVar training algorithm

Variational data assimilation and machine-learning based super-resolution are two alternative approaches to state estimation in turbulent flows. The former is an optimisation problem featuring a time series of coarse observations, the latter usually requires a library of high-resolution 'ground truth' data. We show that the classic '4DVar' data assimilation algorithm can be used to train neural networks for super-resolution in three-dimensional isotropic turbulence without the need for high-resolution reference data. To do this, we adapt a pseudo-spectral version of the fully-differentiable JAX-CFD solver (Kochkov et al, Proc. Nat. Acad. Sci. 118, 2021) to three-dimensional flows and combine it with a convolutional neural network for super-resolution. As a result we are able to include entire trajectories in our loss function which is minimised with gradient-based optimisation to define the neural network weights. We show that the resulting neural networks outperform 4DVar for state estimation at initial time over a wide variety of metrics, though 4DVar leads to more robust predictions towards the end of its assimilation window. We also present a hybrid approach in which the trained neural network output is used to initialise 4DVar. The resulting performance is more than twice as accurate as other state estimation strategies for all times and performs well even beyond known limiting lengthscales, all without requiring access to high-resolution measurements at any point.

physics.flu-dyn

Characterizing the Reynolds number dependence of the chaotic attractor in two-dimensional turbulence with dimension-minimizing autoencoders

Deep autoencoder neural networks can generate highly accurate, low-order representations of turbulence. We design a new family of autoencoders which are a combination of a 'dense-block' encoder-decoder structure (Page et al, J. Fluid Mech. 991, 2024), an 'implicit rank minimization' series of linear layers acting on the embeddings (Zeng et al, Mach. Learn. Sci. Tech. 5, 2024) and a full discrete+continuous symmetry reduction. These models are applied to two-dimensional turbulence in Kolmogorov flow for a range of Reynolds numbers $25 \leq Re \leq 400$, and used to estimate the dimension of the chaotic attractor, $d_{\mathcal A}(Re)$. We find that the dimension scales like $\sim Re^{1/3}$ -- much weaker than known bounds on the global attractor which grow like $Re^{4/3}$. In addition, two-dimensional maps of the latent space in our models reveal a rich structure not seen in previous studies, including multiple classes of high-dissipation events at lower $Re$ which guide bursting trajectories. We visualize the embeddings of large numbers of "turbulent" unstable periodic orbits, which the model indicates are distinct (in terms of features) from any flow snapshot in a large turbulent dataset, suggesting their dynamical irrelevance. This is in sharp contrast to their appearance in more traditional low-dimensional projections, in which they appear to lie within the turbulent attractor.

physics.flu-dyn

Dynamical relevance of periodic orbits under increasing Reynolds number and connections to inviscid dynamics

Large numbers of relative periodic orbits (RPOs) have been found recently in doubly-periodic, two-dimensional Kolmogorov flow at moderate Reynolds numbers $Re \in \{40, 100\}$. While these solutions lead to robust statistical reconstructions at the $Re$-values where they were obtained, it is unclear how their dynamical importance evolves with increasing $Re$. We perform arclength continuation on this library of solutions to show that large numbers of RPOs quickly become dynamically irrelevant, reaching dissipation values either well above or below those associated with the turbulent attractor at high $Re$. The scaling of the high dissipation RPOs is shown to be consistent with a direct connection to solutions of the unforced Euler equation, and is observed for a wide variety of states beyond the 'unimodal' solutions considered in previous work (Kim & Okamoto, Nonlinearity 28, 2015). On the other hand, the weakly dissipative states have properties indicating a connection to exact solutions of a forced Euler equation. The apparent dynamical irrelevance is associated with poor statistical reconstructions away from the $Re$ values where the RPOs were originally converged. Motivated by the connection to solutions of the Euler equation, we show that many of these states can be well described by exact relative periodic solutions in a system of point vortices. The point vortex RPOs are converged via gradient-based optimisation of a scalar loss function which (1) matches the dynamics of the point vortices to the turbulent vortex cores and (2) insists the point vortex evolution is itself time-periodic.

physics.flu-dyn

Super-resolution with dynamics in the loss

Super-resolution of turbulence is a term used to describe the prediction of high-resolution snapshots of a flow from coarse-grained observations. This is typically accomplished with a deep neural network and training usually requires a dataset of high-resolution images. An approach is presented here in which robust super resolution can be performed without access to high-resolution reference data, as might be expected in an experiment. The training procedure is similar to data assimilation, wherein the model learns to predict an initial condition that leads to accurate coarse-grained predictions at later times, while only being shown coarse-grained observations. Implementation of the approach requires the use of a fully differentiable flow solver in the training loop to allow for time-marching of predictions. A range of models are trained on data generated from forced, two-dimensional turbulence. The networks have reconstruction errors which are similar to those obtained with `standard' super-resolution approaches using high resolution data. Furthermore, they significantly outperform data-assimilation for state-estimation on individual trajectories, allowing accurate reconstruction on coarser grids than is possible with standard variational approaches.

physics.flu-dyn

Transition route to elastic and elasto-inertial turbulence in polymer channel flows

Viscoelastic shear flows support additional chaotic states beyond simple Newtonian turbulence. In vanishing Reynolds number flows, the nonlinearity in the polymer evolution equation alone can sustain inertialess 'elastic' turbulence (ET) while 'elasto-inertial' turbulence (EIT) appears to rely on an interplay between elasticity and finite-$Re$ effects. Despite their distinct phenomenology and industrial significance, transition routes and possible connections between these states are unknown. We identify here a common Ruelle-Takens transition scenario for both of these chaotic regimes in two-dimensional direct numerical simulations of FENE-P fluids in a straight channel. The primary bifurcation is caused by a recently-discovered 'polymer diffusive instability' associated with small but non-vanishing polymer stress diffusion which generates a finite-amplitude, small-scale travelling wave localised at the wall. This is found to be unstable to a large-scale secondary instability which grows to modify the whole flow before itself breaking down in a third bifurcation to either ET or EIT. The secondary large-scale instability waves resemble 'centre' and 'wall' modes respectively - instabilities which have been conjectured to play a role in viscoelastic chaotic dynamics but were previously only thought to exist far from relevant areas of the parameter space.

physics.flu-dyn

Asymptotics of the centre mode instability in viscoelastic channel flow: with and without inertia

Motivated by the recent numerical results of Khalid et al., Phys. Rev. Lett., 127, 134502 (2021), we consider the large-Weissenberg-number ($W$) asymptotics of the centre mode instability in inertialess viscoelastic channel flow. The instability is of the critical layer type in the distinguished ultra-dilute limit where $W(1-\beta)=O(1)$ as $W \rightarrow \infty$ ($\beta$ is the ratio of solvent-to-total viscosity). In contrast to centre modes in the Orr-Sommerfeld equation, $1-c=O(1)$ as $W \rightarrow \infty$ where $c$ is the phase speed normalised by the centreline speed as a central `outer' region is always needed to adjust the non-zero cross-stream velocity at the critical layer down to zero at the centreline. The critical layer acts as a pair of intense `bellows' which blows the flow streamlines apart locally and then sucks them back together again. This compression/rarefaction amplifies the streamwise-normal polymer stress which in turn drives the streamwise flow through local polymer stresses at the critical layer. The streamwise flow energises the cross-stream flow via continuity which in turn intensifies the critical layer to close the cycle. We also treat the large-Reynolds-number ($Re$) asymptotic structure of the upper (where $1-c=O(Re^{-2/3})$) and lower branches of the $Re$-$W$ neutral curve confirming the inferred scalings from previous numerical computations. Finally, we argue that the viscoelastic centre mode instability was actually first found in viscoelastic Kolmogorov flow by Boffetta et al., J. Fluid Mech., 523, 161-170 (2005).

physics.flu-dyn

Exact coherent structures in two-dimensional turbulence identified with convolutional autoencoders

Convolutional autoencoders are used to deconstruct the changing dynamics of two-dimensional Kolmogorov flow as $Re$ is increased from weakly chaotic flow at $Re=40$ to a chaotic state dominated by a domain-filling vortex pair at $Re=400$. The highly accurate embeddings allow us to visualise the evolving structure of state space and are interpretable using `latent Fourier analysis' (Page {\em et. al.}, \emph{Phys. Rev. Fluids} \textbf{6}, 2021). Individual latent Fourier modes decode into vortical structures with a streamwise lengthscale controlled by the latent wavenumber, $l$, with only a small number $l \lesssim 8$ required to accurately represent the flow. Latent Fourier projections reveal a detached class of bursting events at $Re=40$ which merge with the low-dissipation dynamics as $Re$ is increased to $100$. We use doubly- ($l=2$) or triply- ($l=3$) periodic latent Fourier modes to generate guesses for UPOs (unstable periodic orbits) associated with high-dissipation events. While the doubly-periodic UPOs are representative of the high-dissipation dynamics at $Re=40$, the same class of UPOs move away from the attractor at $Re=100$ -- where the associated bursting events typically involve larger-scale ($l=1$) structure too. At $Re=400$ an entirely different embedding structure is formed within the network in which no distinct representations of small-scale vortices are observed; instead the network embeds all snapshots based around a large-scale template for the condensate. We use latent Fourier projections to find an associated `large-scale' UPO which we believe to be a finite-$Re$ continuation of a solution to the Euler equations.

physics.flu-dyn

Inertial enhancement of the polymer diffusive instability

Beneitez et al. (Phys. Rev. Fluids, 8, L101901, 2023) have recently discovered a new linear "polymer diffusive instability" (PDI) in inertialess rectilinear viscoelastic shear flow using the FENE-P model when polymer stress diffusion is present. Here, we examine the impact of inertia on the PDI for both plane Couette (PCF) and plane Poiseuille (PPF) flows under varying Weissenberg number $W$, polymer stress diffusivity $\varepsilon$, solvent-to-total viscosity ratio $\beta$, and Reynolds number $Re$, considering the FENE-P and simpler Oldroyd-B constitutive relations. Both the prevalence of the instability in parameter space and the associated growth rates are found to significantly increase with $Re$. For instance, as $Re$ increases with $\beta$ fixed, the instability emerges at progressively lower values of $W$ and $\varepsilon$ than in the inertialess limit, and the associated growth rates increase linearly with $Re$ when all other parameters are fixed. For finite $Re$, it is also demonstrated that the Schmidt number $Sc=1/(\varepsilon Re)$ collapses curves of neutral stability obtained across various $Re$ and $\varepsilon$. The observed strengthening of PDI with inertia and the fact that stress diffusion is always present in time-stepping algorithms, either implicitly as part of the scheme or explicitly as a stabiliser, implies that the instability is likely operative in computational work using the popular Oldroyd-B and FENE-P constitutive models. The fundamental question now is whether PDI is physical and observable in experiments, or is instead an artifact of the constitutive models that must be suppressed.

physics.flu-dyn

Multistability of elasto-inertial two-dimensional channel flow

Elasto-inertial turbulence (EIT) is a recently discovered two-dimensional chaotic flow state observed in dilute polymer solutions. It has been hypothesised that the dynamical origins of EIT are linked to a center-mode instability, whose nonlinear evolution leads to a travelling wave with an 'arrowhead' structure in the polymer conformation, a structure also observed instantaneously in simulations of EIT. In this work we conduct a suite of two-dimensional direct numerical simulations spanning a wide range of polymeric flow parameters to examine the possible dynamical connection between the arrowhead and EIT. Our calculations reveal (up to) four co-existent attractors: the laminar state and a steady arrowhead, along with EIT and a 'chaotic arrowhead'. The steady arrowhead is stable for all parameters considered here, while the final pair of (chaotic) flow states are visually very similar and can be distinguished only by the presence of a weak polymer arrowhead structure in the 'chaotic arrowhead' regime. Analysis of energy transfers between the flow and the polymer indicates that both chaotic regimes are maintained by an identical near-wall mechanism and that the weak arrowhead does not play a role. Our results suggest that the arrowhead is a benign flow structure that is disconnected from the self-sustaining mechanics of EIT.

physics.flu-dyn

Exploring the free-energy landscape of a rotating superfluid

The equilibrium state of a superfluid in a rotating cylindrical vessel is a vortex crystal -- an array of vortex lines which is stationary in the rotating frame. Experimental realisations of this behaviour typically show a sequence of transient states before the free-energy minimising configuration is reached. Motivated by these observations, we construct a new method for a systematic exploration of the free-energy landscape via gradient-based optimisation of a scalar loss function. Our approach is inspired by the pioneering numerical work of Campbell & Ziff (Phys. Rev. B 20, 1979), and makes use of automatic differentiation (AD) which crucially allows us to include entire solution trajectories in the loss. We first use the method to converge thousands of low-free-energy relative equilibria for vortex numbers in the range $10 \leq N \leq 30$, which reveals an extremely dense set of mostly saddle-like solutions. As part of this search, we discover new continuous families of relative equilibria (in the unbounded domain) which are often global minimisers of the free energy. These continuous families all consist of crystals arranged in a double-ring configuration, and we assess which state from the family is most likely to be observed experimentally by computing energy-minimising pathways from nearby local minima -- identifying a common entry point into the family. Finally, we develop an approach to compute homoclinic orbits and use it to examine the dynamics in the vicinity of the minimising state by converging connections for low-energy saddles.

physics.flu-dyn

Recurrent flow patterns as a basis for turbulence: predicting statistics from structures

A dynamical systems approach to turbulence envisions the flow as a trajectory through a high-dimensional state space transiently visiting the neighbourhoods of unstable simple invariant solutions (E. Hopf, Commun. Appl. Maths 1, 303, 1948). The hope has always been to turn this appealing picture into a predictive framework where the statistics of the flow follows from a weighted sum of the statistics of each simple invariant solution. Two outstanding obstacles have prevented this goal from being achieved: (1) paucity of known solutions and (2) the lack of a rational theory for predicting the required weights. Here we describe a method to substantially solve these problems, and thereby provide the first compelling evidence that the PDFs of a fully developed turbulent flow can be reconstructed with a set of unstable periodic orbits. Our new method for finding solutions uses automatic differentiation, with high-quality guesses constructed by minimising a trajectory-dependent loss function. We use this approach to find hundreds of new solutions in turbulent, two-dimensional Kolmogorov flow. Robust statistical predictions are then computed by learning weights after converting a turbulent trajectory into a Markov chain for which the states are individual solutions, and the nearest solution to a given snapshot is determined using a deep convolutional autoencoder. To our knowledge, this is the first time the PDFs of a spatio-temporally-chaotic system have been successfully reproduced with a set of simple invariant states, and provides a fascinating connection between self-sustaining dynamical processes and the more well-known statistical properties of turbulence.

physics.flu-dyn

Polymeric diffusive instability leading to elastic turbulence in plane Couette flow

Elastic turbulence is a chaotic flow state observed in dilute polymer solutions in the absence of inertia. It was discovered experimentally in circular geometries and has long been thought to require a finite amplitude perturbation in parallel flows. Here we demonstrate, within the commonly-used Oldroyd-B and FENE-P models, that a self-sustaining chaotic state can be initiated via a linear instability in a simple inertialess shear flow caused by the presence of small but non-zero diffusivity of the polymer stress. Numerical simulations show that the instability leads to a three-dimensional selfsustaining chaotic state, which we believe is the first reported in a wall-bounded, parallel, inertialess viscoelastic flow.

physics.flu-dyn

Finite-amplitude elastic waves in viscoelastic channel flow from large to zero Reynolds number

Using branch continuation in the FENE-P model, we show that finite-amplitude travelling waves borne out of the recently-discovered linear instability of viscoelastic channel flow (Khalid et al. {\em J. Fluid Mech.} {\bf 915}, A43, 2021) are substantially subcritical reaching much lower Weissenberg ($Wi$) numbers than on the neutral curve at a given Reynolds ($Re$) number over $Re \in [0,3000]$. The travelling waves on the lower branch are surprisingly weak indicating that viscolastic channel flow is susceptible to (nonlinear) instability triggered by small finite amplitude disturbances for $Wi$ and $Re$ well below the neutral curve. The critical $Wi$ for these waves to appear in a saddle node bifurcation decreases monotonically from, for example, $\approx 37$ at $Re=3000$ down to $\approx 7.5$ at $Re=0$ at the solvent-to-total-viscosity ratio $\beta=0.9$. In this latter creeping flow limit, we also show that these waves exist at $Wi \lesssim 50$ for higher polymer concentrations - $\beta \in [0.5,0.97)$ -- where there is no known linear instability. Our results therefore indicate that these travelling waves -- found in simulations and named `arrowheads' by Dubief et al. {\em arXiv}.2006.06770 (2020) - exist much more generally in $(Wi,Re, \beta)$ parameter space than their spawning neutral curve and hence can either directly, or indirectly through their instabilities, influence the dynamics seen far away from where the flow is linearly unstable. Possible connections to elastic and elasto-inertial turbulence are discussed.

physics.flu-dyn

Vorticity amplification in viscoelastic channel flows with long-wave surface distortions

Surface distortions to an otherwise planar channel flow introduce vorticity perturbations. We examine this scenario in viscoelastic fluids, and identify new mechanisms by which significant vorticity perturbations can be generated in both inertialess and elasto-inertial channel flows. We focus on the case where the lengthscale of the surface distortion is much longer than the channel depth, where we find significant departure from plane shear (Page & Zaki, J. Fluid Mech. 801 2016) due to the non-monotonic base-flow streamwise-normal elastic stress. In inertialess flows, a purely elastic response results in streamlines deforming to match the bottom topography in the lower half the channel. However, the vanishing stress at the centreline introduces a blocking effect, and the associated $O(1)$ jump in normal velocity is balanced by a narrow, large amplitude streamwise-oscillating `jet', resulting in a localised, chevron-shaped vorticity perturbation field. In elasto-inertial flows, resonance between the frequency of elasto-inertial `Alfven' waves and the frequency apparent to an observer moving with the fluid results in vorticity amplification in a pair of critical layers on either side of the channel. The vorticity in both layers is equal in magnitude and as such the perturbation vorticity field penetrates the full channel depth even when inertia is dominant. The results demonstrate that long-wave distortions - which are relatively innocuous in Newtonian fluids - can drive a significant flow distortion in viscoelastic fluids for a wide range of parameter values.

physics.flu-dyn

Weakly nonlinear analysis of the viscoelastic instability in channel flow for finite and vanishing Reynolds numbers

The recently-discovered centre-mode instability of rectilinear viscoelastic shear flow (Garg et al. Phy. Rev. Lett. 121, 024502, 2018) has offered an explanation for the origin of elasto-inertial turbulence (EIT) which occurs at lower Weissenberg ($Wi$) numbers. In support of this, we show using weakly nonlinear analysis that the subcriticality found in Page et al. (Phys. Rev. Lett. 125, 154501, 2020) is generic across the neutral curve with the instability only becoming supercritical at low Reynolds ($Re$) numbers and high $Wi$. We demonstrate that the instability can be viewed as purely elastic in origin even for $Re=O(10^3)$, rather than `elasto-inertial', as the underlying shear does not energise the instability. It is also found that the introduction of a realistic maximum polymer extension length, $L_{max}$, in the FENE-P model moves the neutral curve closer to the inertialess $Re=0$ limit at a fixed ratio of solvent-to-solution viscosities, $\beta$. In the dilute limit ($\beta \rightarrow 1$) with $L_{max} =O(100)$, the linear instability can brought down to more physically-relevant $Wi\gtrsim 110$ at $\beta=0.98$, compared with the threshold $Wi=O(10^3)$ at $\beta=0.994$ reported recently by Khalid et al. (arXiv: 2103.06794) for an Oldroyd-B fluid. Again the instability is subcritical implying that inertialess rectilinear viscoelastic shear flow is nonlinearly unstable - i.e. unstable to finite amplitude disturbances - for even lower $Wi$.

physics.flu-dyn