Search arXivSearch

arXiv · 2006.01496

Approximation error analysis of some deep backward schemes for nonlinear PDEs

Abstract

Recently proposed numerical algorithms for solving high-dimensional nonlinear partial differential equations (PDEs) based on neural networks have shown their remarkable performance. We review some of them and study their convergence properties. The methods rely on probabilistic representation of PDEs by backward stochastic differential equations (BSDEs) and their iterated time discretization. Our proposed algorithm, called deep backward multistep scheme (MDBDP), is a machine learning version of the LSMDP scheme of Gobet, Turkedjiev (Math. Comp. 85, 2016). It estimates simultaneously by backward induction the solution and its gradient by neural networks through sequential minimizations of suitable quadratic loss functions that are performed by stochastic gradient descent. Our main theoretical contribution is to provide an approximation error analysis of the MDBDP scheme as well as the deep splitting (DS) scheme for semilinear PDEs designed in Beck, Becker, Cheridito, Jentzen, Neufeld (2019). We also supplement the error analysis of the DBDP scheme of Hur{é}, Pham, Warin (Math. Comp. 89, 2020). This yields notably convergence rate in terms of the number of neurons for a class of deep Lipschitz continuous GroupSort neural networks when the PDE is linear in the gradient of the solution for the MDBDP scheme, and in the semilinear case for the DBDP scheme. We illustrate our results with some numerical tests that are compared with some other machine learning algorithms in the literature.

Explore related subjects

Keep this discovery

Explore connections, maps & timelines

BibTeXRIS

Maximilien Germain, Huyen Pham, Xavier Warin. 2021-09-16. Approximation error analysis of some deep backward schemes for nonlinear PDEs. https://arxiv.org/abs/2006.01496

Cite the original work for its findings. Save a collection to share your selection of sources.

KEEP EXPLORING

Related papers

Multilayered fluid-structure interactions: existence of weak solutions for time-periodic and initial-value problems

We establish the existence of weak solutions for a class of fully coupled multilayered fluid-structure interaction systems in a three-dimensional spatial setting. The model consists of an incompressible viscous fluid interacting with a thin elastic shell, which is in turn coupled to a three-dimensional elastic solid, yielding a nonstandard $3D/2D/3D$ coupling configuration. The system is driven by time-periodic boundary forcing through Bernoulli-type pressure conditions. For sufficiently small forcing in $L^2$, we prove the existence of at least one time-periodic weak solution. A central analytical difficulty stems from the strong nonlinear coupling across interfaces of different dimensionality and the absence of classical compactness mechanisms. This challenge is overcome through a carefully designed energy framework combined with and new $L^{2}$ compactness arguments adapted to the multilayered geometry. A key structural assumption is the viscoelasticity of the three-dimensional solid, which yields additional diffusion estimates and ensures energy stability. In the purely elastic case, we establish the global-in-time existence of weak solutions to the corresponding initial-value problem, provided that no degeneration (self-contact) of the fluid domain occurs. These results extend existing theories for two-dimensional and reduced-dimensional configurations to a genuinely three-dimensional multilayered setting, providing new analytical insight into complex coupled PDE systems arising in fluid-structure interaction.

math.AP

A linear test approach to global controllability of third- and fifth-order nonlinear dispersive equations

We investigate third- and fifth-order nonlinear dispersive equations of KdV type on the torus and establishes approximate controllability by a fixed four-dimensional control; rather than relying solely on the saturation machinery, the analysis exploits the finite-dimensional controllability of the inviscid Burgers equation linearized around a carefully constructed return trajectory, with the trajectory itself obtained from an observable family. This ``linear test" strategy, yields more information about the structure of the control than the standard approach. In particular, the constructed control is shown to depend continuously on the initial and target states, a property that is by no means automatic in nonlinear control problems, and to decompose as a bounded linear operator applied to the data plus a fixed remainder, with the operator part interestingly independent of the order of dispersion.

math.AP

Global in-time rough large data solution to complex-valued semilinear damped evolution equations

We study the semilinear Cauchy problem for complex-valued damped evolution equations \begin{align*} \partial_t^2u+(-Δ)^σu+(-Δ)^δ\partial_tu=u^p,\ \ u(0,x)=u_0(x),\ \partial_tu(0,x)=u_1(x), \end{align*} with $δ\in[0,σ]$, $σ\in\mathbb{R}_+$ and $p\in\mathbb{N}_+\backslash\{1\}$, where the initial data belong to the rough space $E^α_s$ endowed with the norm \begin{align*} \|f\|_{E^α_s}=\big\|\langleξ\rangle^s\,2^{α|ξ|}\widehat{f}(ξ)\big\|_{L^2}\ \ \mbox{with}\ \ α<0, \ s\in\mathbb{R}. \end{align*} Concerning $(u_0,u_1)\in E^α_{s+\barκ}\times E^α_s$ when $s\geqslant\frac{n}{2}-\frac{2κ+\barκ-2δ}{p-1}-\barκ$ with $κ=\min\{2δ,σ\}$ and $\barκ=\max\{2δ,σ\}$ whose Fourier transforms are supported in a suitable subset of first octant, we prove a global in-time existence result without requiring the smallness of rough initial data.

math.AP