A Critical Assessment of PINNs and Operator Learning for Geotechnical Engineering

Krishna Kumar

Home/Archive/arXiv

arXiv · 2512.24365

A Critical Assessment of PINNs and Operator Learning for Geotechnical Engineering

Krishna Kumar

View original source ↗Read source document ↗Export metadata ↓

Abstract

Scientific machine learning (SciML) offers neural-network alternatives to numerical workflows in geotechnical engineering. This paper benchmarks multi-layer perceptrons (MLPs), physics-informed neural networks (PINNs), deep operator networks (DeepONet), and graph network simulators (GNS) against finite-difference and particle-based references on geotechnical benchmarks, and compares PINN inversion with automatic differentiation (AD) through a conventional solver. We evaluate each method for extrapolation, training, and inference cost, transfer across problem instances, and physics accuracy. An MLP trained on two years of Terzaghi consolidation fits the data, but at year ten predicts ~290 mm with ReLU and ~60 mm with tanh or sigmoid, against a reference of 99.3 mm. A PINN on a damped oscillator with a time domain inside [0,1] matches the closed form within that interval but fails outside, since the residual constrains the fit only where it is sampled. For the 1D wave equation, PINN training is ~96,000 times slower than finite-difference methods and less accurate. DeepONet avoids PINN retraining, yet for the beam on elastic foundation, its training cost equals ~1.8 million finite-difference solves, and inference is slower per query than the direct solver. GNS improves geometric transfer through local particle interactions, though formulations still need trajectories, large training sets, and substantial memory. In the inverse wave benchmark, AD through the finite-difference solver recovers the material profile in seconds with ~1% error. The results support a cautious role for SciML. Neural networks suit interpolation and pattern recognition inside validated domains, while inverse analysis should first try differentiable physics-based solvers when a reliable forward solver exists.

Explore related subjects

physics.geo-ph cs.LG

Keep this discovery

Explore connections, maps & timelines

BibTeX RIS

Krishna Kumar. 2026-05-17. A Critical Assessment of PINNs and Operator Learning for Geotechnical Engineering. https://arxiv.org/abs/2512.24365

Cite the original work for its findings. Save a collection to share your selection of sources.

KEEP EXPLORING

Related papers

arXiv2026

Parameter-Efficient Adaptation of Pre-Trained Vision Foundation Models for Active and Passive Seismic Data Denoising

The demand for high-resolution subsurface imaging and continuous Earth monitoring has driven rapid growth in active and passive seismic data from dense geophone deployments, distributed acoustic sensing (DAS) arrays, and large-scale 2D and 3D surveys. This expansion makes complex noise suppression increasingly challenging, especially when signal fidelity must be preserved. Conventional supervised deep learning methods are often task-specific, require large paired datasets, and can suffer from domain shift under new acquisition conditions. Foundation models offer a promising alternative, but pre-training seismic foundation models from scratch requires massive domain-specific data and substantial computation. We propose an efficient framework that repurposes general-purpose Vision Foundation Models (VFMs) for geophysical tasks through Parameter-Efficient Fine-Tuning. The architecture uses a pre-trained VFM, a DINOv3 encoder, adapted with Low-Rank Adaptation (LoRA) to enable effective feature adaptation with few additional parameters. To improve robustness under unseen field conditions without ground truth, we introduce a kurtosis-guided unsupervised test-time adaptation module that updates only LoRA parameters during inference. This module self-calibrates the model to site-specific noise by identifying information-rich regions via kurtosis and performing self-training without labeled data. Experiments on public exploration seismic images and DAS vertical seismic profiling data from the Utah FORGE site show that the framework matches or outperforms domain-specific models. Tests on unseen cross-site data from a land survey in China and the Groß Schönebeck geothermal site in Germany further demonstrate strong generalization and effective signal-noise separation. These results highlight the potential of adapting pre-trained VFMs to data-intensive problems in exploration seismology.

physics.geo-ph↗

arXiv2026

Shallow-to-deep velocity model building via diffusion models-Part I: Method and Proof of concept

Seismic velocity model building (VMB) is fundamental for understanding subsurface structures. Traditional methods demand high-quality starting models and, also, remain limited in resolution in coverage and computationally intensive. Recent generative diffusion model-based approaches capture statistical priors to support traditional inversion methods, but these approaches do not account for the top to bottom progression of information (layer stripping) involved in surface recorded data, where deep velocity information depends on the shallow. To address this issue, we propose a depth-progressive diffusion framework that constructs velocity models incrementally from shallow to deep by propagating prior information. Our method trains on paired shallow-deep velocity patches with variable overlap and explicit depth encoding, integrating multiple geophysical constraints including well logs and seismic images (representing structural information). During inference, we synthesize overlapping depth slices using a progressive algorithm and merge them with Gaussian-weighted blending to eliminate boundary artifacts. This approach leverages both learned geological distributions and observed shallow priors while providing uncertainty quantification. Extensive numerical experiments on in-distribution tests and an out-of-distribution test demonstrate excellent VMB accuracy with a strong correlation between predicted uncertainty and actual errors. As a proof of concept, this part I employs idealized structural constraints derived from vertical reflectivity to validate the methodological framework. The companion paper (Part II) extends the approach to realistic structural constraints relying on migrated images with field data applications.

physics.geo-ph↗

arXiv2026

Shallow-to-deep velocity model building via diffusion models-Part II: Realistic scenarios

Full-waveform inversion (FWI) requires accurate initial velocity models to avoid cycle-skipping, but constructing such models remains challenging in practice. Building on the depth-progressive diffusion framework introduced in Part~I, which relied on idealized reflectivity constraints, this work adapts the methodology to realistic exploration scenarios. We replace perfect structural information with migration-derived attributes extracted from seismic images, and introduce smooth background velocity models from tomography as additional conditioning inputs. The framework jointly leverages background/migration velocity, migrated structural information, and sparse well measurements to synthesize high-resolution velocity models through depth-progressive generation. Validation on synthetic examples demonstrates superior accuracy compared to conventional interpolation and alternative deep learning methods, with generated models successfully initializing FWI and mitigating cycle-skipping even in complex geological structures. Field data confirms practical applicability: despite training on synthetic data, the method generalizes effectively to field conditions, producing velocity models with synthetic data response that nearly match observed seismic data. As a result, this framework establishes a practical pathway to deploy generative diffusion models for velocity model building under realistic constraints.

physics.geo-ph↗