Search arXiv⌕ Search
Home/Archive/arXiv

arXiv · 2204.07833

Optimizing differential equations to fit data and predict outcomes

Steven A. Frank
View original source ↗Read source document ↗Export metadata ↓

Abstract

Many scientific problems focus on observed patterns of change or on how to design a system to achieve particular dynamics. Those problems often require fitting differential equation models to target trajectories. Fitting such models can be difficult because each evaluation of the fit must calculate the distance between the model and target patterns at numerous points along a trajectory. The gradient of the fit with respect to the model parameters can be challenging. Recent technical advances in automatic differentiation through numerical differential equation solvers potentially change the fitting process into a relatively easy problem, opening up new possibilities to study dynamics. However, application of the new tools to real data may fail to achieve a good fit. This article illustrates how to overcome a variety of common challenges, using the classic ecological data for oscillations in hare and lynx populations. Models include simple ordinary differential equations (ODEs) and neural ordinary differential equations (NODEs), which use artificial neural networks to estimate the derivatives of differential equation systems. Comparing the fits obtained with ODEs versus NODEs, representing small and large parameter spaces, and changing the number of variable dimensions provide insight into the geometry of the observed and model trajectories. To analyze the quality of the models for predicting future observations, a Bayesian-inspired preconditioned stochastic gradient Langevin dynamics (pSGLD) calculation of the posterior distribution of predicted model trajectories clarifies the tendency for various models to underfit or overfit the data. Coupling fitted differential equation systems with pSGLD sampling provides a powerful way to study the properties of optimization surfaces, raising an analogy with mutation-selection dynamics on fitness landscapes.

Explore related subjects

q-bio.QMcs.LG

Keep this discovery

Explore connections, maps & timelines

BibTeXRIS

Steven A. Frank. 2022-04-16. Optimizing differential equations to fit data and predict outcomes. https://doi.org/10.1002/ece3.9895

Cite the original work for its findings. Save a collection to share your selection of sources.

KEEP EXPLORING

Related papers

arXiv2026

BreCol: Benchmarking Classical and Deep-Learning Methods for Microbiome-Based Cancer Detection

DNA sequencing of the gut microbial community shows promise for cancer detection, but questions remain about the generalizability of results across studies. We propose BreCol, a benchmark of 2,040 16S rRNA gene sequencing runs across 26 studies spanning breast cancer, colorectal cancer, and healthy cohorts. Train-test splits are made within pre-2023 studies, while holdout evaluation uses studies from 2023 onward, reflecting temporal separation from training data. Classical models reach test/holdout AUCs of 0.77/0.60 for cancer diagnosis and 1.00/0.83 for cancer type prediction. We train the models on both cancer types simultaneously and find that colorectal cancer is often easier to detect than breast cancer. We also evaluate two deep learning models: HyenaDNA, a long-range sequence model that pools hidden states for classification, and SetBERT, a transformer that produces contextualized embeddings over sets of reads. Both deep learning models underperform the best classical methods on holdout data, though tuning training set size and the classification head yields modest gains. Our classical pipeline uses unsupervised clustering to derive features from tetramer frequencies, preserving within-run compositional signal and achieving near state-of-the-art performance without relying on taxonomic assignments. BreCol data and associated code are publicly available.

q-bio.QM↗
arXiv2026

Topological Inference for Organoids

The reproducibility of organ morphology and the extent to which computational models can predict morphogenesis remain difficult to quantify, particularly for organs with complex networks of fluid-filled lumina. Here, we combine Topological Data Analysis (TDA), biophysical simulation, and Bayesian inference to study lumen morphogenesis in pancreatic organoids. Lumen formation is governed by physical processes that are challenging to measure directly, including cell proliferation and luminal osmotic pressure. We simulate organoid development using a phase-field model and address the inverse problem of inferring these parameters from either time-lapse images or single morphological snapshots. Since lumen architectures vary substantially in size, structure, and connectivity, conventional geometric descriptors provide only a partial representation of their morphology. We therefore represent each organoid using SampEuler, a topological descriptor derived from the Euler Characteristic Transform (ECT). We first show that SampEuler captures morphological information encoded by established morphometrics. We then perform parameter inference using an approximate Bayesian computation (ABC) rejection framework with the SampEuler Wasserstein distance. Using synthetic organoids with known ground-truth parameters, our approach accurately recovers the osmotic pressure and the proliferation rate while revealing a compensatory trade-off between the two processes. Applied to experimental data from ten pancreatic organoids, the inferred posterior distributions are consistent with biological expectations. Together, these results establish a non-destructive, image-based pipeline for estimating otherwise inaccessible physical parameters governing lumen formation and highlight the potential of topological representations for linking complex biological morphology to mechanistic models.

q-bio.QM↗
arXiv2026

Circadian Derived Features for Early Discrimination Across Insomnia Severity Levels: At Least 8 Weeks of Monitoring Are Needed for Clinically Meaningful Assessment

Background: Wearable devices provide continuous, objective measures of daily activity and offer promise for assessing sleep disorders. However, the minimum monitoring duration needed to differentiate insomnia severity remains unclear. We investigated when wearable-derived behavioral features become informative for distinguishing Insomnia Severity Index (ISI) categories and examined the contribution of Activity Count (AC) and circadian-derived features. Methods: We analyzed wearable data from 2,305 participants in the Advancing Understanding of Recovery after Trauma (AURORA) study. Separate binary classifiers were developed for four ISI categories across six follow-up periods using AC and circadian-derived feature sets. Performance was evaluated using accuracy, F1-score, precision, recall, and AUROC. Results: Classification improved with longer monitoring. Across ISI categories, approximately eight weeks was the earliest time point at which wearable-derived features consistently achieved informative discrimination, with modest improvements thereafter. Participants without clinically significant insomnia were easiest to identify, reaching an AUROC of 0.693. Circadian-derived features performed comparably to, and in several cases better than, AC features, suggesting that the temporal organization of daily activity provides information beyond overall activity volume. Conclusions: Approximately eight weeks of longitudinal wearable monitoring may represent a practical minimum for differentiating ISI-defined insomnia categories. Longer monitoring provided only incremental improvements. Circadian behavioral features show promise as digital biomarkers for objective insomnia assessment.

q-bio.QM↗