Search arXiv⌕ Search

arXiv · q-bio/0701039

Universally Sloppy Parameter Sensitivities in Systems Biology

Abstract

Quantitative computational models play an increasingly important role in modern biology. Such models typically involve many free parameters, and assigning their values is often a substantial obstacle to model development. Directly measuring \emph{in vivo} biochemical parameters is difficult, and collectively fitting them to other data often yields large parameter uncertainties. Nevertheless, in earlier work we showed in a growth-factor-signaling model that collective fitting could yield well-constrained predictions, even when it left individual parameters very poorly constrained. We also showed that the model had a `sloppy' spectrum of parameter sensitivities, with eigenvalues roughly evenly distributed over many decades. Here we use a collection of models from the literature to test whether such sloppy spectra are common in systems biology. Strikingly, we find that every model we examine has a sloppy spectrum of sensitivities. We also test several consequences of this sloppiness for building predictive models. In particular, sloppiness suggests that collective fits to even large amounts of ideal time-series data will often leave many parameters poorly constrained. Tests over our model collection are consistent with this suggestion. This difficulty with collective fits may seem to argue for direct parameter measurements, but sloppiness also implies that such measurements must be formidably precise and complete to usefully constrain many model predictions. We confirm this implication in our signaling model. Our results suggest that sloppy sensitivity spectra are universal in systems biology models. The prevalence of sloppiness highlights the power of collective fits and suggests that modelers should focus on predictions rather than on parameters.

Explore related subjects

Keep this discovery

Explore connections, maps & timelines

BibTeXRIS

Ryan N. Gutenkunst, Joshua J. Waterfall, Fergal P. Casey, Kevin S. Brown, Christopher R. Myers, James P. Sethna. 2007-07-27. Universally Sloppy Parameter Sensitivities in Systems Biology. https://doi.org/10.1371/journal.pcbi.0030189

Cite the original work for its findings. Save a collection to share your selection of sources.

KEEP EXPLORING

Related papers

BreCol: Benchmarking Classical and Deep-Learning Methods for Microbiome-Based Cancer Detection

DNA sequencing of the gut microbial community shows promise for cancer detection, but questions remain about the generalizability of results across studies. We propose BreCol, a benchmark of 2,040 16S rRNA gene sequencing runs across 26 studies spanning breast cancer, colorectal cancer, and healthy cohorts. Train-test splits are made within pre-2023 studies, while holdout evaluation uses studies from 2023 onward, reflecting temporal separation from training data. Classical models reach test/holdout AUCs of 0.77/0.60 for cancer diagnosis and 1.00/0.83 for cancer type prediction. We train the models on both cancer types simultaneously and find that colorectal cancer is often easier to detect than breast cancer. We also evaluate two deep learning models: HyenaDNA, a long-range sequence model that pools hidden states for classification, and SetBERT, a transformer that produces contextualized embeddings over sets of reads. Both deep learning models underperform the best classical methods on holdout data, though tuning training set size and the classification head yields modest gains. Our classical pipeline uses unsupervised clustering to derive features from tetramer frequencies, preserving within-run compositional signal and achieving near state-of-the-art performance without relying on taxonomic assignments. BreCol data and associated code are publicly available.

q-bio.QM↗

Topological Inference for Organoids

The reproducibility of organ morphology and the extent to which computational models can predict morphogenesis remain difficult to quantify, particularly for organs with complex networks of fluid-filled lumina. Here, we combine Topological Data Analysis (TDA), biophysical simulation, and Bayesian inference to study lumen morphogenesis in pancreatic organoids. Lumen formation is governed by physical processes that are challenging to measure directly, including cell proliferation and luminal osmotic pressure. We simulate organoid development using a phase-field model and address the inverse problem of inferring these parameters from either time-lapse images or single morphological snapshots. Since lumen architectures vary substantially in size, structure, and connectivity, conventional geometric descriptors provide only a partial representation of their morphology. We therefore represent each organoid using SampEuler, a topological descriptor derived from the Euler Characteristic Transform (ECT). We first show that SampEuler captures morphological information encoded by established morphometrics. We then perform parameter inference using an approximate Bayesian computation (ABC) rejection framework with the SampEuler Wasserstein distance. Using synthetic organoids with known ground-truth parameters, our approach accurately recovers the osmotic pressure and the proliferation rate while revealing a compensatory trade-off between the two processes. Applied to experimental data from ten pancreatic organoids, the inferred posterior distributions are consistent with biological expectations. Together, these results establish a non-destructive, image-based pipeline for estimating otherwise inaccessible physical parameters governing lumen formation and highlight the potential of topological representations for linking complex biological morphology to mechanistic models.

q-bio.QM↗

Circadian Derived Features for Early Discrimination Across Insomnia Severity Levels: At Least 8 Weeks of Monitoring Are Needed for Clinically Meaningful Assessment

Background: Wearable devices provide continuous, objective measures of daily activity and offer promise for assessing sleep disorders. However, the minimum monitoring duration needed to differentiate insomnia severity remains unclear. We investigated when wearable-derived behavioral features become informative for distinguishing Insomnia Severity Index (ISI) categories and examined the contribution of Activity Count (AC) and circadian-derived features. Methods: We analyzed wearable data from 2,305 participants in the Advancing Understanding of Recovery after Trauma (AURORA) study. Separate binary classifiers were developed for four ISI categories across six follow-up periods using AC and circadian-derived feature sets. Performance was evaluated using accuracy, F1-score, precision, recall, and AUROC. Results: Classification improved with longer monitoring. Across ISI categories, approximately eight weeks was the earliest time point at which wearable-derived features consistently achieved informative discrimination, with modest improvements thereafter. Participants without clinically significant insomnia were easiest to identify, reaching an AUROC of 0.693. Circadian-derived features performed comparably to, and in several cases better than, AC features, suggesting that the temporal organization of daily activity provides information beyond overall activity volume. Conclusions: Approximately eight weeks of longitudinal wearable monitoring may represent a practical minimum for differentiating ISI-defined insomnia categories. Longer monitoring provided only incremental improvements. Circadian behavioral features show promise as digital biomarkers for objective insomnia assessment.

q-bio.QM↗