Search arXiv⌕ Search
Home/Archive/arXiv

arXiv · 2105.12893

Calibrating Over-Parametrized Simulation Models: A Framework via Eligibility Set

Yuanlu Bai·Tucker Balch·Haoxian Chen·Danial Dervovic·Henry Lam·Svitlana Vyetrenko
View original source ↗Read source document ↗Export metadata ↓

Abstract

Stochastic simulation aims to compute output performance for complex models that lack analytical tractability. To ensure accurate prediction, the model needs to be calibrated and validated against real data. Conventional methods approach these tasks by assessing the model-data match via simple hypothesis tests or distance minimization in an ad hoc fashion, but they can encounter challenges arising from non-identifiability and high dimensionality. In this paper, we investigate a framework to develop calibration schemes that satisfy rigorous frequentist statistical guarantees, via a basic notion that we call eligibility set designed to bypass non-identifiability via a set-based estimation. We investigate a feature extraction-then-aggregation approach to construct these sets that target at multivariate outputs. We demonstrate our methodology on several numerical examples, including an application to calibration of a limit order book market simulator (ABIDES).

Explore related subjects

stat.MEcs.CEcs.LG

Keep this discovery

BibTeXRIS

Yuanlu Bai, Tucker Balch, Haoxian Chen, Danial Dervovic, Henry Lam, Svitlana Vyetrenko. 2021-05-27. Calibrating Over-Parametrized Simulation Models: A Framework via Eligibility Set. https://doi.org/10.1145/3742427

Cite the original work for its findings. Save a collection to share your selection of sources.

Discover connections

cs.CE subjectcs.LG subjectstat.ME subject

Connections use source metadata and explicit phrase matches, not verified experimental comparisons.

KEEP EXPLORING

Related papers

arXiv2026

Robust topology optimization with non-Gaussian material fields using polygonal finite elements

We present a computational framework for robust topology optimization that integrates polygonal finite-element discretizations, spatially correlated non-Gaussian material modeling, and non-intrusive polynomial-chaos surrogates. Spatial uncertainty in Young's modulus is represented as a homogeneous non-Gaussian random field obtained via a memoryless transformation of a truncated Karhunen-Loève expansion, ensuring physical admissibility through positivity of stiffness while preserving the prescribed autocovariance. Polygonal finite elements provide a stable discretization for density-based optimization on unstructured meshes and mitigate checkerboard artefacts and mesh bias, while the sparse polynomial-chaos expansion enables efficient estimation of low-order statistical moments required by the robust objective at a fraction of the cost of intrusive or Monte Carlo approaches. Numerical studies on a cantilever and a curved beam show that introducing non-Gaussian material variability leads to systematic load-path redistribution and a reallocation of 6-12% of the structural volume, together with a reduction in compliance scatter. The non-intrusive surrogate reproduces intrusive reference results within 3% using an order of magnitude fewer full finite-element analyses. These results demonstrate that the proposed framework offers a physically consistent and computationally efficient route to topology-optimized designs that remain reliable under realistic material uncertainty.

cs.CE↗
arXiv2026

Clustering Three-Way Data with Outliers

Matrix-variate distributions are a relatively recent addition to the model-based clustering literature, thereby making it possible to analyze data in matrix form with complex structure such as images and time series. Due to its recent appearance, there is limited literature on matrix-variate data, with even less on dealing with outliers in these models. An approach for clustering matrix-variate normal data with outliers is discussed. The approach, which uses the distribution of subset log-likelihoods, extends the OCLUST algorithm to matrix-variate normal data and uses an iterative approach to detect and trim outliers.

stat.ML↗
arXiv2026

Learning a Size-Weight Frontier for Synthetic-Augmented Inference

Synthetic data can improve statistical inference when real data are scarce, but naively treating synthetic samples as real data can introduce bias and lead to unreliable inference. We develop a general framework for synthetic-augmented inference across a population of related tasks. It characterizes synthetic augmentation by the number of synthetic observations and their weight. Central to our framework is a size-weight frontier that specifies, for each weight, the largest synthetic sample size for which all smaller sizes attain the target task-marginal coverage. We estimate this frontier from historical tasks, and establish a finite-sample coverage guarantee simultaneously for all size-weight configurations on or below the estimated frontier. In experiments using large language model responses to augment opinion survey data, our procedure achieves target coverage and substantially narrows confidence intervals.

stat.ME↗