Search arXiv⌕ Search

arXiv · 2609.34482

Risk-Calibrated Balancing for High-Dimensional Causal Extrapolation

Abstract

In observational causal inference, covariate balancing is widely used to reduce source-target covariate shift, but under weak overlap in high dimensions, stronger balance can induce concentrated weights and increase variance. Balance measures how well the target covariate distribution is represented, but does not by itself determine how reliably the counterfactual mean can be estimated. We develop risk-calibrated balancing for the average treatment effect on the treated, which applies ridge augmentation to any normalised base weights and selects its penalty using conditional prediction risk of the counterfactual mean. Under a random-effects predictive model, we derive an exact finite-sample decomposition of this risk into residual covariate imbalance and weight-induced variance. For design-independent base weights under proportional asymptotics, we characterise how limiting risk depends on source and target covariance geometry, population mean shift, and weight concentration. For covariate-adaptive base weights, we develop a uniformly consistent target-aware risk estimator whose minimiser attains vanishing scaled oracle excess risk. Simulations show that the high-dimensional risk predictions remain informative for adaptive balancing and that target-aware tuning generally reduces excess target risk. Empirical analyses of job-training and single-cell perturbation data show that risk-calibrated balancing generally improves on the corresponding base estimators, with larger gains under weaker overlap.

Explore related subjects

Keep this discovery

Explore connections, maps & timelines

BibTeXRIS

Fenglin Yang, Haoran Lei, Yan Chen, Jin-Hong Du. 2026-09-28. Risk-Calibrated Balancing for High-Dimensional Causal Extrapolation. https://arxiv.org/abs/2609.34482

Cite the original work for its findings. Save a collection to share your selection of sources.

KEEP EXPLORING

Related papers

Univariate-Guided Interaction Modeling

We propose a procedure for sparse regression with pairwise interactions, by generalizing the Univariate Guided Sparse Regression (UniLasso) methodology. A central contribution is our introduction of TripletScan, which screens a pair $(j,k)$ using the coefficient of $X_jX_k$ in the local regression of the response on $1$, $X_j$, $X_k$, and $X_jX_k$. The retained products are incorporated either jointly with the main effects through UniLasso, yielding uniPairs, or after a first-stage main-effects fit, yielding uniPairs-2stage. For the UniLasso components of the procedures, we prove false-positive exclusion and uniform coefficient-error bounds. In simulations and an HIV drug-resistance application, the proposed procedures produce substantially smaller fitted models than competing interaction methods while retaining competitive predictive performance.

stat.ME↗

Factoring A-Optimality into D-Optimality and Sphericity

The D criterion measures the volume of the joint confidence ellipsoid for the linear model coefficients and ignores its shape, so designs with the same D value can estimate individual effects with different variances. Meanwhile, A-optimality minimizes average coefficient variance. With both criteria expressed as information values, A equals D multiplied by a sphericity index for the same ellipsoid. In a fixed coefficient basis, sphericity further factors into coefficient-variance balance and a determinant-based correlation component. In five published screening comparisons, the A-optimal design has a larger correlation component despite slightly poorer variance balance; in three it also has a smaller D value. In a seven-run family of designs that all tie under D, the two with equal coefficient variances have the lowest A value. Both sphericity components can be calculated directly from standard errors and estimate correlations available in statistical software. After whitening by a prediction moment matrix, the same determinant-sphericity factorization applies to the I-criterion.

stat.ME↗

Testing the equality of parameters in fixed and increasing dimension

This paper proposes a general and unified framework for testing the equality of a broad class of parameters, defined as a smooth function of expectations of symmetric kernels, across multiple independent populations. We consider two test statistics, a Wald-type statistic and an ANOVA-type statistic. The asymptotic distribution of the first one is derived under a fixed-dimension regime, whereas the second one is studied under both fixed and increasing-dimension regimes, where the parameter dimension diverges with the sample size. Based on these limiting distributions, we construct test procedures enabling asymptotically exact inference without parametric assumptions. Additionally, an alternative null distribution estimator based on a weighted bootstrap approximation is studied, which is applicable to the ANOVA-type statistic under a fixed-dimension regime. The finite-sample performance and computational efficiency of the proposed procedures are evaluated through an extensive simulation study and a real dataset application.

stat.ME↗