Search arXiv⌕ Search

arXiv · 2610.02944

Cross-Fitting Under Nonregularity: Normality and Inference via Locality

Abstract

Cross-fitting is routine in much of applied research. While conventional confidence intervals that ignore cross-fold dependence are asymptotically valid in several settings, they undercover in many applications that share a common form of nonregularity: from the classic cross-validation problem of testing whether a fitted model outperforms another, to testing for heterogeneous treatment effects with machine learning, to estimating the value of a potentially non-unique optimal treatment regime. Exploiting a new locality condition, I show that a large class of cross-fitting estimators still satisfies a central limit theorem despite the nonregularity, but with an asymptotic variance that must be adjusted for the cross-fold correlation. Then, I propose a method for estimating this correlation and construct new confidence intervals that attain asymptotically nominal coverage. Finally, I show that the proposed confidence intervals attain approximately nominal coverage in a simulation study with random forests and neural networks.

Explore related subjects

Keep this discovery

Explore connections, maps & timelines

BibTeXRIS

Bruno Fava. 2026-10-02. Cross-Fitting Under Nonregularity: Normality and Inference via Locality. https://arxiv.org/abs/2610.02944

Cite the original work for its findings. Save a collection to share your selection of sources.

KEEP EXPLORING

Related papers

Bootstrap Inference with a Randomly Assigned Regressor: Covariance Filtering and the Limits of Marginal Resampling

Random assignment can make ordinary least squares (OLS) inference insensitive to outcome dependence, yet iid resampling can still fail because assignment and resampling need not remove the same covariance terms. With binary treatment, the iid variance target differs from the sampling variance by exactly minus aggregate cross-unit covariance of treatment effects. Under a Gaussian first-order limit, positive covariance leads to over-rejection and negative covariance to under-rejection. Two designs can generate the same distribution for each observation but require variance corrections of opposite signs, so no marginal-only variance correction is first-order exact for both. For first-order Gaussian inference, only one covariance component---the covariance carried by the randomized-regressor score---must be recovered. Standard dependence estimators on that score restore validity under suitable ordered or grouped dependence conditions. In simulations with ordered data, fixed-bandwidth calibration reduces several large-bandwidth size distortions.

econ.EM↗

Matched Triple-Differences: A Framework for Covariate Adjustment

A common empirical strategy in triple-differences (DDD) is to include either covariate trends or covariate levels to a three-way fixed effects (3WFE) regression. This strategy is typically motivated by the conditional parallel gaps assumption which assumes that deviations from parallel trends are similar among units with comparable observed covariates. We formally study both 3WFE specifications and show that, in general, neither consistently estimates the average treatment effect on the treated (ATT). Our diagnosis has two parts. First, we show that the OLS estimands of both specifications fail to satisfy the covariate balancing condition that is sufficient for them to equal the ATT. Second, we characterize the additional assumptions for each OLS estimand to equal the ATT. To address these limitations, we propose a matched triple-differences framework that accommodates a general class of matching procedures, including nearest-neighbor matching and kernel matching. Within this framework, we construct a class of consistent matching estimators, establish their asymptotic normality, and provide a consistent variance estimator that accounts for the variability introduced by the matching step. Our empirical application shows that the proposed matched triple-differences estimator can yield estimates and qualitative conclusions that differ from those obtained using the 3WFE regression.

econ.EM↗

Forecasting the Price of Carbon with Macroeconomic and Financial variables

We tackle the issue of producing point, sign, and density forecasts for the monthly real price of carbon in the European Union Emissions Trading System (EU ETS). We show that Bayesian Vector Autoregressive (BVAR) models augmented with factors based on macroeconomic and financial variables yield improvements in point and density forecasting performance, with the largest point-forecast gains emerging at intermediate and longer horizons. In particular, the one-factor BVAR model provides lowest values at six and nine months ahead, while the baseline BVAR performs best at the one-year horizon. By contrast, a large BVAR including all predictors individually does not improve point forecast accuracy, supporting the use of parsimonious model specifications. Simple forecast pooling delivers modest gains from medium horizons onward, but does not mitigate the time variation in relative forecast performance. We also provide a qualitative comparison of model-based forecasts with survey expectations and forecasts released by data providers, which further highlights that relative forecast performance varies over time. Moreover, we consider verified emissions and show that stochastic volatility improves point forecasts, with reductions of about 6.5 to 7.1% at the one-year horizon. Lastly, we use model-based forecasts to construct market monitoring tools that track demand and price pressure in the EU ETS.

econ.EM↗