Scalable Nonparametric Change-Plane Regression with Random Features: Estimation and Inference

Wei Liu; Shaogao Lv

Home/Archive/arXiv

arXiv · 2610.13290

Scalable Nonparametric Change-Plane Regression with Random Features: Estimation and Inference

Wei Liu·Shaogao Lv

View original source ↗Read source document ↗Export metadata ↓

Abstract

Threshold and change-plane models provide a useful framework for capturing regime-dependent dynamics, but most existing approaches typically rely on scalar thresholds or linear splitting boundaries. We propose a scalable semiparametric change-plane regression framework that allows the regime boundary to depend nonlinearly on multivariate state variables. Random Fourier features provide a flexible and computationally efficient approximation to the nonlinear boundary function. A two-stage procedure first estimates the induced regime classification using a smooth surrogate and then refits the structural parameters by hard-threshold OLS. We establish convergence of the first-stage regime classification and show that its estimation error is asymptotically negligible for the second-stage refit, yielding oracle equivalence. We further develop a dependent-multiplier bootstrap Sup-Wald test for detecting the existence of regime effects when the boundary is unidentified under the null, and establish its asymptotic validity. Simulations demonstrate accurate regime recovery, near-oracle performance of the proposed estimator, and satisfactory finite-sample behavior of the Sup-Wald test. An application to postwar U.S. unemployment data provides strong evidence of regime dependence, while the estimated nonlinear change plane identifies a distinct stress regime characterized by significant shifts in short-run unemployment dynamics.

Explore related subjects

stat.ME

Keep this discovery

Explore connections, maps & timelines

BibTeX RIS

Wei Liu, Shaogao Lv. 2026-10-09. Scalable Nonparametric Change-Plane Regression with Random Features: Estimation and Inference. https://arxiv.org/abs/2610.13290

Cite the original work for its findings. Save a collection to share your selection of sources.

KEEP EXPLORING

Related papers

arXiv2026

Fully Bayesian Spectral Clustering and Benchmarking with Uncertainty Quantification for Small Area Estimation

In this work, inspired by machine learning techniques, we propose a new Bayesian model for Small Area Estimation (SAE), the Fay-Herriot model with Spectral Clustering (FH-SC). Unlike traditional approaches, clustering in FH-SC is based on spectral clustering algorithms that utilize external covariates, rather than geographical or administrative criteria. A major advantage of the FH-SC model is its flexibility in integrating existing SAE approaches, with or without clustering random effects. To enable benchmarking, we leverage the theoretical framework of posterior projections for constrained Bayesian inference and derive closed form expressions for the new Rao-Blackwell (RB) estimators of the posterior mean under the FH-SC model. Additionally, we introduce a novel measure of uncertainty for the benchmarked estimator, the Conditional Posterior Mean Square Error (CPMSE), which is generalizable to other Bayesian SAE estimators. We conduct model-based and data-based simulation studies to evaluate the frequentist properties of the CPMSE. The proposed methodology is motivated by a real case study involving the estimation of the proportion of households with internet access in the municipalities of Colombia. Finally, we also illustrate the advantages of FH-SC over existing Bayesian and frequentist approaches through our case study.

stat.ME↗

arXiv2026

Anchored multiple testing: a transparent use of e-closure to improve FDR procedures

The recent e-closure method can recover every procedure that controls FDR (and other expectation losses). But the recovered e-collection is ``self-referential'' and gives no insight on how to improve the procedure (if improvable), and some recent improvements have been somewhat opaque. We introduce an elementary new technique called anchoring that exploits looseness in existing FDR proofs to enlarge a baseline multiple-testing procedure's self-referential local e-value. The resulting e-closure thus transparently retains every baseline discovery (and usually adding more) and controlling the false discovery rate under the same conditions as the baseline. To show that this principle is broadly applicable, we use it to improve a large suite of multiple testing procedures: (i) Anchored-BH dominates the Benjamini-Hochberg (BH) procedure under PRDS while being incomparable to Goeman's recent closed-BH, (ii) Anchored-BY dominates the Benjamini-Yekutieli (BY) procedure under arbitrary dependence while being incomparable to closed-BY, (iii) For two-sided Gaussian p-values (under appropriate covariance conditions), Anchored-2BH dominates running BH twice at half the level on two one-sided p-values, (iv) Anchored-dBH dominates dependence-adjusted BH, (v) Anchored e-BH dominates e-BH and is incomparable to closed e-BH, (vi) Anchored SeqStep+ improves the original (including selective and adpative variants) while preserving ordered rejection structures. All of these are accomplished in sorting or quadratic time. The appendix shows how to dominate Shifted-BH (for two-sided arbitrarily correlated Gaussians) and NDBH (for negatively dependent p-values), IndBH (for graph-dependent p-values), some online FDR procedures and the support line procedure for boundary FDR control.

stat.ME↗

arXiv2026

Prior-Informed Generalizable Low-Rank Representation Learning via Regularized Adversarial Reweighting

Modern learning problems increasingly leverage data from heterogeneous sources to improve robustness and generalizability under distribution shift, often with high-dimensional parameters admitting low-rank structure. Existing group distributionally robust optimization (group-DRO) approaches optimize against adverse source mixtures, but extending this principle to low-rank matrix estimation with a broad class of losses leads to a challenging nonconvex-concave problem for which methods and theory remain limited. We propose Prior-Informed generalizable Low-rank representation Learning via Adversarial Reweighting (PILLAR), which smooths the group-DRO objective by regularizing adversarial source weights toward a user-specified reference distribution while learning a shared low-rank representation. By tempering extreme adversarial reweighting, PILLAR improves estimation stability and reduces the potential conservativeness of group-DRO. Using Burer-Monteiro factorization, we optimize the nonconvex-concave objective by bifactored gradient descent with mirror ascent. We establish linear convergence to a statistical neighborhood of the population saddle point and derive an error bound that separates low-rank estimation from adversarial reweighting. We further show that PILLAR improves on vanilla group DRO when the latter's excess conservativeness dominates source heterogeneity and prior misspecification. Simulations and an electronic health record study of suicide-attempt risk demonstrate improved worst-source and transported predictive accuracy.

stat.ME↗