Identifying and Measuring Treatment-Effect Heterogeneity across Sites through Within-Site Randomization

Takahiro Hoshino

Home/Archive/arXiv

arXiv · 2610.15531

Identifying and Measuring Treatment-Effect Heterogeneity across Sites through Within-Site Randomization

Takahiro Hoshino

View original source ↗Read source document ↗Export metadata ↓

Abstract

Parallel cluster-randomized trials can identify mean effects by site characteristics and risk differences between fixed predictors, while leaving residual heterogeneity and absolute prediction risk (mean squared error of site-effect predictions) unidentified. We acquire missing same-site cross-arm information by randomizing participants within selected sites. Under randomized site selection with compatible participant reference distributions and intervention versions, we characterize necessary and sufficient observation patterns for quadratic targets in a model with unrestricted joint distributions of site response means. From finite independent participant samples, we construct unbiased moments and exact covariances. Under regularity conditions, we prove consistency as informative paired site counts grow, allowing fixed within-site sample sizes. For a fixed predictor, we optimize paired-site selection and unequal cell counts using corrected risk variances, pilot error, and costs. In an International Stroke Trial information-deletion experiment, pilot allocation reduces the conditional variance of reconstructing the complete-information corrected risk estimate by 34.3\% relative to uniform allocation with equal expected cost. In 40 Honduras villages, correction reduces estimated residual variation from 0.04081 to 0.00282 in squared log-consumption units for the same fixed explanatory basis; the explained share rises despite a smaller explained component, illustrating how participant sampling noise can inflate estimated residual variation.

Explore related subjects

stat.ME

Keep this discovery

Explore connections, maps & timelines

BibTeX RIS

Takahiro Hoshino. 2026-10-11. Identifying and Measuring Treatment-Effect Heterogeneity across Sites through Within-Site Randomization. https://arxiv.org/abs/2610.15531

Cite the original work for its findings. Save a collection to share your selection of sources.

KEEP EXPLORING

Related papers

arXiv2026

Principal stratification with continuous treatments and continuous post-treatment variables

Principal stratification (PS) is a commonly used approach for understanding the mechanisms through which a treatment affects an outcome. The goal of this work is to extend the PS framework to studies with continuous treatments, which introduces a number of both challenges and opportunities in terms of defining causal effects and performing inference. This manuscript provides multiple key methodological contributions: 1) we introduce principal causal estimands for continuous treatments that provide insights into different causal mechanisms, 2) we show that nonparametric identification is possible under a principal ignorability assumption, but only under a restrictive assumption on the joint distribution of potential mediators, which can be dropped under certain parametric assumptions, 3) we utilize nonparametric Bayesian models for the joint distribution of the potential mediating variables to mitigate issues from model misspecification, and 4) we provide theoretical justification for utilizing an outcome model to identify the joint distribution of the potential mediating variables, and show that this is only possible if a principal ignorability assumption is violated. Lastly, we illustrate our methodology by applying it to a novel study of the relationship between the economy and arrest rates, and how this is potentially mediated by police capacity.

stat.ME↗

arXiv2026

Controlling the false discovery rate in high-dimensional linear models using model-X knockoffs and $p$-values

We propose a novel multiple testing methodology for controlling the false discovery rate (FDR) in high-dimensional linear models that integrates model-X knockoff techniques with debiased penalized regression estimators. At the foundation of our methodology, we construct and study two sets of naturally paired high-dimensional test statistics and the associated $p$-values for evaluating the same null hypotheses. The first set is shown to be asymptotically mutually independent, justifying the use of the Benjamini-Hochberg procedure. We further exploit the pairing structure through a two-step procedure aimed at improving power. Our theoretical results establish the key properties of the framework with respect to asymptotic FDR control and formally characterize the associated power gains of the two-step procedure. Importantly, our framework accommodates general dependence in the design matrix. Extensive simulations demonstrate that our methods outperform existing approaches -- particularly those relying on empirical FDP estimates -- in both power and FDR control accuracy, with notable gains in settings involving weaker signals, small sample sizes, or low target FDR levels.

stat.ME↗

arXiv2026

Measuring frailty in the elderly: an indicator based on a super-classifier

Identifying frail older adults in an ageing population is essential for improving healthcare services. This study proposes a composite indicator to assess individual frailty levels using administrative healthcare data. Given the complex and multidimensional nature of frailty, a multi-outcome approach is adopted. Following an extensive literature review, a set of adverse health events is selected as proxies for frailty. These events were modelled using logistic classifiers, with frailty determinants (associated to adverse health events, selected using a gradient tree boosting) serving as covariates. The sensitivity and specificity of each classifier is used to compose their combined likelihood. From this, we derive an indicator capable of quantifying frailty across the population. The indicator shows robust performance across multiple outcomes and over time. Its primary innovation lies in allowing the use of diverse and outcome-specific sets of frailty determinants without any structural constraint. Overall, we offer an effective tool for quantifying frailty among older adults, potentially supporting health authorities in the prevention of frailty-related adverse events.

stat.ME↗