Search arXiv⌕ Search

arXiv · 2610.27354

A plug-in estimator of the non-iterative conditional expectation g-formula using long short-term memory models

Abstract

The non-iterative conditional expectation (NICE) plug-in estimator of the g-formula can be used to estimate the causal effects of sustained treatment strategies, even in the presence of treatment-confounder feedback, under the assumptions of exchangeability, positivity, and consistency. In practical applications, parametric models are commonly used to estimate the joint distribution of confounders, treatments, and outcomes over time. As an alternative to parametric models, long short-term memory (LSTM) models, designed to capture both short-term patterns and long-range dependencies in sequential data, may better accommodate complex temporal dependencies among time-varying confounders, treatments, and outcomes. However, the validity of statistical inferences of a plug-in estimator based on LSTM models has not yet been investigated. Here, we provide proof of principle that, under a complex data generation mechanism that resembles data from a cohort of persons with HIV and sufficiently large sample sizes, an LSTM-based NICE g-formula plug-in estimator results in less bias than parametric estimators while achieving near-nominal coverage for 95\% confidence intervals. This work is intended to spur the development of a theoretical framework that encompasses deep learning plug-in estimators for causal inference based on high-dimensional longitudinal data.

Explore related subjects

Keep this discovery

Explore connections, maps & timelines

BibTeXRIS

Jing Li, Sophia M. Rein, Zilong Wang, Zixiao Wang, Sean McGrath, James M. Robins, Thomas Kolokotrones, Rajarshi Mukherjee, Miguel A. Hernán. 2026-10-19. A plug-in estimator of the non-iterative conditional expectation g-formula using long short-term memory models. https://arxiv.org/abs/2610.27354

Cite the original work for its findings. Save a collection to share your selection of sources.

KEEP EXPLORING

Related papers

Causal Inference Under Network Interference

We review the growing body of research on the challenging topic of interference in causal inference. Interference arises when the treatment assignments of connected units affect the outcomes of other units directly (via spillover) or indirectly (via contagion). Examples include public health, economic, political, or educational interventions, as well as advertising on social media. Adapting the Neyman-Rubin potential outcome framework, we review selected causal effects under interference and discuss identification of causal effects based on experimental and observational data. We then review statistical tests for interference and causal effects, design- and model-based estimators for causal effects, and methodological challenges, including variance reduction, unknown interference graphs, and misspecified exposure mappings. We conclude with a discussion of the scope of causal conclusions based on fixed and random potential outcomes and interference graphs. While the fixed potential outcome framework is sufficient in many applications, the random potential outcome framework can be useful when the data fall short. Examples include causal inference for heterogeneous treatment effects and external validity, including generalizability and transportability.

stat.ME↗

Can discrete-time analyses be trusted for stepped wedge trials with continuous recruitment?

In stepped wedge cluster randomized trials (SW-CRTs), the intervention is rolled out to clusters sequentially over multiple periods. It is common practice to analyze data from SW-CRTs using linear mixed models that treat time as discrete. However, a recent systematic review found that 95.1\% of cross-sectional SW-CRTs recruit individuals continuously over time. Despite the prevalence of continuous recruitment, there has been limited guidance on how to draw model-robust inference for such designs. In this article, we conduct simulation studies to examine the performance of discrete-time linear mixed models in the case of continuous recruitment designs with a continuous outcome. Specifically, we generate outcomes under a continuous-time exponential decay correlation structure with either discrete or continuous fixed period effects. We consider constant and exposure-time-dependent intervention effects, with and without random intervention effects across clusters. We then analyze the simulated data using linear mixed models under three discrete-time working correlation structures: simple exchangeable, nested exchangeable, and discrete-time exponential decay, with robust sandwich variance estimation. Our results demonstrate that discrete-time analysis often yields negligible bias and that the robust variance estimator with the Mancl and DeRouen correction consistently achieves nominal coverage and type I error rate. However, when recruitment patterns vary systematically between control and intervention periods, discrete-time analyses give slightly biased intervention effect estimates. Finally, we illustrate these findings by reanalyzing a completed SW-CRT.

stat.ME↗

Automated selection of $r$ in $r$-largest order statistics models: finite-sample performance and return-level inference

Selecting the number $r$ of upper order statistics is a key practical issue in fitting $r$-largest order statistics models. The entropy difference test for selecting $r$ relies on a large-sample approximation. The score test can be used for small samples but is computationally demanding. To obtain a fast method that is also applicable to small samples, we propose a method based on the conditional cumulative distribution function (CCDF), which applies a sequence of Cramér--von Mises goodness-of-fit tests. The tests are calibrated by a parametric bootstrap in which each refit is replaced by a single Newton step, so the computation remains fast. We also revisit the spacings test and show that the two test statistics become nearly identical as $r$ increases. Monte Carlo simulations show that the CCDF test has accurate size and good power in small and moderate samples. Further simulations show that a few additional order statistics can reduce the error of return-level estimates compared with those obtained from the block maxima only. The method is illustrated using rainfall data from Sancheong, Korea.

stat.ME↗