Search arXiv⌕ Search

arXiv · 2610.36222

Relaxed MEMs: Enhancing Borrowing in Multisource Exchangeability Models for Small Sample Applications

Abstract

Information sharing in clinical trials provides a promising way to increase trial efficiency, specifically in rare disease settings where sample sizes are small. Multisource Exchangeability Modeling (MEM) is a method that incorporates historical data from potentially multiple data sources, such as past trials, by exploring all possible configurations of exchangeability and provides a weight estimate for each configuration, allowing the user to quantify how much is being borrowed from each source. While MEMs have previously been shown to be asymptotically consistent, small sample sizes introduce uncertainty that naturally limits the amount of borrowing MEMs can facilitate. The proposed ``relaxed MEMs'' provide a mathematical framework for relaxing or removing those limits and allowing greater borrowing even in small-sample settings. Several relaxed MEM versions are proposed, and all strategies provide enhanced borrowing with minimal sacrifice in the bias and variance of the mean estimates. Specifically, the maximum absolute mean bias was 3.5\% (0.035) of the true mean in the two source continuous outcome settings and 6.4\% (0.032) of the true proportion in the two source binary outcome settings (absolute mean bias was 1.4\% (0.014) and 3.6\% (0.018), respectively, for traditional MEMs) and variance decreased relative to traditional MEMs across all exchangeable and small difference scenarios. The methods were then demonstrated using two endpoints from a series of phase II trials in cystic fibrosis.

Explore related subjects

Keep this discovery

Explore connections, maps & timelines

BibTeXRIS

Shannon D. Thomas, Alexander M. Kaizer. 2026-10-26. Relaxed MEMs: Enhancing Borrowing in Multisource Exchangeability Models for Small Sample Applications. https://arxiv.org/abs/2610.36222

Cite the original work for its findings. Save a collection to share your selection of sources.

KEEP EXPLORING

Related papers

A multistate approach to disability insurance reserving with information delays

Disability insurance claims are often affected by lengthy reporting delays and adjudication processes. The classic multistate life insurance modeling framework is ill-suited to handle such information delays since the cash flow and available information can no longer be based on the biometric multistate process determining the contractual payments. We propose a new individual reserving model for disability insurance schemes which describes the claim evolution in real-time. Under suitable independence assumptions between the available information and the underlying biometric multistate process, we show that these new reserves may be calculated as natural modifications of the classic reserves. For estimation of the model constituents, we employ the procedure proposed in [Buchardt, K., Furrer, C., & Sandqvist, O. L. (2025). Estimation for multistate models subject to reporting delays and incomplete event adjudication. The Annals of Applied Statistics, 19(4), 2782-2802. https://doi.org/10.1214/25-AOAS2068]. A real data application illustrates how the proposed estimation and reserving methods can be implemented and compares the resulting reserves with simpler reserving approaches.

stat.AP↗

Improving causal inference in interrupted time series analysis: the triple difference design

Background: Interrupted time series analysis (ITSA) is widely used to evaluate health policy and intervention effects. While multiple-group ITSA (MG-ITSA) improves causal inference by incorporating a control group, residual confounding from unmeasured time-varying factors may remain. The triple-difference interrupted time series (DDD-ITSA) design extends this approach by adding a second control group to further isolate treatment effects, but it remains underutilized and lacks formal guidance. Methods: We formalize the DDD-ITSA framework, specify the regression model, define key parameters for estimating level and trend effects, and clarify interpretation of the triple-difference estimand. We illustrate the approach using a worked example evaluating California's Proposition 99 cigarette tax and its impact on per-capita cigarette sales. Results: In the example, all groups were balanced on pre-intervention level and trend. The triple-difference estimand indicated a statistically significant annual reduction of -1.76 per-capita cigarette packs in California relative to the secondary control (P = 0.020; 95 percent CI: -3.24, -0.28), consistent with results from the primary comparison. Differences between control groups were not significant. Conclusions: DDD-ITSA strengthens causal inference when two-group comparisons may be confounded by leveraging an additional control group to remove remaining biases and assess heterogeneity. Implementation is facilitated by updates to the itsa Stata package. Careful attention to control selection, baseline balance, and autocorrelation remains essential.

stat.AP↗

Leveraging Large Language Models to Improve Precision in Randomized Controlled Trials

Large language models (LLMs) are increasingly used in statistical research and applications. However, they are also notorious for unreliable or biased information. Here, we explore whether LLMs can be used to improve the precision of randomized controlled trials (RCTs) in a safe and rigorous way. We consider two pathways for incorporating LLM assistance: (1) using LLMs to transform non-standard covariates, such as text, into numerical representations, and (2) leveraging the general knowledge embedded in LLMs to generate predicted outcomes. Although external data sources have been leveraged to improve precision before, the value added by LLM-generated predictions through these pathways remains an open question. We develop a pipeline for generally leveraging LLMs in this context and apply it to three different case studies. We find that we are able to safely improve precision, primarily through transforming non-standard covariates, but that LLMs also possess general knowledge that is useful in some contexts.

stat.AP↗