Search arXiv⌕ Search
Home/Archive/arXiv

arXiv · 2508.06288

Comparing Methods of Expert Elicitation for Treatment Effect or Borrowing Parameters in Standard and Rare Disease Clinical Trials: A Systematic Mapping Study

Laura M. Morgan·James M. S. Wason·Kevin J. Wilson·Nina Wilson
View original source ↗Read source document ↗Export metadata ↓

Abstract

Expert elicitation is an invaluable tool for gaining insights into the degree of clinical knowledge surrounding parameters of interest when designing, or supplementing trial data when analysing, a clinical trial. Elicitation is considered particularly useful in cases where limited data are available, such as in rare diseases. This study aims to identify methods of expert elicitation and aggregation for treatment effect or borrowing parameters that are used in the design or analysis stages of clinical trials. A comprehensive review of statistical and non-statistical literature was conducted by database searching, and reference list screening of older, relevant literature reviews. The search took place in October 2024 and identified 366 potentially relevant publications. Of these, 126 were selected for full-text review based on review of titles and abstracts, and 41 publications were deemed eligible for inclusion after a full reading. For each included publication, data were extracted on methods of elicitation and aggregation, the types of parameters elicited, the resulting distributions, the number of experts used, and any training provided to experts. Publication characteristics such as contribution type, journal type, and application to the rare disease setting was also noted. A narrative description of the selected publications was produced, detailing 6 unique methods for expert elicitation and 10 unique methods for aggregation. We discuss the most popular methods used across standard and rare disease clinical trials, along with any strengths and limitations. Overall, there is no formal framework for expert elicitation in clinical trials, and more general methods are applied with little consideration into the specific context and trial designs. This review identifies the methodological gaps in current practice, providing a foundation for future development.

Explore related subjects

stat.AP

Keep this discovery

Explore connections, maps & timelines

BibTeXRIS

Laura M. Morgan, James M. S. Wason, Kevin J. Wilson, Nina Wilson. 2025-08-08. Comparing Methods of Expert Elicitation for Treatment Effect or Borrowing Parameters in Standard and Rare Disease Clinical Trials: A Systematic Mapping Study. https://arxiv.org/abs/2508.06288

Cite the original work for its findings. Save a collection to share your selection of sources.

KEEP EXPLORING

Related papers

arXiv2026

From Metrics to Decisions in NBA Analytics: A Critical Integrative Review and Decision-Readiness Framework

National Basketball Association (NBA) teams have increasingly detailed metrics, but better predictions do not necessarily improve decisions. This critical integrative review draws on prior reviews, citation tracing, and topic searches across seven research streams: on-court action, player value, role, lineup synergy, availability, draft and development, and contracts and roster construction. An observation-state-action-decision-evaluation chain organizes the synthesis. Six decision-readiness gates guide our assessment: point-in-time validity, uncertainty, context portability, action feasibility, opportunity-set observability, and evaluation, with requirements matched to each claim. The reviewed literature is strongest in measuring and predicting individual components of a decision. Evidence is less developed at interfaces that combine components, transfer them across settings, and compare feasible actions. We outline a proposed deployment workflow, a reporting contract, and a research agenda covering player transport, role substitution, roster fragility, legal action generation, and asset valuation. The 2023 collective bargaining agreement and forthcoming 3-2-1 Draft Lottery illustrate how institutional changes generate research questions. Models should inform evaluable comparisons of feasible choices. While its effect on organizational decision quality remains an empirical question, the framework provides a diagnostic and reporting structure for matching decision claims to evidence requirements.

stat.AP↗
arXiv2026

Bayesian calibration of adaptive-behavior SIR models for multi-wave COVID-19 incidence in New York City

Epidemic incidence reflects both transmission dynamics and adaptive human behavior, yet these mechanisms may be difficult to distinguish from aggregate case data alone. We calibrated four susceptible--infected--recovered (SIR) specifications to weekly confirmed COVID-19 incidence in New York City from June to December 2020, comparing a single continuous SIR trajectory, a wave-initialized SIR model, and two adaptive-behavior models with either shared or wave-specific transmission. Inference was performed using rejection Approximate Bayesian Computation (ABC), and in-sample reconstruction was assessed using root mean squared error (RMSE) and the weighted interval score (WIS). Reinitializing the epidemic state by wave produced the largest structural improvement over the continuous SIR trajectory, reducing mean-based RMSE by 48.6\% and WIS by 17.6\%. Adding delayed prevalence-dependent behavioral adaptation with shared transmission further reduced mean-based RMSE by 23.4\%, but yielded essentially unchanged WIS relative to the wave-initialized SIR model. Allowing transmission to vary by wave did not provide a consistent additional advantage and produced strongly asymmetric posterior-simulation trajectories. Behavioral sensitivity, response midpoint, and delay remained only weakly to partially identified. The clearest posterior structure was a negative association between transmission intensity and the behavioral midpoint, indicating that higher transmission could be compensated by behavioral responses activated at lower prevalence. Sensitivity to ordered behavioral priors further showed that reconstruction and behavioral inference depend materially on structural prior assumptions. These results suggest that adaptive mechanisms can improve multi-wave incidence reconstruction, while aggregate incidence alone is insufficient to sharply separate transmission from behavioral adaptation.

stat.AP↗
arXiv2026

Short-term rental market occupancy - daily time series for 2017-2022 on 500 markets worldwide

Short-term vacation rentals, as promoted by platforms such as Airbnb, Homeaway, Vrbo, etc., are a growing component of the travel industry. This paper provides a unique, large dataset on global market occupancy for the short-term rental market using data from the American company Wheelhouse. The dataset consists of data for $500$ markets around the world. For each market, a daily occupancy time series from January $2017$ to December $2022$ is provided, allowing for studies of local and global patterns in the evolution of the short-term rental market. Additionally, the dataset includes curves representing the booking trajectory of each market and stay date up to one year prior to the stay date. This large dataset comprises a unique combination of time series and survival analysis data, and is suitable as a methodological benchmark for both classical statistical and machine learning models.

stat.AP↗