Search arXiv⌕ Search
Home/Archive/arXiv

arXiv · 1707.00222

Sample Size for Pilot Studies and Precision Driven Experiments

C. O. S. Sorzano·D. Tabas-Madrid·F. Núñez·C. Fernández-Criado·A. Naranjo
View original source ↗Read source document ↗Export metadata ↓

Abstract

Pilot studies are highly recommended in experiments with animals when little is known about the anticipated values of the mean of the variable under study, its variance or the probability of response. They are also recommended to test the feasibility of the animal model or the experimental technique. However, the sample size required for a pilot study has received little attention and typical sizes practically used go from 5 to 20 animals disregarding any statistical consideration. Pilot studies are a particular case of precision driven experiments in which the sample size is designed according to a desired precision. In this article we provide some statistical guidance on the selection of the sample size of a pilot study whose driving force is the accuracy desired for the determination of the unknown parameters. We provide formulas and design tables for the sample size when trying to determine the standard deviation of a population, its mean, the probability of a certain feature or event, the correlation between two variables, and the survival time before an event occurs. All the calculations performed in this article can also be freely performed on the web through the online calculator available at http://i2pc.es/coss/Programs/SampleSizeCalculator/index.html. An immediate consequence of our analysis is that typical pilot sizes (5-20) are normally result in a very small precision and that the researcher should be aware of this fact before carrying out a pilot study.

Explore related subjects

stat.AP

Keep this discovery

Explore connections, maps & timelines

BibTeXRIS

C. O. S. Sorzano, D. Tabas-Madrid, F. Núñez, C. Fernández-Criado, A. Naranjo. 2018-03-18. Sample Size for Pilot Studies and Precision Driven Experiments. https://arxiv.org/abs/1707.00222

Cite the original work for its findings. Save a collection to share your selection of sources.

KEEP EXPLORING

Related papers

arXiv2026

Relegation, promotion and the components of scoring in water polo

Relegation, not the championship, decides the outcome of many European water polo leagues: one club has won every recent national title in Italy, Spain and Hungary. We make the relegation decision our object of inference. Serie A1 relegates one club for finishing last and a second through a three-match play-out, and we ask at each stage how much can be known and when. Promoted clubs arrive with no top-flight record, so we also compare four ways of setting their prior. These analyses rest on the first Bayesian hierarchical model of water polo, which splits scoring into even-strength, man-up and penalty components, models opportunities and conversions separately, and lets abilities evolve between seasons. Treating the components as independent proves untenable, since they compete for a common budget of possessions. Fitted to a new dataset of 940 matches, the model identifies the directly relegated club from the ninth round, before the league table does, predicts the play-out field better than the table, and shows the play-out itself to be close to a coin toss. Promoted clubs start below the league on every component except drawing exclusions: knowing a club was promoted improves forecasts; knowing how does not.

stat.AP↗
arXiv2026

Geospatial Foundation Models Capture Health-Relevant Dimensions of Place Beyond Conventional Social Risk Indices

Area-based social risk indices summarize residents' socioeconomic conditions but incompletely capture physical features of place that may affect health. We evaluated whether numerical representations of physical place produced by four geospatial foundation model families from 2022 satellite data explained residual variance in tract-level associations between the Area Deprivation Index, Social Deprivation Index, and Social Vulnerability Index with health outcomes. We used LightGBM to predict variables from the American Community Survey and 40 chronic disease and health-behavior outcomes from CDC PLACES across 82,646 census tracts in the contiguous United States, evaluating performance across 10 held-out states. Among survey variables, models were moderately predictive of some variables including housing type (R-squared up to 0.54) but weak for disability, unemployment, and income disparity. For health outcomes, models explained up to 54% of variance left unexplained by social risk indices, with the largest gains for annual checkups, arthritis, and high blood pressure. Mean total variance explained by geospatial foundation models across the 40 health-related outcomes increased from 0.31 in the smallest tract-size decile to 0.39 in the largest. Geospatial foundation models capture health-relevant features of place not represented by conventional social risk indices and may usefully augment them in epidemiological analyses.

stat.AP↗
arXiv2026

Transporting summary measures of relative effects from randomised trials to the treated patient population: an application to breast cancer endocrine therapy

Randomised trials often report relative treatment effects, such as risk ratios and hazard ratios, for trial populations. Clinical decision-making, however, often benefits from estimates of absolute treatment effects in the population eligible for treatment. Trial participants may not represent this target population well, and restrictions on access to individual participant trial data can further complicate absolute effect estimation. Routine care data are often representative of the target population but may be subject to uncontrolled confounding. We consider estimation of the average treatment effect on the treated (ATT), an absolute measure, by combining a representative sample of treated routine care patients with summary measures (i.e., estimated risk or hazard ratios) from either a randomised trial or a meta-analysis of trials. Under marginal or conditional transportability assumptions, the ATT is shown to be identifiable. The implications of collapsibility of the effect measure on transportability are discussed, and plug-in estimators of the ATT are presented. Simulation studies are used to assess finite sample performance of the estimators in a range of settings. The proposed methods are applied to estimate the ATT of endocrine therapy on 15-year breast cancer mortality using results from a meta-analysis of randomised trials and England's National Disease Registration Service.

stat.AP↗