Search arXiv⌕ Search

arXiv · 2610.04181

Score-based confidence intervals for variance-covariance parameters in linear mixed models

Abstract

We propose confidence intervals with near-nominal coverage of variance-covariance parameters in linear mixed models, even when interest or nuisance parameters are near the boundary, that is, when some random effects have small variances or are strongly correlated. In such settings, our simulations show standard Wald, likelihood ratio, and score intervals with nominal level 95% can have coverage as low as 45% and as high as 99%, while the proposed intervals are near nominal. The proposed intervals invert a modified profile score statistic based on the restricted likelihood, with nuisance parameters estimated on an extended parameter set. In a longitudinal study of socialization in children with autism, where the estimated correlation between the random intercept and slope is near minus one, our intervals show that children who start higher improve more slowly. In a genetic study of white blood cell count in mice, they distinguish the contributions of variant classes even though several intervals include zero. Compared to universal inference intervals, which are valid in finite samples, ours are 1.7 to 3.1 times narrower, and finite where one universal interval is not, at a forty-seventh of the computing time. We establish asymptotically correct coverage uniformly in the parameter under a condition known to hold with independent clusters and crossed random effects.

Explore related subjects

Keep this discovery

Explore connections, maps & timelines

BibTeXRIS

Matias Shedden, Karl Oskar Ekvall. 2026-10-03. Score-based confidence intervals for variance-covariance parameters in linear mixed models. https://arxiv.org/abs/2610.04181

Cite the original work for its findings. Save a collection to share your selection of sources.

KEEP EXPLORING

Related papers

Direct estimation and inference of differential Granger causality between two high-dimensional time series

Comparing dependence structures between two related multivariate time series is of fundamental interest in many scientific applications, where changes may occur in both directed temporal interactions and contemporaneous connectivity. Modeling each time series by a vector autoregressive (VAR) model, we propose a new framework for estimation and inference of differential Granger causality (DiffGC) and differential network (DiffNet) structures in high dimensions. The proposed method is based on a novel estimating equation derived from the Yule-Walker equations that directly links the difference between VAR transition matrices to the corresponding difference between precision matrices. Unlike separate estimation strategies that estimate the two VAR models individually and then take their difference, the proposed method directly targets the differential structures and requires sparsity only of the differences, thereby accommodating potentially dense individual networks, including hub structures. Building on the direct estimators, we develop selective inference procedures for both DiffNet and DiffGC parameters, providing valid post-selection inference while accounting for the data-driven screening process. Theoretically, we establish convergence rates and support recovery guarantees for the proposed estimators, derive asymptotic distributions for the selective inference targets, and obtain new consistency results for DiffNet estimation under weaker assumptions than existing methods. Simulation studies confirm the theoretical convergence rates and demonstrate accurate support recovery and robust inferential performance. An application to resting-state electroencephalography (EEG) data identifies substantial changes in both contemporaneous and Granger-causal connectivity across recording sessions.

stat.ME↗

Modelling Territorial Dynamics through Statistical Mechanics: An Application to Resident Foreign Population

This study proposes an energy-based framework for exploring local variations around observed territorial configurations in Official Statistics. The observed distribution serves as the initial reference, without assuming equilibrium. A register-derived graph represents structural similarities between municipalities, while socio-economic composite indices are synthesised through Principal Component Analysis into a univariate external field. A Continuous Ising model and a Langevin-based procedure provide complementary stochastic exploration strategies. Simulated Annealing progressively limits exploration, favouring lower-energy configurations under each specification. Recorded energy trajectories and municipal deviations characterise the resulting ensembles. Conformal Prediction provides calibrated intervals whose widths and empirical coverage describe their relationship with fixed observed municipal values under repeated subsampling. The application to resident foreign population shares in North-East Italy yields simulated municipal averages close to the observed values, but substantially different calibrated interval widths between the two procedures. Comparisons across territorial groups reveal heterogeneous associations with socio-economic profiles, without a uniform ordering of interval widths between central and peripheral municipalities. The framework connects territorial interactions, socio-economic information, and stochastic variation within an exploratory analysis. Its contribution is to examine how nearby simulated alternatives relate to the observed configuration and to formulate hypotheses about territorial heterogeneity. Further applications and sensitivity analyses would assess the robustness of these interpretations.

stat.ME↗

Parameter Estimation for Differential Equation Models Using Generalized Profiling: A Computational Tutorial

Parameter estimation connects mathematical models to real-world data and decision making across many scientific and industrial applications. Standard approaches such as maximum likelihood estimation and Markov chain Monte Carlo estimate parameters by repeatedly solving the model, which often requires numerical solutions of differential equation models. In contrast, generalized profiling (also called parameter cascading) focuses directly on the governing differential equation(s), linking the model and data through a penalized likelihood that explicitly measures both the data fit and model fit. Despite several advantages, generalized profiling is relatively rarely used in practice. This tutorial-style article outlines a set of self-directed computational exercises that facilitate skills development in applying generalized profiling to a range of ordinary differential equation models. All calculations can be repeated using reproducible open-source Jupyter notebooks that are available on GitHub.

stat.ME↗