Ultrahigh Dimensional Feature Selection via Kernel Canonical Correlation Analysis

Tianqi Liu; Kuang-Yao Lee; Hongyu Zhao

Home/Archive/arXiv

arXiv · 1604.07354

Ultrahigh Dimensional Feature Selection via Kernel Canonical Correlation Analysis

Tianqi Liu·Kuang-Yao Lee·Hongyu Zhao

View original source ↗Read source document ↗Export metadata ↓

Abstract

High-dimensional variable selection is an important issue in many scientific fields, such as genomics. In this paper, we develop a sure independence feature screening pro- cedure based on kernel canonical correlation analysis (KCCA-SIS, for short). KCCA- SIS is easy to be implemented and applied. Compared to the sure independence screen- ing procedure based on the Pearson correlation (SIS, for short) developed by Fan and Lv [2008], KCCA-SIS can handle nonlinear dependencies among variables. Compared to the sure independence screening procedure based on the distance correlation (DC- SIS, for short) proposed by Li et al. [2012], KCCA-SIS is scale free, distribution free and has better approximation results based on the universal characteristic of Gaussian Kernel (Micchelli et al. [2006]). KCCA-SIS is more general than SIS and DC-SIS in the sense that SIS and DC-SIS correspond to certain choice of kernels. Compared to supremum of Hilbert Schmidt independence criterion-Sure independence screening (sup-HSIC-SIS, for short) developed by Balasubramanian et al. [2013], KCCA-SIS is scale free removing the marginal variation of features and response variables. No model assumption is needed between response and predictors to apply KCCA-SIS and it can be used in ultrahigh dimensional data analysis. Similar to DC-SIS and sup- HSIC-SIS, KCCA-SIS can also be used directly to screen grouped predictors and for multivariate response variables. We show that KCCA-SIS has the sure screening prop- erty, and has better performance through simulation studies. We applied KCCA-SIS to study Autism genes in a spatiotemporal gene expression dataset for human brain development, and obtained better results based on gene ontology enrichment analysis comparing to the other existing methods.

Explore related subjects

stat.ME

Keep this discovery

Explore connections, maps & timelines

BibTeX RIS

Tianqi Liu, Kuang-Yao Lee, Hongyu Zhao. 2016-06-02. Ultrahigh Dimensional Feature Selection via Kernel Canonical Correlation Analysis. https://arxiv.org/abs/1604.07354

Cite the original work for its findings. Save a collection to share your selection of sources.

KEEP EXPLORING

Related papers

arXiv2026

Considerations for the Integration of Randomized Controlled Trials and Real-World Data

As clinical decision-making increasingly moves toward individualized and context-specific treatment recommendations, reliance on any single evidence source, randomized or observational, may be insufficient. Principled integration of randomized controlled trials and real-world data, grounded in explicit causal frameworks, offers a path toward evidence that is both internally credible and externally relevant. In this article, we describe distinct objectives for the integration of randomized controlled trials and real-world data and discuss how these objectives shape key design and analytic considerations, illustrating the resulting choices through example estimands. We highlight practical issues that commonly arise in applied settings, including data relevance and curation, cross-source comparability, estimand specification, and sensitivity analysis. We aim for this article to help readers evaluate and implement principled approaches to integrating randomized controlled trials and real-world data in ways that can support more reliable treatment recommendations while maintaining regulatory-grade evidentiary standards.

stat.ME↗

arXiv2026

Validity of MMRM-based hypothesis testing under missing-not-at-random mechanisms

In randomized clinical trials with longitudinal continuous outcomes, missing-not-at-random (MNAR) missingness often motivates conservative alternatives to mixed models for repeated measures (MMRM). Such caution is important for estimation, but estimation and testing need not require identical assumptions. Moreover, overly conservative primary analyses may reduce power, increase required sample size, and raise trial costs. We investigated the validity of MMRM-based testing under the global null of identical longitudinal outcome distributions across groups. Because valid testing minimally requires treatment-effect estimators to converge to the null under the null hypothesis, we investigated sufficient conditions for this property. We introduced a proportional observation condition requiring ratios of observation probabilities relative to a reference group, conditional on the full outcome vector, to be outcome-independent, and showed that, with arbitrary post-baseline visits and monotone missingness, this condition is sufficient for convergence to the null value. The condition allows observation to depend on unobserved outcomes and permits between-group differences in overall observation probabilities through outcome-independent dropout, making it clinically interpretable while accommodating outcome-dependent MNAR missingness. Synthetic and data-based bootstrap simulations showed negligible bias and empirical test sizes near 0.05, including nonmonotone missingness. Thus, MNAR missingness does not by itself imply that a more conservative primary testing procedure is required. This result does not justify treatment-effect estimation under alternatives, which still requires estimand-based interpretation and sensitivity analyses.

stat.ME↗

arXiv2026

Optimized variance estimation under interference and complex experimental designs

Unbiased and consistent variance estimators generally do not exist for design-based treatment effect estimators because experimenters never observe more than one potential outcome for any unit. The problem is exacerbated by interference and complex experimental designs. Experimenters must accept conservative variance estimators in these settings, but they can strive to minimize the conservativeness. In this paper, we show that the task of constructing a minimally conservative variance estimator can be interpreted as an optimization problem that aims to find the lowest estimable upper bound of the true variance given the experimenter's risk preferences and knowledge of the potential outcomes. We characterize the set of admissible bounds in the class of quadratic forms, and we demonstrate that the optimization problem is a convex program for many natural objectives. The resulting variance estimators are guaranteed to be conservative regardless of whether the background knowledge used to construct the bound is correct, but the estimators are less conservative if the provided information is reasonably accurate. Numerical results show that the resulting variance estimators can be considerably less conservative than existing estimators, allowing experimenters to draw more informative inferences about treatment effects.

stat.ME↗