Generalized scale behavior and renormalization group for data analysis

Abstract

Some recent results showed that renormalization group can be considered as a promising framework to address open issues in data analysis. In this work, we focus on one of these aspects, closely related to principal component analysis for the case of large dimensional data sets with covariance having a nearly continuous spectrum. In this case, the distinction between "noise-like" and "non-noise" modes becomes arbitrary and an open challenge for standard methods. Observing that both renormalization group and principal component analysis search for simplification for systems involving many degrees of freedom, we aim to use the renormalization group argument to clarify the turning point between noise and information modes. The analogy between coarse-graining renormalization and principal component analysis has been investigated in [Journal of Statistical Physics,167, Issue 3-4, pp 462-475, (2017)], from a perturbative framework, and the implementation with real sets of data by the same authors showed that the procedure may reflect more than a simple formal analogy. In particular, the separation of sampling noise modes may be controlled by a non-Gaussian fixed point, reminiscent of the behaviour of critical systems. In our analysis, we go beyond the perturbative framework using nonperturbative techniques to investigate non-Gaussian fixed points and propose a deeper formalism allowing going beyond power-law assumptions for explicit computations.