Nonlinear Tensor Decomposition for Pattern Discovery

Abstract

The CANDECOMP/PARAFAC (CP) decomposition is widely used for revealing the underlying patterns from multiway data (also referred to as a higher-order tensor). When the data is clipped or saturated, however, the linear CP model becomes unreliable. Several remedies exist such as treating the clipped entries as missing or imputation; however, both fall short in different scenarios. We propose a nonlinear CP model (NCP) for pattern discovery in this setting, extending ideas from nonlinear matrix decompositions to tensors, and solve it using a flexible ADMM (Alternating Direction Method of Multipliers)-based framework that can accommodate a variety of nonlinearities. Using synthetic data with known factors and simulated metabolomics data where clipping arises from instrument detection limits, we demonstrate that NCP recovers the underlying factors more accurately than CP fitted to only the observed entries or threshold-imputed data.