Model Selection and Parameter Estimation of One-Dimensional Gaussian Mixture Models

Xinyu Liu; Hai Zhang

Home/Archive/arXiv

arXiv · 2404.12613

Model Selection and Parameter Estimation of One-Dimensional Gaussian Mixture Models

Xinyu Liu·Hai Zhang

View original source ↗Read source document ↗Export metadata ↓

Abstract

In this paper, we study the problem of learning one-dimensional Gaussian mixture models (GMMs) with a specific focus on estimating both the model order and the mixing distribution from independent and identically distributed (i.i.d.) samples. This paper establishes the optimal sampling complexity for model order estimation in one-dimensional Gaussian mixture models. We prove a fundamental lower bound on the number of samples required to correctly identify the number of components with high probability, showing that this limit depends critically on the separation between component means and the total number of components. We then propose a Fourier-based approach to estimate both the model order and the mixing distribution. Our algorithm utilizes Fourier measurements constructed from the samples, and our analysis demonstrates that its sample complexity matches the established lower bound, thereby confirming its optimality. Numerical experiments further show that our method outperforms conventional techniques in terms of efficiency and accuracy.

Explore related subjects

stat.ML cs.LG eess.SP stat.ME

Keep this discovery

BibTeX RIS

Xinyu Liu, Hai Zhang. 2026-08-31. Model Selection and Parameter Estimation of One-Dimensional Gaussian Mixture Models. https://arxiv.org/abs/2404.12613

Cite the original work for its findings. Save a collection to share your selection of sources.

Discover connections

cs.LG subject eess.SP subject stat.ME subject stat.ML subject

Connections use source metadata and explicit phrase matches, not verified experimental comparisons.

KEEP EXPLORING

Related discoveries

arXiv2026

Optimal Adversarial Testing: Extracting Honest Test Results from Dishonest Test Takers

In applications, it is often required to test objects or people to determine their qualities in terms of certain metrics. However, besides being naturally noisy, the test results can be corrupted by adversarial behaviors of objects or people being tested (test takers). For example, dishonest test takers can cheat in the exams to distort the test results. With the development of AI technologies, such distortions driven by cheating using AI technologies are becoming more commonplace and severe. In this paper, we propose optimal testing strategies which can still recover needed test results even if there are cheaters polluting the results. The proposed testing strategies will optimally re-test selected group of test takers using different testing security measures. We determine the optimal testing strategies using a dynamic programming method.

cs.CR↗

arXiv2026

Observability Analysis for Fusion of Doppler Measurements in Multistatic Radar Near the Tx-Rx Baseline

This paper studies multistatic measurement fusion when a target lies within the Tx--Rx (Transmitter-Receiver) baseline ambiguity zone, with particular emphasis on configurations involving two closely spaced stationary Tx--Rx pairs. Such configurations provide overlapping detectable regions and extend the effective detection range compared with sparsely spaced multistatic systems. However, in this region, the accuracy of range and bearing measurements degrades rapidly, and Doppler measurements often remain the only reliable information source. As a result, target trajectory estimation becomes highly challenging, with observability being marginal or even completely lost. To address this problem, the observability of target trajectories is analyzed under various conditions, enabling system designers to assess system performance in advance. A Doppler-only measurement fusion approach is then developed, employing a multiple-initial-point Maximum Likelihood (ML) nonlinear estimator for initial state estimation, followed by dynamic state updates using an Extended Kalman Filter (EKF). Simulation results are presented and shown to be consistent with the observability analysis.

eess.SY↗

arXiv2024

Approaching an unknown communication system by latent space exploration and causal inference

This paper proposes a methodology for discovering meaningful properties in data by exploring the latent space of unsupervised deep generative models. We combine manipulation of individual latent variables to extreme values with methods inspired by causal inference into an approach we call causal disentanglement with extreme values (CDEV) and show that this method yields insights for model interpretability. With this, we can test for what properties of unknown data the model encodes as meaningful, using it to glean insight into the communication system of sperm whales (Physeter macrocephalus), one of the most intriguing and understudied animal communication systems. The network architecture used has been shown to learn meaningful representations of speech; here, it is used as a learning mechanism to decipher the properties of another vocal communication system in which case we have no ground truth. The proposed methodology suggests that sperm whales encode information using the number of clicks in a sequence, the regularity of their timing, and audio properties such as the spectral mean and the acoustic regularity of the sequences. Some of these findings are consistent with existing hypotheses, while others are proposed for the first time. We also argue that our models uncover rules that govern the structure of units in the communication system and apply them while generating innovative data not shown during training. This paper suggests that an interpretation of the outputs of deep neural networks with causal inference methodology can be a viable strategy for approaching data about which little is known and presents another case of how deep learning can limit the hypothesis space. Finally, the proposed approach can be extended to other architectures and datasets.

stat.ML↗