Search arXiv⌕ Search

arXiv subjects

Maksim Kazanskii

Publications and source records attributed to Maksim Kazanskii.

2 recordsLinked to original sources

DR-SNE: Density-Regularized Stochastic Neighbor Embedding

Dimensionality-reduction methods such as t-SNE preserve local neighborhood structure but can substantially distort the local distribution of data. We introduce Density-Regularized Stochastic Neighbor Embedding (DR-SNE), which augments stochastic neighbor embedding with a regularizer that directly aligns normalized inverse-neighborhood-scale profiles between the original and embedding spaces. The resulting objective preserves relative local concentration while remaining invariant to global rescaling of the embedding. Across real and synthetic datasets, DR-SNE generally improves preservation of the targeted concentration profile while maintaining controlled levels of neighborhood fidelity. Experiments reveal a consistent empirical trade-off between concentration preservation and neighborhood fidelity as the regularization strength varies. These results position DR-SNE as a simple extension of SNE for settings in which relative variation in local concentration is an important property of the representation.

cs.LG↗

Prior Distribution and Model Confidence

We study how the training data distribution affects confidence and performance in image classification models. We introduce Embedding Density, a model-agnostic framework that estimates prediction confidence by measuring the distance of test samples from the training distribution in embedding space, without requiring retraining. By filtering low-density (low-confidence) predictions, our method significantly improves classification accuracy. We evaluate Embedding Density across multiple architectures and compare it with state-of-the-art out-of-distribution (OOD) detection methods. The proposed approach is potentially generalizable beyond computer vision.

cs.LG↗