arXiv · 2604.23670
Preserve, Then Resolve: Many-to-Many Association and Robust Estimation with General-Purpose Visual Features
Abstract
The semantic transferability of general-purpose visual features does not guarantee geometric consistency across images. Using frozen DINOv3 features, we show that geometrically correct correspondences often fall below rank one in cosine similarity yet remain within a small top-$K$ candidate set. This motivates a preserve-then-resolve design: we retain multiple candidates in a many-to-many (m-to-m) association graph and defer their disambiguation to robust estimation. We study m-to-m robust estimation from a probabilistic perspective. We interpret the existing Matching Cardinality Maximization (MCM) mechanism as a dominant-cardinality approximation to likelihood maximization and propose a faster, real-valued mechanism called Harmonic Consensus Maximization (HCM). A two-stage LO-RANSAC uses HCM for candidate sourcing and MCM for graph-aware selection. We evaluate end-task gains in relative-pose estimation, where our pipeline consistently improves rank-one baselines for DINOv2, DINOv3, V-JEPA 2.1, and SigLIP 2. Code is available at https://github.com/LIAS-CUHKSZ/preserve_then_resolve.
Explore related subjects
Keep this discovery
Haodong Jiang, Mingzhe Li, Junfeng Wu. 2026-08-30. Preserve, Then Resolve: Many-to-Many Association and Robust Estimation with General-Purpose Visual Features. https://arxiv.org/abs/2604.23670
Cite the original work for its findings. Save a collection to share your selection of sources.
Discover connections
Connections use source metadata and explicit phrase matches, not verified experimental comparisons.