Search arXiv⌕ Search
Home/Archive/arXiv

arXiv · 2505.16320

Learning novel representations of variable sources from multi-modal $\textit{Gaia}$ data via autoencoders

P. Huijse·J. De Ridder·L. Eyer·L. Rimoldini·B. Holl·N. Chornay·J. Roquette·K. Nienartowicz·G. Jevardat de Fombelle·D. J. Fritzewski·A. Kemp·V. Vanlaer·M. Vanrespaille·H. Wang·M. I. Carnerero·C. M. Raiteri·G. Marton·M. Madarász·G. Clementini·P. Gavras·C. Aerts
View original source ↗Read source document ↗Export metadata ↓

Abstract

Gaia Data Release 3 (DR3) published for the first time epoch photometry, BP/RP (XP) low-resolution mean spectra, and supervised classification results for millions of variable sources. This extensive dataset offers a unique opportunity to study their variability by combining multiple Gaia data products. In preparation for DR4, we propose and evaluate a machine learning methodology capable of ingesting multiple Gaia data products to achieve an unsupervised classification of stellar and quasar variability. A dataset of 4 million Gaia DR3 sources is used to train three variational autoencoders (VAE), which are artificial neural networks (ANNs) designed for data compression and generation. One VAE is trained on Gaia XP low-resolution spectra, another on a novel approach based on the distribution of magnitude differences in the Gaia G band, and the third on folded Gaia G band light curves. Each Gaia source is compressed into 15 numbers, representing the coordinates in a 15-dimensional latent space generated by combining the outputs of these three models. The learned latent representation produced by the ANN effectively distinguishes between the main variability classes present in Gaia DR3, as demonstrated through both supervised and unsupervised classification analysis of the latent space. The results highlight a strong synergy between light curves and low-resolution spectral data, emphasising the benefits of combining the different Gaia data products. A two-dimensional projection of the latent variables reveals numerous overdensities, most of which strongly correlate with astrophysical properties, showing the potential of this latent space for astrophysical discovery. We show that the properties of our novel latent representation make it highly valuable for variability analysis tasks, including classification, clustering and outlier detection.

Explore related subjects

astro-ph.IMcs.LG

Keep this discovery

Explore connections, maps & timelines

BibTeXRIS

P. Huijse, J. De Ridder, L. Eyer, L. Rimoldini, B. Holl, N. Chornay, J. Roquette, K. Nienartowicz, G. Jevardat de Fombelle, D. J. Fritzewski, A. Kemp, V. Vanlaer, M. Vanrespaille, H. Wang, M. I. Carnerero, C. M. Raiteri, G. Marton, M. Madarász, G. Clementini, P. Gavras, C. Aerts. 2025-07-22. Learning novel representations of variable sources from multi-modal $\textit{Gaia}$ data via autoencoders. https://doi.org/10.1051/0004-6361%2F202554025

Cite the original work for its findings. Save a collection to share your selection of sources.

KEEP EXPLORING

Related papers

arXiv2026

GW-YOLO: Multi-transient segmentation in LIGO using computer vision

Time series data and their time-frequency representations from gravitational-wave interferometers present opportunities for artificial intelligence methods in signal and image processing, particularly for low-latency analysis. In this work, we introduce GW-YOLO, a signal and noise identification tool based on the YOLO (You Only Look Once) object detection framework. GW-YOLO identifies whether an observed transient contains noise, an astrophysical signal, or both, while providing time-frequency coordinates of detected objects through pixel-level segmentation masks. Our approach achieves a 53% detection efficiency for binary black hole signals in the signal-to-noise ratio (SNR) 12--15 range when they overlap with transient noise, increasing to more than 75% at SNR 15--18. For binary neutron star signals overlapping with transient noise, the detection efficiency reaches 57% at SNR 30--33 and 87% at SNR 39--42. To our knowledge, this is the first quantitative assessment of the ability to detect astrophysical signals overlapping with realistic instrumental noise in gravitational-wave interferometers. We also present a fully automated, low-latency pipeline that produces pixel-level segmentation masks for individual noise transients and astrophysical signals, enabling further automation of event validation and downstream noise-mitigation procedures.

astro-ph.IM↗
arXiv2026

Multi-Scale Contrastive Attention for Light-Curve Representation Learning

Current and next-generation time-domain surveys demand automated techniques capable of analyzing millions of light curves, observed in multiple filters, without relying on exhaustive human annotation or scarce spectroscopic follow-up. We present Astra-CLR, an attention-based, self-supervised contrastive learning framework which enables the representation of raw light curves into a highly discriminative latent space. Pre-trained on $\sim$2.1 million unlabeled Zwicky Transient Facility light curves, the framework utilizes partial light curves as input sequences to generate asymmetric, multi-scale temporal views (explicitly contrasting shorter sequences against longer ones) forcing the network to learn a robust "local-to-global" mapping strategy. Furthermore, we introduce a novel multi-view late fusion architecture that extends the model to efficiently handle longer light curves with larger numbers of observations while accommodating the different cadences associated with each filter. The discriminatory power of the resulting representations was evaluated by using them as input to a Multinomial Logistic Regression classifier, trained to identify 12 broad classes of variability. Final accuracy achieved $\sim 0.70$. When applying a label-efficient, partial top-layer fine-tuning strategy, the topological structure of the latent space is significantly refined, boosting results to $\sim$0.77. Astra-CLR is the first publicly available multi-filter time-series Transformer trained exclusively on real ZTF light curves. Results presented here demonstrate that it provides an ideal foundation for the development of end-to-end pipelines, taking into account color evolution and respecting the inhomogeneous nature of astronomical light curve sampling.

astro-ph.IM↗
arXiv2026

Combining astrometry with pulsar timing: the first joint analysis of very low frequency gravitational waves

The pHz to sub-nHz GW regime remains largely unexplored but is crucial for mapping the early inspiral stage of SMBHBs and probing early-Universe physics. Astrometry and pulsar timing offer orthogonal and deeply complementary secular observables to investigate this frequency band. We aim to present the first joint data analysis combining real astrometric proper motions with binary pulsar timing, to search for and constrain continuous gravitational waves (CWs) sourced by SMBHBs in the ultra-low-frequency regime ($10^{-12} \le f_{GW} \le10^{-9} Hz$). We employ a Bayesian model selection and upper limit estimation framework to combine apparent proper motion displacements of $\sim 1.5 \times 10^6$ quasars from the Gaia CRF3 catalog with the line-of-sight orbital period derivatives ($\dot{P}_b$) of 11 high-precision binary pulsars. To prevent spurious detections, we heavily model instrumental and astrophysical systematics: we propagate the Galactic potential uncertainty for pulsars via Monte Carlo simulations and perform a Vector Spherical Harmonics (VSH) decomposition up to the octupole order (l=3) for quasars. We find no statistically significant evidence for a CWs signal in the joint analysis ($\ln B_{joint} = -0.42 \pm 0.03$). In the absence of detection, we set the tightest constraints to date on CW strain in the pHz band, yielding a 95% upper limit of $h_0\le6.4x10^{-11}$ at a reference frequency of $f_{ref} = 4 \times 10^{-10}$ Hz. The combined dataset achieves full sky coverage and improves single-dataset upper limits by 20%-30%. Combining orthogonal observables successfully breaks spatial degeneracies intrinsic to isolated searches. Furthermore, forecasts from inj.-rec. indicate that with the extended temporal baseline and reduced uncertainties of the upcoming Gaia DR4, this joint framework is poised to break the $h_0 < 10^{-11}$ upper limit barrier for sub-nHz CWs.

astro-ph.IM↗