Search arXivSearch

arXiv · 2302.13854

A Deep Neural Network Based Reverse Radio Spectrogram Search Algorithm

Abstract

Modern radio astronomy instruments generate vast amounts of data, and the increasingly challenging radio frequency interference (RFI) environment necessitates ever-more sophisticated RFI rejection algorithms. The "needle in a haystack" nature of searches for transients and technosignatures requires us to develop methods that can determine whether a signal of interest has unique properties, or is a part of some larger set of pernicious RFI. In the past, this vetting has required onerous manual inspection of very large numbers of signals. In this paper we present a fast and modular deep learning algorithm to search for lookalike signals of interest in radio spectrogram data. First, we trained a B-Variational Autoencoder on signals returned by an energy detection algorithm. We then adapted a positional embedding layer from classical Transformer architecture to a embed additional metadata, which we demonstrate using a frequency-based embedding. Next we used the encoder component of the B-Variational Autoencoder to extract features from small (~ 715,Hz, with a resolution of 2.79Hz per frequency bin) windows in the radio spectrogram. We used our algorithm to conduct a search for a given query (encoded signal of interest) on a set of signals (encoded features of searched items) to produce the top candidates with similar features. We successfully demonstrate that the algorithm retrieves signals with similar appearance, given only the original radio spectrogram data. This algorithm can be used to improve the efficiency of vetting signals of interest in technosignature searches, but could also be applied to a wider variety of searches for "lookalike" signals in large astronomical datasets.

Explore related subjects

Keep this discovery

Explore connections, maps & timelines

BibTeXRIS

Peter Xiangyuan Ma, Steve Croft, Chris Lintott, Andrew P. V. Siemion. 2024-01-19. A Deep Neural Network Based Reverse Radio Spectrogram Search Algorithm. https://doi.org/10.1093/rasti%2Frzad056

Cite the original work for its findings. Save a collection to share your selection of sources.

KEEP EXPLORING

Related papers

Adaptive Polynomial Chaos Expansion for Uncertainty Quantification of Radio Wave Propagation over Irregular Terrains

Accurate modeling of radio wave propagation over irregular terrains is crucial for designing reliable wireless communication systems in such environments, yet uncertainties in the antenna configuration are not quantified within deterministic models. This paper develops a fixed number of samples adaptive polynomial chaos expansion (APCE) method for uncertainty quantification (UQ) of radio wave propagation over realistic irregular terrains, where the model evaluations are obtained using a two-way parabolic wave equation (PWE) method. The proposed APCE method is designed to construct a compact and stable PCE model from a prescribed and limited set of simulations. The polynomial basis is enriched using an anisotropic basis extension algorithm driven by variance contributions, while validation behavior and the available sample size are used to control basis growth. The convergence analysis shows decreasing validation errors and improved robustness as the sampling budget increases, with lower trial-to-trial variability than the baseline adaptive PCE method, which uses the same variance-driven basis extension strategy. For two realistic terrain profiles, the proposed method accurately predicts the mean and the 5-95 percentile range of the path loss, and improves the estimation of the standard deviation compared with standard and sparse PCE, using only 30 PWE simulations. APCE outperforms standard and sparse PCE, with the largest gains observed for the 5th and 95th percentile estimates, and its construction time is close to that of standard PCE and much lower than that of sparse PCE based on least angle regression. As the sample size increases, APCE maintains low errors with reduced trial-to-trial variability.

eess.SP

Overlap-Summation-Based Pulse Shaping Transceiver for Affine Frequency Division Multiplexing

Affine frequency division multiplexing (AFDM) has recently emerged as a promising waveform for doubly-selective channels. A direct-windowing-based pulse shaping transceiver (PS-AFDM) was proposed to suppress the Doppler sidelobes, thus improving the accuracy of channel estimation. We observe that, when the path delays and Doppler shifts are randomly distributed, the legacy PS-AFDM scheme significantly increases the condition number of the effective channel matrix. The resulting ill-conditioning degrades the numerical stability of channel equalization in noise and consequently increases the BER. To address this issue, this letter applies the existing weighted overlap-summation (WOLA) transceiver to AFDM and proposes a novel channel-aware (CA) receive shaping window design, which simultaneously achieves accurate channel estimation and robust equalization performance, at the cost of additional prefix overhead and receive-window calculation. The resulting scheme is termed CAWOLA-AFDM. Compared with the legacy WOLA scheme, which employs a fixed receive window, the proposed CAWOLA design exploits the channel estimates of slowly varying power gains and Doppler shifts to design a channel-tailored receive shaping window in closed form, thereby further enhancing channel-estimation accuracy while maintaining the channel condition number when a Nyquist prototype window is adopted. The proposed CAWOLA receive-window design aims to produce an effective AFDM channel with more compact support in the DAFT domain. The source code for the simulations is provided at https://github.com/SANIS-HITSZ/Waveform_AFDM.

eess.SP

Parametric Channel Estimation with Hardware Impaired Hybrid Beamformers: Sensing, Communications, and Power Efficiency Tradeoffs

Due to high power consumption and hardware costs of fully digital arrays, hybrid beamformers are often considered as a more economic alternative. Furthermore, using high resolution analog to digital converters (ADCs) can also have prohibitive power consumption, which leads to lower resolution converters being considered for radio frequency (RF) front end design. The finite quantization resolution as well as the nonlinearities caused by the power amplifiers (PAs) and low noise amplifiers (LNAs) can have a substantial impact on system performance. While widely studied for communications, the impact of hardware impairments on sensing performance is considerably less explored. In this work, we study the interplay between hybrid beamforming architectures, hardware impairments, and sensing and communications performance. Additionally, we define the concept of double-isotropy for pilot-combiner pairs, formalizing the notion of a perfectly energy-fair beam sweep. The multiple start (MS) space alternating generalized expectation maximization algorithm (SAGE) is also introduced, aimed at addressing the optimization issues arising from parametric channel estimation (PCE) in hybrid beamformed systems. We then provide a set of numerical results assessing the impacts of beamformer architecture and ADC resolution on PCE, sensing, and communications performance. The results show that medium resolution ADCs lead to the most power efficient configurations, with the best tradeoff between power consumption and performance for the majority of beamforming architectures. Additionally, fully digital beamforming architectures with high resolution converters can often be substituted for a hybrid beamformer setup with medium resolution converters without significant performance loss at a lower power consumption and overall hardware cost.

eess.SP