Search arXiv⌕ Search

arXiv subjects

Deep Chatterjee

Publications and source records attributed to Deep Chatterjee.

At least 19 recordsLinked to original sources
arXiv2026

AI-enabled gravitational-waves searches for binary neutron stars at optimal sensitivity

Gravitational Waves (GWs) represent the newest window of astronomy, furthering our understanding of compact objects like black holes and neutron stars in the Universe. The signal from two merging neutron stars is especially interesting since it brings the prospect of concordant electromagnetic and neutrino emissions. Such multi-messenger observations have a transformational impact on fundamental physics, nuclear matter, astrophysics, and gravity. It was first witnessed in 2017 with the detection of the binary neutron star (BNS) merger GW170817. However, searching for BNS signals in real-time in the LIGO-Virgo-KAGRA (LVK) GW detectors presents a computational challenge, as the data streaming out must be matched against $\sim$ million reference waveforms, which requires up to a thousand CPU cores. We present a different approach using neural networks to learn the presence of a signal in the data. Our algorithm, called Aframe, was deployed in the LVK's fourth observing run and was the first artificial intelligence (AI)-enabled search to detect multiple binary black holes (BBHs) live. In this work, we demonstrate that the approach extends to the lower-mass BNS regime, and is the first AI-enabled search that achieves sensitivity comparable to matched-filter pipelines at lower computational and latency costs. The challenge of the longer-duration BNS signals is addressed by heterodyning the data, following which the network architecture used for BBHs is sufficient to distinguish signal versus background. We also show that this analysis requires a single non-flagship GPU for online deployment. Furthermore, the design and adoption of inference-as-a-service tools allow rapid offline analysis using a distributed pool of GPU resources. Hence, aside from the use case of rapid online data analysis, we also establish the use of Aframe for efficient archival data analysis.

astro-ph.HE↗
arXiv2025

Likelihood-free inference for gravitational-wave data analysis and public alerts

Rapid and reliable detection and dissemination of source parameter estimation data products from gravitational-wave events, especially sky localization, is critical for maximizing the potential of multi-messenger astronomy. Machine learning based detection and parameter estimation algorithms are emerging as production ready alternatives to traditional approaches. Here, we report validation studies of AMPLFI, a likelihood-free inference solution to low-latency parameter estimation of binary black holes. We use simulated signals added into data from the LIGO-Virgo-KAGRA's (LVK's) third observing run (O3) to compare sky localization performance with BAYESTAR, the algorithm currently in production for rapid sky localization of candidates from matched-filter pipelines. We demonstrate sky localization performance, measured by searched area and volume, to be equivalent with BAYESTAR. We show accurate reconstruction of source parameters with uncertainties for use distributing low-latency coarse-grained chirp mass information. In addition, we analyze several candidate events reported by the LVK in the third gravitational-wave transient catalog (GWTC-3) and show consistency with the LVK's analysis. Altogether, we demonstrate AMPLFI's ability to produce data products for low-latency public alerts.

gr-qc↗
arXiv2025

Compact Binary Coalescence Sensitivity Estimates with Injection Campaigns during the LIGO-Virgo-KAGRA Collaborations' Fourth Observing Run

We describe the effort to characterize gravitational-wave searches and detector sensitivity to different types of compact binary coalescences during the LIGO-Virgo-KAGRA Collaborations' fourth observing run. We discuss the design requirements and example use cases for this data product, constructed from $> 4.33\times10^8$ injections during O4a alone. We also identify subtle effects with high confidence, like diurnal duty cycles within detectors. This paper accompanies a public data release of the curated injection set, and the appendixes give detailed examples of how to use the publicly available data.

gr-qc↗
arXiv2025

A machine learning-enabled search for binary black hole mergers in LIGO-Virgo-KAGRAs third observing run

We conduct a search for stellar-mass binary black hole mergers in gravitational-wave data collected by the LIGO detectors during the LIGO-Virgo-KAGRA (LVK) third observing run (O3). Our search uses a machine learning (ML) based method, Aframe, an alternative to traditional matched filtering search techniques. The O3 observing run has been analyzed by the LVK collaboration, producing GWTC-3, the most recent catalog installment which has been made publicly available in 2021. Various groups outside the LVK have re-analyzed O3 data using both traditional and ML-based approaches. Here, we identify 38 candidates with probability of astrophysical origin ($p_\mathrm{astro}$) greater than 0.5, which were previously reported in GWTC-3. This is comparable to the number of candidates reported by individual matched-filter searches. In addition, we compare Aframe candidates with catalogs from research groups outside of the LVK, identifying three candidates with $p_\mathrm{astro} > 0.5$. No previously un-reported candidates are identified by Aframe. This work demonstrates that Aframe, and ML based searches more generally, are useful companions to matched filtering pipelines.

astro-ph.IM↗
arXiv2024

A Neural Network-Based Search for Unmodeled Transients in LIGO-Virgo-KAGRA's Third Observing Run

This paper presents the results of a Neural Network (NN)-based search for short-duration gravitational-wave transients in data from the third observing run of LIGO, Virgo, and KAGRA. The search targets unmodeled transients with durations of milliseconds to a few seconds in the 30-1500 Hz frequency band, without assumptions about the incoming signal direction, polarization, or morphology. Using the Gravitational Wave Anomalous Knowledge (GWAK) method, three compact binary coalescences (CBCs) identified by existing pipelines are successfully detected, along with a range of detector glitches. The algorithm constructs a low-dimensional embedded space to capture the physical features of signals, enabling the detection of CBCs, detector glitches, and unmodeled transients. This study demonstrates GWAK's ability to enhance gravitational-wave searches beyond the limits of existing pipelines, laying the groundwork for future detection strategies.

gr-qc↗
arXiv2024

What to expect: kilonova light curve predictions via equation of state marginalization

Efficient multi-messenger observations of gravitational-wave candidates from compact binary coalescence candidate events rely on data products reported in low-latency by the International Gravitational-wave Network (IGWN). While data products such as $\texttt{HasNS}$, the probability of at least one neutron star, and $\texttt{HasRemnant}$, the probability of remnant matter forming after merger, exist, these are not direct observables for a potential kilonova. Here, we present new kilonova light curve and ejecta mass data products derived from merger quantities measured in low latency, by marginalizing over our uncertainty in our understanding of the neutron star equation of state and using measurements of the source properties of the merger, including masses and spins. Two additional types of data products are proposed. The first is the probability of a candidate event having mass ejecta ($m_{\mathrm{ej}}$) greater than $10^{-3} M_\odot$, which we denote as $\texttt{HasEjecta}$. The second are $m_{\mathrm{ej}}$ estimates and accompanying $\texttt{ugrizy}$ and $\texttt{HJK}$ kilonova light curves predictions produced from a surrogate model trained on a grid of kilonova light curves from $\texttt{POSSIS}$, a time-dependent, three-dimensional Monte Carlo radiative transfer code. We are developing these data products in the context of the IGWN low-latency alert infrastructure, and will be advocating for their use and release for future detections.

astro-ph.HE↗
arXiv2024

Kilonova Light Curve Parameter Estimation Using Likelihood-Free Inference

Rapid parameter estimation is critical when dealing with short lived signals such as kilonovae. We present a parameter estimation algorithm that combines likelihood-free inference with a pre-trained embedding network, optimized to efficiently process kilonova light curves. Our method is capable of retrieving the mass, velocity, and lanthanide fraction of the neutron star ejecta with an accuracy and precision on par with nested sampling methods while taking significantly less computational time. Our inference uniquely utilizes a pre-trained embedding network that marginalizes the time of arrival and the luminosity distance of the signal, allowing inference of signals at distances up to 200 Mpc. We find that including a pre-trained embedding outperforms the use of likelihood-free inference alone, reducing training time, model size, and offering the capability to marginalize over certain nuisance parameters. This framework has been integrated into the publicly available Nuclear Multi-Messenger Astronomy codebase, enabling the broader scientific community to deploy the model for their inference purposes. Our algorithm is broadly applicable to parameterized or simulated light curves of other transient objects, and can be adapted for quick sky localization.

astro-ph.IM↗
arXiv2024

Rapid Likelihood Free Inference of Compact Binary Coalescences using Accelerated Hardware

We report a gravitational-wave parameter estimation algorithm, AMPLFI, based on likelihood-free inference using normalizing flows. The focus of AMPLFI is to perform real-time parameter estimation for candidates detected by machine-learning based compact binary coalescence search, Aframe. We present details of our algorithm and optimizations done related to data-loading and pre-processing on accelerated hardware. We train our model using binary black-hole (BBH) simulations on real LIGO-Virgo detector noise. Our model has $\sim 6$ million trainable parameters with training times $\lesssim 24$ hours. Based on online deployment on a mock data stream of LIGO-Virgo data, Aframe + AMPLFI is able to pick up BBH candidates and infer parameters for real-time alerts from data acquisition with a net latency of $\sim 6$s.

gr-qc↗
arXiv2024

A machine-learning pipeline for real-time detection of gravitational waves from compact binary coalescences

The promise of multi-messenger astronomy relies on the rapid detection of gravitational waves at very low latencies ($\mathcal{O}$(1\,s)) in order to maximize the amount of time available for follow-up observations. In recent years, neural-networks have demonstrated robust non-linear modeling capabilities and millisecond-scale inference at a comparatively small computational footprint, making them an attractive family of algorithms in this context. However, integration of these algorithms into the gravitational-wave astrophysics research ecosystem has proven non-trivial. Here, we present the first fully machine learning-based pipeline for the detection of gravitational waves from compact binary coalescences (CBCs) running in low-latency. We demonstrate this pipeline to have a fraction of the latency of traditional matched filtering search pipelines while achieving state-of-the-art sensitivity to higher-mass stellar binary black holes.

gr-qc↗
arXiv2024

Neural post-Einsteinian framework for efficient theory-agnostic tests of general relativity with gravitational waves

The parametrized post-Einsteinian (ppE) framework and its variants are widely used to probe gravity through gravitational-wave tests that apply to a large class of theories beyond general relativity. However, the ppE framework is not truly theory-agnostic as it only captures certain types of deviations from general relativity: those that admit a post-Newtonian series representation in the inspiral of coalescing compact objects. Moreover, each type of deviation in the ppE framework has to be tested separately, making the whole process computationally inefficient and expensive, possibly obscuring the theoretical interpretation of potential deviations that could be detected in the future. We here present the neural post-Einsteinian (npE) framework, an extension of the ppE formalism that overcomes the above weaknesses using deep-learning neural networks. The core of the npE framework is a variational autoencoder that maps the discrete ppE theories into a continuous latent space in a well-organized manner. This design enables the npE framework to test many theories simultaneously and to select the theory that best describes the observation in a single parameter estimation run. The smooth extension of the ppE parametrization also allows for more general types of deviations to be searched for with the npE model. We showcase the application of the new npE framework to future tests of general relativity with the fifth observing run of the LIGO-Virgo-KAGRA collaboration. In particular, the npE framework is demonstrated to efficiently explore modifications to general relativity beyond what can be mapped by the ppE framework, including modifications coming from higher-order curvature corrections to the Einstein-Hilbert action at high post-Newtonian order, and dark-photon interactions in possibly hidden sectors of matter that do not admit a post-Newtonian representation.

gr-qc↗
arXiv2023

Optimizing Likelihood-free Inference using Self-supervised Neural Symmetry Embeddings

Likelihood-free inference is quickly emerging as a powerful tool to perform fast/effective parameter estimation. We demonstrate a technique of optimizing likelihood-free inference to make it even faster by marginalizing symmetries in a physical problem. In this approach, physical symmetries, for example, time-translation are learned using joint-embedding via self-supervised learning with symmetry data augmentations. Subsequently, parameter inference is performed using a normalizing flow where the embedding network is used to summarize the data before conditioning the parameters. We present this approach on two simple physical problems and we show faster convergence in a smaller number of parameters compared to a normalizing flow that does not use a pre-trained symmetry-informed representation.

cs.LG↗
arXiv2023

Predictions for Electromagnetic Counterparts to Neutron Star Mergers Discovered during LIGO-Virgo-KAGRA Observing Runs 4 and 5

We present a comprehensive, configurable open-source framework for estimating the rate of electromagnetic detection of kilonovae (KNe) associated with gravitational wave detections of binary neutron star (BNS) mergers. We simulate the current LIGO-Virgo-KAGRA (LVK) observing run (O4) using up-to-date sensitivity and up-time values as well as the next observing run (O5) using predicted sensitivities. We find the number of discoverable kilonovae during LVK O4 to be ${ 1}_{- 1}^{+ 4}$ or ${ 2 }_{- 2 }^{+ 3 }$, (at 90% confidence) depending on the distribution of NS masses in coalescing binaries, with the number increasing by an order of magnitude during O5 to ${ 19 }_{- 11 }^{+ 24 }$. Regardless of mass model, we predict at most five detectable KNe (at 95% confidence) in O4. We also produce optical and near-infrared light curves that correspond to the physical properties of each merging system. We have collated important information for allocating observing resources and directing search and follow-up observations including distributions of peak magnitudes in several broad bands and timescales for which specific facilities can detect each KN. The framework is easily adaptable, and new simulations can quickly be produced as input information such as merger rates and NS mass distributions are refined. Finally, we compare our suite of simulations to the thus-far completed portion of O4 (as of October 14, 2023), finding a median number of discoverable KNe of 0 and a 95-percentile upper limit of 2, consistent with no detection so far in O4.

astro-ph.HE↗
arXiv2023

GWAK: Gravitational-Wave Anomalous Knowledge with Recurrent Autoencoders

Matched-filtering detection techniques for gravitational-wave (GW) signals in ground-based interferometers rely on having well-modeled templates of the GW emission. Such techniques have been traditionally used in searches for compact binary coalescences (CBCs), and have been employed in all known GW detections so far. However, interesting science cases aside from compact mergers do not yet have accurate enough modeling to make matched filtering possible, including core-collapse supernovae and sources where stochasticity may be involved. Therefore the development of techniques to identify sources of these types is of significant interest. In this paper, we present a method of anomaly detection based on deep recurrent autoencoders to enhance the search region to unmodeled transients. We use a semi-supervised strategy that we name Gravitational Wave Anomalous Knowledge (GWAK). While the semi-supervised nature of the problem comes with a cost in terms of accuracy as compared to supervised techniques, there is a qualitative advantage in generalizing experimental sensitivity beyond pre-computed signal templates. We construct a low-dimensional embedded space using the GWAK method, capturing the physical signatures of distinct signals on each axis of the space. By introducing signal priors that capture some of the salient features of GW signals, we allow for the recovery of sensitivity even when an unmodeled anomaly is encountered. We show that regions of the GWAK space can identify CBCs, detector glitches and also a variety of unmodeled astrophysical sources.

astro-ph.IM↗
arXiv2023

Low-latency gravitational wave alert products and their performance at the time of the fourth LIGO-Virgo-KAGRA observing run

Multi-messenger searches for BNS and NSBH mergers are currently one of the most exciting areas of astronomy. The search for joint electromagnetic and neutrino counterparts to GWs has resumed with O4. To support this effort, public semi-automated data products are sent in near real-time and include localization and source properties to guide complementary observations. In preparation for O4, we have conducted a study using a simulated population of compact binaries and a MDC in the form of a real-time replay to optimize and profile the software infrastructure and scientific deliverables. End-to-end performance was tested, including data ingestion, running online search pipelines, performing annotations, and issuing alerts to the astrophysics community. We present an overview of the low-latency infrastructure and the performance of the data products that are now being released during O4 based on the MDC. We report the expected median latency for the preliminary alert of full bandwidth searches (29.5s) and show consistency and accuracy of released data products using the MDC. For the first time, we report the expected median latency for triggers from early warning searches (-3.1s), which are new in O4 and target neutron star mergers during inspiral phase. This paper provides a performance overview for LVK low-latency alert infrastructure and data products using the MDC and serves as a useful reference for the interpretation of O4 detections.

astro-ph.HE↗
arXiv2023

Demonstration of Machine Learning-assisted real-time noise regression in gravitational wave detectors

Real-time noise regression algorithms are crucial for maximizing the science outcomes of the LIGO, Virgo, and KAGRA gravitational-wave detectors. This includes improvements in the detectability, source localization and pre-merger detectability of signals thereby enabling rapid multi-messenger follow-up. In this paper, we demonstrate the effectiveness of \textit{DeepClean}, a convolutional neural network architecture that uses witness sensors to estimate and subtract non-linear and non-stationary noise from gravitational-wave strain data. Our study uses LIGO data from the third observing run with injected compact binary signals. As a demonstration, we use \textit{DeepClean} to subtract the noise at 60 Hz due to the power mains and their sidebands arising from non-linear coupling with other instrumental noise sources. Our parameter estimation study on the injected signals shows that \textit{DeepClean} does not do any harm to the underlying astrophysical signals in the data while it can enhances the signal-to-noise ratio of potential signals. We show that \textit{DeepClean} can be used for low-latency noise regression to produce cleaned output data at latencies $\sim 1-2$\, s. We also discuss various considerations that may be made while training \textit{DeepClean} for low latency applications.

gr-qc↗
arXiv2023

Applications of Deep Learning to physics workflows

Modern large-scale physics experiments create datasets with sizes and streaming rates that can exceed those from industry leaders such as Google Cloud and Netflix. Fully processing these datasets requires both sufficient compute power and efficient workflows. Recent advances in Machine Learning (ML) and Artificial Intelligence (AI) can either improve or replace existing domain-specific algorithms to increase workflow efficiency. Not only can these algorithms improve the physics performance of current algorithms, but they can often be executed more quickly, especially when run on coprocessors such as GPUs or FPGAs. In the winter of 2023, MIT hosted the Accelerating Physics with ML at MIT workshop, which brought together researchers from gravitational-wave physics, multi-messenger astrophysics, and particle physics to discuss and share current efforts to integrate ML tools into their workflows. The following white paper highlights examples of algorithms and computing frameworks discussed during this workshop and summarizes the expected computing needs for the immediate future of the involved fields.

hep-ex↗
arXiv2022

Breaking bad degeneracies with Love relations: Improving gravitational-wave measurements through universal relations

The distance-inclination degeneracy limits gravitational-wave parameter estimation of compact binary mergers. Although the degeneracy can be partially broken by including higher-order modes or precession, these effects are suppressed in binary neutron stars. In this work, we implement a new parametrization of the tidal effects in the binary neutron-star waveform, exploiting the binary Love relations, that breaks the distance-inclination degeneracy. The binary Love relations prescribe the tidal deformability of a neutron star as a function of its source-frame mass in an equation-of-state insensitive way and, thus, allows direct measurement of the redshift of the source. If the cosmological parameters are assumed to be known, the redshift can be converted to a luminosity distance, and the distance-inclination degeneracy can thus be broken. We implement this new approach, studying a range of binary neutron-star observing scenarios using Bayesian parameter estimation on synthetic data. In the era of the third-generation detectors, for observations with signal-to-noise ratios ranging from 6 to 167, we forecast up to an $\sim70\%$ decrease in the $90\%$ credible interval of the distance and inclination and up to an $\sim50\%$ decrease in that of the source-frame component masses. For edge-on systems, our approach can result in moderate ($\sim50\%$) improvement in the measurements of distance and inclination for binaries with a signal-to-noise ratio as low as 10. This prescription can be used to better infer the source-frame masses and, hence, refine population properties of neutron stars, such as their maximum mass, impacting nuclear astrophysics. When combined with the search for electromagnetic counterpart observations, the work presented here can be used to put improved bounds on the opening angle of jets from binary neutron-star mergers.

gr-qc↗
arXiv2022

The Simulated Catalogue of Optical Transients and Correlated Hosts (SCOTCH)

As we observe a rapidly growing number of astrophysical transients, we learn more about the diverse host galaxy environments in which they occur. Host galaxy information can be used to purify samples of cosmological Type Ia supernovae, uncover the progenitor systems of individual classes, and facilitate low-latency follow-up of rare and peculiar explosions. In this work, we develop a novel data-driven methodology to simulate the time-domain sky that includes detailed modeling of the probability density function for multiple transient classes conditioned on host galaxy magnitudes, colours, star formation rates, and masses. We have designed these simulations to optimize photometric classification and analysis in upcoming large synoptic surveys. We integrate host galaxy information into the SNANA simulation framework to construct the Simulated Catalogue of Optical Transients and Correlated Hosts (SCOTCH), a publicly-available catalogue of 5 million idealized transient light curves in LSST passbands and their host galaxy properties over the redshift range $0<z<3$. This catalogue includes supernovae, tidal disruption events, kilonovae, and active galactic nuclei. Each light curve consists of true top-of-the-galaxy magnitudes sampled with high ($\lesssim$2 day) cadence. In conjunction with SCOTCH, we also release an associated set of tutorials and the transient-specific libraries to enable simulations of arbitrary space- and ground-based surveys. Our methodology is being used to test critical science infrastructure in advance of surveys by the Vera C. Rubin Observatory and the Nancy G. Roman Space Telescope.

astro-ph.IM↗